National Consultant cum Evaluator, Terminal Evaluation
Contract
This is a National Consultant contract. More about National Consultant contracts.
Background
In accordance with 2016 UNDP Evaluation Policy, UNDP Country Office in Malaysia is commissioning a terminal evaluation upon completion of a UNDP-supported Government-financed project implementation under the Country Programme Action Plan (CPAP) 2016 – 2020. This terms of reference (TOR) sets out the expectations for a Terminal Evaluation (TE) of the project titled Implementing the National Sustainable Consumption and Production Blueprint through Government Green Procurement (SCP-GGP).
The details of the SCP-GGP project to be evaluated are as follows:
Project Summary Table
Project Title:
Implementing the National Sustainable Consumption and Production Blueprint through Government Green Procurement (SCP-GGP)
ATLAS Project ID:
00094672
at endorsement (US$)
at completion (US$)
ATLAS Output ID:
00098761
Government financing (government cost-sharing):
374,920
To be confirmed (TBC) during TE
Country:
Malaysia
UNDP TRAC:
25,080
TBC during TE
Region:
Asia
Other:
250,000 (in-kind contribution)
100,000 (donors/private sector)
TBC during TE
CPAP Outcome:
2.0 Implementation of a national development agenda that enables green growth through climate-resilient measures, sustainable management of energy and natural resources, and improved risk governance.
Total co-financing:
350,000
TBC during TE
11th Malaysia Plan Linkage:
Strategic Thrust 4: Pursuing Green Growth for Sustainability and Resilience
Focus Area B: Adopting the Sustainable Consumption and Production Concept
Strategy B1: Creating Green Markets
Total Project Cost (government + UNDP):
400,000
TBC during TE
Implementing Partner:
Environment and Natural Resource Economics Section, Economic Planning Unit, Prime Minister’s Department Malaysia
Project Document (ProDoc) Signature
(date project began):
6 July 2018
(Operational) Closing Date:
Proposed:
31 December 2020
Actual:
31 December 2020
(Operational) Closing Date:
Proposed:
31 December 2020
Actual:
31 December 2020
Duties and Responsibilities
OBJECTIVE & SCOPE
The project was designed to provide incremental support that will lead to the full adoption and implementation of the National Sustainable Consumption and Production (SCP) Blueprint, particularly through SCP Pathway 1 Government Green Procurement (GGP); to achieve the 11th Malaysia Plan’s target of 20% of selected groups of products and services in government procurement to be green procurement by year 2020. The project has three main outputs namely:
- Enabling policy and institutions institutionalized for National SCP Blueprint and GGP implementation.
- Technical and institutional capacity for SCP and GGP built and enhanced, particularly government procurement practitioners and industry players such as Small and Medium Enterprise (SME).
- Best practices of GGP are demonstrated by developing and piloting product criteria, guidelines and standard operating procedures in construction sector, and monitoring & evaluation system.
These outputs will in turn contribute to the achievement of the 11th Malaysia Plan Strategic Thrust 4 Pursuing Green Growth for Sustainability and Resilience, and Country Programme Action Plan 2016 – 2020 between Government of Malaysia and UNDP – Outcome 2 Enhancing national resiliency to climate variability and change.
The TE will be conducted according to the guidance, rules and procedures established by UNDP as reflected in the UNDP Evaluation Guidelines.
The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming.
EVALUATION APPROACH AND METHOD
An overall approach and method[1] (For additional information on methods, see the Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 7, pg. 163) for conducting project terminal evaluations of UNDP supported projects has developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Evaluation Guidelines (http://web.undp.org/evaluation/guideline/) and UNDP Guidance for Conducting Terminal Evaluations of UNDP-supported, GEF-financed Projects. The National Consultant cum Evaluator is expected to prepare, amend, complete and submit a set of questions covering each of these criteria in consultation with UNDP Malaysia Country Office; as part of an evaluation inception report, and shall include it as an annex to the final report.
The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular, Economic Planning Unit – the implementing partner, UNDP Country Office, project team, and key stakeholders. Interviews will be held with the following organizations and individuals at a minimum:
- Environment and Natural Resource Economics Division, Economic Planning Unit at the Prime Minister’s Department
- Ministry of Finance Malaysia
- Ministry of Environment and Water (KASA)
- Ministry of Energy and Natural Resources (KeTSA)
- Malaysia Green Technology and Climate Change Centre (MGTC)
- Public Works Department (JKR)
- Universiti Technology MARA (UiTM)
- Institute of Strategic and International Studies (ISIS) Malaysia
The evaluator will review all relevant sources of information, such as the project document, project reports – including Mid-Year Progress Report, Annual Progress Report, project budget revisions, project files, national policy and strategic documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex A of this Terms of Reference.
EVALUATION CRITERIA & RATINGS
An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework in the Project Document (which is available at https://open.undp.org/projects/00094672), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary. The obligatory rating scales are included in Annex B.
Evaluation Ratings:
1. Monitoring and Evaluation
rating
2. IA& EA Execution
rating
M&E design at entry
Quality of UNDP Oversight and Quality Assurance (QA)
M&E Plan Implementation
Quality of Implementing Partner’s Execution
Overall quality of M&E
Overall quality of Oversight & QA and Execution
3. Assessment of Outcomes
rating
4. Sustainability
rating
Relevance
Financial resources:
Effectiveness
Socio-political:
Efficiency
Institutional framework and governance:
Overall Project Outcome Rating
Environmental:
Overall likelihood of sustainability:
PROJECT FINANCE/ CO-FINANCE
The Evaluation will assess the key financial aspects of the project, including the extent of co-financing planned and realized. Project cost and funding data will be required, including annual expenditures. Variances between planned and actual expenditures will need to be assessed and explained. Results from recent financial audits, as available, should be taken into consideration. The evaluator will receive assistance from the Country Office (CO) and Project Team to obtain financial data in order to complete the co-financing table below, which will be included in the terminal evaluation report.
Co-financing
(type/source)
UNDP financing (TRAC) (US$)
Government Cost-Sharing
(US$)
Others
(US$)
Total
(US$)
Planned
Actual
Planned
Actual
Planned
Actual
Actual
Actual
Grants
In-kind contribution
Other
Total
MAINSTREAMING
UNDP supported projects are key components in UNDP country programming, as well as regional and global programmes. The evaluation will assess the extent to which the project was successfully mainstreamed with other UNDP priorities, including poverty alleviation, improved governance, the prevention and recovery from natural disasters, and gender.
IMPACT
The evaluator will assess the extent to which the project is achieving impacts or progressing towards the achievement of impacts. Key findings that should be brought out in the evaluations include whether the project has demonstrated: a) verifiable improvements in the implementation of the National Sustainable Consumption and Production Blueprint through government green procurement, and b) demonstrated progress towards these impact achievements.
Conclusions, recommendations & lessons
The evaluation report must include a chapter providing a set of conclusions, recommendations and lessons.
IMPLEMENTATION ARRANGEMENTS
The principal responsibility for managing this evaluation resides with the UNDP Country Office (CO) in Malaysia. The UNDP CO will contract the evaluator and ensure the timely coordination of meeting arrangements within the country for the evaluator. The Project Team will be responsible for liaising with the Evaluator to set up stakeholder interviews, arrange meetings, coordinate with the Government etc.
EVALUATION TIMEFRAME
The total duration of the evaluation will be 30 days according to the following plan:
Activity
Timing
Completion Date
Preparation including TE Inception Report with detailed work plan
5 days
18 December 2020
Evaluation Mission
10 days
15 January 2021
Draft Evaluation Report
12 days
31 January 2021
Final Report
3 days
12 February 2021
EVALUATION DELIVERABLES
The evaluation team is expected to deliver the following:
Deliverable
Content
Timing
Responsibilities
Inception Report including detailed work plan
Evaluator provides clarifications on timing and method
No later than 2 weeks before the evaluation mission.
Evaluator submits to UNDP CO
Presentation
Initial Findings
End of evaluation mission
To project management and UNDP CO
Draft Final Report
Full report, (per annexed template) with annexes
Within 3 weeks of the evaluation mission
Sent to CO for review
Final Report*
Revised report
Within 1 week of receiving UNDP comments on draft
Sent to CO for uploading to UNDP ERC.
*When submitting the final evaluation report, the evaluator is required also to provide an 'audit trail', detailing how all received comments have (and have not) been addressed in the final evaluation report.
PAYMENT SCHEDULE
%
Milestone
20%
Following submission and approval of the detailed work plan and inception report by UNDP CO
50%
Following submission and approval of the 1st draft terminal evaluation report by UNDP CO
30%
Following submission and approval of the final terminal evaluation report by UNDP CO
Competencies
Corporate competencies
- Commitment to UNDP’s mission, vision, values and ethical standards
- Sensitivity to cultural, gender, religion, race, nationality and age differences
- Treat all stakeholders fairly and without prejudice
- Maintains objectivity and impartiality in handling evaluation processes
Functional competencies
- Experience in project development, implementation and evaluation particularly in directly managing results-based monitoring and evaluation methodologies
- Demonstrated experience in conducting evaluation of multi-year and multi-component programmes and projects
- Familiarity with the norms and issues in sustainable consumption and production
- Demonstrated strong coordination and facilitation skills
- Strong interpersonal skills and the ability to initiate discussions with national/local governmental officials, civil society organizations and communities
- Demonstrated ability to function in a team environment and to deal with complex multi-stakeholder environment
- Demonstrated ability to prepare and present comprehensive reports
Required Skills and Experience
The National Consultant shall have prior experience in evaluating similar projects. Experience with UNDP-supported projects is an advantage. The evaluator selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities. The evaluator must present the following qualifications:
Education:
- Minimum 10 years of relevant professional experience in the field of environment (10 points);
Experience:
- Minimum 5 years of experience with results-based monitoring and evaluation methodologies (25 points);
- Technical knowledge in the sustainable consumption and production, sustainable and/or green procurement, circular economy, green economy/growth, etc. (25 points);
- Knowledge of UNDP and Government of Malaysia (10 points).
Language:
Language required for this assignment is English and Malay.
EVALUATOR ETHICS
Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct (Annex C to be provided by UNDP) upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations'
DOCUMENTS TO BE INCLUDED WHEN SUBMITTING THE PROPOSALS
Interested individual applicants must submit the following documents/information to demonstrate their qualifications:
- Document 1 : Letter of Confirmation of Interest and Availability at http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Letter%20of%20Interest%20_Annex%201.docx?download;
- Document 2: Technical Proposal: on how your qualifications, experience and list of track records can lead to successful deliverables of this assignment within the required timeframe, and provide a methodology and approach on how you will approach and conduct the assignments; and
- Document 3: Financial Proposal at https://www.my.undp.org/content/dam/malaysia/docs/Procurement/Financial Proposal Template (Daily Fee) - MYR.doc .All inclusive and takes into account various expenses the candidate expects to incur during the contract, including:
- The daily professional fee;
- The cost of travel from the home base to the duty station (UNDP Office, Putrajaya) and vice versa;
- Communications, utilities and consumables; and
- Life, health and any other insurance.
- Document 4: Personal CV or P11 including areas of expertise and past experiences in similar projects and at least three (3) references at http://www.my.undp.org/content/dam/malaysia/docs/Procurement/P11%20for%20SC%20&%20IC.doc?download
- Please submit this information in one file as Document 1, 2, 3 and 4.The system will only accept one attachment , please merge all documents and submit as one file.
- Applicants must reply to the mandatory questions asked by the system when submitting the application.
- Candidates who fail to submit all the information requested above will be disqualified.
How to Apply:
- Kindly download the Letter of Confirmation of interest and availability, Financial Proposal Template and General Terms & Conditions mentioned below;
- Read and agree to the General Terms & Conditions (refer to below link);
- Click the ‘apply’ icon and complete what is required;
- Scan all documents into 1 pdf folder and then upload;
- For clarification question, please email to [email protected]. The clarification question deadline is three (3) days before the closing. When emailing for clarification questions, please put "MyIC/2020/063"as the subject matter.
General terms & conditions to be downloaded:
- The General Terms & Conditions for Individual contract is available at: http://www.my.undp.org/content/dam/malaysia/docs/Procurement/General%20Conditions%20of%20Contract%20for%20IC.pdf?download
Reimbursable Loan Agreement (RLA): A legal instrument between UNDP and a Company/institution, according to which, the latter makes available the services of an individual delivering time-bound and quantifiable outputs that are directly linked to payments
- The General Terms & Conditions for Reimbursement Loan Agreement is available at:http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Reimbursable%20Loan%20Agreement%20_%20Terms%20&%20Conditions.pdf?download?
ANNEXES
1. Annex A: List of Documents to be received by the Evaluators, http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex A List of Documents to be revieced by the Evaluators.pdf
2. Annex B: Rating Scales, http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20B%20Rating%20Scales.pdf
3. Annex C: Evaluation Consultant Code of Conduct and Agreement Form http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex C Evaluation Consultant Code of Conduct and Agreement Form.pdf
4. Annex D: Evaluation Report Outline, http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20D%20Evaluation%20Report%20Outline.pdf
5. Annex E: Evaluation Report Clearance Form. http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20E%20Evaluation%20Report%20Clearance%20Form.pdf
EVALUATION METHOD AND AWARD OF CONTRACT
- Only those applications which are responsive and compliant will be shortlisted for technical evaluation;
- Offers will be evaluated according to the Combined Scoring method – where the technical criteria will be weighted at 70% and the financial offer will be weighted at 30%;
- The technical criteria including education, experience and written test will be based on a maximum 70 points. Only the top 3 candidates scoring 50 points or higher from the technical proposal review will be considered for financial evaluation;
- Financial score (max 30 points) shall be computed as a ratio of the proposal being evaluated and the lowest priced proposal of those technically qualified;
- The financial proposal shall specify an all-inclusive fee and including breakdown per deliverable and all costs components required to perform the deliverables identified in the TOR, including professional fee, in-country travel costs, living allowance and any other applicable cost to be incurred by the National Consultant in completing the assignment. In order to assist the requesting unit in the comparison of financial proposals, the financial proposal must additionally include a breakdown of this daily fee (including number of anticipated working days and all foreseeable expenses to carry out the assignment);
- Applicant receiving the Highest Combined Score and has accepted UNDP’s General Terms and Conditions will be awarded the contract.
UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, aboriginal groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.