Consultant Evaluation Technical Advisor, Education Outcomes Fund (EOF), Hosted Funds, REMOTE, 36 months, Req: 566706
Contract
This is a Consultancy contract. More about Consultancy contracts.
UNICEF works in some of the world’s toughest places, to reach the world’s most disadvantaged children. To save their lives. To defend their rights. To help them fulfill their potential.
Across 190 countries and territories, we work for every child, everywhere, every day, to build a better world for everyone.
And we never give up.
For every child, EDUCATION
At the Education Outcomes Fund, we aim to improve the education and employment outcomes of 10 million children and youth by supporting governments to utilize a range of outcomes-based finance (OBF) instruments at scale, including outcomes funds. We support improvements in the quality of education and skills programs, with a special focus on underserved populations.
How can you make a difference?
BACKGROUND ON EOF’S EARLY CHILDHOOD CARE AND EDUCATION (ECCE) PORTFOLIO
The Education Outcomes Fund developed a joint vision with the LEGO Foundation for how outcomes-based finance (OBF) can support ECCE outcomes.
Currently, we are in the design phase of three programs in Rwanda, Sierra Leone, and South Africa aiming to expand access to quality early learning opportunities through different intervention models, from home-based to community-based early childhood centers. We expect these three programs to be launched in 2024.
PURPOSE OF THE ASSIGNMENT
In the 1st phase of this work, the Consultant will provide technical advice on the definition of the most appropriate evaluation methodology for each of the 3 programs. These programs will be working with an external evaluation firm that will recommend the evaluation methodology, evaluation protocols, and estimated budgets.
In the 2nd phase, the consultant will provide expertise and strategic guidance on the evaluation implementation of the ECCE programs, starting in 2024.
The consultant is expected to:
Phase 1: Provide evaluation expertise during the design of the three OBF programs (from Nov 2023 to mid-2024)
Phase 2: Provide evaluation expertise during the implementation of the three OBF programs (starting mid-2024 until December 2026)
In parallel to phases 1 and 2: portfolio-level support (starting in November 2023 until Q2 2024)
DELIVERABLES
ECCE Sierra Leone Program
Deliverables
Description
Estimated number of working days
Deadline/ timeline
Phase I
Deliverable 1:
Written assessment of four deliverables by the external evaluation firm, namely the recommendation of the evaluation methodology, evaluation protocols, data on indicative targets, and estimated budget (1-3 page per deliverable).
Review and assess the evaluation firm’s deliverables, including the evaluation methodology, evaluation protocols, indicative targets and estimated budget. Provide a technical assessment on the relevance and feasibility of the recommendations provided, and any additional requirements that should be ensured in the work
Help the team prepare for technical meetings and make informed decisions during the process of approval of recommendations
Additional support in reviewing the recommendations for the adaptation/validation of measurement tools
10 days
Nov 2023-
Jan 2024
Deliverable 2: Written comments to the Terms of Reference to contract the evaluation firm for the program implementation
Support the technical review of the Terms of Reference to contract the evaluation firm for implementation, in view of the recommendations provided in deliverable 1
Assess all risks and anticipate issues that should be raised during the contracting period, to mitigate issues during implementation, leveraging learnings and expertise on other similar interventions
Support review of learning agenda questions and definition of protocols and requirements to be included in the Terms of Reference
5 days
Jan-Feb 2024
Deliverable 3: Written assessment of proposals received in evaluation procurement for implementation (1-3 page per proposal, likely to be one single proposal)
Review and assess the proposals received as part of the evaluation procurement for implementation and help the team make informed decisions. This includes a technical analysis of the protocols and considerations proposed by the firm, raising any risks and issues that should be discussed with the bidder
Take part in negotiation calls, if needed
4 days
Feb-March 2024
Phase II
Deliverable 4: Detailed technical review of evaluation inputs and outputs (~7 inputs and outputs until 2026)
The independent evaluator prepares inputs (i.e., fieldwork preparation materials and reviews of the tests and instruments) and outputs (results reports and fieldwork reports) every evaluation cycle. The evaluation expert will review all these inputs and outputs to ensure high quality and raise any comments or questions to be solved by the evaluation firm
Support the team during the adaptation of measurement tools to be conducted by the evaluation firm
The evaluation expert will support and advise EOF’s team on the decision-making on how to best manage the integrity of the evaluation during data collection and analysis some
Support technical conversations with the evaluation firm, the government and service providers.
45 days
Yearly starting mid-2024
(5 days in 2024, 20 days in 2025 and 2026)
ECCE Rwanda Program
Deliverables
Description
Estimated number of working days
Deadline/ timeline
Phase I
Deliverable 1:
Written assessment of four deliverables by the external evaluation firm, namely the recommendation of the evaluation methodology, evaluation protocols, data on indicative targets, and estimated budget (1-3 page per deliverable).
Review and assess the evaluation firm’s deliverables. Provide a technical assessment on the relevance and feasibility of the recommendations provided, and any additional requirements that should be ensured in the work
Help the team prepare for technical meetings and make informed decisions during the process of approval of recommendations
Additional support in reviewing the recommendations for the adaptation/validation of measurement tools might be needed
10 days
Dec 2023-
Feb 2024
Deliverable 2: Written comments to the Terms of Reference to contract the evaluation firm for the program implementation
Support the technical review of the Terms of Reference to contract the evaluation firm for implementation, in view of the recommendations provided in deliverable 1
Assess all risks and anticipate issues that should be raised during the contracting period, to mitigate issues during implementation, leveraging learnings and expertise on other similar interventions
Support review of learning agenda questions and definition of protocols and requirements to be included in the Terms of Reference
5 days
Jan-Feb 2024
Deliverable 3: Written assessment of proposals received in evaluation procurement for implementation (1-3 page per proposal, likely to be one single proposal)
Review and assess the proposals received for implementation and help the team make informed decisions. This includes a technical analysis of the protocols and considerations proposed by the firm, raising any risks and issues that should be discussed with the bidder
Take part in negotiation calls, if needed
4 days
Feb-March 2024
Phase II
Deliverable 4: Detailed technical review of evaluation inputs and outputs (~7 inputs and outputs until 2026)
The independent evaluator prepares inputs (i.e., fieldwork preparation materials and reviews of the tests and instruments) and outputs (results reports and fieldwork reports) every evaluation cycle to ensure high quality and raise any comments or questions to be solved by the evaluation firm.
Support the team during possible adaptation and piloting of measurement tools to be conducted by the evaluation firm, in case issues may arise.
During data collection and analysis some issues may arise, which will require problem-solving and finding the best solutions to best manage the integrity of the evaluation
Support technical conversations with the evaluation firm, the government and service providers
40 days
Yearly starting June 2024 until July 2026 (40 days across the period)
ECCE South Africa Program
Deliverables
Description
Estimated number of working days
Deadline/ timeline
Phase I
Deliverable 1: Written assessment of three deliverables by the external evaluation firm, namely the recommendation of the evaluation methodology, evaluation protocols, and estimated budget (1-3 page per deliverable).
Review and assess the evaluation firm’s deliverables, including the evaluation methodology, evaluation protocols, and estimated budget. Provide a technical assessment of the relevance and feasibility of the recommendations provided and any additional requirements that should be ensured in the work.
Help the team prepare for technical meetings and make informed decisions during the process of approval of recommendations.
10 days
Jan- March 2024
Deliverable 2: Written comments to the Terms of Reference to select an independent evaluator and a written assessment (2-3 pages) on the proposals from bidders
Support the technical review of the Terms of Reference to contract the evaluation firm for implementation, in view of the recommendations provided in deliverable 1
Assess all risks and anticipate issues that should be raised during the contracting period, to mitigate issues during implementation, leveraging learnings and expertise on other similar interventions
Support review of learning agenda questions and definition of protocols and requirements to be included in the Terms of Reference
5 days
Feb-March 2024
Deliverable 3: Written assessment of proposals received in evaluation procurement for implementation (1-3 page per proposal, likely to be one single proposal)
Review and assess the proposals received as part of the evaluation procurement for implementation and help the team make informed decisions. This includes a technical analysis of the protocols and considerations proposed by the firm, raising any risks and issues that should be discussed with the bidder
Take part in negotiation calls, if needed.
4 days
April - June 2024
Phase II
Deliverable 4: Detailed technical review of evaluation inputs and outputs (~7 inputs and outputs until 2026)
The independent evaluator prepares inputs (i.e., fieldwork preparation materials and reviews of the tests and instruments) and outputs (results reports and fieldwork reports) every evaluation cycle. The evaluation expert will review all these inputs and outputs to ensure high quality and raise any comments or questions to be solved by the evaluation firm
During data collection and analysis some issues may arise, which will require problem-solving and finding the best solutions to best manage the integrity of the evaluation
Support technical conversations with the evaluation firm, the government and service providers
40 days
Yearly starting in Nov. 2025- Dec. 2026
(40 days across the period)
Cross-cutting deliverable for the three programs (in parallel to phases 1 and 2):
Deliverables
Description
Estimated number of working days
Deadline / timeline
Deliverable 1:
Assess and structure lessons learned from the experiences across the three programs (~15-page document)
A lessons-learned analysis of common learnings across the three ECCE programs, and the application of these for EOF’s future programs, with considerations, risks and mitigation strategies for EOF to structure its evaluation processes for future programs.
Help structure a continuing learning and reflection document of good practices and lessons learned that we could use to continue designing and implementing our programs.
Lead an evaluation session with EOF team to structure these design lessons as part of the codification work led by EOF
15 days
Dec 2023 -
Dec 2026
(approximately 5 days per year)
Total estimated number of working days: 165
To qualify as an advocate for every child you will have…
- PhD in statistics, econometrics, economics, education or relevant fields.
- A minimum of 10 years of proven professional experience in quality assurance or a similar role in experimental, quasi-experimental and observational evaluation methods, quantitative data and educational research projects, as well as experience working in evaluation methodologies preferably in early childhood education or at the very least in education sector.
- Demonstrated experience with designing and using data collection, management, and analysis techniques for experimental, quasi-experimental, and observational evaluation methods in the context of education.
- Familiarity with early childhood education related tools to measure structural and process quality (e.g., BEQI, Teach ECE, MELE, etc.) and child outcomes (e.g., GSED, MELQO, IDELA, etc.) is a plus.
- Experience working on projects in Rwanda, Sierra Leone and/or South Africa, or in similar contexts is strongly desirable.
- Excellent attention to detail and strong analytical skills.
- Fluency in English is required.
For every Child, you demonstrate…
UNICEF's values of Care, Respect, Integrity, Trust, Accountability, and Sustainability (CRITAS).
To view our competency framework, please visit here.
UNICEF is here to serve the world’s most disadvantaged children and our global workforce must reflect the diversity of those children. The UNICEF family is committed to include everyone, irrespective of their race/ethnicity, age, disability, gender identity, sexual orientation, religion, nationality, socio-economic background, or any other personal characteristic.
UNICEF offers reasonable accommodation for consultants/individual contractors with disabilities. This may include, for example, accessible software, travel assistance for missions or personal attendants. We encourage you to disclose your disability during your application in case you need reasonable accommodation during the selection process and afterwards in your assignment.
UNICEF has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and UNICEF, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination. UNICEF also adheres to strict child safeguarding principles. All selected candidates will be expected to adhere to these standards and principles and will therefore undergo rigorous reference and background checks. Background checks will include the verification of academic credential(s) and employment history. Selected candidates may be required to provide additional information to conduct a background check.
Remarks:
Only shortlisted candidates will be contacted and advance to the next stage of the selection process.
Individuals engaged under a consultancy or individual contract will not be considered “staff members” under the Staff Regulations and Rules of the United Nations and UNICEF’s policies and procedures, and will not be entitled to benefits provided therein (such as leave entitlements and medical insurance coverage). Their conditions of service will be governed by their contract and the General Conditions of Contracts for the Services of Consultants and Individual Contractors. Consultants and individual contractors are responsible for determining their tax liabilities and for the payment of any taxes and/or duties, in accordance with local or other applicable laws.
The selected candidate is solely responsible to ensure that the visa (applicable) and health insurance required to perform the duties of the contract are valid for the entire period of the contract. Selected candidates are subject to confirmation of fully-vaccinated status against SARS-CoV-2 (Covid-19) with a World Health Organization (WHO)-endorsed vaccine, which must be met prior to taking up the assignment. It does not apply to consultants who will work remotely and are not expected to work on or visit UNICEF premises, programme delivery locations or directly interact with communities UNICEF works with, nor to travel to perform functions for UNICEF for the duration of their consultancy contracts.