Consultant Evaluation Technical Advisor, Education Outcomes Fund (EOF), Hosted Funds, REMOTE, 36 months, Req: 566706

Consultant Programme & Policy Teaching & Training Monitoring & Evaluation

Overview

Provide evaluation expertise for childhood education programs.

You have:

• PhD in statistics, econometrics, economics, education or relevant fields.
• A minimum of 10 years of proven professional experience in quality assurance or a similar role in evaluation methods and educational research projects.
• Demonstrated experience with designing and using data collection, management, and analysis techniques.
• Familiarity with early childhood education related tools to measure quality and child outcomes is a plus.
• Experience working on projects in Rwanda, Sierra Leone and/or South Africa is strongly desirable.
• Excellent attention to detail and strong analytical skills.
• Fluency in English is required.

Contract

This is a Consultancy contract. More about Consultancy contracts.

UNICEF works in some of the world’s toughest places, to reach the world’s most disadvantaged children. To save their lives. To defend their rights. To help them fulfill their potential.

Across 190 countries and territories, we work for every child, everywhere, every day, to build a better world for everyone.

And we never give up.

For every child, EDUCATION

At the Education Outcomes Fund, we aim to improve the education and employment outcomes of 10 million children and youth by supporting governments to utilize a range of outcomes-based finance (OBF) instruments at scale, including outcomes funds. We support improvements in the quality of education and skills programs, with a special focus on underserved populations.

How can you make a difference?

BACKGROUND ON EOF’S EARLY CHILDHOOD CARE AND EDUCATION (ECCE) PORTFOLIO

The Education Outcomes Fund developed a joint vision with the LEGO Foundation for how outcomes-based finance (OBF) can support ECCE outcomes.

Currently, we are in the design phase of three programs in Rwanda, Sierra Leone, and South Africa aiming to expand access to quality early learning opportunities through different intervention models, from home-based to community-based early childhood centers. We expect these three programs to be launched in 2024.

PURPOSE OF THE ASSIGNMENT

In the 1st phase of this work, the Consultant will provide technical advice on the definition of the most appropriate evaluation methodology for each of the 3 programs. These programs will be working with an external evaluation firm that will recommend the evaluation methodology, evaluation protocols, and estimated budgets.

In the 2nd phase, the consultant will provide expertise and strategic guidance on the evaluation implementation of the ECCE programs, starting in 2024.

The consultant is expected to:

Phase 1: Provide evaluation expertise during the design of the three OBF programs (from Nov 2023 to mid-2024)

Phase 2: Provide evaluation expertise during the implementation of the three OBF programs (starting mid-2024 until December 2026)

In parallel to phases 1 and 2: portfolio-level support (starting in November 2023 until Q2 2024)

DELIVERABLES

ECCE Sierra Leone Program

Deliverables

Description

Estimated number of working days

Deadline/ timeline

Phase I

Deliverable 1:

Written assessment of four deliverables by the external evaluation firm, namely the recommendation of the evaluation methodology, evaluation protocols, data on indicative targets, and estimated budget (1-3 page per deliverable).

Review and assess the evaluation firm’s deliverables, including the evaluation methodology, evaluation protocols, indicative targets and estimated budget. Provide a technical assessment on the relevance and feasibility of the recommendations provided, and any additional requirements that should be ensured in the work

Help the team prepare for technical meetings and make informed decisions during the process of approval of recommendations

Additional support in reviewing the recommendations for the adaptation/validation of measurement tools

10 days

Nov 2023-

Jan 2024

Deliverable 2: Written comments to the Terms of Reference to contract the evaluation firm for the program implementation

Support the technical review of the Terms of Reference to contract the evaluation firm for implementation, in view of the recommendations provided in deliverable 1

Assess all risks and anticipate issues that should be raised during the contracting period, to mitigate issues during implementation, leveraging learnings and expertise on other similar interventions

Support review of learning agenda questions and definition of protocols and requirements to be included in the Terms of Reference

5 days

Jan-Feb 2024

Deliverable 3: Written assessment of proposals received in evaluation procurement for implementation (1-3 page per proposal, likely to be one single proposal)

Review and assess the proposals received as part of the evaluation procurement for implementation and help the team make informed decisions. This includes a technical analysis of the protocols and considerations proposed by the firm, raising any risks and issues that should be discussed with the bidder

Take part in negotiation calls, if needed

4 days

Feb-March 2024

Phase II

Deliverable 4: Detailed technical review of evaluation inputs and outputs (~7 inputs and outputs until 2026)

The independent evaluator prepares inputs (i.e., fieldwork preparation materials and reviews of the tests and instruments) and outputs (results reports and fieldwork reports) every evaluation cycle. The evaluation expert will review all these inputs and outputs to ensure high quality and raise any comments or questions to be solved by the evaluation firm

Support the team during the adaptation of measurement tools to be conducted by the evaluation firm

The evaluation expert will support and advise EOF’s team on the decision-making on how to best manage the integrity of the evaluation during data collection and analysis some

Support technical conversations with the evaluation firm, the government and service providers.

45 days

Yearly starting mid-2024

(5 days in 2024, 20 days in 2025 and 2026)

ECCE Rwanda Program

Deliverables

Description

Estimated number of working days

Deadline/ timeline

Phase I

Deliverable 1:

Written assessment of four deliverables by the external evaluation firm, namely the recommendation of the evaluation methodology, evaluation protocols, data on indicative targets, and estimated budget (1-3 page per deliverable).

Review and assess the evaluation firm’s deliverables. Provide a technical assessment on the relevance and feasibility of the recommendations provided, and any additional requirements that should be ensured in the work

Help the team prepare for technical meetings and make informed decisions during the process of approval of recommendations

Additional support in reviewing the recommendations for the adaptation/validation of measurement tools might be needed

10 days

Dec 2023-

Feb 2024

Deliverable 2: Written comments to the Terms of Reference to contract the evaluation firm for the program implementation

Support the technical review of the Terms of Reference to contract the evaluation firm for implementation, in view of the recommendations provided in deliverable 1

Assess all risks and anticipate issues that should be raised during the contracting period, to mitigate issues during implementation, leveraging learnings and expertise on other similar interventions

Support review of learning agenda questions and definition of protocols and requirements to be included in the Terms of Reference

5 days

Jan-Feb 2024

Deliverable 3: Written assessment of proposals received in evaluation procurement for implementation (1-3 page per proposal, likely to be one single proposal)

Review and assess the proposals received for implementation and help the team make informed decisions. This includes a technical analysis of the protocols and considerations proposed by the firm, raising any risks and issues that should be discussed with the bidder

Take part in negotiation calls, if needed

4 days

Feb-March 2024

Phase II

Deliverable 4: Detailed technical review of evaluation inputs and outputs (~7 inputs and outputs until 2026)

The independent evaluator prepares inputs (i.e., fieldwork preparation materials and reviews of the tests and instruments) and outputs (results reports and fieldwork reports) every evaluation cycle to ensure high quality and raise any comments or questions to be solved by the evaluation firm.

Support the team during possible adaptation and piloting of measurement tools to be conducted by the evaluation firm, in case issues may arise.

During data collection and analysis some issues may arise, which will require problem-solving and finding the best solutions to best manage the integrity of the evaluation

Support technical conversations with the evaluation firm, the government and service providers

40 days

Yearly starting June 2024 until July 2026 (40 days across the period)

ECCE South Africa Program

Deliverables

Description

Estimated number of working days

Deadline/ timeline

Phase I

Deliverable 1: Written assessment of three deliverables by the external evaluation firm, namely the recommendation of the evaluation methodology, evaluation protocols, and estimated budget (1-3 page per deliverable).

Review and assess the evaluation firm’s deliverables, including the evaluation methodology, evaluation protocols, and estimated budget. Provide a technical assessment of the relevance and feasibility of the recommendations provided and any additional requirements that should be ensured in the work.

Help the team prepare for technical meetings and make informed decisions during the process of approval of recommendations.

10 days

Jan- March 2024

Deliverable 2: Written comments to the Terms of Reference to select an independent evaluator and a written assessment (2-3 pages) on the proposals from bidders

Support the technical review of the Terms of Reference to contract the evaluation firm for implementation, in view of the recommendations provided in deliverable 1

Assess all risks and anticipate issues that should be raised during the contracting period, to mitigate issues during implementation, leveraging learnings and expertise on other similar interventions

Support review of learning agenda questions and definition of protocols and requirements to be included in the Terms of Reference

5 days

Feb-March 2024

Deliverable 3: Written assessment of proposals received in evaluation procurement for implementation (1-3 page per proposal, likely to be one single proposal)

Review and assess the proposals received as part of the evaluation procurement for implementation and help the team make informed decisions. This includes a technical analysis of the protocols and considerations proposed by the firm, raising any risks and issues that should be discussed with the bidder

Take part in negotiation calls, if needed.

4 days

April - June 2024

Phase II

Deliverable 4: Detailed technical review of evaluation inputs and outputs (~7 inputs and outputs until 2026)

The independent evaluator prepares inputs (i.e., fieldwork preparation materials and reviews of the tests and instruments) and outputs (results reports and fieldwork reports) every evaluation cycle. The evaluation expert will review all these inputs and outputs to ensure high quality and raise any comments or questions to be solved by the evaluation firm

During data collection and analysis some issues may arise, which will require problem-solving and finding the best solutions to best manage the integrity of the evaluation

Support technical conversations with the evaluation firm, the government and service providers

40 days

Yearly starting in Nov. 2025- Dec. 2026

(40 days across the period)

Cross-cutting deliverable for the three programs (in parallel to phases 1 and 2):

Deliverables

Description

Estimated number of working days

Deadline / timeline

Deliverable 1:

Assess and structure lessons learned from the experiences across the three programs (~15-page document)

A lessons-learned analysis of common learnings across the three ECCE programs, and the application of these for EOF’s future programs, with considerations, risks and mitigation strategies for EOF to structure its evaluation processes for future programs.

Help structure a continuing learning and reflection document of good practices and lessons learned that we could use to continue designing and implementing our programs.

Lead an evaluation session with EOF team to structure these design lessons as part of the codification work led by EOF

15 days

Dec 2023 -

Dec 2026

(approximately 5 days per year)

Total estimated number of working days: 165

To qualify as an advocate for every child you will have…

• PhD in statistics, econometrics, economics, education or relevant fields.
• A minimum of 10 years of proven professional experience in quality assurance or a similar role in experimental, quasi-experimental and observational evaluation methods, quantitative data and educational research projects, as well as experience working in evaluation methodologies preferably in early childhood education or at the very least in education sector.
• Demonstrated experience with designing and using data collection, management, and analysis techniques for experimental, quasi-experimental, and observational evaluation methods in the context of education.
• Familiarity with early childhood education related tools to measure structural and process quality (e.g., BEQI, Teach ECE, MELE, etc.) and child outcomes (e.g., GSED, MELQO, IDELA, etc.) is a plus.
• Experience working on projects in Rwanda, Sierra Leone and/or South Africa, or in similar contexts is strongly desirable.
• Excellent attention to detail and strong analytical skills.
• Fluency in English is required.

For every Child, you demonstrate…

UNICEF's values of Care, Respect, Integrity, Trust, Accountability, and Sustainability (CRITAS).

To view our competency framework, please visit here.

UNICEF is here to serve the world’s most disadvantaged children and our global workforce must reflect the diversity of those children. The UNICEF family is committed to include everyone, irrespective of their race/ethnicity, age, disability, gender identity, sexual orientation, religion, nationality, socio-economic background, or any other personal characteristic.

UNICEF offers reasonable accommodation for consultants/individual contractors with disabilities. This may include, for example, accessible software, travel assistance for missions or personal attendants. We encourage you to disclose your disability during your application in case you need reasonable accommodation during the selection process and afterwards in your assignment.

UNICEF has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and UNICEF, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination. UNICEF also adheres to strict child safeguarding principles. All selected candidates will be expected to adhere to these standards and principles and will therefore undergo rigorous reference and background checks. Background checks will include the verification of academic credential(s) and employment history. Selected candidates may be required to provide additional information to conduct a background check.

Remarks:

Only shortlisted candidates will be contacted and advance to the next stage of the selection process.

Individuals engaged under a consultancy or individual contract will not be considered “staff members” under the Staff Regulations and Rules of the United Nations and UNICEF’s policies and procedures, and will not be entitled to benefits provided therein (such as leave entitlements and medical insurance coverage). Their conditions of service will be governed by their contract and the General Conditions of Contracts for the Services of Consultants and Individual Contractors. Consultants and individual contractors are responsible for determining their tax liabilities and for the payment of any taxes and/or duties, in accordance with local or other applicable laws.

The selected candidate is solely responsible to ensure that the visa (applicable) and health insurance required to perform the duties of the contract are valid for the entire period of the contract. Selected candidates are subject to confirmation of fully-vaccinated status against SARS-CoV-2 (Covid-19) with a World Health Organization (WHO)-endorsed vaccine, which must be met prior to taking up the assignment. It does not apply to consultants who will work remotely and are not expected to work on or visit UNICEF premises, programme delivery locations or directly interact with communities UNICEF works with, nor to travel to perform functions for UNICEF for the duration of their consultancy contracts.

Apply now

Potential interview questions

Added 2 years ago - Updated 1 year ago - Source: unicef.org