End-Term Survey for the Global Fund Supported Adolescent Girls and Young Women (AGYW) Program 2018-2020

Contract

This is a National Consultant contract. More about National Consultant contracts.

Background

The Global Fund is an innovative financing mechanism that has been supporting programs in Zimbabwe, since 2003, for prevention, treatment and care for people with HIV/AIDS, tuberculosis and malaria. Under the current HIV grant (2018-2020), the primary goal is to reduce the rate of HIV incidence (prevent new infections) and reduce HIV related morbidity and mortality in Zimbabwe. GF resources are being used to improve access to HIV counselling and testing services; support HIV prevention through behaviour change communication; expand PMTCT services; strengthen provision of community-based HIV services; and achieve universal access to HIV treatment. UNDP is the Principal Recipient of the HIV Grant. National AIDS Council (NAC) is an organization enacted through the Act of Parliament of 1999 to coordinate and facilitate the national multi-sectorial response to HIV and AIDS. Under the current Global Fund HIV Grant (2018-2020), NAC is the Sub recipient (SR) responsible for managing and coordinating the (i) Adolescent Girls and Young Women (AGYW) and (ii) Key Populations (KP) programs. There are 4 SubSub Recipients (SSRs) under NAC which include: Plan International and ZACH (AGYW); and CeSHHAR and UNFPA (KP).

The AGYW Programme:

The AGYW Programme is managed and implemented under NAC? through three (3) SSRs namely (i) NAC who are responsible for the Sista2Sista and Male Mobilization programme; (ii) PLAN International who are responsible for the modified Determined, Resilient, Empowered, AIDS-free, Mentored and Safe (DREAMS) and; (iii) Zimbabwe Association of Church related Hospitals (ZACH) who are responsible for Start Awareness Support and Action (SASA!) and One Stop Centers (OSC). The Sista2Sista and Male Mobilization programmes cover 30 districts. PLAN International’s DREAMS programme is in 4 districts while ZACH’s SASA districts are 6 districts and the OSC covers 4 districts.

The primary aim of the AGYW program is to raise awareness and facilitate access to sexual health and reproductive health justice for adolescent girls and young women. The program utilizes safe spaces within which the adolescent girls and young women can learn more about their sexual and reproductive health, and how to access justice when their rights are or have been violated. By partnering with existing community structures, such as youth groups and activity clubs, the approach ensures that the adolescent girls and young women are able to obtain and generate information on their sexual and reproductive health rights, freely and effectively express themselves, strengthen their life skills, as well as have unlimited access to legal aid and advice on their rights. In addition, the program is meant to address the gap in sex education which has not been addressed at the societal level because of the collapse of the traditional cultural structure.

The Evaluation Context

The overall objective of the End-Term Evaluation is to establish and document the effectiveness and programmatic reach of the AGYW program including activities, outputs and results since project inception to completion. The evaluation will be guided by the 5 core ODA evaluation criteria:? relevance, effectiveness, efficiency, impacts, and sustainability. The project started in 2018 with the roll-out of the current GF HIV grant; and was followed by a baseline assessment in 2019. The end-term survey re-examines progress made in achieving the underlying objectives of the project. NAC will share the findings with key stakeholders, Global Fund and other relevant partners including donors and national stakeholders to inform future programming, but also to draw relevant lessons and appropriate recommendations for AGYW programs in Zimbabwe.

Evaluation Strategy ?Since inception of the current grant, the evaluation strategy that has been designed and adopted for the implementation of the AGYW program, comprises of the several components: a) the baseline study which was conducted in 2019; b) routine data collection that NAC collects every month through the NARF reporting c) the quarterly reports submitted to UNDP as the PR; and d) the end-term evaluation scheduled for 2020 to measure the overall impact of the program interventions.

Evaluation Scope

The end-term evaluation will cover the period Jan 2018 – Dec 2020 and will take into consideration the project geographical areas and the relevant implementing partners. The evaluation will target (and be guided by) the various thematic/result areas of the AGYW project as stipulated by the NAC Mini-M&E Plan and the national strategic plan. These include: Sista2Sista and Male Mobilization interventions; (ii) modified Determined, Resilient, Empowered, AIDS-free, Mentored and Safe (DREAMS) programme (iii) Start Awareness Support and Action (SASA!) and; (iv) One Stop Centres (OSC).

The end-term evaluation will assess the effectiveness of the implementation strategy and the results. This will include the implementation modalities, roles and responsibilities, coordination, partnership arrangements, institutional strengthening, beneficiary participation, replication and sustainability of the programme. The evaluation will include review of the project design and assumptions made at the beginning of the programme development process. Programme management including the implementation strategies; project activities; it will assess the extent to which the project results have been achieved, partnerships established, capacities built, and cross cutting issues. It will also assess whether the programme implementation strategy has been optimum and recommend areas for improvement and learning.?

Evaluation questions

The following key questions are proposed to guide the programme evaluation:

Relevance – (Design and focus of the programme) To what extent did the programme achieve its overall objectives • What and how much progress has been made towards achieving the overall outputs and outcomes of the programme • To what extent were the results (outcomes and outputs) achieved • Were the inputs and strategies identified, and were they realistic, appropriate and adequate to achieve the results • Was the programme relevant to the identified needs ii) Effectiveness – (Describe the management processes and their appropriateness in supporting delivery) • Was the programme effective in delivering desired/planned results • To what extent did the programme’s M&E mechanism contribute in meeting programme results • How effective were the strategies and tools used in the implementation of the programme • How effective has the programme been in responding to the needs of the beneficiaries, and what results were achieved • What are the future intervention strategies and issues iii) Efficiency – (of Programme Implementation) • Was the process of achieving results efficient. Specifically did the actual or expected results (outputs and outcomes) justify the costs incurred? Were the resources effectively utilized - What factors contributed to implementation efficiency • Did programme activities overlap and duplicate other similar interventions (funded nationally and /or by other donors? Are there more efficient ways and means of delivering more and better results (outputs and outcomes) with the available inputs - Could a different approach have produced better results • How was the programme’s collaboration with the Government Partners, national institutions, development partners, and other relevant stakeholders • How efficient were the management and accountability structures of the programme • How did the project financial management processes and procedures affect programme implementation • What are the strengths, weaknesses, opportunities and threats of the programme implementation process Impact Measurement • This involves positive and negative effects as a result of implementing projecting activities • The effects could be primary, medium-term or long-term • Impact measurement to involve the specific details regarding changes brought about by the project, comparing the actual situation before and after the project Sustainability and Ownership • To what extent are the benefits of the programme likely to be sustained after the completion of this programme • What is the likelihood of continuation and sustainability of programme outcomes and benefits after completion of the programme • How effective were the exit strategies, and approaches to phase out assistance provided by the programme including contributing factors and constraints • What are the key factors that will require attention in order to improve prospects of sustainability of programme outcomes and the potential for replication of the approach • How were capacities strengthened at the individual and organizational level (including contributing factors and constraints) • Describe the main lessons that have emerged. • What are the recommendations for similar support in future

(NB: The recommendations should provide comprehensive proposals for future interventions based on the current evaluation findings).

Evaluation Methodology

A combination of both quantitative and qualitative methods will be used for the endterm evaluation. A participatory approach will be adopted to appropriately gather the various perspectives of key stakeholders. However, the selected consultant will be required to propose the details in terms of suitable methodology for the evaluation, and this should be well articulated in their technical proposal. Once selected and in consultation with UNDP, NAC and key stakeholders, the consultant will revise the methodology and reflect this in the Inception Report. After the methodology is agreed upon, the consultant will develop relevant instruments to capture and analyse the data during the evaluation. The proposed methodology, tools and schedules should be gender and target group sensitive.

Duties and Responsibilities

Specifically, during the process of carrying out the End-Term Survey the consultant shall:

• Conduct the End-Term Survey to obtain the outcomes and impact of the project based on planned interventions.
• Undertake a desk review on available literature and project documents to identify relevant information for the final project evaluation
• Design the End-Term Survey methodology and tools focusing and ensuring that samples are representative of the target population groups? iv. It is the responsibility of the consultant to recruit and train enumerators for data collection and this should be costed accordingly
• Conduct interviews with select beneficiaries to obtain primary data on the key survey questions.
• Conduct in depth interviews with potential target groups and beneficiaries
• Conduct key-informant interviews with project implementers and partners, including Adolescent Girls and Young Women, Community-Based Organizations (CBOs), Civil Society Organizations (CSOs) and Ministry of Women Affairs among others
• The evaluator will conduct data analysis using appropriate methodologies
• The consultant will write a comprehensive report based on the findings from the evaluation.
• Prepare and present the findings in a dissemination workshop organized by NAC for stakeholders?

Timeframe and deliverables Time frame 40 days.

Key Deliverables

• Evaluation design, methodology and detailed work plan Inception report - 5 days
• Inception Meeting Initial briefing Recruit and train enumerators for data collection, Draft evaluation report - 5 days
• Documents review and stakeholder consultations - 25 days

• Field Visits for data collection Data analysis, debriefing and presentation of draft Evaluation Report Validation Workshop Finalization of evaluation report incorporating additions and comments provided by all stakeholders and submission to National AIDS Council and UNDP. Final evaluation report - 5 days

  Total number of working days 40 days

Competencies

• Ability to research and write at a high level; and
• Ability to produce high quality outputs in a timely manner while understanding and anticipating
• the evolving client needs;
• Strong organizational skills;
• Ability to work independently, produce high quality outputs;
• Sound judgment, strategic thinking and the ability to manage competing priorities;
• Demonstrates integrity by modelling KELIN’s values and ethical standards;
• Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability.

Required Skills and Experience

Education:

• Advanced University degree in Public Health, or any of the Social Sciences.

Experience:

• 3-5 years experience in Health Promotion, social mapping and development of baseline studies for adolescent girls and young women
• Experience in carrying out public health evaluations
• Experience of conducting baseline surveys;
• Significant experience conducting advocacy on Sexual and Reproductive Health Rights.
• Extensive knowledge of the Zimbabwe national HIV sector;
• Experience in the usage of computers and office software packages (MS Word, Excel, etc.) and advance knowledge of spreadsheet and database packages.

Language:

• Excellent written and spoken English;
• Understanding of Shona and Ndebele will be an added advantage.

How to Apply:

Scope of Price Proposal and Schedule of Payments

The consultant shall be paid the consultancy fee upon completion of the following milestones. • 20% after adoption of the inception report • 30% after presentation and adoption of the draft report • 50% after the approval of the final report

Recommended Presentation of Offer

Interested bidders must submit the following:

1. Duly accomplished Letter of Confirmation of Interest and Availability using the template provided by UNDP;
2. Personal CV or P11, indicating all experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references;
3. Brief description, separately or as part of the CV, of why the individual considers him/herself as the most suitable for the assignment, highlighting specialized background advantages for the scope of work and requirement.
4. Technical Proposal that details the evaluation design, methodology, data analysis and presentation
5. Financial Proposal that indicates the all-inclusive fixed total contract price, supported by a breakdown of costs, as per template provided.Criteria for Selection of the Best Offer Submissions will be evaluated in consideration of the Evaluation Criteria as stated below:

The offer will be evaluated by using the Best value for money approach (combined scoring method).? Technical proposal will be evaluated on 70% whereas the financial one will be evaluated on 30%. Below is the breakdown of technical proposal on 100% which will be brought to 70%:

Presentation of evaluation design and methodology 40%

• Advanced University degree in Public Health, Law, or any of the Social Sciences - 3 %
• Experience in Health Promotion, social mapping and development of baseline studies for adolescent girls and young women - 3 %
• Experience of conducting baseline surveys - 10%
• Significant experience conducting advocacy on Sexual and Reproductive Health Rights - 5%
• Extensive knowledge of the Zimbabwe national HIV sector- 5%
• Experience in the usage of computers and office software packages (MS Word, Excel, etc.) and advance knowledge of spreadsheet and database packages - 2%
• Fluency in both written and oral English - 2%