Final Evaluation of South Sudan SIDA HFA- 5 Year 1-PBA Program

Job Description

Background:

The IRC responds to the world’s worst humanitarian crises and helps people whose lives and livelihoods are shattered by conflict and disaster to survive, recover, and gain control of their future. The IRC was founded in 1933 to respond to the needs of people vulnerable to conflict around the world. Since then, it has expanded and evolved to become one of the world’s leading humanitarian organizations. In 2016, more than 26 million people benefited from IRC programs and those of its partner organizations. Today, the IRC continues to serve communities with emergency relief and reconstruction assistance, including child protection programming, operating in both refugee and host communities affected by conflict and disaster. The IRC in South Sudan has been providing humanitarian assistance since 1989.

In alignment with the Humanitarian Response Plan (HRP) 2021 and IRC’s South Sudan Strategy Action Plan (SAP) priority outcome areas, this programme aimed to address the critical protection needs of children and their caregivers who have experienced or are at risk of violence, abuse, and exploitation, building on Safety, Health, and Economic Wellbeing outcomes. In line with the SIDA strategy for 2021-2025 and IRC SS SAP, with fund from SIDA the IRC implemented a one-year (1 April 2021 – 31 March 2022) project for HFA- 5 Year 1-Project Based Approach Program.

IRC in this response to child protection, focused to improving the prevention from and respond to abuse, exploitation, neglect, and violence of crisis affected children in Koch County and Don Bosco IDP Camp. The intervention focuses on CP case management and family tracing and reunification (FTR), Safe Healing and Learning Space (SHLS), socio-emotional learning/ psychosocial support and community-based child protection committee. In addition, the IRC’s child protection programme engaged adolescent girls in the SAFE training curriculum and strengthen the capacity of the community-based protection structures.

IRC in response to nutrition, implement Community-based Management of Acute Malnutrition (CMAM) components integrated with maternal, infant, young child nutrition (MIYCN) across the existing 18 outpatient therapeutic feeding programme (OTP) static sites. IRC deployed two mobile team to provide services to hard-to-reach areas.

The project aimed at contributing to achieving the Safety outcome “People are safe in their communities and receive support when they experience harm” by ensuring women, girls, men, and boys have safe access to GBV prevention, response, and mitigation services in Juba, Bentiu, Ganyiel, Nyal and Koch. In coordination with other protection and health partners, the WPE programme provided lifesaving and psychosocial support services (PSS) to GBV survivors and engaged the community in GBV prevention interventions through the Engaging Men into Accountable Practices (EMAP) framework. In addition, the programme provided cash assistance to at risk women and girls.

Objectives of the Project:

The specific objectives of the project includes:

1. Children protected from consequences of neglect, exploitation, and abuse. 2. Children have safe places to play, learn, and heal and caregivers practice non-violent forms of discipline. 3. Women, men, girls and boys have their urgent protection needs met, and community members protect themselves and each other. 4. Increased access to nutrition services, coverage of micronutrients supplementations, knowledge and practice among primary caregivers on best nutrition practices. 5. Communities have sufficient purchasing power to buy basic necessities and women are able to use and control resources and assets. 6. Improved capacity of communities to maintain income and assets even in emergencies and mitigate and manage financial risks.

Key Project Outcomes:

1. Safety: People are safe in their communities and receive support when they experience harm 2. Health: Children are protected from and treated for malnutrition 3. Economic Wellbeing: People meet basic needs and avoid negative coping strategies

Purpose of Endline Evaluation:

In line with the grant agreement and project proposal document, a final project evaluation will be conducted in order to assess the completeness and effectiveness of the project deliverables, achievements realized, take stock of the positive and negative changes brought about as a result of this action. The main interest of the endline study will be measuring the relevance, coherence, efficiency, effectiveness, impact and sustainability of the Sida Programme Based Approach (PBA)[1] project as per the specific objectives of the three IRC outcome areas of safety, economic wellbeing and nutrition In addition, this evaluation will measure the contribution of the PBA approach (a flexible funding modality supported by Sida that contributes to the overall country strategy) in the IRC South Sudan country program and identify lessons, best practices and learning to inform any future scale up efforts or design of a next multiyear funding of the project.

Objectives of the Endline Evaluation:

This final evaluation exercise will seek to achieve the following objectives:

1. To determine to what extent the project responded to the needs and priorities of the beneficiaries as well as global, regional, country and IRC needs and priorities. 2. To determine how compatible has the project been with other interventions in the sector, in South Sudan and in IRC. 3. To determine to what extent the project achieved its objectives and outcomes as described in the project work plan and logframe. 4. To assess the level of community engagement and accountability (CEA) across all stages of the project cycle management. 5. To determine to what extent the project generated significant positive or negative, intended or unintended effects in the targeted populations. 6. To ascertain the extent to which the target population can sustain the benefits of the project. 7. To assess the level of IRC collaboration and coordination with county, state and national stakeholders in the planning and implementation of the project. 8. To assess to what extent the project has been able to respond to the evolution of clients' needs and context changes. 9. To document key lessons learnt and promising/best practices to inform future programming.

Endline Evaluation Scope:

The consultant will conduct endline evaluation in Juba, Bentiu, Ganyiel, Nyal and Koch. The Consultant will work closely with the MEAL Coordinator in the planning and execution of the evaluation. However, the quality of the evaluation assignment shall remain the sole responsibility of the Consultant.

Sample Size:

The Consultant will determine the appropriate sample sizes considering the geographical areas, targeted groups, and the homogeneity and heterogeneity of the target population.

Methodology:

The evaluation will use a mixed method approach where quantitative and qualitative approaches will be applied. The consultant is expected to collect quantitative and qualitative data from primary and secondary sources, conduct analysis using various relevant techniques and triangulate information from various sources when presenting and discussing findings. The consultant is expected to make conclusions and recommendations based on findings. The recommendations made should be actionable and practical in the context of South Sudan. The evaluation should be utilization-focused as IRC intends to use the findings to inform current and future programming. Given this overall guidance, the technical proposals should provide detailed methodology for this assignment.

Key Deliverables:

1. Submit inception report detailing evaluation design and methodology (including tools/instruments) to be used in this evaluation within 5 days after the sign of the contract/agreement. The inception report will be reviewed and approved by IRC before allowing any survey activities to continue. Develop and pre-test data collection instruments, collect quantitative and qualitative from primary and secondary data sources and conduct quantitative and qualitative data analysis. Children and adolescents should be involved in the evaluation in a meaningful manner and using child and adolescent friendly tools. Special consideration should be given to ethics related to interacting with children and adolescents. 2. Present preliminary findings to IRC and relevant project stakeholders for validation and to inform the draft evaluation report. 3. Submit first draft endline evaluation report for review and comments to IRC- the outline for this delivery could be as outlined in the inception report and as agreed in the contract. 4. Submit the final report incorporating inputs from IRC and other relevant stakeholders. The report should be using the agreed format(s) and within the agreed timelines as per the contractual agreement. 5. Make available the raw materials gathered during the evaluation. See below about "Data disclosure".

IRC Responsibility:

1. Work closely with the MEAL Coordinator in planning, coordination and execution of the assignment. 2. Ensure the highest research ethical standards and transparency are upheld during the evaluation. 3. Induction on the IRC safeguarding policy for the consultant and enumerators before directly engaging with the clients. 4. Responsible for organizing meetings with the different stakeholders during the survey (if required). 5. Introducing the consultant to local authorities for easy execution of the survey in the communities. 6. Provide relevant project documents for review

Consultant Responsibility:

1. Participate in the induction to the safeguarding policy and sign the safeguarding statement. 2. Ensure the actual survey is conducted as per the TOR and contract. 3. Ensure that the time scheduled is adhered to. 4. Responsible for his or her stationaries and other items needed for the evaluation. 5. International and national flights/travel will be at the Consultant's responsibility. 6. Consultancy fee is expected to cover the Consultant's subsistence needs (food, accommodation, security/allowances, enumerator fees, training). All costs related to the evaluation should be included in the consultation fee. 7. Consultant will be responsible to train the enumerators which is agreed as per inception report, and test the tools agreed. Refinement will be checked by IRC after field testing. 8. Survey execution - according to the agreed sample size and area, beneficiary/ community, and stakeholder coverage. If possible, the data collection should be conducted with the support of Kobo Collect or CommCare and GPS to map the respondents for future reference (if possible).

Data Disclosure:

1. The Consultant should handover/deliver to IRC, at minimum, all files obtained during the survey including: quantitative data sets (raw and refined products), transcripts of qualitative data and others in an easy to read format, and maintain naming conventions and labelling for the use of the project/ program/ initiative and key stakeholders. 2. Data must be disaggregated by gender, age and other relevant diversity, etc. 3. Datasets must be anonymized with all identifying information (personal identifiable information) removed. Each individual or household should be assigned a unique identifier. Datasets which have been anonymized will be accompanied by a password protected identifier key document to ensure that we are able to return to households or individuals for follow up. 4. Stakeholders with access to this document will be limited and defined in collaboration with IRC during evaluation inception. The Consultant is not allowed to use other than for this evaluation purpose or share data, findings, reports etc of this survey, except with the written approval from IRC.

Qualifications

Duration of Assignment:

The estimated duration of the study is 35 working days within the month of March and April 2022 which includes field work and report compilation. The consultant is required to submit a workplan of activities in the technical proposal based on the proposed timeline.

Payment:

Payment upon receipt of invoice and completion of deliverables (first tranche 30%: inception report, second tranche 30%: draft report and third tranche 40%: final report). All costs of deployment to Juba and field locations in the target locations are to be covered under the fee. The consultant is expected to arrange for his/her own accommodation and transportation in Juba. IRC will support in booking UNHAS flight to the study sites and coordinate field ground transport – However, the responsibility of payment of the flights should be charged to consultation fee by the Consultant. Consultant is required to submit a detailed budget for this activity in his/her proposal.

Qualifications:

- Advanced University degree (Master or PhD Level) in Sociology, Social Sciences, Evaluation & Socio-Economic Studies, Public Health, or another related field. - Minimum of 5 years of relevant practical evaluation experience within three or more of the following areas: participatory methods; qualitative methods; social network analyses; social accountability; conflict prevention and peacebuilding; community participation and/or empowerment. - Demonstrated publication record of evaluations on related topics. - Demonstrated excellent analytical, writing and reporting skills, with a focus on accessible, actionable, practitioner-focused reporting. - Prior work experience in South Sudan is a strong asset. - Familiarity with humanitarian and conflict-affected settings - Fluency in written and spoken English required. - Ability and willingness to travel to implementation sites in South Sudan (pending approval from IRC safety and security, based on security situation)

How to apply

Applicants should send:

- Cover letter outlining relevant experience and skills against qualifications listed. - Brief Technical Proposal (Not more than 5-pages) detailing the methodology on how to carry out the evaluation and a work plan including the COVID-19 Pandemic adaptation plan. - CVs of proposed consultant and a company profile in case of a consultancy firm. Note: Key personnel whose CVs are submitted in the proposal will undertake the assignment and work directly with IRC. Any attempt at replacement or substitution of consultancy personnel will be treated as breach of agreement. - Detailed budget to complete assignment including: 1) use of the estimated total number of days required; 2) daily rates for consultant(s); Data collection requirements for enumerators if any and 3) travel and accommodation costs during assignment. The Financial Proposal should include all costs that the consultant envisions and is charging for this assignment, including flights to and from Juba, flights and ground transport in the field and renumeration for enumerators and evaluation staff and procurement of any software, hardware and other materials for the assignment. - Provide a sample report(s) of similar work conducted previously – the name of the client may be redacted. IRC will only use the sample reports for purposes of identification of a consultant for this assignment.

Evaluation and Award of Consultancy

IRC will evaluate the proposals and award the assignment based on technical and financial soundness and feasibility. IRC reserves the right to accept or reject any proposal received without giving reasons and is not bound to accept the lowest, the highest or any bidder.

- - - - - -

[1] The Programme-Based Approach is an outcome-driven and flexible approach to humanitarian programming. It is based on an organisation and a country programme’s strategy, while allowing for substantial flexibility in terms of programmatic interventions, budget use and geographic focus, to adapt to actual shifts in the operating environment and evolving needs of target populations.