NATIONAL CONSULTANTs - ASSISTANT EVALUATOR FOR THE FINAL EVALUATION OF THE UN WOMEN PROJECT “GOOD GOVERNANCE FOR GENDER EQUALITY IN GEORGIA (GG4GEG)” - 2 positions
Application deadline 1 month ago: Friday 23 Dec 2022 at 23:59 UTCOpen application form
This is a National Consultant contract. More about National Consultant contracts.
UN Women, grounded in the vision of equality enshrined in the Charter of the United Nations, works for the elimination of discrimination against women and girls; the empowerment of women; and the achievement of equality between women and men as partners and beneficiaries of development, human rights, humanitarian action and peace and security.
UN Women supports UN Member States as they set global standards for achieving gender equality and works with governments and civil society to design laws, policies, programmes and services needed to implement these standards. It stands behind women’s equal participation in all aspects of life, focusing on five priority areas: increasing women’s leadership and participation; ending violence against women; engaging women in all aspects of peace and security processes; enhancing women’s economic empowerment; and making gender equality central to national development planning and budgeting. UN Women also coordinates and promotes the UN system’s work in advancing gender equality.
Although many positive results have been achieved since Georgia began actively working on accelerating gender equality laws and policies in 1994 (CEDAW ratification year), significant challenges remain in formal as well as informal policies, practices and procedures across state institutions as well as public sector that hinder the achievement of substantive gender equality. To enhance good governance and democratic development of Georgia and to strengthen the private sector’s role in women’s economic empowerment, UN Women Georgia Country Office launched a project Good Governance for Gender Equality in Georgia (GG4GEG) with the support of the Norwegian Ministry of Foreign Affairs. The project started in 1st of September 2019 and runs for 45 months with an end date in 31st of May, 2023. The total budget of the project is USD 4,224,915.
The overarching goal/impact of the GG4GEG project is to ensure that Governance systems, programmes, and policies along with private sector partners are gender sensitive and enable women’s economic empowerment and broader gender equality in Georgia. The project consists of two components linked to two outcomes of the project. Under the first component, the project aims to ensure that Governance systems are gender sensitive and enable gender equality in Georgia (Outcome 1) and delivers on the following three key outputs: 1. Gender equality and gender mainstreaming are institutionalized at the national and local levels; 2. Gender mainstreaming capacities are developed and sustained at the national and local levels; and 3. More and better-quality data and analysis are available to promote and track the progress of gender equality and women’s empowerment. The proposed theory of change for the first outcome is as follows: if (1) gender equality and gender mainstreaming are institutionalized at national and local levels; and (2) gender mainstreaming capacity is developed and sustained at national and local levels; and (3) more and better-quality data and analysis are available to promote and track the progress of gender equality and women’s empowerment; then (4) governance systems will be strengthened for gender equality; because (5) institutional mechanisms and policymaking processes and patterns will become gender-sensitive and gender-aware. This component of the project started in 1st of September 2019 and runs for 45 months with an end date in 31st of May 2023.
Under its second component, the project aims to to ensure that women in rural areas benefit from increased income-generation opportunities in the agritourism and ICT sectors and fully realize their economic rights with the support of a gender-responsive private sector (Outcome 2). Under this Outcome, the project delivers on the following three outputs: 1. Businesses have an increased understanding of the Women’s Empowerment Principles (WEPs) and have the skills to implement measures that benefit women, specifically in rural areas; 2. Policymakers and public agencies have increased capacities to identify and address challenges faced by women entrepreneurs in agritourism and ICT; and 3. Women have increased confidence, skills and resources to utilize income-generation opportunities in the agritourism and ICT sectors and related value chains. The Theory of Change for the second outcome of the GG4GEG project is: If (1) Businesses have increased understanding of Women’s Empowerment Principles (WEPs) and skills to implement measures that benefit women, specifically in rural areas; and if (2) Policymakers and public agencies have increased capacities to identify and address challenges faced by women entrepreneurs in agritourism and ICT; and if (3) Women have increased confidence, skills and resources to utilize income generation opportunities in the agritourism and ICT sectors, then (4) women in rural areas benefit from increased income generation opportunities in the agritourism and ICT sectors in Georgia, because (5) the private, public and civil society sectors take actions to create an enabling environment for rural women’s economic empowerment. This Women’s Economic Empowerment (WEE) component of the project started in 1st of June 2021 and ends in 31st of May 2023 (as a result of the Donor Agreement Amendment #1).
Under the first outcome, the key state partners of the project in Georgia are: the Gender Equality Council of the Parliament and relevant legislative committees; the newly created Inter-Agency Commission for Gender Equality in the Prime Minister’s Office, Public Defender’s Office and GEOSTAT; The target groups of the project are the public servants, especially those responsible for planning and budgeting on the national level – more specifically, those within the Prime Minister’s Office, the Civic Service Bureau, the Ministry of Finance and all other ministries through their affiliation in the Inter-Agency Commission, as well as the local governments of all 64 municipalities and 5 self-governing cities. The key benefits of the action for the primary target group include increased knowledge and individual and institutional capacities in gender equality and gender mainstreaming (using GRB, GIA and PGA methodologies) to carry out decentralization, civil service and public finance reforms in line with Georgia’s international and national commitments in the field of women’s rights and gender equality. The intervention also targets gender advocates, experts, academia and civil society organizations (as secondary target groups) by deepening their knowledge and expertise in the selected gender mainstreaming tools and methodologies, such as Gender Responsive Budgeting (GRB), Gender Impact Assessment (GIA) and Participatory Gender Audit (PGA).The ultimate beneficiaries of the project are socially excluded groups of women and men who, in the long run, will benefit from more transparent and coherent planning and budgeting processes, as well as from better informed civil servants equipped with more sensitive gender approaches to the diverse needs of women, men, boys and girls.
Under the second Outcome the project works with three key target groups: 1. Private businesses interested in increasing their contributions to the SDGs, their accountability and women’s economic empowerment by promoting gender equality in the workplace, marketplace and community (over 150 companies’ signatories of UN Women Women’s Empowerment Principles: Equality Means Business (WEPs) as of October 2022). 2. Government bodies / public entities responsible for an enabling environment for businesses development, especially agrotourism and ICT sectors’ growth and equal opportunities therein such as the Ministry of Economy and Sustainable Development and its entities (Enterprise Georgia, Georgia’s Innovation and Technology Agency, etc.). 3.Women in Georgia, especially those residing in rural areas, supporting their skills building to access decent work and/or grow their agritourism-related businesses.
Purpose and the Use of Evaluation
Upon the project completion, as established in the Project Document, a mandatory external final evaluation is to be conducted by UN Women for accountability and learning purposes. This final evaluation will take place towards the end of the implementation of the intervention (December 2022 – April 2023) and its main purpose is assessing the achievement of project results and performance of the above-described interventions. Findings of the final external evaluation will inform UN Women Georgia’s future work in the areas of governance and participation in public life and women’s economic empowerment. The external evaluation will further identify lessons learned, best practices and challenges of the GG4GEG project and will greatly inform the development of the follow-up programmatic interventions.
The information generated by the evaluation will be used by different stakeholders to contribute to building of the evidence base on effective strategies for women’s empowerment in Georgia and to facilitate UN Women’s strategic reflection and learning for programming in the area.
The information generated by the evaluation will be used by different stakeholders to:
- Contribute to building of the evidence base on effective strategies for gender sensitive governance system and economic empowerment of women
- Facilitate strategic reflection, learning and further planning for programming in the areas of governance and participation in public life and economic empowerment of women
- Strengthen national stakeholders and structures with the aim to increase sustainability of the results beyond the project
Main evaluation users include UN Women Country Office in Georgia as well as Government of Norway (project donor). Furthermore, national stakeholders – civil society partners, private sector partners, private Parliamentary counterparts and targeted state and non-state agencies will be also closely involved in the evaluation process to increase ownership of findings, draw lessons learned and make and greater use of this final evaluation results.
Evaluation Objectives, Criteria and Questions
The specific evaluation objectives are as follows:
- Analyze the relevance of the implementation strategy and approaches of the “Good Governance for Gender Equality in Georgia” project;
- Assess effectiveness and organizational efficiency in progressing towards the achievement of the project’s results as defined in the interventions;
- Validate the project results in terms of achievements and/or weaknesses toward the outcome and outputs;
- Determine the impact of the intervention with respect to gender equality and women’s empowerment;
- Assess the sustainability of the results achieved by the project;
- Document lessons learned, best practices, success stories and challenges to inform future work of UN Women and the Norwegian Ministry of Foreign Affairs in the areas of governance and participation in public life and economic empowerment of women;
- Identify strategies for replication and up-scaling of the project’s best practices;
- Provide actionable recommendations for future programmatic developments and maximize ownership by partners in the country covered by the project;
- To assess how the project and its results relate and contribute to commitments and achievement of Sustainable Development Goals (SDGs) in Georgia.
The evaluation will address the criteria of Project Relevance, Effectiveness, Efficiency, and Sustainability. More specifically, the evaluation will address the key evaluation questions:
- Relevance: A) How does the project reflect and align with gender equality national strategic plans and normative frameworks as well as Georgia’s international obligations and commitments? B) Is the project design based on quality analysis, including gender and human rights-based analysis, risk assessments, socio-cultural and political analysis? C) Were the programmatic strategies appropriate to address the identified needs of beneficiaries?
- Coherence: A) To what extent the project adheres to corporate strategic priorities of UN Women and the UN Women CO Strategic Note? B) Is the project achieving synergies between the larger UN Women’s portfolios and the work of the UN Country Team? C) Is the project achieving synergies between UN Women and key national stakeholders including national governments and CSOs? D) How does the project design match with the complexity of national structures, systems and decision-making processes?
- Effectiveness: A) What has been the progress made towards achievement of the expected outcomes and expected results? What are the results achieved? B) What are the reasons for the achievement or non-achievement of the project results? C) Does the project have effective monitoring mechanisms in place to measure progress towards results? D) What is the influence of the specific country context and circumstances on the achievement of results and operational effectiveness? F) How adaptable and rapidly does the project react to changing situations? G) Has the project achieved any unforeseen results, either positive or negative? For whom? H) What are the good practices and the obstacles or shortcomings encountered? How were they overcome? I) To what extent have capacities of relevant duty-bearers and rights-holders been strengthened? J) What -if any- types of innovative good practices have been introduced in the project for the achievement of WEE results?
- Efficiency: A) Have resources (financial, human, technical support, etc.) been allocated strategically to achieve the project outcomes? B) Have the outputs been delivered in a timely manner? C) To what extent were relevant stakeholders and actors included in the project planning and implementation?
- Sustainability A) How effectively has the project been able to contribute to the generation of national ownership of the project outputs? B) What is the likelihood that the benefits from the project will be maintained for a reasonably long period of time after the project phase out? C) To what extend has the project identified strategic partners that could pick up on supporting continued government and non-governmental action when the project comes to an end? D) Do national/local institutions demonstrate leadership commitment and technical capacity to continue to replicate some project activities? E) To what extend have the project’s exit strategy been well planned and successful? F) To what extent has UN Women been able to promote replication of project successes?
The questions outlined above are preliminary and are expected to be revised and refined by the evaluation team during the inception phase of the evaluation.
Scope of the Evaluation
The final evaluation of the project is to be conducted externally by an international external consultant/evaluator in a team with two national consultants/assistant evaluators. National consultants/assistant evaluators are expected to work under the direct supervision of the international consultant/evaluator for 30 working days in the period of 15 December 2022 – 30 April 2023.
The final evaluation will include all aspects of the project and will cover almost the full project implementation period starting from September 1, 2019 till the end of March 2023.
Evaluation Design, Process and Methods
The evaluation methodology will be mixed (quantitative and qualitative research methods and analytical approaches) to account for complexity of gender relations and to ensure participatory and inclusive processes that are culturally appropriate. A theory of change approach will be followed, and the consultant is expected to reconstruct, validate, and identify the gaps in the project’s theory of change. The reconstructed theory of change should elaborate on following how GG4GEG project has contributed to creating an enabling legislative, policy, institutional and economically enabling environment in line with internationally binding standards on gender-sensitive governance systems and women’s economic empowerment in Georgia. Assumptions should be tested and explain both the connections between early, intermediate, and long-term project outcomes and the expectations about how and why the project has brought them about. By reconstructing the Theory of Change the evaluator is also expected to identify challenges and gaps in the implementation of the project for future improvement. Hence an eventual next phase of the project will benefit from a refined and tested Theory of Change.
Interviews and focus group discussions with all key stakeholders involved in the project implementation, including but not limited to GG4GEG project team, government partners, NGO partners, beneficiaries, etc. shall also take place.
The evaluation team should develop a sampling frame (area and population represented, rationale for selection, mechanism of selection, limitations of the sample) and specify how it will address the diversity of stakeholders in the intervention. The evaluation team should take measures to ensure data quality, reliability and validity of data collection tools and methods and their responsiveness to gender equality and human rights; for example, the limitations of the sample (representativeness) should be stated clearly and the data should be triangulated (cross-checked against other sources) to help ensure robust results.
The evaluation process is divided in four phases: 1) Preparation, mainly devoted to structuring the evaluation approach, establishing reference group, preparing the TOR, compiling project documentation, and recruitment of the evaluation team; 2) Conduct, which involves reconstruction of theory of change, organizing inception meetings, drafting inception report and finalization of evaluation methodology, data collection and analysis, including desk research and preparation of interviews and focus groups, preparation of field missions and visits to project sites (data collection in the field will be implemented by national consultants based on the clear and specific guidelines from the international consultant); 3) Reporting, focusing on presentation of preliminary findings, developing draft and final reports; and 4) Use and follow-up, which will entail the development of management response by UN Women team and follow-up to the implementation of the management response.
The national consultants will be responsible only for Conduct and Reporting phases.
- Conduct phase: at the beginning of the consultancy, the team of evaluators will be provided with key sources of information for an initial desk review. The online inception meetings will be conducted with GG4GEG team. In this phase an inception report that will include the refined evaluation methodology including data collection plan and instruments will be delivered. The inception report will be validated and approved by UN Women. Based on the inception phase, the consultant will carry out further in-depth desk review. Data collection will be carried out jointly by the international and national consultants. Online or face-to-face interviews and focus group discussions with key stakeholders, as relevant, will take place. Field missions will be conducted by national consultants in line with data collection plan and instruments developed by the international consultant, while international consultant can also interview major English-speaking project partners online. National consultants will provide summaries of interviews in English to the consultant in line with the pre-agreed format and the international consultant will carry out further analysis.
- Reporting phase: The collected information will be analyzed and final evaluation report will be delivered. A validation meeting will be organized where the consultant will validate the final report with UN Women and Evaluation Reference Group (ERG) and submit for approval by UN Women.
UN Women’s Independent Evaluation Service (IES) has developed the GERAAS, which has adapted UNEG Standards for Evaluation in the UN System to guide evaluation managers and evaluators on what constitutes a ‘good quality’ report at UN Women. All evaluations in UN Women are annually assessed against the framework adopted in GERAAS and hence the consultant should be familiar with GERAAS quality standards.
In addition, UN Women is an UN-SWAP reporting entity and the consultant will take into consideration that all the evaluation in UN Women are annually assessed against the UN-SWAP Evaluation Performance Indicator and its related scorecard. The evaluation will be conducted in accordance with UN Women evaluation guidelines and UNEG Norms and Standards for evaluation and the UNEG Code of Conduct for Evaluations in the UN System (UNEG Ethical Guidelines : http://uneval.org/papersandpubs/documentdetail.jsp?doc_id=102; The UNEG Code of Conduct for Evaluation: http://uneval.org/papersandpubs/documentdetail.jsp?doc_id=100).
Stakeholders Participation and Evaluation Management Structure
The evaluation will be a consultative, inclusive and participatory process and will ensure the participation of stakeholders engaged in the implementation of the project.
The evaluation will be Human Rights and Gender responsible and an Evaluation Reference Group (ERG) will be established.
The Evaluation Reference Group is an integral part of the evaluation management structure and is constituted to facilitate the participation of relevant stakeholders in the design and scope of the evaluation, raising awareness of the different information needs, quality assurance throughout the process and in disseminating the evaluation results. The Evaluation Reference Group will be engaged throughout the process and will be composed of relevant representatives of state and non-state stakeholders. The ERG group will review the draft evaluation report and provide substantive feedback to ensure quality and completeness of the report and will participate in the inception and validation meeting of the final evaluation report.
The UN Women Georgia Monitoring and Evaluation Focal Point will serve as the Evaluation Task Manager, who will be responsible for day-to-day management of the evaluation and ensure that the evaluation is conducted in accordance with the sister entities Evaluation Policies, United Nations Evaluation Group Ethical Guidelines and Code of Conduct for Evaluation in the United Nations system and other key relevant guidance documents. The evaluation process will be supported by the UN Women Europe and Central Asia Regional Evaluation Specialist.
Coordination in the field including logistical support will be the responsibility of UN Women.
Within six weeks upon completion of the evaluation, UN Women has the responsibility to prepare a management response that addresses the findings and recommendations to ensure future learning and inform implementation of relevant projects.
This is a consultative/participatory final project evaluation with a strong learning component. The management of the evaluation will ensure that key stakeholders are consulted.
The international consultant will lead the evaluation in close coordination with two (2) national consultants.
Duties and Responsibilities
The national consultants/assistant evaluators will work under the direct supervision of the international evaluator and will benefit from technical and operational support of UN Women Country Office in Georgia. In more specific terms, the national consultant will be providing support to the international consultant in the process of the project evaluation in Georgia and will be responsible for the following tasks:
- To collect and review all relevant materials, such as reports, assessments, studies and draft laws, etc.
- Provide outline/translation of all key documents from Georgian into English to the international consultant, as needed;
- To contribute to the development of methodology and evaluation instruments, i.e. focus group and interview guides and translate the final instruments in Georgian if needed;
- To support arrangement of meetings, focus group discussions, interviews with key beneficiaries and stakeholders of the project together and in consultation with UN Women.
- To support the international consultant to conduct individual interviews and focus groups discussions with the relevant stakeholders online and face-to-face;
- To participate in all the meetings, focus group discussions and interviews, provide interpretation as needed, take notes and prepare summaries in English;
- To conduct focus groups and in depth interviews with selected respondents independently (including the regions of Georgia), using the agreed guides and provide the international consultant with the summaries of the interviews and focus groups;
- To support international consultant in analyzing the data;
- To be available if further clarification is needed by the international evaluator during the drafting and finalization process of the evaluation and provide inputs to the evaluation report as needed;
- To support the international consultant in preparing a Power Point Presentation and an outline on preliminary findings and present to ERG and reflect the feedback shared at this presentation in the final report;
- To prepare a brief narrative report on fulfillment of all the tasks assigned by this ToR.
- Desk review of all relevant materials such as reports, assessments, studies, draft laws, etc. completed and summaries/translations of all key Georgian documents, as needed, provided to the international consultant – by 15 January 2023 (5 working days);
- Evaluation methodology including the instruments finalized and selected guides translated in Georgian– by 15 January 2023 (5 working days);
- Meetings, interviews and focus group discussions in consultation with the international consultant arranged, conducted and relevant summaries prepared – 30 March 2023 (15 working days);
- Support to the international consultant in data analysis and preparing a Power Point Presentation and an outline on preliminary findings and present to ERG and reflect the feedback shared at this presentation in the final report provided (1 working day) - by April 28, 2023 (3 working day).
- Inputs and clarifications provided to the evaluation report prepared by the international consultant – by April 28, 2023 (2 working days);
The timeframe for the work of both national consultants is planned for 15 December 2022 – 30 April 2023 for a total of 30 working days.
- Respect for Diversity
- Awareness and Sensitivity Regarding Gender Issues
- Creative Problem Solving
- Effective Communication
- Inclusive Collaboration
- Stakeholder Engagement
- Leading by Example
Please visit this link for more information on UN Women’s Core Values and Competencies: https://www.unwomen.org/sites/default/files/Headquarters/Attachments/Sections/About%20Us/Employment/UN-Women-values-and-competencies-framework-en.pdf
Required Skills and Experience
- At least a master’s degree in sociology, international development, gender studies or related area;
- At least two years in conducting/supporting evaluations of strategies, policies and projects;
- At least two years of experience in conducting qualitative research, including developing qualitative research instruments, conducting interviews and focus groups and analyzing data
- At least two years of experience in gender equality and/or women’s empowerment issues;
- Excellent writing and reporting skills with ability to prepare minutes and document key findings of the meetings/consultations/interviews;
- Proficiency in English and Georgian
UNEG Ethical Guidance should be applied to the selection of methods for the evaluation and throughout the evaluation process. The consultant will sign the “Evaluation Consultants Agreement Form – UNEG Code of Conduct for Evaluation in the UN System” prior to the initiation of the evaluation process.
The candidates will be evaluated in three stages: according to minimum qualification criteria, technical and financial review.
The candidates must possess following minimum qualification criteria to be eligible for further technical review:
- At least a master’s degree in sociology, international development, gender studies or related area;
- At least two years of experience in gender equality, and/or women’s empowerment issues;
- At least two years of experience in conducting/supporting evaluation of strategies, policies and projects
- Proficiency in English and Georgian.
Technical evaluation criteria (including minimum qualifications):
- At least a master’s degree in sociology, international development, gender studies or related area (max 50 points)
- At least two years of experience in conducting/supporting evaluation of strategies, policies and projects (max 70 points)
- At least two years of experience in conducting qualitative research, including developing qualitative research instruments, conducting interviews and focus groups and analyzing data (max 60 points).
- At least two years of experience in gender equality, and/or women’s empowerment issues (max 70 points)
- Excellent writing and reporting skills with ability to prepare minutes and document key findings of the meeting/consultations/interviews (max 70 points)
- Proficiency in English (max 30 points).
Maximum total technical score amounts to 350 points. Only candidates who have passed over the minimum qualification criteria and have accumulated at least 245 points out of maximum 350 under technical evaluation will qualify for the next stage i.e. evaluation of their financial proposals.
Evaluation of submitted financial offers will be done based on the following formula: S = Fmin / F * 150
S – score received on financial evaluation;
Fmin – the lowest financial offer out of all the submitted offers qualified over the technical evaluation round;
F – financial offer under consideration.
The winning candidate will be the candidate, who has accumulated the highest aggregated score (technical scoring + financial scoring).
Both national consultants will work under the guidance of the International Evaluator. The UN Women M&E Focal Point in Georgia will serve as the evaluation task manager. The evaluation task manager will be responsible for day-to-day management of the review. Coordination in the field including logistical support will be the responsibility of the UN Women Project Team.
Payment will be disbursed upon submission and approval of deliverables and certification by UN Women that the services have been satisfactorily performed as specified below:
- Deliverable 1,2 (10 working days)
- Deliverables 3,4,5,6,7 (20 working days)
Application Submission Package
Application submission package shall include:
- Duly filled Personal History Form PHF11 that can be downloaded from: https://www.unwomen.org/en/about-us/employment/application-process
- A sample of previously conducted / most relevant evaluation report;
- Two financial proposals with two possible scenarios (one including travel to regions of Georgia to undertake field visits and second – including online interviews and focus groups adjusting to the Covid-19 situation) - lump sum proposal/offer* in GEL (including breakdown of this lump sum amount, indicating all necessary costs to complete this assignment).
*The applicants are required to submit an aggregated financial offer: “aggregated financial offer” is the total sum of all financial claims of the candidate, including travel costs (ticket, DSA etc.) for accomplishment of all tasks spelled out in this ToR.
Only short-listed candidates will be contacted.
At UN Women, we are committed to creating a diverse and inclusive environment of mutual respect. UN Women recruits, employs, trains, compensates, and promotes regardless of race, religion, color, sex, gender identity, sexual orientation, age, ability, national origin, or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, competence, integrity and organizational need.
If you need any reasonable accommodation to support your participation in the recruitment and selection process, please include this information in your application.
UN Women has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and UN Women, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination. All selected candidates will be expected to adhere to UN Women’s policies and procedures and the standards of conduct expected of UN Women personnel and will therefore undergo rigorous reference and background checks. (Background checks will include the verification of academic credential(s) and employment history. Selected candidates may be required to provide additional information to conduct a background check.)
- UNEG Code of Conduct for Evaluations 
- UNEG Ethical Guidelines
- UNEG Norms for Evaluation in the UN System
- UNEG Standards for Evaluation in the UN System
- UNEG Guidance Integrating Human Rights and Gender in the UN System
- UN Women Evaluation Handbook
- UN SWAP Evaluation Performance Indicator and related Scorecard
- Evaluation Consultants Agreement Form