Evaluation Consultant, OIO
Conduct evaluations and produce reports for ICAO's oversight programs.
Overview
Conduct evaluations and produce reports for ICAO's oversight programs.
You have:
- An advanced level university degree (Masters’ degree or equivalent) in an aviation-related field, evaluation, economics, engineering, business management, social science or any other related field is required.
- A minimum of 10 years of professional experience in evaluation, specifically in evaluating projects and programmes, is required.
- Experience in project management, is required.
- Familiarity in dealing with State Representatives as well as governmental and non-governmental entities at different levels, is required.
- Sound knowledge of RBM systems and strong Monitoring and Evaluation (M&E) experience, and M&E approaches (including quantitative, qualitative and participatory), information analysis and report writing, is required.
- Knowledge and experience of the UN System, is required.
- Experience in using UNEG Norms and Standards for evaluation, is required.
- Excellent communication and interview skills, is required.
- Excellent report writing skills, is required.
- Demonstrated ability to deliver quality results within strict deadlines, is required.
- Experience in evaluating aviation related projects in NACC Region, is desirable.
- Experience in evaluating regional projects, is desirable.
- Extensive knowledge of and experience in the management and implementation of aviation programmes and projects at international, regional or national levels, is desirable.
- Thorough knowledge of the Convention on International Civil Aviation, ICAO Standards and Recommended Practices (SARPs), is desirable.
- Experience working at a management level or in an advisory capacity in areas related to aviation safety and air navigation, is desirable.
- Fluent reading, writing and speaking abilities in English and Spanish
- A working knowledge of a second language of the Organization (Arabic, Chinese, French or Russian)
Result of Service - Inception report – draft and final - Summary Interview Note - PowerPoint presentation of preliminary findings, conclusions and recommendations - Draft and final - Evaluation reports – draft and final
Work Location Montréal, Canada
Expected duration The selected consultant is expected to be employed within the period of 27 March to 31 October 2023 for 50 working days.
Duties and Responsibilities THE ORGANIZATIONAL SETTING
The mandate of The Office of Internal Oversight (OIO) is to assist the Secretary General in ensuring that ICAO is managed effectively, efficiently and economically and in conformity with the applicable regulations and rules, and to provide him/her with independent and objective assurance, advice, insight and foresight through performing internal audits, evaluations, and other oversight assignments. OIO assesses and contributes to the improvement of governance, risk management, and control processes; and to the improvement of programme management and achievement of results, using a systematic and disciplined approach that ensures accountability for the effective and efficient use of organizational resources in accordance with the approved Budget and Business Plan.
Evaluation is mainly focused on assessing the relevance, effectiveness, efficiency, impact and sustainability of programmes and activities against established plans and objectives. Internal audit ensures that a system of cost-effective internal controls has been established to mitigate potential risks to the Organization, to ensure compliance with policies, regulations, rules and administrative directives, and to ensure accountability for the proper, efficient and economical use of resources, consistent with organizational objectives and applicable best practices.
MAJOR DUTIES AND RESPONSIBILITIES
Under the general guidance of the Chief, Office of Internal Oversight (OIO), and reporting to the Evaluation Specialist, the evaluation consultant will assess the Regional Portfolio of North American, Central American and Caribbean (NACC) Office, conduct analysis of findings, and produce evaluation reports with practical recommendations. The overall objective of the evaluation is to examine the relevance, effectiveness, and efficiency of the NACC Office in addressing regional priorities and Member States aviation objectives and identify lessons, best practices, and provide recommendations for improvement. The consultant will conduct the evaluation in line with the Norms and Standards for Evaluation in the United Nations System approved by the United Nations Evaluation Group (UNEG) in April 2016.
Function 1 (incl. Expected results)
Develops and finalizes the drafts Inception report and tools.
The Inception report will provide evidence-based information that is credible, reliable, and useful. The evaluation consultant is expected to develop inception report and data collection tools under the supervision and in consultation with the evaluation specialist and key stakeholders both in Montreal and NACC Regional Office.
Function 2 (incl. Expected results)
Collects and analyses data for the evaluation.
The Evaluation Consultant reviews all relevant sources of information, such as the Business Plans, NACC Regional Office Operating Plans, project documents, Global Plans, PIRGs/RASGs plans and different Bureaus, programmes, plans, projects, reports, etc., and any other materials that the Consultant considers useful for this evidence-based assessment. A list of documents will also be provided to the Consultant. In addition, the Evaluation Consultant, with the support of the Evaluation Specialist:
- Collects data from existing ICAO information systems;
- Collects data and information through face to face and/or virtual interviews and surveys as well as other data collection methods from ICAO Headquarters, Regional Office, Member States and projects;
- Prepares summary interview notes;
- Analyses data/information and performs technical quality assurance of the interpretation of the results of such analyses; and
- Prepares and presents initial findings in Power Point.
Function 3 (incl. Expected results)
Develops conclusions and actionable recommendations and drafts Evaluation Report.
The report should be prepared and presented following the guidance document clearly responding to the evaluation questions under each criterion. The consultant, with the support from the evaluation Specialist:
- Prepares the draft report following the evaluation report outline and the TOR;
- Collects and analyses comments received during the briefing and address them as necessary;
- Submits final Evaluation Report.
Function 4 (incl. Expected results)
Performs other duties, as assigned
Qualifications/special skills Educational background:
An advanced level university degree (Masters’ degree or equivalent) in an aviation-related field, evaluation, economics, engineering, business management, social science or any other related field is required. A first-level university degree in combination with additional years of qualifying experience may be accepted in lieu of the advanced university degree.
Professional experience and knowledge:
- A minimum of 10 years of professional experience in evaluation, specifically in evaluating projects and programmes, is required;
- Experience in project management, is required;
- Familiarity in dealing with State Representatives as well as governmental and non-governmental entities at different levels, is required;
- Sound knowledge of RBM systems and strong Monitoring and Evaluation (M&E) experience, and M&E approaches (including quantitative, qualitative and participatory), information analysis and report writing, is required;
- Knowledge and experience of the UN System, is required;
- Experience in using UNEG Norms and Standards for evaluation, is required;
- Excellent communication and interview skills, is required;
- Excellent report writing skills, is required;
- Demonstrated ability to deliver quality results within strict deadlines, is required.
- Experience in evaluating aviation related projects in NACC Region, is desirable;
- Experience in evaluating regional projects, is desirable;
- Extensive knowledge of and experience in the management and implementation of aviation programmes and projects at international, regional or national levels, is desirable;
- Thorough knowledge of the Convention on International Civil Aviation, ICAO Standards and Recommended Practices (SARPs), is desirable;
Experience working at a management level or in an advisory capacity in areas related to aviation safety and air navigation, is desirable.
Languages Essential:
Fluent reading, writing and speaking abilities in English and Spanish
Desirable:
A working knowledge of a second language of the Organization (Arabic, Chinese, French or Russian)
Additional Information Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct upon acceptance of the assignment. This Evaluation shall be conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations'.
No Fee THE UNITED NATIONS DOES NOT CHARGE A FEE AT ANY STAGE OF THE RECRUITMENT PROCESS (APPLICATION, INTERVIEW MEETING, PROCESSING, OR TRAINING). THE UNITED NATIONS DOES NOT CONCERN ITSELF WITH INFORMATION ON APPLICANTS’ BANK ACCOUNTS.
Potential interview questions
| Can you provide an example of a challenging evaluation you conducted and how you approached it? | This question assesses your problem-solving skills and approach to evaluation challenges. | Describe the evaluation, its challenges, and the strategies you implemented to overcome them. |
| What methods do you use to ensure data integrity during evaluations? | The interviewer wants to understand your approach to data collection and analysis validity. | Pro members can see the explanation. |
| How do you manage stakeholder expectations during an evaluation? | Pro members can see the explanation. | Pro members can see the explanation. |
| Describe your experience with United Nations evaluation standards. | Pro members can see the explanation. | Pro members can see the explanation. |
| Can you give an example of how your recommendations have been implemented after an evaluation? | Pro members can see the explanation. | Pro members can see the explanation. |