Evaluation Consultant

Result of Service - Inception report – draft and final - PowerPoint presentation of findings, conclusions and recommendations - Draft and final - Assessment reports – draft and final

Work Location Montréal, Canada and/or working remotely

Expected duration The selected consultant is expected to be employed within the period of 15 June – 31 November 2022 for 50 working days.

Duties and Responsibilities THE ORGANIZATIONAL SETTING

The International Civil Aviation Organization (ICAO ) is a specialized UN agency, which is funded and directed by 193 national governments to support their diplomacy and cooperation in air transport as signatory states to the Chicago Convention. ICAO’s mission is to serve as the global forum of States for international civil aviation. In that regard, ICAO develops policies and Standards, undertakes compliance audits, performs studies and analyses, provides assistance and builds aviation capacity through many other activities and the cooperation of its Member States and stakeholders. International civil aviation is an enabler of socio-economic development at the national, regional and global levels and supports the achievement of the United Nations 2030 Sustainable Development Goals (SDGs).

The Office of Internal Oversight (OIO) is responsible for the systematic evaluation and internal audit of ICAO's programmes, projects, and activities, with a view to assessing whether the Organization's stated objectives and impacts have been achieved, and resources have been expended in accordance with applicable rules and regulations and with due regard to economy, efficiency and effectiveness. The Office provides an annual report of its evaluations and internal audits to the ICAO Council.

Evaluation is mainly focused on assessing the relevance, effectiveness, efficiency, impact and sustainability of programmes and activities against established plans and objectives. Internal audit ensures that a system of cost-effective internal controls has been established to mitigate potential risks to the Organization, to ensure compliance with policies, regulations, rules and administrative directives, and to ensure accountability for the proper, efficient and economical use of resources, consistent with organizational objectives and applicable best practices.

MAJOR DUTIES AND RESPONSIBILITIES

Under the general guidance of the Chief, Office of Internal Oversight (OIO), and reporting to the Evaluation Specialist, the consultant will assess the effectiveness of ICAO’s engagement with Member States and examine the needs and expectations of Member States over the next 5 – 10 years. The assessment is expected to identify priority needs of Member States in different strategic areas of ICAO and suggest best possible approach to meet the demands of Member States. The assessment is expected to provide input to the ICAO strategic planning process.

Function 1 (incl. Expected results) Drafts Inception report and designs the method, timing and tools of the assessment Inception report will be prepared by the consultant after an initial review of relevant documents and interview of the users of the assessment report. The inception report will set out the conceptual framework to be used in the assessment, the key questions to be answered by the assessment, a work plan and methodology, including information on data sources and collection methods. The consultant is expected to follow a participatory and consultative approach ensuring close engagement with ICAO Council, Secretary General, SPCP, Directors and staff of Headquarter Bureaus and Regional Offices and other key stakeholders. The consultant will:

• Prepare the Inception report in which s/he will provide clarification on the detailed methodology and timing of the assessment in accordance with the TORs; and
• Design data collection tools (to be attached as part of the inception report).

Function 2 (incl. Expected results) Collects and analyses data The consultant will review all relevant sources of information, such as previous assessment reports (including the 2015 & 2018 evaluation of the needs and expectations of Member States), ICAO Business Plans and Operating Plans, Assembly resolutions and decisions, reports, guidance documents and manuals, etc., and any other materials that s/he considers useful for this evidence-based assessment. A list of documents will be provided to the consultant. In addition, the consultant will:

• Collect data from existing ICAO information systems and platforms;
• Collect and analyse data and information through interviews and surveys from Member States, staff other relevant partners;
• Prepare summary interview notes;
• Perform qualitative and quantitative analysis of data/information and technical quality assurance; and
• Prepare and present initial findings in Power Point.

Function 3 (incl. Expected results) Identifies priority needs of Member States and develops actionable recommendations and draft Assessment Report The report should be prepared and presented following the TOR report outline clearly responding to the assessment questions:

• Prepare the draft report following the report outline in the TOR;
• Collect and analyse comments received during the briefing and address them as necessary
• Submit final Assessment Report; and
• Provide a briefing to the Strategic Planning, Coordination and Partnerships Office (SPCP) and Strategic Planning team

Function 4 (incl. Expected results) Performs other duties, as assigned

Qualifications/special skills Academic Qualifications:

An advanced level university degree (Masters’ degree or equivalent) in an aviation-related field, management, evaluation, economics, social science or any other related field is required. A first-level university degree in combination with additional years of qualifying experience may be accepted in lieu of the advanced university degree.

Experience: Essential: - A minimum of 10 years of professional experience in evaluation with strong experience in capacity needs assessment; - Strong management and monitoring and evaluation experience and M&E approaches (including quantitative, qualitative and participatory), information analysis and report writing; - Familiarity in dealing with State Representatives as well as governmental and non-governmental entities at different levels. - Knowledge and experience of the UN System; - Excellent communication and interview skills; - Excellent report writing skills in English; and - Demonstrated ability to deliver quality results within strict deadlines.

Desirable: - Extensive knowledge of and experience in the management and implementation of aviation programmes and projects at international, regional or national levels. - Thorough knowledge of the Convention on International Civil Aviation, ICAO Standards and Recommended Practices (SARPs) - Experience working at a management level or in an advisory capacity in areas related to aviation safety, security and air navigation.

Language: Essential

• Fluent reading, writing and speaking abilities in English.

Desirable - A working knowledge of a second language of the Organization (Arabic, Chinese, French, Russian, or Spanish).

Additional Information The consultant will be held to the highest ethical standards and are required to sign a Code of Conduct and an individual declaration of independence (or statement of confidentiality) upon acceptance of the assignment. This assessment/evaluation shall be conducted in accordance with UNEG Standards.

No Fee THE UNITED NATIONS DOES NOT CHARGE A FEE AT ANY STAGE OF THE RECRUITMENT PROCESS (APPLICATION, INTERVIEW MEETING, PROCESSING, OR TRAINING). THE UNITED NATIONS DOES NOT CONCERN ITSELF WITH INFORMATION ON APPLICANTS’ BANK ACCOUNTS.