Evaluation Consultant, OIO

Result of Service

• Inception report – draft and final
• Summary Interview Note
• PowerPoint presentation of preliminary findings, conclusions and recommendations - Draft and final
• Evaluation reports – draft and final

Work Location

Montréal, Canada

Expected duration

The selected consultant is expected to be employed within the period of 27 March to 31 October 2023 for 50 working days.

Duties and Responsibilities

THE ORGANIZATIONAL SETTING

The mandate of The Office of Internal Oversight (OIO) is to assist the Secretary General in ensuring that ICAO is managed effectively, efficiently and economically and in conformity with the applicable regulations and rules, and to provide him/her with independent and objective assurance, advice, insight and foresight through performing internal audits, evaluations, and other oversight assignments. OIO assesses and contributes to the improvement of governance, risk management, and control processes; and to the improvement of programme management and achievement of results, using a systematic and disciplined approach that ensures accountability for the effective and efficient use of organizational resources in accordance with the approved Budget and Business Plan.

Evaluation is mainly focused on assessing the relevance, effectiveness, efficiency, impact and sustainability of programmes and activities against established plans and objectives. Internal audit ensures that a system of cost-effective internal controls has been established to mitigate potential risks to the Organization, to ensure compliance with policies, regulations, rules and administrative directives, and to ensure accountability for the proper, efficient and economical use of resources, consistent with organizational objectives and applicable best practices.

MAJOR DUTIES AND RESPONSIBILITIES

Under the general guidance of the Chief, Office of Internal Oversight (OIO), and reporting to the Evaluation Specialist, the evaluation consultant will assess the Regional Portfolio of North American, Central American and Caribbean (NACC) Office, conduct analysis of findings, and produce evaluation reports with practical recommendations. The overall objective of the evaluation is to examine the relevance, effectiveness, and efficiency of the NACC Office in addressing regional priorities and Member States aviation objectives and identify lessons, best practices, and provide recommendations for improvement. The consultant will conduct the evaluation in line with the Norms and Standards for Evaluation in the United Nations System approved by the United Nations Evaluation Group (UNEG) in April 2016.

Function 1 (incl. Expected results)

Develops and finalizes the drafts Inception report and tools.

The Inception report will provide evidence-based information that is credible, reliable, and useful. The evaluation consultant is expected to develop inception report and data collection tools under the supervision and in consultation with the evaluation specialist and key stakeholders both in Montreal and NACC Regional Office.

Function 2 (incl. Expected results)

Collects and analyses data for the evaluation.

The Evaluation Consultant reviews all relevant sources of information, such as the Business Plans, NACC Regional Office Operating Plans, project documents, Global Plans, PIRGs/RASGs plans and different Bureaus, programmes, plans, projects, reports, etc., and any other materials that the Consultant considers useful for this evidence-based assessment. A list of documents will also be provided to the Consultant. In addition, the Evaluation Consultant, with the support of the Evaluation Specialist:

• Collects data from existing ICAO information systems;
• Collects data and information through face to face and/or virtual interviews and surveys as well as other data collection methods from ICAO Headquarters, Regional Office, Member States and projects;
• Prepares summary interview notes;
• Analyses data/information and performs technical quality assurance of the interpretation of the results of such analyses; and
• Prepares and presents initial findings in Power Point.

Function 3 (incl. Expected results)

Develops conclusions and actionable recommendations and drafts Evaluation Report.

The report should be prepared and presented following the guidance document clearly responding to the evaluation questions under each criterion. The consultant, with the support from the evaluation Specialist:

• Prepares the draft report following the evaluation report outline and the TOR;
• Collects and analyses comments received during the briefing and address them as necessary;
• Submits final Evaluation Report.

Function 4 (incl. Expected results)

Performs other duties, as assigned

Qualifications/special skills

Educational background:

An advanced level university degree (Masters’ degree or equivalent) in an aviation-related field, evaluation, economics, engineering, business management, social science or any other related field is required. A first-level university degree in combination with additional years of qualifying experience may be accepted in lieu of the advanced university degree.

Professional experience and knowledge:

• A minimum of 10 years of professional experience in evaluation, specifically in evaluating projects and programmes, is required;
• Experience in project management, is required;
• Familiarity in dealing with State Representatives as well as governmental and non-governmental entities at different levels, is required;
• Sound knowledge of RBM systems and strong Monitoring and Evaluation (M&E) experience, and M&E approaches (including quantitative, qualitative and participatory), information analysis and report writing, is required;
• Knowledge and experience of the UN System, is required;
• Experience in using UNEG Norms and Standards for evaluation, is required;
• Excellent communication and interview skills, is required;
• Excellent report writing skills, is required;
• Demonstrated ability to deliver quality results within strict deadlines, is required.
• Experience in evaluating aviation related projects in NACC Region, is desirable;
• Experience in evaluating regional projects, is desirable;
• Extensive knowledge of and experience in the management and implementation of aviation programmes and projects at international, regional or national levels, is desirable;
• Thorough knowledge of the Convention on International Civil Aviation, ICAO Standards and Recommended Practices (SARPs), is desirable;
• Experience working at a management level or in an advisory capacity in areas related to aviation safety and air navigation, is desirable.

Languages

Essential:

• Fluent reading, writing and speaking abilities in English and Spanish

Desirable:

• A working knowledge of a second language of the Organization (Arabic, Chinese, French or Russian)

Additional Information

Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct upon acceptance of the assignment. This Evaluation shall be conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations'.

No Fee

THE UNITED NATIONS DOES NOT CHARGE A FEE AT ANY STAGE OF THE RECRUITMENT PROCESS (APPLICATION, INTERVIEW MEETING, PROCESSING, OR TRAINING). THE UNITED NATIONS DOES NOT CONCERN ITSELF WITH INFORMATION ON APPLICANTS’ BANK ACCOUNTS.