Mid-Term Evaluation Expert-TVET 2

OVERVIEW

Parent Sector : Education Sector (ED)

Duty Station: Baghdad

Job Family: Education

Type of contract : Non Staff

Duration of contract : From 1 to 6 months

Recruitment open to : External candidates

Application Deadline (Midnight Paris Time) : 15.08.2022

 

UNESCO Core Values: Commitment to the Organization, Integrity, Respect for Diversity, Professionalism

 

The UNESCO Office for Iraq is seeking a qualified external evaluator for the Mid-Term evaluation of the TVET2 Project “Jobs Creation Through Technical & Vocational Education System Strengthening & Labor Market Linkages”.
 

Long Description

1. Background

Following the successful completion of the “Reforming Technical and Vocational Education and Training in Iraq” Phase 1 project ended in 2020. UNESCO built on Phase I successful implementation and started “Jobs Creation Through Technical & Vocational Education System Strengthening & Labor Market Linkages”, Phase II of the project TVET (TVET 2) with continued funding support from the European Union.  
The overall goal (impact) of TVET 2 is to ensure increased access to inclusive skills development services and assets, contributing to improved employability and socio-economic status.  
To achieve this goal, the project has set three different outcomes with specific outputs as mentioned below:

1.    Outcome 1: Strengthened MoE national and Directorate systems and capacities for quality management, curriculum, and labour market alignment for vocational education. 

2.    Outcome 2: Enhanced the performance of selected vocational schools to create Centres of Excellence.

3.    Outcome 3: Developed higher education institutions’ systems and leadership for meeting local skills needs and international recognition of qualifications
 

 

Long Description

2. Purpose and objectives of the assignment

The purpose of the evaluation will be primarily summative. The evaluation will assess the project performance, and will have two formative purposes: (1) The evaluation's findings/recommendations are expected to provide UNESCO with further guidance on implementation of future planned activities (2) Measure the potential contributions of the project's deliverables on stakeholders and beneficiaries. 

The overall objective of the evaluation is to assess the level of project performance considering the project environment and thus implementation modalities, timeframe, and financial commitments. This will include: 

•    Using the following evaluation criteria: assess issues of effectiveness, efficiency, relevance, sustainability and coordination;
•    Generate lessons and good practices of the project. 
•    Offer recommendation(s) for the most appropriate next steps
 

Long Description

3. Scope (geographical, target groups, criteria and questions)

 

I.    The geographical scope of the TVET 2 Project is the Republic of Iraq (Baghdad, Basra, Karbala, Ninawa) and Kurdistan Region of Iraq (Erbil, Sulaymaniyah, Dohuk)

II.    Target Groups
The project target groups are represented via the following Key-stakeholders: 
1.    Projects’ official stakeholders (PMAC, MoLSA, MoHESR, MoE, MoP; Project Steering Committee, and relevant KRG ministries) 
2.    Beneficiaries (vocational centres, vocational schools and technical/polytechnic universities; private sector, teachers and TVET leaders and learners) 
3.    UNESCO staff involved in project execution. 

4. Main Evaluation Questions

 

Generally, some questions can lead the evaluator(s) to tackle the essence of the evaluation process by providing answers to the following: 
•    Are the objectives of the project relevant in light of challenges the Iraqi TVET sector is confronted with? 
•    Considering the given/prevailing project framework conditions on the ground in Iraq, did the chosen mode of delivery under the TVET 2 project provide/allow for an efficient implementation process? 
•    Did the project design, and chosen approaches, as well as methodologies applied by TVET 2 project address the development needs of the Iraqi TVET sector administration effectively? 
•    How does the beneficiary safeguard the sustainability of project outcomes and outputs towards an improved capability in applied and strategic TVET management? 

The criteria, however, based on which the evaluation should be carried out, essentially focuses on the following key dimensions (exemplified questions are provided for orientation):
1.    Relevance 
2.    Effectiveness 
3.    Efficiency 
4.    Sustainability 
5.    Visibility
 

5. Methodology

 
The evaluation will be carried out by an external evaluator who has no previous links to the project in conformity with the principles, standards, and practices set out in the DAC evaluation quality standards. The evaluation requires a participatory methodology whereby all key stakeholders including, implementing partners, government stakeholders, beneficiaries, and UNESCO staff are engaged in the process. 
The methodology of the evaluation should include the collection of information/data from primary and secondary sources by using at a minimum the following mixed methods: 
•    Desk review of project-related documentation and other relevant documents to facilitate the formulation of the evaluation questions. Review of the log-frame/results framework, annual and progress reports, and other related materials; assessment of results and deviations from planned activities and outputs 
•    Key informant interviews and/or focus group discussions with UNESCO staff in addition to key partners and beneficiaries in Baghdad, Basra, Karbala, Ninawa, and Kurdistan Region of Iraq (Erbil, Sulaymaniyah, Dohuk), members of the project steering committee, training participants, the European Union delegation in Baghdad 
•    Questionnaires and surveys addressed as appropriate to groups of stakeholders at various levels in this respect, UNESCO have developed an evaluation matrix for field work questions (see Table 2). It will be the evaluator/s’ responsibility to further develop and refine this based on the desk review. Given the scale of the work, UNESCO will contract a local survey company to undertake fieldwork under the supervision of the evaluator 
•    Selected field visits to meet with the local stakeholders, beneficiaries and partners involved in the implementation of the projects, including interviews with direct beneficiaries 
•    Participatory workshops to steer the evaluation and to discuss findings and recommendations. 
 

6. Roles and Responsibilities

The mid-term evaluation of the TVET 2 project will be managed by UNESCO Iraq Office in coordination with EU as the donor. The evaluator will be responsible for his/her logistical needs including travel to and within Iraq, accommodation,   laptop, administrative support, translation, meeting arrangements, collecting data, dissemination, and printing of questionnaires. S/He will be responsible for the dissemination of methodological tools such as surveys, observation checklists, etc. UNESCO's team will facilitate the process to the extent possible by providing relevant documents, contact information of and appointment with relevant stakeholders that will be consulted during the evaluation. The team will provide guidance, comments and feedback on the Inception Report and draft Evaluation Report, sharing the ToR, and report with the stakeholders/partners for their comments. The external evaluator will provide UNESCO with the Inception Report including questionnaires and data analysis methodology.
 

7. Deliverables 

The evaluation will have four main deliverables (to be written in English): (1) a Kick-off meeting, (2) an Inception Report including the related evaluation matrix, (3) draft Evaluation Report and (4) final Evaluation Report. These deliverables are the responsibility of the external evaluator with inputs from UNESCO: 

Deliverable 1: 

Kick-off meeting discussion of the assignment takes place. First documents, including available data, are provided to the evaluation team

Deliverable 2:

 Evaluation Inception Report (10 pages maximum excluding annexes) prior to visit to Iraq will outline in detail the key scope of the work; a work plan/schedule of tasks; evaluation methodology, refined design and questions; proposed methods; sources of data; data collection plan (proposed list of people to be interviewed), as well as an evaluation matrix showing the relationship between the evaluation questions and methods of data collection and analysis 

Deliverable 3: 

Detailed draft of Evaluation Report (30 pages maximum excluding annexes): 
The Report content should at least follow the following: 
•    Executive summary (maximum 10 pages) that encapsulates the essence of the key-findings, conclusions, lessons learnt 
•    Introduction 
•    Background information 
•    Purpose and objectives 
•    Scope and Methodology 
•    Cross-cutting key findings with clear evidence: Relevance, Efficiency, effectiveness, Sustainability and Visibility 
•    Lessons learnt (successes and challenges) 
•    Recommendations 
•    Overall conclusions 
•    Annexes: including the list of stakeholders consulted during the evaluation, key documents reviewed, evaluation Terms of Reference, data collection instruments, budgetary analysis, etc. 
Deliverable 4:

Final Evaluation Report responding to comments and questions 

Additional clarification on the report content: 

A description and assessment of the intervention logic and the evaluation framework overarching the relevance, efficiency, effectiveness, efficiency, sustainability, and visibility of the project: 
•    A clear and concise view on findings regarding relevance, efficiency, effectiveness, efficiency, sustainability and visibility. 
•    an explanation of the resources that have been made available to the project, timeliness of availability, their use and the extent to which they were used in accordance with project agreement(s); changes in (specifically contractually agreed) government support provided to the project; and, 
•    recommendations on how to improve project delivery reflecting on relevance, efficiency, effectiveness, efficiency, sustainability, and visibility. 

Timeframe (tentative, to be finalized in the Inception Report): 
•    Duration: 9 weeks 
o    Week 1-2: kick off meeting, desk research, and Inception Report 
o    Week 3-6: in-country – a combination of the evaluator(s) and survey company (TBC) (data collection, field visits, presentation of initial findings and draft Evaluation Report) 
o    Week 8-9: write-up (Final Evaluation Report) 
•    A mission to Iraq and the Kurdistan Region of Iraq will be required 
•    Remuneration will be paid monthly based on the deliverables completed and consultant’s proposal below being accepted by UNESCO. 
All submitted reports/materials should be in English 
 

8. Qualifications and Experience

•    Advanced university degree, with demonstrated expertise at national and international levels 
•    At least 10 years of relevant experience in evaluations including similar complex, large-scale international development projects in conflict settings 
•    At least 10 years of relevant experience in the education/training sector; knowledge of TVET would be an advantage 
•    Excellent planning and reporting skills 
•    Good facilitation skills; excellent communication capabilities; ability to adapt to dynamic environments 
•    Excellent knowledge of English.  Arabic is desirable.
•    A commitment to UN 
 

9. Application Process

Interested candidates should click on “Apply Now”, then download and complete the Employment History form (Word file). At the end of the Word file, insert extra pages with the following required information in English:

A Technical Proposal; should consist of:
a)    A description of your proposed approach and methodology for undertaking the assignment (5 pages only).
b)    Work plan, including description of key deliverables/ milestones (in Gantt chart)
c)    An up-to-date curriculum vitae
d)    A detailed financial proposal
A financial Proposal should consist of:
A monthly rate payable against meeting deliverables in that month
A travel expenses/ Lump sum to cover the mission to Iraq which will be paid against actual expenses incurred
Other documents:
e)    List of work assignments and/or three (3) contacts as references 
It is the individual’s responsibility to ensure that his/her proposal is received by the deadline.
 

COMPETENCIES (Core / Managerial) Accountability (C) Communication (C) Innovation (C) Knowledge sharing and continuous improvement (C) Planning and organizing (C) Results focus (C) Teamwork (C) Professionalism (C) - For detailed information, please consult the UNESCO Competency Framework. SELECTION AND RECRUITMENT PROCESS

Please note that all candidates must complete an on-line application and provide complete and accurate information. To apply, please visit the UNESCO careers website. No modifications can be made to the application submitted.

The evaluation of candidates is based on the criteria in the vacancy notice, and may include tests and/or assessments, as well as a competency-based interview. 

UNESCO uses communication technologies such as video or teleconference, e-mail correspondence, etc. for the assessment and evaluation of candidates.

Please note that only selected candidates will be further contacted and candidates in the final selection step will be subject to reference checks based on the information provided.

Footer

UNESCO recalls that paramount consideration in the appointment of staff members shall be the necessity of securing the highest standards of efficiency, technical competence and integrity. UNESCO applies a zero-tolerance policy against all forms of harassment. UNESCO is committed to achieving and sustaining equitable and diverse geographical distribution, as well as gender parity among its staff members in all categories and at all grades. Furthermore, UNESCO is committed to achieving workforce diversity in terms of gender, nationality and culture. Candidates from non- and under-represented Member States (last update here) are particularly welcome and strongly encouraged to apply. Individuals from minority groups and indigenous groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the highest level of confidentiality. Worldwide mobility is required for staff members appointed to international posts.

UNESCO does not charge a fee at any stage of the recruitment process.