By continuing to browse this site, you agree to our use of cookies. Read our privacy policy

National Evaluator

Tripoli (Libya)

  • Organization: CTG - Committed To Good
  • Location: Tripoli (Libya)
  • Grade: Level not specified
  • Occupational Groups:
    • Monitoring and Evaluation
  • Closing Date: 2021-04-25

Click "SAVE JOB" to save this job description for later.

Sign up for free to be able to save this job for later.

CTG Overview CTG stands for Committed To Good. With an ethical approach at the heart of all that we do, it is a description that makes us proud. Respect for the fundamental human rights of our staff, and those our staff encounter, is a cornerstone of our values. We strive for gender equality, inclusion and diversity, providing fair and equal opportunities for all. We take a zero tolerance approach to corruption and stay true to local labour laws and all local statutory requirements.
In operation since 2006, today we are honoured to serve clients in 15 fragile and conflict-affected states assisting with disaster relief, peace building, humanitarian aid and development programmes through our specialised recruitment, HR management and operational services.
Overview of position
The Stabilization Facility for Libya (SFL) is an immediate stabilization initiative that provides quick rehabilitation of critical infrastructure, and enhances the engagement between the central government and municipalities. The Stabilization Facility will repair light infrastructure within the conflict affected areas to reverse the physical disruption caused by the conflict, and enable the reopening of key services at the municipal level.  It may also support quick recovery of businesses that are critical to the survival of whole communities through rehabilitation and provision of equipment.

The Stabilization Facility will undertake rehabilitation of light infrastructure and critical businesses destroyed by conflict in East, West and South Libya.

The project will support the following types of infrastructure rehabilitation:
  • key public infrastructure including clinics, hospitals, schools and police stations and government buildings;
  • rehabilitation of waste water treatment facilities, and water networks;
  • rehabilitation of power stations, electricity networks, power grids and other destroyed electricity infrastructure;
  • Rehabilitation of roads and bridges;
  • Rehabilitation of small businesses that are critical to the community (e.g. bakeries).

The project will also require provision of equipment that will complement the works, including:
  • Provision of equipment including alternative electricity sources.
  • Provision of equipment to small businesses being rehabilitated.

The first step of the project will be to undertake a participatory rapid needs assessment in the first three locations where the Stabilization Facility will start working in, including a location in the East, West and South Libya.





 
Role objectives
The independent evaluation will focus on the 2nd phase of the Stabilization Facility project which started 1 January 2019 and cover the period from 1 January 2019 to 31 December 2020.  The evaluation will be conducted over a duration of 68 days with pre-identified number of working days for each evaluator under “ duration of work section page 7 & 8.  . The evaluation must address two main issues: the extent to which the Facility was able to adapt to changes in operating context brought on by the fighting in Tripoli in early April 2019 which persisted for more than one year and on the impact of the Covid-19 pandemic.  The SFL went through an in-depth review in 2018 which led to an approach for the 2nd phase of the Facility (1 January 2019 – 31 December 2021).  The evaluation should address a) the shift in the project outcome in the new phase to the promotion of stronger legitimate and internationally recognized state authorities and national unity, b) how the introduction of local stabilization goals to the Theory of Change has made a difference in the project implementation; and c) how far the changes in project structure and methodology set out in the 2nd phase project document have been reflected in practice and what reasons underlay that outcome.

In assessing the Project, the evaluation will take into consideration the following evaluative dimensions and questions:
 
  1. The validity of the Design and Relevance:

The extent to which the project strategy, proposed activities and expected outputs and outcomes are justified and remain relevant to beneficiaries’ assessed needs, country’s policies and donor’s priorities.  More specifically, the relevance of the project should be assessed through the following questions:
  • To what extent is the intervention strategically relevant to fulfil its political objective as stated in the Project Document? 
  • To what extent are the revised objectives for the 2nd phase of the Facility still relevant given the continued political instability, Libya’s financial crisis, and the impact of COVID-19 pandemic?
  • Is there evaluation evidence which indicates that SFL’s work on locally based stabilization (though an instrument like the SFL) is relevant to support political settlements?
  • Has the project put in place a mechanism to understand and design specific interventions to address the issues of women, girls and boys?
  • Is the SFL’s Theory of Change – national and local – valid?  What changes, further assumptions or additional risk management might be required to give it greater purchase?
  • Has the SFL provided a relevant response to the COVID crisis?
 
  1. Efficiency of resource used

The extent to which the project resources (funds, expertise/human resources, time, etc.) are optimally used and converted into intended outputs. More specifically, the efficiency of the project should be assessed through the following guiding questions:
  • To what extent has the SFL adopted the changes in structure, processes and methodology set out in the project document for the 2nd phase?
  • To what extent has SFL adapted to the COVID emergency to ensure efficiency in implementation?
  • To what extent have SFL’s communications efforts contributed to efficient implementation?  Are the resources for communication (with donors, with Government, with Libyan citizens, and with donor taxpayers) appropriate? Has the project communicated the perspective of women in their role in peacebuilding? Has the project been able to communicate benefits for women and girls?
  • Is SFL’s risk matrix fit for purpose?  Is the risk management approach appropriate?
Does the risk matrix include or distinguish issues as relates to women in their role in peacebuilding and the specific risks faced by women and young girls?
 
  1. Effectiveness

Effectiveness the extent to which the project’s expected outputs and outcomes are being achieved or are expected to be achieved. Factors contributing to or detracting from the achievement of the project desired results and objectives should also be included in the assessment. More specifically, the effectiveness of the project should be assessed through the following guiding questions:
  • Is the sequence of Output 3-Output 2-Output 1 being reflected in practice?  Is it working effectively?  Are there trade-offs (e.g. with speed of visible delivery) which might merit revisiting the concept or its implementation? Has the SFL’s revised approach to Output 3 been sound in principle?  Has it worked?  What factors have made it more or less effective?
  • What factors have influenced the ability of SFL to deliver its results? Has the impact of the Covid-19 pandemic affected implementation of project activities? To what extent has SFL adapted and responded to any factors affecting its implementation? Has the project put in place a mechanism to understand and design specific interventions to address the issues of women, girls and boys?
  • To what extent has the SFL provided a relevant response to the COVID crisis? In what ways has the pandemic affected overall implementation?
Has the project responded effectively to the specific needs of women, girls and boys, especially with regards to the identification of stabilization goals and the identification of priority investments in support of stabilization goals (Output 1)?
 
  1. Impact and Sustainability of the Project.

In assessing the impact and sustainability of the Project, the evaluation will look at the positive and negative changes produced by the Project’s development interventions, directly or indirectly, intended or unintended.  It will also include the positive and negative impact of external factors, such as changes in terms of peacebuilding and reconciliation conditions.
On sustainability, the evaluation will measure the likeliness of project’s results continuity after donor funding has been withdrawn. Some of the key questions will include:
 
  • To what extent did the Project contribute to the advance on reconciliation and dialogue among the community leaders in Libya?
  • To what extent was sustainability considered in the planning and execution of the Project’s activities? To what extent is there evidence of sustainability of results?
  • To what extent are the SFL’s approach and results likely to be replicated and scaled up by national partners?
  • To what extent has the Project modified its approach to respond to the needs of the municipalities to address the Covid-19 pandemic?
  • Have the resources of the SFL been sufficient to contribute to meeting the needs of the municipalities regarding Covid-19?
  • Has the project been able to efficiently deliver interventions to address Covid-19 pandemic?



 
  1. Proposed Methodology

Based on UNDP guidelines for evaluations (UNDP Handbook on Monitoring and Evaluating for Results and the UNDP Guidelines for Outcome Evaluators), and in consultation with UNDP Libya CO, the evaluation will be inclusive and participatory, involving all principal stakeholders into the analysis.  The evaluation will consider the social, political, security and economic context which affects the overall performance of the outcome achievements.  During this evaluative exercise, the evaluation team is expected to apply the following approaches for data collection and analysis.

The evaluation will be conducted by the evaluation team composed of an International Evaluation Consultant/Team Leader and National Evaluation Consultant (team member)
The National Evaluation Consultant will bear responsibility for providing support to the International Evaluation Consultant in conducting the final project evaluation. This entails: providing support in designing the evaluation process according to this terms of reference; rigorous desk review; gathering data from different sources of information; analysing, organizing and triangulating the collected information; responding to comments and factual corrections from stakeholders and incorporating them, as appropriate, in subsequent versions; and making briefs and presentations ensuring the evaluation findings, conclusions and recommendations are communicated in a coherent, clear and understandable manner.
The proposed evaluation methodology consists of a preliminary desk review of Project materials and deliverables and review of existing information relevant to the Project context; preparation of an Inception report followed by field visits; preparation of a draft Evaluation Report, debriefing with stakeholders; and Final Evaluation Report write-up. An integral part of the Final Project Evaluation will also be a concept note and a set of recommendations on directions of the next phase of the Project.
The National Evaluation Consultant is required to assist the International Evaluation Consultant in evaluating the Project Document, progress, annual and mid-year Project reports, UNDP Quality Assurance assessments, key Project deliverables and other relevant documents.
As needed, the National Evaluation Consultant will accompany the International Evaluation Consultant at the meetings with representatives of the main project stakeholders for an initial briefing as well as for the debriefing at the end of the assignment.
Furthermore, the National  Evaluation Consultant is expected to support International Evaluation Consultant in interviewing the Project team, partners as well as other stakeholders as needed. To assess Project performance, approach and modalities, the Consultants will meet with key Project partners, namely the Ministry of planning and selected officials from the local governments (Mayors and municipality council), in addition to other local partners and beneficiaries so as to obtain critical feedback and information on the Project activities and results and assess the Project performance and its approach and modalities. Each visit will allow for meetings with 2 – 3 partners/stakeholders in the respective region. The Consultants will also meet with representatives of other agencies active in the field of stabilization and local community development to assess their cooperation and level of synergies with the SFL, if needed. During these meetings, it would be important to record and accumulate inputs necessary not only for the Project evaluation, but also to inform potential design of a next project phase.
The National Evaluation Consultant is encouraged to propose additional data collecting and analysis methods to ensure better insight into and review of project achievements and may use additional approaches such as simple questionnaire-based data collection. 
.
The Final Evaluation Report will capture the feedback by key Project partners and stakeholders as well as observations and conclusions by the Consultants. The Final Evaluation Report will particularly highlight the recommendations.

 
  1. Data Collection, Data Review and Analysis:

The evaluation methodology will adhere to the United Nations Evaluation Group (UNEG) Norms & Standards. The evaluation will be carried out by an independent evaluation team. The evaluation team should adopt an integrated approach involving a combination of data collection and analysis tools to generate concrete evidence to substantiate all findings. Evidence obtained and used to assess the results of UNDP support should be triangulated from a variety of sources, including verifiable data on indicator achievement, existing reports, evaluations and technical papers, stakeholder interviews, focus group discussions (FGD), surveys and site visits where/when possible. It is expected that the evaluation methodology will comprise of the following elements:
 
  • Review documents (Desk Review);
  • Interviews with project staff, present and past;
  • Interviews with key stakeholders including government line ministries, development partners, civil society and other relevant partners through a participatory and transparent process;
  • Consultations with beneficiaries through interviews and/ or focus group discussions;
  • Survey and/ or questionnaires where appropriate;
  • Triangulation of information collected from different sources/methods to enhance the validity of the findings.

The evaluation is expected to use a variety of data sources, primary, secondary, qualitative, quantitative, etc. to be extracted through surveys, storytelling, focus group discussions, face to face interviews, participatory methods, desk reviews, etc. conducted with a variety of partners. A transparent and participatory multi-stakeholder approach should be followed for data collection from government partners, community members, private sector, UN agencies, multilateral organizations, etc.

Evidence will be provided for every claim generated by the evaluation and data will be triangulated to ensure validity. An evaluation matrix or other methods can be used to map the data and triangulate the available evidence.

In line with the UNDP’s gender mainstreaming strategy, gender disaggregation of data is a key element of all UNDP’s interventions and data collected for the evaluation will be disaggregated by gender, to the extent possible, and assessed against the programme outputs/outcomes.

Due to travel restrictions imposed globally and internally by Covid-19 pandemic, the majority of the work will be done remotely using different mediums (Zoom, WhatsApp, Microsoft teams, etc.) to conduct the evaluation. FGDs in Libya will be limited in number in order to conform with country restrictions on public meetings and gatherings.

Special Note:

As of 11 March 2020, the World Health Organization (WHO) declared COVID-19 a global pandemic as the new coronavirus rapidly spread to all regions of the world. Travel to the country has been restricted since 2 March 2020 and travel in the country is also restricted. If it is not possible to travel to or within the country for the evaluation then the evaluation team should develop a methodology that takes this into account the conduct of the evaluation virtually and remotely, including the use of remote interview methods and extended desk reviews, data analysis, surveys and evaluation questionnaires. This should be detailed in the Inception report and agreed with the Evaluation Manager.

If all or part of the evaluation is to be carried out virtually. Consideration should be taken for stakeholder availability, ability or willingness to be interviewed remotely. In addition, their accessibility to the internet/ computer may be an issue as many government and national counterparts may be working from home. These limitations must be reflected in the evaluation report.


Since a data collection/field mission is not possible for the international consultant, then remote interviews must be undertaken through telephone or online (skype, zoom etc.). International consultant will work remotely with national evaluator support in the field if it is safe for him/her to operate and travel. No stakeholders, consultants or UNDP staff should be put in harm’s way and safety is the key priority.
One qualified and independent national consultants will  be hired to contribute to the evaluation and interviews in country as long as it is safe to do so.
 
  1. Composition and qualification of the evaluation team

Members of the mission must be independent to the project’s formulation, implementation or monitoring phases. It is proposed that the evaluation team be composed of a senior team leader (international), assisted by a national consultant.

The national consultant will perform the following tasks;

Task 1 – Provide support in desk review
Following the initial meeting, the National Evaluation Consultant will support the International Evaluation Consultant in conducting a detailed review of all relevant Project documents produced during its implementation. Documentation includes but is not limited to: Project document; Project annual work plans; Project reports; monitoring records, conceptual and methodological papers and analyses; empirical studies, data on implementation of CSOs/NGOs financed from the Project grant funds. During the desk review, the focus will be on evaluating the Project baseline, indicators and targets, as well as the relevance, quality and adequacy of Project approach versus its objectives and intended outputs.
, the National Evaluation Consultant may also provide some assistance in preparation of an Inception report.


Task 2 – Provide support in evaluation process.
Upon the approval of the Inception report and the evaluation work plan by the UNDP, the National Evaluation Consultant will assist the International Evaluation Consultant in conducting the evaluation of the Project, via direct interviews with key stakeholders and beneficiaries, in person if security permits or via telephone.  UNDP will provide support in organization of meetings and interviews.
Once the interviews are completed, the National Evaluation Consultant will help in data analysis and collection of information (qualitative and quantitative), as inputs for the International Evaluation Consultant draft of the evaluation report , including main findings and a concept for a possible follow-up direction. This evaluation report should include a contextual analysis of the environment in which the Project is working and its relevance in fulfilling a role in that environment . The report shall seek to assess Project progress, efficiency and adequacy; process and level of success of partnership building and ownership over Project products and results; the quality of Project deliverables. The report should include the data, inputs and analysis, as well as success indicators used, and an overview of the effectiveness of the Project from the perspective of various stakeholders. The evaluation will also capture the efficiency of Project organisation and management. The draft report will contain the positive or negative, intended or unintended, changes brought about by the Project and identify factors which facilitated or impeded the realization of intended objectives.
The national consultant and international consultants will create a google drive for the inception and draft reports to be reviewed by the UNDP team and Evaluation Reference Group members.. The minimum structure of the evaluation report (to be written in English language) is the following:
  • Executive summary;
  • Introduction;
  • Methodological approach;
  • Evaluation findings against the main evaluation criteria;
  • Lessons learned
  • Main conclusions and recommendations;
  • Concept note outlining key priorities to be addressed in a possible project future phase;
  • Annexes.
A debriefing session will be organised with representatives of UNDP and relevant stakeholders, so as to present the preliminary findings and recommendations of the Final Evaluation Report.

Task 3 – Provide support in consolidation of the Final Project Evaluation Report 
Following the briefing session, the National Evaluation Consultant  the  on the draft evaluation report, received from project stakeholders. Also, any observations that may arise from the evaluation will be incorporated into the final report. The International Evaluation Consultant will prepare a final Project Evaluation Report, capturing findings and recommendations on both the Project approach and performance.

Duration of Work

The detailed evaluation workplan will be agreed upon between the UNDP and the evaluation team. The Project evaluation will require 20 working days for the national consultant.
The national Consultant is expected to commence the assignment on 1st April 2021 (subject to restrictions and conditions imposed by the Covid-19 pandemic). The assignment and final deliverable are expected to be completed by the evaluation team, no later than 31 May 2021, with the detail as described in the below table signifying the tasks of the team leader and the national consultant.
Activity National consultant
Inception report on proposed evaluation methodology, work plan and proposed structure of the report.
 
 
Briefing to UNDP on inception report for agreeing methodology  
Desk review of existing documents, interviews, and preparation of guidance for national consultant Provide support in desk review
5 workdays
Data collection and interviews in the country Provide support in evaluation
10 workdays
Draft evaluation report Provide support in consolidation of the Final Project Evaluation Report
3 workdays
Debriefing with UNDP  
Elaboration of the final report (incorporating comments received on first drafts) and the set of recommendations 1 workday
Presentation to SFL Board 1 workday
  20

 
Project reporting
Reporting to the Project Manager.
Key competencies Required Skills and Experience
• University degree in social sciences, political sciences, public administration or related field;
• With bachelor degree at least 7 years ( Master degree 5 years) of professional experience in project/programme evaluations, specifically in the area of local development;
• Knowledge and experience in the area of local government, public administration, conflict sensitivity and local development-related projects;
• General understanding and knowledge of the political and administrative.
• Prevoius work with UNDP or other UN agencies is an asset;
• Fluency in English and Arabic

• Evaluation Ethics
Evaluation consultants will be held to the highest ethical standards and are required to sign a code of conduct upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outlined in the United Nations Evaluation Group (UNEG) 'Ethical Guidelines for Evaluations'.
This evaluation will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’. The consultant must safeguard the rights and confidentiality of information providers, interviewees and stakeholders through measures to ensure compliance with legal and other relevant codes governing collection of data and reporting on data. The consultant must also ensure security of collected information before and after the evaluation and protocols to ensure anonymity and confidentiality of sources of information where that is expected. The information knowledge and data gathered in the evaluation process must also be solely used for the evaluation and not for other uses with the express authorization of UNDP and partners. A code of conduct must be signed by the evaluator (s).
Evaluation Criteria

Offers will be evaluated according to the Combined Scoring method – where the technical criteria will be weighted at 70% and the financial offer will be weighted at 30%;
Only candidates obtaining a minimum of 49 points (70% of the total technical points) would be considered for the Financial Evaluation;

Criteria Weight
Education 15
Relevance of degree and education
• University degree in social sciences, political sciences, public administration or related field; 15
Technical Competencies 45
Bachelor’s degree at least 7 years (master’s degree at least 5 years) of professional experience in project/programme evaluations, specifically in the area of local development;
Knowledge and experience in the area of local government, public administration, conflict sensitivity and local development-related projects.
General understanding and knowledge of the political and administrative.
Experience in evaluation
Previous work with UNDP or other UN agencies is an asset; 30
Knowledge of the evaluation and RBM approach 15
Language 10
Fluency in written and spoken English 10
Overall 70
Team management
This role does not require management field.
Further information
Duty Station

The consultancy will be based in Tripoli with travel within Libya to the selected project locations.

Travel within Tripoli will be in the consultant’s private vehicle, and the consultant will provide her/his own accommodation.  Transport to other project locations in Libya may require armoured vehicles, depending on discussions between the consultant and the UNDP FSO.  Travel to Tunis will be by scheduled flights or UN aviation depending on availability and cost.

Deliverables and Payment:

DELIVERABLES AND TIMELINESS
The national consultant will work, be guided and report to the international team leader/international consultant
The following deliverables are expected:
  • Task 1: Provide support in desk review
Initial meeting with the Project team organized (Skype session is also possible); Performed desk review of documentation - (5 days);
  • Task 2– Provide support in evaluation
Interviews with stakeholders and Project beneficiaries, including field visits, partner local and central and local governments conducted and qualitative, as well as quantitative information collected as main inputs for the Final Project Evaluation; Briefing and validation session with Project team conducted (Skype session also possible); Draft Final Project Evaluation Report; 10 days);
  • Task 3 – Provide support in consolidation of the Final Project Evaluation Report
Recommendations on the draft Final Project Evaluation Report provided by the evaluation team, and the Final Evaluation Report submitted to UNDP - (3 days);
  • Also, 1 day to support the finding presentation that will be delivered by the international consultant to the project board.
  • Presentation to SFL Board 1 day


Institutional Arrangement
 
  1. Responsibilities of evaluators

The National Consultant will:
 
  • Be primarily responsible for data gathering in Libya
  • Support the Team Leader in coordinating, planning and ensuring implementation of FGDs, Key Informant Interviews (KII), and contacts with key stakeholders (national and local level).
  • Contribute to the preparation of the evaluation draft, presentations and final submission under the direct guidance of the Team Leader.
  • Have/bring their laptops, and other relevant software/equipment
  • Use their own mobile and personal email address during the consultancy period, including when in-country
 
  1. Responsibilities of UNDP
.

The project Evaluation is commissioned by the UNDP Libya Resident Representative. The International Consultant will work with the project team for conducting the evaluation, who will be responsible for the provision of documents and data as requested and support the overall evaluation.
An Evaluation Reference Group will be established, made up of representatives of the donors to the Stabilization Facility and national counterparts. The ERG will perform advisory role throughout the evaluation process and will provide advice on the ToRs, including the appropriateness of evaluation questions and methodology, will support the evaluation in its analysis of existing evidence by facilitating access and providing inputs, and will discuss the preliminary findings of the evaluation.

The ERG will provide feedback to the evaluation report which should be addressed by the evaluator.

The ERG will also provide input to the development of the management responses and key actions recommended by the evaluation
 
We do our best to provide you the most accurate info, but closing dates may be wrong on our site. Please check on the recruiting organization's page for the exact info. Candidates are responsible for complying with deadlines and are encouraged to submit applications well ahead.
Before applying, please make sure that you have read the requirements for the position and that you qualify.
Applications from non-qualifying applicants will most likely be discarded by the recruiting manager.
Apply

What does it mean?

Click "SAVE JOB" to save this job description for later.

Sign up for free to be able to save this job for later.