Independent Evaluation Team - 2 Consultants (Team Leader + Team Member/Expert)
Suva (Fiji )
1) GENERAL BACKGROUND
The second phase (2016-2020) of the joint UNDP-UNODC Pacific Regional Anti-Corruption Project (UN-PRAC) aims to support Pacific Island Countries (PICs) to strengthen their national integrity systems. This is in order to promote ‘clean’ governments and to create an enabling environment for trade, business, investment and sustainable development. In turn, this will enhance the delivery of equitable and high-quality services to all Pacific Islanders.
Over the past years, the debate has shifted from ‘why’ countries should be preventing and fighting corruption to ‘how’. The UN Convention against Corruption (UNCAC) is the only international legally binding framework on how to prevent and fight corruption. It provides a solid basis upon which PICs can develop sustainable anti-corruption reforms. It is for this reason that this Project was designed to build on the platform of UNCAC, as well as the efforts undertaken during the first phase (2012-2016) of UN-PRAC. This includes leveraging the recognition by PICs of the UN as a trusted, impartial partner. One medium by which PICs are addressing the ‘how’ question is through the Mechanism for the Implementation of UNCAC (UNCAC Review Mechanism). This requires States parties to consider what national legislative, institutional and practical frameworks are in place to effectively address corruption. Another related anchor is the Development Agenda 2030 and the Sustainable Development Goals (SDGs), recently adopted by UN Member States. SDG 16 (Promote just, peaceful and inclusive societies) directly calls for stronger action on anti-corruption, transparency and accountability. This Project also strives to more coherently address the link between anti-corruption and development, and to integrate anti-corruption into national and regional development processes.
One of the key implementation principles of UN-PRAC, as noted in the project document, is the integration of gender and human rights throughout the Project. Both UNDP and UNODC are committed to mainstreaming gender equality in their programme work and as such, this Project is also committed to gender equality. In addition, where appropriate, specific activities in support of gender equality in the anti-corruption context are considered. The Project reporting is designed to be gender responsive and raise gender-related issues to the extent possible.
The goal of UN-PRAC is to promote and strengthen measures to prevent and fight corruption more efficiently and effectively in the Pacific region. This aligns with the purpose of UNCAC in paragraph 1(1) and the spirit of SDG 16.
In particular, the project aims to:
2) OBJECTIVES OF THE ASSIGNMENT
In line with the project document, the mid-term Independent Project Evaluation will be undertaken around 24 months after the initiation of the project. The aim of the evaluation is to assess the effectiveness of the design and relevance of the project. Its results will be used to inform the implementation of the second half of the project, assess project’s successes and good practices, as well as lesson learnt and areas of improvement. The main users of the evaluation results will be project managers and donors.
The following DAC (Development Assistance Committee) criteria will be assessed during the evaluation: relevance, efficiency, effectiveness, impact and sustainability. In addition, design, established partnerships and cooperation as well as aspects of human rights and gender mainstreaming will be assessed. The evaluation will specifically assess how gender aspects have been mainstreamed into the project. Furthermore, lessons learned and best practices will be identified and recommendations based on the findings formulated.
The outcomes of the evaluation will inform as to what extent the project is contributing to the outcomes of the UNDP and UNODC relevant corporate strategic documents, and above towards the operationalization of the SDG agenda.
Duties and Responsibilities
3) SCOPE OF WORK
Under the guidance and supervision of the Head of the Integrated Results Management Unit (IRMU) of the UNDP Office in Fiji and the Chief or Deputy Chief of the Independent Evaluation Unit (IEU) of UNODC, the key responsibilities of the evaluation team include (i) development of the evaluation design with detailed methods, tools and techniques, sensitive to key gender as well as human rights issues (ii) ensuring adherence to the United Nations Evaluation Group (UNEG) Norms and Standards, UNODC evaluation norms, standards, guidelines and templates and the full evaluation Terms of Reference (ToR), and (iii) ensuring that all deliverables are submitted in a timely and satisfactory manner and in line with the quality criteria checklist.
The mid-term Independent Project Evaluation (MTE) should assess the design of the project. The following are the key evaluation questions:
Given that this is a Mid-Term Independent Project Evaluation, the emphasis will be on identifying lessons learnt, with a view to adjusting the project design and implementation accordingly. The MTE will therefore make recommendations for the way forward, based on progress thus far.
Findings and lessons learned:
MTE Methodology and Approach
The MTE team should consist of two international consultants (Team leader and Team Member / Expert).
The evaluation will use methodologies and techniques as determined by the specific needs for information, the questions set out in the ToR for the evaluation and the availability of stakeholders. The methodologies and approach need to take into account that this is a regional project, covering 15 countries in a geographically scattered region. In all cases, the evaluation team is expected to analyse all relevant information sources, such as reports, programme documents, thematic programmes, programme files, financial reports and any other documents that may provide further evidence for triangulation, on which his/her conclusions will be based. The evaluation team is also expected to use relevant quantitative and/or qualitative tools as a means to collect relevant data for the evaluation. While maintaining independence, the evaluation will be carried out based on a participatory approach, which seeks the views and assessments of all parties identified as the key stakeholders of the project/ programme, the Core Learning Partners (CLP).
The evaluation ToR provides basic information as regards to the methodology, which should not be understood as exhaustive. It is rather meant to guide the evaluation team in elaborating an effective, efficient, and appropriate evaluation methodology that should be proposed, explained and justified in the Inception Report.
In addition, the evaluation team will be asked to present a summarized methodology (including an evaluation matrix) in the Inception Report outlining the evaluation criteria, indicators, sources of information and methods of data collection. The evaluation methodology must conform to the United Nations Evaluation Group (UNEG) Norms and Standards as well as the UNODC Evaluation Policy, Norms and Standards.
While the evaluation team shall fine-tune the methodology for the evaluation in an Inception Report, a mixed-methods approach of qualitative and quantitative methods is mandatory due to its appropriateness to ensure an inclusive methodology. Special attention shall be paid to an unbiased and objective approach and the triangulation of sources, methods, data, and theories. Indeed, information stemming from secondary sources will be cross-checked and triangulated through data retrieved from primary research methods. Primary data collection methods need to be gender-sensitive as well as inclusive.
The credibility of the data collection and analysis are key to the evaluation. Rival theories and competing explanations must be tested once plausible patterns emerge from triangulating data.
The limitations to the evaluation need to be identified and discussed by the evaluation team in the Inception Report, e.g. data constraints (such as missing baseline and monitoring data). Potential limitations as well as the chosen mitigating measures should be discussed.
When designing the evaluation data collection tools and instruments, the evaluation team needs to consider the analysis of certain relevant or innovative topics in the form of short case studies, analyses, etc. that would benefit the evaluation results.
Bidders shall be free to propose their own team composition and roles. The team should consist of two experts:
Overall responsibilities lie with the MTE Team Leader, who will provide guidance and leadership on conducting the MTE and on preparing/revising the deliverables. The Team Leader will have expertise in results-based evaluation methodologies.
The Team Leader will be responsible for the quality and timely submission of his/her specific deliverables, as specified below, interacting with the UNODC IEU and UNDP IRMU throughout the evaluation process. All products should be well written, inclusive and have a clear analysis process.
Specific responsibilities of the Team Leader include:
The MTE Team Member/Expert will support the Team Leader and provide the expertise on anti-corruption and integrity in the context of the evaluation. S/he may be asked to lead on specific areas and will be responsible for drafting relevant parts of the inception report and the draft and final MTE report, as well as the Evaluation Brief. Overall responsibilities lie with the MTE Team Leader, who will provide guidance and leadership on conducting the MTE and on preparing/revising the deliverables.
Specific responsibilities of the MTE Team Member include:
The evaluators must not have been involved in the design and/or implementation, supervision and coordination of and/or have benefited from the programme/project or theme under evaluation. The evaluation team will report exclusively to the chief or deputy chief of the UNODC IEU and head of the UNDP IRMU, who are the sole clearing entities for all evaluation deliverables and products. The evaluators shall respect the UNEG Ethical Guidelines.
4) DURATION OF ASSIGNMENT, DUTY STATION AND EXPECTED PLACES OF TRAVEL
This assignment will take place between 13 August and 19 December 2018 and is output-based. Travel to Fiji and potentially one other Pacific country is required to hold consultations. Stakeholder from other countries will be interviewed via skype or phone due to the vast geographical area covered by the project and expensive and challenging travel options in the region. Therefore, other work will be home-based. Travel will be facilitated by UN-PRAC as per UNDP’s travel rules and regulations.
The MTE is expected to take a total of 67 working days: 40 working days for Consultant 1 (MTE Team Leader) and 27 working days for Consultant 2 (MTE Team Member / Expert), as follows:
5) FINAL PRODUCTS
The final products for this assignment are as follows:
Inception report: The inception report should be prepared by the MTE team before going into the full-fledged MTE exercise. It should include initial observations of the desk review, refined evaluation questions, data collection instruments (including surveys/questionnaires and interview guides), sampling strategy, evaluation matrix and limitations to the evaluation, in line with UNODC evaluation norms, standards, guidelines and templates.
Draft MTE report: Draft evaluation report should be prepared in line with UNODC evaluation norms, standards, guidelines and templates, including an analysis of the performance of the project to adequately address gender equality as well as human rights issues, with concrete findings, conclusions and recommendations.
MTE report: The final report will be produced by the MTR team based on feedback received on the draft report. The final report will be shared with stakeholders and other partners. The final evaluation report and an Evaluation Brief (2-pager) should be prepared in line with UNODC evaluation norms, standards, guidelines and templates.
6) PROVISION OF MONITORING AND PROGRESS CONTROLS
The evaluation team will work under the supervision of the UNODC IEU and UNDP IRMU, who will consult with and seek inputs from other counterparts in line with the evaluation ToR.
UN-PRAC will support the logistical arrangements of consultant travels and stakeholder consultations. Although UN-PRAC is administratively responsible for the MTE, it shall not interfere with analysis and reporting, except where requested and at opportunities for comments/feedback.
UNODC and UNDP will share the final version of the MTE report with the national stakeholder agencies and all partners of the project.
 Please note that this independent mid-term evaluation is a joint UNDP-UNODC effort. It was agreed that for this occasion UNODC evaluation norms, standards, guidelines and templates are used for consistency purposes, to avoid potential conflict between the guidelines of the two organizations.
The MTE team will be composed of two independent consultants not involved with the formulation, appraisal, approval and/or implementation of daily management of the project. Both UNODC and UNDP will have the opportunity to weigh in on the selection of the consultants and provide inputs to the required qualifications and competencies. UNDP will oversee the administrative process of recruitment and contracting, with both UNODC and UNDP being given the option of participating in each stage of the selection, including short-listing, reviewing financial proposals, interview panels, etc.
The following are required experience and competencies for MTE Team Lead:
Required Skills and Experience
The following are required qualification for MTE Team Lead:
- Master’s degree in Law, Development Studies, Public Finance, Political Science, Social Sciences, Evaluation, or other relevant field and preferably formal training/education on evaluation methodologies and principles;
The following are required qualification for MTE Team Member / Expert
- Master’s degree in Law, Development Studies, Public Finance, Political Science, Social Sciences, or other relevant field and preferably formal training/education on evaluation methodologies and principles;
8) REVIEW TIME REQUIRED
10 days after submission of each deliverable.
Payment will be made after satisfactory acceptance and certification of the deliverables and in accordance with UNDP procedures:
Price Proposal and Schedule of Payments
Consultant must send a financial proposal based on Lump Sum Amount. The total amount quoted shall be all-inclusive and include all costs components required to perform the deliverables identified in the TOR, including professional fee, travel costs, living allowance (if any work is to be done outside the IC´s duty station) and any other applicable cost to be incurred by the IC in completing the assignment. The contract price will fixed output-based price regardless of extension of the herein specified duration.
In general, UNDP shall not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources
In the event of unforeseeable travel not anticipated in this TOR, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and the Individual Consultant, prior to travel and will be reimbursed.
Evaluation Method and Criteria:
Individual consultants will be evaluated based on the cumulative analysis methodology.
The award of the contract shall be made to the individual consultant whose offer has been evaluated and
a) responsive/compliant/acceptable, and
b) Having received the highest score out of a pre-determined set of weighted technical and financial
criteria specific to the solicitation: Technical Criteria 70% (as indicated above in Experience and
Qualifications section) and Financial Criteria 30%.
Only candidates obtaining a minimum of 49 points (70% of the total technical points) would be
considered for the Financial Evaluation.
Technical Criteria – Maximum 70 points
Consultant 1: Team Leader – Evaluation Specialist, with some previous knowledge of anti-corruption, transparency, accountability
Consultant 2: Team Member/ Expert – Anti-Corruption / Integrity Specialist
DOCUMENTS TO BE INCLUDED WHEN SUBMITTING THE PROPOSALS.
All applications must be clearly marked with the title of the consultancy and submitted by 20th July 2018 (Fiji Time) electronically to firstname.lastname@example.org
For any clarification regarding this assignment please write to Lavenia Rokovucago email@example.com .
Incomplete applications will not be considered, and only candidates for whom there is further interest will be contacted.
Please combine all your documents (Signed P11/CV, Technical Proposal, Confirmation of Interesta and submission of financial proposal form, etc into one (1) single PDF document as this system only allows to upload maximum one document, failure to combine all document in one will beconsidered as incomplete and proposal will not be accepted”. You can email firstname.lastname@example.org to request for these templates.
- Organization: UNDP - United Nations Development Programme
- Location: Suva (Fiji )
- Grade: International Consultant - Internationally recruited Contractors Agreement - Consultancy
- Monitoring and Evaluation
- Managerial positions
- Closing Date: 2018-07-20