Local Evaluation Consultant
Rule of Law and Access to Justice are one of the key areas of UNDP’s work in Kosovo since 2004. UNDP’s work on Rule of Law is based on strong partnerships with Kosovo institutions, international stakeholders working on rule of law and financing partners. The overall objective of UNDP’s project Support to Strengthening the Rule of Law in Kosovo (SSROLK) was to support the provision of an efficient, effective, and timely administration of justice. Rule of Law and Access to Justice are among the main political conditions for Kosovo in the European Integration process, which calls for ensuring that courts and prosecution are effective, independent, accountable and impartial, and free from political influence. As such, the SSROLK was designed to support Kosovo’s Rule of Law priorities and strategic objectives focusing on:
- Policy level: addressed the policy and coordination aspects between justice institutions, and harmonization of strategic planning to increase efficiency on the implementation of reforms.
- Capacity development and institutional reform: focused on providing tailor-made institutional support to increase institutional and individual capacities, efficiency and accountability.
- Access to justice and service delivery: increasing access to justice for Kosovo’s population and reducing the court case backlog through the mediation system.
The project was implemented in close cooperation and coordination with the Ministry of Justice (MoJ), Kosovo Judicial Council (KJC), Kosovo Prosecutorial Council (KPC), Academy of Justice (AJ), Agency for Free Legal Aid, civil society, and CSOs. The project activities and indicators for annual work plan were developed jointly with the above noted project beneficiaries and partners.
Due to the limited inter-institutional coordination on rule of law (also highlighted by the EC Kosovo Report 2019) project contributed in establishing a Justice Coordination Mechanism (Secretariat) in 2016. The Secretariat consisted of the MoJ, KJC, KPC, and AJ. Through this coordination platform, the project contributed in improving strategic planning, policy development and coordination of priorities in the rule of sector, especially in light of the European Integration requirements.
With the commencement of the rule of law functional review process under the leadership of MoJ in 2018, the project aligned its professional and legal support to the Ministry in implementing the review process. To date, the review, supported also by other international stakeholders, is nearing completion opening the way to the drafting of the Sectoral Strategic Plan for the Justice System. UNDP’ provided professional and legal support in developing the necessary policy papers that will feed into the upcoming Sectoral Strategic Plan for the Justice System.
Project worked with KJC and KPC to improve the administration of justice in light of the 2015 and 2018 amended basic laws on judiciary. Specifically, the project supported KJC and the KPC to prepare the secondary legislations to support the effective implementation of these laws. These regulations and administrative instructions have, among others, regulated the responsibilities, duties and organizational structures of Courts and justice institutions, and divided their work accordingly, thereby improving the administration of justice.
In cooperation with the Academy of Justice, the project provided various capacity development support for judges, prosecutors, and other legal practitioners. The project supported the Academy in drafting its annual training program, updating the e-learning tool to provide online trainings, and conducted various training on topics related to human rights, mediation, case management, drafting of legal opinions, etc. In addition, by publishing the Bulletin for Case Law for 2016, 2017 and 2018 the project contributed in improving judicial practices of the first instance Courts.
To guarantee equal access to justice for all the project worked towards improving the legal aid system. Legal aid in Kosovo is provided by AFLA, but it lacks the necessary capacities and financial resources to respond to citizens’ needs. Although several CSOs are supplementing legal aid delivery, the coordination between CSOs and AFLA needs to improve in order to improve the impact and quality of services. By bringing together the legal aid actors and institutions in the Legal Aid Coordination Forum, the project contributed in improving the communication and coordination of the actors, and in identifying systematic issues related to the functioning of the legal aid.
In its efforts to promote access to justice, the project supported the mediation system, as an alternative dispute resolution. Over the past years, UNDP’s efforts involved preparing the necessary legislation, namely the Law on mediation contributing to the sustainability of the mediation system, developing the capacities of more than 500 legal practitioners, and raising awareness about the advantage of using mediation. This intervention contributed in not only improving citizens’ access to justice, but also in decreasing of the court and prosecution backlog.
As the project entered its final stage of implementation a final evaluation of the project activities will be conducted to assess the overall progress of the project towards the expected results, and provide lessons learned and recommendations for future interventions of similar nature. To this end, the project will hire a local evaluation specialist, who will work jointly to achieve the expected results.
Objectives of AssignmentThe overall objective of this consultancy assignment is to assess the overall achievement of the project in terms of its relevance, impact, effectiveness, efficiency, and sustainability, and elaborate on the lessons learned and recommendations for future improvements and interventions in rule of law sector. The scope of the evaluation of SSROLK should look both into the outcome-level results as well as the output-level results as key indicators of the overall project performance.
Project InformationProject/outcome title: (1) Improving Access to Justice in Kosovo, and (2) Enhanced Access to Justice and Rule of Law ReformAtlas ID: Award No. 00084098 (Output 00092278 and Output 00112988)Corporate outcome and output: CDP Outcome 1.1 Rule of law system and institutions are accessible to all and perform in a more efficient and effective manner.Country: Kosovo (as per UNSCR 1244/1999)Region: Western Balkans, ECISProject dates: Start: April 2016 Planned end: January 2019Project budget: USD 1,475,581 (2016-2019)Funding source: UNDP Global Programme for Justice, Security and Human Rights (BBPS), Norwegian Ministry of Foreign Affairs, German GovernmentImplementing party : UNDP
Duties and Responsibilities
- Conduct a desk review of relevant project-related documents and UNDP evaluation policies and, based on this information, draft and submit an inception report with appropriate methodology to be applied during the evaluation, as well as the work plan and any technical instruments to be used during the course of the assignment, while being guided by the set of evaluation questions as presented below (3 w/ds);
- Conduct on-site field visits, meetings, discussions, and interviews with relevant stakeholders and project beneficiaries in Kosovo which include, but are not limited to: Ministry of Justice, Kosovo Judicial Council, Kosovo Prosecutorial Council, Academy of Justice, Ombudsperson Institution, Agency for Free Legal, representatives of key civil society organizations, and implementing partners. The Evaluator is expected to share the list of interviews to be conducted beforehand, and receive feedback and clearance from UNDP (4 w/ds);
- Hold a debriefing workshop at the end of the mission with main stakeholders to summarize initial findings and recommendations (1 w/d);
- Based on the inception report and on the feedback received during the debriefing workshop, draft a final evaluation report containing the methodology applied, a presentation of findings, presentation of the lessons learned and clear strategic recommendations to the UNDP and its partners for future interventions in rule of law. These recommendations should contain specifically to whom of each of the partners of the project they are addressed (5 w/ds);
The final evaluation report should include the elements outlined below:
- Title and opening pages
- Table of contents
- List of acronyms and abbreviations
- Executive summary, including a summary of the lessons learned and recommendations
- Description of the intervention
- Evaluation scope and objectives
- Evaluation methodology
- Data analysis
- Findings and conclusions
- Lessons learned
- Report annexes
- Finalize the final evaluation report, accounting for UNDP and stakeholders’ feedback on the first draft (2 w/ds).
The following evaluation criteria are to be used as per the UNDP methodology, and related evaluation questions are proposed for the evaluation process; however, these can be expanded, prioritized, and modified by the evaluator during the inception phase in consultation with UNDP.
Relevant evaluation criteria
Key questions suggested
Stakeholders and Partnership Strategy
Theory of Change or Results/Outcome Map
MethodologyMethodological approaches may include some or all of the following. The final methodological approach including the interview schedule, field visits and data to be used in the evaluation should be clearly outlined in the inception report and be fully discussed and agreed with UNDP.
- Evaluation should employ a combination of both qualitative and quantitative evaluation methods and instruments.
- Document review of all relevant documentation. This would include a review of inter alia
- Project document (contribution agreement).
- Theory of change and results framework.
- Programme and project quality assurance reports.
- Annual workplans.
- Consolidated periodic and annual reports.
- Project board meeting minutes.
- Technical/financial monitoring reports.
- Semi-structured interviews with key stakeholders including key central and local institutions (which include, but are not limited to: Ministry of Justice, Kosovo Judicial Council, Kosovo Prosecutorial Council, Academy of Justice, Ombudsperson Institution, Agency for Free Legal, representatives of key civil society organizations, and implementing partners:
- Development of evaluation questions around relevance, effectiveness, efficiency, impact and sustainability and designed for different stakeholders to be interviewed.
- All interviews should be undertaken in full confidence and anonymity. The final evaluation report should not assign specific comments to individuals.
- Surveys and questionnaires including participants in development programmes, and/or surveys and questionnaires involving other stakeholders at strategic and programmatic levels.
- Field visits and on-site validation of key tangible outputs and interventions.
- The evaluator is expected to follow a participatory and consultative approach that ensures close engagement with the evaluation managers, implementing partners and direct beneficiaries.
- Other methods such as outcome mapping, observational visits, group discussions, etc.
- Data review and analysis of monitoring and other data sources and methods.
- Ensure maximum validity, reliability of data (quality) and promote use; the evaluation team will ensure triangulation of the various data sources.
Expected Outputs and Deliverables
- Inception report (approx. 15-20 pages) containing appropriate methodology to be applied during the final evaluation, as well as the work plan and technical instruments to be used during the course of the assignment is drafted, submitted, and endorsed by UNDP. 3 w/ds
- Field visits, meetings and interviews in Kosovo are conducted, gathering data to be used in the final evaluation report. 3 w/ds
- A debriefing meeting with key stakeholders is held and initial findings and recommendations presented. 1 w/d
- Draft final Evaluation report with the methodology applied, a presentation of findings, a presentation of the lessons learned and clear strategic and operational recommendations to the UNDP and its partners is formulated, based on the findings acquired during the field mission to Kosovo and through the relevant project documentation, and submitted. 5 w/ds
- A finalized Final Evaluation report accounting for the UNDP, and stakeholders’ feedback on the first draft is produced, submitted to, and validated by UNDP. 3 w/ds
Implementation ArrangementsThe Evaluation Consultant
- The Evaluator will work together the SSROLK Project Manager and project team, in close consultation with the UNDP Governance and Peacebuilding Portfolio Manager. The project team will provide administrative and logistical support as needed.
- The SSROLK Project Manager and project team will provide necessary information for the evaluation, will lead the logistical support of the evaluation (support in arrangements of meetings, field visits), and will be the primary point of contact for the evaluator.
- The Governance and Peacebuilding Portfolio Manager will perform quality assurance of the evaluation process and its outputs.
- This evaluation will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’. The consultant must safeguard the rights and confidentiality of information providers, interviewees and stakeholders through measures to ensure compliance with legal and other relevant codes governing collection of data and reporting on data. The consultant must also ensure security of collected information before and after the evaluation and protocols to ensure anonymity and confidentiality of sources of information where that is expected. The information knowledge and data gathered in the evaluation process must also be solely used for the evaluation and not for other uses with the express authorization of UNDP and partners.
Remuneration - Lump Sum Amount:
The Contract is based on lump sum remuneration and shall be processed subject to deliverables as per the schedule listed below:
- 70% of the total amount of the contract upon submission of the Draft Final Evaluation report
- 30% of the total amount of the contract upon submission and validation of the Final version of the Final Evaluation report
Recommended Presentation of OfferThe following documents must be submitted in order to be evaluated and considered for the assignment:
- P11 and CV (signed), indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the candidate and at least three (3) professional references
- Technical proposal, a max. 2-page document briefly outlining the methodology envisaged for the assignment for delivering the expected results within the indicated timeframe (an interview will be conducted for the shortlisted candidates);
- Letter of Confirmation of Interest and Availability;
- Financial proposal, - the consultant is expected to provide an all-inclusive lump sum amount/financial proposal. The Offeror must indicate at this point and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP.
Criteria for selection of the Best OfferOffers will be evaluated utilizing a combined Scoring method – where the qualifications, technical proposal, and the interview will be weighted a max. of 70% and combined with the price offer which will be weighted a max of 30%.
Corporate Competencies :
- Committed to highest regards of professionalism, impartiality, accountability, transparency, ethics, and integrity;
- Displays cultural, gender, religion, race, nationality, ethnicity, and age sensitivity and adaptability;
- Demonstrates substantial experience in gender equality and social inclusion.
- Treats all people fairly without favouritism.
- Ability to work effectively within a team and develop good relationships with counterparts and stakeholders;
- Ability to synthesise research and draw conclusion on the related subjects;
- Ability to pay attention to details;
- Demonstrates transparency and provides feedback to all those who will contribute to the evaluation;
- Excellent interpersonal skills and ability to communicate effectively, both orally and in writing;
- Ability to establish effective working relations in a multicultural team environment;
- Commitment to accomplish work;
- Responds positively to critical feedback;
- Results and task oriented.
Required Skills and Experience
- Bachelor’s degree in law, or any other social sciences related to the RoL;
- Minimum seven (7) years of professional experience in the area of the rule of law;
- Extensive knowledge and familiarity with the Kosovo judiciary;
- Experience in conducting analyses, and evaluations;
- Strong working knowledge of UNDP and its mandate;
- Knowledge of results-based management evaluation, as well as participatory M&E methodologies and approaches is highly regarded;
- Excellent communication skills with various partners including donors;
- Fluency in English and Albanian is required, knowledge of Serbian is a strong asset.
- Click on the "Apply now" button;
- Input your information in the appropriate sections: personal information, language proficiency, education, resume and motivation; you can type in, or paste your short Resume into the last box;
- Upon completion of the first page, please hit "submit application" tab at the end of the page. On the next page, you will be asked to upload your Resume;
- System will only allow one attachment. All docs (CV; P11; financial offer; list of similar profiles should be included as one attachment).
- Please make sure to submit all the requested documents/information; otherwise, your application will be considered incomplete.