International Consultant / Evaluator for the final evaluation of the eu/un women project “unite to fight violence against women”
Home-based with travel to Georgia
In November 2016, UN Women – the United Nations Entity for Gender Equality and the Empowerment of Women – with the generous support of the European Union (EU), launched a 3-year project “Unite to Fight Violence against Women.” The overall objective of the action is to prevent violence against women (VAW) and domestic violence (DV) and to eliminate its causes and consequences in Georgia. The specific objective is to create an enabling legislative, policy and service delivery environment in line with internationally binding standards on ending violence against women and girls (EVAWG) at national and local levels (Guria and Qvemo Qartli regions) in Georgia.
The project is aimed at realizing two inter-related results: 1) Key stakeholders conduct awareness-raising, preventive and corrective actions, based on reliable data and in such a way that they contribute to increased disclosure and prevention of violence and 2) Capacity of key policy and service delivery institutions strengthened to promote and protect women’s right to a life free from VAWG, including DV.
Compliant to UN Women’s Strategic Note 2016-2020, the project ensured realization of project results with interventions on policy, institutions and grassroots’ levels to bring about interrelated positive change and contribute to the achievement of the overall, as well as the specific objectives of the action. On level 1: Policies and Legislation – the action generated comprehensive data and evidence through conducting a National Study on VAW in Georgia and provided comprehensive support to the government of Georgia in streamlining national policies, laws and plans in line with generated evidence, as well as Georgia’s international and national commitments on EVAW. On level 2: institutions – capacity development – the project provided capacity development support to key institutional partners engaged in the national response against VAW/DV. On the level 3: grassroots, the project provided coordinated support to national and local partners on raising awareness to prevent and increase disclosure of VAWG and DV in Georgia.
Key partnerships with relevant government and civil society actors in Georgia have been strengthened or established to ensure delivery of project results and to enhance project sustainability and national ownership. In line with the project document, UN Women formalized frameworks of cooperation with responsible parties – the National Statistics Office of Georgia (GEOSTAT), the State Fund for Protection and Assistance of (Statutory) Victims of Human Trafficking and Domestic Violence, Legal Aid Service (LAS) and the Public Defender’s Office (PDO) – via Letters of Agreement. Effective and meaningful partnerships have been further sustained with the Inter-Agency Commission on Gender Equality, Violence against Women and Domestic Violence with UN Women providing robust technical assistance in development, implementation and monitoring of the national laws and policies on EVAW. The project further established partnerships with key state actors engaged in the national response against VAW/DV, including the Ministry of Internal Affairs (MIA), Ministry of Justice (MoJ) and the Ministry of Health (MoH) providing technical assistance in the area of enhancing safety of and strengthening service provision to the victims/survivors of violence. On the local levels, UN Women established close partnerships with the local governments and civil society organizations in project target regions of Guria and Qvemo Qartli via regular consultation meetings, capacity development trainings and awareness raising campaigns around VAW/DV.
Throughout the project lifespan, UN Women completed its administrative and financial obligations and implemented all project-related activities specified in the project document. A summary of highlight results and achievements are listed below:
- The project bridged the national data gap on VAWG/DV by conducting the National VAW Study in Georgia, in partnership with GEOSTAT. The study findings provided data on the prevalence of intimate-partner violence (IPV), domestic violence and non-partner physical and sexual violence, sexual harassment and stalking, as well as the perceptions and awareness of women and men on gender and violence in Georgia. The findings generated by the study established baseline indicators for a number of the nationalized Sustainable Development Goals (SDGs) and offered evidence to inform the design of policies and programmes by national stakeholders;
- The project ensured coordination and unity of action by state agencies in delivering awareness-raising interventions on EVAWG by supporting the Inter-Agency Commission on Gender Equality, Violence against Women and Domestic Violence in the development and adoption of two framework-setting documents: the National Communication Strategy and the National Communication Action Plan on EVAWG. To ensure effective implementation of these two documents, the project further supported the Inter-Agency Commission in the establishment and effective functioning of the EVAWG Communication Task Force. The project further contributed to encouraging disclosure of VAWG/DV by providing support to selected national partners and civil society organizations to promote zero tolerance for VAWG/DV and increase awareness around services available for the victims/survivors of violence nationwide, as well as in project target region of Guria and Qvemo Qartli;
- The project further provided coordinated support and trainings to policymakers and service providers in order to strengthen capacities for the implementation of laws and policies, as well as provide better service delivery. As a direct result of strategic technical support provided to the Inter-Agency Commission in the development of the 2018-2020 National Action Plan on the Measures to be Implemented for Combating Violence against Women and Domestic Violence and Protection of Victims/Survivors (hereinafter referred to as 2018-2020 VAW/DV NAP), the Government of Georgia adopted the VAW/DV NAP on 13 April 2018;
- The project resulted in a milestone policy shift in the police response to DV through its support of the Ministry of Internal Affairs (MIA) in developing and adopting the DV risk assessment methodology. The DV risk assessment methodology has been integrated into the restraining order protocol for DV offenders in accordance with the ministerial decree issued on 13 July 2018 (Decree of the Minister of Internal Affairs No. 81 on the Approval of the Restraining Order and Restraining Order Protocol issued on 13 July 2018. Available at https://matsne.gov.ge/ka/document/view/4262664?publication=0). It enables police officers to document the history of violence suffered and evaluate risks for lethality and re-offence, thereby informing restrictive measures to be applied using a standardized methodology;
- The project has further strengthened the police response to DV by contributing to the creation and effective functioning of the Human Rights Protection Department (HRPD), a specialized unit of the MIA to steer the ministry’s work, inter alia, on VAWG/DV issues. Strategic capacity development support has been provided to the HRPD via a series of specialized trainings and consultation meetings;
- The project contributed to improving the safety of victims/survivors via the introduction of Global Positioning System (GPS) ankle bracelets to monitor and track high-risk DV offenders. UN Women has further secured commitment from the ministry to take over the funding for the maintenance of the system after the project phaseout;
- The project expanded the geographic coverage of services available to the victims/survivors of VAWG/DV by supporting the State Fund in establishing two new crisis centers in the project target regions of Guria and Qvemo Qartli. The crisis centers provide psychological and socioeconomic assistance and rehabilitation, medical and legal services to victims/survivors of VAWG/DV as well as referral to shelters, as necessary. The project further contributed to bridging the gap on the provision of socioeconomic rehabilitation to the victims/survivors of domestic violence by supporting the State Fund in launching the development of the socioeconomic rehabilitation programme for the victims/survivors of VAW/DV.
- The project addressed the key gap in the provision of preventive interventions for the perpetrators of VAWG/DV by developing and piloting the rehabilitation/behavioral correction programme for perpetrators convicted of DV. The programme has been piloted in two penitential institutions of Georgia and is expected to become mandatory for VAW/DV offenders in 2019.
- The project addressed the key gap in the provision of the free-of-charge legal aid services to the victims/survivors of VAWG/DV by supporting the Legal Aid Service (LAS) in expanding its mandate to provide legal consultations and court representation services to the victims/survivors of VAWG/DV (regardless of their socioeconomic status) on civil and administrative legal matters related to their victimization. The project further strengthened the capacity of lawyers working for the LAS by conducting in-depth specialized trainings on VAWG/DV.
- The project further enabled Gender Equality Department (GED) of the PDO (Public Defender’s Office) to expand its geographic coverage and monitor implementation of the legislation in relation to GE and VAWG nationwide in 6 regions of Georgia (Adjara, Guria, Kakheti, Qvemo Qartli, Samegrelo and Samtskhe-Javakheti);
Evaluation objectives, purpose and use
The specific evaluation objectives are as follows:
- Analyze the relevance of the implementation strategy and approaches of the “Unite to Fight Violence against Women” project;
- Validate the project results in terms of achievements and/or weaknesses toward the outcome and outputs;
- Assess the potential for sustainability of the results achieved by the project;
- Document lessons learned, best practices, success stories and challenges to inform future work of UN Women and the EU in addressing violence against women and domestic violence;
Findings of the evaluation will inform UN Women Georgia’s future work in the area of EVAW. The external evaluation will further identify lessons learned, best practices and challenges of the “Unite to Fight Violence against Women” project and will greatly inform the development of the follow-up programmatic interventions.
The information generated by the evaluation will be used by different stakeholders to contribute to building of the evidence base on effective strategies for EVAW in Georgia and to facilitate UN Women’s strategic reflection and learning for programming in the area.
The evaluation will be conducted by the Evaluation Team, comprised of international consultant/evaluator and national consultant/interpreter in Georgia.
Criteria and Key Evaluation Questions:
The evaluation will address the criteria of Project Relevance, Effectiveness, Efficiency, and Sustainability. More specifically, the evaluation will address the key evaluation questions:
- Relevance: A) How does the project design match with the complexity of national structures, systems and decision-making processes? B) How does the project reflect and align with national strategic plans and normative frameworks as well as Georgia’s international obligations and commitments in the field of ending violence against women and domestic violence? C) Is the project design based on quality analysis, including gender and human rights-based analysis, risk assessments, socio-cultural and political analysis? D) Were the programmatic strategies appropriate to address the identified needs of beneficiaries?
- Effectiveness: A) What has been the progress made towards achievement of the expected outcomes and expected results? What are the results achieved? B) What are the reasons for the achievement or non-achievement of the project results? C) Does the project have effective monitoring mechanisms in place to measure progress towards results? D) What is the influence of the specific country context and circumstances on the achievement of results and operational effectiveness? F) How adaptable and rapidly does the project react to changing situations? G) Has the project achieved any unforeseen results, either positive or negative? For whom? H) What are the good practices and the obstacles or shortcomings encountered? How were they overcome? I) To what extent have capacities of relevant duty-bearers and rights-holders been strengthened? J) What -if any- types of innovative good practices have been introduced in the programme for the achievement of GEEW results? K) Has the project led to complementary and synergistic effects on broader UN Women efforts to combat violence against women and domestic violence in Georgia?
- Efficiency: A) Have resources (financial, human, technical support, etc.) been allocated strategically to achieve the project outcomes? B) Have the outputs been delivered in a timely manner? C) To what extend were relevant stakeholders and actors included in the project planning and implementation?
- Sustainability A) How effectively has the project been able to contribute to the generation of national ownership of the project outputs? B) What is the likelihood that the benefits from the project will be maintained for a reasonably long period of time after the project phase out? C) To what extend has the project identified strategic partners that could pick up on supporting continued government and non-governmental action when the project comes to an end? D) Do national/local institutions demonstrate leadership commitment and technical capacity to continue to replicate some project activities? E) To what extend have the project’s exit strategy been well planned and successful? F) To what extend has the UN Women been able to promote replication of project successes?
Scope of the Evaluation:
The final evaluation of the project is to be conducted externally by an international external consultant/evaluator in a team with national consultant/interpreter. It is planned to be completed in 29 working day in the period of 25 July 2019 – 30 September 2019.
The evaluation will cover almost the full project implementation period that started in November 2016 will end in October 2019.
The review will be conducted in Georgia, where the project has been implemented, in the capital Tbilisi with a travel to project target regions – Guria and/or Qvemo Qartli to collect data as defined by the evaluation plan.
Evaluation Design, Process, and Methods
The evaluation methodology will be mixed (quantitative and qualitative research methods and analytical approaches) to account for complexity of gender relations and to ensure participatory and inclusive processes that are culturally appropriate. A theory of change approach will be followed and the consultant is expected to reconstruct, validate and identify the gaps in the project’s theory of change The reconstructed theory of change should elaborate on following how “Unite to Fight Violence against Women” project has contributed to creating an enabling legislative, policy and service delivery environment in line with internationally binding standards on ending violence against women and girls (EVAWG) in Georgia. Assumptions should be tested and explain both the connections between early, intermediate and long term project outcomes and the expectations about how and why the project has brought them about. By reconstructing the ToC the evaluator is also expected to identify challenges and gaps in the implementation of the project for future improvement. Hence an eventual next phase of the project will benefit from a refined and tested ToC.
The evaluation process is divided in five phases: 1) Preparation, mainly devoted to structuring the evaluation approach, preparing the TOR, compiling programme documentation, and hiring the evaluation team; 2) Inception, which will involve reconstruction of theory of change, evaluability assessment, inception meetings, inception report and finalization of evaluation methodology; 3) Data collection and analysis, including desk research and preparation of field missions, visits to project sites 4) Data analysis and synthesis stage, focusing on data analyzed, interpretation of findings and drafting of an Evaluation Report; and 5) Dissemination and follow-up, which will entail the development of Management Response, uploading it into UN Women GATE system.
The consultant will be responsible for inception, data collection and data analysis and synthesis phases.
- Inception phase: at the beginning of the consultancy, the consultant will be provided with key sources of information for an initial desk review. At the end of this phase an inception report that will include the refined evaluation methodology will be delivered. The inception report will be validated and approved by UN Women.
- Data collection phase: based on the inception phase, the consultant will carry out further in-depth desk review, and field missions will be conducted to complete data collection and triangulation of information. Interviews and focus group discussions with key stakeholders, as relevant, will take place.
- Data analysis and synthesis phase: The collected information will be analyzed and final evaluation report will be delivered. A validation meeting will be organized where the consultant will validate the final report with UN Women and the ERG and approved by UN Women.
UN Women IEO has developed the GERAAS, which has adapted UNEG Standards for Evaluation in the UN System to guide evaluation managers and evaluators on what constitutes a ‘good quality’ report at UN Women. All evaluations in UN Women are annually assessed against the framework adopted in GERAAS and hence the consultant should be familiar with GERAAS quality standards.
In addition, UN Women is a UN-SWAP reporting entities and the consultant will take into consideration that all the evaluation in UN Women are annually assessed against the UN-SWAP Evaluation Performance Indicator and its related scorecard. The evaluation will be conducted in accordance with UN Women evaluation guidelines and UNEG Norms and Standards for evaluation and the UNEG Code of Conduct for Evaluations in the UN System (UNEG Ethical Guidelines : http://uneval.org/papersandpubs/documentdetail.jsp?doc_id=102; The UNEG Code of Conduct for Evaluation: http://uneval.org/papersandpubs/documentdetail.jsp?doc_id=100).
Stakeholders Participation and Evaluation Management
The evaluation will be a consultative, inclusive and participatory process and will ensure the participation of stakeholders engaged in the implementation of the project.
The evaluation will be Human Rights and Gender responsible and an Evaluation Reference Group (ERG) will be established.
The Evaluation Reference Group is an integral part of the evaluation management structure and is constituted to facilitate the participation of relevant stakeholders in the design and scope of the evaluation, raising awareness of the different information needs, quality assurance throughout the process and in disseminating the evaluation results. The Evaluation Reference Group will be engaged throughout the process and will be composed of relevant representatives of state and non-state stakeholders. The ERG group will review the draft evaluation report and provide substantive feedback to ensure quality and completeness of the report and will participate in the inception and validation meeting of the final evaluation report.
The UN Women Georgia Monitoring and Evaluation Focal Point will serve as the Evaluation task manager, who will be responsible for day-to-day management of the evaluation. The evaluation process will be supported by UN Women Europe and Central Asia Regional Evaluation Specialist (based in Istanbul, Turkey).
Coordination in the field including logistical support will be the responsibility of UN Women.
Within six weeks upon completion of the evaluation, UN Women has the responsibility to prepare a management response that addresses the findings and recommendations to ensure future learning and inform implementation of relevant projects.
This is a consultative/participatory final project evaluation with a strong learning component. The management of the evaluation will ensure that key stakeholders are consulted.
Duties and Responsibilities
Duties and responsibilities of the International Consultant are:
- To elaborate and submit the detailed inception report which contains evaluation objectives and scope, desk review, description of evaluation methodology / methodological approach, data collection tools, data analysis methods, key informants/agencies, evaluation questions, performance criteria, issues to be studied, work plan and reporting requirements. It should include a clear evaluation matrix linking all these aspects;
- To elaborate and finalize the data collection methodology such as guides, questioners/tools to be used with the key informants/interviewees;
- To conduct field visit combined with individual interviews and focus groups discussions with the relevant stakeholders;
- To prepare a Power Point Presentation and an outline on preliminary findings and present to ERG and reflect the feedback shared at this presentation in the final report;
- To produce and submit the draft and final evaluation reports in English. Format of the final evaluation report shall include the following chapters: Executive Summary (maximum five pages), Project description, Evaluation purpose, Evaluation methodology, Findings, Lessons learnt, Recommendations and Annexes (including interview list- without identifying names for confidentiality, data collection instruments, key documents consulted, Terms of Reference).
- Detailed Inception Report, which contains evaluation objectives and scope, findings from inception meetings with all relevant stakeholders, initial desk review, description of evaluation methodology/methodological approach, data collection tools, data analysis methods, key informants/agencies, evaluation questions, performance criteria, issues to be studied, work plan and reporting requirements. It should include a clear evaluation matrix linking all these aspects - by 10 August 2019 (7 working days, home-based);
- Data collected through completed field visit and key informant interviews and focus group discussions - by 25 August 2019 (8 working days, in Georgia);
- Data analyzed and Power Point Presentation on preliminary findings conducted to highlight key evaluation findings and conclusions, lessons learnt and recommendations- by - 30 August 2019 (2 working days, in Georgia);
- Draft and Final Evaluation report in English taking into consideration comments and feedback collected from the presentation of preliminary findings. The report shall include the following chapters: Executive Summary (maximum five pages), Introduction and Background, Evaluation approach and methodology, Findings, Conclusions, Lessons learnt, Recommendations and relevant Annexes - by 20 September 2019 (10 working days, home based). The evaluation team has to submit the initial draft of the evaluation report to Evaluation Reference Group after 7 working days and use the additional 3 days to address ERG comments/feedback and resubmit the final version to the Evaluation task manager).
- Respect for Diversity
- Awareness and Sensitivity Regarding Gender Issues
- Creative Problem Solving
- Effective Communication
- Inclusive Collaboration
- Stakeholder Engagement
- Leading by Example
Please visit this link for more information on UN Women’s Core Values and Competencies: http://www.unwomen.org//media/headquarters/attachments/sections/about%20us/employment/un-women-employment-values-and-competencies-definitions-en.pdf
Required Skills and Experience
- At least a master’s degree in sociology, international development, gender/women studies or related areas;
- At least 7 years practical experience in conducting evaluations of strategies, policies and programmes;
- Experience and knowledge on gender equality and women’s empowerment, violence against women and domestic violence;
- Experience/knowledge of gender equality and violence against women issues in Georgia;
- Excellent analytical, facilitation and communications skills and ability to negotiate amongst a wide range of stakeholders;
- Proficiency in English.
The candidates will be evaluated against the following technical and financial crteria:
- At least a master’s degree in sociology, international development, gender/women studies or related areas (max 40 points);
- At least 7 years practical experience in conducting evaluations of strategies, policies and programmes (max 70 points);
- Knowledge on gender equality and women’s empowerment, violence against women and domestic violence (max 70 points);
- Experience/knowledge of gender equality and violence against women issues in Georgia (max 70 points);
- Excellent analytical, facilitation and communications skills and ability to negotiate amongst a wide range of stakeholders (max 70 points);
- Proficiency in English (max 30 points).
Maximum total technical score amounts to 350 points. Only candidates who have passed over the minimum qualification criteria and have accumulated at least 245 points out of maximum 350 under technical evaluation will qualify for the next stage i.e. evaluation of their financial proposals.
Evaluation of submitted financial offers will be done based on the following formula: S = Fmin / F * 150
S – score received on financial evaluation.
Fmin – the lowest financial offer out of all the submitted offers qualified over the technical evaluation round.
F – financial offer under consideration.
The winning candidate will be the candidate, who has accumulated the highest aggregated score (technicalscore + financial score).