Consultant Evaluation of the ‘Emergency Assistance to Internally Displaced Women and Girls and Survivors of SGBV in Nigeria - (2016-2017)’
The North-East Nigeria has witnessed unprecedented violent conflict orchestrated by frequent insurgence. This has resulted to widespread displacement, violations of international humanitarian and human rights law, protection risks and a growing humanitarian crisis. The crisis which began in 2009, have resulted to the death of more than 20,000 people, over 2,000 women and girls have been abducted and 2.5 million people have fled their homes, of whom 2.2 million are internally displaced, and 177,000 are seeking refuge in the neighboring countries of Cameroon, Chad and Niger.
In the second half of 2015, reports show that more than two-third of internally displaced persons (IDPs) were made up of women and children suggesting that women and children constitute the largest proportion of IDPs in Adamawa, Bauchi, and Gombe States.
Women and girls in particular face grave threats and are affected in various ways, ranging from direct killings and injuries, of becoming victims of sexual violence, of being separated from their families, of being recruited and used as operatives in suicide attacks, and suffering extreme distress, egregious physical and psychological abuse to more subtle, yet persistent and irreversible effects on schooling, health, nutrition, future opportunities and overall well-being.
Duties and Responsibilities
UN Women Response
- UN Women received support from the Government of Japan to implement the “Emergency Assistance to Internally Displaced Women and Girls and Survivors of Boko Haram Terrorism Attacks in Nigeria” (2016-2017) in the three most affected states of Borno, Adamawa and Yobe where about 7 million people needed humanitarian assistance, with 80% of them being women and children.
- Through this project, UN Women prioritized the reinforcement and the integration of gender into humanitarian response in the three most affected states in Nigeria with an explicit focus of targeting women and girls, especially in a context in which they have such a crucial status.
- The intervention focused on filling critical gender gaps in the on-going humanitarian response activities in three areas: (a) Strengthen emergency assistance initiatives to Internally Displaced Persons (IDPs) women/girls and survivors of SGBV in target areas; (b) Improve the economic capacity and social rehabilitation of women affected by crisis for peaceful cohabitation in target areas and (c) Strengthen humanitarian coordination mechanisms for a more comprehensive and gender-responsive approach in Nigeria.
- In line with the project objectives and expected outcomes, UN Women conducted a baseline survey on the socio-economic status of women and girls affected by insurgency in the three states, serving as a framework for the project.
Purpose and use of Evaluation
- The evaluation will serve a dual and mutually reinforcing learning and accountability purpose as it provides an opportunity to (i) consolidate learning from what worked and what could be done differently in improving emergency assistance to internally displaced women and girls and survivors of SGBV; and (ii) offer evidence-informed recommendations geared towards building gender-sensitive assistance in IDP camps and host communities, including access to skills acquisitions and improved livelihoods. The evaluation is also expected to identify the internal and external enabling factors and challenges to Nigeria CO’s performance on emergency response in such a complex environment.
- UN Women Nigeria, the government of Japan and relevant partners in Nigeria will be the prime users of this evaluation. The evaluation will also be used to inform the ongoing corporate Thematic Evaluation of UN Women’s Contribution to Humanitarian Action and will inform and influence strategies, priorities, approaches, decisions and actions needed to scale-up and sustain an effective gender responsive intervention in crisis situation.
The specific objectives of the evaluation are to:
- Assess the relevance and contributions of the interventions to the humanitarian agenda in Nigeria;
- Assess effectiveness and organizational efficiency in progressing towards the achievement of GEWE in humanitarian action;
- Identify intervention gaps, lessons learned, good practices and examples of innovation that could be replicated or used to inform future projects;
- Propose relevant recommendations based on the evaluation results and outcomes to UN Women’s humanitarian action in Nigeria; and
- Assess how the human rights-based approach and gender equality principles are integrated into the work in humanitarian action.
- The evaluation will seek to answer the following key evaluation questions.
Relevance / Appropriateness
- To what extent has UN Women’s emergency assistance to Internally Displaced Women and Girls and Survivors of SGBV project adapted to identified humanitarian needs?
- To what extent has UN Women’s response been appropriate in the context of the needs and priorities of the affected populations, particularly those left furthest behind in humanitarian contexts?
- To what extent was UN Women’s NGN office able to adapt its strategies and project to respond to changes in the context?
- To what extent did UN Women Nigeria Office interventions reach the population groups with greatest need for increased access to adequate survivor services and holistic emergency assistance to IDP’s women and girls and survivors of SGBV in the host communities?
- To what extent did the UN Women response contribute to economic recovery of women and girls IDPs and their vulnerable host communities?
- To what extent has UN Women Nigeria Office contributed to having more women play a greater role and being better served by emergency assistance?
- What are enabling and limiting factors that contribute to the achievement of results and what actions need to be taken to overcome any barriers that limit the progress?
- To what extent has UN Women’s institutional arrangements, operational mechanisms and financial resources advanced an effective and efficient response?
- To what extent did UN Women make good use of its human, financial and technical resources, as well as of different partnerships in pursuing the achievement of the results expected from its emergency response?
- Does the project complement the activities of other thematic areas embedded in the Nigeria CO Strategic Note and build on synergies with them?
- Has the project build synergies with other programmes being implemented at country level with the United Nations and the Government of Nigeria?
- To what extent is UN Women NGN contributing to making coordination mechanisms on emergency response more gender-sensitive?
Connectedness and Sustainability
- To what extent did UN Women NGN Office humanitarian activities support, and plan for, longer-term (across the humanitarian-development-peace continuum) goals of the project?
- Was the assistance provided in a way that took account of the longer-term context?
- To what extent has UN Women enhanced national and local ownership to strengthen the resilience of communities?
Gender Equality and Human Rights
- To what extent does the humanitarian action work undertaken by UN Women address the underlying causes of inequality and discrimination?
- To what extent were a human rights based approach and gender equality incorporated in the design and implementation of the project?
The evaluators are encouraged to further analyze stakeholders according to the following characteristics:
- System roles (target groups, programme controllers, sources of expertise, and representatives of excluded groups);
- Gender roles (intersections of sex, age, household roles, community roles);
- Human Rights roles (rights holders, principal duty bearers, primary, secondary and tertiary duty bearers);
- Intended users and uses of the respective evaluation.
The evaluators are encouraged to extend this analysis through mapping relationships and power dynamics as part of the evaluation. It is important to pay particular attention to participation of rights holders—in particular women and vulnerable and marginalized groups—to ensure the application of a gender-responsive approach. It is also important to specify ethical safeguards that will be employed. The evaluators are expected to validate findings through engagement with stakeholders at stakeholder workshops, debriefings or other forms of engagement.
Stakeholders and Stakeholder participation
- The primary stakeholders of the evaluation are the implementing and collaborative partners: UN Women, the federal ministry of women affairs and social development (FMWA&SD), State Ministry of Women Affairs and Social Development (Adamawa, Bauchi, Borno and Gombe states), National Center for Women Development (NCWD, National and state Emergency Management Agency (NEMA/SEMA), UNOCHA. UNFPA, FAO, relevant CSOs; Adventist Development and Relief Agency (ADRA), E-Way for Development (Women and Youths Environmental Safety and Empowerment Organization) IANSA – (International Action Network on Small Arms) Women Network Nigeria, women groups; and Association for the Advancement of Women in Nigeria (ASSAWIN).
Evaluation Approach and Scope
- The evaluation will be a transparent and participatory process involving relevant UN Women stakeholders and partners both at the central and sub-regional level where the project was implemented. It will be based on gender and human rights principles, as defined in the UN Women Evaluation Policy and adhere to the UN norms and standards for evaluation in the UN System.
- The evaluation methodology will be based on mixed methods and will deploy a variety of evaluation techniques ranging from desk review, interviews, surveys, observation and other participatory methods. Efforts will be made to capture and document real voices of women and girls and marginalized groups.
- The evaluation should adopt a flexible approach given the complex nature of the interventions. An important component of this evaluation will be the assessment of the project results logic and approach. Based on the results of the baseline survey already commissioned and the implicit ToC articulated in the project document, the evaluation team will reconstruct a theory of change during the inception phase of the evaluation. The evaluation should also look into the synergy with other projects/programmes implemented by UN Women and other partners.
- The evaluation will be carried out in the implementation states (Borno, Adamawa and Yobe) and the federal capital. The project will cover the period 2016-2017.
Data Collection & Methodology and Scope
The detailed methodology for the evaluation will be developed and validated with the CO and relevant stakeholders at the onset of the evaluation and will build on the following methodologies for collecting and triangulating data.
Initiation of evaluation exercise
Inception phase of evaluation
Desk Review of Documents
The evaluation should begin with an in-depth context analysis of the project from a desk review of documents that can also answer questions of relevance and appropriateness (e.g. successes, challenges, lessons learnt, opportunities, etc.).
October 25-5 November, 2018
Clearly outlining the key scope of the work and intended work plans of the teams. The inception report will be discussed and agreed with the Evaluation Reference Group and the Evaluation Managers. The report should include evaluation objectives and scope, description of evaluation methodology/methodological approach, evaluation matrix that displays each evaluation criteria, questions and sub questions, and data collection methods. The Inception Report will also include key areas for further examination from the desk review.
November 6, 2018
Organisation and Logistics
The Country Office through the Evaluation Manager prepare necessary logistics for Evaluation Team to conduct the evaluation by facilitating access to additional background information, organising site visits and interviews, providing office space etc.
Evaluation Manager inform the national stakeholders when the evaluation is about to start to facilitate a smooth evaluation process.
Data collection phase of evaluation
Field mission and data collection
Field mission of approximately 10 days. Depending on the accessibility and security situation on the ground, a selection criteria will be developed in consultation with the ERG and CO management. A participatory approach will be used during the field site visits. Data collection methods during site visits include in-depth interviews, focus group discussions with relevant informants: UN Women CO staff and management, other UN agencies, donors, national counterparts, and CSOs and surveys. Evaluation Team will ensure that data collection methods are gender and human rights-responsive and that the voices of women and other groups subject to discrimination are included. In addition, the Evaluation Team will abide by the UNEG Ethical Guidelines and Code of Conduct and guarantee the principles of anonymity, confidentiality and informed consent to protect the individual informants.
Inception Meeting [first day of the field mission]: Consist of a one-day inception meeting with Evaluation Reference Group and Country Office Staff to clarify the purpose of the evaluation and collection useful information on the expectations.
November 15, 2018
Analysis and reporting phase
Data Analysis Phase
The evaluation team will implement the data analysis methods agreed in the inception report (or as revised following the data collection phase), ensuring triangulation, and integration of human rights and gender analysis. All data collected through the course of evaluation by the evaluation team will be made available to the IES.
December 20, 2018 – February 2019
Presentation preliminary findings
At the end of the mission, the Evaluation Team presents Preliminary Findings outlining the preliminary findings, conclusions and recommendations from the evaluation based on the data collection to date. Comments received will be integrated by the Evaluation Team as an input to the draft evaluation report. The evaluation team will maintain an audit trail of the comments received and provide a response on how the comments were addressed.
The Evaluation Team prepares the draft evaluation report incorporating the feedback received on the Preliminary Findings report and additional data collection and analysis. The Evaluation Manager review the report and requests any necessary changes before circulating for comment. UN Women quality assessment tool [GERAAS] should be provided to the Evaluation Team by the Evaluation Managers.
The final report will include a concise Executive Summary and annexes detailing the methodological approach and any analytical products developed during the course of the evaluation. The report has to be logically structured, containing evidence-based findings, conclusions, lessons and recommendations.
30 February 2019
The Evaluation will be conducted under the overall guidance and supervision of the Evaluation Manager and UN Women Independent Evaluation Service Evaluation Specialist. The Evaluation Managers will quality assure the evaluation report. The draft and final evaluation report will be shared with the Evaluation Reference Group for quality review. All of the outputs and payments are subject to the approval of the Evaluation Manager and UN Women Independent Evaluation Service - Evaluation Specialist.
Evaluation team composition
- A qualified evaluation expert is required to undertake the evaluation. The consultant will is expected to have significant experience in designing and conducting gender responsive evaluation and experience on humanitarian evaluation. The consultants will be expected to work with the UN Women Evaluation focal persons in country and the UN IES Evaluation Specialist to agree implementation of the evaluation processes. The national consultant will lead the development of the inception report, data collection, translations analysis and drafting of the report.
- The IES Evaluation Specialist will also take part in the data collection, quality assurance of the entire evaluation process as well as assisting the consultants in the write-up of the final report. The national consultants will support the evaluation team in collecting the required data
- The estimated number of person-days required for national consultant is 40 days spread over four months period.
 Relevance and appropriateness are complementary criteria often used in HA evaluation. “Appropriateness focuses on the extent to which an intervention is tailored to local needs and context, and compliments other interventions from other actors. It includes how well the intervention takes into account the economic, social, political and environmental context, thus contributing to ownership, accountability, and cost-effectiveness.” http://www.ifrc.org/Global/Publications/monitoring/IFRC-Framework-for-Evaluation.pdf
 In evaluating humanitarian interventions which are not designed to be sustainable, connectedness is often used instead of sustainability as an evaluation criterion. As defined by Minear (1994) connectedness assesses whether activities of a short-term emergency nature are carried out in a context which takes longer-term and inter-connected problems into account. - https://evaluation.msf.org/sites/evaluation/files/evaluation_of_humanitarian_action.pdf
CORE VALUES / GUIDING PRINCIPLES
- Integrity: Demonstrate consistency in upholding and promoting the values of UN Women in actions and decisions, in line with the UN Code of Conduct. Exhibits positive actions without consideration personal gains nor interests. Upholds prompt action in cases of unethical behavior. Possess the ability to resist political pressure in decision making.
- Professionalism: Express professional competence and expert knowledge of the pertinent substantive areas of work. Shows persistence and resilience when faced with challenges. Mandatory to be conscientious and efficient in meeting commitments, deadlines and must be result-oriented.
- Cultural sensitivity and valuing diversity: Showcase an appreciation of the multicultural nature of the organization and the diversity of its staff. Demonstrate an international outlook, appreciating difference in values and learning from cultural diversity. Ensure conscious and constant effort to eexamine personal biases and behaviours to avoid stereotypical responses
- Ethics and Values: Demonstrate and safeguard ethics and integrity
- Organizational Awareness: Demonstrate corporate knowledge and sound judgment
- Planning and Organizing: Develops clear goals that are consistent with agreed strategies.
- Identifies priority activities and assignments; adjusts priorities as required. Allocates appropriate amount of time and resources for completing work. Foresees risks and allows for contingencies when planning. Monitors and adjusts plans and actions as necessary. Uses time efficiently
- Development and Innovation: Take charge of self-development and take initiative
- Work in teams: Demonstrate ability to work in a multicultural, multi ethnic environment and to maintain effective working relations with people of different national and cultural backgrounds.
- Communicating and Information Sharing: Facilitate and encourage open communication and strive for effective communication
- Self-management and Emotional Intelligence: Stay composed and positive even in difficult moments, handle tense situations with diplomacy and tact, and have a consistent behavior towards others
- Conflict Management: Surface conflicts and address them proactively acknowledging different feelings and views and directing energy towards a mutually acceptable solution.
- Continuous Learning and Knowledge Sharing: Encourage learning and sharing of knowledge
- Appropriate and Transparent Decision Making: Demonstrate informed and transparent decision making
- Excellent research skills
- Ability to lead formulation of strategies
- Strong networking skills
- Excellent knowledge of the women’s economic empowerment thematic area
- Ability to build strong relationships and focus on impact and result for the client and responds positively to feedback
- Excellent oral and written communication skills
- Focuses on impact and result for the partners and responds positively to feedback.
- Adaptability and dynamism
- Attention to detail
- Strong analytical skills
- Ability to work under pressure
- Technological awareness
Required Skills and Experience
Advanced University degree (master’s Degree or equivalent) in a relevant Social Science (Development studies, peace and security, humanitarian studies, public administration, anthropology, agricultural economics, and food security, Business Administration, International Relations)
- Field experience of humanitarian response in complex environments
- Sectoral knowledge of UN Women thematic areas: women economic empowerment, violence against women etc
- Advanced understanding of humanitarian principles, humanitarian space, humanitarian access, gender as well as Advanced understanding of accepted norms and standards for humanitarian response; Core Humanitarian Standards, Sphere standards, INEE, and IASC guidance materials for protection and cross cutting issues in humanitarian response
- Previous work or consultancy experience with UN and understanding of UN Women’s mandate is desirable
- Advanced technical knowledge, skills and expertise in gender responsive evaluation
- Strong quantitative and qualitative data collection, and analysis and synthesis skills
- Experience and strong facilitation skills
- Ability to work under strict deadlines and schedules
- Fluency in written and spoken English is required
- Knowledge of Hausa is an asset but not compulsory