Local Consultant - Team Member / UN Women Joint Programme Portfolio Evaluation
The Water Supply and Sanitation Collaborative Council (WSSCC)?
The mission of the Council is to ensure sustainable sanitation, better hygiene and safe drinking water for all people, with focus on the poorest and most marginalized members of society in low- and middle-income countries in Africa and Asia.? To achieve its mission, WSSCC facilitates sector coordination at national, regional and global levels, and engages rights holders and duty bearers to adopt policy guidelines on menstrual hygiene and disability.
The Council also supports national sanitation and hygiene improvement programmes through its Global Sanitation Fund, coordinates knowledge platforms, and advocates on behalf of the 2.4 billion people without access to improved sanitation. For more information on WSSCC, please go to http://wsscc.org/.
WSSCC entered into a partnership with the United Nations Entity for Gender Equality and the Empowerment of Women, also known as UN Women. UN Women is a United Nations entity and the global champion for gender equality, working to develop and uphold standards and create an environment in which every woman and girl can exercise her human rights and live up to her full potential. For more information on UN Women, please go to http://www.unwomen.org.
UN Women West and Central Africa Regional Office (UN Women WCARO)
UN Women WCARO, through its regional offices in Dakar and Nairobi and several country offices, implements programmes tailored to individual countries, in close collaboration with governments, the UN system and civil society. UN Women promotes the integration of gender in national planning and budgeting, trains national officials and provides technical support to the monitoring progress. It also carries out advocacy initiatives to promote and strengthen the empowerment of women. For more information on UN Women WCARO, please go to http://africa.unwomen.org/en.
About the WSSCC/UN Women Joint Programme on Gender, Hygiene and Sanitation (Joint Programme hereafter)
UN Women and the WSSCC launched a partnership aimed at accelerating women and girls’ right to sanitation and hygiene in West and Central Africa on 9 March 2014, as part of the celebrations for International Women’s Day in Senegal. The Joint Programme on Gender, Hygiene and Sanitation was designed to support governments in West and Central Africa to formulate evidence-based policies, laws, regulations and programmes to achieve the human rights of women and girls to sanitation and hygiene.? Furthermore, using Menstrual Hygiene Management (MHM) as an entry point to challenge historical gender inequalities, the programme made a commitment to ensure women and? girls’? right? to? dignity? and? wider? developmental? outcomes? such? as? health, education, decent jobs and well-being.? With a budget of approximately USD? 2 million covering the three-year programme period, the programme has been functional in three countries to date: Cameroon, Niger and Senegal.
Driven by the complementary technical skills and political expertise of two members of the United Nations family, the programme has worked to fill a critical gap in policy, practice and research on Gender and WASH in West and Central Africa.
To achieve the above-stated goals, the Joint Programme is designed to deliver on four key objectives at the level of public policies, knowledge and practice, research and inter-agency learning:
Objective 1: to ensure that the specific needs of women and girls regarding sanitation and hygiene are integrated into policies, laws and regulations, and are budgeted for in the target countries- Senegal, Cameroon and Niger.
Objective 2: to identify good practices in the field of sanitation and hygiene for women and girls and integrate it into training materials.
Objective 3: to identify knowledge gaps to improve the programme.
Objective 4: to identify lessons learned to equip the two organisations to work more effectively towards a progressive reduction of inequalities.
WSSCC has been responsible for the oversight and overall management of the programme and UN Women led the strategic, operational and programmatic coordination at the local, national and regional level for effective implementation of the programme activities.? Both organisations have also worked in partnership to carry out advocacy at strategic global platforms such as the Commission for the Status of Women (CSW).
As specified in the programme design, the Joint Programme is required to undergo an independent end -term evaluation that is both a summative and a formative/forward-looking exercise, aimed at supporting WSSCC and UN Women for their learning, reflection and future decision-making.? The evaluation intends to identify lessons and share them widely; report to donors on whether project objectives were met and resources were prudently utilized; identify areas of improvement and future opportunity; highlight and resolve problems; get feedback, appraisal; and attract recognition.? To this end, the end-term evaluation will seek to measure the impact made in the West and Central Africa Region based on the objectives and original programme definition of impact.? The evaluation will measure the extent to which the Joint Programme has fully implemented its activities, delivered outputs and attained planned as well as unplanned/un-intended outcomes. It will also generate substantive evidence-based knowledge by identifying any unplanned results and provide forward-looking recommendations to sustain and build on the achievements of the programme.
The evaluation will uphold the UNEG Norms and Standards for Evaluation.? It will attempt to answer questions related to the evaluation criteria of the Organization for Economic Co-operation and Development (OECD), including relevance, development efficiency, effectiveness and sustainability, in addition to assessing the programme on Gender, Equity and Human Rights principles. The evaluation is expected to be utilization-focused, providing key lessons and clear, concrete, feasible recommendations.
The evaluation questions will be finalized during the inception phase. As part of the inception meeting, the evaluation team is required to develop an evaluation matrix identifying a set of indicators, sources, sampling methods, and methodology for answering each evaluation question. The overall objective will be to assess the following evaluation questions:
- What does the project evaluation tell us regarding the relevance of the programme and its strategy, paying specific attention to the partnership arrangement and cooperation between a WASH and a NonWASH UN organization to achieve mutually complementing objectives outlined in the Inter-Agency Agreement?
- Are the activities and outputs consistent and aligned with the defined and documented overall goal and objectives of the programme?
- Is the programme responding to a need in the countries/region?
- To what extent were the results achieved against what was originally planned or subsequently officially revised?
- What were the major factors influencing the achievement or non-achievement of planned results? What are the elements of success or failure?
- Which activities are yielding desired results, which are not and what are the reasons for differences in performance?
- How appropriate are planning, monitoring, and reporting systems and procedures working?
- To what extent were planned outputs achieved on time?
- To what extent was the time put in to the activity proportionate to the outcome?
- Does the programme offer a plausible value for money proposition?
- Wat activities were achieved as a result of the cooperation of both organisations (UNW-WCARO & WSSCC)??
- What processes are in place to disseminate learning to other contexts?? To what extent has the programme contributed to strengthening capacities of Ministries, non-governmental organizations in the region on gender equality in WASH?
- Which initiatives and/ or Government programmes benefited from the programme and how?
- What information was available on MHM in the three countries before the start of the programme in 2014 and what were the existing projects or initiatives on gender equality in WASH?
- What information is available on MHM and/or WASH for women and girls in the three countries to date? What initiatives and/projects emerged since 2014?
·- Has the programme contributed to strengthening existing government programmes or other initiatives? If yes, how??
Gender, Equity and Human Rights
- To what extent were the principles of gender equality integrated into programme objectives and processes?
- In what ways did the programme address the underlying causes of gender inequality, the situation of women and marginalized groups?
- To what extent has the programme contributed towards transforming the gender relations and power differentials between different groups?
- Has the programme been implemented as per the principles of human rights and development effectiveness through participation/empowerment; inclusion/non-discrimination; national accountability/transparency?
UN SWAP Evaluation Performance Indicator:
The evaluation report must demonstrate compliance with the UN SWAP Evaluation Performance Indicator in accordance with the following evaluation quality criteria:
- Gender Equality and the Empowerment of Women (GEEW) is integrated in the evaluation scope of analysis and evaluation indicators are designed in a way that ensures GEEW related data will be collected;
- GEEW is integrated in evaluation criteria and evaluation questions are included that specifically address how GEEW has been integrated into the design, planning, implementation of the intervention and the results achieved;
- A gender-responsive methodology, methods and tools, and data analysis techniques are selected;
- Evaluation findings, conclusions and recommendations reflect a gender analysis.
- What are the key lessons from the programme- what has worked, what has not worked and why?
- Are there lessons that can be applied in a different context?
- What are some of the key lessons to consider to embed the programme objectives firmly in the West, Central Africa Region, and globally?
- Identify and document unexpected or unplanned issues that may have facilitated or hindered the success of the programme.
Joint Evaluation Modality
WSSCC believes in the principles of participatory evaluation, shared learning, reflection and overall programme improvement.? The joint evaluation arrangement aims to collectively assess the relevance, efficiency, effectiveness and sustainability of the programme while ensuring shared ownership of the findings and recommendations. The evaluation findings will also help address broader evaluation questions, beyond the results of one individual agency. It is also intended to limit the number of different evaluations and their associated costs and avoid the risk of duplication.? Following these principles, the UN Women - WCA Regional Office will lead the Joint Evaluation with the HQ (IEG-Independent Evaluation Group, UN Women) assuming Advisory responsibilities. The joint evaluation will be co-led by WSSCC. An Evaluation Technical Committee will be set up to manage the Evaluation, including quality control and adherence to the UNEG Principles. An Evaluation Steering Committee is set up to approve the TORs and other deliverables.? In addition, an Evaluation Reference Group will be set up to facilitate the participation of the relevant wider public in the design and scope of the evaluation, raise awareness of the different information needs, and to disseminate the evaluation results.? The Evaluation Reference Group will be composed of experts in the subject area drawn from education, government, civil society, etc.? For a breakdown of the roles and responsibilities of each group in the management structure for the evaluation, please refer to Table 2 labelled Management Structure and Responsibilities.
This arrangement would maximize the likelihood of using recommendations addressed to both parties.? The independent consultant or team will report to and be managed by the Evaluation Unit at the UN Women WCA Regional Office.
Team composition:? The independent evaluation team will be composed of an international team leader and three national evaluators from Senegal, Niger and Cameroon.
The evaluation will employ a mixed method approach that includes document reviews, key informant interviews, and field visits of the three countries.
- The evaluators shall familiarize themselves with the programme through a review of relevant documents.
These documents will include, but not be limited to:
- Joint Programme Work Plan;
- Annual progress reports;
- Project procurement and financial documents;
- Reports of the Steering Committee meetings;
- Policy briefs, studies and any other technical reports;
- Joint Programme case study conducted as a part of the WSSCC Medium-Term Strategic Plan (MTSP) Review, and completed in 2016;
Key Informant Interviews:
- The evaluator shall do a comprehensive stakeholder mapping in the beginning to identify the key informant interviewees;
- The evaluator shall carry out key informant interviews, including with UN Women country offices in Senegal, Niger and Cameroon, Ministerial-level government officials and other senior government officials. In addition, hold interviews with the WSSCC Geneva-based Joint Programme portfolio team, as well as UNOPS focal point for grant - support;
- During site visits, the evaluator will carry out interviews with the community, making sure that the perspective of the most vulnerable group is included in the consultation;
- The interviews should be organized in a semi-structured format to include, e.g. focused group discussion; individual interviews; surveys; and/or participatory exercises with the community/individuals.
- A sampling strategy should be selected to elaborate on the sampling techniques that will be applied choosing the sites to visit for field visits and observation.
Limitations to the evaluation
The End-Term Evaluation aims to evaluate the programme against its planned outcomes as well as to identify and document its significant unexpected or unplanned results. It is, however, limited in its scope to carry out an impact evaluation at this stage.
Duties and Responsibilities
The deliverables expected for the scope of work for this assignment are as follows, along with a detailed list of deliverables and timeline in Table1 labeled Proposed list of deliverables:
- A detailed inception report, including a work plan that will respond to the TOR with clear links between the proposed evaluation approach and evaluation questions.
- A briefing and report with preliminary findings;
- A draft evaluation report for a 360-degree review and feedback;
- A final evaluation report incorporating the 360-degree feedback;
- A compliance note against the comments/360-degree feedback;
- A presentation of the final evaluation report to the primary stakeholders of the evaluation.
- A power point presentation of key findings and recommendations that can be shared internally by WSSCC and UN Women with their Steering Committee and Board respectively.
- A succinct, user friendly learning document that captures the main evaluation messages and can act as a standalone summary of the evaluation report for broader dissemination.
All draft and final outputs, including supporting documents, analytical reports and raw data should be provided in electronic version compatible with Word for Windows. All evaluation report submissions must include a MS Word and a PDF version.? All deliverables must be submitted in French. The translated versions in English must be validated by the independent consultant.
The evaluation must be completed to the highest standards and in a timely manner in order to qualify for the shortlist of outstanding annual corporate evaluations in UN Women HQ.? In addition, the key lessons/emerging findings should be available for sharing for a regional event in Senegal in October and the evaluation should be completed by November.
The independent consultant shall submit a draft report to UN Women and WSSCC within 30 days following completion of the evaluation mission.? UN Women will solicit and revert promptly with collective feedback from WSSCC, Joint Evaluation Steering Committee and the Reference Group for the evaluator to finalize the report. The evaluator is required to append the following items to the final report:
- Terms of Reference;
- Data collection instruments;
- List of meetings/consultations attended;
- List of persons or organisations interviewed;
- List of documents/publications reviewed and cited;
- Any further information the independent consultant deems appropriate;The procedures for the submission of the final report will be as follows in consecutive order:
- The consultant will submit a draft evaluation report to the UN Women Evaluation Unit using the proposed Evaluation Report Outline in Table 4 as a guidance/reference document;
- The UN Women Evaluation Unit will forward a copy to the three Committees for review and feedback;
- The UN Women Evaluation Unit will consolidate the comments and send them to the evaluator;
- The consultant will finalize the report incorporating any comments deemed appropriate and providing a compliance note explaining why any comments might not have been incorporated. He/she will submit the report in track changes along with the compliance check to the UN Women Evaluation Unit;
- UN Women Deputy Regional Representative jointly with WSSCC Representative along with WSSCC’s Senior Evaluation Officer and the UNW- WCA Regional Evaluation Specialist approve the evaluation products. Both UN Women and WSSCC will abide by the principles of independence, impartiality, transparency, quality and credibility;
- The Evaluation Steering Committee will officially complete a management response within six weeks of receiving the evaluation;
- The evaluation will comply with UN Norms and Standards and UNEG ethical guidelines.
Budget and Level of Effort
The budget should be realistic, with consideration given to the comprehensiveness of the evaluation topics, size of the team and resource constraints. The consultancy service is planned for a maximum of 60 days’ level of effort.
- Excellent management skills, negotiation, communication, and interviewing skills;
- Ability to work in a team and independently;
- Ability to deliver results within strict deadlines, and report writing skills is required;
- Ability to work in a multicultural and multidisciplinary team environment;
- Ability to be flexible and adaptable;
- The ability to maintain confidentiality;
- Respect and trust of other programme stakeholders;
- Respect for UN Values and Principles.
Required Skills and Experience
- Advanced university degree (Master) in International Development, Human Rights, Gender Studies, Social Science, Water and Sanitation, Community Development, or Public Health.
- Minimum of 7 years of proven experience in International Development particularly in Gender and Human Rights and Water, Sanitation and Hygiene (WASH) is required;
- Knowledge and understanding of gender and public health and MHM is desirable;
- Previous experience and knowledge of the region is required;
- A national member from the West & Central Francophone Africa region is required;
- Knowledge and country experience of Cameroon, Niger, and Senegal related to Gender, WASH and Human Rights is required;
- Demonstrated track record of designing and leading complex evaluations of regional/multi-country programmes that aims to achieve policy and programme transformation on the issues of equality, non-discrimination and Human Rights is required;
- Substantive experience in reviewing and evaluating similar technical assistance projects, preferably those involving UN Women and WSSCC or other United Nations development agencies and/or other major donors is required;
- An ability to assess policy and governance framework and institutional capacity is required;
- Relevant experience with UN organizations, major donors, INGOs, local NGOs, national and local governments, etc. is required;
- Proven expertise in applying innovative and creative evaluation approaches and methodologies such as high-level Ministerial round table dialogues to evaluate initiatives and programmes that are transformative in nature is desirable;
- Understanding of governance, political, economic and institutional issues associated with WASH and gender issues in the region is required;
- Proven experience to engage in high-level dialogue with Policy makers and Senior Government Officials to seek their inputs, facilitate their endorsement of the evaluation process, its results and utilisation of the recommendation(s) is required;
- A reasonable level of expertise in assessing the value for money of programmes;
- Good mastery of information technology required for organized presentation of information, including quantitative information and graphical presentations, and for organizing information and materials is desirable;
- A strong commitment to ensuring the dissemination and use of evaluation findings is desirable.
- Excellent English and French writing and communication skills and demonstrated ability to assess complex situations to succinctly and clearly distil critical issues and draw well supported conclusions is required.
Candidates should submit
- A letter of interest with indication of availability during the period from August 2017 to December 2017;
- A personal CV, not to exceed two pages. The candidate is required to provide only information relevant to the evaluation in her CV.