Communities of Practice (CoP) – External Evaluation (Consultancy) - UNICEF - WCARO

Objective: The objective of the consultancy is to evaluate the relevance, efficiency, effectiveness, impact, sustainability of the COP’s that are currently being supported by UNICEF WCARO through the French Muskoka Funds The evaluation should allow to answer the following questions: • What CoP have done? • What have been the direct and indirect achievements (both quantitative and qualitative) of the CoP’s from the perspectives of the CoPs themselves, of HHA agencies, of users/members of the different CoPs? What are the good practices and lessons learnt in terms of facilitation and engagement of communities’ members? • What has been the contribution of the CoPs on the policies and strategies of the nine governments benefitting from the FFM on Health Systems Strengthening/SRMNIAH? What factors have positively or negatively affected their performance (particular attention should be paid to the facilitators profile, resources and relationship with UNICEF)? • What would be the advantage for UNICEF to continue support the CoP and how this could be linked to the UNICEF’s new strategic plan, knowledge management and internal learning processes? • What is in place today? (assets) What should be done for the future?

If you are a committed, creative professional and are passionate about making a lasting difference for children, the world's leading children's rights organization would like to hear from you.

For 70 years, UNICEF has been working on the ground in 190 countries and territories to promote children's survival, protection and development. The world's largest provider of vaccines for developing countries, UNICEF supports child health and nutrition, good water and sanitation, quality basic education for all boys and girls, and the protection of children from violence, exploitation, and AIDS. UNICEF is funded entirely by the voluntary contributions of individuals, businesses, foundations and governments.

Purpose of the Assignment

Objective: The objective of the consultancy is to evaluate the relevance, efficiency, effectiveness, impact, sustainability  of the COP’s that are currently being supported by UNICEF WCARO through the French Muskoka Funds

The evaluation should allow to answer the following questions:

• What CoP have done?
• What have been the direct and indirect achievements (both quantitative and qualitative) of the CoP’s from the perspectives of the CoPs themselves, of HHA agencies, of users/members of the different CoPs? What are the good practices and lessons learnt in terms of facilitation and engagement of communities’ members?
• What has been the contribution of the CoPs on the policies and strategies of the nine governments[1] benefitting from the FFM on Health Systems Strengthening/SRMNIAH? What factors have positively or negatively affected their performance (particular attention should be paid to the facilitators profile, resources and relationship with UNICEF)?
• What would be the advantage for UNICEF to continue support the CoP and how this could be linked to the UNICEF’s new strategic plan, knowledge management and internal learning processes?
• What is in place today? (assets) What should be done for the future?

Assignment Tasks

1. Methodology

1. Desk review and review of existing documents
2. Analysis of existing documents
3. Qualitative data collection including but not limited to in-depth interviews of sub-sample of the users including partners, government officials involved in the CoP through skype…
4. On-line statistics analysis (forums online etc.)
5. Triangulation of all information

 Expected Deliverables

STEP 1: Produce an inception report and evaluation grid based on review of literature

The consultant will review existing literature on COP’s[1] and will develop a methodology and an evaluation grid that will allow to describe at least the following elements of the CoPs: the nature, objectives, composition, evolution, volume of activities, learning agenda and contribution of the facilitator. The methodology and evaluation grid will be shared and discussed with the facilitators of the COP’s and with UNICEF WCARO and will need to be validated by UNICEF WCARO before continuing the evaluation.

 STEP 2: Compilation and completion of data to fill in the evaluation grid

The consultant will collect data by reviewing activity reports produced by the COP’s, report from reviews conducted, webinars recordings, and any other reports available within the CoP’s. A questionnaire will also be developed and used to gather information from facilitators and key resource persons.

 STEP 3: Conduct interviews with facilitators and key resource persons

The consultant will conduct a series of interviews (F2F or skype) with the facilitators of the COP and any other resource person identified as such. Interviews of key respondents of the ministries of health targeted by the FFM in the 9 countries will be held to assess the impact of the CoPs on policies and strategies on HSS and SRMIAH. One or two country visits may be envisaged if funding is available.

 STEP 4: Produce an evaluation report

The consultant will produce a draft evaluation report that will contain:

• A separate evaluation of each CoP à these separate evaluations should be  discussed and approved by UNICEF before sharing with all the facilitators
• A comparative evaluation of the five CoP’s à this part of the report will allow UNICEF to feed into strategic decisions on future support
• A global evaluation report of all the CoP’s
• Recommendations to UNICEF based on key findings

• The report should include both operational (e.g. contractual aspects and availability of resources) as strategic elements (How can UNICEF better exploit these COP’s? How to better articulate the CoPs with country, regional and HQ priorities? How to organize learning so that some CoP practices can feed into knowledge management and internal learning at UNICEF?)

   STEP 5: Present the final conclusions of the evaluation report during a regional meeting of facilitators and users of the COP’s

The consultant will present the final conclusions of the evaluation report during a regional meeting between UNICEF, the facilitators and main users of the CoP’s. 

 In summary, the consultant will submit 3 deliverables: an inception report (methodology and evaluation grid), a draft evaluation report – for UNICEF comments, and a final report that takes into account comments and inputs from UNICEF WCARO.

 Management, Organization and Timeframe

Regular exchanges with the HSS team will be organized. Their review and inputs are requested at all the five steps of evaluation process.

Supervisor and frequency of performance reviews:

• Regional adviser Health System Strengthening, in collaboration with the PM&E specialist, UNICEF WCARO
• Performance review will be discussed whenever needed or required by the consultant.

Qualifications of Successful Candidate

Education

University degree in related field such as Public Health,

Professional Experience and expertise requirements:

• Years of relevant experience
• At least eight  years of work experience in knowledge management and research
• Experience in conducting evaluation and research. P5 level,
• Good knowledge of health systems in the West and Central Africa Region
• Excellent knowledge and practice of professional networks, social networks including facilitation methods, new technologies of the information; a professional experience with other CoPs will be an asset
• Excellent writing skills and analysis skills

Competencies of Successful Candidate

 To view our competency framework, please click here. 

Please indicate your ability, availability and daily/monthly rate (in US$) to undertake the terms of reference above (including travel and daily subsistence allowance, if applicable).  Applications submitted without a daily/monthly rate will not be considered.

UNICEF is committed to diversity and inclusion within its workforce, and encourages qualified female and male candidates from all national, religious and ethnic backgrounds, including persons living with disabilities, to apply to become a part of our organisation.