Consultancy - Evaluation of Empowerment of Youth for Economic Development and Peace Building Programme
Juba (South Sudan)
Save the Children Context
Save the Children is the world's leading independent organisation for children. With work in 120 countries, we save children's lives; we fight for their rights; we help them fulfil their potential. We work together, with our partners, to inspire breakthroughs in the way the world treats children and to achieve immediate and lasting change in their lives. We have over two million supporters worldwide and raised 1.6 billion dollars last year to reach more children than ever before, through programmes in health, nutrition, education, protection and child rights, also in times of humanitarian crises.
Save the Children has been operating in South Sudan since the early 1990s and currently implements programmes in eight out of ten states, including the states most affected by the current conflict. Save the Children works closely with local and international non-governmental organisations across a number of sectors including education, health and nutrition, child protection, child rights governance, food security and livelihoods. With a large child protection and technical vocational training programme portfolio in South Sudan, Save the Children works to strengthen local partners and stakeholders, and to provide life-changing services to children and juveniles in Lakes State, delivering integrated vocational training and justice strengthening programmes for at risk juveniles and children.Programme context
Recognising the lack of Technical Vocational Education and Training (TVET) opportunities for youth, and poor access and judicial practice for youth and juveniles, Save the Children South Sudan was awarded a total of 2.449 million Euro from the Dutch Government to implement The Empowerment of Youth for Economic Development and Peace Building Programme in Lakes State(Rumbek central and Cueibet counties). The Empowerment of Youth for Economic Development and Peace Building Programme is a three year programme, beginning October 2012, and ending on the 31st December 2015. It aims to equip over 1,200 individuals and by extension the communities of Rumbek Central, Cueibet and Lakes State with the knowledge and tools required to increase human security.
The Principal Objective of the programme is: Human security in South Sudan is improved as the development of a legitimate South Sudan government has been supported and conditions have been created for socio-economic reconstruction in the region.
Reflecting the two thematic components of the programme, the project has two specific objectives.
Specific Objective 1 is that: Legitimate government is developed with adequate capacity to establish and maintain child friendly justice systems in Lakes State by the end of 2015.
Specific Objective 2is that: Vulnerable youth have increased access to quality TVET and entrepreneurship programming, are socially empowered and have improved livelihoods in Lakes State.
This programme is delivered directly by Save the Children and through a national partner based in Rumbek, the DRDA (Dhiar for Rehabilitation and Development Association). The programme works closely with relevant local state ministries (Ministry of Justice, Ministry of Labour, Ministry of Education, Science and Technology), police and prison officials, coordination bodies and community based organisations.
Key result areas (Outcomes):
· Justice for Children is strengthened to promote child friendly and restorative justice principles and practices in Lakes State by the end of 2015.
· Children in contact with the law have access to fair justice and referral services in Lakes State by the end of 2015.
· Enhanced effective coordination by Ministry of Justice and the Judiciary of South Sudan on Justice for Children by the end of 2015.
· Improved management capacity and coordination of Business, Technical, Vocational and Entrepreneurship Training (BTVET) programmes at institutional and national level by the end of 2015.
· Increased socioeconomic abilities and opportunities for vulnerable children and youth through gender responsive TVET programmes in Lakes State by the end of 2015.
Key indicators of interest:
a)Juvenile Justice component of Youth Skills Enhancement Project
% of judges/ judicial officers applying the juvenile courts guidelines
% of children interviewed who demonstrate knowledge of child friendly and restorative justice principles
% of children interviewed who report to have received fair and friendly treatment at prison/police stations
% of children in contact with the law (disaggregated by sex) who received assistance at the Child Friendly Help Desks
% Increase in availability of information about community support, resources and services on Justice for Children (increased)
% of increase Inter-agency collaboration and referral for services on Justice for Children (increased)
b)TVET component of Youth
Skills Enhancement Project
% increase of national and state level budget for TVET programmes
% increased Inter-agency collaboration and referral for community support, resources and services on TVET:
% of youth (disaggregated by sex) who graduate from TVET programme with skills relevant for market opportunities in Lakes
% of graduating TVET Trainees who are employed or managing their own businesses six months post-graduation:
Purpose of the Evaluation
a) To assess the extent to which the programme met its objectives, and reached the desired impacts and outcomes
(b) To measure the extent to which the response has been accountable to the local needs of the community
(c) To recommend improvements for the longer-term strategies and sustainability of Juvenile Justice and Technical Vocational Training in Lakes State.
(d) To measure the quality of the intervention, contextualizing the findings to the needs and challenges of South Sudan and Lakes States as well as recognised international and Save the Children standards and protocols.
(e) To assess the link between the programme and peace and stability in targeted locations, as viewed by the communities we work with.
This evaluation will be shared with the donor, relevant partners and stakeholders, and the Save the Children family for the purposes of learning and accountability. It should be compliant to DAC OECD evaluation standards.
Key focus areas
This evaluation will have the following primary objectives:
1) Assessment of outcome indicators, testing and demonstrating changes from baseline produced by this programme.
2) Assessment of how the outcomes and outputs link to the intended impacts of the programme.
2) Analysis of delivery of outputs, analysing how the delivery of outputs integrates with the intended outcomes.
3) Assessment of the quality of the programme as a whole and the individual components of the intervention.
4) Assessment of how well Save the Children has worked with local partners and key stakeholders.
5) Offer clear recommendations and lessons learned that can be used to improve future responses and programmes.
6) Test community satisfaction with this programme and analyse how accountable Save the Children has been while delivering this programme.
7) Assessment of key decisions made, and systems and structures related to the programme, including programme design and adaptions.
The selected candidate will be responsible for constructing the methodology, evaluation framework and tools for this evaluation with the support of the Save the Children MEAL Technical Specialist. The selected candidate will report to the MEAL Technical Specialist while in country. The evaluation must be composed of the following components:
- A desk review of all relevant programme documentation, including( but not limited to):
· Programme documents, log frame, contracts and related agreements
· Work plans and budgets
· Progress, technical and financial reports
- Face to face interviews and discussions with beneficiaries and key stakeholders involved in the programme implementation to ensure that the review is carried out in a participatory manner. Children should be included in proposed interviews.
- Electronic interviews through teleconference, skype or email.
- Qualitative approaches including: Focus Group Discussions, Key Informant Interviews and observations.
- Quantitative approaches including: surveys, graduate tracking and market analysis.
- Will follow approaches and methodologies of baseline report, tracking performance against indicators set at the baseline.
Questions to answer
Within this framework, specific issues (and questions) to be assessed include, but are not limited to, the following questions:
- Are the activities implemented in accordance with the programme plan? If not, why?
- What outputs have been achieved? To what extent do they contribute to the programme’s objectives?
- How effective are the approaches and structures in delivering the desired outputs? How can they be improved?
- How do the planned outputs lead to the desired outcomes?
- Does the partnership work effectively? Is the partnership structure and the geographical focus effective in achieving the desired outputs? How can the partnership be improved?
- Are the capacities of the partners adequate?
- What have been the roles of the partners and staff and are they appropriate?
- Is there an effective process built into the management structure for self-monitoring, assessment, reporting and reflection?
- Are the available technical and financial resources adequate to fulfil the programme plans?
- Have there been any unforeseen problems in terms of resource (technical and financial) allocation and utilisation? How well were they dealt with?
- Are the funds being spent in accordance with the programme plans and using the right procedures?
- Are the design and approach of the programme relevant in addressing the identified needs, issues and challenges in improving human security.
- To what extent is the programme contributing to the strategic policies of SCI county programme and that of the partners? How could relevance be improved?
- Will the changes caused by this programme continue beyond the life of the project?
- What mechanisms have Save the Children and partners put into place to sustain the key programme Outputs and Outcomes?
- How has the programme worked with local partners to increase their capacity in a sustainable way?
- What motivations /mechanisms exist for partners to continue playing these roles?
- What are the risks facing sustainability of programme Outputs and Outcomes?
- Is the programme beginning to demonstrate any desired change in the behaviour of people and the institutions?
- Have there been any unintended positive or negative impacts arising from particular outcomes/ results?
- What could have been the likely situation (of the environment and institutions) without this programme?
The consultant is expected to lead, accomplish and submit the following deliverables within the agreed timeframe and budget:
- A summary of agreed methodology and proposed data collection tools
- A 30 page draft report (in MS Office), in the following format at a minimum
a) Executive Summary (max. 2 pages)
c) Methodology, including sampling
d) Analysis and findings of the evaluation, responding to the objectives and evaluation criteria
- Annexes: The consultant shall submit the following as annexes in both soft and hard copy to SC South Sudan:
a) Relevant maps and photographs of the evaluation areas
b) Bibliography of consulted secondary sources
c) Finalised data collection tools
d) List of key informants
e) Raw data of the research (in MS Excel format)
f) Reports of the presentations of preliminary findings and recommendations, validation and feedback sessions with community, key stakeholders and SC South Sudan
- Final report with corresponding finalised annexes, including: summary, background, objectives, survey methodology, findings, recommendations, annexes
· Master’s degree in Monitoring, Evaluation, Development, Juvenile Justice, Technical Vocational Training or other related area of study
· Experience in evaluating relevant programmes as a lead researcher, leading a team
· Experience of working in insecure environments
· Understanding of TVET and Juvenile Justice policy, standards and protocols
· Demonstrable experience in conducting mixed methods approaches
· Demonstrable experience of communicating with conflict affected communities
· Ability to communicate clearly and concisely both verbally and in written form
· Understand and is committed to operate to the highest ethical standards
10 November Application deadline
18 November Review of applications and successful individuals contacted
25 November Methodology finalized and agreed by all parties
15 December Presentation of initial findings
15 December Draft-1 Evaluation report
18 December Feedback on draft evaluation report by SC-SS and SCNL
21 December Final Evaluation Report
Interested Parties are requested to submit the following:
· A letter of interest stating how they would approach this assignment and their availability
· A summary of the methodology they would employ
· The candidate/s CV and a brief statement with regards to their previous experience relevant to the evaluation proposed
· A top line budget, outlining consultant fees and research team composition
Interested candidates to send their application to firstname.lastname@example.org by close of day on 13th November 2015