Consultancy – Endline Evaluation Consultant (Kenya-based)

Terms of Reference – Endline Evaluation 

Consultant (KENYA-based)

Project: WUSC’s Volunteer Cooperation Program – IGNI+E 

Dates:  August 1, 2024 – January 15, 2025

Level of effort: 38 days, maximum 

Location: Nairobi, Kenya 

Reports to : Manager, Planning, Performance and Learning (Canada) & Program Manager (Kenya)

Summary: The consultant will lead the coordination of the Endline Evaluation , including planning, tool adaptation/development, data collection, analysis, and reporting. A simultaneous endline evaluation will also take place in Uganda for the same project. We have built 6 additional days into this contract so the Consultant from Kenya will lead on coordination, tool adaptation/development, and the consolidation of data and consolidation of the two reports into one final report with harmonized conclusions and recommendations from both evaluations, and 2 country chapters. 

Introduction

WUSC is a Canadian non-profit organization with a mission to enhance education, economic opportunities, and empowerment for youth. We work with a diverse network of students, volunteers, institutions, governments, and businesses. Together, we foster youth-centered solutions to overcome inequality and exclusion.

WUSC’s Volunteer Cooperation Program called IGNI+E (Innovative Global Networks for 

Inclusion + Equality, pronounced IGNITE ) , is an 8-year initiative (2020-2028) funded by Global Affairs Canada, to strengthen the performance of 70+ partner organizations to advance gender equality, social inclusion, and economic empowerment for 1.2 million youth living in poverty and marginalized youth, in particular, young women and forcibly displaced youth. 

WUSC is seeking qualified consultants to conduct the Endline Evaluation for the Volunteer Cooperation Project in Kenya. 

Background of the Project

Young people experience different challenges and have different opportunities depending on their sex, age, ability, refugee status, ethnicity, religion, gender identity and expression, sexual orientation, and other identity factors. People’s attitudes toward these factors, and the way they intersect, often result in further exclusion, inequality, and vulnerability. Globally, young women are particularly marginalized, and in addition to age-based discrimination, they also confront systematic and systemic gender-based discrimination and violence. Young people are more likely to be unemployed than adults, with the global youth unemployment rate 3X higher than the adult rate of 4.3% (ILO, 2018). 

Across most labour market indicators, wide disparities exist between young women and men, underpinning and giving rise to wider gaps during the transition to adulthood. There is a growing body of evidence that specialized employment and entrepreneurship programs do work, especially when they target marginalized youth, and when they combine training with other forms of support. Given this background, WUSC’s VCP is responding to these challenges by supporting 70+ partners across eight countries to improve their performance in delivering inclusive and innovative programming that advances gender equality, social inclusion, and economic empowerment. 

Through the improved performance of service delivery organizations, employers, government bodies, training institutions, advocacy groups, and a higher-performing and more inclusive ecosystem of stakeholders (Intermediate Outcome 1200), the VCP contributes to the improvement of the socio-economic well-being of youth living in poverty and marginalized youth, particularly young women and forcibly displaced youth, by generating inclusive and sustainable employment and entrepreneurship opportunities (Ultimate Outcome). IGNI+E is mobilizing 1.1 million Canadians along a continuum of awareness to action on key global issues, with 50,000 Canadians undertaking an action to sustain IGNI+E’s development impact (Intermediate Outcome 1100).

The performance of partners to deliver more gender-responsive and inclusive initiatives and services is being improved through the achievement of the following immediate outcomes: 

i) Increased awareness among partner staff of policies and practices that perpetuate gender-based inequalities and constrain the equitable access of vulnerable youth, particularly women to employment/self-employment related initiatives and services  (Outcome 1210). This awareness will support partners to analyze and understand the needs and aspirations of poor and marginalized youth, particularly young women, and advocate for their economic empowerment and rights; 

ii) Improved capacity of partners to develop, test & scale innovative gender-responsive and environmentally sustainable initiatives and services for the equitable economic empowerment of vulnerable youth, in collaboration with development actors, particularly young women (Outcome 1220). This outcome will ensure that partners have the knowledge, skills, and business models needed to pilot and scale innovative programs and/or products and services. It draws upon contextual knowledge and awareness gained through Outcome 1210 and puts these into practice; and 

iii) Increased capacity of partners to develop, improve, and implement inclusive, gender-responsive, and environmentally sustainable policies and practices that reflect the priorities and interests of vulnerable youth, particularly young women (Outcome 1230). This outcome ensures that partners have policies and structures in place to ensure the sustainability of changes introduced or reinforced in Outcomes 1210 and 1220.

WUSC’s VCP began implementation in six countries in 2020 (Ghana, Malawi, Kenya, Uganda, Sri Lanka, and Vietnam), and expanded to Jordan and Cote d’Ivoire in 2022. The VCP closed in Vietnam in 2023 and will close in Kenya and Uganda in 2025. 

Purpose and Objectives of the Endline Evaluation

The purpose of this evaluation is to assess the performance of the project and capture project achievements, challenges, and good practices to inform future similar programming. It will also review the recommendations of the baseline report, and assess the extent to which these were implemented. The evaluation will also ensure accountability towards Global Affairs Canada as a donor, the partners, and the partner program participants. On the other hand, it offers a learning aspect for all stakeholders in the countries where the project is continuing until 2028. The evaluation will identify key lessons learned, challenges, and the flexibility of the programme to adapt and respond to the changes and sustainability of the youth and women’s economic opportunities sectors in the project locations.

The endline evaluation of the VCP will have 3 objectives:

Objective 1: Evaluate to what extent the WUSC’s IGNI+E Project has delivered effective, efficient, relevant, and timely activities to partners as set in the project logic model. Objective 2: Assess whether the collaboration between WUSC and its partners has added value to partner programs and services, and had a positive effect on their program participants and other stakeholders. What has contributed to this added value and what has not? Objective 3: Identify and assess key lessons learned, barriers to progress and challenges and draw recommendations for future programming and, where possible, recommendations for the project as it continues in the other project countries.

The main recipients of the evaluation are WUSC’s senior management, the VCP management team, the program staff in the country, the VCP Partners and Program Advisory Committees, VCP volunteers, and other key project stakeholders. The results of the evaluation will be shared with Global Affairs Canada. 

Research/Evaluation Questions

The main research questions to be answered by the Endline Evaluation are: 

Effectiveness:

To what extent has WUSC’s VCP achieved its expected intermediate outcome of improved partner performance, and did it support partners to make progress toward the ultimate outcome as described in the project’s logic model? At endline, what are the project partners’ capacities to deliver inclusive, gender-responsive, innovative, and environmentally sustainable programming to vulnerable youth, in response to their needs from the start of the project? According to the project partners and stakeholders, was the technical assistance provided by volunteers effective in contributing to the achievement of development results? According to the project partners, was the support provided through the Partner Innovation Fund effective in contributing to the achievement of development results? (For PIF Recipients only) Have there been any unexpected results (positive or negative)? To what extent have partner programs or initiatives (supported by the VCP) had an impact on partner participants’ economic and social well-being? Are there any indications of systems-level change, or contributions to system-level change?

Efficiency:

How efficiently did the different types of inputs and chosen intervention mechanisms (types of volunteer assignments, Partner Innovation Fund, partner training, Partner Forums, and Program Advisory Committees) contribute to the achievement of outcomes?

Relevance:

Were the strategies and results achieved relevant, and did they align with the needs and priorities of partners in Kenya? Was the choice of partners relevant and did they meet the needs of the most marginalized youth (particularly women)? How has the collaboration between partners (and/or PAC stakeholders) contributed to appropriate response of the specific needs and priorities of the youth program participants?  To what extent was the project able to adapt and provide appropriate response to context changes and emerging local needs, (e.g. COVID-19 pandemic, post-pandemic economic crisis, etc)?

Sustainability:

To what extent have sustainability considerations been integrated into the implementation of the VCP? To what extent has the project contributed to sustainably strengthening the capacities of partners and their staff? Has the project contributed to sustainable development results for partners? How? Have measures been put in place to support the sustainability of partner outcomes achieved? If yes, which measures? Which partner outcomes (that were supported by VCP volunteers, PIF, etc) are likely to be sustainable? Why? Which are not? Why? What policy, strategy, partnership, managerial, and financial changes are needed to sustain or scale outcomes after the end of the project?

Innovation: 

According to partners, have there been any examples of innovations achieved by partners with the support of the project? If yes, what types?  According to partners, have there been any examples of innovations within the VCP project itself? If yes, what kind? 

Cross-cutting themes:

Has the program achieved or contributed to gender equality outcomes in Kenya? Describe.  Has the program achieved or contributed to inclusion outcomes in Kenya? Describe.  Has the program achieved or contributed to environmental sustainability outcomes in Kenya? Describe. 

Decision-Making

To what extent have project interventions influenced/contributed to young women’s ability to participate in decision-making processes? To what extent have project interventions influenced/contributed to young women’s ability to participate in leadership roles?

Access to and Control Over Resources

To what extent has the project influenced/contributed to women’s access to and control over resources for their economic development? To what extent has project interventions supported/contributed to marginalized women’s access to market-relevant skills to promote employment and entrepreneurship opportunities?

Human Rights

To what extent has the project achieved or contributed to inclusion outcomes in Kenya? To what extent has the project achieved or contributed to human rights outcomes in Kenya? To what extent has project interventions influenced workplace and institutional systems, policies, laws and practices towards youth and in particular young women’s empowerment?

Social Norms

To what extent have project interventions supported partners to influence, shift and change social norms and partners’ perceptions to promote youth and young women’s participation in the advancement of economic empowerment?

Engaging Men and Boys 

To what extent have project interventions supported partners to engage and influence men and boys to promote gender equality and social inclusion, and young women’s participation in the advancement of economic empowerment?

Environment

To what extent has the project achieved or contributed to environmental sustainability outcomes in Kenya? 

Lessons Learned

What good practices or lessons learned can we draw and use for current and future programming, in terms of: Program design (Volunteer Engagement, Capacity Strengthening, Partner Innovation Fund, Group Training)Program ImplementationWays of workingPartner selection, nurturing partner relationships, partner accountability, partner evaluation and partner exit strategies (for non-performing partners), conducting due diligenceGender equality and social inclusion, gender mainstreaming, gender-responsive, inclusive, transformative approachesOngoing monitoring, evaluation, accountability/ compliance, research and learningRisk (including GE SI risks) and mitigation strategies Where could we have improved as a project? Were there any barriers to progress or outright failures of the project to meet partner’s expectations or needs?

Scope of Evaluation

The evaluation covers WUSC’s VCP program from its inception in April 2020 to October 2024 The following elements should guide the design and implementation of the evaluation:

The geographic scope of the evaluation will be aligned with the project’s intermediaries (partner organisations) in Kenya, and the partner’s program participants (ultimate beneficiaries) targeted by the project as laid out in the project description. The evaluation should consciously apply research methods that are gender and youth-sensitive.  The data collection approaches and specific tools used should be adapted to assure the appropriateness and reliability of the data collected. The evaluation should ensure ethical and safeguarding considerations are integrated throughout the process.

Outcomes, indicators, and data collection methods for each indicator, are included in the project’s PMF and the Baseline Report (available upon contracting). 

Evaluation approach and methodology

The methodology and all relevant tools will be developed by the consultant and presented in the inception report. The three strategic objectives should be assessed, including all research questions noted in these ToRs. The data collection should include the use of a number of mixed-method approaches to get a deeper understanding of the outcomes of the project, including:

Desk review of background documents Endline evaluation survey with sample partner program participants, volunteers and partner staff FGDs with sample of partner program participants and volunteers Key Informant Interviews and site visits with partners  Key Informant Interviews with non-partner PAC members Case studies: Three (volunteer engagement/collaboration toward results, Partner Innovation Fund, gender equality/social norms)

An appropriate and strategic sampling method should be selected for each data collection method.

Key Activities and Deliverables

Overall, the consultant will be responsible for the following:

1. Coordinate the Endline Evaluation in Kenya, with a focus on design and sampling, and the development or adaptation of data collection and entry tools, analysis of all data, and report writing. Report will include annexes containing the disaggregated results tables. A template will be provided.

2. Collaborate with consultants in Uganda, where simultaneous evaluation will take place, and ensure harmonized tools and approaches. Coordinate data collection, analysis and consolidation of the Uganda and Kenya report. 

3. If needed, recruit, orient, supervise enumerators to support data collection and cleaning, including enumerator training and ensure quality control is maintained during data collection and entry. 

The Consultant will coordinate the Endline Evaluation in Kenya and be responsible for ensuring quality and timeliness of all deliverables. The consultant will design and facilitate plans in close collaboration with the consultants in Uganda, the WUSC VCP management teams in Kenya and Ottawa. 

The key activities and deliverables expected from the Consultant for this assignment are as follows:

Review all relevant documents, studies and other data sources relevant to the project, including performance indicators and definitions identified in the project Performance Measurement Framework Participate in an Inception meeting: to clarify expectations of the mandate and provide contextual information necessary to produce the inception report and plan Inception Report: a detailed inception report (max 20 pages) and work plan is to be produced including the following elements: Demonstrated understanding of the Endline Evaluation design and sampling strategy and proposed sample size Planning and contingency planning for data collectionSynthesis of desk review and initial interviewsEvaluation questions and evaluation matrixOutline and agree on the methodology for the endline evaluationAgreed timeline and detailed data collection planAnalysis of risks (including GESI risks) related to the endline evaluation methodology and proposed mitigation measuresDesign and pilot data collection toolsEthical and safeguarding considerationsRefined outline of the endline evaluation reportDetailed work plan that includes all tasks by the Consultant, team members and enumerators, and incorporating the overall evaluation timelinesLevel of effort of each team memberDetailed evaluation budget including professional fees, expected reimbursables, etc.A copy of quantitative and qualitative tools for data collection and plan for translation and/or back translation Development of quantitative and qualitative tools for data collection and plan for translation and back translation.  Development of Guidelines and Protocols for Data Collection If applicable, coordinate and conduct Enumerator Training following a detailed agenda and outlining evaluation protocols (this agenda should be included in the inception report) Coordinate/conduct/supervise data collection, as per agreed methodology Develop a common repository for all data (digital) so raw data can be shared with the VCP team during and after the evaluation Ensure Data Entry Quality by reviewing initial data entry conducted at the country level  Analyze qualitative and quantitative data. It is also expected that the Consultant will do a critical analysis of the data through statistical treatment and triangulation with other sources and literature review. Develop an Endline Report for Kenya, including the Executive Summary and Methodology. Reports and annexes are to be submitted in both Word and PDF versions. Report should include Preliminary Pages (Title page, Table of Contents including a list of annexes, Acknowledgement, Executive Summary, List of Acronyms and Abbreviations, Definition of Terms, etc.)A description of the project, including the results framework and theory of change – max 3 pagesPurpose and Objectives of the Endline Evaluation – max 3 pagesKey study questions or objectives and a statement of the scope of the study, with information on limitations and delimitations – max 3 pagesAn overview of the study approach, methodology, and data sources – max 3 pagesStudy findings – max 8 pagesConclusion/lessons learnt based on study findings – max 3 pagesRecommendations for WUSC, GAC and VCP Partners & Stakeholders based on survey findings – max 3 pagesAppendices Copies of original and cleaned data sets including any field notes are to be submitted to WUSC with the draft report. A PowerPoint presentation to be used as part of the validation of the draft endline evaluation report.

Project deliverables

Inception report (detailing the consultant’s understanding of the assignment and costs associated with the assignment) Cleaned quantitative dataset (for quantitative data) FGD score sheets/ reports/recordings and key informant interview forms/ reports. Any related codebooks, and data analysis files (syntax files,) All field notes which should guarantee anonymity for the interviewees.

Time Frame and Level of Effort

The period of the contract is expected to be from August 1, 2024 – January 15, 2025 with an expected contribution of approximately 38 working days for the consultant over the contract period. The consultant is expected to carry out all the preparation required to roll out the evaluation as per the suggested time frame below. 

WUSC’s Roles and Responsibilities

To provide relevant documentation and answer the Consultant’s questions throughout the period of the mandate. To mobilize the necessary team to support the consultant and designate a person responsible for the file at WUSC.  To provide the Consultant with feedback/comments on the various documents produced, according to the approved work plan. To provide the Consultant with any support deemed necessary in the accomplishment of this mandate.

Qualifications of Consultant(s) 

Minimum of 10 years of experience in administering studies, collecting data and producing quality baseline/midline/endline evaluation reports, preferably for international non- international non-profit organizations or multilateral agencies and multi-country studies  Demonstrated experience in designing baseline, midline and endline studies including proven experience in sound sampling, mixed methods approaches (quantitative and qualitative), tool development, data collection training, etc. Excellent facilitation skills and ability to recruit and manage facilitators for qualitative component; Demonstrated experience in quantitative and qualitative data analysis Knowledge and experience with youth and gender equality policies and systems in the IGNI+E project countries; Knowledge and experience in gender equality issues in the youth economic empowerment sector are highly preferred. Fluency in English is mandatory and other languages of project countries are an asset Ability to produce high quality work under tight timeframes Application Packages and Procedures

The table below summarizes important dates for Applicants:

Qualified and interested parties are asked to submit the following (note: proposals should be a maximum of 6 pages, unlimited annexes – saved as one PDF document please): 

Letter of interest  Detailed technical proposal clearly demonstrating a thorough understanding of this ToR and including the following: Description of the capacity and qualifications of the consultant or consulting firm, including previous relevant experience. Description of the proposed approach and methodology, including data collection, sampling strategy, data analysis, integration of gender considerations and ethical standards, quality assurance A proposed timeframe detailing activities and a schedule/work plan (including a Gantt chart) Team composition, qualifications and level of effort of each proposed team member  A financial proposal with a detailed breakdown of costs for the evaluation, including proposed daily rate for consultant fees. Please provide one daily rate, that should include all costs related to the evaluation: enumerator costs, transportation, communication, refreshments, etc (including refreshments for FGDs). All costs should be folded into the 1 daily rate x 38 days.  Itemized field data collection expenses Itemized administrative expenses Validity period of quotation Expected payment plan and method Curriculum Vitae(s) of all proposed staff outlining relevant experience Names and contact information of three references who can be contacted regarding relevant experience A copy of a previous reports of similar work undertaken  A Consulting Firm profile (if applicable). 

Only those candidates selected for an interview will be contacted. WUSC is an equal opportunity employer. We welcome and encourage applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process. If you wish to apply for this exciting role, .

WUSC does not charge a fee at any stage of the recruitment process. If you have any questions about this RFP, please contact Mel Godwaldt, Planning, Performance and Learning Manager at . 

Closing date for submission of the application package is the end of business day on Monday July 8, 9am Eastern Time (Ottawa).