The specific objectives of the endline evaluation are
- Assess Research Quality & Production (Outcome 1): Determine the extent to which the platform increased the production of high-quality, locally authored research products, evaluating their academic and technical rigor using standardized qualitative rubrics.
- Evaluate Policy and Programmatic Influence (Outcome 3): Trace the utilization of KEP evidence products (policy briefs, research papers, Evidence Mapping Reports) within government bodies, humanitarian agencies, and NGO coordination mechanisms, assessing their specific influence on policy, practice outcomes and programme design.
- Reconstruct Tiered Capacity Trajectories (Outcome 2): Measure changes in technical research skills, policy engagement capacity, and professional networking among supported researchers, disaggregated by category/tier of support (e.g., Independent Research Projects vs. Writing Workshops vs. Training Cohorts), using retrospective self-assessments triangulated against objective artifact quality scores.
- Analyze Systemic Localization (Cross-cutting): Evaluate the project's contribution to increased visibility, credibility, institutional leadership (e.g., FOMREK), and structural inclusion of refugee-led and locally grounded researchers within Kenya's displacement architecture.
- Provide Strategic Recommendations (Learning): Offer actionable, user-specific insights for the Kingdom of the Netherlands (DGIS), ReDSS, consortium partners, and local government actors on sustaining platform gains beyond the current funding cycle.
Methodology & Scope of Work
NOTE: The Methodology shared here is not prescriptive, the applicants are encouraged to propose a different approach, integrate with other approaches that deliver the results the consultancy is looking for or adapt it altogether. If adapted, the consultants will be at liberty to refine it during the inception phase.
Additional Note: The Project's Theory of Change already exists with highlighted Assumptions. The Total Project Participants after removal of duplicities are 789 (Nairobi, Kakuma, Dadaab (20%)). Total Project Evidence Products: 12
This evaluation will utilize an Integrated Theory-Based Evaluation (TBE) Framework. Bidders are explicitly instructed not to propose quasi-experimental designs or non-treatment comparison groups, as these are unviable given the population parameters. Bidders must demonstrate methodological mastery in the following four core pillars:
Core Methodological Pillars
- Contribution Analysis (CA) with Process Tracing:
- The evaluation will use Mayne’s Contribution Analysis to test the project's vertical Theory of Change (ToC) logic and claims
- During the Inception Phase, the consultant will explicitly reconstruct and disaggregate implicit ToC assumptions (these are generated from an already existing ToC) into testable capacity, behavioural, and contextual hypotheses.
- For major policy and practice outcome claims, the consultant will apply qualitative Process Tracing tests to evaluate KEP’s contribution against rival hypotheses (e.g., independent Shirika Plan political momentum, World Bank/UNHCR funding shifts, or broader economic trends).
- Inductive Outcome Harvesting (OH) with Independent Substantiation:
- OH, will identify intended and unintended changes in the behaviour, relationships, policies, or practices of external social actors (government officials, UN agencies, RLOs, INGOs).
- Strict Methodological & Safeguarding Requirement: Site-based Outcome Harvesting workshops in Nairobi, Kakuma, and Dadaab are strictly for outcome formulation and discovery. All outcome substantiation must be conducted independently via 1-on-1 external Key Informant Interviews (KIIs) or documentary verification.
- Tiered Within-Subject Capacity Mapping & Rubric Artifact Scoring: To account for varying intervention intensity, the consultant must partition the beneficiary population into explicit Exposure Tiers rather than aggregating them into a single average:
- Tier 1 (High Intensity - IRP Grantees & Mentees): Evaluated via qualitative 1-on-1 narrative KIIs, retrospective skill recall grids, and objective rubric-based scoring of baseline vs. endline research artifacts (comparing early proposals against final published papers/briefs using a 4-point qualitative quality rubric).
- Tier 2 (Medium Intensity - Writing Workshop Alumni): Evaluated via retrospective self-assessment grids cross-checked against independent publication/submission verification.
- Tier 3 (Low Intensity - Training Cohort Alumni & Event Attendees): Evaluated via lightweight tracer surveys focusing strictly on skill application, evidence reach, and immediate utility.
Phased Scope of Work
The Note on the Methodology applies here as well.
Phase 1: Inception Phase (Days 1–10): Inception Report, Reconstructing Theory of Change assumptions for CA; drafting quality rubrics for artifact scoring; designing modular, stakeholder-specific KII guides; and the Outcome Register template.
Phase 2: Fieldwork & Independent Substantiation (Days 11–40): Administering tiered quantitative/qualitative surveys to treated participants; conducting site-based OH workshops; conducting independent 1-on-1 substantiation KIIs with stakeholders
Phase 3: Synthesis, Validation & Reporting (Days 40-60): Triangulating qualitative narratives, rubric scores, and citation depth metrics; conducting participatory member-checking validation sessions with refugee researchers; drafting the final report; and producing the Policy & Programme Influence Map.
Deliverables
The Consultant will be requested to submit the following deliverables
Phase
Expected deliverables
Indicative description tasks
Maximum expected timeframe
Inception
Inception Report & Tools
Detailed Workplan ; Reconstructed Theory of Change Assumptions/Hypotheses for CA ; Tiered Survey & Modular KII Guides ; Rubric-Based Artifact Scoring Template ; Manual Document Audit Protocol ; and Preliminary Outcome Register
10 days
Data Collection/Fieldwork
Raw Data & Interim Update
Completion of modular KIIs, site-based OH formulation workshops, independent 1-on-1 substantiation KIIs, treated-population survey; raw anonymized datasets, transcripts, and updated Outcome Register.
15 days
Analysis and Reporting
Draft Evaluation Report
Comprehensive analysis of contribution claims, tiered capacity trajectories, process tracing tests, and policy influence maps.
15 days
Final
Final Report Deliverable Package
Integrated Final Evaluation Report; cleaned anonymized datasets & codebooks; completed Outcome Register; standalone Policy & Programme Influence Map; and a 3-page plain-language Learning Brief.
20 days
Duration, timeline, and payment
The Endline Evaluation will be conducted over a period of 60 days.
Payment tranches are strictly tied to formal technical approval of deliverables by the ReDSS MEAL Unit :
- Tranche 1 (15%): Upon formal clearance of the Inception Report & Tools (Deliverable 1).
- Tranche 2 (25%): Upon submission and technical review of Raw Data, Field Report, and Clean Datasets (Deliverable 2).
- Tranche 3 (60%) : Upon final clearance and sign-off of the Integrated Final Report, Policy Influence Map, and 3-page Learning Brief (Deliverable 4).
Proposed Composition of Team
The selected consultant will work under the supervision of
- ReDSS Kenya Manager.
- ReDSS Kenya Learning Specialist.
Location and support
Submissions for this consultancy are open to bids for firms with team members based in Kenya. Ideally the (lead) consultant and the team members will be based in Kenya.
The Consultant(s) will provide her/his/their own computer and mobile telephone.
What ReDSS will provide access to
- Evidence and knowledge products that have been produced by the Kenya evidence Platform (KEP) in the past 3 years and the affiliated Forced Migration and Research Network in Kenya (FOMREK).
- Participants database for KEP activities over the years by all the 3 partners.
- Indicators Performance tracking Table and the Log Frame and Theory of Change (TOC).
- Annual Reports submitted to the donor for Year 1 and 2 and any activity-specific reports needed.
- Policy Makers, Academics and other Stakeholders Mapped by the consultants; ReDSS will support access to these actors.
Travel
The Consultant will be expected to arrange for his/her own transportation, meals, and accommodation in the field areas (Nairobi, Kakuma, Dadaab) for data collection should the presented methodology demand so. The consultant is also expected to make adequate provisions for this in the Financial Proposal.
TERMS & CONDITIONS
DRC will evaluate proposals and award the assignment based on technical and financial feasibility in line with DRC Procurement guidelines. DRC reserves the right to accept or reject any proposal received without disclosing reasons to applicants and is not bound to accept the lowest bidder.
CONFIDENTIALITY & INTELLECTUAL PROPERTY
All information presented, obtained, and produced is to be treated as DRC’s property and is considered confidential for all other purposes than what is outlined in these terms of reference.
All materials, transcripts, reports, and digital assets developed under this consultancy will remain the sole property of DRC/ReDSS. The firm will hand over all editable files, documentation, data sets and report Upon completion.