Coherence
- CHS Commitment 6 - Coordinated and Complementary Support
- CHS Commitment 3 - Resilience and Locally Led Action
- CHS Commitment 2 - Appropriate Support and Referrals
Effectiveness
- CHS Commitment 2: Timely, Accessible and Quality Support
- CHS Commitment 7 - Feedback, Learning and Adaptation CHS
- Commitment 5: Complaints are welcomed and addressed.
- CHS Commitment 8: Staff is supported to do their job effectively and are treated fairly and equitably.
Efficiency
- CHS Commitment 6: Humanitarian Responses are Coordinated and Complementary.
- CHS Commitment 9: Resources are managed and used responsibly for their intended purpose.
- CHS Commitment 8 - Competent and Well-managed Staff and Volunteers
The evaluation will provide an assessment of how the intervention performed against each of the nine CHS commitments as above.
OBJECTIVES
General Objectives
To evaluate the project’s performance against the logical framework and assess in accordance with Project’s Result Framework and OECD-DAC evaluation criteria—relevance, coherence, effectiveness, impact, sustainability, and inclusiveness and to examine the extent to which the project interventions benefited the lives of the targeted communities or households.
Specific Objectives
- To assess the extent to which the project achieved its intended outputs, outcomes, and targets as outlined in the project's Logical Framework and Results Framework, with analysis disaggregated by age, gender, and disability.
- Assess the effectiveness, efficiency, coherence and implementation strategies, including the utilization of assistance, the methodologies and approaches applied.
- Assess the effectiveness of livelihood interventions in enhancing the knowledge, skills, resources, and capacities of households and SHG members to establish or strengthen diversified, sustainable, and climate-resilient livelihood activities.
- Determine the contribution of livelihood interventions to household economic resilience, particularly in terms of income generation, livelihood diversification, savings, access to productive resources, collective economic activities, and capacity to cope with economic and climate-related shocks.
- Evaluate the effectiveness of community-based disaster risk reduction interventions in developing, validating, and disseminating gender-responsive and inclusive Barangay Disaster Risk Reduction and Management (BDRRM) Plans and establishing functional disaster preparedness measures.
- Assess improvements in disaster risk reduction and climate change adaptation knowledge and preparedness among targeted schools and communities, including the integration and implementation of enhanced preparedness mechanisms in updated School DRRM Plans.
- Examine the inclusiveness and responsiveness of project interventions to the needs and participation of women, persons with disabilities, extremely poor households, and other vulnerable or marginalized groups in livelihood development and disaster preparedness initiatives.
- Determine the sustainability and potential for replication or scaling up of the livelihood initiatives, SHG mechanisms, BDRRM Plans, and school-based preparedness measures beyond the project implementation period.
- To assess the evaluation findings against the relevant Core Humanitarian Standard (CHS) commitments.
- Identify key lessons learned, good practices, implementation challenges, and recommendations to inform future livelihood, climate resilience, and community-based DRR programming.
- Examine the effectiveness of beneficiary selection, targeting processes, and implementation of IR Policies.
SCOPE OF THE ES/EVALUATION AND KEY EVALUATION QUESTIONS
Locale of the ES/Evaluation
The activity will cover Municipalities of Pahamuddin and Rajah Buayan.
Target Respondents
The respondents will consist of project rightsholders and beneficiaries, partners from Local Government Unit (LGU) at both the Municipal and Barangay levels, key stakeholders, as well as other individuals considered relevant to the activity.
CONSULTANCY DETAILS
Required Competency
The successful team will have the following competencies
- Demonstrate evidence of experience in evaluating humanitarian action/development project
- Demonstrate experience in evaluating livelihood or graduation models/project
- Possess sectoral experience and knowledge in evaluating DRR, Climate Change, protection and inclusion etc.
- Possess deep knowledge and practical experience of using quality standards such as CHS and Sphere
- Possess strong statistical/quantitative and qualitative research skills
- Have excellent written skills in English
- Be able to communicate fluently in English and the local languages. If local translators are required, this should be budgeted.
The chosen evaluation team will be supported by IR Philippines MEAL Team.
Expected Output of the Assignment for the Consultant
The consultant is expected to produce
- A detailed Work Plan and Inception Report developed with and approved by IR Philippines set out the detailed methodology, data collection tools (survey questionnaire), data collection protocols/guidelines, and checklists for FGD, KII, and Observation, reporting structure, and deliverables prior to commencing the review.
- The work plan, inception report, draft report, final report, presentation, etc., and communication language must be in English.
- Conduct interviews (FGD, KII, In-depth interviews,) with project stakeholders (rightsholders, local government authority and stakeholders, project staff, etc.).
- Orientation of local survey team/volunteers for the data collection process and questionnaire and data collection protocol.
- Develop quantitative data collection tools (questionnaire), Kobo design, data quality checking, support the data collection team, data quality management, and data editing and analysis.
- Collation and analysis of evaluation data including cost-benefit analysis for specific interventions and submission of the first draft to IR Philippines /IRW for comments and share the initial presentation of findings.
- Final report submitted to IR Philippines, IRW. A full report with following section,
a) Title of Report
b) Consultancy Organization and Any Partner Names
c) Name of person who compiled the report including summary of role/contribution of others in the team
d) Period during which the review was undertaken
e) Acknowledgements
f) Abbreviations
g) Table of contents
h) Executive summary (max 4 page)
i) Main report – max 40 pages – (Standard reporting structure will be shared at inception
stage, but consultant is invited to propose most suitable report structure layout)
j) Annexes
- Terms of reference for the review
- Profile of the review team members
- Review schedule
- Documents consulted during the desk review
- Persons participating in the review
- Field data used during the review
- Additional key overview tables, graphs or charts etc. created and used to support
10. The evaluator will present the evaluation findings and recommendations to
- IR Philippines team.
- Regional desk, IRW and Donor
QUALITY ASSURANCE PROTOCOLS
The ES/Evaluation report should represent a thoughtful, well-researched and well-organized effort to objectively benchmark outcome and address study questions which ultimately should identify gaps and potential project integral approach in maximizing the impact:
- The report shall address all questions included in the scope of work/ToR.
- The report should include the scope of work as an annex. All modifications to the scope of work, whether
in technical requirements, consulting team composition, methodology or timeline need to be agreed
upon in writing by the technical person.
- The study’s design and methodology shall be explained in detail and all tools used in conducting the study
such as questionnaires, checklists and discussion guides will be included in an Annex in the final report.
- Study’s findings will assess outcomes and impact on men, women and youth where possible. Limitations
to the study shall be disclosed in the report, with particular attention to the limitations associated with
the study methodology (selection bias, recall bias, unobservable differences between comparator groups,
etc.). Study’s findings should be presented as analyzed facts, evidence and data and not based on
anecdotes; findings should be specific, concise and supported by strong quantitative or qualitative
evidence. Sources of information need to be properly identified and listed in an annex. Recommendations
need to be supported by a specific set of findings. Recommendations should be action oriented, practical
and specific, with defined responsibility for the action