Consultants Needed a the Catholic Relief Services (CRS)

Catholic Relief Services (CRS) invites interested, reputable and eligible consultants with requisite qualifications and experience to submit applications for the following works:

Catholic Relief Services (CRS) is the official international humanitarian agency of the Catholic community in the United States. CRS works to save, protect, and transform lives in need in more than 100 countries, without regard to race, religion or nationality. CRS’ relief and development work is accomplished through programs of emergency response, HIV, health, agriculture, education, microfinance and peacebuilding.

In responding to the protracted crisis, CRS Emergency and Early Recovery Program in northeast Nigeria focuses on food security and livelihoods, Nutrition, WASH and shelter. CRS target the most vulnerable families for both IDPs and host families. To ensure coordination, effectiveness and efficiency CRS adopted a multi-sectoral approach for the provision of a comprehensive support that can assist vulnerable individual to realize minimum threshold of living standards. CRS attach high value in adoption of community participatory practices in delivery of all intervention to enhance ownership. CRS adopted market-based approaches through e-vouchers using the RedRose OneSytem platform – leveraging integrated programming and empowering targeted communities through participatory approaches.

Applications are invited for:

Title: Consultancy for BHA End of Project Evaluation

Title of the evaluation: BHA Ceton Rayuka “Saving Lives” Project
Time frame of evaluation: June 2021 to May 2022
Type of evaluation: End of Project Evaluation
Evaluation commissioned by: Catholic Relief Service, Borno State, Northeast Nirgeria
Date 1 May to 15 June 2022

Project Objectives
The Ceton Rayuka I (Saving Lives) project is funded by United States Agency for International Development’s (USAID) under the Bureau for Humanitarian Assistance was implemented in Borno State from June 2021 and will be ending in May 2022. The project targeted to reach 109,608 individuals: 71,245 females, 38,363 malesfor all the three sectors in four LGAs – Gubio, Jere, Kaga and Magumeri. The project is aiming to achieve the following results:

• Goal: To ensure conflict-affected individuals in Borno live in dignity.
• Purpose: Conflict-affected individuals in Borno are food secure by May 2022
• Sub-Purpose 1: Affected individuals, women, men, girls, and boys access food with the provided assistance by May 2022.
• Output 1.1: Affected individuals receive food assistance
• Sub-Purpose 2: Affected individuals produce sufficient quantities of food by May 2022.
• Output 2.1: Affected individuals receive assistance to purchase agricultural inputs and receive agricultural trainings
• Sub-Purpose 3: Affected individuals have diversity of diet and proper food utilization by May 2022.
• Output 3.1.1: Acute malnutrition of children is managed
• Output 3.1.2: Caregivers in affected communities receive behavior change interventions
• Intermediate Outcome 3.2: Affected individuals have an enabling WASH environment for proper nutrition
• Output 3.2.1: Affected individuals receive hygiene promotion
• Output 3.2.2: Affected individuals receive WASH NFIs
• Output 3.2.3: Affected individuals have access to clean and safe water
• Output 3.2.4: Affected individuals have access to sanitation facilities

Project Key Activities
CRS conducted various activities under each sector based on needs assessment and stakeholder engagement inputs. Under Food security and Livelihoods, CRS distributed e-vouchers for food assistance and agricultural inputs, train households on good farming and post-harvest storage practices. Under Nutrition, CRS implemented community based supplementary programme “Tom Brown program” to improve nutrition status for the moderately malnourished children under-fives -, conduct training to CNMs, Lead Mothers, and caregivers on Tom Brown preparation and optimal breastfeeding practices to enhance community capacity in managing acute malnutrition, strengthen referrals for identified SAM cases to OTPs managed by existing nutrition partners across the project locations. In WASH NFI distribution, improve access to water through rehabilitation of water facilities, latrine and shower rehabilitation, shelter rehabilitation, hygiene promotion to improve hygiene practices in the community.

Scope and Objectives of Evaluation
The overall objective of the assignment is to assess the progress made and effects produced by Ceton Rayuka I (Saving Lives) programme across its entire life (from the inception closeout) This may include assessing the change in food security status, reduction in hunger scores after receiving food assistance, different coping strategies adopted by communities in food security, improvement of nutrition status for malnourished children supported, knowledge, practices and skills retention for all training, sensitizations and counselling on optimal MIYCN-E practices conducted, improvement in utilization of water and sanitation facilities; and change in hygiene behavior and practices.

For the purpose of quantifying the changes produced by the project, the evaluation will draw on evidence generated from the baseline survey, and will guided by these criteria overall achievement, relevance, efficiency, effectiveness, coordination, and indicative sustainability. Following are the specific objectives of the evaluation.

The evaluation will focus on achieving the following objective:

• Measure the overall achievement of the project implementation against the Results Framework (project goal, sector objectives – outcome and outputs) and the baseline, set target in each expected results of the project.
• Assess the project’s relevance, efficiency, effectiveness, coordination, and indicative sustainability of the project.
• Determine if a market-based approach is the most appropriate modality for CRS in delivering assistance in NE Nigeria

Methodology of Final Evaluation.
Based on the scope and objectives of the study, the consultant will be responsible for developing a detail methodology, tools and approaches for the evaluation. The consultant must demonstrate explicitly, in the technical proposal, sufficient methodological details for drawing valid conclusions for the study and present at the inception meeting. During the meeting, it will be discussed further and agreed upon with CRS project team. The consultant will thereafter develop a full statement of work (including evaluation matrix, data collection tools and guidelines) in alignment with the already agreed upon evaluation criteria such as relevance, efficiency, effectiveness, coordination, and indicative sustainability. The statement of work will also include clear strategies for accessing the relevant, information required, sources of data, data collection methods, sampling strategy, data collector’s training strategy, data collection and management plan, data analysis procedures and implementation timelines.

The evaluation will use a mixed methodology, employing both quantitative and qualitative approach in order to understand underlying factors that contribute to vulnerable individual living in vicious circle of poverty and perpetual insecurity. The consultant is expected to conduct a survey to collect data to provide answers to the performance of each indicator. Qualitative methods such as FGDs, KII and potentially story profiling will be adopted to triangulate the quantitative data to unearth gender, social and cultural issues perpetuating insecurity of these already vulnerable individuals. These two approaches will be complemented by content review and analysis of key project documents, deliverables, and other products.

Methods for Data Collection

• Survey: Data to be collected using a survey questionnaire. The questionnaire must be designed relating but not limited to questions developed during the baseline and should be structured per sector in order to make comparison of the change observed from the baseline. For standardization of question interpretation, the evaluator should extensively train enumerators for them to conceptualize the questions in the local languages and training should incorporate practical demonstration.
• Desk review: review of strategic and planning documents, baseline report, semi-annual report, monthly report, PDM, pre and post phase assessment reports, sector dashboard, extract reports from Redrose and KOBO platform and other related documents.
• Key Informants (KII) and focus group discussions (FGD): the evaluation team is expected to conduct key informant interviews and focus groups with key stakeholders in person or remotely. Key stakeholders will include, but not be limited to project beneficiaries, representatives of community leaders, local authorities, and representatives from project teams directly involved in the coordination of project implementation.
• Direct observation during data collection: Evaluators are expected to apply observation technique on children participated in Nutrition project, WASH facilities, hygiene practices and other factors related to the project. An observation checklist should be developed and agreed with the program managers before field data collection.

Key Evaluation Questions

Data Collection Modalities

• The evaluator will conduct field data collection and is expected to bring his/her own enumerators for data collection.
• CRS will only provide support during enumerators training and coordinating activities during data collection.
• Due to access issues in some of the areas, remote data collection may be considered with strict compliance to CRS remote data collection modalities.
• The evaluator will also use baseline and other surveys datasets and compare with the end-line values for each outcome indicator.
• For the output indicators, the evaluator will run a trend analysis to assess the key points of change and use qualitative data to triangulate the changes observed.
• The evaluator will use the BHA Ceton Rayuka M&E plan to guide decisions on specific indicator sampling frame.

Data Protection:

• CRS has ownership to all data collected during this evaluation.
• Data collected using paper-based tools are kept by CRS in a secure location to be accessed only by authorized persons. Electronic data is stored on cloud-based servers which vary depending on the software used for collection: RedRose Collect data is hosted by RedRose; Kobo Collect and PowerBi dashboard. Data collected on these platforms can be accessed by authorized MEAL Coordinator and PMs.
• The data will be used primarily for CRS final evaluation and future reference. Only findings from analysis will be shared with the project partners, donor and stakeholders. Raw datasets requested should be approved following CRS data protection approval processes.

Ethical standards:

• The consultant is expected to follow American Evaluation Association’s Guiding Principles for Evaluators (Evaluation Guidelines and Principles)
• Prior to accessing CRS operational areas, the consultant and his team, including Enumerators will sign CRS Code of Conduct, Safeguarding Policy and Data Protection Policy.
• The consultant must seek and have a signed informed consent from participants before data collection with beneficiaries.
• The evaluator is expected to keep all data from beneficiary with anonymity and confidentiality, no mentioning of names in questionnaires or reports. and ensure protection of minors.
• The consultant will be expected to use locally acceptable conduct, dressing and norms to ensure the data collection is done in a respectful and dignified manner.

N/B: Collected data can be stored on devices belonging to the CRS, but upon completion of the evaluation, all devices must be submitted to CRS.
Expected Deliverable
The evaluation team is expected to execute the following tasks:

• Inception report with a detailed Statement of work (indicative contents described earlier) for the evaluation, an evaluation matrix and methodology which respond to the agreed evaluation questions
• Develop data collection tools and schedule for the evaluation
• Train enumerators on data collection methodology and tools
• Facilitate completion of data collection and submit/safely store datasets for all the interviews conducted in line with CRS data policies.
• A comprehensive evaluation report which responds to the evaluation questions for each sector including written responses to comments/feedback from CRS staff.
• Produce a PowerPoint presentation with key findings to be presented during the evaluation briefing meeting.

Requirements for the final evaluation report are as follows:

• Maximum 30 pages excluding annexes in Microsoft Word and PDF format for the approved version.
• Written in English.
• Sections:
  • Title page
  • List of acronyms and abbreviations
  • Table of contents, including a list of annexes.
  • Executive summary – (max. 1 page) including bullets of main findings that answer the evaluation question and fulfill the evaluation purpose.
  • Introduction describing the program’s background and context.
  • Evaluation purpose and questions
  • Methodology
  • Sector specific key findings and detailed analysis organized by evaluation question and responding to theory of change.
• Annexes:
  • Relevant maps
  • Annotated photographs with consent for publication where relevant
  • List of existing data
  • Finalized data collection tools.
  • List of interviewees from primary data collection
  • Raw datasets, transcribed notes from FGDs and KII and observation notes
  • File containing analyses of data, both end-line and primary data collection.

Intended User
The primary users of this evaluation will be CRS Project Team including regional level Programme Development and Quality Assurance team, Emergency Coordination, all sector Program Managers, Monitoring, Evaluation, Accountability, and Learning Coordinator and Team, and Nigeria Country Program Management. Findings of the evaluation will be discussed with beneficiaries, local partners and stakeholders who were directly involved in the implementation of the project. Finally, the report will be shared with the donor (USAID) to communicate the project’s contribution to the change achieved in emergency response in Borno state.

Findings from this evaluation may inform the technical design and implementation of future, similar projects. In addition, the report will also document lessons learned and good practices for implementing projects in emergency context that can be replicated in other CRS programs; and may also help identify opportunities to enhance implementation strategies in future.

Evaluation Team Composition
The evaluation is expected to be conducted by two evaluators: a lead evaluator and assistant evaluator who will oversee the execution of the entire evaluation process in partnership with CRS staff. The MEAL Coordinator will lead the overall coordination of the evaluation, checking quality and compliance issues to the CRS and USAID evaluation guidelines. The evaluator will work with support from enumerators from CRS for data collection.

Roles and Responsibilities
Lead Evaluator:

• Review existing secondary data, prepare inception report and present it to CRS management (evaluation methodology, evaluation matrix, evaluation detailed and costed activities)
• Develop evaluation data collection tools, hiring and training of enumerators.
• Supervise data collection ensuring data quality and protection standards are met.
• Hold daily debrief meetings with enumeratorsand performing daily data quality checks.
• Write and submit draft evaluation report to CRS.
• Prepare a PowerPoint presentation and present key evaluation findings to CRS staff.
• Incorporate comments and feedback from CRS staff into final evaluation report and submit report to CRS.
• Submit all datasets and CRS documents to the MEAL team at the end of the evaluation.

CRS Staff:

• Prepare and share all relevant secondary data required for desk review including all project reports, planning documents, MEAL plan and ITT.
• Oversee and coordinate execution of the evaluation from the start to the end.
• Review and approve the inception report within 5 days after the inception meeting.
• Review and provide feedback on data collection tools.
• Provide feedback on draft evaluation report.
• Process the payment of the evaluator after submission and approval of each deliverable agreed
• Regularly update evaluator on security context and associated risks for completing the evaluation.

Required Qualifications
Lead Evaluator:

• Post graduate qualification in Development studies, Monitoring and Evaluation, Statistics, or International Development, PHD will be an added advantage.
• Extensive knowledge of evaluating multisectoral projects in emergencies and good understanding of the emergence response in the Northeast.
• At least 5 years’ experience in conducting evaluations in complex environments, experience evaluating USAID/BHA funded projects. Experience working in Nigeria Northeast states, preferably BAY states will be an added asset.
• Extensive experience in evaluating multi-sectoral programs implemented through multiple partners.
• Excellent oral and written communication skills in English and fluency in Hausa and Kanuri.
• Extensive knowledge of qualitative and quantitative data collection methods and analytical methods and techniques.
• Experience in generating strategic, informative and action-oriented recommendations to CRS project staff and strategic management.

Application Closing Date
5:00pm (West Central Africa),13th April, 2022.

Submission of Documents
Full applications should be submitted electronically to: [email protected] with the subject line “Application BHA Ceton Rayuka -Saving Lives I Final Evaluation”.

Note

• Applicants when applying should submit a brief (maximum 3 pages) approach paper outlining how they understand the TOR and proposed methodology.
• In addition, applicants should submit their profile highlighting key areas of expertise and experience matching the required skills specified in these terms of reference.
• We also request links to at least three recent examples of relevant work, and the contact details for three references.
• Indicative budgets should be prepared in line with the expected deliverables and should show all related costs including travel costs and anticipated overhead costs.

Timeline and Milestones

Budget

• The total maximum budget available for this assignment is USD $30,000.00 (In words: Thirty Thousand Dollars only) inclusive of applicable taxes.
• This includes consultant’s fee, lodging (accommodation), DSA, transportation and enumerators’ allowances and all other associated field cost related to this assignment.
• 10% of service charge will be deducted from the total amount.
• 40% of the total agreed amount shall be disbursed upon submission of inception report;
• 60 % will be paid against the submission and approval of the final report.
• CRS will not bear any financial liability in excess of the above amount.