Terms of Reference (ToR) Call for Proposals: Independent Evaluation of the Educational Impact of COECSA Examination Sponsorship on Ophthalmology Residency Training Outcomes in Ethiopia, Somaliland, and Rwanda

Terms of Reference (ToR)

Call for Proposals: Independent Evaluation of the Educational Impact of COECSA Examination Sponsorship on Ophthalmology Residency Training Outcomes in Ethiopia, Somaliland, and Rwanda

1. Background

The Himalayan Cataract Project, doing business as “The Cure Blindness Project,” is a US based non-profit organization incorporated and existing under the laws of the States of Vermont, USA under registration number 0056237 with its registered office in the United States, at 5430 Waterbury Stowe Road, Waterbury Center, Vermont. In Ethiopia, HCP is registered and accorded legal personality by Agency for Civil Society Organizations with Registry number 4435 as Foreign Organization in accordance with Civil Society Organization Proclamation No. 1113/2019

Himalayan Cataract Project (HCP) doing business as The Cure Blindness Project is committed to strengthening the Ophthalmology workforce in Eastern Africa through strategic investments in residency and fellowship training programs. As part of this commitment, HCP supports Ophthalmology residents through sponsorship of the College of Ophthalmology of Eastern, Central and Southern Africa (COECSA) examinations which is jointly delivered by Ophthalmology foundation in recent times

The examination serves as an important regional assessment and certification mechanism designed to evaluate resident knowledge, clinical competence, and readiness for independent ophthalmic practice. HCP has invested significant resources over the years to support residents from Ethiopia, Somaliland, and Rwanda to participate in these examinations.

While examination sponsorship is widely perceived as beneficial, there is limited evidence regarding its actual contribution to educational outcomes, resident competency development, certification success, training quality, career progression, and overall strengthening of residency programs. Furthermore, there is a need to determine whether investment provides sufficient educational and programmatic relevance to justify continued or expanded support.

To address this gap, HCP seeks to engage an experienced consultant or consulting firm to design and conduct an independent evaluation of the educational impact of COECSA examination sponsorship among Ophthalmology residency programs in Ethiopia, Somaliland, and Rwanda.

1. Purpose of the Consultancy

The purpose of this consultancy is to evaluate the educational impact and relevance of HCP-supported COECSA examination sponsorship on Ophthalmology residency training outcomes and to generate evidence-based recommendations for future investments in residency education and professional certification programs.

1. Study Title

Evaluating the Educational Impact of COECSA Examination Sponsorship on Ophthalmology Residency Training Outcomes in Ethiopia, Somaliland, and Rwanda.

1. Study Objectives

General Objective

To evaluate the educational impact of COECSA examination sponsorship on Ophthalmology residency training outcomes in Ethiopia, Somaliland, and Rwanda.

Specific Objectives

The evaluation should:

1. Assess the contribution of COECSA examination sponsorship to residents' academic performance and professional development.
2. Determine the effect of examination participation on resident knowledge, competency development, and preparedness for independent clinical practice.
3. Assess the extent to which examination sponsorship contributes to strengthening residency training programs and promoting adherence to regional training standards.
4. Evaluate the strategic importance of HCP's investment in COECSA examination sponsorship.
5. Identify lessons learned, implementation challenges, and opportunities for improving future examination support programs.
6. Key Evaluation Questions

Applicants are encouraged to address, but not be limited to, the following questions:

• Educational Impact: To what extent has COECSA examination sponsorship contributed to residents' academic achievement and professional development?
• Competency & Practice: How does participation in COECSA examinations influence residents' knowledge, competencies, and readiness for independent clinical practice?
• Program Strengthening: How has examination sponsorship strengthened residency training programs and supported alignment with COECSA and regional training standards?
• Value for Money: What is the value-for-money and strategic return of HCP's investment in COECSA examination sponsorship?
• Learning & Improvement: What lessons, implementation challenges, and opportunities for improvement can inform future examination sponsorship programs?

1. Scope of Work and Assignment Duration

The selected consultant will be responsible for:

• Reviewing relevant program documents, reports, and residents' sponsorship records.
• Developing a comprehensive evaluation framework.
• Designing appropriate study methodologies and data collection tools.
• Undertaking quantitative and qualitative data collection across Ethiopia, Somaliland, and Rwanda.
• Consulting with key stakeholders including residents, faculty members, residency coordinators, training institutions, COECSA representatives, and HCP staff.
• Conducting data analysis and interpretation.
• Producing high-quality reports and presentations.
• Facilitating dissemination of findings and recommendations.

Assignment Duration

The consultancy is expected to be completed within approximately 8 -12 weeks from the date of the contract signing, unless otherwise agreed with HCP.

1. Expected Methodology

Applicants are expected to propose an appropriate methodology to answer the evaluation objectives and questions.

A mixed-methods approach is strongly encouraged and may include:

• Literature review
• Document review
• Resident surveys
• Faculty surveys
• Key informant interviews
• Focus group discussions
• Comparative analyses of resident cohorts
• Review of examination and certification records

Consultants are expected to justify the proposed methodology and explain how it will generate robust and actionable evidence.

1. Geographic Coverage

The study will include Ophthalmology residency programs supported by HCP in:

• Ethiopia: In-country data collection.
• Somaliland: Virtual interviews and stakeholder consultations, unless otherwise agreed.
• Rwanda: Virtual interviews and stakeholder consultations, unless otherwise agreed.

Consultants may propose local collaborators where necessary to facilitate data collection.

1. Contract Administration

This section outlines key contractual expectations for the successful consultant.

• Confidentiality: The Consultant shall maintain strict confidentiality of all information obtained during the assignment and shall not disclose or publish any information without prior written approval from HCP.
• Data Ownership: All data, reports, tools, databases, presentations, and other materials produced under this consultancy shall remain the exclusive property of HCP.
• Conflict of Interest: Consultants shall disclose any actual or potential conflict of interest, including previous or current engagements with COECSA, participating universities, residency programs, or other organizations directly involved in the evaluation.
• Ethical Approval: Where ethical approval is required (e.g., from Institutional Review Boards), the proposal shall clearly indicate responsibility for obtaining approvals and any associated costs.
• Intellectual Property Rights: All reports, databases, instruments, presentations and other outputs produced under this consultancy shall become the exclusive property of HCP.

1. Deliverables and Payment Schedule

The following deliverables will be expected from the successful consultant after the award of the contract. Payments will be linked to the acceptance of these deliverables.

Deliverable Acceptance

Each deliverables shall be reviewed by HCP within ten (10) working days of submission. The Consultant shall revise and resubmit deliverables based on HCP's comments before final acceptance. Payment will be released following the final acceptance of each deliverables.

Proposal Submission Requirements

Interested consultants or consulting firms are invited to submit both Technical and Financial Proposals. Proposals must be submitted electronically to aamin@cureblindness.org and dtafa@cureblindness.org  no later than September 4, 2026, at 5:00 PM (East Africa Time). Proposals shall remain valid for 90 days after the submission deadline.

A. Technical Proposal

The technical proposal should not exceed 15 pages and should include:

1. Understanding of the Assignment
2. • Understanding of the study objectives.
   • Understanding of the context of Ophthalmology residency training and COECSA examinations.
   • Assessment of major evaluation considerations and challenges.
3. Proposed Methodology
4. • Evaluation design.
   • Sampling strategy.
   • Data collection approach.
   • Proposed analytical framework.
   • Ethical considerations and data quality assurance mechanisms.
5. Proposed Inception Phase Deliverables
6. • Evaluation framework.
   • Conceptual framework.
   • Preliminary evaluation matrix.
   • Draft data collection approach.
   • Draft work plan.
7. Work Plan and Timeline
8. • Activity schedule.
   • Major milestones.
9. Team Composition
10. • Team structure.
    • Roles and responsibilities.
    • Level of effort of key personnel.
11. Relevant Experience
12. • Similar details assignments are completed within the last five years, particularly in:
    • • Medical education.
      • Residency training evaluations.
      • Workforce development.
      • Ophthalmology and eye health programs.
      • Mixed-methods evaluations.

B. Financial Proposal

The financial proposal should include a detailed budget breakdown, including:

• Professional fees (by key personnel, with daily rates and number of consultancy days).
• Travel costs (by country, including flights, accommodation, and per dime).
• Data collection costs (by country, including enumerator fees, translation, etc.).
• Administrative and overhead costs.
• Taxes and statutory obligations.
• Any other relevant costs.