Local Evaluation Specialist – Challenge TB, Final Evaluation
USAID/Ethiopia Performance Monitoring and Evaluation Service (EPMES) Activity
Social Impact (SI) is a Washington, DC-area international development management consulting firm. SI’s mission is to improve the effectiveness of international development programs in improving people’s lives. We provide a full range of management consulting, technical assistance, and training services to strengthen international development programs, organizations, and policies. We provide services globally in the areas of monitoring and evaluation, strategic planning, project and program design, organizational capacity building, and gender and social analysis. SI services cross-cut all development sectors including democracy and governance, health, education, the environment, and economic growth. SI’s clients include US government agencies such as USAID, the Millennium Challenge Corporation, the US Department of State, bilateral donors, multilateral development banks, foundations, and non-profits. In Ethiopia, SI implements the Ethiopia Performance Monitoring and Evaluation Service (EPMES) Activity of USAID. The EPMES Activity provides monitoring and evaluation (M&E) services to the USAID/ Ethiopia Mission, which include external evaluation, performance monitoring technical support and improving capacity for learning and adapting.
The USAID/Challenge TB Ethiopia (CTB) Project is a 5-year global mechanism active since October 2014 and ending in September 2019. In Ethiopia, it is being implemented by KNCV TB Foundation as the in-country lead, along with Management Sciences for Health (MSH) and World Health Organization (WHO). Additional partners who are in the global coalition but not active in-country in Ethiopia are the American Thoracic Society, FHI 360, and Interactive Research and Development (IRD). Challenge TB Ethiopia supports a comprehensive package of tuberculosis (TB) interventions.
Challenge TB Ethiopia collaborates with the National TB Program (NTP), major national institutions (EPHI, AHRI, PFSA and FMHACA), Ethiopian universities and other local institutions and helps the regional health bureaus (RHBs), zonal health departments (ZHDs), and woreda (district) primary health care units to take ownership of TB, TB/HIV, and multidrug-resistant TB (MDR-TB) program management. Through this assistance, the RHBs, ZHDs, and woreda (district) primary health care units have been fully engaged to ensure improved and sustainable program management capacity. Challenge TB Ethiopia focuses on increasing case notification and decentralization of TB services to communities through Health Extension Workers (HEW) and expanding access to additional health facilities (HF) in rural and urban areas. The project is also helping to strengthen Ethiopia’s health system by supporting the national laboratory network, program management teams of regional, zonal and woreda health offices and health facility staff capacity, woreda planning and improved drug supply management and TB infection prevention standards.
The purpose of this final performance evaluation is to independently assess the overall performance of the Challenge TB Project—in terms of achievements and challenges faced during implementation—and provide insight into effectiveness and relevance of the intervention strategies that have been implemented. Further, the evaluation should generate evidence and document lessons learned aimed at improving future TB program strategies to inform the design and implementation of similar projects in line with the USAID/Ethiopia Country Development Cooperation Strategy.
Evaluation Tasks and Timeline
The Evaluation Team Leader will lead a team of two (2) local consultants. During the evaluation design phase, the team will develop a detailed evaluation inception report which will include qualitative and quantitative data collection methods and analysis approaches, including a desk review to evaluate the performance of the Challenge TB Project. The evaluation team will be responsible for conducting primary and secondary data collection, performing data analysis, preparing PowerPoint presentations, presenting evaluation findings to USAID and other stakeholders, and preparing draft and final evaluation reports. The evaluation is expected to start the first week of January 2019.
Social Impact, through its EPMES Activity, is seeking to recruit on a short-term basis, two (2) competent evaluation Team Members experienced in conducting evaluations in the health sector. The consultants should have strong evaluation backgrounds, particularly in Tuberculosis programming, and must be knowledgeable about the Ethiopia Health sector program. The anticipated period of performance for the evaluation is approximately 70 days. The consultants will work under the immediate guidance of an Evaluation Team Leader.
The evaluation Team Members will be required to participate fully in all aspects of this evaluation, including but not limited to the following:
Participating in the preparation of an inception report (planning and preparation of the evaluation design, methods, data collection tools and logistics)
- Reviewing relevant background documents to support the evaluation design and triangulating results and to obtain supplementary information
- Pre-testing data collection instruments
- Conducting training of data collectors if primary data collection requires the involvement of data collectors
- Collecting data, i.e. conducting interviews and focus group discussions, and obtaining secondary data from stakeholders
- Transcribing data from all sources
- Conducting qualitative and quantitative data analysis and assisting other team members in data analysis
- Advising the team in identifying and applying preferred methods for sampling, data collection, and analysis
- Participating in the preparation of preliminary findings, conclusions, and recommendations matrices
- Preparing PowerPoint presentations on evaluation findings, conclusions, and recommendations
- Presenting the evaluation findings, conclusions, and recommendations to SI, USAID, and other stakeholders together with the Team Leader as required
- Preparing draft and final evaluation reports
- Performing other duties as instructed by the Evaluation Team Leader or the EPMES Chief of Party
The incumbents must meet the following criteria:
- Advanced degree (MA, MPH, DrPH, PhD) in Public Health, Social Work, or other social sciences and related disciplines
- Experience conducting at least two evaluations as a Team Member
- Experience working with tuberculosis programming in Ethiopia
- At least 5 years’ experience in qualitative and quantitative data collection and analysis
- Experience in evaluation methods
- Knowledge of qualitative and quantitative data analysis software
- Experience with the specific issues affecting genders differently in health programs, specifically in Tuberculosis programming in Ethiopia
- Understanding of the local Ethiopian health system and structures (FMOH, RHBs,…)
- Fluency in Amharic and English (Level 4)
- Strong English writing skills