Job Function: International
Department: Central & West Africa
Location: Democratic Republic of CongoConsultant for Final Evaluation of NDI DRC Tomikotisa ProgramFinal Evaluation Statement of WorkINTRODUCTION
The purpose of the following Statement of Work (SOW) is to guide and define the deliverables for a final evaluation of the National Democratic Institute’s (NDI or the Institute) program, Building Participatory and Responsive Political Parties in the Democratic Republic of the Congo or Tomikotisa (in Lingala), implemented with funding from the United States Agency for International Development (USAID). The period of performance for the evaluation is July-September 2018.Purpose and Scope:
The evaluation will consider the 1) relevance, 2) effectiveness, 3) efficiency, 4) sustainability, and 5) impact of the NDI’s Tomikotisa program, including the extent that the program objectives have been achieved. It will also provide recommendations to inform future political party programming in the Democratic Republic of the Congo (DRC). In addition to NDI, the evaluation report will be shared with other stakeholders, including USAID/DRC.PROGRAM BACKGROUND AND OBJECTIVESBackground:
Since September 2013, NDI is implementing the Tomikotisa program, with funding from the USAID. “Tomikotisa” is Lingala for “Participation” or “Engagement.” The three-year program seeks to increase the managerial and organizational capacity, accountability, and responsiveness of Congolese political parties by modernizing internal party processes and increasing participation and inclusion of marginalized groups, notably women and youth.
At the beginning of the program and in consultation with USAID, NDI selected six political party partners based on pre-determined criteria that included results from the 2011 elections, national level representation, demonstrated interest and engagement by party leadership in NDI’s past events or interest in participating in future events or meetings. Four additional parties were added in 2017. In the final year of the program, additional parties from both opposition and majority have been invited to join certain activities to include a wider range of the political landscape, which has evolved considerably since the program began.
The Institute implemented the Tomikotisa program in a tense political climate. Elections were constitutionally set for late 2016, but they did not take place; the government has cited security concerns and the need for a new voter register to explain the delay. The timing and sequencing of local and national elections divided the Congolese political class for most of the program’s duration; only in November 2017 did the electoral commission announce an electoral calendar that set presidential, National Assembly, and provincial assembly elections for December 23, 2018, with additional Senate and local elections planned in 2019 and 2020. As the program nears its end, political tensions are high over uncertainty over whether the calendar will be respected, if electoral processes will be credible and fair, and whether President Kabila will decide to abide by the constitution and refrain from seeking a third consecutive term. This years-long tension has fractured the governing coalition and split political parties in the opposition. Election-related developments, as well as internal conflicts, distracted political party partners, making them less available to commit time and resources to organizational development through the Tomikotisa program.
Following the official launch of Tomikotisa in January 2014, the Institute undertook a major baseline assessment of party strengths and weaknesses, conducted several interventions with women and youth leagues and strategic planning with select parties’ cadre, trained master trainers, and used public opinion research to inform political parties’ platform development processes with citizens’ concerns. Following recommendations from a mid-term internal evaluation conducted in August 2015, and with a cost-extension from USAID that added four party partners, a fourth objective, and two additional years of programming, the Institute adjusted its program implementation strategy and emphasized institutional strengthening over individual skills building. As the Congolese political context evolved, the Institute delivered party-sought and party-tailored assistance to participating political parties and facilitated multi-party consensus-building on national priority issues among women and youth. NDI also focused on interparty dialogue in the tense environment surrounding uncertain election preparations.Program Objectives:
The four program objectives below are supported by nine intermediate results and four sub- intermediate results. In some cases, they were slightly amended when the program transitioned from Phase I (three years spanning 2013 to 2016) and Phase II (two years spanning 2016 to 2018). The changes are denoted with a (PI) or (PII). In some cases, the changes were superficial, in others they were slightly more substantive.Objective One
: Increase youth and women’s capacity to act as change agents for party modernization efforts
IR 1.1: Increase Youth Capacity to Act as Change Agents for Party Modernization Efforts
Sub-IR 1.1.1: (PI) Party youth define and shape youth reform and policy priorities./ (PII) Youth Voices Are Heard on Key Issues
Sub-IR 1.1.2 (PI) Party youth strengthen intra-party demand for inclusive processes./ (PII) Party Youth Demonstrate Reform Capacity
IR 1.2 Increase women’s capacity as change agents for party modernization efforts.
Sub-IR 1.2.1 Women leaders work across party lines to (PI) define common priorities/ (PII) enhance Women’s Political Participation
Sub-IR 1.2.2 (PI) Party women create intra-party demand for inclusive processes./ (PII) Women Expand Space Within Their PartiesObjective Two:
Improve Congolese parties’ internal management and organization
IR 2.1: Participating parties improve their (PI) strategic/ (PII) operational planning capacity.
IR 2.2: Parties develop (PI) internal training capacity/ (PII) core capacities.Objective Three:
(PI) Improve Congolese parties’ capacity to be representative of and responsive to citizens’ concerns/ (PII) Assist Congolese Political Parties become more Representative and Responsive to Citizens’ Concerns
IR 3.1: Political parties (PI) adopt/ (PII) acquire more systematic approaches to collecting citizen input for the formulation of platforms and policies.
IR 3.2: Political parties (PI) craft/ (PII) construct messages and policy platforms that incorporate information on citizen interests.
IR 3.3: Political parties communicate policy positions and collect citizen feedback.Objective 4:
(PII only) Foster Interparty Dialogue on Key National Issues
IR 4.1: Parties Address Barriers to Dialogue
IR 4.2: Electoral Challenges Are Addressed Through Interparty Dialogue EVALUATION OBJECTIVE AND ILLUSTRATIVE QUESTIONS
The objective of the program assessment is to evaluate the extent to which NDI has successfully achieved or contributed to its achievement of the Tomikotisa program objectives. Using the Development Assistance Committee (DAC) evaluation criteria to guide the evaluation design, the illustrative evaluation questions may include:Relevance:
How relevant was NDI’s approach to the development goal (need) of supporting Congolese political parties, particularly in light of political challenges in the DRC?Effectiveness:
- How effective was the program in increasing parties’ appreciation for strategic planning and making this process research-driven?
- To what extent has the program been successful in helping parties improve their internal management and capacity?
- Have interparty dialogue mechanisms mitigated tensions effectively and/or helped integrate wider party perspectives into election preparations?
How well did NDI mitigate risks and leverage opportunities in the program’s uncertain electoral environment?
How has NDI’s choice of partners led to greater or lesser program efficiencies? As more parties were added, did support remain sufficiently robust so as to be useful to each?Sustainability:
How sustainable are NDI’s party modernization interventions in enabling parties to improve their internal policies/planning and be more inclusive of youth and women?Impact:
To what extent has the program impacted the ability of young people and women to participate meaningfully in party modernization efforts (such as strengthen intra-party demand for inclusiveness, and contribute to reforming decision-making processes or party structures)?
What have been the program’s unintended results, if any?EVALUATION METHODOLOGY
The external evaluator, in their inception report, should detail the evaluation design including final key and sub-questions, primary data sources, data collection tools, methodology and analysis methods. The evaluation design is expected to be non-experimental. It should include a combination of qualitative and quantitative data collection from a purposive sample of key individuals and stakeholders including, but not limited to, partner political party leaders and/or senior officials and members of the youth and women’s leagues, members of the debate steering committee, Congolese political analysts, and journalists.
The evaluator should consider a range of possible methods and approaches to collecting and analyzing the information required to assess program results, establish relationships between activities and outcomes, contributions to the overall impact and make programmatic recommendations. Emphasis should be placed on capturing the arc of the program, looking at how the program as a whole contributed to change, as well as the success or effectiveness of specific types of interventions at different points over the course of the program. In determining the effectiveness in achieving the program objectives and results, the evaluation consultant should draw heavily from indicators outlined in the proposal, as well as program reports. Qualitative methods in data collection and analysis should be employed by the evaluation consultant in the process. Focus group discussions, key informant interviews, and surveys have worked well with program stakeholders in the past. The external evaluator is responsible for developing a detailed evaluation design including finalizing sub-questions and identifying data collection tools and methodology and analysis methods.
The evaluation should include a desk review of program reports and outputs. To make the field time as efficient as possible, preparation should include completing a majority of the documentation review, establishing interview guides, developing team protocol and responsibilities, and establishing the evaluation schedule, and a tentative appointment schedule with various groups that will be interviewed in the field. Appointments on the schedule will be confirmed by NDI field office before the evaluator arrives in the country. This will ensure that field time is primarily spent consulting with partners, stakeholders, and beneficiaries in the DRC.
NDI will be involved with design, planning, and logistics, but the external evaluator is required to provide significant and overall leadership and direction, as well as having the final responsibility for the major evaluation duties and deliverables, which includes collecting both quantitative and qualitative data, conducting key informant interviews and focus group discussions, analyzing data and producing the report.
NDI will be responsible for arranging travel logistics for the evaluation consultant for the data collection in the field.Informed Consent and Data Anonymization
Require Informed Consent language (either written or verbal) that communicates: the researchers and their role on the project/study; the purpose of the study; the voluntary nature of their participation in the study; informing them that they can choose to participate, refuse to participate or withdraw from the study with no negative repercussions; an explanation of the process and format of the study; the risks and benefits of participating in the study, the anonymity and confidentiality of their participation in the study; how the data will be shared; the incentives or reimbursements the researchers will provide as a result of their participation, if any; how the results of the study will be reported and shared and the contact information of someone that the participants can call if they have question on the research. The researcher will communicate to NDI how informed consent will be collected.
Data Confidentiality and Security Plan clearly addresses: data storage and protection; process of anonymizing data; response to data loss or security breaches; data flow and transmission; identity of those who will have access to the data; and retaining, archiving or destroying data after study is completed.TIMELINE AND KEY DELIVERABLESDesign and data compilation -
June-JulyData collection in the field -
July-AugustData analysis -
AugustFinal report -
SeptemberLevel of effort:
NDI anticipates the consultancy will take place between June and September 2018, finishing no later than September 15, as follows:
5 days – Document review and inception report from consultant’s home base
12 days – In-country data collection (excluding travel days)
Up to 10 days – Data analysis and report productionTasks:
Desk review of program documents, including NDI donor reports and tools and reports produced by consultants
Design of the overall evaluation strategy and methodological approach, including identification of appropriate data collection and analysis methods, development of evaluation instruments and questionnaires, and establishment of protocols for data collection and analysis
Refine the evaluation questions
Getting informed consents signed by interviewees of this evaluation
Data collection and analysis, likely including a review of project reports, partner outputs, data collected through ongoing program monitoring, and interviews with key informants and focus groups
Data analysis against program results
Submission of draft report for comments by NDI
Submission of final evaluation reportDeliverables:
Deliverables must be in English and include:
- Evaluation Inception Report in MS Word format prior to beginning of evaluation fieldwork, which includes: refined terms of reference (TOR) and evaluation strategy, evaluation questions, methodology and work plan
- Informed consent documentation
- Data Confidentiality plan
- Draft program assessment summary and oral briefing of findings during validation session with NDI-DRC prior to departure from DRC
- Draft evaluation Report in MS Word with preliminary findings & recommendations
- Remain receptive to comments, suggestions, and/or additions in the report that are proposed by NDI, until the document is finalized
- Final evaluation Report in MS Word
- Raw data and records of the evaluation report (e.g. interview transcripts, survey responses etc.)
The final report should include:
EVALUATION PROPOSAL PACKAGE
- Executive summary of findings, conclusions and recommendations
- Introduction and background to the evaluation
- Evaluation questions, methodologies and approach, scope, constraints, and limitations
- Description of the project objectives evaluated
- Data collection and analysis
- Key findings, conclusions, and lessons learned for future programming
- Recommendations for future political party programming in DRC
- Annexes including: TORs, workplan, instruments and protocols, databases, references, documentation, etc.
- A complete hard and soft copy of raw data for the evaluation
Interested individuals or companies should submit the following:
- A written statement of interest and qualifications (no more than five pages in length) highlighting: prospective data collection options for this program, including experience with each proposed approach. If proposing a junior evaluation specialist as part of the evaluation team, include relevant experience and thematic expertise of team members and the tasks each member would fulfill
- Estimated level of effort necessary to complete the evaluation
- A current CV for each member of the evaluation team
- At least two client references from past evaluation work
- One example of a previous evaluation inception report written by the evaluation consultant/team lead
- One example of an assessment or evaluation report written by the evaluation consultant/team lead
Please note that the successful individual or team must be fluent or highly proficient in French.The deadline for submitting your documents is June 13, 2018.