Duration: 27 days completed by June 2019, with specific deadlines to meet

Duty station: The Consultant will be based in Maputo with eventual field trip to Cabo Delgado

Background of Consultancy

UNFPA is a key player in the health sector wide approach in Mozambique and participates in its various levels, at policy dialogue and also technical level. UNFPA supports the Government of Mozambique to broaden availability, access and use of quality Sexual and Reproductive Health (SRH) services at several levels.

The KIMCHI programme, funded by Korea International Cooperation Agency (KOICA), aims to contribute to the reduction of maternal and newborn morbidity and mortality in Mozambique and particularly in Cabo Delgado Province. The programme is to reinforce the demand and access to quality maternal and sexual and reproductive health services of the hard to reach population of Cabo Delgado. Gender issues are mainstreamed in the proposal and specific actions towards gender equality are also integrated, considering the context of power inequalities between women and men, in favor of the latter, especially regarding sexual and reproductive rights;

KIMCHI programme started in Mozambique in November 2015 under the overall coordination, technical support and management of UNFPA in partnership with WHO and is expected to end in June 2019. It has been implemented by Ministry of Health at central level, Provincial Directorate of Health in Cabo Delgado, Ministry of Women and Social Affairs, AMODEFA (IPPF Affiliate) and Fundação Wiwanana, a local implementing partner.

Purpose of Consultancy

Considering that KIMCHI nears completion of its cycle, an evaluation is to be undertaken, to provide a comprehensive and systematic accounting of performance, the likelihood of sustainability and possible impacts. The analysis and recommendations of the evaluation will be important for UNFPA future interventions, to the Government on eventual replication and follow up, to the partners and beneficiaries, and will also inform the formulation of eventual successor proposal.

UNFPA Mozambique is looking for a consultant to conduct an independent, external, forward-looking evaluation of KIMCHI Programme “Support to Cabo Delgado province to reduce the burden of maternal, neonatal and child mortality and morbidity”. 

Project Goal, Objectives, and Strategies

“Support to Cabo Delgado province to reduce the burden of maternal, neonatal and child mortality and morbidity”.

The specific objectives are the strategic objectives formulated in the Integrated Plan to Achieve MDGs 4&5: 

• Objective 1: Reinforce the health system to improve the availability of Maternal, Neonatal, health and family planning services and increase access for the target population. 
• Objective 2: Strengthen the involvement and capacity of communities in the promotion of Maternal, Neonatal and child health and family planning 
• Objective 3: Increase the quality of Maternal, Neonatal health including Family Planning services. 
• Objective 4: strengthen coordination and M&E mechanisms to ensure the effective implementation of the Integrated Plan Mozambique to Achieve MDGs 4&5.
• The planned interventions are fully aligned with national policies, strategies and plans and especially, the National Health Strategy 2014/2019 (PESS 2014-2019) national Integrated Plan to Achieve MDGs 4&5 and the National Family Planning strategy 2010-2015 (2020).
• In support of the overall goal and specific objectives of the programme, planned activities are implemented along the continuum of care. The "continuum of care" for maternal, child and newborn health includes integrated service delivery for adolescents and mothers from pregnancy to delivery, the immediate postnatal period. Such care is provided by families and communities, and through outpatient services, clinics and other health facilities. 
• The continuum of care recognizes that safe pregnancy and childbirth are critical to the health of both the woman and the newborn child—and that a healthy start in life is an essential step towards a sound childhood and a productive life.

 The following main strategies are used: 

• System strengthening in Cabo Delgado, including provision of essential commodities for service delivery and support to the referral system. 
• Institutional capacity development of government and non-governmental partners (through training and technical assistance) to ensure high-quality engendered service delivery, in Cabo Delgado province, complemented at the local level by community capacity development. 
• Capacity building to deliver quality maternal and new-born (ENC) health interventions 
• Provision of family planning services at community level. The approach is mainly targeting rural areas where access to health facilities is difficult. Community-based family planning (CBFP) brings family planning (FP) information and methods to women and men in the communities where they live rather than require them to visit health facilities. 
• Social mobilization to increase the knowledge and demand of communities of and for quality engendered health care, denounce gender-based violence and increase the involvement of men in reproductive and sexual health. 

Scope of Work

The evaluation will pursue the following objectives:

• To review the relevance, effectiveness, efficiency, sustainability, equity and impact of the KIMCHI approaches / programme.
• To identify the factors that have affected positively and negatively its implementation.
• To identify a set of lessons learned and provide recommendations to UNFPA and partners for future programming, based on the evaluation findings.

1. While assessing results, the evaluation is expected to consider the following aspects: country ownership, mainstreaming, sustainability, catalytic role and impact. This also includes assessing the integration of KIMCHI programme approaches in capacity building, commodity management, community-based family planning in target areas, as measured by the adoption and ownership of KIMCHI programme components within government strategy, policy and programme framework. 

The evaluation will analyse and interpret the results of the endline surveys that will help defining the results of KIMCHI implementation. The endline surveys are mostly the replication of the baseline exercise done in 2015 which established a set of data that is used as basis for measurement and comparison, a starting point from where the implementation began. 

Directly linked to the programme logical and result frameworks, the baseline was twofold: a Health Facility Assessment (HFA) and a Household KAP survey (KAP).

The Health Facility Assessment is a census of all 59 hospitals and health centers, present in KIMCHI 8 intervention districts; a facility-based cross sectional survey that will measure current functioning and capacity of the provincial health system to provide antenatal care, maternal and newborn services and postnatal care.

The assessment meets international standards and covers the following areas: infrastructure, human resources, equipment and commodities, statistics, key functions and essential services, skills and competencies of health providers.

Individual interviews based upon semi-structured questionnaires and direct observations (infrastructure, equipment, ANC, PNC, etc.) are the methods used to collect data which once aggregated and analysed identify possibly persisting gaps the KIMCHI programme focused on. It also allowed DPS and UNFPA to define the most effective use of funds to equip health facilities in need and bring them up to standards.

The KAP survey, a cross-sectional household-based survey, assesses the sexual and reproductive health needs, knowledge, attitudes and practices of young people in Cabo Delgado. It informed programme planning and provided baseline data for evaluation of the impact, efficiency, efficacy and relevance of programme approaches. It helped define in each of the eight target districts specific objectives and most appropriate interventions. The specific objectives of this household survey are: (1) to assess the sexual and reproductive health needs of young people (aged 15 – 24) in the 8 districts of Cabo Delgado; (2) to define the factors that enable or prevent young people from making healthy life choices or using services in their communities in order to adapt programmatic approaches to address gaps; and (3) to collect data on programme results indicators related to SRH for evaluation of KIMCHI programme.

The survey with a multi-stage clustered sampling is carried out (standardized questionnaire) among a representative sample of men and women aged 15-24 years in in the eight districts of interventions in Cabo Delgado Province, namely: Pemba City, Ancuabe, Balama, Chiure, Mocimba da Praia, Montepuez, Mueda and Namuno.

Reports and full data sets of both endline surveys will be made available once the consultant is hired.

2. The evaluation is expected to identify the factors that have affected positively and negatively its implementation, factors that can explain performance as well as non-performance. Attention should be given to results that were planned and/or achieved. 

3. Evaluation findings should be concise and punctual, leading to solid and operational recommendations for all stakeholders in their on-going implementation and forward planning. The evaluation is expected to provide clear recommendations for strengthening the programming approach, including by highlighting areas which need to be strengthened and recommend collaborative ways to improve results in future MNCH programming. 

This evaluation will be carried out in the districts where KIMCHI has been implemented.

Activities and Tasks

1. Desk review of relevant documents (project document, baseline, monitoring matrix and 2015, 2016 & 2017 Annual Reports, project reports, sector plans and strategies, Mozambique key SRH and MNCH documents and policies, baseline, endline, monitoring and financial information and other relevant documentation will be provided once the consultant is selected)
2. Development of evaluation protocol with potential submission to provincial and national committees
3. Draft, present and finalize inception report
4. Fieldwork, interviews with strategic partners and implementers and beneficiaries, focus group discussions, review of documents on site
5. Management of the evaluation
6. Draft report and finalize evaluation report, including incorporating comments from UNFPA and stakeholders
7. Prepare and present to UNFPA and stakeholders dissemination materials on the evaluation draft and final findings and recommendations

Duration and Working Schedule

•    Desk review: 5 days
•    Evaluation protocol: 3 days
•    Draft, present and finalize inception report: 3 days, by 1 May
•    Fieldwork: 5 days
•    Draft report: 2 days
•    Incorporate comments and inputs: 2 days
•    Present to UNFPA and stakeholders: 2 days
•    Submission of final report: 5 days by end of June

Expected Outputs and Deadlines

The following deliverables are expected from this service, in hard and soft versions:

1. The inception report and evaluation protocol
2. The draft evaluation report
3. The full data sets.
4. The final evaluation report with recommendations.
5. Dissemination materials (e.g. briefing note, presentations on draft and final findings); 

Deliverables -- Deadlines (TBC)

• Inception report with Evaluation protocol -- 1 May 2019
• Draft report and its presentation -- 15 June 2019
• Final report and its presentation -- 30 June 2019

Methodology and Technical Approach

The evaluation should follow the UN Evaluation Group (UNEG) ethical guidelines (http://www.unevaluation.org/document/detail/102), norms and standards (http://www.unevaluation.org/document/detail/1914)   and code of conduct (http://www.unevaluation.org/document/detail/100) for evaluations in the United Nations System.

UNFPA anticipates a two-phase process.  

Phase 1 – Development of evaluation methodology and tools: based on the TORs and on existing information, the consultant will prepare a detailed evaluation protocol and schedule, including an evaluation matrix with evaluation questions and sub-questions, sources of information, methodology, data collection tools, sampling, statistical formulas, questionnaires, and analysis methods and tools. 
This information will be summarised in an inception report, which will guide the assessment.
Information sources are expected to include, but will not be exclusive to the project document, baseline, monitoring matrix and KIMCHI Annual Reports, project reports, policy and strategic documents, expert articles and opinions, the documents already developed by the work undertaken during the process of project development (baseline), implementation (result framework) and analysis (reports, endline). Data collection instruments can include amongst others, surveys, questionnaires, interviews through SWOT analysis, focus group discussions, and other participatory methods. The proposed methodology should specify measures the evaluation will take to ensure that the process is ethical, that confidentiality and dignity of participants in the evaluation are guaranteed, in particular in case of participation by adolescent minors and vulnerable groups. 

Phase 2 – Implementation of the evaluation: this phase will focus on data collection, according to the protocol defined and agreed in Phase 1, data analysis and report drafting.  
The evaluator will establish appropriate communication and collaboration among the main KIMCHI stakeholders – the Government of Mozambique, the Korea International Cooperation Agency, DPS Cabo Delgado, Amodefa, Fundação Wiwanana, and UNFPA - and will be responsible for presenting findings of this evaluation to project stakeholders, and others considered pertinent. The consultant will also formulate and present conclusions and recommendations based on the evaluation findings.
 

Supervisory Arrangement

The consultant will work under the direct supervision of the M&E officer, in close collaboration with Deputy Representative and Programme staff. 

Expected Travel

Visit of some KIMCHI intervention areas in accessible districts of Cabo Delgado province of Mozambique (to list) will be required. Expenses will be reimbursed on pre-approved budgets in line with UNFPA financial regulations. 

Qualifications and Experience

Education:

Minimum of Master’s degree in Evaluation and Social Research Methods, Programme Management, International Development, Public Health, Social Science, ICT or related fields 

Qualifications and Skills:

• Demonstrated knowledge, competence and working experience on ICT4D, ICT & services for monitoring purposes and ICT for service delivery
• Excellent research skills: data collection, data analysis and report writing in the field of sexual and reproductive health
• Excellent planning, analytical, organizational, and managerial skills
• Knowledge and/or experience with communication and information technologies 
• In depth knowledge of the region or of Mozambique and the Mozambican public sector, familiar with SRH, MNCH issues in Mozambique 
• Proficiency in statistical packages 
• Being based in Mozambique or in the region is an asset

Professional Experience:

• At least 7 years of proven experience in conducting evaluations 
• Extensive experience in designing and leading evaluations of programmes/ projects in public heath, preferably in SRH/MNCH
• Strong record of assessing programme framework and impact 
• Experience in analyzing surveys and statistics preferably in the area of health 
• Experience both in quantitative and qualitative analysis
• Experience evaluating programmes for/with mothers, adolescents and youth 
• Experience evaluating programmes involving ICTs 
• Experience in gender analysis and human-rights based approaches 
• Familiarity with UNFPA or the UN is an added value
• Familiarity with Mozambique institutional context
• Experience working in Southern Africa would be an asset

Language:

Fluency in English and in Portuguese.

Inputs/Services to be provided by UNFPA or implementing partner:

Reports and full data sets of both endline surveys will be made available once the Consultant is hired.

How to Apply:

Interested candidates should submit their application with motivation letter, updated CV and UN P11 Form to dedicated email inbox of moz.recruitments@unfpa.org by the latest 17 February 2019, 5:00 PM (Maputo time). Applications received after this deadline will not be taken into consideration.

All applications should be clearly marked with Subject Line “International Consultant: Evaluation of Kimchi Programme” 

You can download P11 UN Personal History Form here: https://www.unfpa.org/resources/p11-un-personal-history-form

Applicants will be short-listed on the basis of their qualifications and work experience. Only the short-listed candidates will be invited for interviews.

IMPORTANT: There is NO application processing or other fee at any stage of UNFPA application processes.