Purpose of consultancy: 

To conduct a midterm review (MTR) of BERANI programme (2018-2020). 

Scope of work (Description of services, activities, or outputs): 

INTRODUCTION

UNFPA and UNICEF Indonesia are planning to conduct an independent programme midterm review (2018-2020) of the BERANI, Better Sexual and Reproductive Health and Rights for All in Indonesia programme (2018-2022) as agreed in its project document. Programme midterm review serves three main purposes: (i) demonstrate accountability to stakeholders on performance in achieving development results and on invested resources; (ii) support evidence-based decision-making; (iii) contribute important lessons learned to the formulation of the 2021-2022 work plans.

UNFPA Indonesia together with the Government of Canada, the Government of Indonesia (GoI), and UNICEF, have been working since 2018 to improve sexual and reproductive health and rights (SRHR) for women and young people in Indonesia, through a joint programme aimed at increasing the quality of skilled birth attendance (SBA) and thereby decreasing maternal mortality; increasing access to SRHR information and services to young people through comprehensive sexuality education (CSE) and a youth friendly services (UNALA); and decreasing harmful practices such as child marriage  and female genital mutilation/cutting (FGM/C) and gender based violence (GBV)  through advocacy, evidence-generation, and capacity building.

The programme is implemented through partnerships with strategic partners, such as national counterparts, including BAPPENAS, BKKBN, MOH and MOWECP; and partnerships with parliamentarians, faith-based organizations, the private sector, philanthropists, and youth and women’s networks.

OBJECTIVES AND SCOPE OF THE MIDTERM REVIEW

The MTR aims at assessing the progress of BERANI joint programme towards the achievement of results of the first half of the programme cycle in order to:

1. Propose corrective action and strategic recommendations for the remaining one year of the five-year cycle across thematic outputs as well as in cross-cutting issues (management, coordination, strategic partnerships, knowledge management).
2. Be the basis for mid-term revisions of the Programme Planning, Monitoring, and Evaluation Matrix.
3. To assess the quality of the programme design through  assessing the theory of change, bottleneck analysis and critical assumptions of the programme and its sub-programmes including the validity, quality and adequacy of the results and resources frameworks of the respective programmes and capturing all key intended and unintended contributions of the programmes.

Objectives of the MTR:

With the above stated purpose, the objectives of the MTR are:

• To review the programme design (including logic model/results framework), governance, and management measures, identifying the gaps, challenges, and opportunities, in the achievement of programme results/goals as well as in the engagement of national partners.
• To review progress in programme implementation, identifying status of mid-term results achieved in relation to outputs and outcomes.
• To propose corrective action in order to improve performance for the remaining one year of the programme cycle; this may include the revision of the planning framework and the revision of annual targets.

Intended audience:

The main audience and primary users of the midterm review report are the decision makers and programme managers in UNFPA and UNICEF Indonesia (CO), the Government of Canada, as well as counterparts in the Government of Indonesia (GOI), including the civil society, and the United Nations Resident Coordinator Office (UNRCO) in Indonesia.

Outputs:

The MTR team will produce the following deliverables:

1. An approved design report including (as a minimum): 

• A stakeholder map;
• The MTR matrix (including the final list of evaluation questions and the corresponding judgement criteria and indicators); and
• The overall evaluation design and methodology, with a detailed description of the data collection plan for the data collection phase.
• The division of labor among the MTR team with a work plan indicating timeline for key milestones.

2. A debriefing presentation document in the format of PowerPoint synthesizing the main preliminary findings, conclusions and recommendations of the data collection
3. A draft MTR report, potentially followed by a second draft
4. A power point presentation of the results of the evaluation for the in-country stakeholder workshop;
5. An approved final MTR report, with annexes, based on comments expressed during the in-country stakeholder workshop; and
6. An evaluation brief, a 2-3 page summary of the key evaluation findings, conclusions and recommendations.

All deliverables will be in English.

SCOPE OF THE CONSULTANCY:

The consultant is expected to undertake the MTR as a leader of the MTR team and make recommendations that are valid and reliable, based on available data and evidence. It is expected that the consultant will conduct a participatory MTR that will involve programme implementers and target beneficiaries. Existing project documents and progress reports will be shared with the consultant to facilitate completion of the tasks.

The Team Leader will be responsible for:

• Providing overall leadership on the independent MTR programme review based on inputs and insights from the other consultants in the MTR team;
• Covering at least one component (Coordination and Management) of the MTR
• Supervising and coordinating the work of MTR team members and responsible for the quality assurance of all MTR deliverables;
• Developing the design report including the MTR matrix and the work plan;
• Collecting information, conducting desk reviews of relevant documents and interviews with key stakeholders;
• Drafting the first comprehensive draft of the MTR report with inputs from team members, addressing the comments from ERG to produce the  2nd draft and final MTR report in line with UNFPA-UNICEF evaluation quality standards; and
• Ensuring that all the MTR team members selected to work under his/her supervision are fully briefed about the whole review process, objectives, methodology framework, evaluation tools, ethical standards, and key milestones/deliverables.

MANAGEMENT OF EVALUATION:

The MTR team will consist of the MTR team leader and the MTR team members. The responsibilities of Team Leader position are: a team leader with overall responsibility for the MTR process including the production of the final report. S/he will lead and coordinate the work of the MTR team and will also be responsible for the quality assurance of all evaluation deliverables. She/he will be responsible for putting together the design report, the draft final and the final MTR reports based on inputs from other MTR team members.

Methodology:

The MTR will utilize a mixed method approach, using qualitative and quantitative methods as necessary. The Logic Model used to design the BERANI joint programme will be reviewed and revised as necessary, based on stakeholder consultations to provide the basis for this MTR.

The MTR will pay special attention to ensure equity, gender and human rights based approaches are embedded into the data collection and analysis.  It will be also guided by the United Nations Evaluation Group (UNEG) ethical guidelines for evaluation, as well as UNEG Norms and Standards.[1][2] The MTR will be transparent, inclusive and participatory as well as gender and human rights responsive.  It will seek and utilize data disaggregated by age, gender, vulnerable groups, etc. to ensure findings are gender reflective and targeted.