International Consultant, Mid-Term Evaluation

Bangladesh has achieved strong economic development over the last 20 years. The poverty rate has been reduced from 57 percent in 1990 to 36.3 percent in 2008, driven by robust and stable economic growth (averaging 5-6 percent per year). Whilst 80 percent of Bangladesh’s GDP is generated through service and industry sectors, agriculture accounts for almost 50 percent of total employment.

Based on a delta plain at the confluence of the Ganges, Brahmaputra and Meghna Rivers, most parts of Bangladesh are less than 12 metres above the sea level. Consequently, 80 percent of the landmass is made up of fertile alluvial lowland, aiding agricultural productivity. However, this topography and the country’s tropical monsoon climate make Bangladesh vulnerable to natural disasters. Floods, cyclones, and tidal surges affect the country every year. Annual monsoon flooding results in the loss of human life, damage to infrastructure and a shortage of drinking water (leading to the spread of disease).

It is widely accepted that Bangladesh is extremely vulnerable to climate change. Likely impacts include sea level rise, changing weather patterns and increased climate variability such as increased temperatures, enhanced monsoon precipitation and runoff, potentially reduced dry season precipitation (leading to droughts), and an increase in frequency and intensity of tropical cyclones and storms. A large proportion of Bangladesh’s population lives close to the poverty line and is hence vulnerable to falling into poverty as a result of even a small shock. Consequently, addressing the challenges presented by climate change is crucial in sustaining poverty reduction in Bangladesh.

Strengthening country capacity to integrate poverty-environment-climate concerns into the mainstream of development planning and investment is an increasingly urgent priority. The Poverty-Environment Initiative (PEI) is a global programme and a joint effort led by UNDP and UNEP to build a common operational platform for helping countries meet the challenge of poverty-environment mainstreaming. The Poverty Environment Climate Mainstreaming (Bangladesh version of PEI) programme aims to strengthen capacity of the Planning Commission to integrate poverty-environment-climate concerns and opportunities in key development planning processes.

PECM supports:

• Assessing the extent to which climate change concerns are reflected in a sample of ADP projects in agriculture, water resources, rural development and transport.
• Drafting sectoral checklists and guidelines designed to climate-proof future ADP projects (including criteria and indicators) for line ministries and the Planning Commission.
• Drafting a revised format of the Development Project Proforma (DPP), incorporating pro-poor climate change concerns. DPP is a template followed by each line ministry when preparing detailed project proposals.
• Conducting technical training of staff in the Planning Commission and relevant ministries on implementing final checklists, guidance and DPP.
• Integrating climate into the budget process through the conduct of a Climate Public Expenditure and Institutional Review (CPEIR) and implementation of recommendations.

Objective of the Assignment:

The main objective of this assignment is to undertake a mid-term review and evaluation of the implementation of the PECM program (2010-2013) to assess achievements, progress, and key challenges in implementation.

The review will recommend improvements for the remainder of the programme from 2012-2013. The review will also recommend key activities of possible further support from 2013. The synthesis from this review will feed into the possible formulation of the PEI Phase II (2013-2016).

The National consultant will work under supervision of the UNDP Environment Unit Chief and UNDP-UNEP Regional PEI Advisors.

Specifically the evaluation will focus on:

1. Measuring progress against expected targets; Reviewing effectiveness and efficiency in delivery of targets; Identifying areas where special attention is needed in order to achieve targets;
2. Examining project management arrangements both within UNDP and across the different government agencies to ensure that they are adequate for and consistent with the attainment of assigned project outcomes and the implementation of agreed project activities;
3. Assessing the level of satisfaction of project stakeholders and beneficiaries with the results achieved thus far
4. Assessing sustainability of implemented activities;
5. Drawing insights gained from stakeholder consultations and lessons learned, provide concrete recommendations for the PECM Phase II focusing on but not limited to:
    - Design of an appropriate programmatic and management structure
    - Communications and awareness needs to influence for policy makers and the general public
    - Areas for policy relevant research
    - Identifying appropriate balance between policy and planning at national level with action-oriented activities at the local-level.

Evaluation questions:

The following broad questions are the minimum that need to be addressed in this Mid-Term Review:

• Have the right things been done? (Was the outcome and associated programme/ projects relevant, appropriate and strategic to national goals and the UNDP mandate?),
• Have things been done right? (Were the actions to achieve the outputs and outcomes effective and efficient?),
• Are the results sustainable? (Will the outputs and outcome(s) lead to benefits beyond the life of the existing programme(s)/project(s))?
• How might we do things better in the future? (Which findings may have relevance for future programming or for other similar initiatives elsewhere?)

Scope of work and expected outputs / deliverables:

This assignment will be for 16 days over a period of five weeks. In consultation with CCED Cluster and the implementing agencies, the consultant will:

• Outline scope of the review, areas of focus and information needed;
• Propose methodology and steps in which the review will be carried out for different components;
• Undertake consultations with stakeholders including Government ministries, institutions, development partners, INGOs, private sectors, academia and where appropriate local people;
• Based on the analysis, produce a draft mid-term review and evaluation report based on the objectives specified above;
• Organize consultation workshops to seek comments from implementing Government partners and relevant ministries, development partners, private sector and non-government organizations on the draft report; and
  vi. Incorporate comments and produce final mid-term review and evaluation report on the implementation of the PEI phase I by the final week of the evaluation.

Methodology and Reporting Framework:

Methodology of the evaluation should be participatory. This is expected that the OECD evaluation criteria or UNDP evaluation guideline will be followed in the evaluation. 

However, the methodology should be around five key dimensions:

• Relevance
• Efficiencies
• Effectiveness
• Impacts (early by indicative)
• Sustainability

The evaluation should also provide a set of recommendations for remaining period of the project and also suggest the design of a second phase. Involvement of GoB and UNDp is a key aspect of the methodology of the evaluation. The Government of Bangladesh and UNDP Country Office will assist with arranging consultation meetings and field visits, and provide all relevant documents. In addition, both the Government and UNDP will also ensure the joint review and evaluation of the implementation of PECM Phase I by the consultant is carried out in a fair manner. UNDP and the Government will facilitate the entire process and make sure that resources are in place to ensure the completeness of the review with high quality.

The International consultant will get a National Consultant for 16 days in his/her team to complete the midterm evaluation of the project. The International Consultant will report directly to the UNDP Bangladesh and the National Planning Commission.

The International consultant-MTE is expected to undertake the following over five weeks (16 days) time period:

Output 1:

• Come to agreement on scope of review and areas of focus. Draft outline of the mid-term review and evaluation report and proposed mission time schedule circulated for comments to UNDP and implementing agencies
• Timing for output delivery - Week 1 (2 work days)
• Means of Validation - Presentation Slides

Output 2:

• Preparatory review of relevant documents and reports
• Timing for output delivery - Week 1 (3 work days)
• Means of Validation - Presentation Slides

Output 3:

• In-country meetings and stakeholder consultations
• Timing for output delivery - Week 2-3 (5 work days)
• Means of Validation - Presentation Slides

Output 4:

• A presentation to Planning Commission, UNDP and other stakeholders on the initial midterm review results
• Timing for output delivery - Week 3 (1 work day)
• Means of Validation - Presentation Slides

Output 5:

• Submission of first draft mid-term review report to Planning Commission and UNDP
• Timing for output delivery - Week 4 (3 work days)
• Means of Validation - Draft Evaluation Report

Output 6:

• Final mid-term review report submitted to UNDP and Planning Commission incorporating comments on first draft report from stakeholders
• Timing for output delivery - 3 work days
• Means of Validation - Final Evaluation Report

Supervision and Performance Review:

The International Consultant will be supervised by the UNDP Assistant Country Director (Climate Change, Environment and Disaster Cluster).

• Strong and proven research and analytical skills;
• Initiative and ability to organize his/her work independently, but also to work as part of a team;
• Proven ability to deliver quality output working under tight deadlines;
• Ability to communicate effectively and to facilitate discussions at the senior level with government officials and the development community;
• Excellent command of written and spoken English;
• Knowledge of Bangla language (spoken and/or written) an advantage; and
• Excellent computer skills (Word, Excel, PowerPoint, Internet).

Education:

• Post-graduate degree (Masters or higher level) with a focus on development studies, economics, environmental management or other relevant discipline.

Experience:

• At least 10 years of relevant experience in carrying out high level analytical work on environmental governance, development policies and programmes. Preferably 5 years of this work was in South Asia;
• Experience of working in developing countries, preferably South Asia;
• In-depth understanding of common issues faced by Bangladesh or other Asia economies in their development planning processes and environmental governance;
• Thorough understanding of key elements of results-based programme management;
• Extensive experience in project development including familiarity with full project cycle process.

Evaluation of Candidates:

Individual consultants will be evaluated based on the weighted scoring method, the award of the contract will be made to the individual consultant whose offer has been evaluated and determined as:
  a) Responsive/compliant/acceptable, and
  b) Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation.

**Only candidates obtaining a minimum of 70% marks in the Technical Evaluation will be considered for further Financial Evaluation

Technical Evaluation Criteria (Total 70 marks)

• Experience in carrying out high level analytical work on environmental governance, development policies and programmes - 20 marks
• Experience of working in developing countries, preferably South Asia - 15 marks
• Thorough understanding of key elements of results-based programme management - 15 marks
• Extensive experience in project development including familiarity with full project cycle process - 20 marks

Financial Evaluation (Total 30 marks)

All technically qualified proposals will be scored out 30 based on the formula provided below. The maximum points (30) will be assigned to the lowest financial proposal. All other proposals receive points according to the following formula:
p = y (μ/z)
Where:
p = points for the financial proposal being evaluated
y = maximum number of points for the financial proposal
μ = price of the lowest priced proposal
z = price of the proposal being evaluated