This project has been implemented since the end of 2008 and is expected to be completed in 2012. The project is nationally executed by the State Agency for Architecture and Construction under the Government of the Kyrgyz Republic. The project aims at reducing energy consumption and associated Green House Gas emissions in the Kyrgyzstan building sector by 30-40% as compared to the current level.
This Mid Term Evaluation (MTE) is initiated by UNDP Kyrgyzstan as the Implementation Agency for this project and it aims to provide managers (at the Project Implementation Unit, UNDP Kyrgyzstan Country Office and UNDP-GEF levels) with strategy and policy options for more effectively and efficiently achieving the project’s expected results and for replicating the results. It also provides the basis for learning and accountability for managers and stakeholders.
The MTE is intended to identify potential project design problems, assess progress towards the achievement of objectives, identify and document lessons learned (including lessons that might improve design and implementation of other UNDP-GEF projects), and to make recommendations regarding specific actions that might be taken to improve the project. It is expected to serve as a mean of validating or filling the gaps in the initial assessment of relevance, effectiveness and efficiency obtained from monitoring. The MTE provides the opportunity to assess early signs of project success or failure and prompt necessary adjustments.
The evaluation will play a critical role in the future implementation of the project by providing advice on: how to strengthen the adaptive management and monitoring function of the project; how to ensure accountability for the achievement of the GEF objective; how to enhance organizational and development learning; and how to enable informed decision–making.
The evaluation should provide to the GEF Secretariat with complete and convincing evidence to support its findings/ratings. The evaluator should prepare specific ratings on specific aspects of the project, as described in the section IV of this Terms of Reference. Particular emphasis should be put on the current project results and the possibility of achieving the objective and outcomes in the established timeframe, taking into consideration the speed, at which the project is proceeding.
|
- To assess overall performance against the project objective and outcomes as set out in the Project Document, the project’s Logical Framework, and other related documents;
- To assess the effectiveness and efficiency of the project;
- To analyze critically the implementation and management arrangements of the project;
- To assess the progress to date towards achievement of the outcomes;
- To review planned strategies and plans for achieving the overall objective of the project within the timeframe;
- To assess the sustainability of the project’s interventions;
- To list and document initial lessons concerning project design, implementation and management;
- To assess project relevance to national priorities;
- To provide guidance for the future project activities and, if necessary, for the implementation and management arrangements;
- To provide lessons learned for the future.
In particular, this evaluation will assess progress in establishing the information baseline, and identifying any difficulties in project implementation and their causes, and recommend corrective course of action. Effective action to rectify any identified issues hindering implementation will be a requirement prior to determining whether implementation should proceed.
Project performance will be measured based on the Project’s Logical Framework Matrix, which provides clear performance and impact indicators for project implementation along with their corresponding means of verification. Success and failure will be determined in part by monitoring changes in baseline conditions. During the inception period the Logical Framework Matrix has been updated, along with a number of indicators which were revised to render more clarity and rigidity to the system.
The evaluation team is expected to work with key project stakeholders, including the UNDP Country Office in Kyrgyzstan, the State Agency for Architecture and Construction under the Government of the Kyrgyz Republic, Bishkek and Osh City Municipalities, the National Agency on Local-self Governance, th e Agency on Environment Protection and Forestry, and members of the Project Advisory Board.
|
The evaluation will be undertaken by a team composed of an International Consultant (Team Leader) and a Local Consultant. They will receive the support of the UNDP Country Office in Kyrgyzstan and Project Management Team, and will be assisted by a translator/interpreter.
The evaluators selected should not have participated in the project preparation and/or implementation and should not have a conflict of interest with project related activities.
The International Consultant (Team Leader) will be responsible for delivering the expected output of the mission. Specifically, he/she will perform the following tasks:
- Lead and manage the evaluation mission;
- Design the detailed evaluation methodology and plan;
- Conduct desk-reviews, interviews and site-visits in order to obtain objective and verifiable data to substantive evaluation ratings and assessments;
- Draft the evaluation report and share with the key stakeholders for comments;
- Finalize the evaluation report based on the inputs from key stakeholders.
|