Three main elements to be evaluated are Delivery, Implementation and Finances. Each component will be evaluated using three criteria: Relevance, effectiveness, efficiency and timeliness
Project delivery:
The MTE will assess to what extent the HHRB project has achieved its immediate objectives. It will also identify what outputs, impacts and results have been produced and how they have enabled the project to achieve its objectives. The consultants are required to make assessment of the following issues under each priority area outlined below:
Institutional arrangement :
- Preparatory work and implementation strategies
- Consultative processes
- Technical support
- Capacity building initiatives
- Project outputs
- Assumptions and risks
- Project related complementary activities
Outcome, results and impacts:
- Efficiency of all project activities under the three major components
- Progress in the achievement of the immediate objectives (include level of indicator achievement when available)
Partnerships: Assess the following:
- National level involvement and perception
- Local partnerships, and involvement of stakeholders
- Collaboration between government, intergovernmental and non-governmental organisations
Risk management:
- Were problems/constraints, which impacted on successful delivery of the project identified at the project design stage and implementation?
- Were there new threats/risks to project success that emerged during project implementation?
- Were both kinds of risk appropriately dealt with?
Monitoring and Evaluation:
- Assess the extent, appropriateness and effectiveness of adaptive management at all levels of the project implementation
- Has there been a monitoring and evaluation framework for the project and how was this developed?
- Is the reporting framework effective/appropriate?
- Is this framework suitable for replication/continuation by the end of the project?
Project Implementation:
- Review the project management and implementation arrangements at all levels, in order to provide an opinion on its efficiency and cost effectiveness. This includes:
Processes and administration:
- Project related administration procedures
- Milestones(Log-frame matrix)
- Key decisions and outputs,
- Major project implementation documents prepared with an indication of how the documents and reports have been useful
- Project oversight and active engagement by UNDP and project steering committee
- Project execution: Xinyang Municipal Government as the executing agency and project sub-executing agencies
- Project implementation: UNDP as the Implementing Agency
Project Finances:
How well and cost effectively have financial arrangements of the project worked? This section will focus on the following three priority areas:
- Project disbursements
- Provide an overview of actual spending against budget expectations
- Critically analyse disbursements to determine if funds have been applied effectively and efficiently.
Budget procedures
- Did the Project Document provide adequate guidance on how to allocate the budget
- Review of audits and any issues raised in audits and subsequent adjustments to accommodate audit recommendations;
- Review the changes to fund allocations as a result of budget revisions and provide an opinion on the appropriateness and relevancy of such revisions
- Coordination mechanisms
- Evaluate appropriateness and efficiency of coordinating mechanisms between Implementing agency and executing agency, UNDP and Xinyang Municipal Government
- Does the HHRB approach represent an effective means of achieving the objectives
- How can the approach be improved
|