IC: Project Evaluation

Brief project description:
 
GEF Strategic Priority2 - Mainstreaming Biodiversity Conservation in Production Landscapes/Seascapes and Sectors:

• Start Date:  May 2005
• Project End Date: 31 December 2011
• Management Arrangements: National Execution
• Executing Agency: Ministry of Nature, Environment and Tourism

Budget:

• GEF - US$ 2,720,000
• The Netherlands Government - US$ 1,865,672
• UNDP - US$ 248,788
• Total  - US$  4,834,460

Project Sites:

• 4 aimags, 20 soums
• Khovd Aimag (Must, Tsetseg, Altai, Monkhkhairkhan soums)
• Bayan Ulgii   (Tsengel, Altai, Ulaankhus, Deluun, Sagsai, Nogoonnuur) 
• Uvs Aimag (Turgen, Sagil, Khovd, Bukhmurun, Tarialan, Ulaangom)
• Khovsgol Aimag (Tsagaannuur, Renchinlhumbe, Ulaan Uul soums, Khatgal village)

Project context:
 
Biodiversity is shrinking at a worrying pace all around the world and Mongolia is no exception. The Altai Sayan Ecoregion consists of the Altai and Sayan Mountains (see map) and is designated a WWF-200 global Ecoregion; one of the key Ecoregions to host remaining biodiversity hotspots in the world. It covers 4 countries, with the majority of the area in Russia, then Mongolia, Kazakhstan and China. Important species in this area include the snow leopard, argali wild sheep, ibex goat, musk deer and taimen fish. The area is sparsely populated and is the home of many minority groups.
 
To improve conservation of the biodiversity in this area, Mongolia’s Ministry of Nature, Environment and Tourism (MNET) is cooperating with UNDP on a community based conservation project in 4 Aimags (provinces); Khovsgol, Khovd, Uvs and Bayan Olgii. There are 20 target sites. With project support, herders are forming groups, to work together on conservation but also to empower them and improve their economic situation. Many herders reside in or near the habitats of important species and pressure from grazing is one of the main threats to species in the area, next to hunting, logging, the development of mining and infrastructure, and climate change. Local governments and protected areas area also involved in the project and supported to improve coordination and planning and to work more with local communities. On the national level the project supports MNET to develop improved policies on community based conservation and to establish transboundary conservation agreements.
 
In 2008 the project Mid-Term evaluation recommended some substantive changes in the project logical framework and management structure. From 2009 these changes were implemented, resulting in a new logical framework with fewer outcomes, outputs and clear targets and indicators.

Scope of Work.
 
The evaluation is initiated and commissioned jointly by UNDP/Mongolia country office. According to the GEF M&E evaluation program, medium and full size project is required to undergo a terminal evaluation upon completion of implementation.
 
The evaluation will assess the progress and achievements against the project’s logical framework. In addition, it will analyze adaptation to changing conditions (adaptive management), partnerships in implementation arrangements, changes in project design, overall project management main findings and key lessons including examples of best practices for future projects in the country, region and GEF. The results of the evaluation will be reviewed by the GEF Evaluation Unit and will be subsequently incorporated in the annual Project Implementation Review (PIR) to complement findings of other M&E exercises.
 
The Final Evaluation document has to provide an analysis of the attainment of global environmental objectives, outcomes/impacts, project objectives, and delivery and completion of project outputs/activities (based on indicators).  Evaluation of project achievements according to GEF Project Review Criteria:

• Implementation approach
• Country ownership/Driveness
• Stakeholder participation/Public Involvement
• Sustainability
• Replication approach
• Financial planning
• Cost-effectiveness
• Monitoring and evaluation

In addition, the Final Evaluation should present and analyze main finding and key lessons, including examples of best practices for the future project in the country, region and GEF. Evaluation should also have an annex explaining any differences or disagreements between the findings of the evaluation, the Implementing Agency/Executing Agency or the recipient organization.
 
The Final Evaluation should include but not limited to ratings on the following criteria:

• Project effectiveness, (Outcomes/Achievements of objectives, or the extent to which the project’s environmental and development objectives were achieved).
• Implementation Approach.
• Stakeholder Participation/Public Involvement.
• Cost-effectiveness.
• Sustainability
• Monitoring & Evaluation.

The ratings are classified as:

• Highly Satisfactory
• Satisfactory
• Marginally Satisfactory
• Unsatisfactory
• N/A.   

In addition, the following specific questions need to be researched:

• Did the project achieve the targets as set out in the logical framework?
• To which extent did the project contribute to the objective?
• To which extent are the structures that have been supported by the project expected to endure after the project ends?
• What was the progress made in policy development of Community Based Natural Resource Management and Landcscape based conservation?
• How did the attitude towards conservation change between the start and end of the project?
• How did key species develop since the project started?

Methodology of Evaluation:
 
The methodology that will be used by the evaluation team should be presented in detail. It may include the following information:

• Desk review of relevant documents (project document, Annual Project Reports, mid-term evaluation report, other relevant documents)
• Interviews
• Field visits
• Questionnaires
• Participatory techniques and other approaches for the gathering and analysis of data.
• Draft the report and make a presentation of findings and recommendations.
• Finalize the report with comments and inputs from various stakeholders.
• Outputs
• Initial workplan
• Draft evaluation report (in line with UNDP/GEF evaluation guidelines)
• Final evaluation report (in line with UNDP/GEF evaluation guidelines)

Management Arrangement:

The consultant will be responsible for arranging the travel to and from Mongolia. UNDP CO in Mongolia take care of the visa, logistics arrangements, field visits and meeting programme. In addition, Project staff will accompany the mission to gather basic data, set up meetings, identify key individuals, assist with planning and logistics, and generally ensure that the evaluation is carried out smoothly.
 
A team of two independent evaluators will conduct the evaluation. The evaluators selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities. The evaluation team will be composed of one International Team Leader and one National Expert. The evaluators should have prior experience in evaluating similar projects. Former cooperation with GEF is an advantage.
 
The selection of consultants will be aimed at maximizing the overall “team” qualities in the following areas:

• Recent experience with result-based management evaluation methodologies.
• Experience applying participatory monitoring approaches.
• Experience applying SMART indicators and reconstructing or validating baseline scenarios.
• Recent knowledge of the GEF Monitoring and Evaluation Policy.
• Recent knowledge of UNDP’s results-based evaluation policies and procedures.

Evaluation criteria and weight: 

Experts will be evaluated against combination of technical and financial criteria. Technical component shall weigh 70% and financial part – 30%.
 
As for the technical evaluation, the following aspects will be considered:

• Educational background 15%
• Previous experience with evaluations 30%
• Previous experience with community based natural resource management 30%
• Experience in Mongolia 10%
• Required language and other technical skills 15%

Duration of the Work:

• One month, starting 15 August 2011

 
The assignment will follow the following working schedule:

• Desk review:15 - 16 August
• Travel to Mongolia: 17 August
• Briefings for evaluators: 18 August
• Field visits, interviews, questionnaires, de-briefings: 20-30 August
• Finalisation of draft report and debriefing with UNDP and the MNET: 1 – 9 September
• Return travel from Mongolia: 10 September
• Finalisation of final report from homebase: 12-14 September.

Application procedure: Qualified and interested candidates are requested to apply on-line through this site.  The application should contain:

• Completed P11 form or a detailed CV - http://sas.undp.org/Documents/P11_Personal_history_form.doc
• Brief cover letter addressing the requirements stated
• Proposed methodology and workplan (max 1 page)
• Financial proposal - the financial proposal should have a breakdown of consultancy fee and all travel-related costs that are expected to be incurred. While preparing your proposal, kindly note that the standard for air travels authorized by UNDP for individual subscribers is economy class.

Payment modality and schedule - The UNDP standard method of payment is the output-based lump-sum scheme and the payment will be made in two installments upon satisfactory completion of the above deliverables:

• 1st installment – 50% upon the approval/clearance of the draft report
• 2nd installment – 50% upon satisfactory completion of all services.

• Sound analytical and organizational skills.
• Good understanding of community based conservation concept .
• Capacities for strategic thinking and planning.
• Excellent participatory process skills.
• Competence in Adaptive Management, as applied to capacity development natural resource management.
• Demonstrable analytical skills.
• Good interpersonal and communication skills
• Computer literacy including MS Word, Excel, PowerPoint.

Education:

• Minimum Masters Degree in environmental science, biology, geography or related field.

Experience:

• At least 10 years of work experience in relevant areas.
• Project evaluation experiences within United Nations/GEF Projects will be considered as an asset.
• Previous experience of working in Mongolia is an asset.

Language:

• Excellent English communication skills.