Summary of GEF 4th International Waters Conference
Peer-to-Peer Assist Clinic on Results Framework and Indicators
Day 3; Thursday August 2, 2007
Diagnostic tools:
o “Monitoring and Evaluation Indicators for GEF International Waters Projects”, Monitoring and Evaluation Working Paper number 10, November 2002
o Focal Area Strategy for GEF International Waters (draft 8), June 2007
o GEF Evaluation Office paper on harmonization of indicator terminology across GEF implementing and executing agencies, Aaron Zazueta as reference
Table 1 – hosted by Tracy Hart, World Bank
Query #1
Q: How do you translate specific project indicators into generic Strategic Priority indicators so that GEF can “roll them up”?
A: It is useful to make a “shadow” table to include as an Annex in your GEF documentation which maps the project logframe to the GEF OP/SP generic indicators requested to report on, so as to give GEF an explicit road map to use to should those involving in logframe design leave the project.
Query #2
Q: The TDA/SAP phase 1 projects often include Parliament approval of the TDA as a key indicator for moving from Phase 1 to Phase 2 (SAP implementation). However, in design phase, this indicator is often underspecified in terms of the amount of time and financing it takes to get TDA approval through multiple countries in Parliament. How can a project jump or otherwise bypass this hurdle?
A: This is a difficult question, and not directly related to results frameworks/indicators. Most GEF CTAs/project managers responsible for delivering on this are not politicians, and this is a political-based outcome. One piece of advice is to bring in the GEF focal point to help deliver on this. Another is to convince ministerial parties and governments that this is their outcome to deliver and not the PMU’s. (Peer-to-peer assist aided by Dnipro Basin)
Query #3:
Q: How and when can we expect agencies to move towards a consolidated use of the same terminology?
A: The GEF Evaluation Office has commissioned a study on the framework/indicators terminology across all implementing and executing agencies. An initial recommendation of the study is the adoption of OECD terminology as a common framework.
Query #4:
Q: How do you translate generic GEF project indicators into specific project- or program-based indicators so that countries can own them and adopt them through and beyond the lifetime of GEF funding?
A: (i) Only choose the subset of them that apply to your project (ii) Tailor them as specifically as possible to your ecosystem (iii) Supplement them with additional indicators outside the GEF IW framework if suitable.
Query #5:
Q: What do you do if basin-level baseline data is “true” and national-level baseline data is “suspect”?
A: This may appear to be an indicators issue, but it is a trust-building exercise waiting to happen. The first step is to start with a consultation mechanism for data standardization for technical staff across the relevant national ministries. Then each country has to provide a means for input into a regional-level mechanism. The basin level institution builds a basin-level model with basin-level data that provides some independent means of data verification. Once this basin level model is developed in parallel with the basin-level trust-building exercises, both capacities are transferred up to decision-makers. (Peer-to-peer assist aided by Nubian and Illumeden Aquifers)
Query #6:
Q: How can different countries have access to basin-level indicators and data, as well as each other’s data?
A: A joint (ecosystem-based) authority can build a mechanism that allows access to be able to share data. This can be through a monitoring network or databank that is either a pre-existing or new mechanism. Often GEF projects add new layers (socio-economic and environmental impacts) to an existing regional hydrological database and increase regional willingness to share such data. (Peer-to-peer assist aided by Nubian Aquifer)
Query #7:
Q: How can national and regional levels intersect in developing indicators for a project?
A: One such example is to use the ecosystem institution to employ national-level staff whose responsibilities include, in part, roles as links for M&E cooperation from the focal Ministry from their respective countries. In the case of the Niger River Basin, the Executive Secretariat hosts a GEF Focal Point from each of nine countries, who represents the Ministry of Environment from each country, and can link back into the MoE M&E system in that country in term of fostering M&E cooperation in the development of long-term indicators for the basin. (Peer-to-peer assist aided by Niger River Basin)
Table 2 – hosted by Nicolas Kotschoubey, World Bank
Participants and Queries:
Chris Corbin, UNEP (Caribbean projects)
Alex Cooman (Caribbean projects): projects were initiated in 1989; indicators either no longer relevant, or were inadequate to begin with. Original staff no longer on project. How to set indicators if data are practically inexistent?
Johan (South Africa EPA / BCLME): would like to learn more on indicators and logframe;
Dahlia (WB)Ms Jeung Sook (Korea)
Mr Jae-Young Shin (Yellow Sea): trying to develop awareness in the artisanal community; use awareness raised and change of behavior as indicators of project success;
Nic Kotschoubey (WB): have program-based indicators, broken down into project-based indicators
Other points made:
- project-level indicators should contribute to program-level or regional-level indicators
- To facilitate M&E, incorporate your M&E into a bigger (national) M&E program.
- Don’t use too many indicators
- Include launch workshop at operational level to disclose logframe to clarify each role
- there is a grey area sometimes between outcomes and outputs
- if no baseline exists, the objective could be to establish a baseline, and the indicator could be “baseline established” (a process indicator)
- Lack of data should not stop you from doing a project
Requests
- the group would like greater funding by GEF to establish baselines
Questions
- What indicators can wee use to measure water quality in very remote areas? Perhaps suspended solids as in Guinea for the Niger Basin as single indicators of water quality
- Does GEF fund laboratories?