SEA Change Webinar "Monitoring and Evaluation of Climate Change Adaptation Interventions: What Can We Learn From Existing CCA M&E Frameworks and Principles?" - Presentation Slides.

With financial support provided by the Rockefeller Foundation and technical and logistical support from Pact.
http://www.seachangecop.org
11th SEA Change webinar 1st webinar in the 2013 series!
Monitoring and Evaluation of Climate Change Adaptation:

What can we learn from existing
CCA M&E Frameworks / Principles?
BY DENNIS BOURS, TEAM LEADER OF THE SEA CHANGE COMMUNITY OF PRACTICE, 15TH OF FEBRUARY 2013 - 16:00 BANGKOK/JAKARTA TIME (ICT / UTC+7), 09:00 LONDON (UTC)
http://www.seachangecop.org/node/1480
Monitoring and Evaluation of Climate Change Adaptation: What can we learn from existing CCA M&E Frameworks / Principles?
11th SEA Change webinar 1st webinar in the 2013 series! Dennis Bours (Dbours@pactworld.org)
Team Leader SEA Change CoP
11th SEA Change webinar 1st webinar in the 2013 series! Paul Bacon (Pbacon@pactworld.org)
M&E Expert SEA Change CoP
Logistics of this webinar session

40 to 45 minutes of presentation
20 to 30 minutes of Q&A session

The Q&A session

During the Q&A, please click on the Raise Hand icon or simply type the question(s) in the Question window
* Webinar facilities will unmute microphones for attendees who have raised their hand and would like to ask their question verbally.
Monitoring and Evaluation of Climate Change Adaptation:

What can we learn from existing
CCA M&E Frameworks / Principles?
UNDP Proposed Framework for Monitoring Adaptation to Climate Change (UNDP, 2007-2008)
http://www.seachangecop.org/node/139 http://www.seachangecop.org/node/140
1
Advantages
UNDP Proposed Framework for Monitoring Adaptation to Climate Change (UNDP, 2007-2008) Disadvantages Framework doesnt follow a clear step-bystep approach (i.e. where the user would start and finish etc) Not much mention of possible timeframes for applying the evaluation framework
Well established framework, used by UNDP since 2007 (but still unpublished) Good consideration of particular CCAI contexts, situations and policy/program levels Follows LFA, including MDG goals Indicators provided good specific examples that can be readily applied Specific Applicability
Focusing on National Adaptation Programmes of Action (NAPAs) under Special Climate Change Fund (SCCF) and resilience under the Least Developed Countries Fund (LDCF); Could apply to broad, well established development multi/bi-lateral programs in various sectors that need to consider some candidate indicators for CCAI (although of course these should be carefully considered and not just cosmetically bolted on) http://www.seachangecop.org/node/139 http://www.seachangecop.org/node/140
IDS Sussex GEF DFID: Evaluation of Adaptation to Climate Change from a Development Perspective (IDS Sussex, GEF-EO, DFID, 2008)
2
Advantages
IDS Sussex GEF DFID: Evaluation of Adaptation to Climate Change from a Development Perspective (IDS Sussex, GEF-EO, DFID, 2008) Disadvantages Actual framework only drops out at the end of the document, and is not really clear on the steps to be followed by the user Indicators are given for all intervention levels, but their number is quite limited
Good explanation of adaptation theory (including maladaptation) and synthesis of other frameworks Guides users through a full consideration process of important aspects of CCAI Useful pyramid diagram of international to household levels with accompanying candidate indicators for these levels Specific Applicability
The descriptions for community and household levels could be useful for application at these levels (as these are not seemingly included to such detail in some of the other frameworks)
Synthesis report on efforts undertaken to monitor and evaluate the implementation of adaptation projects, policies and programmes and the costs and effectiveness of completed projects, policies and programmes, and views on lessons learned, good practices, gaps and needs (UNFCCC, 2010)
Synthesis report on efforts undertaken to monitor and evaluate the implementation of adaptation projects, policies and programmes and the costs and effectiveness of completed projects, policies and programmes, and views on lessons learned, good practices, gaps and needs (UNFCCC, 2010) Disadvantages
Advantages
Gives guidance on how to develop and use adaptation indicators Recognizes different policy/program levels Links to the work of the GEF and UKCIP on M&E and the UNDP on VRA
Not a distinct framework and no step-bystep approach towards implementation Very limited number of high-level process-indicators given Lessons learned and good practice page comes to some conclusions that leave room for misinterpretation, and no real new lessons learned are introduced
Specific Applicability Good to scan through, but ideas and guidance presented can be very broadly applied.
Tracking progress for effective action: A framework for monitoring and evaluating adaptation to climate change (GEF Climate-Eval, 2011)
4
Advantages
Tracking progress for effective action: A framework for monitoring and evaluating adaptation to climate change (GEF Climate-Eval, 2011) Disadvantages Not a distinct framework/methodology with steps as such
Strong background document with good synthesis and consideration of previous frameworks (including UNDP, UNFCCC, IDS Sussex) A good overview of most of the indicators presented in previous reports Presents a number of guiding questions to develop a foundation for a CCAI M&E framework Useful set of nine national climate change adaptation frameworks / NAPAs
Specific Applicability
An essential pre-requisite read before starting to develop your own CCAI framework
Learning to ADAPT: monitoring and evaluation approaches in CCA and DRR challenges, gaps and ways forward (SCR, 2011)
5
Advantages
Learning to ADAPT: monitoring and evaluation approaches in CCA and DRR challenges, gaps and ways forward (SCR, 2011) Disadvantages
A lot of conceptual thinking drawn out by Possibly hard to implement maybe too following the framework broad and time consuming in practice Interesting recap of current approaches, At times more conceptual than practical split by M&E methodology Indicators need to be ADAPT, but no Interesting approach with the ADAPT actual ADAPT candidate indicators are principles for generating CCAI indicators presented and developing a CCAI M&E framework
Specific Applicability Could apply parts of the framework to broad, well established development multi/bilateral programs in various sectors that need to consider some candidate indicators for CCAI (similar to the UNDP framework)
IIED Climate Change working paper 1: Tracking adaptation and measuring development (IIED, 2011)
IIED Climate Change working paper 1: Tracking adaptation and measuring development (IIED, 2011)
6
Advantages
IIED Climate Change working paper 1: Tracking adaptation and measuring development (IIED, 2011) Disadvantages Doesnt cover all aspects of CCAI, reader would need a good understanding of this before using the framework Not much on M&E Learning No indicators presented, and limited guidance on the development of indicators No step-by-step approach for implementation of the framework
Very readable and clear document, easy for the reader to get a quick grasp of the essentials of the framework Should be relatively easy to apply in various contexts Report split into clear background / framing part and evaluation framework section Specific Applicability
Preferably programmes that either are at a local or sub-national level, but part of a national strategy. Or programmes that are focusing on a higher level (policy development), and incorporate the concept of developing activities on lower levels as part of the policy being developed
Making adaptation count: Concepts and options for monitoring and evaluation of climate change adaptation (GIZ, WRI, 2011)
Making adaptation count: Concepts and options for monitoring and evaluation of climate change adaptation (GIZ, WRI, 2011)
7
Advantages
Making adaptation count: Concepts and options for monitoring and evaluation of climate change adaptation (GIZ, WRI, 2011) Disadvantages
Very good attempt at providing a practical framework after some useful discussion of M&E for CCAI Clear, step by step methodology including Theory of Change component and good explanations for choosing indicators and establishing baselines Focused on M&E learning Mention of integration with existing indicators and M&E system components
Specific Applicability
You need a good M&E understanding to appreciate the document to the full (not necessarily a disadvantage) Maybe insufficient discussion on consideration of M&E levels (i.e. global, national, sub-national, local, community, household level)
Should be able to be applied to various contexts by experienced M&E practitioners
AdaptME Toolkit for monitoring and evaluation of adaptation activities (UKCIP, 2011)
AdaptME Toolkit for monitoring and evaluation of adaptation activities (UKCIP, 2011)
8
Advantages
AdaptME Toolkit for monitoring and evaluation of adaptation activities (UKCIP, 2011) Disadvantages Little explanation or consideration of CCAI background in the framework Generic, and not really clear how long would take to complete the 10 steps for a CCA situation in reality
10 clear steps following LFA, that should be easy to trial LFA example presented and discussed Differences presented between building adaptive capacity and delivering adaptation action Links to reference documents per topic Good integration of M&E learning into the framework Specific Applicability
A useful step by step approach, following the LFA, to apply once the overall CCAI context has been analysed, documented and understood. Its probably the model that is a true ready to go tool http://www.seachangecop.org/node/116 http://www.seachangecop.org/node/519
- A moment to reflect -
Summarizing Most of these CCAI M&E frameworks / approaches discussed are virtually untested in the field / for particular sectors, and if they have been used results have often not been shared It is difficult to really compare them as they apply to different size CCA scenarios and though most are multi-level, they apply best to certain program/policy levels They are generally complex and introduce several monitoring & evaluation concepts in the same framework package There is little mention of likely implementation timeframes when attempting to apply them There is generally not much how to in the frameworks (i.e. the particular steps to readily apply the framework to the CCAI) A few mention M&E learning, which is positive, but again this is untested and CCAI bring particular M&E learning challenges.
Key issues involved in evaluating CCAI
1. Different definitions of adaptation - What is adaptation? - Decision-process vs. Actions vs. Outcome - Process oriented adaptation vs. Result oriented adaptation - Action linked to outcome vs. Action linked to social learning - And what is successful adaptation? 2. Adaptation and adaptive capacity - Does adaptation lead to increased adaptive capacity? - Does increased adaptive capacity lead to increased ability to adapt? - Determinants are diverse and gathering information on these, measuring change, can be extremely challenging.
Key issues involved in evaluating CCAI 3. Types of adaptation - Changing natural resource management / agricultural practices - Building institutions; creating new and strengthening existing - Launch planning processes - Raising awareness - Promoting technology change - Establishing monitoring / early warning systems - Empowering people / income generating opportunities for adaptation - Promoting policy change; establishing new and adjusting existing - Improving infrastructure (roads, seawalls, water and irrigation systems) - Providing social protection - Assisted climate migration - Climate-smart disaster management
4. Successful adaptation - Effectiveness: achieving objectives - Flexibility: How far can we adapt? - Equity: Inequality dimensions to adaptation - Efficiency: Cost-effectiveness - Legitimacy: Acceptance by all stakeholders - Sustainability: The wider implications of adaptation, beyond the project 5. Dealing with maladaptation - What are the risks of vulnerability not reducing, but increasing? - Processes are not linear and stagnation or reversal might be possible in the rout to long-term success - Do short-term successes guarantee long-term successes?
6.
The nature of adaptation - Long timescales associated with climate change - The moving baseline presented by climate - The mix of hazards and opportunities - Multi-sectoral nature of adaptation, involvement of different partners at different scales Attribution Decoupling climate change risks from other drivers and stressors is very difficult. And at times perhaps impossible. Calibration Trying to assess the impact of an adaptation intervention against the backdrop of changing hazard profiles.
7.
8.
SEA Change is a Community of Practice that develops a culture of

high quality and rigorous M&E frameworks, approaches and
methodologies for climate change interventions and practices in

Asia, and beyond.

SEA Change Webinar "Monitoring and Evaluation of Climate Change Adaptation Interventions: What Can We Learn From Existing CCA M&E Frameworks and Principles?" - Presentation Slides.

Cargado por

Información del documento

Título original

Derechos de autor

Formatos disponibles

Compartir este documento

Compartir o incrustar documentos

Opciones para compartir

¿Le pareció útil este documento?

¿Este contenido es inapropiado?

Copyright:

Formatos disponibles

SEA Change Webinar "Monitoring and Evaluation of Climate Change Adaptation Interventions: What Can We Learn From Existing CCA M&E Frameworks and Principles?" - Presentation Slides.

Cargado por

Copyright:

Formatos disponibles

With financial support provided by the Rockefeller Foundation and technical and logistical support from Pact.

11th SEA Change webinar 1st webinar in the 2013 series!

Monitoring and Evaluation of Climate Change Adaptation:

CCA M&E Frameworks / Principles?

11th SEA Change webinar 1st webinar in the 2013 series!

Team Leader SEA Change CoP

M&E Expert SEA Change CoP

11th SEA Change webinar 1st webinar in the 2013 series!

Logistics of this webinar session

20 to 30 minutes of Q&A session

The Q&A session

11th SEA Change webinar 1st webinar in the 2013 series!

Monitoring and Evaluation of Climate Change Adaptation:

CCA M&E Frameworks / Principles?

Should be able to be applied to various contexts by experienced M&E practitioners

Key issues involved in evaluating CCAI

Key issues involved in evaluating CCAI

Key issues involved in evaluating CCAI

SEA Change is a Community of Practice that develops a culture of

methodologies for climate change interventions and practices in

También podría gustarte