Annual Outcome Survey

Training Workshop Prepared by DEPOCEN

Bac Kan Province, Vietnam April, 2011

First thing first

Greetings Working agenda Purpose Expected outcome Working format Lectures (short) Hand-on experience Group discussion and group work Working schedule Annual Outcome Survey

Working agenda
Purpose Conduct an Annual Outcome/Impact Survey for Backan Training and capacity building for all other provinces Expected outcome Standard and typical Annual Outcome/Impact survey for Backan Findings from this survey would assist the implementation of IFAD project in Backan (corrective action) M&E officers are able to replicate and adapt similar Annual Outcome Survey in their provinces with minimal support from DEPOCEN

Working format
Lectures (a series of short lectures on selected topics) Hand-on experience Sampling Sample design Sampling construction Questionnaire design/modification Based on log-frame of Backan project to modify the standard IFAD questionnaire to suite with Backan situation Fieldwork interviews First hand experience in conducting fieldwork Data entry and data analysis Group discussion and group work Fieldwork group Data group

Working schedule
See the attached agenda for detailed information Day 1: Sample design and selection Day 2: Questionnaire design Day 3: Fieldwork training and data entry Day 4-12: Fieldwork implementation and data entry under direct supervision by DEPOCEN

Consideration for conducting the survey

1. Best case scenario: quasi-experimental design
T0: programme group Baseline C0: control group T1: programme group Follow-up
C1: control group

intervention

Ti and Ci : measurable characteristic of the population, i = time of observation (0,1).

Annual Outcome Survey and RIMS

RIMS is a comprehensive system for measuring, aggregating, and reporting on the results and impact of IFAD supported country programmes and projects; RIMS is made up of a standardized list of common indicators that could be applied across all IFAD projects and programmes: Report and
1st level indicators (outputs); 2nd level indicators (outcomes); 3rd level indicators (impact) M&E system Annual Outcome survey

RIMS Impact survey

1st and 2nd level Indicators

First level indicators (outputs)
People trained in infrastructure management People trained in improved agricultural practices Kilometers of road constructed Annual Outcome survey

Second level indicators (outcomes)

Community groups manage infrastructure in a sustainable way Acres of land under improved agricultural practices Community is using the road to market their produces

Project Results-Chain

1st LEVEL RESULTS [OUTPUTS]

RIMS 1 level Indicators
st

2ND LEVEL RESULTS [OUTCOMES]

RIMS 2nd level Indicators

IMPACT

RIMS 3rd level Indicators

3rd level Indicators (RIMS Impact Survey)

MDGs Goal 3 Eradicate : extreme poverty and hunger Goal 3 Achieve : universal primary education Goal 3 Promote : gender equality and empower women Goal 3 Combat : HIV/AIDS, malaria and other diseases Goal 3 Ensure : environmental sustainability
rd RIMS 3 level (impact) Indicators Households with improvement in household assets ownership index, based on additional assets (productive assets, improved housing, etc.)* Reduction in the prevalence of child malnutrition* Net enrolment ratio in primary education

Literacy rate (by gender) Ratio of literate females to males Reduction in the incidence of infectious disease (HIV/AIDS, malaria, tuberculosis) People with access to improved sanitation People with sustainable access to an improved source of water (drinking water)

* Mandatory for all projects under RIMS (Anchor Indicators)

RIMS survey

Annual Outcome Survey & Logical Framework

Narrative Summary Goal (Impact) Purpose (Outcomes) Outputs Activities Objectively Verifiable Indicators* (incl. RIMS 3rd level results indicators) (incl. RIMS 2nd level results indicators) (incl. RIMS 1st level results indicators) Means of Verifications Assumptions

Inputs

LFs include other indicators that are not specified under RIMS

Annual Outcome Survey & Logical Framework

Objective hierarchy Goal (Impact) Purpose (Outcomes) Outputs Project Logic Improved food security of 50% households in X area 70% of the farmers adopted sustainable agricultural practices 700 farmers received training on sustainable agricultural techniques Conduct 5 training on sustainable agricultural techniques

Activities (Process) Inputs

Staff, Resources

Annual Outcome Survey & Logical Framework

Objective hierarchy Goal (Impact) Indicators % households in X area reports increased food adequacy % households in X area reports increased dietary diversity % of farmers adopted sustainable agricultural practices # of farmers received training on sustainable agriculture

Purpose (Outcomes) Outputs

Activities (Process) Inputs

# of training on sustainable agriculture organized Staff, Resources

Annual Outcome Survey & Logical Framework

Objective hierarchy Goal (Impact) Purpose (Outcomes) Outputs Project Logic Reduction in diarrheal incidence in X area 80% of the HHs use safe water in all purposes 70% of HHs practice improved personal hygiene 65% of HHs use sanitary latrine 200 women received counseling on safe water, personal hygiene and sanitary practices 160 households received subsidized latrine Conduct 15 counseling sessions on the importance of safe water, personal hygiene & sanitation Distribute 160 sanitary latrines at a subsidized cost Staff, Resources

Activities (Process) Inputs

Annual Outcome Survey & Logical Framework

Objective hierarchy Goal (Impact) Purpose (Outcomes) Outputs Indicators % of HHs report diarrheal incidence in the last two weeks % of the HHs use safe water in all purposes % of HHs practice improved personal hygiene % of HHs use sanitary latrine # of women received counseling on safe water, personal hygiene and sanitary practices # of subsidize latrine distributed # of counseling sessions conducted

Activities (Process) Inputs

Staff, Resources

Annual Outcome Survey: WHY?

IFAD is not attempting to report on all aspects of the project but rather on a limited number of indicators; (i) Measure changes happening at the household level in terms of livelihoods and food security during the project life (ii) assess targeting efficiency; (iii) provide evidence of project success or failure; and (iv) provide timely performance information necessary to undertake corrective actions.

Annual Outcome Survey and RIMS Reporting Requirements

1. Annual Reporting Pre Mid-Term Projects -Report on 1st level indicators Post Mid-term Projects -Report on 1st level indicators -Report on 2nd level indicators and ratings 2. Baseline, Mid-Term, Completion - RIMS Impact Survey
Annual Outcome survey