Loading presentation...

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

Make your likes visible on Facebook?

Connect your Facebook account to Prezi and let your likes appear on your timeline.
You can change this under Settings & Account at any time.

No, thanks

Evaluating a Peace Education Programme

Fundamentals and practical application of Monitoring & Evaluation
by

Elzette Rousseau

on 26 February 2014

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Evaluating a Peace Education Programme

Milena Flament
Evaluate to Motivate
M&E Models



defining and illustrating
'the miracle'
that occurs
Building a Culture of Learning
Types of Data Collection
Programme Evaluation: systematic gathering, analysis and reporting of programme data to assist in decision-making.
Fundamentals and Practical Applications of Programme Monitoring & Evaluation
Evaluating a Peace Education Programme
Written Surveys
Most Significant Change
Pre-Post Tests
Act on evaluation findings
Evidence-based
Elzette Rousseau
Evaluating Change
In order to see the change you’ve made, quickly remind yourself of your original plan:
Evaluation research is appropriate whenever some social intervention occurs or is planned. It is the process of determining whether a social intervention has produced the intended result. It's about celebrating successes whilst believing we can be even better.
If you do not measure results, you cannot tell success from failure 
If you cannot see success, you cannot reward it 
If you cannot reward success, you are probably rewarding failure 
If you cannot see success, you cannot learn from it 
If you cannot recognise failure, you cannot correct it 
If you can demonstrate results, you can win public support 
Power of Measuring Results
Demonstrating the impact of the programme
Describing participant characteristics

Models of Evaluation
Needs Assessment
Process Evaluation
Outcome Evaluation
Cost-Benefit Analysis
Indicators of change should be BASELINED.
What were you trying to achieve
What were the aims and objectives of the programme/event?
What did success look like to you and the group?
Communicate evaluation results effectively

Reporting
Evaluate to Motivate
Describing the intended programme
Documenting what was actually implemented

Impact Evaluation
A result or effect that is caused by or attributed to a programme intervention.
Research
Conduct analytical and comprehensive research, and produce innovative solutions within specific development contexts.

Its about understanding the context wherein a project is implemented, societal factors, theories applicable to the change to be promoted etc.
Evaluation
Using quantitative and qualitative research methods we strive to add value to the public, stakeholders and donors, by providing accurate, insightful and cost-effective solutions to enhance programme performance.

We establish what is needed, what works well, what doesn't work, and what can be improved.
Communications
Offer a wide range of communication methods that help to showcase best practice and enhance our services and organisational effectiveness.

Through creative and strategic communications, the profile of organisations can be raised as well as benefit can be drawn for stakeholders through comprehensive Behaviour Change Communication, Development and Advocacy Campaigns.

Evaluating a Peace Education Programme
1. FUNDAMENTALS OF EVALUATION
2. PRACTICAL APPLICATION
Defining Programme Evaluation
Importance of Evaluation
Models of Evaluation
Indicators of Change
Whose voice counts?
Gathering data
Building a culture of learning
Source: Kusek & Rist, Ten Steps to a Results-Based Monitoring and Evaluation System

War/Violence is only the tip of the iceberg
Evaluation supports learning and contributes to achieving development goals by informing decision-making.
“we have done a fine job this year”

"From what I’ve heard, we are providing more and better services than ever before”

300 people were at the campaign
"Just the other day, the programme coordinator told me that the kids have shown tremendous change"
...THE END...
2013 US Military Spending $716 billion
2013 UN Peacekeeping < $8 billion
Indicators of Change
WHO
Understanding who are the intended beneficiaries / stakeholders of change
WHAT
WHEN
WHERE
WHY
Why do the findings matter?
The 5 W's...
Asking 'what' needs to change for beneficiaries relates to the purpose of the programme. The purpose relates to the motive behind the activities in the programme...
1. The Fundamentals of Evaluation
2. Practical Application of M&E
Needs Evaluation identifies and measures the level of unmet needs within a community / organisation.
Institutions currently serving community
Relevant Policies
Through close contact with residents, local leaders, etc. you can determine which aspects of a programme are most useful and acceptable for the community.
Describe context of the programme activities.
The extent to which implementation has taken place, the nature of the people being served, and the degree to which the programme operates as expected.
Do the needs of the community match what was believed during planning?
Is there evidence to support the assessment of needs made during the planning stage?
Are the programme participants performing well?
Compare performance of those in the programme with those not receiving the service.
Show that receiving the programme's services caused a change for the better in the condition of those participating.
Impact is often used to refer to higher-level or longer-term effects of a programme or project.
How do we put 'value' on the value and quality of human life?
What are the benefits to the community, government and funders from a quantitative perspective?
OUTPUTS
OUTCOMES
Sometimes referred to as “deliverables”.
Directly dependent on the actions of the implementer.
Measuring outputs is a key part of MONITORING a project or programme.
Sometimes referred to as "impact".
Dependent on changes in actions/behaviours of people or groups the implementer targeted and reached.
One means of EVALUATING a programme or project.
Changes in behaviour, attitudes, awareness, knowledge, environment, policy, and general population trends.
“Every evaluation situation is unique. A successful evaluation (one that is useful, practical, ethical, accurate, and accountable) emerges from the special characteristics and conditions of a particular situation – a mixture of people, politics, history, context, resources, constraints, values, needs, interest and chance"
Stakeholder Evaluation

Stakeholders bring a broad range of experience and perspective to an evaluation
Stakeholder evaluation is a useful method in getting lead decision makers to co-operate, intimately understand and attract attention to findings, AND hopefully get participants to take findings into account when making decisions
policy makers
programme managers
practitioners
citizens
Intended beneficiaries of the programme
Providers of services
Direct Beneficiaries
Indirect Beneficiaries
Objectives
Results
Outputs
Activities
Project Planning Phase
Project Implementation & Evaluation Phase
Why was a certain activity used in the process?
Why this instead of some other activity or programme that's available?
Why is this programme activity the best fit for your purpose and beneficiaries?
What are you trying to prove with specific activities / events?
Where are the links between activities and change?
Almost all evaluation is concerned with time in some capacity
When and for how long was the activity implemented?
When did change occur?
(We might be able to cut out processes that are not adding value)
The usefulness of pre-post testing
Where can I verify the change information?
Triangulation of sources
Regular snapshots describing beneficiaries and services, track the programme and beneficiaries change over time.
Understanding the relationship between specific programme elements and programme outcomes
Data for programme improvement efforts
Reaching important target audiences and stakeholders
What evidence can be found that supports the theoretical assumptions made by the programme planners?
Do the activities carried out by the staff match the plans for the programme?
EVALUATION
All which lead to
Level 3:
Level 2:
Level 1:
Examples:
# of persons trained
# of communities with access to clean water
Examples:
# of organisations successfully implementing a gender strategy
# of households practicing good hygiene
“Evaluations that involve stakeholder groups, other than sponsors, in the formulation of evaluation questions and in any other evaluation activities”
BENEFITS
Evaluating
Peace Education

"One of the greatest mistakes is to judge policies and programmes by their intentions rather than their results" - Milton Friedman
Community Resources
Environmental Scan
Social needs of community
Establishing which programme is the most relevant, within the most cost effective way possible.
Interviews & Focus Groups
Secondary Programme Data
explore stakeholder information needs
set a communication schedule
provide progress reports and press releases
spend time on editing - formal reports should look attractive
Develop a Communication Plan
Treat findings as tentative indicators!
Work with Stakeholders
Adopt Developmental Interpretations
Keep evaluaton findings on the Agenda
Example: Needs Assessment
Q: What is the key conflict that concern you?
Types of Indicators
Quantitative
"Number of..."
"Percentage of..."
"Frequency of..."
Qualitative
"Extent of..."
"Presence of..."
"Quality of..."
These indicators will help you collect NUMBERS or STATISTICS
These indicators will help you collect STORIES, IDEAS or LANGUAGE
Full transcript