Loading presentation...

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

Make your likes visible on Facebook?

Connect your Facebook account to Prezi and let your likes appear on your timeline.
You can change this under Settings & Account at any time.

No, thanks

Going Beyond Mixed Methods to Mixed Approaches

Presented at the American Evaluation Association Conference on 11 November 2015 in Chicago
by

Jeneen Garcia

on 9 June 2016

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Going Beyond Mixed Methods to Mixed Approaches

11 November 2015, Chicago
Adapted from OECD DAC 2002

AND
What is
Inputs and Activities
Correct assumptions
An intervention’s typical theory of change
IMPACT?
Positive + Negative
Intended + Unintended
Primary + Secondary
Direct + Indirect
Changes and trends that are
Caused by the intervention
IMPACT
American Evaluation Association Conference
Aaron Zazueta
Jeneen R. Garcia
COMMUNICATION'S
NEXT
BIG
IT'S
NOT ONE
THING
50 BILLION
BIG
THANKS
BRAD WHITWORTH
ABC, IABC FELLOW
@bradwhitworth
Brad Whitworth
ONE
BY 2020
SMART
OBJECTS
DATA
BIG
CREATERS
BECOME
CURATORS
YOU'LL BE
FINE
THING
IS NOT
NOTHING
IT'S
HANDLE
YOU CAN'T
NOTHING
IT'S
GOING BEYOND MIXED METHODS TO
Boundaries
Components
Interactions
Emergent properties
Understand the elements of the TOC and system
The “true” THEORY OF CHANGE (as far as the evaluation is concerned)
Define the evaluation questions
What needs to be assessed, where and when
Refine the evaluation scope and units of analysis
Define the evaluation objectives
What needs an evaluation
Why it needs to be evaluated
What the evaluation findings and recommendations will be used for
Identify the methodologies
What data sources and gaps exist
Which data collection and analysis tools are appropriate
How this conceptual framework fits into the evaluation design process
Adapted from Garcia and Zazueta 2015
Determined by or in consultation with relevant stakeholders
Determined iteratively as understanding increases over the course of the evaluation
The intervention is PART of the system!
The larger system
a.k.a. the real world
How the questions need to be asked (lines of questioning)
Which variables can and must be measured
Determined iteratively based on refined units of analysis
BUT...
How to know what to include
What elements does it intend to use to achieve impact?
What does it intend to influence to achieve impact?
What impact does it intend to achieve?
What else can it potentially influence?
What other elements can potentially influence the intended impacts?
What can potentially influence its implementation?
What can potentially influence the elements that are supposed to help achieve impact?
INTERVENTION
IMPACT
LARGER SYSTEM
Read! Talk to experts! Think creatively!
INTERVENTION TOC
COMMUNICATION'S
NEXT
BIG
MIXED APPROACHES
Using Complex Systems Thinking to Ask the Right Questions
UNEP-implemented South China Sea Project
Boundaries
Emergent properties
Components
Interactions
South China Sea (oceanographic)
National governments
Local governments
Scientists
Steering committee meetings among national ministers
Roundtable meetings among local government executives
Scientific conferences
Countries agree to fund and collaboratively implement SCS Strategic Action Programme (INTENDED OUTCOME)
SCS Strategic Action Programme signed by all beneficiary countries despite initial resistance from two countries
East Asia (geopolitical)
Boundaries
Emergent properties
Components
Interactions
UNDP-implemented PEMSEA Project
Boundaries
Emergent properties
Components
Interactions
East Asian Seas (geopolitical)
National governments
Local governments
Scientists
Network and conferences for local government executives
Multidisciplinary experts group
Countries agree to fund PEMSEA and implement Sustainable Development Strategy for Seas of East Asia (INTENDED OUTCOME)
UNEP-initiated COBSEA
JICA
USAID
SIDA
DANIDA
Sovereign Countries
Other
donors
Long-standing maritime disputes continue
Countries reluctant to enter into legally binding regional environmental agreements due to sovereignty concerns
National governments traditionally adopt but do not fund regional environmental plans
Regional activities
BUT
diluted country resources and caused fatigue due to lack of coordination
increased communication
THINK OUTSIDE THE BOX!
The intervention is PART of the system!
There are many roads to impact.....
Full transcript