This is an entry that complements the Measuring What Matters toolkit which you can find here: https://info.copronet.wales/measuring-what-matters/
Measuring What Matters online tool result: code DGI
Technical description
You want to adopt a quantitative and consultative approach, to an outcome or impact evaluation, that can be delivered relatively quickly and easily.
Glossary
Participatory approaches: Involve the stakeholders of a programme or policy in the evaluation process. (Source: Better Evaluation)
Co-productive approaches: Share power and responsibility with stakeholders working together in equal, reciprocal and caring relationships. (Source: Co-production Network for Wales)
Qualitative approaches: Focus on the quality of an activity (often feelings and subjective opinions) as opposed to quantity (objective facts and figures).
Consultative approaches: Invite people to share their experiences through some kind of formal and structured process.
Observational approaches: Involve direct observation of people in their typical environment or activity, whilst causing minimal disturbance to that environment or activity.
Experimental approaches: Investigate cause and effect by manipulating aspects of an environment or activity (variables) in a repeatable way with carefully controlled conditions.
Formative Evaluations: Assess the feasibility and potential of a programme, policy or intervention.
Process Evaluations: Assess how effectively a programme, policy or intervention is being, or has been, implemented.
Outcome Evaluations: Assess the extent to which a programme, policy or intervention has achieved its planned outcomes.
Impact Evaluations: Explore and assess longer-term effects, intended or otherwise, of a programme, policy or intervention.
Economic Evaluations: Assess a programme’s or intervention’s value for money.
Data collection methods
Capturing Causal Moments
Time: low / Cost: low
Staff or volunteers record comments in non-formal circumstances.
Free Capturing Causal Moments resources and instructions are provided by Evaluation Support Scotland.
Community Navigators
Time: moderate / Cost: moderate
Community Navigators come out of their communities and act as community researchers, working with the public (or any group of stakeholders) to find out their views on a given question.
Check out Page 28 of Think Local Act Personal’s Guide ‘Does it Work? – A guide to evaluating community capacity initiatives.’
Cross Sectional Study
Time: moderate / Cost: moderate
Cross Section Studies assess a representative sample of people at a given point in time.
The pros and cons of participatory approaches to evaluation are outlined on Page 22 of Nesta’s ‘Using Research Evidence – A Practical Guide’.
Focus Group
Time: moderate / Cost: moderate
Focus groups are facilitated sessions where groups share feedback regarding a project or specific issue. They are a good source of in-depth qualitative information.
Free Focus Group resources and instructions are provided by Evaluation Support Scotland.
Key Informant Assessment
Time: low / Cost: moderate
Key Informant Assessments are semi-structured interviews with key members of the group who are the focus of an evaluation.
Check out Page 28 of Think Local Act Personal’s Guide ‘Does it Work? – A guide to evaluating community capacity initiatives.’
Observation
Time: high / Cost: low
Observation involves staff or volunteers observing the beneficiaries of a project, and recording information regarding project outcomes.
A free guide to Observation is provided by Evaluation Support Scotland.
Single Case Study
Time: moderate / Cost: moderate
A Case Study is a detailed and intensive examination of a single case such as community, family, organisation, event or individual.
The pros and cons of participatory approaches to evaluation are outlined on Page 21 of Nesta’s ‘Using Research Evidence – A Practical Guide’.
Skip to content