This is an entry that complements the Measuring What Matters toolkit which you can find here: https://info.copronet.wales/measuring-what-matters/
Measuring What Matters online tool result: code DGJ
Technical description
You want to adopt a quantitative and consultative approach, to an outcome or impact evaluation, and want to commit time and resources to gathering rich and detailed evidence.
Glossary
Participatory approaches: Involve the stakeholders of a programme or policy in the evaluation process. (Source: Better Evaluation)
Co-productive approaches: Share power and responsibility with stakeholders working together in equal, reciprocal and caring relationships. (Source: Co-production Network for Wales)
Qualitative approaches: Focus on the quality of an activity (often feelings and subjective opinions) as opposed to quantity (objective facts and figures).
Consultative approaches: Invite people to share their experiences through some kind of formal and structured process.
Observational approaches: Involve direct observation of people in their typical environment or activity, whilst causing minimal disturbance to that environment or activity.
Experimental approaches: Investigate cause and effect by manipulating aspects of an environment or activity (variables) in a repeatable way with carefully controlled conditions.
Formative Evaluations: Assess the feasibility and potential of a programme, policy or intervention.
Process Evaluations: Assess how effectively a programme, policy or intervention is being, or has been, implemented.
Outcome Evaluations: Assess the extent to which a programme, policy or intervention has achieved its planned outcomes.
Impact Evaluations: Explore and assess longer-term effects, intended or otherwise, of a programme, policy or intervention.
Economic Evaluations: Assess a programme’s or intervention’s value for money.
Data collection methods
Longitudinal Study
Time: high / Cost: moderate
A Longitudinal Study evaluates the same sample of people surveyed over multiple points in time.
The pros and cons of participatory approaches to evaluation are outlined on Page 22 of Nesta’s ‘Using Research Evidence – A Practical Guide’.
Quasi Experimental Design
Time: high / Cost: moderate
Quasi Experimental Design does not use random allocation to groups, rather it makes use of natural populations or case matching.
The pros and cons of participatory approaches to evaluation are outlined on Page 23 of Nesta’s ‘Using Research Evidence – A Practical Guide’.
Randomised Control Trial
Time: high / Cost: high
In a Randomised Control Trail, one group receives an intervention while another receives none or one of another type, with the chance of trial being allocated to either group being identical.
The pros and cons of participatory approaches to evaluation are outlined on Page 21 of Nesta’s ‘Using Research Evidence – A Practical Guide’.
Single Case Study
Time: moderate / Cost: moderate
A Case Study is a detailed and intensive examination of a single case such as community, family, organisation, event or individual.
The pros and cons of participatory approaches to evaluation are outlined on Page 23 of Nesta’s ‘Using Research Evidence – A Practical Guide’.
Skip to content