This is an entry that complements the Measuring What Matters toolkit which you can find here: https://info.copronet.wales/measuring-what-matters/
Measuring What Matters online tool result: code AFJ
Technical description
You want to adopt a participatory and co-productive approach, to a formative or process evaluation, and want to commit time and resources to gathering rich and detailed evidence.
Glossary
Participatory approaches: Involve the stakeholders of a programme or policy in the evaluation process. (Source: Better Evaluation)
Co-productive approaches: Share power and responsibility with stakeholders working together in equal, reciprocal and caring relationships. (Source: Co-production Network for Wales)
Formative Evaluations: Assess the feasibility and potential of a programme, policy or intervention.
Process Evaluations: Assess how effectively a programme, policy or intervention is being, or has been, implemented.
Data collection methods
Collaborative Outcomes Reporting
Time: high / Cost: high
Collaborative Outcomes Reporting is a participatory approach which ‘story’ of a program’s performance using multiple-lines of evidence, contributed to by technical experts and project stakeholders.
Collaborative Outcomes Reporting features in Better Evaluation’s ‘Rainbow Framework’ and more information can be found of their website.
Innovation History
Time: moderate / Cost: moderate
Innovation Histories bring together the experience of project stakeholders, to develop an agreed narrative of how an innovation was developed, informing future innovation efforts.
Innovation History features in Better Evaluation’s ‘Rainbow Framework’ and more information can be found of their website.
Most Significant Change
Time: high / Cost: high
Most Significant Change is a story-based evaluation method, which considers the significance of stories offered by stakeholders, and ensures learning from these stories is shared by all.
Most Significant Change features in Better Evaluation’s ‘Rainbow Framework’ and more information can be found of their website.
Participatory Evaluation
Time: moderate / Cost: moderate
Participatory Evaluation covers a range of approaches that involve project stakeholders the decision-making processes around all aspects of evaluation.
The pros and cons of participatory approaches to evaluation are outlined on Page 22 of Nesta’s ‘Using Research Evidence – A Practical Guide’.
Participatory Impact Pathways Analysis
Time: high / Cost: moderate
Participatory Impact Pathways Analysis brings key stakeholders in a project together in order to co-construct a theory of how the project will achieve its intended outcomes.
Participatory Impact Pathways Analysis is a recommended approach to developing a programme theory, in Better Evaluation’s ‘Rainbow Framework.’ A practical guide to how it’s done is offered by the The Institutional Learning and Change (ILAC) Initiative.
Realist Evaluation
Time: moderate / Cost: moderate
Realist Evaluation is a theory-driven approach which considers the context in which a project takes places, to understand what works for whom, where and why. It is a ‘method-neutral’ approach to evaluation which is used in conjunction with any data collection method/s.
Realist Evaluation features in Better Evaluation’s ‘Rainbow Framework’ and more information can be found of their website.
Skip to content