Search the co-production knowledge base

Measuring What Matters online tool result: code DGI

This is an entry that complements the Measuring What Matters toolkit which you can find here: https://info.copronet.wales/measuring-what-matters/

 

Measuring What Matters online tool result: code DGI

 

Technical description

You want to adopt a quantitative and consultative approach, to an outcome or impact evaluation, that can be delivered relatively quickly and easily.

 

Glossary

Participatory approaches: Involve the stakeholders of a programme or policy in the evaluation process. (Source: Better Evaluation)

Co-productive approaches: Share power and responsibility with stakeholders working together in equal, reciprocal and caring relationships. (Source: Co-production Network for Wales)

Qualitative approaches: Focus on the quality of an activity (often feelings and subjective opinions) as opposed to quantity (objective facts and figures).

Consultative approaches: Invite people to share their experiences through some kind of formal and structured process.

Observational approaches: Involve direct observation of people in their typical environment or activity, whilst causing minimal disturbance to that environment or activity.

Experimental approaches: Investigate cause and effect by manipulating aspects of an environment or activity (variables) in a repeatable way with carefully controlled conditions.

Formative Evaluations: Assess the feasibility and potential of a programme, policy or intervention.

Process Evaluations: Assess how effectively a programme, policy or intervention is being, or has been, implemented.

Outcome Evaluations: Assess the extent to which a programme, policy or intervention has achieved its planned outcomes.

Impact Evaluations: Explore and assess longer-term effects, intended or otherwise, of a programme, policy or intervention.

Economic Evaluations: Assess a programme’s or intervention’s value for money.

 

Data collection methods

Capturing Causal Moments

Time: low / Cost: low

Staff or volunteers record comments in non-formal circumstances.

Free Capturing Causal Moments resources and instructions are provided by Evaluation Support Scotland.

 

Community Navigators

Time: moderate / Cost: moderate

Community Navigators come out of their communities and act as community researchers, working with the public (or any group of stakeholders) to find out their views on a given question.

Check out Page 28 of Think Local Act Personal’s Guide ‘Does it Work? – A guide to evaluating community capacity initiatives.’

 

Cross Sectional Study

Time: moderate / Cost: moderate

Cross Section Studies assess a representative sample of people at a given point in time.

The pros and cons of participatory approaches to evaluation are outlined on Page 22 of Nesta’s ‘Using Research Evidence – A Practical Guide’.

 

Focus Group

Time: moderate / Cost: moderate

Focus groups are facilitated sessions where groups share feedback regarding a project or specific issue. They are a good source of in-depth qualitative information.

Free Focus Group resources and instructions are provided by Evaluation Support Scotland.

 

Key Informant Assessment

Time: low / Cost: moderate

Key Informant Assessments are semi-structured interviews with key members of the group who are the focus of an evaluation.

Check out Page 28 of Think Local Act Personal’s Guide ‘Does it Work? – A guide to evaluating community capacity initiatives.’

 

Observation

Time: high / Cost: low

Observation involves staff or volunteers observing the beneficiaries of a project, and recording information regarding project outcomes.

A free guide to Observation is provided by Evaluation Support Scotland.

 

Single Case Study

Time: moderate / Cost: moderate

A Case Study is a detailed and intensive examination of a single case such as community, family, organisation, event or individual.

The pros and cons of participatory approaches to evaluation are outlined on Page 21 of Nesta’s ‘Using Research Evidence – A Practical Guide’.

 

Leave a Reply

Your email address will not be published. Required fields are marked *