Measuring What Matters online tool result: code CGI

This is an entry that complements the Measuring What Matters toolkit which you can find here: https://info.copronet.wales/measuring-what-matters/

 

Measuring What Matters online tool result: code CGI

 

Technical description

You want to adopt a qualitative and consultative approach, to an outcome or impact evaluation, that can be delivered relatively quickly and easily.

 

Glossary

Qualitative approaches: Focus on the quality of an activity (often feelings and subjective opinions) as opposed to quantity (objective facts and figures).

Consultative approaches: Invite people to share their experiences through some kind of formal and structured process.

Observational approaches: Involve direct observation of people in their typical environment or activity, whilst causing minimal disturbance to that environment or activity.

Experimental approaches: Investigate cause and effect by manipulating aspects of an environment or activity (variables) in a repeatable way with carefully controlled conditions.

Formative Evaluations: Assess the feasibility and potential of a programme, policy or intervention.

Process Evaluations: Assess how effectively a programme, policy or intervention is being, or has been, implemented.

Outcome Evaluations: Assess the extent to which a programme, policy or intervention has achieved its planned outcomes.

Impact Evaluations: Explore and assess longer-term effects, intended or otherwise, of a programme, policy or intervention.

Economic Evaluations: Assess a programme’s or intervention’s value for money.

 

Data collection methods

Body Map

Time: low / Cost: low

Body Map is a tool for facilitating discussions about perceptions, opinions, beliefs, and attitudes. It is particularly helpful when exploring unknown outcomes with groups with limited literacy or language differences.

Free Body Map resources and instructions are provided by Evaluation Support Scotland.

 

Choosing Pictures

Time: low / Cost: low

Choosing Pictures involves the use of pictures to facilitate discussion about perceptions, opinions, beliefs, and attitudes. It is particularly helpful when exploring unknown outcomes with groups with limited literacy or language differences.

Free Choosing Pictures resources and instructions are provided by Evaluation Support Scotland.

 

Creative Writing

Time: low / Cost: low

Creative Writing allows an individual or group to reflect and feedback on any aspect of a project or issue, with a poem, story, or anything else. It can be fun and therapeutic as well as a helpful data collection method.

A free Creative Writing guide is provided by Evaluation Support Scotland.

 

Emotional Touchpoints

Time: low / Cost: low

Emotional Touchpoints are used to identify key points in people’s experiences of a project. They can also be used to facilitate story gathering.

A free Emotional Touchpoints guide is provided by Evaluation Support Scotland.

 

Forms

Time: low / Cost: low

Forms come in all shapes and sizes, can be paper-based or shared online, and used to gather a range of project related evaluation data.

Links and free resources relating to different kinds of forms are available from Charity Catalogue.

 

Outcomes Star

Time: low / Cost: low

Outcomes Star is an evidence-based evaluation tools for measuring and supporting change.

The Outcomes Star was developed by Triangle.

 

Positive Deviance

Time: high / Cost: moderate

Positive Deviance asks project stakeholders to identify ‘outliers’ especially those leading to positive outcomes, to understand how these were achieved.

Positive Deviance features in Better Evaluation’s ‘Rainbow Framework’ and more information can be found of their website.

 

Questionnaire

Time: moderate / Cost: low

Questionnaires are structured lists of questions regarding a specific topic or issue. They can be paper based or shared online.

Some example questionnaires (tailored to young people) are provided by Sport Educate’s ‘Sport for Development Toolkit’ and are available for free from their website.

 

Relationship Map

Time: low / Cost: low

Relationship Maps are a simple method for understanding friendship networks, relationships and their relation to project outcomes.

Free Relationship Map guides and resources are provided by Evaluation Support Scotland.

 

Sticky Wall

Time: low / Cost: low

Sticky walls can be used to quickly collect qualitative feedback from a large group of people.

Free Sticky Wall guides and resources are provided by Evaluation Support Scotland.

 

Stretch or Positive Statements

Time: low / Cost: low

Stretch or Positive Statements are simple statements which act as prompts for discussion.

A free guide to stretch or positive statements is provided by Evaluation Support Scotland.

 

Survey

Time: moderate / Cost: low

Surveys provide quantitative data on attitudes, opinions, knowledge and behaviours from a representative sample of project stakeholders and/or beneficiaries.

Links and free resources relating to different kinds of survey are available from Charity Catalogue.

 

Tactile Feedback

Time: low / Cost: low

Tactile Feedback involves the use of textures to facilitate discussion about perceptions, opinions, beliefs, and attitudes. It is particularly helpful when exploring unknown outcomes with groups with limited literacy, language differences or visual impairment.

Free Choosing Pictures resources and instructions are provided by Evaluation Support Scotland.