Research Impact Evidence

Evidence for impact types
and case study examples

Impact can arise from a multitude of directions and follow diverse pathways. To help you document how the impact journey of your research has progressed, this resource outlines examples of impact evidence gathering. It is arranged by impact type[1] and is a non-exhaustive list of ways in which change resulting from research impact can happen.

Included are examples of high-scoring impact case studies (ICS) linked to the REF2021 Impact Case Study Database. All could have been listed under more than one impact category and build impact over time.

The research impact types and forms of evidence listed under each of the categories are not exhaustive and are often found in conjunction with each other. For example, a policy change may come from environmental impact, capacity building can interweave with economic impact, or health-related impact may correlate to social welfare.

All elements can be evidenced, measured and reported. The methods of evidence gathering can be diverse but must aim to demonstrate the reach, significance and rigour of the research impact through contextualised and substantiated claims.

[1] The evidence for each Impact type was generated via https://openai.com/blog/chatgpt.


Industry

Industrial partnerships are a key aspect of impact work for many as creative collaborators, vehicles of refinement or as end users. When engaging in work with industry, evidence of change can be demonstrated through various indicators.
For many indicators, starting benchmarks and methodologies to show causality should be considered early in the project.

Here are some examples of impact evidence for work relating to industry:

  • Increased Efficiency or Productivity: Evidence of change can be seen in improved efficiency or productivity within the industry. This can be measured by quantifiable metrics such as reduced production time, increased output, cost savings, waste reduction or improved operational processes resulting from the collaboration or intervention.

  • Adoption of New Technologies or Practices: If the work with industry involves introducing new technologies, methodologies, or practices, evidence of change can be demonstrated through their adoption. This can be observed by industry stakeholders implementing and integrating these innovations into their operations or processes, resulting in improved outcomes or competitive advantages.
  • Enhanced Quality or Safety: Evidence of change can be shown through improvements in quality standards or safety practices within the industry. This can be evidenced by reduced defects or errors, enhanced product reliability, increased adherence to safety regulations, or decreased workplace accidents or incidents.
  • Innovations or New Products: Collaboration with industry can lead to the development of new products, services, or innovations. Evidence of this can be demonstrated by the successful launch and commercialisation of these new offerings, along with their positive reception/feedback from the target market or industry.
  • Market Expansion or Diversification: Evidence of change can be seen in industry’s ability to expand or diversify its market reach or customer base. This can be demonstrated by increased market share, successful entry into new markets, or the development of new customer segments resulting from the collaboration.
  • Cost Reduction or Revenue Growth: Evidence of change can be measured by cost reduction or revenue growth for industrial partners. This can be demonstrated through financial indicators such as increased profitability, higher return on investment, reduced expenses, or resulting increases in revenue streams.
  • Partnerships and Collaborations: Evidence of change can be reflected in the establishment of successful partnerships and collaborations between researchers and industry stakeholders. This includes joint projects, co-developed technologies, or collaborative ventures, which signify a mutually beneficial relationship and can lead to long-term impact.
  • Employee Skills and Training: Research impact can be seen in the upskilling or professional development of industry employees. This can be measured by improvements in employee knowledge, competencies, or qualifications resulting from the collaboration or training initiatives.

These examples illustrate some potential evidence of change that can be observed when working with industry, though they may have applications elsewhere. The specific indicators will depend on the nature of the collaboration, the goals, and the industry sector involved. Evaluative methods, such as surveys, interviews, statements, and performance metrics, can be utilised to collect data and assess the reach of impact and effectiveness and significance of the work with industrial partners.

Example high-scoring ICSs:

Production

Many of the innovations from St Andrews have impact potential in production. There are multiple ways in which impact success can be measured, through indicators that reflect positive transformations in production processes, efficiency, and outcomes. Here are some examples of evidence of change for work aimed at production:

  • Increased Productivity: Evidence of change can be seen through increased productivity in production processes. This includes indicators such as higher output per unit of input, reduced production time, improved resource utilisation, or increased production volumes without compromising quality.
  • Cost Reduction: Evidence of change can be observed through efforts to reduce production costs. This includes indicators such as decreased production expenses, optimised supply chain management, improved inventory control, or increased efficiency in energy consumption, leading to cost savings.
  • Quality Improvement: Impact can be demonstrated through improvements in product quality. This includes indicators such as reduced defect rates, enhanced product reliability or durability, improved customer satisfaction, or increased adherence to quality standards or certifications.
  • Innovation and New Product Development: Evidence of change can be seen through innovation in production processes and the development of new products. This includes indicators such as the introduction of new technologies or techniques, the successful implementation of process improvements, or the launch of innovative products that meet market demands.
  • Environmental Sustainability: Evidence of change can be observed through efforts to improve environmental sustainability in production via indicators such as reduced environmental impact, decreased carbon footprint, improved waste management and recycling practices, or the adoption of eco-friendly production methods.
  • Health and Safety: Evidence of change can be demonstrated through improvements in health and safety practices in production environments. This can be evidenced by indicators such as reduced accident rates, improved workplace safety measures, enhanced employee wellbeing, or increased compliance with health and safety regulations.
  • Supply Chain and Logistics Optimisation: Evidence of change can be seen through the optimisation of supply chain and logistics processes. This includes indicators such as reduced lead times, improved inventory management, enhanced distribution efficiency, or increased transparency and traceability throughout the supply chain.
  • Employee Engagement, Skills Development and Culture: Evidence of change can be demonstrated through efforts to engage employees and develop their skills in production roles. This includes indicators such as increased employee satisfaction, improved teamwork and collaboration, enhanced employee training and development programs, or reduced employee turnover rates.

These examples highlight some potential evidence of change that can be observed in work aimed at production improvements. The specific indicators will depend on the goals, context, and industry sector of the work. Evaluation methods, such as performance metrics, data analysis, process assessments, or employee feedback, can be utilised to gather evidence and assess the impact and effectiveness of production-related initiatives.

Example high-scoring ICSs:

The Economy

When engaging in work to enhance the economy, evidence of change can be demonstrated through various indicators that reflect positive economic outcomes. Here are some examples of evidence of change for work aimed at enhancing the economy:

  • Increased Employment: Impact can be seen through an increase in employment opportunities. This can be measured by a rise in the number of jobs created, reduced unemployment rates, or an increase in workforce participation.
  • Economic Growth: Evidence of change can be demonstrated by positive economic growth indicators. This includes an increase in gross domestic product (GDP), expansion of industries or sectors, and improved economic performance compared to previous periods.
  • Business Development and Investment: Impact can be observed through the growth and development of businesses and increased investment activities. This can be measured by indicators such as increased business formation, higher levels of entrepreneurship, and greater inflows of domestic or foreign investment.
  • Improved Productivity: Evidence of change can be seen in improved productivity levels within industries or sectors. This can be measured by indicators such as increased output per worker, enhanced efficiency, or higher rates of innovation and technological adoption.
  • Enhanced Competitiveness: Improved competitiveness of businesses or the economy as a whole can result from collaboration with external partners. This can be measured by indicators such as improved global rankings, increased market share, or successful market penetration in domestic or international markets.
  • Reduced Poverty and Inequality: Evidence of change can be observed through a reduction in poverty rates and income inequality. This can be recorded via a decrease in poverty levels, improved income distribution, or an increase in social mobility.
  • Trade and Export Growth: Research impact fuelled by partnership can result in increased trade volumes and export growth. This can be measured by indicators such as higher export values, improved trade balance, or expanded market access for local products or services.
  • Regional Development: Evidence of change can be seen through enhanced regional development and economic diversification. This can be measured by indicators such as improved infrastructure, increased economic activity in specific regions, or the growth of emerging industries.

It is important to note that these examples of evidence of change are interconnected, and multiple indicators may need to be considered to provide a comprehensive understanding of the economic impact. Evaluation methods, such as economic impact assessments, analysis of economic indicators, or statements, can be utilised to collect data and assess the impact and effectiveness of initiatives aimed at enhancing the economy at macro and micro levels.

Example high-scoring ICSs:

Policy

Impacting policy and the ideas and actions therein is a wide-reaching source of change. When  influencing policy, evidence of change can be demonstrated through various indicators that reflect positive transformations in policy development, implementation, or impact. Here are some examples of evidence of change for work aimed at engaging with policy:

  • Policy Adoption: Evidence of change can be seen through the adoption of new policies or the revision of existing policies. This can be demonstrated by the enactment of legislation, the issuance of official policy documents, or the integration of policy recommendations into government frameworks.
  • Policy Resonance: Evidence of change can be observed through the repercussions of policies on the intended target population or issue. This includes indicators such as improved outcomes, reduced problem rates, or positive changes in the social, economic, or environmental conditions affected by the policy.
  • Stakeholder Engagement: Policy development and decision-making processes which involve stakeholders, particularly those who would not have been involved previously. Evidence indicators, such as the active involvement of diverse stakeholders, public consultations, or the establishment of multi-sectoral partnerships, can demonstrate this.
  • Data-Driven Decision Making: Evidence of change can be seen through the adoption of evidence-based or data-driven approaches to policy development. This includes indicators such as the use of rigorous research findings, data analysis, or impact assessments to inform policy decisions.
  • Policy Implementation: Evidence of change can be observed through effective policy implementation. This includes indicators such as the allocation of resources, the establishment of implementation plans or frameworks, or the successful execution of policy actions and initiatives.
  • Policy Evaluation: Evidence of change can be demonstrated through the evaluation of policy effectiveness and outcomes. Evidence can arise from assessment of policy impact, monitoring of policy implementation progress, or the use of feedback mechanisms to inform policy adjustments or improvements.
  • Policy Learning and Adaptation: Evidence of change can be seen through policy learning and adaptation based on evidence and feedback. This includes indicators such as policy revisions, policy reviews, or the incorporation of lessons learned from previous policy experiences and integration of research findings.
  • Policy Influence: Evidence of change can be demonstrated through the influence of policy work on the broader policy discourse and agenda. This can be evidenced by recognition of policy contributions through citations, policy endorsements or adoption by other jurisdictions, or policy innovations becoming best practices.

These examples highlight some potential evidence of change that can be observed in initiatives aimed at enhancing policy; these examples may work in tandem or may evolve in the form of an impact pathway, moving from engagement to influences to evaluation and impact. The specific indicators will depend on the policy area, context, and goals of the work. Evaluation methods, such as policy analysis, impact assessments, case studies, or stakeholder feedback, can be utilised to gather evidence and assess the impact and effectiveness of policy enhancement efforts.

Example high-scoring ICSs:

Practitioners

Research can translate into how others work; by involving practitioners in impact work, we can extend its reach. Ways to strengthen or establish strong collaborations and partnerships and fruitful working relationships between researchers and practitioners can include joint publications, joint projects, in-kind funding, and ongoing engagement.  

When engaging in work with practitioners, evidence of change can be demonstrated through various means. Here are a few examples:

  • Improved Practices: If work with practitioners involves introducing new methods, techniques, or approaches, evidence of change can be seen in the adoption and implementation of these practices. For example, if a training program was conducted to enhance teaching methods, evidence of change would be observed in improved instructional practices and outcomes in the classroom.
  • Enhanced Skills and Knowledge: When working with practitioners, evidence of change can be demonstrated through the development of new skills and knowledge. This can be measured through assessments, evaluations, or self-reporting, showing that practitioners have acquired new competencies, are able to apply them effectively in their work and/or can translate their new skills to others.
  • Changes in Attitudes and Perspectives: Evidence of change can also be seen in shifts in attitudes and perspectives among practitioners. This can be observed through surveys, interviews, or focus groups, where practitioners express a change in their beliefs, values, or understanding of a particular topic or issue as a result of the collaboration or intervention.
  • Improved Outcomes: One of the most significant forms of evidence of change is the demonstration of improved outcomes resulting from engagement with practitioners. This could be evidenced by quantitative data, such as increased productivity, improved user outcomes, greater KPI achievement, or reduced error rates. Qualitative evidence, such as positive testimonials or success stories from practitioners, can also illustrate the impact of the work.
  • Sustainability and Continuity: Evidence of change can be demonstrated by the sustainability and continuity of the implemented practices or interventions. If the changes initiated with practitioners are maintained over time and continue to yield positive results, it indicates a successful impact and lasting change.

Engagement is a key vehicle in collecting impact evidence from practitioners to measure sustained change in practice. Evaluation methods, such as surveys, observations, interviews, or case studies, can be utilised to collect and analyse data to demonstrate the impact and effectiveness of the work with practitioners.

Example high-scoring ICSs:

Environment

When engaging in work to understand, improve or protect the environment, evidence of impact can be demonstrated through various indicators that reflect positive transformations in environmental understanding, conditions and practices. Here are some examples of evidence of change for work aimed at the environment:

  • Conservation and Biodiversity: Successful conservation efforts and biodiversity protection can have wide-reaching impact. This includes indicators such as the restoration of ecosystems, increased species abundance or diversity, improved habitat quality, or the recovery of endangered or threatened species.
  • Reduced Pollution and Emissions: Research impact can be observed through efforts to reduce pollution and emissions. This can be evidenced by improved air or water quality, reduced greenhouse gas emissions, decreased pollution levels in specific areas, or the adoption of cleaner production practices.
  • Sustainable Resource Management: Evidence of change can be demonstrated through sustainable management of natural resources. This includes indicators such as the implementation of sustainable agriculture or forestry practices, responsible water management, reduced waste generation, or the promotion of circular economy principles.
  • Climate Change Mitigation and Adaptation: A diversity of impact journeys join efforts to mitigate and adapt to climate change.  This can be evidenced by measuring indicators such as decreased carbon footprint, increased use of renewable energy sources, development and implementation of climate change adaptation plans, or improved resilience to climate-related impacts.
  • Environmental Education and Awareness: Evidence of change can be demonstrated through increased environmental education and awareness among individuals, industries and communities. At the micro and/or macro level, this can be evidenced by improved knowledge and understanding of environmental issues, increased adoption of sustainable behaviours, or active participation in environmental initiatives.
  • Policy and Advocacy: (see also the ‘Policy’ section, page 5) Impact can be observed through the influence of environmental work on policy development and advocacy efforts. This includes indicators such as the adoption of environmental regulations or policies, the inclusion of environmental considerations in decision-making processes, or the successful advocacy for environmental protection measures.
  • Restoration and Rehabilitation: Evidence of change can be seen through successful restoration and rehabilitation efforts of degraded environments. This includes indicators such as the regeneration of ecosystems, improved soil quality, the recovery of polluted or contaminated sites, or the revitalisation of urban green spaces.
  • Stakeholder Engagement and Collaboration: Evidence of change can be demonstrated through effective stakeholder engagement and collaboration in environmental initiatives. This includes indicators such as the active involvement of local communities, partnerships with businesses or NGOs, or the establishment of multi-stakeholder platforms for environmental decision-making.

The specific indicators will depend on the environmental context, goals of the work, and the scale of the interventions. Evaluation methods, such as environmental monitoring, data analysis, impact assessments, or community feedback, can be utilised to gather evidence and assess the impact and effectiveness of environmental enhancement efforts.

Example high-scoring ICSs:

Capacity building

Building capacity through positive changes in resource – whether physical, financial or cultural – can be evidenced through various indicators that demonstrate the development and enhancement of capabilities within individuals, organisations/industries, or communities. Here are some examples of evidence of change for work on capacity building:

  • Increased Knowledge and Skills: Evidence of change can be demonstrated by an increase in knowledge and skills among the target group. This can be assessed through pre- and post-training assessments, evaluations, or certifications, showing a measurable improvement in specific areas of knowledge or skills relevant to the capacity-building initiative.
  • Improved Performance: Evidence of change can be seen in improved performance or outcomes resulting from the capacity-building efforts. This can be measured by key performance indicators (KPIs), targets achieved, or positive changes in operational processes or outputs.
  • Enhanced Leadership and Management: Capacity-building initiatives often aim to develop leadership and management capabilities. Evidence of change can be observed through increased leadership effectiveness, improved decision-making, or the implementation of sound management practices within the organisation or community.
  • Strengthened Institutions: Evidence of change can be demonstrated by the strengthening of institutions or organisations. This can be observed through improved governance structures, enhanced policies and procedures, increased organisational resilience, or the establishment of effective monitoring and evaluation systems.
  • Collaboration and Networks: Evidence of change can be reflected in the establishment of collaborative networks or partnerships as a result of capacity-building efforts. This can be observed through the formation of new collaborations, knowledge sharing platforms, or the active engagement of participants in communities of practice.
  • Sustainability and Continuity: Evidence of change can be seen in the sustainability and continuity of capacity-building efforts. This includes the integration of new practices or knowledge into regular operations, the establishment of mechanisms for ongoing learning and development, or the continuation of capacity-building initiatives beyond the initial intervention.
  • Empowerment and Ownership: Evidence of change can be demonstrated by increased empowerment and ownership among the target group. This can be observed through the active participation of individuals or communities in decision-making processes, their ability to advocate for their interests, or the development of self-reliance and resilience.
  • Positive Social Impact: Evidence of change can be seen through the positive social impact resulting from capacity-building efforts. This can be observed in areas such as improved access to services, increased social inclusion, reduced inequalities, or enhanced community development.

These examples highlight some potential evidence of change that can be observed in capacity-building initiatives. The specific indicators will depend on the goals, context, and target group of the capacity-building work. Monitoring and evaluation methodologies, such as surveys, interviews, case studies, and qualitative or quantitative data collection, can be utilised to gather evidence and assess the impact and effectiveness of capacity-building efforts.

Example high-scoring ICSs:

Health and Wellbeing

When engaging in work to enhance health and wellbeing, evidence of change can be demonstrated through various indicators that reflect positive transformations in individual and community health outcomes. Here are some examples of evidence of change for work aimed at enhancing health and wellbeing:

  • Improved Health Outcomes: Evidence of change can be seen through improvements in health indicators and outcomes. This can be measured by indicators such as reduced disease incidence or prevalence, increased life expectancy, improved physical or mental health status, or decreased mortality rates.
  • Behaviour Change: Evidence of change can be observed through positive shifts in health-related behaviours. This includes indicators such as increased adoption of healthy lifestyles, improved dietary habits, increased physical activity levels, reduced tobacco or substance use, or enhanced adherence to medical treatments.
  • Increased Access to Healthcare: Evidence of change can be demonstrated through increased access to quality healthcare services. This can be measured by indicators such as improved healthcare coverage, increased utilisation of preventive services, reduced healthcare disparities, or enhanced availability of healthcare facilities in underserved areas.
  • Health Education and Awareness: Evidence of change can be seen through increased health education and awareness among individuals and communities. This includes indicators such as improved knowledge of health-related issues, increased understanding of preventive measures, or positive changes in health-related attitudes and beliefs.
  • Enhanced Mental Wellbeing: Evidence of change can be demonstrated through improvements in mental wellbeing. This can be measured by indicators such as reduced levels of stress, anxiety, or depression, increased resilience, improved coping mechanisms, or enhanced social and emotional support networks.
  • Social Determinants of Health: Evidence of change can be observed through efforts to address social determinants of health. This includes indicators such as improved access to education, increased employment opportunities, reduced poverty levels, or enhanced social support systems, which contribute to overall health and wellbeing.
  • Community Engagement and Empowerment: Evidence of change can be seen through increased community engagement and empowerment in health-related initiatives. This includes indicators such as active community participation in decision-making processes, the establishment of community-led health programs, or the development of peer support networks.
  • Reduction of Health Inequalities: Evidence of change can be demonstrated through efforts to reduce health inequalities and disparities. This includes indicators such as improved health outcomes among marginalised or vulnerable populations, decreased health gaps between different socio-economic groups or ethnicities, or enhanced equity in healthcare access and provision.

These examples highlight some potential evidence of change that can be observed in initiatives aimed at enhancing health and wellbeing. The specific indicators will depend on the goals, context, and target population of the work. Evaluation methods, such as surveys, health assessments, interviews, or population-based studies, can be utilised to gather evidence and assess the impact and effectiveness of health and wellbeing enhancement efforts.

Example high-scoring ICSs:

Culture

When engaging in work to enhance culture, evidence of change can be demonstrated through various indicators that reflect positive transformations in cultural practices, attitudes, and expressions. Here are some examples of evidence of change for work aimed at enhancing culture:

  • Increased Cultural Participation: Evidence of change can be seen through an increase in cultural participation and engagement. This can be measured by indicators such as higher attendance at cultural events, increased involvement in artistic or cultural activities, or greater community participation in cultural initiatives.
  • Preservation and Conservation: Evidence of change can be demonstrated through successful preservation and conservation efforts. This includes the protection of cultural heritage sites, artifacts, or traditions, as well as the revitalisation of endangered languages, crafts, or cultural practices.
  • Diversity and Inclusivity: Evidence of change can be observed through efforts to promote diversity and inclusivity in cultural expressions. This can be measured by indicators such as increased representation of marginalised or underrepresented groups in cultural activities, greater accessibility to cultural resources, or the fostering of intercultural dialogue and understanding.
  • Cultural Education and Awareness: Evidence of change can be seen through enhanced cultural education and awareness among individuals and communities. This includes indicators such as improved knowledge and understanding of cultural heritage, increased cultural literacy, or the integration of cultural education into formal and informal learning settings.
  • Collaboration and Exchange: Evidence of change can be demonstrated through successful collaborations and cultural exchanges. This includes indicators such as increased partnerships between cultural organisations or practitioners, cross-cultural collaborations, or the facilitation of international cultural exchange programs.
  • Innovation and Creativity: Evidence of change can be observed through the promotion and support of innovation and creativity in cultural expressions. This can be measured by indicators such as the development of new artistic practices, the creation of innovative cultural products, or the recognition and celebration of artistic excellence.
  • Community Empowerment: Evidence of change can be seen through the empowerment of communities in cultural decision-making and expressions. This includes indicators such as increased community involvement in cultural planning and policy development, the establishment of community-led cultural initiatives, or the strengthening of cultural networks and grassroots movements.
  • Cultural Tourism and Economic Development: Evidence of change can be demonstrated through the positive impact of cultural initiatives on tourism and local economies. This includes indicators such as increased cultural tourism activities, job creation in the cultural sector, or the generation of economic benefits for local communities through cultural industries.

These examples highlight some potential evidence of change that can be observed in initiatives aimed at enhancing culture. The specific indicators will depend on the goals, context, and target audience of the cultural work. Evaluation methods, such as surveys, interviews, participant observations, or case studies, can be utilised to gather evidence and assess the impact and effectiveness of cultural enhancement efforts.

Example high-scoring ICSs:

Public understanding

When engaging in work to improve public understanding, evidence of change can be demonstrated through various indicators that reflect positive transformations in knowledge, attitudes, and behaviours among the public. Here are some examples of evidence of change for work aimed at public understanding:

  • Knowledge Acquisition: Evidence of change can be seen through increased knowledge and understanding of specific topics or issues among the public. This can be measured by indicators such as improved performance in knowledge assessments, increased awareness of key facts or concepts, or the ability to articulate informed perspectives on the subject matter.
  • Attitude and Perception Shifts: Evidence of change can be observed through positive shifts in attitudes and perceptions among the public. This includes indicators such as changes in public opinion or attitudes towards a particular issue, increased acceptance of diverse perspectives, or a reduction in misconceptions or stereotypes.
  • Behavioural Changes: Evidence of change can be demonstrated through changes in behaviours or actions resulting from improved public understanding. This includes indicators such as increased adoption of desired behaviours or practices, engagement in informed decision-making processes, or active participation in related initiatives or campaigns.
  • Media Engagement: Evidence of change can be seen through increased engagement with media and information sources that promote accurate and balanced understanding. This includes indicators such as increased viewership or readership of reliable news sources, higher trust in credible information, or the ability to critically evaluate and discern misinformation.
  • Increased Civic Participation: Evidence of change can be observed through increased or sustained public engagement and participation in civic activities. This includes indicators such as higher voter turnout, increased involvement in community organisations or initiatives, or active participation in public consultations and decision-making processes.
  • Awareness and Advocacy: Evidence of change can be demonstrated through increased awareness and advocacy among the public. This includes indicators such as higher levels of public support for specific causes, increased participation in awareness campaigns or public demonstrations, or the establishment of grassroots movements or initiatives related to the subject matter.
  • Policy Influence: Evidence of change can be seen through the influence of public understanding work on policy development and decision-making processes. This includes indicators such as the inclusion of public perspectives in policy discussions, policy changes or reforms that align with public needs or aspirations or increased public engagement in policymaking.
  • Evaluation and Feedback: Evidence of change can be demonstrated through evaluation and feedback mechanisms that capture public perceptions and responses to the work aimed at improving public understanding. This includes indicators such as surveys, focus groups, or public consultations that provide insights into the impact and effectiveness of the initiatives.

These examples highlight potential evidence of change that can be observed in work aimed at improving public understanding. The specific indicators will depend on the goals, context, and subject matter of the work. Evaluation methods, such as surveys, interviews, participant observations, or media analysis, can be utilised to gather evidence and assess the impact and effectiveness of initiatives targeted at enhancing public understanding. Some indicators, such as changes to attitudes and perceptions on a large scale, can be difficult to measure. In such cases, sustained engagement with the public, expansion of engagement activities, increasing engagement over time and take up by others can be proxies of increasing public understanding.

Example high-scoring ICSs:

Public discourse

When engaging in work to improve public discourse, evidence of change can be demonstrated through various indicators that reflect positive transformations in the quality, inclusivity, and effectiveness of public discussions and debates. Here are some examples of evidence of change for work aimed at improving public discourse:

  • Increased Civic Engagement: Evidence of change can be seen through increased civic engagement in public discourse. This includes indicators such as higher participation rates in public meetings, forums, or town hall events, increased public contributions to online platforms or social media discussions, or greater involvement in community-driven initiatives or campaigns.
  • Constructive Dialogue and Debate: Evidence of change can be observed through the promotion of constructive dialogue and debate. This includes indicators such as increased use of respectful language, active listening, and the exchange of diverse perspectives, fostering a culture of mutual respect and understanding during public discussions.
  • Inclusivity and Representation: Evidence of change can be demonstrated through efforts to promote inclusivity and representation in public discourse. This includes indicators such as diverse participation from individuals with different backgrounds, perspectives, and experiences, ensuring a broad range of voices are heard and considered in the discussion.
  • Fact-Based Discussions: Evidence of change can be seen through an emphasis on evidence-based discussions. This includes indicators such as increased use of credible sources, fact-checking, and referencing empirical data or research findings to support arguments, contributing to a more informed and accurate public discourse.
  • Reduction of Polarisation: Evidence of change can be observed through efforts to reduce polarisation and foster more balanced and nuanced discussions. This includes indicators such as the increased presence of dialogue facilitators or mediators, the bridging of ideological divides, and the promotion of empathy and understanding among participants.
  • Collaborative Problem-Solving: Evidence of change can be demonstrated through the promotion of collaborative problem-solving in public discourse. This includes indicators such as the identification of common goals, the exploration of shared interests, and the development of cooperative strategies to address societal challenges, fostering a sense of collective ownership in finding solutions.
  • Media Representation: Evidence of change can be seen through improved media representation in public discourse. This includes indicators such as the presence of diverse voices and perspectives in media coverage, increased opportunities for marginalised or underrepresented groups to share their stories and experiences, and the provision of balanced and unbiased reporting.
  • Evaluation and Feedback: Evidence of change can be demonstrated through evaluation and feedback mechanisms that capture the impact and effectiveness of the work aimed at improving public discourse. This includes indicators such as surveys, audience feedback, or analysis of public discourse platforms to assess the quality, inclusivity, and impact of the initiatives.

These examples highlight potential evidence of change that can be observed in work aimed at improving public discourse. The specific indicators will depend on the goals, context, and subject matter of the work. Evaluation methods, such as surveys, participant observations, media analysis, or qualitative assessments, can be utilised to gather evidence and assess the impact and effectiveness of initiatives targeted at enhancing public discourse. Additionally, sustained engagement, expansion, and increased engagement with time are also indicators for many of these examples.

Example high-scoring ICSs:

Social welfare

When engaging in work on social welfare, evidence of change can be demonstrated through various indicators that reflect positive transformations in the wellbeing, access to services, and quality of life of individuals and communities. Here are some examples of evidence of change for work aimed at social welfare:

  • Improved Access to Basic Needs: Evidence of change can be seen through increased access to essential needs such as food, clean water, shelter, and healthcare. This includes indicators such as reduced rates of hunger or malnutrition, improved sanitation and hygiene practices, increased availability of affordable housing, or enhanced healthcare services and coverage.
  • Poverty Alleviation: Evidence of change can be observed through efforts to alleviate poverty and reduce income inequalities. This includes indicators such as decreased poverty rates, increased income or asset accumulation among marginalised populations, improved economic opportunities or social mobility, or enhanced financial inclusion and empowerment.
  • Education and Skill Development: Evidence of change can be demonstrated through improvements in education and skill development opportunities. This includes indicators such as increased enrolment rates in quality education programs, reduced educational disparities, improved literacy and numeracy skills, or enhanced access to vocational training and lifelong learning opportunities.
  • Social Inclusion and Equity: Evidence of change can be seen through efforts to promote social inclusion and equity. This includes indicators such as reduced discrimination, increased social cohesion, improved access to social protection programs, enhanced participation and representation of marginalised or vulnerable groups, or the reduction of barriers to social integration.
  • Health and Wellbeing: (see also the ‘Health and Well-being’ section, page 9) Evidence of change can be observed through improvements in physical and mental health, as well as overall wellbeing. This includes indicators such as reduced morbidity and mortality rates, increased access to healthcare services and preventive interventions, improved mental health outcomes, enhanced support systems, or higher subjective wellbeing measures.
  • Community Development: Evidence of change can be demonstrated through initiatives that foster community development and empowerment. This includes indicators such as increased community engagement, strengthened social networks, improved local governance structures, enhanced participatory decision-making processes, or the successful implementation of community-driven development projects.
  • Social Services and Support: Evidence of change can be seen through the provision of effective social services and support systems. This includes indicators such as increased availability and accessibility of social welfare programs, improved delivery of social services, enhanced social assistance or safety nets, or the establishment of effective referral mechanisms and case management systems.
  • Reduction of Social Risks and Vulnerabilities: Evidence of change can be demonstrated through efforts to reduce social risks and vulnerabilities. This includes indicators such as decreased rates of violence, exploitation, or abuse, improved disaster preparedness and response, increased resilience among individuals and communities, or the effective support of marginalised or at-risk populations.

These examples highlight some potential evidence of change that can be observed in work aimed at social welfare. The specific indicators will depend on the goals, context, and target population of the work. Evaluation methods, such as surveys, assessments, case studies, or program monitoring, can be utilised to gather evidence and assess the impact and effectiveness of social welfare initiatives.

Example high-scoring ICSs:

Understanding, learning and participation

When engaging in work to enhance understanding, learning, and participation, evidence of change can be demonstrated through various indicators that reflect positive transformations in knowledge acquisition, learning outcomes, and active engagement. Here are some examples of evidence of change for work aimed at enhancing understanding, learning, and participation:

  • Knowledge Acquisition: Evidence of change can be seen through increased knowledge and understanding of specific topics or areas. This includes indicators such as improved performance in knowledge assessments, increased mastery of subject matter, or the ability to articulate informed perspectives on the topic.
  • Learning Outcomes: Evidence of change can be observed through improvements in learning outcomes and skills development. This includes indicators such as increased proficiency in specific skills or competencies, improved critical thinking or problem-solving abilities, or enhanced creativity and innovation.
  • Active Participation: Evidence of change can be demonstrated through increased active participation and engagement. This includes indicators such as increased participation rates in discussions, collaborative activities, or interactive learning experiences, as well as active involvement in decision-making processes.
  • Attitude and Perception Shifts: Evidence of change can be seen through positive shifts in attitudes, perceptions, and beliefs. This includes indicators such as changes in perspectives or values, increased openness to new ideas or diverse viewpoints, or the development of a growth mindset.
  • Collaborative Learning: Evidence of change can be observed through the promotion of collaborative learning and group interaction. This includes indicators such as increased teamwork and cooperation, improved communication and interpersonal skills, or the ability to work effectively in diverse teams.
  • Information and Media Literacy: Evidence of change can be demonstrated through improved information and media literacy skills. This includes indicators such as the ability to critically evaluate information sources, distinguish between credible and unreliable sources, and navigate digital platforms responsibly.
  • Confidence and Self-Efficacy: Evidence of change can be seen through increased confidence and self-efficacy among participants. This includes indicators such as improved self-belief, increased willingness to take on challenges, enhanced self-expression, or the development of leadership and advocacy skills.
  • Sustainable Engagement: Evidence of change can be demonstrated through sustained engagement and continued learning beyond the immediate program or initiative. This includes indicators such as ongoing participation in related activities, continued application of learning in real-life contexts, or the pursuit of further educational opportunities.

These examples highlight some potential evidence of change that can be observed in work aimed at enhancing understanding, learning, and participation. The specific indicators will depend on the goals, context, and target audience of the work. Evaluation methods, such as pre- and post-assessments, surveys, observations, or participant feedback, can be utilised to gather evidence and assess the impact and effectiveness of initiatives focused on understanding, learning, and participation.

Example high-scoring ICSs:

Related Resources: