Skip to main content
4P Collective
The State of Community Safety Partnerships|National Performance and Outcomes Review|Research complete

Measuring Safer Communities

Can partnerships demonstrate safer communities rather than simply report activity?

Community Safety Partnerships can report substantial activity.

Meetings are held. Operations take place. Services are commissioned. Training is delivered. Campaigns run.

But activity does not, by itself, demonstrate that communities became safer.

This research examines whether partnership performance systems can follow the chain from resources and intervention through outcomes, contribution, learning and Board decision.

Central question

Can the partnership demonstrate what changed, for whom, where, with what confidence and what decision followed?

Research at a glance

The evidence base

50local performance and assurance systems reviewed
12deep-dive case studies
15outcome and performance research areas
10Board challenge questions

This is a structured public-document review. The findings assess publicly evidenced performance and assurance maturity. They are not ratings of operational effectiveness.

The central finding

Most partnerships cannot yet demonstrate the full impact chain

Many partnerships can show activity and selected trends. A smaller group can show a plausible contribution through stronger measures, analysis and governance.

This is not a finding that partnerships are ineffective. It is a finding that the public assurance trail is incomplete.

The whole chain

Stopping at outputs answers what was delivered, not whether communities became safer

Inputs
Activity
Outputs
Short-term outcome
Intermediate outcome
Population or system outcome
Contribution
Board decision

Outputs answer questions such as

  • How many patrols were completed?
  • How many people were trained?
  • How many interventions were delivered?

Outcome assurance asks

  • Who became safer?
  • Where did harm reduce?
  • Did repeat victimisation change?
  • Did access or confidence improve?
  • Were outcomes equitable?
  • What else could explain the result?
  • What should the Board do now?

What is missing

Four gaps make confident outcome assurance difficult

Causal logic

7 of 50

14%

Only seven systems reached developing public evidence for theory of change or causal logic.

Baselines and targets

17 of 50

34%

Clear baselines, targets, tolerances and expected trajectories were not consistently visible.

Evaluation and learning

7 of 50

14%

Formal evaluation remains unusual in the public evidence.

Equality and place

17 of 50

34%

Outcome differences across groups and places were not routinely visible.

Hidden-harm measurement

7 of 50

Seven systems reached developing practice.

Resource, value and sustainability

7 of 50

Seven systems reached developing practice.

Context

Why this matters

Community safety partnerships can report substantial activity. Meetings are held. Operations take place. Services are commissioned. Training is delivered. Campaigns run. But activity does not, by itself, demonstrate that communities became safer.

From strategy to delivery

Partial traceability is the most common public position

00%%

Outcome-led and decision-focused

No system in the reviewed sample publicly evidenced the complete advanced chain.

714%%

Strong performance assurance

Useful outcome evidence, stronger measures, analysis and governance visible in the public record.

3366%%

Mixed

Useful performance evidence alongside substantial activity and output reporting.

612%%

Activity-dominant

Performance reporting dominated by activity, operations and output counts.

48%%

Indeterminate

Insufficient public evidence to classify.

The most common position was a partnership with useful performance evidence alongside substantial activity and output reporting. These figures describe the 50-system reviewed sample. Do not extrapolate them to every CSP nationally.

Fifteen specialist research areas

The research identified 15 specialist performance and outcome areas

These are specialist research areas for Practice Standards development. They are not replacement CSP Health Check domains.

1.Outcome clarity
2.Theory of change and causal logic
3.Balanced measure architecture
4.Baseline and target quality
5.Statistical and analytical quality
6.Harm, repeat and concentration
7.Equality and place analysis
8.Public confidence and lived experience
9.Hidden-harm measurement
10.Dashboard design and usability
11.Ownership and corrective action
12.Board assurance and challenge
13.Evaluation and learning
14.Resource, value and sustainability
15.Transparency and continuous improvement

These are specialist research areas for Practice Standards development. They are not replacement CSP Health Check domains.

Transferable practice

Strong practice appeared in different parts of the public offer

The review identified recurring examples of stronger practice. These findings relate to specific features of the public offer, not overall partnership performance.

Harm-weighted analysis

Harm weighting, rates, local comparison and resident survey methodology can make performance evidence more meaningful than volume counts alone.

Transparent methodological caveats

Multi-year trend intent, rate and volume distinction, perceptions and transparent methodological caveats strengthen the credibility of performance reporting.

Board challenge of weak measures

Board-level willingness to identify adverse or incomplete measures and commission refinement is a sign of genuine performance assurance.

Defined performance rules

Defined RAG rules, equality narrative, confidence measures and between-meeting KPI monitoring support consistent Board challenge.

Balanced resident, victim and delivery evidence

Quarterly reporting combining resident and victim views, crime, service performance and delivery provides a more complete assurance picture.

Place-based analytical infrastructure

Neighbourhood-level analysis, harm concentration mapping and place-based outcome tracking can identify where change is and is not happening.

From research to practice standards

This research is informing the developing 4P CSP Practice Standards

In development

4P Outcomes and Performance Practice Standard

A research-informed standard for defining outcomes, measuring change, interpreting uncertainty and turning performance evidence into Board decisions.

The standard will consider

These are specialist research areas for Practice Standards development. They are not replacement CSP Health Check domains.

What this research can tell us

Public evidence can test visibility and accountability, not unseen operational effectiveness

  • 50 systems were reviewed in detail
  • 12 were examined as deep dives
  • the sample was purposive
  • public evidence does not establish unseen operational practice
  • zero means not publicly evidenced, not necessarily absent
  • no complete national indicator inventory was available
  • no defensible national percentage of all indicators by type was calculated
  • population crime change cannot normally be attributed solely to the CSP
  • contribution should be assessed proportionately through theory, triangulation and evaluation
  • public transparency and document availability affect what can be assessed
  • no simplistic national league table is justified

Honest uncertainty is stronger than false assurance.

Collective delivery

Strategy delivery is not the responsibility of the Community Safety team alone

A Community Safety Strategy is a collective partnership commitment.

Different organisations around the CSP table own different parts of the evidence, resources, services, powers and delivery required to turn that commitment into action.

Chair

Does the Board receive evidence that supports decisions rather than simply status updates?

Partnership manager

Can priorities, outcomes, indicators, exceptions, actions and decisions be followed through one assurance system?

Police

Are crime, severity, repeat harm and operational intelligence presented as evidence within a wider partnership picture rather than treated as proof of partnership impact?

Local authority

Are ASB, housing, regulatory, neighbourhood, public health and wider council outcomes connected to partnership priorities?

Fire and Rescue

Are prevention, vulnerability, repeat demand and place-based outcomes visible where Fire and Rescue contributes?

Health and ICB

Are violence injury, mental health, substance use, population need and health inequality informing outcome assessment?

Probation

Are reoffending, resettlement and risk outcomes linked to partnership priorities where relevant?

Youth Justice

Are youth violence, first-time entrants, reoffending, diversion and young people's outcomes visible?

Education

Where prevention depends on education, are safety, attendance, exclusion and young people's experience included appropriately?

Prison and Youth Custody

Where local priorities depend on release and resettlement, can relevant transition outcomes be followed?

Housing and Registered Providers

Are repeat ASB, housing stability, vulnerability, place and resident outcomes visible?

Voluntary and specialist sector

Are service outcomes, hidden harm, access, victim experience and qualitative evidence part of the assurance picture?

Community and lived experience

Can residents and people affected by harm see whether their experience is changing and whether their evidence influenced decisions?

What the research found

Key findings

  1. Outcome language is more common than outcome architecture

    40 of 50 systems had at least developing outcome clarity. Only 7 showed even developing public theory of change or causal logic.

  2. Dashboards can monitor crime without assuring partnership performance

    Crime trends are important context. They do not automatically show what the partnership changed, for whom, at what cost or with what confidence.

  3. Hidden harm cannot be read like ordinary demand

    A rise in domestic abuse, sexual violence, hate crime, exploitation or modern slavery reporting can mean increased harm, increased trust, better identification or changes in recording. Direction alone is not enough.

  4. Board reporting is more visible than Board challenge

    Recurring governance and performance reporting was common. The question, decision, owner, deadline and follow-up were less consistently visible.

  5. Honest uncertainty is stronger than false attribution

    Partnerships should not claim sole credit for population-level crime change. The stronger test is a credible contribution story supported by good evidence and proportionate evaluation.

What better looks like

A Board needs more than one type of measure

Harm

  • Volume
  • Severity
  • Repeat
  • Concentration

People and place

  • Inequality
  • Neighbourhood
  • Displacement

Experience

  • Confidence
  • Fear
  • Victim and survivor experience

Delivery

  • Reach
  • Quality
  • Fidelity
  • Timeliness

Learning

  • Contribution
  • Evaluation
  • Negative or inconclusive findings

Governance

  • Owner
  • Action
  • Deadline
  • Decision
  • Follow-up

No single indicator proves that a community is safer. The strength comes from the pattern across different forms of evidence.

Self-assessment

Questions for boards

These questions emerged from the research. A strong partnership should be able to answer each one with evidence.

  1. What precisely would be different if this priority succeeded?

  2. Which measures are outputs and which are outcomes?

  3. What is the baseline, target or tolerance?

  4. Who and where is experiencing worse outcomes?

  5. What repeats: victim, person causing harm, place or demand?

  6. Could a rise in reports indicate more trust or better identification?

  7. What makes our contribution plausible?

  8. What has not worked and what changed?

  9. Who owns the corrective action and by when?

  10. What decision are we recording today?

A practical route forward

Six steps to strengthen the strategy-to-delivery chain

Complete one outcome chain

Complete one outcome chain for the highest-risk priority.

Classify every current measure

Classify every current dashboard measure by level.

Retire weak measures

Retire measures that cannot support a decision.

Create an indicator dictionary

Create an indicator dictionary.

Add missing evidence types

Add repeat harm, equality and place, lived experience and hidden-harm interpretation.

Replace report noted

Replace report noted with a decision and action record.

Select one intervention for evaluation

Select one material intervention for proportionate evaluation.

Publish an outcome statement

Publish a concise outcome statement with limitations.

Connection to the 4P CSP Health Check

The Strategy Gap provides evidence for why the existing Health Check tests delivery as well as strategy

The 4P CSP Health Check already distinguishes between what the strategy says and how the partnership delivers it.

The Strategy Gap research provides a deeper evidence base for that distinction.

Clear outcome chains

Domain 4: Priorities and Intended Outcomes

Baselines, measurement feasibility and hidden harm

Domain 2: Evidence and Local Need

Lived experience and confidence

Domain 3: Community and Lived Experience

Domain 9: Communication, Engagement and Public Confidence

Board ownership, challenge and decisions

Domain 5: Partnership, Governance and Accountability

Domain 7: Performance, Data and Assurance

Delivery quality and fidelity

Domain 6: Delivery and Implementation

Equality and place

Domain 8: Equality, Safeguarding and Accessibility

Evaluation, negative findings and adaptation

Domain 10: Review, Learning and Continuous Improvement

The research strengthens the evidence base behind these existing Health Check questions. It does not replace the current domains, master question bank or scoring model.

Methodology note

The current CSP Health Check remains fixed. The research provides deeper evidence for why outcomes, data quality, equality, evaluation and Board decisions matter. It does not change the live Health Check weighting, scoring, questions or domains.

From finding to practice

The research produced practical tools for the next assessment cycle

CSP Outcomes Framework

Coming soon

Defines population and place, system and service or intervention outcome levels without requiring false claims of sole attribution.

Performance Measure Bank

Coming soon

A design resource covering harm, repeat, confidence, equality, victim experience and thematic outcome measures.

Board Dashboard Specification

Coming soon

An exception-led Board product focused on outcomes, uncertainty, inequality, corrective action and decisions.

Outcome-Chain Builder

Coming soon

Connects need, intervention, assumptions, inputs, outputs, outcomes, contribution, evaluation and Board decision.

Indicator Dictionary

Coming soon

Defines numerator, denominator, source, owner, baseline, target or tolerance, limitations and interpretation rules.

Performance Narrative and Corrective-Action Record

Coming soon

Connects exceptions to diagnosis, action, owner, deadline, expected effect and Board decision.

Evaluation Summary

Coming soon

Provides a structured route for reporting process, outcome, equality, cost, limitations and negative findings.

Quarterly Assurance Model

Coming soon

Tests data quality, analytical interpretation, exceptions, challenge, decisions and follow-up.

Research boundary

50 systems were reviewed in detail. 12 were examined as deep dives. The sample was purposive. Public evidence does not establish unseen operational practice. Zero means not publicly evidenced, not necessarily absent. No complete national indicator inventory was available. No defensible national percentage of all indicators by type was calculated. Population crime change cannot normally be attributed solely to the CSP. Contribution should be assessed proportionately through theory, triangulation and evaluation. Public transparency and document availability affect what can be assessed. No simplistic national league table is justified.

Honest uncertainty is stronger than false assurance.

From research to practice

Test whether your partnership can demonstrate change, not simply activity

The 4P CSP Health Check already separates Strategy Quality from Delivery Maturity and tests Performance, Data and Assurance within the wider partnership system. This research provides deeper evidence for why outcomes, data quality, equality, evaluation and Board decisions matter.