Cluster randomised evaluation of a training intervention to increase the use of statistical process control charts for hospitals in England: making data count.

continuous quality improvement decision making healthcare quality improvement implementation science

Journal

BMJ quality & safety
ISSN: 2044-5423
Titre abrégé: BMJ Qual Saf
Pays: England
ID NLM: 101546984

Informations de publication

Date de publication:
04 Sep 2024
Historique:
received: 08 01 2024
accepted: 01 08 2024
medline: 6 9 2024
pubmed: 6 9 2024
entrez: 5 9 2024
Statut: aheadofprint

Résumé

The way that data are presented can influence quality and safety initiatives. Time-series charts highlight changes but do not clarify whether data lie outside expected variation. Statistical process control (SPC) charts make this distinction and have been demonstrated to be effective in supporting hospital initiatives. To improve the uptake of the SPC methodology by hospitals in England, a training intervention was created. The current study evaluates the effectiveness of that training against the background of a wider national initiative to encourage the adoption of SPC charts. A parallel cluster randomised trial was conducted with 16 English NHS hospitals. Half were randomised to the training intervention and half to the control. The primary analysis compares the difference in use of SPC charts within hospital board papers in a postrandomisation period (adjusting for baseline use). Trainees completed feedback forms with Likert scale and open-ended items. Fifteen hospitals participated across the study arms. SPC chart use increased in both intervention and control hospitals between the baseline and postrandomisation period (29 and 30 percentage points, respectively). There was no statistically significant difference between the intervention and control hospitals in use of SPC charts in the postrandomisation period (average absolute difference 9% (95% CI -34% to 52%). In the feedback forms, 93.9% (n=31/33) of trainees affirmed learning and 97.0% (n=32/33) had formed an intention to change their behaviour. Control chart use increased in both intervention and control hospitals. This is consistent with a rising tide and/or contamination effect, such that the culture of control chart use is spreading across hospitals in England. Further research is needed to support hospitals implementing SPC training initiatives and to link SPC implementation to quality and safety outcomes. Such research could support future quality and safety initiatives nationally and internationally. NCT04977414.

Sections du résumé

BACKGROUND BACKGROUND
The way that data are presented can influence quality and safety initiatives. Time-series charts highlight changes but do not clarify whether data lie outside expected variation. Statistical process control (SPC) charts make this distinction and have been demonstrated to be effective in supporting hospital initiatives. To improve the uptake of the SPC methodology by hospitals in England, a training intervention was created. The current study evaluates the effectiveness of that training against the background of a wider national initiative to encourage the adoption of SPC charts.
METHODS METHODS
A parallel cluster randomised trial was conducted with 16 English NHS hospitals. Half were randomised to the training intervention and half to the control. The primary analysis compares the difference in use of SPC charts within hospital board papers in a postrandomisation period (adjusting for baseline use). Trainees completed feedback forms with Likert scale and open-ended items.
RESULTS RESULTS
Fifteen hospitals participated across the study arms. SPC chart use increased in both intervention and control hospitals between the baseline and postrandomisation period (29 and 30 percentage points, respectively). There was no statistically significant difference between the intervention and control hospitals in use of SPC charts in the postrandomisation period (average absolute difference 9% (95% CI -34% to 52%). In the feedback forms, 93.9% (n=31/33) of trainees affirmed learning and 97.0% (n=32/33) had formed an intention to change their behaviour.
CONCLUSIONS CONCLUSIONS
Control chart use increased in both intervention and control hospitals. This is consistent with a rising tide and/or contamination effect, such that the culture of control chart use is spreading across hospitals in England. Further research is needed to support hospitals implementing SPC training initiatives and to link SPC implementation to quality and safety outcomes. Such research could support future quality and safety initiatives nationally and internationally.
TRIAL REGISTRATION NUMBER BACKGROUND
NCT04977414.

Identifiants

pubmed: 39237263
pii: bmjqs-2024-017094
doi: 10.1136/bmjqs-2024-017094
pii:
doi:

Banques de données

ClinicalTrials.gov
['NCT04977414']

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Informations de copyright

© Author(s) (or their employer(s)) 2024. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Déclaration de conflit d'intérêts

Competing interests: None declared.

Auteurs

Kelly Ann Schmidtke (KA)

Liberal Arts and Basic Sciences, University of Health Sciences and Pharmacy in St Louis, Saint Louis, Missouri, USA Kelly.Schmidtke@uhsp.edu.
Warwick Medical School, University of Warwick, Coventry, UK.

Laura Kudrna (L)

University of Birmingham, Birmingham, UK.

Laura Quinn (L)

University of Birmingham, Birmingham, UK.

Paul Bird (P)

Institute of Applied Health, University of Birmingham, Institute of Translational Medicine, University Hospitals Birmingham NHS Foundation Trust, Birmingham Health Partners, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK.
Health Innovation West Midlands, Birmingham, UK.

Karla Hemming (K)

School of Health and Population Sciences, University of Birmingham, Birmingham, UK.

Zoe Venable (Z)

Liberal Arts and Basic Sciences, University of Health Sciences and Pharmacy in St Louis, Saint Louis, Missouri, USA.

Richard Lilford (R)

Institute of Applied Health Research, University of Birmingham, Birmingham, UK.

Classifications MeSH