Does a Long-Term Quality and Safety Curriculum for Health Care Professionals Improve Clinical Practice? An Evaluation of Quality Improvement Projects.
Journal
The Journal of continuing education in the health professions
ISSN: 1554-558X
Titre abrégé: J Contin Educ Health Prof
Pays: United States
ID NLM: 8805847
Informations de publication
Date de publication:
2020
2020
Historique:
pubmed:
27
12
2019
medline:
10
4
2021
entrez:
27
12
2019
Statut:
ppublish
Résumé
Little is known about the effects on clinical practice of continuing education quality and safety curricula. The aim of this study is to gain insight into learning outcomes on the fourth level of the Kirkpatrick evaluation model for systematically deployed quality improvement projects performed by health care professionals during a Masters in Healthcare Quality and Safety in the Netherlands. The researchers reviewed 35 projects led by health care professionals in 16 different hospitals to determine their scopes and effects. Afterward, professionals took an online survey to determine the extent of their project's sustainability and spread. Improving health care safety was the most prevalent quality dimension (n = 11, 31%). A positive change was measured by professionals for 64% (n = 35) of the primary outcomes. Statistical significance was measured in 19 (35%) of the outcomes, of which nine (47%) were found to have a statistically significant effect. A minority of professionals (17%) judged their project as sustained by the department, while some stated that the intervention (37%) or the results of the project (11%) had spread. Although most projects indicated an improvement in their primary outcomes, only a few resulted in statistically significant changes. Teaching professionals in using evaluation methods that take into account the complex context where these projects are performed and teaching them leadership skills is needed to reduce the likelihood of unmeasured outcomes. Analyzing learning experiences of professionals in performing the project is important to see what they learned from performing quality improvement projects, providing experiences that may lead to sustainable effects in future projects.
Identifiants
pubmed: 31876535
doi: 10.1097/CEH.0000000000000277
pii: 00005141-202004010-00002
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
3-10Références
Ferlie EB, Shortell SM. Improving the quality of health care in the United Kingdom and the United States: a framework for change. Milbank Q. 2001;79:281–315.
Scott I. What are the most effective strategies for improving quality and safety of health care? Intern Med J. 2009;39:389–400.
Boonyasai RT, Windish DM, Chakraborti C, et al. Effectiveness of teaching quality improvement to clinicians: a systematic review. JAMA. 2007;298:1023–1037.
Kaminski GM, Britto MT, Schoettker PJ, et al. Developing capable quality improvement leaders. BMJ Qual Saf. 2012;21:903–911.
Ogrinc G, Headrick LA, Mutha S, et al. A framework for teaching medical students and residents about practice-based learning and improvement, synthesized from a literature review. Acad Med. 2003;78:748–756.
Wong BM, Etchells EE, Kuper A, et al. Teaching quality improvement and patient safety to trainees: a systematic review. Acad Med. 2010;85:1425–1439.
Zenlea IS, Billett A, Hazen M, et al. Trainee and program director perceptions of quality improvement and patient safety education: preparing for the next accreditation system. Clin Pediatr (Phila). 2014;53:1248–1254.
Goldman J, Kuper A, Wong BM. How theory can inform our understanding of experiential learning in quality improvement education. Acad Med. 2018;93:1784–1790.
Batalden P, Davidoff F. Teaching quality improvement: the devil is in the details. JAMA. 2007;298:1059–1061.
Kolb DA. Experiential Learning: Experience as the Source of Learning and Development, 2nd ed. Upper Saddle River, NJ: Pearson Education, Inc; 2015.
Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs. The four levels. 3rd ed. San Francisco, CA: Berrett-Koehler; 2006.
Moore DE Jr, Green JS, Gallis HA. Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. J Contin Educ Health Prof. 2009;29:1–15.
Brookfield SD. Understanding and Facilitating Adult Learning: A Comprehensive Analysis of Principles and Effective Practices. Milton Keynes, UK: Open University Press; 1986.
Collins J. Education techniques for lifelong learning: principles of adult learning. Radiographics. 2004;24:1483–1489.
Jennett PA, Swanson RW. Lifelong, self-directed learning: why physicians and educators should be interested. J Contin Educ Health Prof. 1994;14:69–74.
Thistlethwaite J, Moran M; Education WHOSGoI, Practice C. Learning outcomes for interprofessional education (IPE): literature review and synthesis. J Interprof Care. 2010;24:503–513.
Davidoff F, Batalden P, Stevens D, et al. Publication guidelines for quality improvement studies in health care: evolution of the SQUIRE project. BMJ. 2009;338:a3152.
Bowen GA. Document analysis as a qualitative research method. Qual Res J. 2009;9:27–40.
Berwick DM. A user's manual for the IOM's “Quality Chasm” report. Health Aff. 2002;21:80–90.
Verweij LM, Baines R, Friele RD, Wagner C. Implementation of effective interventions requires knowledge of the practice, attention to context and flexibility: evaluation of the ZonMw subprogramme Implementation [in Dutch: Implementatie van doelmatige interventies vraagt kennis van de praktijk, aandacht voor de context en flexibiliteit: evaluatie van het ZonMw deelprogramma Implementatie]. Utrecht: 2015. Available at https://www.nivel.nl/sites/default/files/bestanden/Rapport-deelprogramma-implementatie.pdf. Accessed 2019.
Slaghuis SS, Strating MM, Bal RA, et al. A framework and a measurement instrument for sustainability of work practices in long-term care. BMC Health Serv Res. 2011;11:314.
Slaghuis SS, Strating MM, Bal RA, et al. A measurement instrument for spread of quality improvement in healthcare. Int J Qual Health Care. 2013;25:125–131.
Kroneman M, Boerma W, van den Berg M, et al. Netherlands: health system review. Health Syst Transit. 2016;18:1–240.
Øvretveit J, Gustafson D. Evaluation of quality improvement programmes. BMJ Qual Saf. 2002;11:270–275.
Penfold RB, Zhang F. Use of interrupted time series analysis in evaluating health care quality improvements. Acad Pediatr. 2013;13:S38–S44.
Benneyan JC, Lloyd RC, Plsek PE. Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care. 2003;12:458–464.
Fretheim A, Tomic O. Statistical process control and interrupted time series: a golden opportunity for impact evaluation in quality improvement. BMJ Qual Saf. 2015;24:748–752.
Pett MA. Nonparametric Statistics for Health Care Research: Statistics for Small Samples and Unusual Distributions, 2nd ed. Newbury Park, CA: SAGE Publications; 2015.
Palinkas LA, Aarons GA, Horwitz S, et al. Mixed method designs in implementation research. Adm Policy Ment Health. 2011;38:44–53.
Aarons GA, Fettes DL, Sommerfeld DH, et al. Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012;17:67–79.
Nurjono M, Shrestha P, Lee A, et al. Realist evaluation of a complex integrated care programme: protocol for a mixed methods study. BMJ Open. 2018;8:e017111.
Pawson R, Tilley N. Realist Evaluation. London, UK: SAGE Publications Ltd; 1997.
Kaplan HC, Provost LP, Froehle CM, et al. The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement. BMJ Qual Saf. 2012;21:13–20.
Shah P, Cross V, Sii F. Sailing a safe ship: improving patient safety by enhancing the leadership skills of new consultant specialist surgeons. J Contin Educ Health Prof. 2013;33:190–200.
Donaldson LJ. Safe high quality health care: investing in tomorrow's leaders. Qual Health Care. 2001;10(suppl 2):ii8–12.
Garman A, Scribner L. Leading for quality in healthcare: development and validation of a competency model. J Healthc Manag. 2011;56:373–384.
Gude WT, Roos-Blom MJ, van der Veer SN, et al. Health professionals' perceptions about their clinical performance and the influence of audit and feedback on their intentions to improve practice: a theory-based study in Dutch intensive care units. Implement Sci. 2018;13:33.