Behavioral skills training for teaching safety skills to mental health service providers compared to training-as-usual: a pragmatic randomized control trial.
Behavioural skills training
Performance and competency-based staff training
Violence prevention
Workplace violence
Journal
BMC health services research
ISSN: 1472-6963
Titre abrégé: BMC Health Serv Res
Pays: England
ID NLM: 101088677
Informations de publication
Date de publication:
17 May 2024
17 May 2024
Historique:
received:
06
09
2023
accepted:
16
04
2024
medline:
18
5
2024
pubmed:
18
5
2024
entrez:
17
5
2024
Statut:
epublish
Résumé
Violence in the healthcare workplace has been a global concern for over two decades, with a high prevalence of violence towards healthcare workers reported. Workplace violence has become a healthcare quality indicator and embedded in quality improvement initiatives of many healthcare organizations. The Centre for Addiction and Mental Health (CAMH), Canada's largest mental health hospital, provides all clinical staff with mandated staff safety training for self-protection and team-control skills. These skills are to be used as a last resort when a patient is at imminent risk of harm to self or others. The purpose of this study is to compare the effectiveness of two training methods of this mandated staff safety training for workplace violence in a large psychiatric hospital setting. Using a pragmatic randomized control trial design, this study compares two approaches to teaching safety skills CAMH's training-as-usual (TAU) using the 3D approach (description, demonstration and doing) and behavioural skills training (BST), from the field of applied behaviour analysis, using instruction, modeling, practice and feedback loop. Staff were assessed on three outcome measures (competency, mastery and confidence), across three time points: before training (baseline), immediately after training (post-training) and one month later (follow-up). This study was registered with the ISRCTN registry on 06/09/2023 (ISRCTN18133140). With a sample size of 99 new staff, results indicate that BST was significantly better than TAU in improving observed performance of self-protection and team-control skills. Both methods were associated with improved skills and confidence. However, there was a decrease in skill performance levels at the one-month follow-up for both methods, with BST remaining higher than TAU scores across all three time points. The impact of training improved staff confidence in both training methods and remained high across all three time points. The study findings suggest that BST is more effective than TAU in improving safety skills among healthcare workers. However, the retention of skills over time remains a concern, and therefore a single training session without on-the-job-feedback or booster sessions based on objective assessments of skill may not be sufficient. Further research is needed to confirm and expand upon these findings in different settings.
Sections du résumé
BACKGROUND
BACKGROUND
Violence in the healthcare workplace has been a global concern for over two decades, with a high prevalence of violence towards healthcare workers reported. Workplace violence has become a healthcare quality indicator and embedded in quality improvement initiatives of many healthcare organizations. The Centre for Addiction and Mental Health (CAMH), Canada's largest mental health hospital, provides all clinical staff with mandated staff safety training for self-protection and team-control skills. These skills are to be used as a last resort when a patient is at imminent risk of harm to self or others. The purpose of this study is to compare the effectiveness of two training methods of this mandated staff safety training for workplace violence in a large psychiatric hospital setting.
METHODS
METHODS
Using a pragmatic randomized control trial design, this study compares two approaches to teaching safety skills CAMH's training-as-usual (TAU) using the 3D approach (description, demonstration and doing) and behavioural skills training (BST), from the field of applied behaviour analysis, using instruction, modeling, practice and feedback loop. Staff were assessed on three outcome measures (competency, mastery and confidence), across three time points: before training (baseline), immediately after training (post-training) and one month later (follow-up). This study was registered with the ISRCTN registry on 06/09/2023 (ISRCTN18133140).
RESULTS
RESULTS
With a sample size of 99 new staff, results indicate that BST was significantly better than TAU in improving observed performance of self-protection and team-control skills. Both methods were associated with improved skills and confidence. However, there was a decrease in skill performance levels at the one-month follow-up for both methods, with BST remaining higher than TAU scores across all three time points. The impact of training improved staff confidence in both training methods and remained high across all three time points.
CONCLUSIONS
CONCLUSIONS
The study findings suggest that BST is more effective than TAU in improving safety skills among healthcare workers. However, the retention of skills over time remains a concern, and therefore a single training session without on-the-job-feedback or booster sessions based on objective assessments of skill may not be sufficient. Further research is needed to confirm and expand upon these findings in different settings.
Identifiants
pubmed: 38760754
doi: 10.1186/s12913-024-10994-1
pii: 10.1186/s12913-024-10994-1
doi:
Types de publication
Journal Article
Randomized Controlled Trial
Pragmatic Clinical Trial
Comparative Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
639Informations de copyright
© 2024. The Author(s).
Références
International Labour Organization. Joint Programme Launches New Initiative Against Workplace Violence in the Health Sector. 2002. Available from: https://www.ilo.org/global/about-the-ilo/newsroom/news/WCMS_007817/lang--en/index.htm . Cited 2022 Aug 5.
Di Martino V. Workplace violence in the health sector. Country case studies Brazil, Bulgaria, Lebanon, Portugal, South Africa, Thailand and an Additional Australian Study. Geneva: ILO/ICN/WHO/PSI Joint Programme on Workplace Violence in the Health Sector; 2002.
Needham I, Kingma M, O’Brien-Pallas L, McKenna K, Tucker R, Oud N, editors. Workplace Violence in the Health Sector. In: Proceedings of the First International Conference on Workplace Violence in the Health Sector - Together, Creating a Safe Work Environment. The Netherlands: Kavanah; 2008. p. 383.
Health Quality Ontario. Quality Improvement Plan Guidance: Workplace Violence Prevention. 2019.
Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573–6.
pubmed: 25384822
pmcid: 4226781
doi: 10.1370/afm.1713
Somani R, Muntaner C, Hillan E, Velonis AJ, Smith P. A Systematic review: effectiveness of interventions to de-escalate workplace violence against nurses in healthcare settings. Saf Health Work. 2021;12(3):289–95. https://doi.org/10.1016/j.shaw.2021.04.004 .
doi: 10.1016/j.shaw.2021.04.004
pubmed: 34527388
pmcid: 8430427
Li Y, Li RQ, Qiu D, Xiao SY. Prevalence of workplace physical violence against health care professionals by patients and visitors: a systematic review and meta-analysis. Int J Environ Res Public Health. 2020;17(1):299.
pubmed: 31906306
pmcid: 6982349
doi: 10.3390/ijerph17010299
Liu J, Gan Y, Jiang H, Li L, Dwyer R, Lu K, et al. Prevalence of workplace violence against healthcare workers: a systematic review and meta-analysis. Occup Environ Med. 2019;76(12):927–37.
pubmed: 31611310
doi: 10.1136/oemed-2019-105849
O’Rourke M, Wrigley C, Hammond S. Violence within mental health services: how to enhance risk management. Risk Manag Healthc Policy. 2018;11:159–67.
pubmed: 30254500
pmcid: 6143650
doi: 10.2147/RMHP.S131834
Odes R, Chapman S, Harrison R, Ackerman S, Hong OS. Frequency of violence towards healthcare workers in the United States’ inpatient psychiatric hospitals: a systematic review of literature. Int J Ment Health Nurs. 2021;30(1):27–46.
pubmed: 33150644
doi: 10.1111/inm.12812
Gerberich SG, Church TR, McGovern PM, Hansen HE, Nachreiner NM, Geisser MS, et al. An epidemiological study of the magnitude and consequences of work related violence: the minnesota nurses’ study. Occup Environ Med. 2004;61(6):495–503.
pubmed: 15150388
pmcid: 1763639
doi: 10.1136/oem.2003.007294
Ridenour M, Lanza M, Hendricks S, Hartley D, Rierdan J, Zeiss R, et al. Incidence and risk factors of workplace violence on psychiatric staff. Work. 2015;51(1):19–28.
pubmed: 24894691
pmcid: 4674794
doi: 10.3233/WOR-141894
Cooper AJ, Mendonca JD. A prospective study of patient assaults on nurses in a provincial psychiatric hospital in Canada. Acta Psychiatr Scand. 1991;84(2):163–6.
pubmed: 1950611
doi: 10.1111/j.1600-0447.1991.tb03122.x
Hiebert BJ, Care WD, Udod SA, Waddell CM. Psychiatric nurses’ lived experiences of workplace violence in acute care psychiatric Units in Western Canada. Issues Ment Health Nurs. 2022;43(2):146–53.
pubmed: 34379570
doi: 10.1080/01612840.2021.1956656
Lim M, Jeffree M, Saupin S, Giloi N, Lukman K. Workplace violence in healthcare settings: the risk factors, implications and collaborative preventive measures. Ann Med Surg. 2022;78:103727.
doi: 10.1016/j.amsu.2022.103727
Lanctôt N, Guay S. The aftermath of workplace violence among healthcare workers: a systematic literature review of the consequences. Aggress Violent Behav. 2014;19(5):492–501.
doi: 10.1016/j.avb.2014.07.010
Friis K, Pihl-Thingvad J, Larsen FB, Christiansen J, Lasgaard M. Long-term adverse health outcomes of physical workplace violence: a 7-year population-based follow-up study. Eur J Work Organ Psychol. 2019;28(1):101–9.
doi: 10.1080/1359432X.2018.1548437
Berlanda S, Pedrazza M, Fraizzoli M, de Cordova F. Addressing risks of violence against healthcare staff in emergency departments: the effects of job satisfaction and attachment style. Biomed Res Int. 2019;28(5430870):1–12.
doi: 10.1155/2019/5430870
Baig LA, Ali SK, Shaikh S, Polkowski MM. Multiple dimensions of violence against healthcare providers in Karachi: results from a multicenter study from Karachi. J Pakistani Med Assoc. 2018;68(8):1157–65.
International Labour Organization. Safe and healthy working environments free from violence and harassment. International Labour Organization. Geneva: International Labour Organization; 2020. Available from: https://www.ilo.org/global/topics/safety-and-health-at-work/resources-library/publications/WCMS_751832/lang--en/index.htm .
Wirth T, Peters C, Nienhaus A, Schablon A. Interventions for workplace violence prevention in emergency departments: a systematic review. Int J Environ Res Public Health. 2021;18(16):8459.
pubmed: 34444208
pmcid: 8392011
doi: 10.3390/ijerph18168459
U.S. Congress. Workplace Violence Prevention for Health Care and Social Service Workers Act. U.S.A.; 2020. Available from: https://www.congress.gov/bill/116th-congress/house-bill/1309 .
Lu A, Ren S, Xu Y, Lai J, Hu J, Lu J, et al. China legislates against violence to medical workers. TneLancet Psychiatry. 2020;7(3):E9.
pubmed: 32087814
Government of Ontario Ministry of Labour T and SD. Preventing workplace violence in the health care sector | ontario.ca. 2020. Available from: https://www.ontario.ca/page/preventing-workplace-violence-health-care-sector . Cited 2020 Jul 28.
Safe and Well Committee. Safe & Well Newsletter. 2018. Available from: http://insite.camh.net/files/SafeWell_Newsletter_October2018_107833.pdf .
Patel MX, Sethi FN, Barnes TR, Dix R, Dratcu L, Fox B, et al. Joint BAP NAPICU evidence-based consensus guidelines for the clinical management of acute disturbance: de-escalation and rapid tranquillisation. J Psychiatr Intensive Care. 2018;14(2):89–132.
doi: 10.20299/jpi.2018.008
Heckemann B, Zeller A, Hahn S, Dassen T, Schols JMGA, Halfens RJG. The effect of aggression management training programmes for nursing staff and students working in an acute hospital setting. A narrative review of current literature. Nurse Educ Today. 2015;35(1):212–9.
pubmed: 25200511
doi: 10.1016/j.nedt.2014.08.003
Price O, Baker J, Bee P, Lovell K. Learning and performance outcomes of mental health staff training in de-escalation techniques for the management of violence and aggression. Br J Psychiatry. 2015;206:447–55.
pubmed: 26034178
doi: 10.1192/bjp.bp.114.144576
Geoffrion S, Hills DJ, Ross HM, Pich J, Hill AT, Dalsbø TK, et al. Education and training for preventing and minimizing workplace aggression directed toward healthcare workers. Cochrane Database Syst Rev. 2020;9(Art. No.: CD011860). Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8094156/ . Cited 2021 Dec 3.
Paterson B, Turnbull J, Aitken I. An evaluation of a training course in the short-term management of violence. Nurse Educ Today. 1992;12(5):368–75.
pubmed: 1448026
doi: 10.1016/0260-6917(92)90113-3
Rice ME, Helzel MF, Varney GW, Quinsey VL. Crisis prevention and intervention training for psychiatric hospital staff. Am J Community Psychol. 1985;13(3):289–304.
pubmed: 4025244
doi: 10.1007/BF00914934
Wondrak R, Dolan B. Dealing with verbal abuse: evaluation of the efficacy of a workshop for student nurses. Nurse Educ Today. 1992;12(2):108–15.
pubmed: 1584165
doi: 10.1016/0260-6917(92)90036-N
Leach B, Gloinson ER, Sutherland A, Whitmore M. Reviewing the evidence base for de-escalation training: a rapid evidence assessment. RAND research reports. RAND Corporation; 2019. Available from: https://www.rand.org/pubs/research_reports/RR3148.html . Cited 2021 Nov 26.
Parsons MB, Rollyson JH, Reid DH. Evidence-based staff training: a guide for practitioners. Behav Anal Pract. 2012;5(2):2–11.
pubmed: 23730462
pmcid: 3592486
doi: 10.1007/BF03391819
Miltenberger RG, Flessner C, Gatheridge B, Johnson B, Satterlund M, Egemo K. Evaluation of behavioral skills training to prevent gun play in children. J Appl Bahavior Anal. 2004;37:513–6.
doi: 10.1901/jaba.2004.37-513
Baer DM, Wolf MM, Risley TR. Some still-current dimensions of applied behavior analysis. J Appl Behav Anal. 1987;20(4):313–27.
pubmed: 16795703
pmcid: 1286071
doi: 10.1901/jaba.1987.20-313
Dillenburger K. Staff training. Handbook of treatments for autism spectrum disorder. In: Matson JL, editor. Handbook of treatments for autism spectrum disorder. Switzerland: Springer Nature; 2017. p. 95–107.
Kirkpatrick M, Akers J, Rivera G. Use of behavioral skills training with teachers: a systematic review. J Behav Educ. 2019;28(3):344–61.
doi: 10.1007/s10864-019-09322-z
Sun X. Behavior skills training for family caregivers of people with intellectual or developmental disabilities: a systematic review of literature. Int J Dev Disabil. 2020:68(3):247-73.
Davis S, Thomson K, Magnacca C. Evaluation of a caregiver training program to teach help-seeking behavior to children with autism spectrum disorder. Int J Dev Disailities. 2020;66(5):348–57.
doi: 10.1080/20473869.2020.1812144
Gormley L, Healy O, O’Sullivan B, O’Regan D, Grey I, Bracken M. The impact of behavioural skills training on the knowledge, skills and well-being of front line staff in the intellectual disability sector: a clustered randomised control trial. J Intellect Disabil Res. 2019;63(11):1291–304.
pubmed: 31106922
doi: 10.1111/jir.12630
Lin E, Malhas M, Bratsalis E, Thomson K, Boateng R, Hargreaves F, et al. Behavioural skills training for teaching safety skills to mental health clinicians: A protocol for a pragmatic randomized control trial. JMIR Res Protoc. 2022;11(12):e39672.
GraphPad. Randomly assign subjects to treatment groups. Available from: https://www.graphpad.com/quickcalcs/randomize1.cfm . Cited 2023 June 6.
Van Voorhis CRW, Morgan BL. Understanding power and rules of thumb for determining sample sizes. Tutor Quant Methods Psychol. 2007;3(2):43–50.
doi: 10.20982/tqmp.03.2.p043
Erath TG, DiGennaro Reed FD, Sundermeyer HW, Brand D, Novak MD, Harbison MJ, et al. Enhancing the training integrity of human service staff using pyramidal behavioral skills training. J Appl Behav Anal. 2020;53(1):449–64.
pubmed: 31301072
doi: 10.1002/jaba.608
Wong KK, Fienup DM, Richling SM, Keen A, Mackay K. Systematic review of acquisition mastery criteria and statistical analysis of associations with response maintenance and generalization. Behav Interv. 2022;37(4):993–1012.
doi: 10.1002/bin.1885
Richling SM, Williams WL, Carr JE. The effects of different mastery criteria on the skill maintenance of children with developmental disabilities. J Appl Behav Anal. 2019;52(3):701–17 (Available from: https://pubmed.ncbi.nlm.nih.gov/31155708/ ). Cited 2022 Oct 14.
pubmed: 31155708
doi: 10.1002/jaba.580
Pitts L, Hoerger ML. Mastery criteria and the maintenance of skills in children with developmental disabilities. Behav Interv. 2021;36(2):522–31. Available from: https://doi.org/10.1002/bin.1778 . Cited 2022 Oct 17.
R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2021.
Pinheiro J, Bates D. Mixed-effects models in S and S-PLUS. New York: Springer Science+Business Media; 2006.
Bosker R, Snijders TA. Multilevel analysis: An introduction to basic and advanced multilevel modeling. In: Analysis M, editor. London. UK: Sage Publishers; 2012. p. 1–368.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.
Taylor DCM, Hamdy H. Adult learning theories: Implications for learningand teaching in medical education: AMEEGuide No. 83. Med Teach. 2013;35(11):e1561-72.
pubmed: 24004029
doi: 10.3109/0142159X.2013.828153
Nodine TR. How did we get here? A brief history of competency-based higher education in the United States. Competency Based Educ. 2016;1:5–11.
doi: 10.1002/cbe2.1004
Novak MD, Reed FDD, Erath TG, Blackman AL, Ruby SA, Pellegrino AJ. Evidence-Based Performance Management: Applying behavioral science to support practitioners. Perspect Behav Sci. 2019;42:955–72.
pubmed: 31976469
pmcid: 6901648
doi: 10.1007/s40614-019-00232-z
Fienup DM, Broadsky J. Effects of mastery criterion on the emergence of derived equivalence relations. J Appl Behav Anal. 2017;40:843–8.
doi: 10.1002/jaba.416
Fuller JL, Fienup DM. A preliminary analysis of mastery criterion level: effects on response maintenance. Behav Anal Pract. 2018;11(1):1–8.
pubmed: 29556443
doi: 10.1007/s40617-017-0201-0
Alavosius MP, Sulzer-Azaroff B. The effects of performance feedback on the safety of client lifting and transfer. J Appl Behav Anal. 1986;19:261–7.
pubmed: 2945810
pmcid: 1308070
doi: 10.1901/jaba.1986.19-261
Hogan A, Knez N, Kahng S. Evaluating the use of behavioral skills training to improve school staffs’ implementation of behavior intervention plans. J Behav Educ. 2015;24(2):242–54.
doi: 10.1007/s10864-014-9213-9
Nabeyama B, Sturmey P. Using behavioral skills training to promote safe and correct staff guarding and ambulation distance of students with multiple physical disabilities. J Appl Behav Anal. 2010;43(2):341–5.
pubmed: 21119911
pmcid: 2884361
doi: 10.1901/jaba.2010.43-341
Parsons MB, Rollyson JH, Reid DH. Teaching practitioners to conduct behavioral skills training: a pyramidal approach for training multiple human service staff. Behav Anal Pract. 2013;6(2):4–16.
pubmed: 27999628
pmcid: 5139667
doi: 10.1007/BF03391798
Sarakoff RA, Sturmey P. The effects of behavioral skills training on staff implementation of discrete-trial teaching. J Appl Behav Anal. 2004;37(4):535–8.
doi: 10.1901/jaba.2004.37-535
Offiah G, Ekpotu LP, Murphy S, Kane D, Gordon A, O’Sullivan M, et al. Evaluation of medical student retention of clinical skills following simulation training. BMC Med Educ. 2019;19:263.
pubmed: 31311546
pmcid: 6632214
doi: 10.1186/s12909-019-1663-2
Bruno P, Ongaro A, Fraser I. Long-term retention of material taught and examined in chiropractic curricula: its relevance to education and clinical practice. J Can Chiropr Assoc. 2007;51(1):14–8.
pubmed: 17657286
pmcid: 1924649
Yates N, Gough S, Brazil V. Self-assessment: With all its limitations, why are we still measuring and teaching it? Lessons from a scoping review. Med Teach. 2022;44(11):1296–302. https://doi.org/10.1080/0142159X.2022.2093704 .
doi: 10.1080/0142159X.2022.2093704
pubmed: 35786121
Lu FI, Takahashi SG, Kerr C. Myth or reality: self-assessment is central to effective curriculum in anatomical pathology graduate medical education. Acad Pathol. 2021;8:23742895211013530.
pubmed: 34027054
pmcid: 8120525
doi: 10.1177/23742895211013528
Magnacca C, Thomson K, Marcinkiewicz A, Davis S, Steel L, Lunsky Y, et al. A telecommunication model to teach facilitators to deliver acceptance and commitment training. Behav Anal Pract. 2022;15(3):752–752.
pubmed: 36457839
doi: 10.1007/s40617-021-00661-w
Naughton CA, Friesner DL. Comparison of pharmacy students’ perceived and actual knowledge using the pharmacy curricular outcomes assessment. Am J Pharm Educ. 2012;76(4):63.
pubmed: 22611272
pmcid: 3355283
doi: 10.5688/ajpe76463
Persky AM, Ee E, Schlesselman LS. Perception of learning versus performance as outcome measures of educational research. Am J Pharm. 2020;84(7):993–1000.
Katowa-Mukwato P, Sekelani SB. Self-perceived versus objectively measured competence in performing clinical pratical procedures by final medical students. Int J Med Educ. 2016;7:122–9.
pubmed: 27132255
pmcid: 4860286
doi: 10.5116/ijme.5709.2a7e
Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. Residents’ procedural experience does not ensure competence: a research synthesis. J Grad Med Educ. 2017;9(2):201–8.
pubmed: 28439354
pmcid: 5398145
doi: 10.4300/JGME-D-16-00426.1
Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med. 2005;142(4):260–73.
pubmed: 15710959
doi: 10.7326/0003-4819-142-4-200502150-00008
Tavares W, Sockalingam S, Valanci S, Giuliani M, Davis D, Campbell C, et al. Performance Data Advocacy for Continuing Professional Development in Health Professions. Acad Med. 2024;99(2):153-8. https://doi.org/10.1097/ACM.0000000000005490 .