A scoping review of nontechnical skill assessment tools to evaluate trauma team performance.
Journal
The journal of trauma and acute care surgery
ISSN: 2163-0763
Titre abrégé: J Trauma Acute Care Surg
Pays: United States
ID NLM: 101570622
Informations de publication
Date de publication:
01 05 2022
01 05 2022
Historique:
pubmed:
16
12
2021
medline:
28
4
2022
entrez:
15
12
2021
Statut:
ppublish
Résumé
The objective of this scoping review was to identify assessment tools of trauma team performance (outside of technical skills) and assess the validity and reliability of each tool in assessing trauma team performance. We searched Embase, Cochrane Library, Web of Science, Ovid Medline, and Cumulative Index to Nursing and Allied Health Literature from inception to June 1, 2021. English studies that evaluated trauma team performance using nontechnical skill assessment tools in a simulation or real-world setting were included. Studies were assessed by two independent reviewers for meeting inclusion/exclusion criteria. Data regarding team assessment tools were extracted and synthesized into behavior domains. Each tool was then assessed for validity and reliability. The literature search returned 4,215 articles with 29 meeting inclusion criteria. Our search identified 12 trauma team performance assessment tools. Most studies were conducted in the United States (n = 20 [69%]). Twenty studies (69%) assessed trauma team performance in a simulation setting; Team Emergency Assessment Measure (TEAM) and Trauma Nontechnical Skills Scale (T-NOTECHS) were the only tools to be applied in a simulation and real-world setting. Most studies assessed trauma team performance using video review technology (n = 17 [59%]). Five overarching themes were designed to encompass behavioral domains captured across the 12 tools: (1) Leadership, (2) Communication, (3) Teamwork, (4) Assessment, and (5) Situation Awareness. The reliability and validity of T-NOTECHS were investigated by the greatest number of studies (n = 13); however, TEAM had the most robust evidence of reliability and validity. We identified 12 trauma team performance tools that assessed nontechnical skills to varying degrees. Trauma Nontechnical Skills Scale and TEAM tools had the most evidence to support their reliability and validity. Considering the limited research in the impact of trauma team performance on patient outcomes, future studies could use video review technology in authentic trauma cases to further study this important relationship. Systematic reviews and meta-analyses, level IV.
Sections du résumé
BACKGROUND
The objective of this scoping review was to identify assessment tools of trauma team performance (outside of technical skills) and assess the validity and reliability of each tool in assessing trauma team performance.
METHODS
We searched Embase, Cochrane Library, Web of Science, Ovid Medline, and Cumulative Index to Nursing and Allied Health Literature from inception to June 1, 2021. English studies that evaluated trauma team performance using nontechnical skill assessment tools in a simulation or real-world setting were included. Studies were assessed by two independent reviewers for meeting inclusion/exclusion criteria. Data regarding team assessment tools were extracted and synthesized into behavior domains. Each tool was then assessed for validity and reliability.
RESULTS
The literature search returned 4,215 articles with 29 meeting inclusion criteria. Our search identified 12 trauma team performance assessment tools. Most studies were conducted in the United States (n = 20 [69%]). Twenty studies (69%) assessed trauma team performance in a simulation setting; Team Emergency Assessment Measure (TEAM) and Trauma Nontechnical Skills Scale (T-NOTECHS) were the only tools to be applied in a simulation and real-world setting. Most studies assessed trauma team performance using video review technology (n = 17 [59%]). Five overarching themes were designed to encompass behavioral domains captured across the 12 tools: (1) Leadership, (2) Communication, (3) Teamwork, (4) Assessment, and (5) Situation Awareness. The reliability and validity of T-NOTECHS were investigated by the greatest number of studies (n = 13); however, TEAM had the most robust evidence of reliability and validity.
CONCLUSION
We identified 12 trauma team performance tools that assessed nontechnical skills to varying degrees. Trauma Nontechnical Skills Scale and TEAM tools had the most evidence to support their reliability and validity. Considering the limited research in the impact of trauma team performance on patient outcomes, future studies could use video review technology in authentic trauma cases to further study this important relationship.
LEVEL OF EVIDENCE
Systematic reviews and meta-analyses, level IV.
Identifiants
pubmed: 34908024
doi: 10.1097/TA.0000000000003492
pii: 01586154-202205000-00023
doi:
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
e81-e91Informations de copyright
Copyright © 2021 Wolters Kluwer Health, Inc. All rights reserved.
Références
Cooper DJ, McDermott FT, Cordner SM, Tremayne AB. Quality assessment of the management of road traffic fatalities at a level I trauma center compared with other hospitals in Victoria, Australia. Consultative Committee on Road Traffic Fatalities in Victoria. J Trauma . 1998;45(4):772–779.
Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care . 2004;13 Suppl 1(Suppl 1):i85–i90.
Sharma B, Mishra A, Aggarwal R, Grantcharov TP. Non-technical skills assessment in surgery. Surg Oncol . 2011;20(3):169–177.
Steinemann S, Berg B, DiTullio A, Skinner A, Terada K, Anzelon K, Ho HC. Assessing teamwork in the trauma bay: introduction of a modified “NOTECHS” scale for trauma. Am J Surg . 2012;203(1):69–75.
McLaughlin C, Barry W, Barin E, Kysh L, Auerbach MA, Upperman JS, Burd RS, Jensen AR. Multidisciplinary simulation-based team training for trauma resuscitation: a scoping review. J Surg Educ . 2019;76(6):1669–1680.
Rehim SA, DeMoor S, Olmsted R, Dent DL, Parker-Raley J. Tools for assessment of communication skills of hospital action teams: a systematic review. J Surg Educ . 2017;74(2):341–351.
Rosenman ED, Ilgen JS, Shandro JR, Harper AL, Fernandez R. A systematic review of tools used to assess team leadership in health care action teams. Acad Med . 2015;90(10):1408–1422.
Boet S, Etherington N, Larrigan S, Yin L, Khan H, Sullivan K, Jung JJ, Grantcharov TP. Measuring the teamwork performance of teams in crisis situations: a systematic review of assessment tools and their measurement properties. BMJ Qual Saf . 2019;28(4):327–337.
Whittaker G, Abboudi H, Khan MS, Dasgupta P, Ahmed K. Teamwork assessment tools in modern surgical practice: a systematic review. Surg Res Pract . 2015;2015:494827.
Weersink K, Hall AK, Rich J, Szulewski A, Dagnone JD. Simulation versus real-world performance: a direct comparison of emergency medicine resident resuscitation entrustment scoring. Adv Simul (Lond) . 2019;4(1):9.
Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, Moher D, Peters MDJ, Horsley T, Weeks L. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med . 2018;169(7):467–473.
Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol . 2018;18(1):143.
Mokkink LB, Prinsen C, Patrick DL, Alonso J, Bouter LM, de Vet HC, Terwee CB. COSMIN methodology for systematic reviews of patient-reported outcome measures (PROMs). User manual. 2018. Available at: https://www.cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018-1.pdf . Accessed February 10, 2022.
Feeny DH, Eckstrom E, Whitlock EP, Perdue LA. A Primer for Systematic Reviewers on the Measurement of Functional Status and Health-Related Quality of Life in Older Adults. Rockville, MD: Agency for Healthcare Research and Quality; 2013. Available at: https://effectivehealthcare.ahrq.gov/products/quality-of-life-functional-status-measurement . Accessed July 11, 2021.
Cooper S, Cant R, Porter J, Sellick K, Somers G, Kinsman L, Nestel D. Rating medical emergency teamwork performance: development of the TEAM Emergency Assessment Measure (TEAM). Resuscitation . 2010;81(4):446–452.
Amiel I, Simon D, Merin O, Ziv A. Mobile in situ simulation as a tool for evaluation and improvement of trauma treatment in the emergency department. J Surg Educ . 2016;73(1):121–128.
Auerbach M, Roney L, Aysseh A, Gawel M, Koziel J, Barre K, Caty MG, Santucci K. In situ pediatric trauma simulation: assessing the impact and feasibility of an interdisciplinary pediatric in situ trauma care quality improvement simulation program. Pediatr Emerg Care . 2014;30(12):884–891.
Aukstakalnis V, Dambrauskas Z, Stasaitis K, Darginavicius L, Dobozinskas P, Jasinskas N, Vaitkaitis D. What happens in the shock room stays in the shock room? A time-based audio/video audit framework for trauma team performance analysis. Eur J Emerg Med . 2020;27(2):121–124.
Briggs A, Raja AS, Joyce MF, Yule SJ, Jiang W, Lipsitz SR, Havens JM. The role of nontechnical skills in simulated trauma resuscitation. J Surg Educ . 2015;72(4):732–739.
Capella J, Smith S, Philp A, Putnam T, Gilbert C, Fry W, Harvey E, Wright A, Henderson K, Baker D. Teamwork training improves the clinical care of trauma patients. J Surg Educ . 2010;67(6):439–443.
Cohen D, Sevdalis N, Patel V, Taylor M, Lee H, Vokes M, Heys M, Taylor D, Batrick N, Darzi A. Tactical and operational response to major incidents: feasibility and reliability of skills assessment using novel virtual environments. Resuscitation . 2013;84(7):992–998.
Couto TB, Kerrey BT, Taylor RG, FitzGerald M, Geis GL. Teamwork skills in actual, in situ, and in-center pediatric emergencies: performance levels across settings and perceptions of comparative educational impact. Simul Healthc . 2015;10(2):76–84.
DeMoor S, Abdel-Rehim S, Olmsted R, Myers JG, Parker-Raley J. Evaluating trauma team performance in a level I trauma center: validation of the trauma team communication assessment (TTCA-24). J Trauma Acute Care Surg . 2017;83(1):159–164.
Dumas RP, Vella MA, Chreiman KC, Smith BP, Subramanian M, Maher Z, Seamon MJ, Holena DN. Team assessment and decision making is associated with outcomes: a trauma video review analysis. J Surg Res . 2020;246:544–549.
Gillman LM, Brindley P, Paton-Gay JD, Engels PT, Park J, Vergis A, Widder S. Simulated Trauma and Resuscitation Team Training course—evolution of a multidisciplinary trauma crisis resource management simulation course. Am J Surg . 2016;212(1):188–93.e3.
Hamilton NA, Kieninger AN, Woodhouse J, Freeman BD, Murray D, Klingensmith ME. Video review using a reliable evaluation metric improves team function in high-fidelity simulated trauma resuscitation. J Surg Educ . 2012;69(3):428–431.
Hamilton N, Freeman BD, Woodhouse J, Ridley C, Murray D, Klingensmith ME. Team behavior during trauma resuscitation: a simulation-based performance assessment. J Grad Med Educ . 2009;1(2):253–259.
Holcomb JB, Dumire RD, Crommett JW, Stamateris CE, Fagert MA, Cleveland JA, Dorlac GR, Dorlac WC, Bonar JP, Hira K. Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training. J Trauma . 2002;52(6):1078–1085.
Jensen AR, Bullaro F, Falcone RA, Daugherty M, Young LC, McLaughlin C, Park C, Lane C, Prince JM, Scherzer DJ. EAST multicenter trial of simulation-based team training for pediatric trauma: resuscitation task completion is highly variable during simulated traumatic brain injury resuscitation. Am J Surg . 2020;219(6):1057–1064.
Jung HS, Warner-Hillard C, Thompson R, Haines K, Moungey B, LeGare A, Shaffer DW, Pugh C, Agarwal S, Sullivan S. Why saying what you mean matters: an analysis of trauma team communication. Am J Surg . 2018;215(2):250–254.
Lim Y-S, Steinemann S, Berg BW. Team size impact on assessment of teamwork in simulation-based trauma team training. Hawaii J Med Public Health . 2014;73(11):358–361.
Lubbert PH, Kaasschieter EG, Hoorntje LE, Leenen LP. Video registration of trauma team performance in the emergency department: the results of a 2-year analysis in a level 1 trauma center. J Trauma . 2009;67(6):1412–1420.
Miller D, Crandall C, Washington C III, McLaughlin S. Improving teamwork and communication in trauma care through in situ simulations. Acad Emerg Med . 2012;19(5):608–612.
Mitrou N, Elzinga J, Cheng J, Dobrin A, Uppal CM, Leeper TJ, Aguilar AB, Leeper WR. Data driven competitive motivation strategies in a longitudinal simulation curriculum for trauma team training. J Surg Educ . 2019;76(4):1122–1130.
Pucher PH, Aggarwal R, Batrick N, Jenkins M, Darzi A. Nontechnical skills performance and care processes in the management of the acute trauma patient. Surgery . 2014;155(5):902–909.
Roberts NK, Williams RG, Schwind CJ, Sutyak JA, McDowell C, Griffen D, Wall J, Sanfey H, Chestnut A, Meier AH. The impact of brief team communication, leadership and team behavior training on ad hoc team performance in trauma care settings. Am J Surg . 2014;207(2):170–178.
Rosqvist E, Lauritsalo S, Paloneva J. Short 2-H in situ trauma team simulation training effectively improves non-technical skills of hospital trauma teams. Scand J Surg . 2019;108(2):117–123.
Steinemann S, Berg B, Skinner A, DiTulio A, Anzelon K, Terada K, Oliver C, Ho HC, Speck C. In situ, multidisciplinary, simulation-based teamwork training improves early trauma care. J Surg Educ . 2011;68(6):472–477.
Steinemann S, Bhatt A, Suares G, Wei A, Ho N, Kurosawa G, Lim E, Berg B. Trauma team discord and the role of briefing. J Trauma Acute Care Surg . 2016;81(1):184–189.
Sullivan S, Campbell K, Ross JC, Thompson R, Underwood A, LeGare A, Osman I, Agarwal SK, Jung HS. Identifying nontechnical skill deficits in trainees through interdisciplinary trauma simulation. J Surg Educ . 2018;75(4):978–983.
Sullivan S, Warner-Hillard C, Eagan B, Thompson RJ, Ruis AR, Haines K, Pugh CM, Shaffer DW, Jung HS. Using epistemic network analysis to identify targets for educational interventions in trauma team communication. Surgery . 2018;163(4):938–943.
Westli HK, Johnsen BH, Eid J, Rasten I, Brattebø G. Teamwork skills, shared mental models, and performance in simulated trauma teams: an independent group design. Scand J Trauma Resusc Emerg Med . 2010;18:47.
Wieck MM, McLaughlin C, Chang TP, Rake A, Park C, Lane C, Burke RV, Young LC, Cleek EA, Morton I. Self-assessment of team performance using T-NOTECHS in simulated pediatric trauma resuscitation is not consistent with expert assessment. Am J Surg . 2018;216(3):630–635.
Civil I. Are non-technical skills relevant for the delivery of high quality trauma care? Injury . 2016;47(9):1875–1876.
Repo JP, Rosqvist E, Lauritsalo S, Paloneva J. Translatability and validation of non-technical skills scale for trauma (T-NOTECHS) for assessing simulated multi-professional trauma team resuscitations. BMC Med Educ . 2019;19(1):40.
van Maarseveen OEC, Ham WHW, Huijsmans RLN, Dolmans RGF, Leenen LPH. Reliability of the assessment of non-technical skills by using video-recorded trauma resuscitations. Eur J Trauma Emerg Surg . 2020.
Freytag J, Stroben F, Hautz WE, Schauber SK, Kämmer JE. Rating the quality of teamwork-a comparison of novice and expert ratings using the TEAM Emergency Assessment Measure (TEAM) in simulated emergencies. Scand J Trauma Resusc Emerg Med . 2019;27(1):12.
Pau C. Critical synthesis package: Team Emergency Assessment Measure (TEAM). MedEdPORTAL . 2014;10:9930. doi: 10.15766/mep_2374-8265.9930.
doi: 10.15766/mep_2374-8265.9930
Quirion A, Nikouline A, Jung J, Nolan B. Contemporary uses of trauma video review: a scoping review. CJEM . 2021;23:787–796.
Douglas SL, McRae A, Calder L, de Wit M, Sivilotti ML, Howes D, Brooks SC, Szulewski A. Ethical, legal and administrative implications of the use of video and audio recording in an emergency department in Ontario, Canada. BMJ Innovations . 2021;7(1):224–230.
Lloyd A, Dewar A, Edgar S, Caesar D, Gowens P, Clegg G. How to implement live video recording in the clinical environment: a practical guide for clinical services. Int J Clin Pract . 2017;71(6):e12951.
Vella MA, Dumas RP, Holena DN. Supporting the educational, research, and clinical care goals of the academic trauma center: video review for trauma resuscitation. JAMA Surg . 2019;154(3):257–258.
Nolan B, Hicks CM, Petrosoniak A, Jung J, Grantcharov T. Pushing boundaries of video review in trauma: using comprehensive data to improve the safety of trauma care. Trauma Surg Acute Care Open . 2020;5(1):e000510.
Gegenfurtner A, Lehtinen E, Jarodzka H, Säljö R. Effects of eye movement modeling examples on adaptive expertise in medical image diagnosis. Comput Educ . 2017;113:212–225.
Pelaccia T, Tardif J, Triby E, Ammirati C, Bertrand C, Dory V, Charlin B. How and when do expert emergency physicians generate and evaluate diagnostic hypotheses? A qualitative study using head-mounted video cued-recall interviews. Ann Emerg Med . 2014;64(6):575–585.
White MR, Braund H, Howes D, Egan R, Gegenfurtner A, van Merrienboer JJG, Szulewski A. Getting inside the expert's head: an analysis of physician cognitive processes during trauma resuscitations. Ann Emerg Med . 2018;72(3):289–298.