A comparison of rapid cycle deliberate practice and traditional reflective debriefing on interprofessional team performance.

Interdisciplinary simulation Rapid cycle deliberate practice Simulation-based team training Traditional reflective debriefing

Journal

BMC medical education
ISSN: 1472-6920
Titre abrégé: BMC Med Educ
Pays: England
ID NLM: 101088679

Informations de publication

Date de publication:
07 Feb 2024
Historique:
received: 15 08 2023
accepted: 27 01 2024
medline: 8 2 2024
pubmed: 8 2 2024
entrez: 7 2 2024
Statut: epublish

Résumé

In simulation-based education, debriefing is necessary to promote knowledge acquisition and skill application. Rapid Cycle Deliberate Practice (RCDP) and Traditional Reflective Debriefing (TRD) are based in learning theories of deliberate practice and reflective learning, respectively. In this study, we compared the effectiveness of TRD versus RCDP on acquisition of conceptual knowledge and teamwork skills among interdisciplinary learners in the pediatric emergency department. One hundred sixty-four learners including emergency department attending physicians, fellows, nurses, medical technicians, paramedics, and respiratory therapists, participated in 28 in-situ simulation workshops over 2 months. Groups were quasi-randomized to receive RCDP or TRD debriefing. Learners completed a multiple-choice test to assess teamwork knowledge. The TEAM Assessment Tool assessed team performance before and after debriefing. Primary outcomes were teamwork knowledge and team performance. Average pre-intervention baseline knowledge assessment scores were high in both groups (TRD mean 90.5 (SD 12.7), RCDP mean 88.7 (SD 15.5). Post-test scores showed small improvements in both groups (TRD mean 93.2 (SD 12.2), RCDP mean 89.9 (SD 13.8), as indicated by effect sizes (ES = 0.21 and 0.09, for TRD and RCDP, respectively). Assessment of team performance demonstrated a significant improvement in mean scores from pre-assessment to post-assessment for all TEAM Assessment skills in both TRD and RCDP arms, based on p-values (all p < 0.01) and effect sizes (all ES > 0.8). While pre-post improvements in TEAM scores were generally higher in the RCDP group based on effect sizes, analysis did not indicate either debriefing approach as meaningfully improved over the other. Our study did not demonstrate that either TRD versus RCDP was meaningfully better in teamwork knowledge acquisition or improving skill application and performance. As such, we propose Reflective Deliberate Practice as a framework for future study to allow learners to reflect on learning and practice in action.

Sections du résumé

BACKGROUND BACKGROUND
In simulation-based education, debriefing is necessary to promote knowledge acquisition and skill application. Rapid Cycle Deliberate Practice (RCDP) and Traditional Reflective Debriefing (TRD) are based in learning theories of deliberate practice and reflective learning, respectively. In this study, we compared the effectiveness of TRD versus RCDP on acquisition of conceptual knowledge and teamwork skills among interdisciplinary learners in the pediatric emergency department.
METHODS METHODS
One hundred sixty-four learners including emergency department attending physicians, fellows, nurses, medical technicians, paramedics, and respiratory therapists, participated in 28 in-situ simulation workshops over 2 months. Groups were quasi-randomized to receive RCDP or TRD debriefing. Learners completed a multiple-choice test to assess teamwork knowledge. The TEAM Assessment Tool assessed team performance before and after debriefing. Primary outcomes were teamwork knowledge and team performance.
RESULTS RESULTS
Average pre-intervention baseline knowledge assessment scores were high in both groups (TRD mean 90.5 (SD 12.7), RCDP mean 88.7 (SD 15.5). Post-test scores showed small improvements in both groups (TRD mean 93.2 (SD 12.2), RCDP mean 89.9 (SD 13.8), as indicated by effect sizes (ES = 0.21 and 0.09, for TRD and RCDP, respectively). Assessment of team performance demonstrated a significant improvement in mean scores from pre-assessment to post-assessment for all TEAM Assessment skills in both TRD and RCDP arms, based on p-values (all p < 0.01) and effect sizes (all ES > 0.8). While pre-post improvements in TEAM scores were generally higher in the RCDP group based on effect sizes, analysis did not indicate either debriefing approach as meaningfully improved over the other.
CONCLUSIONS CONCLUSIONS
Our study did not demonstrate that either TRD versus RCDP was meaningfully better in teamwork knowledge acquisition or improving skill application and performance. As such, we propose Reflective Deliberate Practice as a framework for future study to allow learners to reflect on learning and practice in action.

Identifiants

pubmed: 38326900
doi: 10.1186/s12909-024-05101-1
pii: 10.1186/s12909-024-05101-1
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

122

Informations de copyright

© 2024. The Author(s).

Références

Perretta JS, Duval-Arnould J, Poling S, Sullivan N, Jeffers JM, Farrow L, et al. Best practices and theoretical foundations for simulation instruction using rapid-cycle deliberate practice. Simul Healthc. 2020;15(5):356–62.
doi: 10.1097/SIH.0000000000000433 pubmed: 32809977
Colman N, Figueroa J, McCracken C, Hebbar K. Simulation-based team training improves team performance among pediatric intensive care unit staff. J Pediatr Intensive Care. 2019;8(2):83–91.
doi: 10.1055/s-0038-1676469 pubmed: 31093460
Lemke DS, Fielder EK, Hsu DC, Doughty CB. Improved team performance during pediatric resuscitations after rapid cycle deliberate practice compared with traditional debriefing: a pilot study. Pediatr Emerg Care. 2019;35:480–6.
doi: 10.1097/PEC.0000000000000940 pubmed: 27741071
Magee MJ, Farkouh-Karoleski C, Rosen TS. Improvement of immediate performance in neonatal resuscitation through rapid cycle deliberate practice training. J Grad Med Educ. 2018;10(2):192–7.
doi: 10.4300/JGME-D-17-00467.1 pubmed: 29686759 pmcid: 5901799
Fernandez R, Rosenman ED, Olenick J, Misisco A, Brolliar SM, Chipman AK, et al. Simulation-based team leadership training improves team leadership during actual trauma resuscitations: a randomized controlled trial. Crit Care Med. 2020;48(1):73–82.
doi: 10.1097/CCM.0000000000004077 pubmed: 31725441
Dugan MC, McCracken CE, Hebbar KB. Does simulation improve recognition and Management of Pediatric Septic Shock, and if one simulation is good, is more simulation better? Pediatr Crit Care Med. 2016;17(7):605–14.
doi: 10.1097/PCC.0000000000000766 pubmed: 27144833
Colman N, Figueroa J, McCracken C, Hebbar KB. Can simulation based-team training impact bedside teamwork in a pediatric intensive care unit? J Pediatr Intensive Care. 2019;8(4):195–203.
doi: 10.1055/s-0039-1688928 pubmed: 31673453 pmcid: 6821531
Eppich WJ, Hunt EA, Duval-Arnould JM, Siddall VJ, Cheng A. Structuring feedback and debriefing to achieve mastery learning goals. Acad Med. 2015;90(11):1501–8.
doi: 10.1097/ACM.0000000000000934 pubmed: 26375272
Riviere E, Jaffrelot M, Jouquan J, Chiniara G. Debriefing for the transfer of learning: the importance of context. Acad Med. 2019;94(6):796–803.
doi: 10.1097/ACM.0000000000002612 pubmed: 30681450
Wang JM, Zorek JA. Deliberate practice as a theoretical framework for Interprofessional experiential education. Front Pharmacol. 2016;7:188.
doi: 10.3389/fphar.2016.00188 pubmed: 27458378 pmcid: 4935723
Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10 Suppl):S70–81.
doi: 10.1097/00001888-200410001-00022 pubmed: 15383395
Kutzin JM, Janicke P. Incorporating rapid cycle deliberate practice into nursing staff continuing professional development. J Contin Educ Nurs. 2015;46(7):299–301.
doi: 10.3928/00220124-20150619-14 pubmed: 26154670
Chancey RJ, Sampayo EM, Lemke DS, Doughty CB. Learners' experiences during rapid cycle deliberate practice simulations: a qualitative analysis. Simul Healthc. 2018;14(1):18–28.
doi: 10.1097/SIH.0000000000000324
Cory MJ, Colman N, McCracken CE, Hebbar KB. Rapid cycle deliberate practice versus reflective debriefing for pediatric septic shock training. Pediatr Crit Care Med. 2019;20(5):481–9.
doi: 10.1097/PCC.0000000000001891 pubmed: 30707211
Eppich W, Cheng A. Promoting excellence and reflective learning in simulation (PEARLS): development and rationale for a blended approach to health care simulation debriefing. Simul Healthc. 2015;10(2):106–15.
doi: 10.1097/SIH.0000000000000072 pubmed: 25710312
Wayne DB, Butter J, Siddall VJ, Fudala MJ, Wade LD, Feinglass J, et al. Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice. J Gen Intern Med. 2006;21(3):251–6.
doi: 10.1111/j.1525-1497.2006.00341.x pubmed: 16637824 pmcid: 1828088
Cooper S, Cant R, Connell C, Sims L, Porter JE, Symmons M, et al. Measuring teamwork performance: validity testing of the TEAM emergency assessment measure (TEAM) with clinical resuscitation teams. Resuscitation. 2016;101:97–101.
doi: 10.1016/j.resuscitation.2016.01.026 pubmed: 26875992
Ebel RL. Estimation of the reliability of ratings. Psychometrika. 1951;16:407–24.
doi: 10.1007/BF02288803
Mukhalalati BA, Taylor A. Adult learning theories in context: a quick guide for healthcare professional educators. J Med Educ Curric Dev. 2019;6

Auteurs

Nora Colman (N)

Department of Pediatrics, Division of Critical Care Medicine, Emory University School of Medicine, Atlanta, GA, 30329, USA.

Susan M Wiltrakis (SM)

Department of Pediatrics, Division of Emergency Medicine, Washington University in St. Louis, 1 Children's Place, St. Louis, MO, 63110, USA. susanwiltrakis@wustl.edu.

Sherita Holmes (S)

Department of Pediatrics, Division of Emergency Medicine, Emory University School of Medicine, Atlanta, GA, 30329, USA.

Ruth Hwu (R)

Department of Pediatrics, Division of Emergency Medicine, Emory University School of Medicine, Atlanta, GA, 30329, USA.

Srikant Iyer (S)

Department of Pediatrics, Division of Emergency Medicine, Emory University School of Medicine, Atlanta, GA, 30329, USA.

Nandranie Goodwin (N)

Children's Healthcare of Atlanta, Atlanta, GA, 30329, USA.

Claire Mathai (C)

Children's Healthcare of Atlanta, Atlanta, GA, 30329, USA.

Scott Gillespie (S)

Scott Gillespie: Department of Pediatrics, Pediatrics Biostatistics Core, Emory University School of Medicine, Atlanta, GA, USA.

Kiran B Hebbar (KB)

Department of Pediatrics, Division of Critical Care Medicine, Emory University School of Medicine, Atlanta, GA, 30329, USA.

Classifications MeSH