Development and prospective validation of a scoring system for the Basic Endoscopic Skills Training (BEST) box.
Endoscopy simulator
FES
FLS
Scoring system
Simulation
Journal
Surgical endoscopy
ISSN: 1432-2218
Titre abrégé: Surg Endosc
Pays: Germany
ID NLM: 8806653
Informations de publication
Date de publication:
12 2021
12 2021
Historique:
received:
23
01
2020
accepted:
04
11
2020
pubmed:
17
11
2020
medline:
5
1
2022
entrez:
16
11
2020
Statut:
ppublish
Résumé
The increased use of endoscopy as a minimally invasive therapeutic technique has created a great demand for endoscopic training. The Basic Endoscopic Skills Training (BEST) box provides a low-cost solution by adapting the Fundamentals of Laparoscopic Surgery (FLS) box for flexible endoscopic simulation. The BEST box consists of six endoscopic tasks with a 5-min time limit per task. This study aims to develop a scoring system for objective evaluation of user performance. A total of 165 participants were tested on the BEST box. Participants were divided into two groups: retrospective analysis (n = 100) and prospective analysis (n = 65). From the retrospective group, 55 individuals were also scored on the Global Assessment of Gastrointestinal Endoscopic Skills-Upper Endoscopy (GAGES-UE). Linear regression between user performance on BEST box and GAGES-UE was performed to develop the scoring system. Receiver Operating Characteristic curve was used to determine a threshold score to help users appreciate their endoscopic expertise. Prospective scoring of 65 individuals was then performed using the formula developed (20 experts and 45 trainees). The minimum and maximum possible scores are 30 and 110, respectively. Retrospective analysis showed that the scoring system was able to distinguish between experts and trainees (p < 0.001), correlated with GAGES-UE (p < 0.001), and had a reliability constant of r = 0.765 (p < 0.001). On prospective testing using the scoring system the expert group received a final average score of 92, whereas the average score for the trainee group was 61 (p < 0.001). The developed BEST box scoring system correlates with the experience level of the test taker as well as with the GAGES-UE scoring system. The results of this study add further evidence to the validity of the BEST box as an effective, low-cost endoscopic simulator with the scores used by trainees to track their performance level overtime.
Identifiants
pubmed: 33196877
doi: 10.1007/s00464-020-08152-9
pii: 10.1007/s00464-020-08152-9
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
6549-6555Informations de copyright
© 2020. Springer Science+Business Media, LLC, part of Springer Nature.
Références
Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P, Lyons C et al (2014) ”Fundamentals of endoscopic surgery: creation and validation of the hands-on test”. Surg Endosc 28(3):704–711
doi: 10.1007/s00464-013-3298-4
Ritter EM, Taylor ZA, Wolf KR, Franklin BR, Placek SB, KorndorfferJr JR, Gardner AK (2018) Simulation-based mastery learning for endoscopy using the endoscopy training system: a strategy to improve endoscopic skills and prepare for the fundamentals of endoscopic surgery (FES) manual skills exam. Surg Endosc 32(1):413–420
doi: 10.1007/s00464-017-5697-4
Guzzetta AA, Weis JJ, Hennessy SA, Willis RE, Wilcox V Jr, Dunkin BJ, Hogg DC, Scott DJ (2018) Proficiency-based preparation significantly improves FES certification performance. Surg Endosc 32(11):4451–4457
doi: 10.1007/s00464-018-6190-4
Crespin OM, Okrainec A, Kwong AV, Habaz I, Jimenez MC, Szasz P, Weiss E, Gonzalez CG, Mosko JD, Liu LW, Swanstrom LL (2018) Feasibility of adapting the fundamentals of laparoscopic surgery trainer box to endoscopic skills training tool. Surg Endosc 32(6):2968–2983
doi: 10.1007/s00464-018-6154-8
Habaz I, Perretta S, Okrainec A, Crespin OM, Kwong AV, Weiss E, van der Velden E, Guerriero L, Longo F, Mascagni P, Liu LW (2019) Adaptation of the fundamentals of laparoscopic surgery box for endoscopic simulation: performance evaluation of the first 100 participants. Surg Endosc 33(10):1–7
doi: 10.1007/s00464-018-06617-6
Siau K, Hodson J, Valori RM, Ward ST, Dunckley P (2019) Performance indicators in colonoscopy after certification for independent practice: outcomes and predictors of competence. Gastrointest Endosc 89(3):482–492
doi: 10.1016/j.gie.2018.07.032
Vassiliou MC, Kaneva PA, Poulose BK, Dunkin BJ, Marks JM, Sadik R, Sroka G, Anvari M, Thaler K, Adrales GL, Hazey JW (2010) Global assessment of gastrointestinal endoscopic skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy. Surg Endosc 24(8):1834–1841
doi: 10.1007/s00464-010-0882-8
Habibzadeh F, Habibzadeh P, Yadollahie M (2016) On determining the most appropriate test cut-off value: the case of tests with continuous results. Biochem Med 26(3):297–307
doi: 10.11613/BM.2016.034
Borgersen NJ et al (2018) Gathering validity evidence for surgical simulation: a systematic review. Ann Surg 267(6):1063–1068
doi: 10.1097/SLA.0000000000002652
Cook D, Rose H (2016) Validation of educational assessments: a primer for simulation and beyond. Adv Simul 1(1):31
doi: 10.1186/s41077-016-0033-y
Lineberry M, Ritter EM (2017) Psychometric properties of the fundamentals of endoscopic surgery (FES) skills examination. Surg Endosc 31(12):5219–5227
doi: 10.1007/s00464-017-5590-1