Content Validity of a High-Fidelity Surgical Middle Ear Simulator: A Randomized Prospective International Multicenter Trial.
Journal
Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology
ISSN: 1537-4505
Titre abrégé: Otol Neurotol
Pays: United States
ID NLM: 100961504
Informations de publication
Date de publication:
01 10 2023
01 10 2023
Historique:
medline:
15
9
2023
pubmed:
17
8
2023
entrez:
17
8
2023
Statut:
ppublish
Résumé
After demonstration of face validity of a surgical middle ear simulator (SMS) previously, we assessed the content validity of the simulator with otolaryngology residents. Multicenter randomized prospective international study. Four academic institutions. Novice participants were randomized into control, low-fidelity (LF), and high-fidelity (HF) groups. Control and LF produced 2 recordings from 2 attempts, and HF produced 4 recordings from 10 attempts, with trials 1, 4, 7, and 10 used for scoring. Three blinded experts graded videos of the simulated stapedectomy operation using an objective skills assessment test format consisting of global and stapedotomy-specific scales. A total of 152 recordings from 61 participants were included. Baseline characteristics did not differ significantly between groups. Depending on the step of the operation, inter-rater reliability ranged from 24 to 90%. For LF and HF, years of training was significantly associated with improved scores in certain objective skills assessment test subparts. HF outperformed the control group on stapes and global scores ( p < 0.05). The HF group demonstrated improvement in global score over trials, but plateaued after four trials. Scores varied greatly for participants from different institutions in certain operative steps, such as transecting incudostapedial joints, likely due to differences in instrumentation and time elapsed since manufacture. Practice with SMS led to better performance in both global and stapes-specific scores. Further studies are needed to examine construct validity and to create otology-appropriate grading systems. Variables like instrumentation and decline in flexibility of the simulator after 12 months greatly affect performance on the simulator.
Identifiants
pubmed: 37590880
doi: 10.1097/MAO.0000000000003998
pii: 00129492-990000000-00384
doi:
Types de publication
Randomized Controlled Trial
Multicenter Study
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
903-911Informations de copyright
Copyright © 2023, Otology & Neurotology, Inc.
Déclaration de conflit d'intérêts
The authors disclose no conflicts of interest.
Références
Abi-Rafeh J, Zammit D, Mojtahed Jaberi M, Al-Halabi B, Thibaudeau S. Nonbiological microsurgery simulators in plastic surgery training: A systematic review. Plast Reconstr Surg 2019;144:496e–507e.
Chan M, Carrie S. Training and assessment in functional endoscopic sinus surgery. J Laryngol Otol 2018;132:133–7.
Chang B, Powell A, Ellsperman S, et al. Multicenter advanced pediatric otolaryngology fellowship prep surgical simulation course with 3D printed high-fidelity models. Otolaryngol Head Neck Surg 2020;162:658–65.
Barber SR, Kozin ED, Dedmon M, et al. 3D-printed pediatric endoscopic ear surgery simulator for surgical training. Int J Pediatr Otorhinolaryngol 2016;90:113–8.
McGaghie WC, Issenberg SB, Barsuk JH, Wayne DB. A critical review of simulation-based mastery learning with translational outcomes. Med Educ 2014;48:375–85.
Reznick RK, MacRae H. Teaching surgical skills—changes in the wind. N Engl J Med 2006;355:2664–9.
Wiet GJ, Deutsch ES, Malekzadeh S, et al. SimTube: A national simulation training and research project. Otolaryngol Head Neck Surg 2020;163:522–30.
De Win G, Van Bruwaene S, Kulkarni J, et al. An evidence-based laparoscopic simulation curriculum shortens the clinical learning curve and reduces surgical adverse events. Adv Med Educ Pract 2016;7:357–70.
Jabbour N, Snyderman CH. The economics of surgical simulation. Otolaryngol Clin North Am 2017;50:1029–36.
Thone N, Winter M, García-Matte RJ, González C. Simulation in otolaryngology: A teaching and training tool. Simulación en Otorrinolaringología: una herramienta de enseñanza y entrenamiento. Acta Otorrinolaringol Esp 2017;68:115–20.
Bhatti NI. Assessment of surgical skills and competency. Otolaryngol Clin North Am 2017;50:959–65.
100 Years of Surgical Education: The Past, Present, and Future. The Bulletin, 6 June 2016. Available at: bulletin.facs.org/2013/07/100-years-of-surgical-education/ . Accessed September 3, 2022.
Sachdeva AK. The changing paradigm of residency education in surgery: A perspective from the American College of Surgeons. Am Surg 2007;73:120–9.
Bass BL. Fundamental changes in general surgery residency training. Am Surg 2007;73:109–13.
Yung MW, Oates J, Vowler SL. The learning curve in stapes surgery and its implication to training. Laryngoscope 2006;116:67–71.
Rothbaum DL, Roy J, Hager GD, et al. Task performance in stapedotomy: Comparison between surgeons of different experience levels. Otolaryngol Head Neck Surg 2003;128:71–7.
Kazmitcheff G, Nguyen Y, Miroir M, et al. Middle-ear microsurgery simulation to improve new robotic procedures. Biomed Res Int 2014;2014:891742.
Iannella G, Marcotullio D, Re M, et al. Endoscopic vs microscopic approach in stapes surgery: Advantages in the middle ear structures visualization and trainee's point of view. J Int Adv Otol 2017;13:14–20.
Wiet GJ, Sørensen MS, Andersen SAW. Otologic skills training. Otolaryngol Clin North Am 2017;50:933–45.
Javia L, Sardesai MG. Physical models and virtual reality simulators in otolaryngology. Otolaryngol Clin North Am 2017;50:875–91.
Kashikar TS, Kerwin TF, Moberly AC, Wiet GJ. A review of simulation applications in temporal bone surgery. Laryngoscope Investig Otolaryngol 2019;4:420–4.
Doerr HW, Cinatl J, Stürmer M, Rabenau HF. Prions and orthopedic surgery. Infection 2003;31:163–71.
Razavi C, Galaiya D, Vafaee S, et al. Three dimensional printing of a low-cost middle-ear training model for surgical management of otosclerosis. Laryngoscope Investig Otolaryngol 2021;6:1133–6.
Mathews SB, Hetzler DG, Hilsinger RL Jr. Incus and stapes footplate simulator. Laryngoscope 1997;107(12 Pt 1):1614–6.
Nguyen Y, Mamelle E, De Seta D, et al. Modifications to a 3D-printed temporal bone model for augmented stapes fixation surgery teaching. Eur Arch Otorhinolaryngol 2017;274:2733–9.
Owa AO, Gbejuade HO, Giddings C. A middle-ear simulator for practicing prosthesis placement for otosclerosis surgery using ward-based materials. J Laryngol Otol 2003;117:490–2.
Clark MPA, Westerberg BD, Mitchell JE. Development and validation of a low-cost microsurgery ear trainer for low-resource settings. J Laryngol Otol 2016;130:954–61.
Jenks CM, Patel V, Bennett B, Dunham B, Devine CM. Development of a 3-dimensional middle ear model to teach anatomy and endoscopic ear surgical skills. OTO Open 2021;5:2473974X211046598.
Monfared A, Mitteramskogler G, Gruber S, et al. High-fidelity, inexpensive surgical middle ear simulator. Otol Neurotol 2012;33:1573–7.
Shim T, Chillakuru Y, Darwish C, et al. High-Fidelity surgical middle ear simulator: A pilot study. Otol Neurotol 2021;42:e1067–71.
Tiffin J, Asher EJ. The Purdue pegboard; Norms and studies of reliability and validity. J Appl Psychol 1948;32:234–47.
Lawson I. Purdue pegboard test. Occup Med 2019;69:376–7.
Figueiredo S, Machado L, Lousada ADP, et al. Physicians versus surgeons. A pilot study on hand dexterity within a controlled population. Acta Orthop Belg 2016;82:456–61.
Ruckenstein MJ, Staab JP. Who is performing stapedectomy surgery? Implications for residency and fellowship training. Laryngoscope 2008;118:1224–7.
Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative “bench station” examination. Am J Surg 1997;173:226–30.
Lin SY, Laeeq K, Ishii M, et al. Development and pilot-testing of a feasible, reliable, and valid operative competency assessment tool for endoscopic sinus surgery. Am J Rhinol Allergy 2009;23:354–9.
Laeeq K, Bhatti NI, Carey JP, et al. Pilot testing of an assessment tool for competency in mastoidectomy. Laryngoscope 2009;119:2402–10.
Andersen SAW, Konge L, Mikkelsen PT, Cayé-Thomasen P, Sørensen MS. Mapping the plateau of novices in virtual reality simulation training of mastoidectomy. Laryngoscope 2017;127:907–14.