Development and evaluation of a societal core robotic surgery accreditation curriculum for the UK.
Curriculum
Development
Evaluation
Proficiency-based progression
Robotics
Surgery
Training
Journal
Journal of robotic surgery
ISSN: 1863-2491
Titre abrégé: J Robot Surg
Pays: England
ID NLM: 101300401
Informations de publication
Date de publication:
06 Aug 2024
06 Aug 2024
Historique:
received:
06
07
2024
accepted:
23
07
2024
medline:
6
8
2024
pubmed:
6
8
2024
entrez:
6
8
2024
Statut:
epublish
Résumé
Standardised proficiency-based progression is the cornerstone of safe robotic skills acquisition, however, is currently lacking within surgical training curricula. Expert consensuses have defined a modular pathway to accredit surgeons. This study aimed to address the lack of a formal, pre-clinical core robotic skills, proficiency-based accreditation curriculum in the UK. Novice robotic participants underwent a four-day pre-clinical core robotic skills curriculum incorporating multimodal assessment. Modifiable-Global Evaluative Assessment of Robotic Skills (M-GEARS), VR-automated performance metrics (APMs) and Objective Clinical Human Reliability Analysis (OCHRA) error methodology assessed performance at the beginning and end of training. Messick's validity concept and a curriculum evaluation model were utilised. Feedback was collated. Proficiency-based progression, benchmarking, tool validity and reliability was assessed through comparative and correlational statistical methods. Forty-seven participants were recruited. Objective assessment of VR and dry models across M-GEARS, APMs and OCHRA demonstrated significant improvements in technical skill (p < 0.001). Concurrent validity between assessment tools demonstrated strong correlation in dry and VR tasks (r = 0.64-0.92, p < 0.001). OCHRA Inter-rater reliability was excellent (r = 0.93, p < 0.001 and 81% matched error events). A benchmark was established with M-GEARS and for the curriculum at 80%. Thirty (63.82%) participants passed. Feedback was 5/5 stars on average, with 100% recommendation. Curriculum evaluation fulfilled all five domains of Messick's validity. Core robotic surgical skills training can be objectively evaluated and benchmarked to provide accreditation in basic robotic skills. A strategy is necessary to enrol standardised curricula into national surgical training at an early stage to ensure patient safety.
Identifiants
pubmed: 39106003
doi: 10.1007/s11701-024-02062-x
pii: 10.1007/s11701-024-02062-x
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
305Informations de copyright
© 2024. Crown.
Références
Intuitive Surgical. Intuitive investor presentation Q3 2023 [Internet]. 2023 [cited 2023 Dec 4]. Available from: https://isrg.intuitive.com/static-files/dd0f7e46-db67-4f10-90d9-d826df00554e
Satava R, Smith R, Patel V, Advincula A, Aggarwal R, Al Ansari A, et al (2012) Fundamentals of robotic surgery: outcomes measures and curriculum development principle investigators. Society of Laproendoscopic Surgeons
Smith R, Patel V, Satava R (2014) Fundamentals of robotic surgery: A course of basic robotic surgery skills based upon a 14-society consensus template of outcomes measures and curriculum development. Int J Med Robot Comput Assist Surg 10(3):379–384
doi: 10.1002/rcs.1559
Satava RM, Stefanidis D, Levy JS, Smith R, Martin JR, Monfared S et al (2020) Proving the effectiveness of the fundamentals of robotic surgery (FRS) skills curriculum: a single-blinded, multispecialty, multi-institutional randomized control trial. Ann Surg 272(2):384–392
doi: 10.1097/SLA.0000000000003220
pubmed: 32675553
Stegemann AP, Ahmed K, Syed JR, Rehman S, Ghani K, Autorino R et al (2013) Fundamental skills of robotic surgery: a multi-institutional randomized controlled trial for validation of a simulation-based curriculum. Urology 81(4):767–774
doi: 10.1016/j.urology.2012.12.033
pubmed: 23484743
Fuchs HF, Collins JW, Babic B, Ducoin C, Meireles OR, Grimminger PP et al (2022) Robotic-Assisted minimally invasive esophagectomy (RAMIE) for esophageal cancer training curriculum-a worldwide Delphi consensus study. Dis Esophagus 35(6):doab055
doi: 10.1093/dote/doab055
pubmed: 34382061
Challacombe BM, Urol F, Ahmed MRCS K, Dasgupta P, Shamim Khan OBE M, Cross FRCS Urol W, et al. British association of urological surgeons (BAUS) robotic surgery curriculum- guidelines for training [Internet]. [cited 2021 Sep 29]. Available from: https://www.baus.org.uk/professionals/baus_business/publications/83/robotic_surgery_curriculum/
Rahimi AO, Ho K, Chang M, Gasper D, Ashouri Y, Dearmon-Moore D et al (2022) A systematic review of robotic surgery curricula using a contemporary educational framework. Surg Endosc. https://doi.org/10.1007/s00464-022-09788-5
doi: 10.1007/s00464-022-09788-5
pubmed: 36481821
pmcid: 9839814
Schmiederer IS, Torices-Dardon A, Ferrari-Light DM, Charbel Abboud E, Villani V, Lau JN et al (2021) Developing a Robotic general surgery training curriculum: identifying key elements through a Delphi process. J Surg Educ 78(6):e129–e136
doi: 10.1016/j.jsurg.2021.08.006
Veronesi G, Dorn P, Dunning J, Cardillo G, Schmid RA, Collins J et al (2018) Outcomes from the Delphi process of the thoracic robotic curriculum development committee. Eur J Cardiothorac Surg 53(6):1173–1179
doi: 10.1093/ejcts/ezx466
pubmed: 29377988
Fong Y, Buell JF, Collins J, Martinie J, Bruns C, Tsung A et al (2020) Applying the Delphi process for development of a hepatopancreaticobiliary robotic surgery training curriculum. Surg Endosc 34(10):4233–4244
doi: 10.1007/s00464-020-07836-6
pubmed: 32767146
Foell K, Finello A, Yasufuku K, Benardini M, Waddell T, Pace K et al (2013) Robotic surgery basic skills training: evaluation of a pilot multidisciplinary simulation-based curriculum. Can Urol Assoc J. https://doi.org/10.5489/cuaj.222
doi: 10.5489/cuaj.222
pubmed: 24381662
pmcid: 3876443
Gómez Ruiz M, Alfieri S, Becker T, Bergmann M, Boggi U, Collins J et al (2019) Expert consensus on a train-the-trainer curriculum for robotic colorectal surgery. Colorectal Dis 21(8):903–908
doi: 10.1111/codi.14637
pubmed: 30963654
Ahmed K, Khan R, Mottrie A, Lovegrove C, Abaza R, Ahlawat R et al (2015) Development of a standardised training curriculum for robotic surgery: a consensus statement from an international multidisciplinary group of experts. BJU Int 116(1):93–101
doi: 10.1111/bju.12974
pubmed: 25359658
Vanlander AE, Mazzone E, Collins JW, Mottrie AM, Rogiers XM, van der Poel HG et al (2020) Orsi consensus meeting on european robotic training (OCERT): Results from the first multispecialty consensus meeting on training in robot-assisted surgery. Eur Urol 78:713–716
doi: 10.1016/j.eururo.2020.02.003
pubmed: 32089358
Burke JR, Fleming CA, King M, El-Sayed C, Bolton WS, Munsch C et al (2023) Utilising an accelerated Delphi process to develop consensus on the requirement and components of a pre-procedural core robotic surgery curriculum. J Robot Surg. https://doi.org/10.1093/bjs/znad101.021
doi: 10.1093/bjs/znad101.021
pubmed: 36757562
pmcid: 9909133
Volpe A, Ahmed K, Dasgupta P, Ficarra V, Novara G, Van Der Poel H et al (2015) Pilot validation study of the European association of urology robotic training curriculum. Eur Urol. https://doi.org/10.1016/j.eururo.2014.10.025
doi: 10.1016/j.eururo.2014.10.025
pubmed: 26707869
Khan MTA, Patnaik R, Lee CS, Willson CM, Demario VK, Krell RW et al (2022) Systematic review of academic robotic surgery curricula. J Robot Surg. https://doi.org/10.1007/s11701-022-01500-y
doi: 10.1007/s11701-022-01500-y
pubmed: 36418717
pmcid: 10374669
Eardley NJ, Matzel KE, Gómez Ruiz M, Khan JS, Riley SA, Donnelly MT et al (2020) European society of coloproctology colorectal robotic surgery training for the trainers course – the first pilot experience. Colorectal Dis 22(11):1741–1748
doi: 10.1111/codi.15265
pubmed: 32663345
Harji D, Houston F, Burke J, Griffiths B, Tilney H, Miskovic D et al (2023) The current status of robotic colorectal surgery training programmes. J Robot Surg 17:251–263
doi: 10.1007/s11701-022-01421-w
pubmed: 35657506
Thomaschewski M, Kist M, Zimmermann M, Benecke C, Kalff JC, Krüger CM et al (2024) Conception and prospective multicentric validation of a robotic surgery training curriculum (RoSTraC) for surgical residents: from simulation via laboratory training to integration into the operation room. J Robot Surg 18(1):53
doi: 10.1007/s11701-023-01813-6
pubmed: 38280113
pmcid: 10821832
Volpe A, Ahmed K, Dasgupta P, Ficarra V, Novara G, Van Der Poel H et al (2015) Pilot validation study of the european association of urology robotic training curriculum. Eur Urol 68(2):292–299
doi: 10.1016/j.eururo.2014.10.025
pubmed: 25454612
Bric J, Connolly M, Kastenmeier A, Goldblatt M, Gould JC (2014) Proficiency training on a virtual reality robotic surgical skills curriculum. Surg Endosc 28(12):3343–3348
doi: 10.1007/s00464-014-3624-5
pubmed: 24946742
Moit H, Dwyer A, De Sutter M, Heinzel S, Crawford D (2019) A Standardized Robotic Training Curriculum in a General Surgery Program. Journal of the Soceity of Laparoscopic and Robotic Surgeons [Internet]. [cited 2022 Feb 15];23. Available from: www.SLS.org
https://www.surgicalexcellence.org/fundamentals-of-robotic-surgery-frs [Internet]. [cited 2023 Nov 9]. Fundamentals of Robotic Surgery (FRS), Institute for Surgical Excellence. Available from: https://www.surgicalexcellence.org/fundamentals-of-robotic-surgery-frs
Puliatti S, Amato M, Mazzone E, Rosiello G, De Groote R, Piazza P et al (2022) Development and validation of the metric-based assessment of a robotic vessel dissection, vessel loop positioning, clip applying and bipolar coagulation task on an avian model. J Robot Surg 16(3):677–685
doi: 10.1007/s11701-021-01293-6
pubmed: 34383208
Falletta S (1998) Evaluating training programs the four levels Donald L. Kirkpatrick, Berrett-Koehler Publishers, San Francisco, CA, 1996, 229 pp. Am J Eval. 1998;19(2):259–61.
Kirkpatrick DL (1967) Evaluation of Training. In: Bittel LR (Ed) Training and Development Handbook: A Guide to Human Resource Development. p. 87–112.
Raison N, Wood T, Brunckhorst O, Abe T, Ross T, Challacombe B et al (2017) Development and validation of a tool for non-technical skills evaluation in robotic surgery—the ICARS system. Surg Endosc 31(12):5403–5410
doi: 10.1007/s00464-017-5622-x
pubmed: 28634630
Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187(1):247–252
doi: 10.1016/j.juro.2011.09.032
pubmed: 22099993
Chen J, Cheng N, Cacciamani G, Oh P, Lin-Brande M, Remulla D et al (2019) Objective assessment of robotic surgical technical skill: a systematic review. J Urol 201(3):461–469
doi: 10.1016/j.juro.2018.06.078
pubmed: 30053510
Liu M, Purohit S, Mazanetz J, Allen W, Kreaden US, Curet M (2018) Assessment of robotic console skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery. Surg Endosc 32(1):526–535
doi: 10.1007/s00464-017-5694-7
pubmed: 28667546
Tang B, Cuschieri A (2020) Objective assessment of surgical operative performance by observational clinical human reliability analysis (OCHRA): a systematic review. Vol. 34, Surgical Endoscopy. Springer. 1492–508.
Foster JD, Miskovic D, Allison AS, Conti JA, Ockrim J, Cooper EJ et al (2016) Application of objective clinical human reliability analysis (OCHRA) in assessment of technical performance in laparoscopic rectal cancer surgery. Tech Coloproctol 20(6):361–367
doi: 10.1007/s10151-016-1444-4
pubmed: 27154295
Tang B (2020) Observational clinical human reliability analysis (OCHRA) for assessing and improving quality of surgical performance: the current status and future. J Surg Simul 7:53–56
doi: 10.1102/2051-7726.2020.0009
Tang B, Hanna GB, Joice P, ChB M, Cuschieri A (2004) Identification and categorization of technical errors by observational clinical human reliability assessment (OCHRA) during laparoscopic cholecystectomy. Arch Surg 139:11–1215
doi: 10.1001/archsurg.139.11.1215
Curtis NJ, Foster JD, Miskovic D, Brown CSB, Hewett PJ, Abbott S et al (2020) Association of surgical skill assessment with clinical outcomes in cancer surgery. JAMA Surg 155(7):590–598
doi: 10.1001/jamasurg.2020.1004
pubmed: 32374371
Gorard J, Boal M, Swamynathan V, Ghamrawi W, Francis N (2023) The application of objective clinical human reliability analysis (OCHRA) in the assessment of basic robotic surgical skills. Surg Endosc. https://doi.org/10.1007/s00464-023-10510-2
doi: 10.1007/s00464-023-10510-2
pubmed: 37932602
pmcid: 10776495
Messick S (1993) Foundations of validity: meaning and consequences in psychological assessment. ETS Res Rep Ser. https://doi.org/10.1002/j.2333-8504.1993.tb01562.x
doi: 10.1002/j.2333-8504.1993.tb01562.x
Korndorffer JR, Kasten SJ, Downing SM (2010) A call for the utilization of consensus standards in the surgical education literature. Am J Surg 199(1):99–104
doi: 10.1016/j.amjsurg.2009.08.018
pubmed: 20103073
Cuteanu A, Hellich A, Le Cardinal A, Thomas M, Valchanova A, Vara S et al (2022) Evaluation of a microsurgery training curriculum. J Reconstr Microsurg. https://doi.org/10.1055/a-2003-7689
doi: 10.1055/a-2003-7689
pubmed: 36564051
Boal MWE, Anastasiou D, Tesfai F, Ghamrawi W, Mazomenos E, Curtis N et al (2023) Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review. Br J Surg. https://doi.org/10.1093/bjs/znad331/7407357
doi: 10.1093/bjs/znad331/7407357
pmcid: 10771126
Novara G, Volpe A, Ahmed K, Dasgupta P, Van Der Poel H, Mottrie A (2015) Validation of the European association of urology robotic training curriculum: pilot study II. Eur Urol 14(2):193
doi: 10.1016/S1569-9056(15)60195-6
Radi I, Tellez JC, Alterio RE, Scott DJ, Sankaranarayanan G, Nagaraj MB et al (2022) Feasibility, effectiveness and transferability of a novel mastery-based virtual reality robotic training platform for general surgery residents. Surg Endosc 36(10):7279–7287
doi: 10.1007/s00464-022-09106-z
pubmed: 35194662
pmcid: 8863393
Turbati MS, Goldblatt MI, Gould JC, Higgins RM (2023) Robotic simulation: validation and qualitative assessment of a general surgery resident training curriculum. Surg Endosc 37(3):2304–2315
doi: 10.1007/s00464-022-09558-3
pubmed: 36002680