Development and validation of the objective assessment of robotic suturing and knot tying skills for chicken anastomotic model.
Face
Proficiency-based metrics
Surgical training
content and construct validation
Journal
Surgical endoscopy
ISSN: 1432-2218
Titre abrégé: Surg Endosc
Pays: Germany
ID NLM: 8806653
Informations de publication
Date de publication:
08 2021
08 2021
Historique:
received:
10
06
2020
accepted:
17
08
2020
pubmed:
29
8
2020
medline:
21
10
2021
entrez:
29
8
2020
Statut:
ppublish
Résumé
To improve patient safety, there is an imperative to develop objective performance metrics for basic surgical skills training in robotic surgery. To develop and validate (face, content, and construct) the performance metrics for robotic suturing and knot tying, using a chicken anastomotic model. Study 1: In a procedure characterization, we developed the performance metrics (i.e., procedure steps, errors, and critical errors) for robotic suturing and knot tying, using a chicken anastomotic model. In a modified Delphi panel of 13 experts from four EU countries, we achieved 100% consensus on the five steps, 18 errors and four critical errors (CE) of the task. Study 2: Ten experienced surgeons and nine novice urology surgeons performed the robotic suturing and knot tying chicken anastomotic task. The mean inter-rater reliability for the assessments by two experienced robotic surgeons was 0.92 (95% CI, 0.9-0.95). Novices took 18.5 min to complete the task and experts took 8.2 min. (p = 0.00001) and made 74% more objectively assessed performance errors than the experts (p = 0.000343). We demonstrated face, content, and construct validity for a standard and replicable basic anastomotic robotic suturing and knot tying task on a chicken model. Validated, objective, and transparent performance metrics of a robotic surgical suturing and knot tying tasks are imperative for effective and quality assured surgical training.
Sections du résumé
BACKGROUND
To improve patient safety, there is an imperative to develop objective performance metrics for basic surgical skills training in robotic surgery.
OBJECTIVE
To develop and validate (face, content, and construct) the performance metrics for robotic suturing and knot tying, using a chicken anastomotic model.
DESIGN, SETTING AND PARTICIPANTS
Study 1: In a procedure characterization, we developed the performance metrics (i.e., procedure steps, errors, and critical errors) for robotic suturing and knot tying, using a chicken anastomotic model. In a modified Delphi panel of 13 experts from four EU countries, we achieved 100% consensus on the five steps, 18 errors and four critical errors (CE) of the task. Study 2: Ten experienced surgeons and nine novice urology surgeons performed the robotic suturing and knot tying chicken anastomotic task. The mean inter-rater reliability for the assessments by two experienced robotic surgeons was 0.92 (95% CI, 0.9-0.95). Novices took 18.5 min to complete the task and experts took 8.2 min. (p = 0.00001) and made 74% more objectively assessed performance errors than the experts (p = 0.000343).
CONCLUSIONS
We demonstrated face, content, and construct validity for a standard and replicable basic anastomotic robotic suturing and knot tying task on a chicken model. Validated, objective, and transparent performance metrics of a robotic surgical suturing and knot tying tasks are imperative for effective and quality assured surgical training.
Identifiants
pubmed: 32857241
doi: 10.1007/s00464-020-07918-5
pii: 10.1007/s00464-020-07918-5
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
4285-4294Références
George EI, Brand TC, LaPorta A, Marescaux J, Satava RM (2018) Origins of robotic surgery: from skepticism to standard of care. JSLS. https://doi.org/10.4293/JSLS.2018.00039
doi: 10.4293/JSLS.2018.00039
pubmed: 30524184
pmcid: 6261744
Palagonia E, Mazzone E, De Naeyer G, D'Hondt F, Collins J, Wisz P, Van Leeuwen FWB, Van Der Poel H, Schatteman P, Mottrie A, Dell'Oglio P (2019) The safety of urologic robotic surgery depends on the skills of the surgeon. World J Urol 38:1373–1383
doi: 10.1007/s00345-019-02901-9
Puliatti S, Mazzone E, Dell'Oglio P (2020) Training in robot-assisted surgery. Curr Opin Urol 30:65–72
doi: 10.1097/MOU.0000000000000687
Pierorazio PM, Allaf ME (2009) Minimally invasive surgical training: challenges and solutions. Urol Oncol 27:208–213
doi: 10.1016/j.urolonc.2008.09.017
Alemzadeh H, Raman J, Leveson N, Kalbarczyk Z, Iyer RK (2016) Adverse events in robotic surgery: a retrospective study of 14 years of FDA Data. PLoS ONE 11:e0151470
doi: 10.1371/journal.pone.0151470
Angelo RL, Ryu RK, Pedowitz RA, Beach W, Burns J, Dodds J, Field L, Getelman M, Hobgood R, McIntyre L, Gallagher AG (2015) A proficiency-based progression training curriculum coupled with a model simulator results in the acquisition of a superior arthroscopic bankart skill set. Arthroscopy 31:1854–1871
doi: 10.1016/j.arthro.2015.07.001
Breen D, O'Brien S, McCarthy N, Gallagher A, Walshe N (2019) Effect of a proficiency-based progression simulation programme on clinical communication for the deteriorating patient: a randomised controlled trial. BMJ Open 9:e025992
doi: 10.1136/bmjopen-2018-025992
Kallidaikurichi Srinivasan K, Gallagher A, O'Brien N, Sudir V, Barrett N, O'Connor R, Holt F, Lee P, O'Donnell B, Shorten G (2018) Proficiency-based progression training: an 'end to end' model for decreasing error applied to achievement of effective epidural analgesia during labour: a randomised control study. BMJ Open 8:e020099
doi: 10.1136/bmjopen-2017-020099
Cates CULL, Gallagher AG (2016) Prospective, randomised and blinded comparison of proficiency-based progression full-physics virtual reality simulator training versus invasive vascular experience for learning carotid artery angiography by very experienced operators. BMJ Simul Technol Enhanc Learn 2(1):1–5
doi: 10.1136/bmjstel-2015-000090
Pedowitz RA, Nicandri GT, Angelo RL, Ryu RK, Gallagher AG (2015) Objective assessment of knot-tying proficiency with the fundamentals of arthroscopic surgery training program workstation and knot tester. Arthroscopy 31:1872–1879
doi: 10.1016/j.arthro.2015.06.021
Van Sickle KR, Ritter EM, Baghai M, Goldenberg AE, Huang IP, Gallagher AG, Smith CD (2008) Prospective, randomized, double-blind trial of curriculum-based training for intracorporeal suturing and knot tying. J Am Coll Surg 207:560–568
doi: 10.1016/j.jamcollsurg.2008.05.007
Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA 3rd, Ramel S, Smith CD, Arvidsson D (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193:797–804
doi: 10.1016/j.amjsurg.2006.06.050
Vanlander AE, Mazzone E, Collins JW, Mottrie AM, Rogiers XM, van der Poel HG, Van Herzeele I, Satava RM, Gallagher AG (2020) Orsi Consensus Meeting on European Robotic Training (OCERT): results from the First Multispecialty Consensus Meeting on Training in Robot-assisted Surgery. Eur Urol. https://doi.org/10.1016/j.eururo.2020.02.003
doi: 10.1016/j.eururo.2020.02.003
pubmed: 32089358
Cacciamani G, De Marco V, Siracusano S, De Marchi D, Bizzotto L, Cerruto MA, Motton G, Porcaro AB, Artibani W (2017) A new training model for robot-assisted urethrovesical anastomosis and posterior muscle-fascial reconstruction: the Verona training technique. J Robot Surg 11:123–128
doi: 10.1007/s11701-016-0626-4
Santos DRD, Calvo FC, Feijo DH, Araujo NP, Teixeira RKC, Yasojima EY (2019) New training model using chickens intestine for pediatric intestinal anastomosis. Acta Cir Bras 34:e201900709
doi: 10.1590/s0102-865020190070000009
Sotelo RJ, Astigueta JC, Carmona OJ, De Andrade RJ, Moreira OE (2009) Chicken gizzard: a new training model for laparoscopic urethrovesical anastomosis. Actas Urol Esp 33:1083–1087
doi: 10.1016/S0210-4806(09)73185-7
Volpe A, Ahmed K, Dasgupta P, Ficarra V, Novara G, van der Poel H, Mottrie A (2015) Pilot validation study of the European Association of Urology robotic training curriculum. Eur Urol 68:292–299
doi: 10.1016/j.eururo.2014.10.025
Van Velthoven RF, Ahlering TE, Peltier A, Skarecky DW, Clayman RV (2003) Technique for laparoscopic running urethrovesical anastomosis:the single knot method. Urology 61:699–702
doi: 10.1016/S0090-4295(02)02543-8
Gallagher AG (2012) Metric-based simulation training to proficiency in medical education: what it is and how to do it. Ulster Med J 81:107–113
pubmed: 23620606
pmcid: 3632817
Gallagher AG, O'Sullivan GC (2011) Fundamentals of surgical simulation: principles and practice. Springer Science & Business Media, London
Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372
doi: 10.1097/01.sla.0000151982.85062.80
Kojima K, Graves M, Taha W, Cunningham M, Joeris A, Gallagher AG (2018) AO international consensus panel for metrics on a closed reduction and fixation of a 31A2 pertrochanteric fracture. Injury 49:2227–2233
doi: 10.1016/j.injury.2018.09.019
Gallagher AG, Ryu RKN, Pedowitz RA, Henn P, Angelo RL (2018) Inter-rater reliability for metrics scored in a binary fashion-performance assessment for an arthroscopic bankart repair. Arthroscopy 34:2191–2198
doi: 10.1016/j.arthro.2018.02.007
Kazdin AE (1994) Behavior modification in applied settings. Brooks. Cole Publishing Co, Pacific Grove, CA
Mazzone E, Mistretta FA, Knipper S, Tian Z, Larcher A, Widmer H, Zorn K, Capitanio U, Graefen M, Montorsi F, Shariat SF, Saad F, Briganti A, Karakiewicz PI (2019) Contemporary national assessment of robot-assisted surgery rates and total hospital charges for major surgical uro-oncological procedures in the United States. J Endourol 33:438–447
doi: 10.1089/end.2018.0840
Brook NR, Dell'Oglio P, Barod R, Collins J, Mottrie A (2019) Comprehensive training in robotic surgery. Curr Opin Urol 29:1–9
doi: 10.1097/MOU.0000000000000566
Larcher A, De Naeyer G, Turri F, Dell'Oglio P, Capitanio U, Collins JW, Wiklund P, Van Der Poel H, Montorsi F, Mottrie A (2019) The ERUS curriculum for robot-assisted partial nephrectomy: structure definition and pilot clinical validation. Eur Urol 75:1023–1031
doi: 10.1016/j.eururo.2019.02.031
Seymour NE, Gallagher AG, Roman SA, O'Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463 discussion 463–454
doi: 10.1097/00000658-200210000-00008
Breen D, O’Brien S, McCarthy N, Gallagher A, Walshe N (2019) Effect of a proficiency-based progression simulation programme on clinical communication for the deteriorating patient: a randomised controlled trial. BMJ Open 9:e025992
doi: 10.1136/bmjopen-2018-025992
Srinivasan KK, Gallagher A, O’Brien N, Sudir V, Barrett N, O’Connor R, Holt F, Lee P, O’Donnell B, Shorten G (2018) Proficiency-based progression training: an ‘end to end’model for decreasing error applied to achievement of effective epidural analgesia during labour: a randomised control study. BMJ Open 8:e020099
doi: 10.1136/bmjopen-2017-020099
Cates CU, Lönn L, Gallagher AG (2016) Prospective, randomised and blinded comparison of proficiency-based progression full-physics virtual reality simulator training versus invasive vascular experience for learning carotid artery angiography by very experienced operators. BMJ Simul Technol Enhanced Learn 2:1–5
doi: 10.1136/bmjstel-2015-000090
Angelo RL, Ryu RK, Pedowitz RA, Beach W, Burns J, Dodds J, Field L, Getelman M, Hobgood R, McIntyre L, Gallagher AG (2015) A proficiency-based progression training curriculum coupled with a model simulator results in the acquisition of a superior arthroscopic Bankart skill set. Arthrosc: J Arthrosc Relat Surg 31:1854–1871
doi: 10.1016/j.arthro.2015.07.001