An American Board of Surgery Pilot of Video Assessment of Surgeon Technical Performance in Surgery.
Journal
Annals of surgery
ISSN: 1528-1140
Titre abrégé: Ann Surg
Pays: United States
ID NLM: 0372354
Informations de publication
Date de publication:
01 04 2023
01 04 2023
Historique:
pubmed:
17
1
2023
medline:
14
3
2023
entrez:
16
1
2023
Statut:
ppublish
Résumé
The American Board of Surgery (ABS) sought to investigate the suitability of video-based assessment (VBA) as an adjunct to certification for assessing technical skills. Board certification is based on the successful completion of a residency program coupled with knowledge and reasoning assessments. VBA is a new modality for evaluating operative skills that have been shown to correlate with patient outcomes after surgery. Diplomates of the ABS were initially assessed for background knowledge and interest in VBA. Surgeons were then solicited to participate in the pilot. Three commercially available VBA platforms were identified and used for the pilot assessment. All participants served as reviewers and reviewees for videos. After the interaction, participants were surveyed regarding their experiences and recommendations to the ABS. To the initial survey, 4853/25,715 diplomates responded. The majority were neither familiar with VBA, nor the tools used for operative assessments. Two hundred seventy-four surgeons actively engaged in the subsequent pilot. One hundred sixty-nine surgeons completed the postpilot survey. Most participants found the process straightforward. Of the participants, 74% felt that the feedback would help their surgical practice. The majority (81%) remain interested in VBA for continuing medical education credits. Using VBA in continuous certification could improve surgeon skills felt by 70%. Two-thirds of participants felt VBA could help identify and remediate underperforming surgeons. Identified barriers to VBA included limitations for open surgery, privacy issues, and technical concerns. VBA is promising as an adjunct to the current board certification process and should be further considered by the ABS.
Sections du résumé
OBJECTIVE
The American Board of Surgery (ABS) sought to investigate the suitability of video-based assessment (VBA) as an adjunct to certification for assessing technical skills.
BACKGROUND
Board certification is based on the successful completion of a residency program coupled with knowledge and reasoning assessments. VBA is a new modality for evaluating operative skills that have been shown to correlate with patient outcomes after surgery.
METHODS
Diplomates of the ABS were initially assessed for background knowledge and interest in VBA. Surgeons were then solicited to participate in the pilot. Three commercially available VBA platforms were identified and used for the pilot assessment. All participants served as reviewers and reviewees for videos. After the interaction, participants were surveyed regarding their experiences and recommendations to the ABS.
RESULTS
To the initial survey, 4853/25,715 diplomates responded. The majority were neither familiar with VBA, nor the tools used for operative assessments. Two hundred seventy-four surgeons actively engaged in the subsequent pilot. One hundred sixty-nine surgeons completed the postpilot survey. Most participants found the process straightforward. Of the participants, 74% felt that the feedback would help their surgical practice. The majority (81%) remain interested in VBA for continuing medical education credits. Using VBA in continuous certification could improve surgeon skills felt by 70%. Two-thirds of participants felt VBA could help identify and remediate underperforming surgeons. Identified barriers to VBA included limitations for open surgery, privacy issues, and technical concerns.
CONCLUSIONS
VBA is promising as an adjunct to the current board certification process and should be further considered by the ABS.
Identifiants
pubmed: 36645875
doi: 10.1097/SLA.0000000000005804
pii: 00000658-202304000-00009
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
591-595Informations de copyright
Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.
Déclaration de conflit d'intérêts
The authors report no conflicts of interest.
Références
Birkmeyer JD, Finks JF, O’Reilly A, et al. Surgical skill and complication rates after bariatric surgery. N Engl J Med. 2013;369:1434–1442.
Hampton T. Efforts seek to develop systematic ways to objectively assess surgeons’ skills. JAMA. 2015;313:782–784.
Personal communication, Frank Lewis, MD.
Rodman JS. History of the American Board of Surgery, 1937-1952. Philadelphia: Lippincott; 1957.
Pugh CM, Hashimoto DA, Korndorffer JR. The what? Why? And who? Of video-based assessment. Am J Surg. 2021;221:13–18.
Miskovic D, Ni M, Wyles SM, et al. Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg. 2013;257:476–482.
Stuhlberg JJ, Huang R, Kreutzer L, et al. Association between surgeon technical skills and patient outcomes. JAMA Surg. 2020;155:960–968.
Brajcich BC, Stulberg JJ, Palis BE, et al. Association between surgical technical skill and long-term survival for colon cancer. JAMA Oncol. 2021;7:127–129.
Mackenzie H, Ni M, Miskovic D, et al. Clinical validity of consultant technical skills assessment in the English National Training Programme for Laparoscopic Colorectal Surgery. Br J Surg. 2015;102:991–997.
Fecso AB, Bhatti JA, Stotland PK, et al. Technical performance as a predictor of clinical outcomes in laparoscopic gastric cancer surgery. Ann Surg. 2019;270:115–120.
Jung JP, Zenati MS, Dhir M, et al. Use of video review to investigate technical factors that may be associated with delayed gastric emptying after pancreaticoduodenectomy. JAMA Surg. 2018;153:918–927.
Hogg ME, Zenati M, Novak S, et al. Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient related variables. Ann Surg. 2016;264:482–491.
Reznick R, Regehr G, MacRae H, et al. Testing technical skill via an innovative “bench station” examination. Am J Surg. 1997;173:226–230.
Feldman LS, Pryor AD, Gardner AK, et al. SAGES video-based assessment (VBA) program: a vision for life-long learning for surgeons. Surg Endosc. 2020;34:3285–3288.
Ritter EM, Gardner AE, Dunkin BJ, et al. Video-based assessment for laparoscopic fundoplication: initial development of a robust tool for operative performance assessment. Surg Endosc. 2020;34:3176–3183.
Mooney R, Corley G, Godfrey A, et al. Application of video-based methods for competitive swimming analysis: a systematic review. Sports Exerc Med. 2015;1:133–150.
Hunter DR, Baker RM Reducing accidents among general aviation pilots through a national aviation safety program. In Aviation Resource Management: Proceedings of the Fourth Australian Aviation Psychology Symposium. Routledge; 2017:63–70.
Pradarelli JC, Quammeac SRP, Yee A, et al. Surgical coaching to achieve the ABMS vision for the future of continuing board certification. Am J Surg. 2021;221:4–10.
Wu RC, Prebay ZJ, Patel P, et al. Using video review to understand the technical variation of robot-assisted radical prostatectomy in a statewide surgical collaborative. W J Urol. 2020;38:1607–1613.
Ghani KR, Miller DC, Linsell S, et al. Measuring to improve: peer and crowd-sourced assessments of technical skill with robot-assisted radical prostatectomy. Eur Urol. 2016;69:547–550.
Varban OA, Thumma JR, Finks JF, et al. Evaluating the effect of surgical skill on outcomes for laparoscopic sleeve gastrectomy: a video-based study. Ann Surg. 2021;273:766–771.
Greenberg CC, Dombrowski J, Dimick JB. Video-based surgical coaching: an emerging approach to performance improvement. JAMA Surg. 2016;151:282–283.
Schlick CJ, Bilimoria KY, Stulberg JJ. Video-based feedback for the improvement of surgical technique: a platform for remote review and improvement of surgical technique. JAMA Surg. 2020;155:1078–1079.