Implementation and validation of a competency assessment tool for laparoscopic cholecystectomy.
Journal
Surgical endoscopy
ISSN: 1432-2218
Titre abrégé: Surg Endosc
Pays: Germany
ID NLM: 8806653
Informations de publication
Date de publication:
11 2022
11 2022
Historique:
received:
07
10
2021
accepted:
09
04
2022
pubmed:
16
6
2022
medline:
1
11
2022
entrez:
15
6
2022
Statut:
ppublish
Résumé
Achieving proficiency in a surgical procedure is a milestone in the career of a trainee. We introduced a competency assessment tool for laparoscopic cholecystectomy in our residency program. Our aim was to assess the inter-rater reliability of this tool. We included all laparoscopic cholecystectomies performed by residents under the supervision of board certified surgeons. All residents were assessed at the end of the procedure by the supervising surgeon (live reviewer) using our competency assessment tool. Video records of the same procedure were analyzed by two independent reviewers (reviewer A and B), who were blinded to the performing trainee's. The assessment had three parts: a laparoscopic cholecystectomy-specific assessment tool (LCAT), the objective structured assessment of technical skills (OSATS) and a 5-item visual analogue scale (VAS) to address the surgeon's autonomy in each part of the cholecystectomy. We compared the assessment scores of the live supervising surgeon and the video reviewers. We included 15 junior residents who performed 42 laparoscopic cholecystectomies. Scoring results from live and video reviewer were comparable except for the OSATS and VAS part. The score for OSATS by the live reviewer and reviewer B were 3.68 vs. 4.26 respectively (p = 0.04) and for VAS (5.17 vs. 4.63 respectively (p = 0.03). The same difference was found between reviewers A and B with OSATS score (3.75 vs. 4.26 respectively (p = 0.001)) and VAS (5.56 vs. 4.63 respectively; p = 0.004)). Our competency assessment tool for the evaluation of surgical skills specific to laparoscopic cholecystectomy has been shown to be objective and comparable in-between raters during live procedure or on video material.
Sections du résumé
BACKGROUND
Achieving proficiency in a surgical procedure is a milestone in the career of a trainee. We introduced a competency assessment tool for laparoscopic cholecystectomy in our residency program. Our aim was to assess the inter-rater reliability of this tool.
METHODS
We included all laparoscopic cholecystectomies performed by residents under the supervision of board certified surgeons. All residents were assessed at the end of the procedure by the supervising surgeon (live reviewer) using our competency assessment tool. Video records of the same procedure were analyzed by two independent reviewers (reviewer A and B), who were blinded to the performing trainee's. The assessment had three parts: a laparoscopic cholecystectomy-specific assessment tool (LCAT), the objective structured assessment of technical skills (OSATS) and a 5-item visual analogue scale (VAS) to address the surgeon's autonomy in each part of the cholecystectomy. We compared the assessment scores of the live supervising surgeon and the video reviewers.
RESULTS
We included 15 junior residents who performed 42 laparoscopic cholecystectomies. Scoring results from live and video reviewer were comparable except for the OSATS and VAS part. The score for OSATS by the live reviewer and reviewer B were 3.68 vs. 4.26 respectively (p = 0.04) and for VAS (5.17 vs. 4.63 respectively (p = 0.03). The same difference was found between reviewers A and B with OSATS score (3.75 vs. 4.26 respectively (p = 0.001)) and VAS (5.56 vs. 4.63 respectively; p = 0.004)).
CONCLUSION
Our competency assessment tool for the evaluation of surgical skills specific to laparoscopic cholecystectomy has been shown to be objective and comparable in-between raters during live procedure or on video material.
Identifiants
pubmed: 35705755
doi: 10.1007/s00464-022-09264-0
pii: 10.1007/s00464-022-09264-0
pmc: PMC9613711
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
8261-8269Informations de copyright
© 2022. The Author(s).
Références
The Amercian Board of Surgery. Booklet of information-surgery 2019–2020. American Board of Surgery, Philadelphia. http://www.absurgery.org/xfer/BookletofInfo-Surgery.pdf . Accessed 10 May 2019
Joint Committee on Surgical Training. Certification Guidelines and Checklists 2017. https://www.jcst.org/quality-assurance/certification-guidelines-and-checklists/ . Accessed 10 May 2019
Nasca TJ, Day SH, Amis ES Jr, Force ADHT (2010) The new recommendations on duty hours from the ACGME task force. N Engl J Med 363:e3
doi: 10.1056/NEJMsb1005800
pubmed: 20573917
Mackenzie H, Ni M, Miskovic D, Motson RW, Gudgeon M, Khan Z, Longman R, Coleman MG, Hanna GB (2015) Clinical validity of consultant technical skills assessment in the English national training programme for laparoscopic colorectal surgery. Br J Surg 102:991–997
doi: 10.1002/bjs.9828
pubmed: 25994456
Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163
doi: 10.1016/j.jcm.2016.02.012
pubmed: 27330520
pmcid: 4913118
Doyle JD, Webber EM, Sidhu RS (2007) A universal global rating scale for the evaluation of technical skills in the operating room. Am J Surg 193:551–555 (discussion 555)
doi: 10.1016/j.amjsurg.2007.02.003
pubmed: 17434353
Hwang H, Lim J, Kinnaird C, Nagy AG, Panton ON, Hodgson AJ, Qayumi KA (2006) Correlating motor performance with surgical error in laparoscopic cholecystectomy. Surg Endosc 20:651–655
doi: 10.1007/s00464-005-0370-8
pubmed: 16391955
Sarker SK, Chang A, Vincent C, Darzi SA (2006) Development of assessing generic and specific technical skills in laparoscopic surgery. Am J Surg 191:238–244
doi: 10.1016/j.amjsurg.2005.07.031
pubmed: 16442953
Snyder RA, Tarpley MJ, Tarpley JL, Davidson M, Brophy C, Dattilo JB (2012) Teaching in the operating room: results of a national survey. J Surg Educ 69:643–649
doi: 10.1016/j.jsurg.2012.06.007
pubmed: 22910164
Heneman R, Wexley K (1983) The effects of time delay in rating and amount of information observed on performance rating accuracy. Acad Manag Ann 26(4):677–686. https://doi.org/10.5465/255915
doi: 10.5465/255915
Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113
doi: 10.1016/j.amjsurg.2005.04.004
pubmed: 15972181
Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using global operative assessment of laparoscopic skills. J Am Coll Surg 204:308–313
doi: 10.1016/j.jamcollsurg.2006.11.010
pubmed: 17254935
Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278
pubmed: 9052454
Mattar SG, Alseidi AA, Jones DB, Jeyarajah DR, Swanstrom LL, Aye RW, Wexner SD, Martinez JM, Ross SB, Awad MM, Franklin ME, Arregui ME, Schirmer BD, Minter RM (2013) General surgery residency inadequately prepares trainees for fellowship: results of a survey of fellowship program directors. Ann Surg 258:440–449
doi: 10.1097/SLA.0b013e3182a191ca
pubmed: 24022436
Grantcharov TP, Schulze S, Kristiansen VB (2007) The impact of objective assessment and constructive feedback on improvement of laparoscopic performance in the operating room. Surg Endosc 21:2240–2243
doi: 10.1007/s00464-007-9356-z
pubmed: 17440781
Giger UF, Michel JM, Opitz I, Th Inderbitzin D, Kocher T, Krahenbuhl L, Swiss Association of L, Thoracoscopic Surgery Study G (2006) Risk factors for perioperative complications in patients undergoing laparoscopic cholecystectomy: analysis of 22,953 consecutive cases from the Swiss association of laparoscopic and thoracoscopic surgery database. J Am Coll Surg 203:723–728
doi: 10.1016/j.jamcollsurg.2006.07.018
pubmed: 17084335
Murphy MM, Ng SC, Simons JP, Csikesz NG, Shah SA, Tseng JF (2010) Predictors of major complications after laparoscopic cholecystectomy: surgeon, hospital, or patient? J Am Coll Surg 211:73–80
doi: 10.1016/j.jamcollsurg.2010.02.050
pubmed: 20610252
Reitano E, de’Angelis N, Schembari E, Carra MC, Francone E, Gentilli S, La Greca G (2021) Learning curve for laparoscopic cholecystectomy has not been defined: a systematic review. ANZ J Surg 91:E554–E560
doi: 10.1111/ans.17021
pubmed: 34180567
pmcid: 8518700
Siqueira DA, Sousa AG, Costa Junior Jde R, Costa RA, Staico R, Tanajura LF, Centemero MP, Feres F, Abizaid AA, Sousa JE (2013) Correlation between plaque composition as assessed by virtual histology and C-reactive protein. Arq Bras Cardiol 101:78–86
pubmed: 23752339
pmcid: 3998173