Objective Evaluation of Clock Face Suture Using the Objective Structured Assessment of Technical Skill (OSATS) Checklist.
Education
Suture analysis
Vascular surgery
Journal
EJVES vascular forum
ISSN: 2666-688X
Titre abrégé: EJVES Vasc Forum
Pays: England
ID NLM: 101766732
Informations de publication
Date de publication:
2022
2022
Historique:
received:
11
01
2022
revised:
30
09
2022
accepted:
06
10
2022
entrez:
17
11
2022
pubmed:
18
11
2022
medline:
18
11
2022
Statut:
epublish
Résumé
Assessment of the quality of the final product (QFP) is critical in simulation training, such as the clock face suture (CFS) exercise that is used to assess trainees' needle handling and suturing accuracy. Objective Structured Assessment of Technical Skill (OSATS) scores are the gold standard for the evaluation of trainees. The aim was to investigate variability in the use of OSATS checklists and to evaluate a semi-automatic method of suture analysis Details of 287 CFSs performed by trainees during Fundamentals in Vascular Surgery examinations were collected. All were rated according to a seven item OSATS checklist, including QFP score and an overall score by one or two expert surgeons immediately after completion. Interassessor variability was assessed for the CFS that were assessed by two assessors.In order to assess intra- and interassessor variability, 50 CFS pictures were chosen randomly and submitted to three expert surgeons to rate the QFP twice and to carry out a semi-automatic image analysis of each CFS and the estimated cumulative error (CE; mm) recorded. It was hypothesised that the CE correlates to OSATS checklist items or overall score. Variables were compared for correlation with OSATS results using a linear regression. A Pearson's test was used to confirm the proposed hypothesis. Mean ± standard deviation overall score for the OSATS checklist was 20.61 ± 6.33. Inter- and intra-assessor correlation were statistically significant regarding OSATS checklist items. Both correlations presented a low coefficient of determination, indicating variability. The mean CE was 16.07 ± 4.84 mm, and the correlation between the QFP and CE was statistically significant, proving that CE is an objective metric by which to assess the QFP. OSATS score demonstrated intra- and interassessor variability, although there was a significant correlation between scores. CE is an objective metric that is not subject to assessor subjectivity or interassessor variability and is correlated with the gold standard of evaluation.
Identifiants
pubmed: 36388464
doi: 10.1016/j.ejvsvf.2022.10.001
pii: S2666-688X(22)00047-8
pmc: PMC9664359
doi:
Types de publication
Journal Article
Langues
eng
Pagination
5-11Investigateurs
John Eidt
(J)
Yannick Georg
(Y)
Erica Leith Mitchell
(EL)
David Rigberg
(D)
Murray Shames
(M)
Fabien Thaveau
(F)
Claudie Sheahan
(C)
Informations de copyright
© 2022 Published by Elsevier Ltd on behalf of European Society for Vascular Surgery.
Références
Semin Vasc Surg. 2006 Dec;19(4):187-90
pubmed: 17178320
J Med Syst. 2017 Feb;41(2):24
pubmed: 28000118
J Vasc Surg. 2013 Jul;58(1):247-53.e1-2
pubmed: 23806258
J Vasc Surg. 2009 May;49(5):1339-44
pubmed: 19217743
J Vasc Surg. 2017 Jan;65(1):257-261
pubmed: 27743805
Am J Surg. 1994 Apr;167(4):423-7
pubmed: 8179088
Surgery. 2004 Jan;135(1):6-20
pubmed: 14694296
Am J Surg. 2008 Feb;195(2):189-94
pubmed: 18070727
Eur J Vasc Endovasc Surg. 2004 Apr;27(4):341-8
pubmed: 15015181
J Am Coll Surg. 2001 Nov;193(5):479-85
pubmed: 11708503
J Surg Educ. 2015 Mar-Apr;72(2):291-6
pubmed: 25481803
Eur J Vasc Endovasc Surg. 2019 Aug;58(2):161-162
pubmed: 31362818
Am J Surg. 2000 Apr;179(4):341-3
pubmed: 10875999
BMJ. 2001 Dec 1;323(7324):1266
pubmed: 11731377
Acad Med. 1998 Sep;73(9):993-7
pubmed: 9759104
Vascular. 2011 Aug;19(4):175-7
pubmed: 21784878
Br J Surg. 1997 Feb;84(2):273-8
pubmed: 9052454
Surg Clin North Am. 2015 Aug;95(4):781-90
pubmed: 26210970
Eur J Cardiothorac Surg. 2015 May;47(5):812-8
pubmed: 25064050
Eur J Vasc Endovasc Surg. 2020 May;59(5):767-774
pubmed: 32089508
J Vasc Surg. 2007 Feb;45(2):343-9
pubmed: 17264015
J Vasc Surg. 2015 Dec;62(6):1660-6.e3
pubmed: 26598123
BMJ. 2003 Nov 1;327(7422):1032-7
pubmed: 14593041
World J Surg. 2003 Apr;27(4):390-4
pubmed: 12658479