(En)trust me: Validating an assessment rubric for documenting clinical encounters during a surgery clerkship clinical skills exam.
Adult
Clinical Clerkship
/ organization & administration
Clinical Competence
Competency-Based Education
Confidence Intervals
Documentation
/ methods
Education, Medical, Undergraduate
/ methods
Educational Measurement
/ methods
Female
General Surgery
/ education
Humans
Male
Observer Variation
Students, Medical
/ statistics & numerical data
United States
Assessment
Entrustable Professional Activity (EPA)
Rubric
Validity
Journal
American journal of surgery
ISSN: 1879-1883
Titre abrégé: Am J Surg
Pays: United States
ID NLM: 0370473
Informations de publication
Date de publication:
02 2020
02 2020
Historique:
received:
18
04
2018
revised:
21
12
2018
accepted:
21
12
2018
pubmed:
15
1
2019
medline:
30
4
2020
entrez:
15
1
2019
Statut:
ppublish
Résumé
The AAMC developed 13 Core Entrustable Professional Activities (EPAs) for graduating medical students. EPA 5 is: Document a clinical encounter in the patient record. Our goal was to develop an assessment rubric and gather evidence to support its validity in measuring progress towards entrustability. A rubric was developed for EPA 5. During the 2017 surgery clerkship, 57 students wrote a note for each of two standardized patient (SP) encounters. These notes were prospectively collected and assessed by two physician raters. Messick's validity framework was used to gather validity data. Inter-rater reliability with two raters was excellent, ICC = 0.86 (ICC 95%, confidence interval (CI) 0.80-0.90) for overall note score. Correlation between note items and SP checklists ranged 0.39-0.46 (p < 0.05) and between note items and clinical evaluations 0.28-0.39 (p < 0.05). There is initial reliability evidence supporting the use of our rubric for assessing progress towards entrustability of EPA 5.
Sections du résumé
BACKGROUND
The AAMC developed 13 Core Entrustable Professional Activities (EPAs) for graduating medical students. EPA 5 is: Document a clinical encounter in the patient record. Our goal was to develop an assessment rubric and gather evidence to support its validity in measuring progress towards entrustability.
METHODS
A rubric was developed for EPA 5. During the 2017 surgery clerkship, 57 students wrote a note for each of two standardized patient (SP) encounters. These notes were prospectively collected and assessed by two physician raters. Messick's validity framework was used to gather validity data.
RESULTS
Inter-rater reliability with two raters was excellent, ICC = 0.86 (ICC 95%, confidence interval (CI) 0.80-0.90) for overall note score. Correlation between note items and SP checklists ranged 0.39-0.46 (p < 0.05) and between note items and clinical evaluations 0.28-0.39 (p < 0.05).
CONCLUSIONS
There is initial reliability evidence supporting the use of our rubric for assessing progress towards entrustability of EPA 5.
Identifiants
pubmed: 30639130
pii: S0002-9610(18)30551-8
doi: 10.1016/j.amjsurg.2018.12.055
pii:
doi:
Types de publication
Journal Article
Validation Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
258-262Informations de copyright
Copyright © 2018 Elsevier Inc. All rights reserved.