Validity Evidence for Assessing Entrustable Professional Activities During Undergraduate Medical Education.
Journal
Academic medicine : journal of the Association of American Medical Colleges
ISSN: 1938-808X
Titre abrégé: Acad Med
Pays: United States
ID NLM: 8904605
Informations de publication
Date de publication:
01 07 2021
01 07 2021
Historique:
entrez:
29
6
2021
pubmed:
30
6
2021
medline:
25
8
2021
Statut:
ppublish
Résumé
To explore validity evidence for the use of entrustable professional activities (EPAs) as an assessment framework in medical education. Formative assessments on the 13 Core EPAs for entering residency were collected for 4 cohorts of students over a 9- to 12-month longitudinal integrated clerkship as part of the Education in Pediatrics Across the Continuum pilot at the University of Minnesota Medical School. The students requested assessments from clinical supervisors based on direct observation while engaging in patient care together. Based on each observation, the faculty member rated the student on a 9-point scale corresponding to levels of supervision required. Six EPAs were included in the present analyses. Student ratings were depicted as curves describing their performance over time; regression models were employed to fit the curves. The unit of analyses for the learning curves was observations rather than individual students. (1) Frequent assessments on EPAs provided a developmental picture of competence consistent with the negative exponential learning curve theory; (2) This finding was true across a variety of EPAs and across students; and (3) The time to attain the threshold level of performance on the EPA for entrustment varied by student and EPA. The results provide validity evidence for an EPA-based program of assessment. Students assessed using multiple observations performing the Core EPAs for entering residency demonstrate classic developmental progression toward the desired level of competence resulting in entrustment decisions. Future work with larger data samples will allow further psychometric analyses of assessment of EPAs.
Identifiants
pubmed: 34183605
doi: 10.1097/ACM.0000000000004090
pii: 00001888-202107001-00012
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
S70-S75Informations de copyright
Copyright © 2021 by the Association of American Medical Colleges.
Références
Carraccio C, Englander R, Gilhooly J, et al. Building a framework of entrustable professional activities, supported by competencies and milestones, to bridge the educational continuum. Acad Med. 2017; 92:324–330.
Violato C. Assessing Competence in Medicine and Other Health Professions. New York, NY: Taylor & Francis; 2019.
ten Cate O, Scheele F. Competency-based postgraduate training: Can we bridge the gap between theory and clinical practice? Acad Med. 2007; 82:542–547.
Englander R, Frank JR, Carraccio C, Sherbino J, Ross S, Snell L; ICBME Collaborators. Toward a shared language for competency-based medical education. Med Teach. 2017; 39:582–587.
Englander R, Flynn T, Call S, et al. Toward defining the foundation of the MD degree: Core entrustable professional activities for entering residency. Acad Med. 2016; 91:1352–1358.
ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005; 39:1176–1177.
Driessen E, Scheele F. What is wrong with assessment in postgraduate training? Lessons from clinical practice and educational research. Med Teach. 2013; 35:569–574.
Rekman J, Gofton W, Dudek N, Gofton T, Hamstra SJ. Entrustability scales: Outlining their usefulness for competency-based clinical assessment. Acad Med. 2016; 91:186–190.
The American Board of Pediatrics. Entrustable professional activities for general pediatrics. https://www.abp.org/entrustable-professional-activities-epas . Accessed November 25, 2020.
Lucey CR, Thibault GE, ten Cate O. Competency-based, time-variable education in the health professions: Crossroads. Acad Med. 2018; 93(3 suppl):S1–S5.
Andrews JS, Bale JF Jr, Soep JB, et al.; EPAC Study Group. Education in Pediatrics Across the Continuum (EPAC): First steps toward realizing the dream of competency-based education. Acad Med. 2018; 93:414–420.
ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013; 5:157–158.
Hirsh DA, Holmboe ES, ten Cate O. Time to trust: Longitudinal integrated clerkships and entrustable professional activities. Acad Med. 2014; 89:201–204.
Frank JR, Snell LS, Cate OT, et al. Competency-based medical education: Theory to practice. Med Teach. 2010; 32:638–645.
Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull. 1955; 52:281–302.
Pusic MV, Boutis K, Hatala R, Cook DA. Learning curves in health professions education. Acad Med. 2015; 90:1034–1042.
Valsamis EM, Chouari T, O’Dowd-Booth C, Rogers B, Ricketts D. Learning curves in surgery: Variables, analysis and applications. Postgrad Med J. 2018:1–6
Thurstone LL. The learning curve equation. Psych Monographs. 1919; 26:i–51.
Thompson BM, Rogers JC. Exploring the learning curve in medical education: Using self-assessment as a measure of learning. Acad Med. 2008; 83(10 suppl):S86–S88.
Pusic M, Pecaric M, Boutis K. How much practice is enough? Using learning curves to assess the deliberate practice of radiograph interpretation. Acad Med. 2011; 86:731–736.
Cundy TP, Gattas NE, White AD, Najmaldin AS. Learning curve evaluation using cumulative summation analysis—A clinical example of pediatric robot-assisted laparoscopic pyeloplasty. J Ped Surg. 2015; 50:1368–1373.
Hobday PM, Borman-Shoap E, Cullen MJ, Englander R, Murray KE. The Minnesota Method: A learner-driven, entrustable professional activity-based comprehensive program of assessment for medical students. Acad Med. 2021; 96:S50–S55.
Chen HC, van den Broek WE, ten Cate O. The case for use of entrustable professional activities in undergraduate medical education. Acad Med. 2015; 90:431–436.
Joreskog KG. On the estimation of polychoric correlations and their asymptotic covariance matrix. Psychometrika. 1994; 3:381–389.
Kampen J, Swyngedouw M. The ordinal controversy revisited. Qual and Quant. 2000; 34:87–102.
Cohen J, Cohen P, West SG, Aiken LS. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. 3rd ed. Mahwah, NJ: Lawrence Earlbaum Associates; 2003.
Meyer EG, Kelly WF, Hemmer PA, Pangaro LN. The RIME model provides a context for entrustable professional activities across undergraduate medical education. Acad Med. 2018; 93:954.