The AAMC Standardized Video Interview: Lessons Learned From the Residency Selection Process.
Journal
Academic medicine : journal of the Association of American Medical Colleges
ISSN: 1938-808X
Titre abrégé: Acad Med
Pays: United States
ID NLM: 8904605
Informations de publication
Date de publication:
11 2020
11 2020
Historique:
entrez:
28
10
2020
pubmed:
29
10
2020
medline:
15
12
2020
Statut:
ppublish
Résumé
Calls to change the residency selection process have increased in recent years, with many focusing on the need for holistic review and alternatives to academic metrics. One aspect of applicant performance to consider in holistic review is proficiency in behavioral competencies. The Association of American Medical Colleges (AAMC) developed the AAMC Standardized Video Interview (SVI), an online, asynchronous video interview that assesses applicants' knowledge of professionalism and their interpersonal and communication skills. The AAMC worked with the emergency medicine community to pilot the SVI. Data from 4 years of research (Electronic Residency Application Service [ERAS] 2017-2020 cycles) show the SVI is a reliable, valid assessment of these behavioral competencies. It provides information not available in the ERAS application packet, and it does not disadvantage individuals or groups. Yet despite the SVI's psychometric properties, the AAMC elected not to renew or expand the pilot in residency selection.In this Invited Commentary, the authors share lessons learned from the AAMC SVI project about introducing a new tool for use in residency selection. They recommend that future projects endeavoring to find ways to support holistic review engage all stakeholders from the start; communicate the value of the new tool early and often; make direct comparisons with existing tools; give new tools time and space to succeed; strike a balance between early adopters and broad participation; help stakeholders understand the limitations of what a tool can do; and set clear expectations about both stakeholder input and pricing. They encourage the medical education community to learn from the SVI project and to consider future partnerships with the AAMC or other specialty organizations to develop new tools and approaches that prioritize the community's needs. Finding solutions to the challenges facing residency selection should be a priority for all stakeholders.
Identifiants
pubmed: 33112586
doi: 10.1097/ACM.0000000000003573
pii: 00001888-202011000-00034
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1639-1642Références
Prober CG, Kolars JC, First LR, Melnick DE. A plea to reassess the role of United States Medical Licensing Examination Step 1 scores in residency selection. Acad Med. 2016;91:12–15
Radabaugh CL, Hawkins RE, Welcher CM, et al. Beyond the United States Medical Licensing Examination score: Assessing competence for entering residency. Acad Med. 2019;94:983–989
Gardner AK, Cavanaugh KJ, Willis RE, Dunkin BJ. Can better selection tools help us achieve our diversity goals in postgraduate medical education? Comparing use of USMLE Step 1 scores and situational judgment tests at 7 surgical residencies. Acad Med. 2020;95:751–757
Bird SB, Hern HG, Blomkalns A, et al. Innovation in residency selection: The AAMC Standardized Video Interview. Acad Med. 2019;94:1489–1497
Hopson LR, Regan L, Bond MC, et al. The AAMC Standardized Video Interview and the electronic Standardized Letter of Evaluation in emergency medicine: A comparison of performance characteristics. Acad Med. 2019;94:1513–1521
American Educational Research Association; American Psychological Association; National Council on Measurement in Education. Standards for Educational and Psychological Testing. 2014.Washington, DC: American Educational Research Association;
Blacksmith N, Willford JC, Behrend TS. Technology in the employment interview: A meta-analysis and future research agenda. Pers Asses Decis. 2016;2:12–20
Campion MA, Palmer DK, Campion JE. A review of structure in the selection interview. Pers Psychol. 1997;50:655–702
Levashina J, Hartwell CJ, Morgeson FP, Campion MA. The structured employment interview: Narrative and quantitative review of the research literature. Pers Psychol. 2014;67:241–293
Deiorio NM, Jarou ZJ, Alker A, et al. Applicant reactions to the AAMC Standardized Video Interview during the 2018 application cycle. Acad Med. 2019;94:1498–1505
Gallahue FE, Hiller KM, Bird SB, et al. The AAMC Standardized Video Interview: Reactions and use by residency programs during the 2018 application cycle. Acad Med. 2019;94:1506–1512
Deiorio NM, Hopson LR, Fletcher LDo Use of Standardized Video Interview practice tests correlate with applicant score?. Presented at: SAEM19; May 14–17, 2019; Las Vegas, Nevada
Jarou Z, Karl E, Alker A, et al. Factors affecting Standardized Video Interview performance: Preparation elements and the testing environment. EM Resident. https://www.emra.org/emresident/article/svi-study-results. April 17, 2018 Accessed June 8, 2020