Do Milestone Ratings Predict Physical Medicine and Rehabilitation Board Certification Examination Scores?
Certification
/ standards
Clinical Competence
/ standards
Cohort Studies
Education, Medical, Graduate
/ standards
Educational Measurement
/ methods
Humans
Internship and Residency
/ standards
Physical and Rehabilitation Medicine
/ education
Practice Patterns, Physicians'
/ standards
Specialty Boards
/ standards
United States
Journal
American journal of physical medicine & rehabilitation
ISSN: 1537-7385
Titre abrégé: Am J Phys Med Rehabil
Pays: United States
ID NLM: 8803677
Informations de publication
Date de publication:
01 02 2021
01 02 2021
Historique:
pubmed:
14
10
2020
medline:
26
2
2021
entrez:
13
10
2020
Statut:
ppublish
Résumé
The Accreditation Council of Graduate Medical Education developed the Milestones to assist training programs in assessing resident physicians in the context of their participation in Accreditation Council of Graduate Medical Education-accredited training programs. Biannual assessments are done over a resident's entire training period to define the trajectory in achieving specialty-specific competencies. As part of its process of initial certification, the American Board of Physical Medicine and Rehabilitation requires successful completion of two examinations administered approximately 9 mos apart. The Part I Examination measures a single dimensional construct, physical medicine and rehabilitation medical knowledge, whereas Part II assesses the application of medical and physiatric knowledge to multiple domains, including data acquisition, problem solving, patient management, systems-based practice, and interpersonal and communication skills through specific patient case scenarios. This study aimed to investigate the validity of the Milestones by demonstrating its association with performance in the American Board of Physical Medicine and Rehabilitation certifying examinations. A cohort of 233 physical medicine and rehabilitation trainees in 3-yr residency programs (postgraduate year 2 entry) in the United States from academic years 2014-2016, who also took the American Board of Physical Medicine and Rehabilitation Parts I and II certifying examinations between 2016 and 2018, were included in the study. Milestones ratings in four distinct observation periods were correlated with scores in the American Board of Physical Medicine and Rehabilitation Parts I and II Examinations. Milestones ratings of medical knowledge (but not patient care, professionalism, problem-based learning, interpersonal and communication skills, and systems-based practice) predicted performance in subsequent Part I American Board of Physical Medicine and Rehabilitation Examination, but none of the Milestone ratings correlated with Part II Examination scaled scores.
Identifiants
pubmed: 33048889
pii: 00002060-202102001-00008
doi: 10.1097/PHM.0000000000001613
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
S34-S39Informations de copyright
Copyright © 2020 Wolters Kluwer Health, Inc. All rights reserved.
Déclaration de conflit d'intérêts
Financial disclosure statements have been obtained, and no conflicts of interest have been reported by the authors or by any individuals in control of the content of this article.
Références
Nasca TJ, Philibert I, Brigham T, et al.: The next GME accreditation system–rationale and benefits. N Engl J Med 2012;366:1051–6
The Physical Medicine and Rehabilitation Milestone Project. Available at: http://www.acgme.org/portals/0/pdfs/milestones/pmrmilestones.pdf . Accessed July 20, 2020
About the American Board of Medical Specialties. Available at: https://www.abms.org/about-abms/ . Accessed July 20, 2020
Reid RO, Friedberg MW, Adams JL, et al.: Associations between physician characteristics and quality of care. Arch Intern Med 2010;170:1442–9
Nichols DG: Maintenance of certification and the challenge of professionalism. Pediatrics 2017;139:e20164371
Kinney CL, Raddatz MM, Sliwa JA, et al.: Does performance on the American Board of Physical Medicine and Rehabilitation initial certification examinations predict future physician disciplinary actions? Am J Phys Med Rehabil 2019;98:1079–83
American Board of Physical Medicine and Rehabilitation. Available at: https://www.abpmr.org/About . Accessed July 20, 2020
Raddatz MM, Robinson LR: Demonstrating construct validity of the American Board of Physical Medicine and Rehabilitation Part I Examination: an analysis of dimensionality. PM R 2017;9:985–9
Certification: Booklet of Information. The American Board of Physical Medicine and Rehabilitation. Available at: https://abpmrprodstorage.file.core.windows.net/pdfs/abpmr_cert_boi.pdf?sv=2018-03-28&sr=s&sig=3R5S%2Flcrn4ZIWHC01Nr53WPhrBHlsdUfESVMYE%2FYyX0%3D&st=2020-06-08T20%3A29%3A25Z&se=2020-06-08T20%3A44%3A25Z&sp=r#page=2 . Accessed July 20, 2020
Chiodo A, Raddatz M, Driscoll SW, et al.: Should there be a part II ABPMR examination?: a psychometric inquiry. PM R 2019;11:1115–20
ACGME: Program requirements for graduate medical education in physical medicine and rehabilitation. Available at: https://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/340_PhysicalMedicineRehabilitation_2020.pdf?ver=2020-06-29-163737-033 . Accessed July 20, 2020
Massagli TL, Gittler MS, Raddatz MM, et al.: Does the physical medicine and rehabilitation self-assessment examination for residents predict the chances of passing the part 1 board certification examination? PM R 2017;9:154–8
Batalden P, Leach D, Swing S, et al.: General competencies and accreditation in graduate medical education. Health Aff (Millwood) 2002;21:103–11
Dreyfus SE: The five-stage model of adult skill acquisition. Bull Sci Technol Soc 2004;24:177–81
Hauer KE, Vandergrift J, Hess B, et al.: Correlations between ratings on the resident annual evaluation summary and the internal medicine milestones and association with ABIM certification examination scores among US internal medicine residents, 2013–2014. JAMA 2016;316:2253–62
Hauer KE, Vandergrift J, Lipner RS, et al.: National Internal Medicine Milestone Ratings: validity evidence from longitudinal three-year follow-up. Acad Med 2018;93:1189–204
Pennock M, Svrakic M, Bent JP 3rd: Completion of an individualized learning plan for otology-related milestone subcompetencies leads to improved otology section otolaryngology training exam scores. Otol Neurotol 2019;40:1392–8
Holmboe E, Robinson L, Shivraj P: ABMS Conference 2019, Initial Certification Scores: Correlations between ACGME OB-GYN and PMR Milestones for US Residents
Hamstra SJ, Yamazaki K, Shah H, et al.: Milestone national report. 2019. ACGME Accreditation Council for Graduate Medical Education. Available at: https://www.acgme.org/Portals/0/PDFs/Milestones/2019MilestonesNationalReportFinal.pdf?ver=2019-09-30-110837-587 . Accessed July 20, 2020
Holmboe ES, Yamazaki K, Nasca TJ, et al.: Using longitudinal milestones data and learning analytics to facilitate the professional development of residents: early lessons from three specialties. Acad Med 2020;95:97–103
Philibert I, Brigham T, Edgar L, et al.: Organization of the educational milestones for use in the assessment of educational outcomes. J Grad Med Educ 2014;6:177–82
Edgar L, Roberts S, Holmboe E: Milestones 2.0: a step forward. J Grad Med Educ 2018;10:367–9