Facilitating Residents' Understanding of Electronic Health Record Report Card Data Using Faculty Feedback and Coaching.
Journal
Academic medicine : journal of the Association of American Medical Colleges
ISSN: 1938-808X
Titre abrégé: Acad Med
Pays: United States
ID NLM: 8904605
Informations de publication
Date de publication:
01 11 2022
01 11 2022
Historique:
pubmed:
11
8
2022
medline:
29
10
2022
entrez:
10
8
2022
Statut:
ppublish
Résumé
Feedback continues to present a challenge for competency-based medical education. Clear, consistent, and credible feedback is vital to supporting one's ongoing development, yet it can be difficult to gather clinical performance data about residents. This study sought to determine whether providing residents with electronic health record (EHR)-based report cards, as well as an opportunity to discuss these data with faculty trained using the R2C2 model, can help residents understand and interpret their clinical performance metrics. Using action research methodology, the author team collected EHR data from July 2017 to February 2020, for all residents (n = 21) in one 5-year Emergency Medicine program and created personalized report cards for each resident. During October 6-17, 2020, 8 out of 17 eligible residents agreed to have their feedback conversations recorded and participate in a subsequent interview with a nonphysician member of the research team. Data were analyzed using thematic analysis, and the authors used inductive analysis to identify themes in the data. In analyzing both the feedback conversations as well as the individual interviews with faculty and residents, the authors identified 2 main themes: (1) Reactions and responses to receiving personalized EHR data and (2) The value of EHR data for assessment and feedback purposes. All participants believed that EHR data metrics are useful for prompting self-reflection, and many pointed to their utility in providing suggestions for actionable changes in their clinical practice. For faculty, having a tool through which underperforming residents can be shown "objective" data about their clinical performance helps underscore the need for improvement, particularly when residents are resistant. The EHR is a valuable source of educational data, and this study demonstrates one of the many thoughtful ways it can be used for assessment and feedback purposes.
Identifiants
pubmed: 35947480
doi: 10.1097/ACM.0000000000004900
pii: 00001888-202211001-00008
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
S22-S28Informations de copyright
Copyright © 2022 by the Association of American Medical Colleges.
Références
Armson H, Lockyer JM, Zetkulic M, Koenings KD, Sargeant J. Identifying coaching skills to improve feedback use in postgraduate medical education. Med Educ. 2019;53:477–493.
Harrison C, Konings K, Dannefer E, Schuwirth L, Wass V, van der Vleuten CPM. Factors influencing students’ receptivity to formative feedback emerging from different assessment cultures. Perspect Med Educ. 2016;5:276–284.
Sargeant J, Lockyer J, Mann K, et al. Facilitated reflective performance feedback: Developing an evidence- and theory-based model that builds relationship, explores reactions and content, and coaches for performance change (R2C2). Acad Med. 2015;90:1698–1706.
Watling CJ, Lingard L. Toward meaningful evaluation of medical trainees: The influence of participants’ perceptions of the process. Adv Health Sci Educ. 2012;17:183–194.
Watling C, Driessen E, van der Vleuten CPM, Lingard L. Learning from clinical work: The roles of learning cues and credibility judgements. Med Educ. 2012;46:192–200.
Watling CJ, Ginsburg S. Assessment, feedback and the alchemy of learning. Med Educ. 2019;53:76–85.
Mann K, van der Vleuten CPM, Eva K, et al. Tensions in informed self-assessment: How the desire for feedback and reticence to collect and use it can conflict. Acad Med. 2011;86:1120–1127.
Watling CJ. Unfulfilled promise, untapped potential: Feedback at the crossroads. Med Teach. 2014;36:692–697.
Sargeant J, Armson H, Driessen E, et al. Evidence-informed facilitated feedback: The R2C2 Feedback Model. MedEdPORTAL. 2016;12:10387. https://doi.org/10.15766/mep_2374-8265.10387 .
doi: 10.15766/mep_2374-8265.10387
Sargeant J, Mann K, van der Vleuten CPM, Metsemakers J. “Directed” self-assessment: Practice and feedback within a social context. J Contin Educ Health Prof. 2008;28:47–54.
Lefroy J, Watling C, Teunissen P, et al. Guidelines: The do’s, don’ts and don’t knows of feedback for clinical education. Perspect Med Educ. 2015;4:284–299.
Telio S, Ajjawi R, Regehr G. The “Educational Alliance” as a framework for reconceptualizing feedback in medical education. Acad Med. 2015;90:609–614.
Sadler DR. Formative assessment and the design of instructional systems. Instr Sci. 1989;18:119–144.
Ajjawi R, Regehr G. When I say…feedback. Med Educ. 2019;53:652–654.
Telio S, Regehr G, Ajjawi R. Feedback and the educational alliance: Examining credibility judgements and their consequences. Med Educ. 2016;50:933–942.
Hayrinen K, Saranto K, Nykanen P. Definition, structure, content, use and impacts of electronic health records: A review of the research literature. Int J Med Inform. 2008;77:291–304.
Sebok-Syer SS, Goldszmidt M, Watling CJ, Chahine S, Venance SL, Lingard L. Using electronic health record data to assess residents’ clinical performance in the workplace: The good, the bad, and the unthinkable. Acad Med. 2019;94:853–860.
Sargeant J, Mann K, Manos S, et al. R2C2 in action: Testing an evidence-based model to facilitate feedback and coaching in residency. J Grad Med Educ. 2017;9:165–170.
Sargeant J, Lockyer JM, Mann K, et al. The R2C2 model in residency education: How does it foster coaching and promote feedback use? Acad Med. 2018;93:1055–1063.
Lockyer J, Armson H, Konings KD, et al. In-the-moment feedback and coaching: Improving R2C2 for a new context. J Grad Med Educ. 2020;12:27–35.
Carr W, Kemmis S. Becoming Critical: Education Knowledge and Action Research. London, UK: Routledge; 2003.
Greenwood DJ, Levin M. Introduction to Action Research: Social Research for Social Change. 2nd ed. Thousand Oaks, CA: Sage; 2007.
Reason P, Bradbury H. Introduction: Inquiry and participation in search of a world worthy of human aspiration. In: Reason P, Bradbury H, eds. Handbook of Action Research: Participative Inquiry and Practice. Thousand Oaks, CA: Sage; 2004:1–14.
Baum F, MacDougall C, Smith D. Participatory action research. J Epidemiol Community Health. 2006;60:854–857.
Lingard L, Albert M, Levinson W. Grounded theory, mixed methods, and action research. BMJ. 2008;337:a567.
Guest G, MacQueen KM, Namey EE. Applied Thematic Analysis. Thousand Oaks, CA: Sage; 2012.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psyc. 2006;3:77–101.
Triola MM, Hawkins RE, Skochelak SE. The time is now: Using graduates’ practice data to drive medical education reform. Acad Med. 2018;93:826–828.
Schumacher DJ, Holmboe ES, van der Vleuten C, Busari JO, Carraccio C. Developing resident-sensitive quality measures: A model from pediatric emergency medicine. Acad Med. 2018;93:1071–1078.
Sebok-Syer SS, Chahine S, Watling CJ, Goldszmidt M, Cristancho S, Lingard L. Considering the interdependence of clinical performance: Implications for assessment and entrustment. Med Educ. 2018;52:970–980.
Sebok-Syer SS, Pack R, Shepherd L, et al. Elucidating system-level interdependence in electronic health record data: What are the ramifications for trainee assessment? Med Educ. 2020;54:738–747.
Portelli A. The Death of Luigi Trastulli, and Other Stories: Form and Meaning in Oral History. Albany, NY: State University of New York Press; 1990.
Ross-Fisher R. Action research to improve teaching and learning. Kappa Delta Pi Record. 2008;44:160–164.