No knowledge gap in human physiology after remote teaching for second year medical students throughout the Covid-19 pandemic.
Basic sciences
Covid-19 pandemic
Knowledge
Medical education
Physiology
Remote assessment
Teaching
Journal
BMC medical education
ISSN: 1472-6920
Titre abrégé: BMC Med Educ
Pays: England
ID NLM: 101088679
Informations de publication
Date de publication:
19 Dec 2023
19 Dec 2023
Historique:
received:
26
04
2023
accepted:
08
12
2023
medline:
20
12
2023
pubmed:
20
12
2023
entrez:
20
12
2023
Statut:
epublish
Résumé
The COVID-19 pandemic had a disruptive effect on higher education. A critical question is whether these changes affected students' learning outcomes. Knowledge gaps have consequences for future learning and may-in health professionals' education-also pose a threat to patient safety. Current research has shortcomings and does not allow for clear-cut interpretation. Our context is instruction in human physiology in an undergraduate medical program from high stakes end of term examinations. The sequence of imposed measures to slow the COVID-19 pandemic created a natural experiment, allowing for comparisons in performance during in-person versus remote instruction.In a two-factorial design, mode of instruction (in-person vs. remote) and mode of assessment (in-person vs. remote) were analyzed using both basic (non-parametric statistics, T-tests) and advanced statistical methods (linear mixed-effects model; resampling techniques). Test results from a total of N = 1095 s-year medical students were included in the study.We did not find empirical evidence of knowledge gaps; rather, students received comparable or higher scores during remote teaching. We interpret these findings as empirical evidence that both students and teachers adapted to pandemic disruption in a way that did not lead to knowledge gaps.We conclude that highly motivated students had no reduction in academic achievement. Moreover, we have developed an accessible digital exam system for secure, fair, and effective assessments which is sufficiently defensible for making pass/fail decisions.
Identifiants
pubmed: 38115062
doi: 10.1186/s12909-023-04959-x
pii: 10.1186/s12909-023-04959-x
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
976Informations de copyright
© 2023. The Author(s).
Références
Abdul Razzak R, Al-Shaibani T, Naguib Y. Do students effectively learn physiology through distance online instruction? Medical students’ perceptions and academic performance. Adv Physiol Educ. 2022;46(1):65–70. https://doi.org/10.1152/advan.00098.2021 .
doi: 10.1152/advan.00098.2021
Adams, R., & editor, R. A. E. (2022). Too many first-class degrees awarded in England, regulator says. The Guardian. https://www.theguardian.com/education/2022/may/12/first-class-degrees-england-regulator
Aguilera-Hermida P. College students’ use and acceptance of emergency online learning due to COVID-19. International Journal of Educational Research Open. 2020;1:100011. https://doi.org/10.1016/j.ijedro.2020.100011 .
doi: 10.1016/j.ijedro.2020.100011
Al Zahrani EM, Al Naam YA, AlRabeeah SM, Aldossary DN, Al-Jamea LH, Woodman A, Shawaheen M, Altiti O, Quiambao JV, Arulanantham ZJ, Elsafi SH. E- Learning experience of the medical profession’s college students during COVID-19 pandemic in Saudi Arabia. BMC Med Educ. 2021;21(1):443. https://doi.org/10.1186/s12909-021-02860-z .
doi: 10.1186/s12909-021-02860-z
Bakken Høstmark, C. (2022). Pandemien skapte et naturlig eksperiment for forskerne. https://www.med.uio.no/studier/aktuelt/aktuelle-saker/2022/pandemien-skapte-et-naturlig-eksperiment-for-forsk.html
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software, 67(1):1–48. https://doi.org/10.18637/jss.v067.i01
Bernard A, Indig G, Byl N, Abdu AN, Mengesha DT, Admasu BA, Holman E. COVID-19 and medical education in Africa: A cross sectional analysis of the impact on medical students. BMC Med Educ. 2021;21(1):605. https://doi.org/10.1186/s12909-021-03038-3 .
doi: 10.1186/s12909-021-03038-3
Billings MS, DeRuchie K, Hussie K, Kulesher A, Merrell J, Morales A, et al. Constructing Written Test Questions for the Health Sciences. Philadelphia: National Board of Medical Examiners; 2020.
Case SM, Swanson DB. Constructing written test questions for the basic and clinical sciences. 3rd ed. Philadelphia: National Board of Medical Examiners; 2000.
Cheloff AZ, Bharadwa S. A Student Perspective on Taking the USMLE Step 1 During the COVID-19 Pandemic. Acad Med. 2022;97(5):621. https://doi.org/10.1097/ACM.0000000000004625 .
doi: 10.1097/ACM.0000000000004625
Downing SM. Reliability: On the reproducibility of assessment data. Med Educ. 2004;38(9):1006–12. https://doi.org/10.1111/j.1365-2929.2004.01932.x .
doi: 10.1111/j.1365-2929.2004.01932.x
Eva KW. Strange days. Med Educ. 2020;54(6):492–3. https://doi.org/10.1111/medu.14164 .
doi: 10.1111/medu.14164
Fostervold KI, Ludvigsen S, Strømsø HI. Students’ time management and procrastination in the wake of the pandemic. Educ Psychol. 2022;42(10):1223–40. https://doi.org/10.1080/01443410.2022.2102582 .
doi: 10.1080/01443410.2022.2102582
Garg M, Eniasivam A, Satterfield J, Norton B, Austin E, Dohan D. Rapid transition of a preclinical health systems science and social justice course to remote learning in the time of coronavirus. Med Educ Online. 2020;25(1):1812225. https://doi.org/10.1080/10872981.2020.1812225 .
doi: 10.1080/10872981.2020.1812225
Graber ML, Franklin N, Gordon R. Diagnostic Error in Internal Medicine. Arch Intern Med. 2005;165(13):1493. https://doi.org/10.1001/archinte.165.13.1493 .
doi: 10.1001/archinte.165.13.1493
Hamamoto Filho, P. T., Cecilio-Fernandes, D., Norcia, L. F., Sandars, J., Anderson, M. B., & Bicudo, A. M. (2022). Reduction in final year medical students’ knowledge during the COVID-19 pandemic: Insights from an interinstitutional progress test. Front Educ 7. https://doi.org/10.3389/feduc.2022.1033732
Heitmann H, Wagner P, Fischer E, Gartmeier M, Schmidt-Graf F. Effectiveness of non-bedside teaching during the COVID-19 pandemic: A quasi-experimental study. BMC Med Educ. 2022;22(1):73. https://doi.org/10.1186/s12909-022-03141-z .
doi: 10.1186/s12909-022-03141-z
Hope D, Davids V, Bollington L, Maxwell S. Candidates undertaking (invigilated) assessment online show no differences in performance compared to those undertaking assessment offline. Med Teach. 2021;43(6):646–50. https://doi.org/10.1080/0142159X.2021.1887467 .
doi: 10.1080/0142159X.2021.1887467
Iglesias-Pradas S, Hernández-García Á, Chaparro-Peláez J, Prieto JL. Emergency remote teaching and students’ academic performance in higher education during the COVID-19 pandemic: A case study. Comput Hum Behav. 2021;119:106713. https://doi.org/10.1016/j.chb.2021.106713 .
doi: 10.1016/j.chb.2021.106713
Jones, P., Tong, Y., Liu, J., Borglum, J., & Primoli, V. (n.d.). Score Comparability between Online Proctored and In-Person Credentialing Exams. Journal of Educational Measurement, n/a(n/a). https://doi.org/10.1111/jedm.12320
Lüdecke, D. (2021). sjPlot: Data Visualization for Statistics in Social Science. https://CRAN.R-project.org/package=sjPlot
Muphy, B. (2020, June 2). Delays, miscommunications add even more stress to USMLE Step exams. American Medical Association. https://www.ama-assn.org/residents-students/usmle/delays-miscommunications-add-even-more-stress-usmle-step-exams
Mylopoulos M, Woods N. Preparing medical students for future learning using basic science instruction. Med Educ. 2014;48(7):667–73. https://doi.org/10.1111/medu.12426 .
doi: 10.1111/medu.12426
Norman GR, Monteiro SD, Sherbino J, Ilgen JS, Schmidt HG, Mamede S. The Causes of Errors in Clinical Reasoning: Cognitive Biases, Knowledge Deficits, and Dual Process Thinking. Academic Medicine: Journal of the Association of American Medical Colleges. 2017;92(1):23–30. https://doi.org/10.1097/ACM.0000000000001421 .
doi: 10.1097/ACM.0000000000001421
Pekrun R. The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice. Educ Psychol Rev. 2006;18(4):315–41. https://doi.org/10.1007/s10648-006-9029-9 .
doi: 10.1007/s10648-006-9029-9
Progress Test Medizin Charité Universitätsmedizin, P. T. M. C. U., Sehy, V., Atanet, I. R., Sieg, M., Struzena, J., & März, M. (2021). Short Term Effect of the COVID-19 Pandemic On Progress Test Outcomes and Emotional State of Medical Students: A Quantitative and Qualitative Analysis [Preprint]. In Review. https://doi.org/10.21203/rs.3.rs-786483/v1
R Core Team. (2021). R: A Language and Environment for Statistical Computing [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/
Sandhu P, de Wolf M. The impact of COVID-19 on the undergraduate medical curriculum. Med Educ Online. 2020;25(1):1764740. https://doi.org/10.1080/10872981.2020.1764740 .
doi: 10.1080/10872981.2020.1764740
Schauber SK, Hecht M, Nouns ZM, Kuhlmey A, Dettmer S. The role of environmental and individual characteristics in the development of student achievement: A comparison between a traditional and a problem-based-learning curriculum. Adv Health Sci Educ. 2015;20(4):1033–52.
doi: 10.1007/s10459-015-9584-2
Sekine M, Watanabe M, Nojiri S, Suzuki T, Nishizaki Y, Tomiki Y, Okada T. Effects of COVID-19 on Japanese medical students’ knowledge and attitudes toward e-learning in relation to performance on achievement tests. PLoS ONE. 2022;17(3):e0265356. https://doi.org/10.1371/journal.pone.0265356 .
doi: 10.1371/journal.pone.0265356
Singh H, Graber ML, Hofer TP. Measures to Improve Diagnostic Safety in Clinical Practice. J Patient Saf. 2019;15(4):311–6. https://doi.org/10.1097/PTS.0000000000000338 .
doi: 10.1097/PTS.0000000000000338
Villavicencio FT, Bernardo ABI. Positive academic emotions moderate the relationship between self-regulation and academic achievement. Br J Educ Psychol. 2013;83(2):329–40. https://doi.org/10.1111/j.2044-8279.2012.02064.x .
doi: 10.1111/j.2044-8279.2012.02064.x
Walters M, Alonge T, Zeller M. Impact of COVID-19 on Medical Education: Perspectives From Students. Acad Med. 2022;97(3S):S40. https://doi.org/10.1097/ACM.0000000000004525 .
doi: 10.1097/ACM.0000000000004525
Watermeyer R, Crick T, Knight C, Goodall J. COVID-19 and digital disruption in UK universities: Afflictions and affordances of emergency online migration. High Educ. 2021;81(3):623–41. https://doi.org/10.1007/s10734-020-00561-y .
doi: 10.1007/s10734-020-00561-y
Woods NN, Brooks LR, Norman GR. The role of biomedical knowledge in diagnosis of difficult clinical cases. Adv Health Sci Educ. 2007;12(4):417. https://doi.org/10.1007/s10459-006-9054-y .
doi: 10.1007/s10459-006-9054-y
Wurth S, Sader J, Cerutti B, Broers B, Bajwa NM, Carballo S, Escher M, Galetto-Lacour A, Grosgurin O, Lavallard V, Savoldelli G, Serratrice J, Nendaz M, Audétat-Voirol M-C. Medical students’ perceptions and coping strategies during the first wave of the COVID-19 pandemic: Studies, clinical implication, and professional identity. BMC Med Educ. 2021;21(1):620. https://doi.org/10.1186/s12909-021-03053-4 .
doi: 10.1186/s12909-021-03053-4
Zheng M, Bender D, Lyon C. Online learning during COVID-19 produced equivalent or better student course performance as compared with pre-pandemic: Empirical evidence from a school-wide comparative study. BMC Med Educ. 2021;21(1):495. https://doi.org/10.1186/s12909-021-02909-z .
doi: 10.1186/s12909-021-02909-z