Real-Time User Feedback to Support Clinical Decision Support System Improvement.

Decision Support Systems, Clinical Feedback Electronic Health Records Workflow

Journal

Applied clinical informatics
ISSN: 1869-0327
Titre abrégé: Appl Clin Inform
Pays: Germany
ID NLM: 101537732

Informations de publication

Date de publication:
10 2022
Historique:
entrez: 26 10 2022
pubmed: 27 10 2022
medline: 29 10 2022
Statut: ppublish

Résumé

To improve clinical decision support (CDS) by allowing users to provide real-time feedback when they interact with CDS tools and by creating processes for responding to and acting on this feedback. Two organizations implemented similar real-time feedback tools and processes in their electronic health record and gathered data over a 30-month period. At both sites, users could provide feedback by using Likert feedback links embedded in all end-user facing alerts, with results stored outside the electronic health record, and provide feedback as a comment when they overrode an alert. Both systems are monitored daily by clinical informatics teams. The two sites received 2,639 Likert feedback comments and 623,270 override comments over a 30-month period. Through four case studies, we describe our use of end-user feedback to rapidly respond to build errors, as well as identifying inaccurate knowledge management, user-interface issues, and unique workflows. Feedback on CDS tools can be solicited in multiple ways, and it contains valuable and actionable suggestions to improve CDS alerts. Additionally, end users appreciate knowing their feedback is being received and may also make other suggestions to improve the electronic health record. Incorporation of end-user feedback into CDS monitoring, evaluation, and remediation is a way to improve CDS.

Identifiants

DOI: 10.1055/s-0042-1757923 PMID: 36288748 PMC: PMC9605820
pubmed: 36288748
doi: 10.1055/s-0042-1757923
pmc: PMC9605820
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

1024-1032

Informations de copyright

Thieme. All rights reserved.

Déclaration de conflit d'intérêts

None declared.

Références

Arch Intern Med. 2006 May 22;166(10):1098-104
pubmed: 16717172
AMIA Annu Symp Proc. 2007 Oct 11;:26-30
pubmed: 18693791
J Am Med Inform Assoc. 2018 Jun 1;25(6):709-714
pubmed: 29474659
Int J Med Inform. 2018 Oct;118:78-85
pubmed: 30153926
J Am Med Inform Assoc. 2001 Jul-Aug;8(4):299-308
pubmed: 11418536
J Biomed Inform. 2012 Dec;45(6):1202-16
pubmed: 22995208
JMIR Hum Factors. 2019 Apr 15;6(2):e12471
pubmed: 30985283
BMJ. 2020 Sep 17;370:m3216
pubmed: 32943437
J Am Med Inform Assoc. 2018 May 1;25(5):476-481
pubmed: 29092059
N Engl J Med. 2003 Jun 19;348(25):2526-34
pubmed: 12815139
JMIR Med Inform. 2020 Nov 4;8(11):e23351
pubmed: 33146626
J Am Med Inform Assoc. 2016 Nov;23(6):1068-1076
pubmed: 27026616
Appl Clin Inform. 2018 Jan;9(1):163-173
pubmed: 29514353
Appl Clin Inform. 2022 Jan;13(1):19-29
pubmed: 34986493
Implement Sci. 2010 Dec 10;5:96
pubmed: 21143978
Ann Intern Med. 2012 Jul 3;157(1):29-43
pubmed: 22751758
J Am Med Inform Assoc. 2018 May 1;25(5):564-567
pubmed: 29036296
Am J Health Syst Pharm. 2017 Aug 1;74(15):1130-1133
pubmed: 28743777
J Biomed Inform. 2020 Jun;106:103453
pubmed: 32417444
Int J Med Inform. 2015 Nov;84(11):901-11
pubmed: 26343972
JAMA Intern Med. 2013 Sep 23;173(17):1584-91
pubmed: 23896675
Appl Clin Inform. 2021 Oct;12(5):1101-1109
pubmed: 34911126
Ann Intern Med. 2006 May 16;144(10):742-52
pubmed: 16702590
Arch Intern Med. 2003 Jun 23;163(12):1409-16
pubmed: 12824090
Appl Clin Inform. 2019 Jan;10(1):1-9
pubmed: 30602195
Appl Clin Inform. 2017 Sep 06;8(3):910-923
pubmed: 28880046
J Am Med Inform Assoc. 2018 Nov 1;25(11):1552-1555
pubmed: 30060109
Appl Clin Inform. 2020 Jan;11(1):46-58
pubmed: 31940671
Artif Intell Med. 2018 Sep;91:49-56
pubmed: 30041919
Appl Clin Inform. 2019 Oct;10(5):810-819
pubmed: 31667818
J Am Med Inform Assoc. 2015 Nov;22(6):1243-50
pubmed: 25829460
J Am Med Inform Assoc. 2003 Nov-Dec;10(6):523-30
pubmed: 12925543
J Am Med Inform Assoc. 2018 May 1;25(5):496-506
pubmed: 29045651
J Am Med Inform Assoc. 2019 Jan 1;26(1):37-43
pubmed: 30590557
Methods Inf Med. 2016 Dec 7;55(6):507-515
pubmed: 27782288

Auteurs

David Rubins (D)

Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, United States.
Digital, Mass General Brigham, Boston, Massachusetts, United States.

Allison B McCoy (AB)

Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States.

Sayon Dutta (S)

Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, United States.
Digital, Mass General Brigham, Boston, Massachusetts, United States.
Department of Emergency Medicine, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, United States.

Dustin S McEvoy (DS)

Digital, Mass General Brigham, Boston, Massachusetts, United States.

Lorraine Patterson (L)

HealthIT, Vanderbilt University Medical Center, Nashville, Tennessee, United States.

Amy Miller (A)

Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, United States.
Digital, Mass General Brigham, Boston, Massachusetts, United States.

John G Jackson (JG)

HealthIT, Vanderbilt University Medical Center, Nashville, Tennessee, United States.

Gianna Zuccotti (G)

Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, United States.
Digital, Mass General Brigham, Boston, Massachusetts, United States.

Adam Wright (A)

Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States.

Articles similaires

Effectiveness of EHR systems on decision support in primary healthcare: a technology acceptance model 3 perspective.

Augustino Mwogosi, Stephen Kibusi
1.00
Primary Health Care Electronic Health Records Humans Tanzania Surveys and Questionnaires

Use of Patient-Reported Outcomes in Risk Prediction Model Development to Support Cancer Care Delivery: A Scoping Review.

Roshan Paudel, Samira Dias, Carrie G Wade et al.
1.00
Humans Patient Reported Outcome Measures Neoplasms Electronic Health Records Delivery of Health Care

Robust extraction of pneumonia-associated clinical states from electronic health records.

Feihong Xu, Félix L Morales, Luís A Nunes Amaral
1.00
Humans Electronic Health Records Pneumonia Data Mining Male

Multifaceted Natural Language Processing Task-Based Evaluation of Bidirectional Encoder Representations From Transformers Models for Bilingual (Korean and English) Clinical Notes: Algorithm Development and Validation.

Kyungmo Kim, Seongkeun Park, Jeongwon Min et al.
1.00
Natural Language Processing Humans Republic of Korea Multilingualism Algorithms

Classifications MeSH

questionsmedicales.fr › Sciences de l'information › Informatique › Informatique médicale › Applications de l'informatique médicale › Systèmes d'information › Systèmes d'aide à la décision clinique › Real-Time User Feedback to Support Clinical...
questionsmedicales.fr › Sciences de l'information › Analyse des systèmes › Recherche opérationnelle › Rétroaction › Real-Time User Feedback to Support Clinical...
questionsmedicales.fr › Environnement et santé publique › Santé publique › Méthodes épidémiologiques › Collecte de données › Documents › Dossiers médicaux › Systèmes informatisés de dossiers médicaux › Dossiers médicaux électroniques › Real-Time User Feedback to Support Clinical...
questionsmedicales.fr › Sciences de l'information › Analyse des systèmes › Flux de travaux › Real-Time User Feedback to Support Clinical...