Machine learning applied to multi-sensor information to reduce false alarm rate in the ICU.


Journal

Journal of clinical monitoring and computing
ISSN: 1573-2614
Titre abrégé: J Clin Monit Comput
Pays: Netherlands
ID NLM: 9806357

Informations de publication

Date de publication:
Apr 2020
Historique:
received: 09 12 2018
accepted: 25 03 2019
pubmed: 8 4 2019
medline: 5 6 2021
entrez: 8 4 2019
Statut: ppublish

Résumé

Studies reveal that the false alarm rate (FAR) demonstrated by intensive care unit (ICU) vital signs monitors ranges from 0.72 to 0.99. We applied machine learning (ML) to ICU multi-sensor information to imitate a medical specialist in diagnosing patient condition. We hypothesized that applying this data-driven approach to medical monitors will help reduce the FAR even when data from sensors are missing. An expert-based rules algorithm identified and tagged in our dataset seven clinical alarm scenarios. We compared a random forest (RF) ML model trained using the tagged data, where parameters (e.g., heart rate or blood pressure) were (deliberately) removed, in detecting ICU signals with the full expert-based rules (FER), our ground truth, and partial expert-based rules (PER), missing these parameters. When all alarm scenarios were examined, RF and FER were almost identical. However, in the absence of one to three parameters, RF maintained its values of the Youden index (0.94-0.97) and positive predictive value (PPV) (0.98-0.99), whereas PER lost its value (0.54-0.8 and 0.76-0.88, respectively). While the FAR for PER with missing parameters was 0.17-0.39, it was only 0.01-0.02 for RF. When scenarios were examined separately, RF showed clear superiority in almost all combinations of scenarios and numbers of missing parameters. When sensor data are missing, specialist performance worsens with the number of missing parameters, whereas the RF model attains high accuracy and low FAR due to its ability to fuse information from available sensors, compensating for missing parameters.

Identifiants

pubmed: 30955160
doi: 10.1007/s10877-019-00307-x
pii: 10.1007/s10877-019-00307-x
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

339-352

Références

Drew BJ, Califf RM, Funk M, Kaufman ES, Krucoff MW, Laks MM, et al. Practice standards for electrocardiographic monitoring in hospital settings. Circulation. 2004;110(17):2721–46.
doi: 10.1161/01.CIR.0000145144.56673.59
Sendelbach S, Funk M. Alarm fatigue: a patient safety concern. Adv Crit Care. 2013;24(4):378–86.
doi: 10.4037/NCI.0b013e3182a903f9
Drew BJ, Harris P, Schindler D, Salas-Boni R, Bai Y, Tinoco A, et al. Insights into the problem of alarm fatigue with physiologic monitor devices: a comprehensive observational study of consecutive intensive care unit patients. PLoS ONE. 2014;9(10):1–23.
doi: 10.1371/journal.pone.0110274
Cvach M. Monitor alarm fatigue: an integrative review. Biomed Instrum Technol. 2012;46(4):268–77.
doi: 10.2345/0899-8205-46.4.268
Sorkin RD. FORUM: why are people turning off our alarms? J Acoust Soc Am. 1988;84(3):1107–8.
doi: 10.1121/1.397232
Edworthy J. The design and implementation of non-verbal auditory warnings. Appl Ergon. 1994;25(4):202–10.
doi: 10.1016/0003-6870(94)90001-9
Xie H, Kang J, Mills GH. Clinical review: the impact of noise on patients’ sleep and the effectiveness of noise reduction strategies in intensive care units. Crit Care. 2009;13(2):208.
doi: 10.1186/cc7154
Institute ECRI. Top 10 heath technology hazards for 2012. Health Devices. 2011;40(11):358–73.
Institute ECRI. Top 10 health technology hazards for 2013. Health Devices. 2012;41(11):342–65.
Institute ECRI. Top 10 heath technology hazards for 2014. Health Devices. 2013;42(11):354–80.
ECRI Institute. Top 10 heath technology hazards for 2015. Health Devices. 2014.
ECRI Institute. Top 10 heath technology hazards for 2016. Health Devices. 2015.
ECRI Institute. Top 10 heath technology hazards for 2017. Health Devices. 2016.
Clifford GD, Silva I, Moody B, Li Q, Kella D, Shahin A, et al. The PhysioNet/Computing in cardiology challenge 2015: reducing false arrhythmia alarms in the ICU. Comput Cardiol. 2015;2015:273–6.
Eerikäinen LM, Vanschoren J, Rooijakkers MJ, Vullings R, Aarts RM. Reduction of false arrhythmia alarms using signal selection and machine learning. Physiol Meas. 2016;37(8):204.
doi: 10.1088/0967-3334/37/8/1204
Rijsbergen CJ. Information Retrieval. 2nd ed. London: Butterworths; 1979.
Bitan Y, O’Connor MF. Correlating data from different sensors to increase the positive predictive value of alarms: an empiric assessment. F1000Research. 2012;1:45.
doi: 10.12688/f1000research.1-45.v1
Imhoff M, Kuhls S. Alarm algorithms in critical care monitoring. Anesth Analg. 2006;102(5):1525–37.
doi: 10.1213/01.ane.0000204385.01983.61
Vesin A, Azoulay E, Ruckly S, Vignoud L, Rusinovà K, Benoit D, et al. Reporting and handling missing values in clinical studies in intensive care units. Intensive Care Med. 2013;39(8):1396–404.
doi: 10.1007/s00134-013-2949-1
Altman DG, Bland JM. Statistics notes: diagnostic tests 2: predictive values. Br Med J. 1994;30(6947):102.
doi: 10.1136/bmj.309.6947.102
Lalkhen AG, McCluskey A. Clinical tests: sensitivity and specificity. Contin Educ Anaesth Crit Care Pain. 2008;8(6):221–3.
doi: 10.1093/bjaceaccp/mkn041
Božikov J, Zaletel-Kragelj L. Test validity measures and receiver operating characteristic (ROC) analysis. Methods Tools Public Health. 2010;50:749–70.
Bishop CM. Pattern recognition and machine learning. New York: Springer; 2007.
Liaw A, Wiener M. Classification and regression by random forest. R News. 2002;2(3):18–22.
Breiman L. Classification and regression trees. Belmont: Wadsworth International Group; 1984.

Auteurs

Gal Hever (G)

Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, POB 653, Beer Sheva, Israel.

Liel Cohen (L)

Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, POB 653, Beer Sheva, Israel.

Michael F O'Connor (MF)

Department of Anesthesia and Critical Care, The University of Chicago, Chicago, IL, USA.

Idit Matot (I)

Department of Anesthesia and Critical Care, Tel-Aviv Medical Center, Tel-Aviv, Israel.

Boaz Lerner (B)

Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, POB 653, Beer Sheva, Israel.

Yuval Bitan (Y)

Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, POB 653, Beer Sheva, Israel. yuval@bitan.net.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH