Exploring Longitudinal Cough, Breath, and Voice Data for COVID-19 Progression Prediction via Sequential Deep Learning: Model Development and Validation.

COVID-19 COVID-19 progression audio deep learning longitudinal study mobile health

Journal

Journal of medical Internet research
ISSN: 1438-8871
Titre abrégé: J Med Internet Res
Pays: Canada
ID NLM: 100959882

Informations de publication

Date de publication:
21 06 2022
Historique:
received: 04 02 2022
accepted: 18 04 2022
revised: 14 04 2022
pubmed: 3 6 2022
medline: 24 6 2022
entrez: 2 6 2022
Statut: epublish

Résumé

Recent work has shown the potential of using audio data (eg, cough, breathing, and voice) in the screening for COVID-19. However, these approaches only focus on one-off detection and detect the infection, given the current audio sample, but do not monitor disease progression in COVID-19. Limited exploration has been put forward to continuously monitor COVID-19 progression, especially recovery, through longitudinal audio data. Tracking disease progression characteristics and patterns of recovery could bring insights and lead to more timely treatment or treatment adjustment, as well as better resource management in health care systems. The primary objective of this study is to explore the potential of longitudinal audio samples over time for COVID-19 progression prediction and, especially, recovery trend prediction using sequential deep learning techniques. Crowdsourced respiratory audio data, including breathing, cough, and voice samples, from 212 individuals over 5-385 days were analyzed, alongside their self-reported COVID-19 test results. We developed and validated a deep learning-enabled tracking tool using gated recurrent units (GRUs) to detect COVID-19 progression by exploring the audio dynamics of the individuals' historical audio biomarkers. The investigation comprised 2 parts: (1) COVID-19 detection in terms of positive and negative (healthy) tests using sequential audio signals, which was primarily assessed in terms of the area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity, with 95% CIs, and (2) longitudinal disease progression prediction over time in terms of probability of positive tests, which was evaluated using the correlation between the predicted probability trajectory and self-reported labels. We first explored the benefits of capturing longitudinal dynamics of audio biomarkers for COVID-19 detection. The strong performance, yielding an AUROC of 0.79, a sensitivity of 0.75, and a specificity of 0.71 supported the effectiveness of the approach compared to methods that do not leverage longitudinal dynamics. We further examined the predicted disease progression trajectory, which displayed high consistency with longitudinal test results with a correlation of 0.75 in the test cohort and 0.86 in a subset of the test cohort with 12 (57.1%) of 21 COVID-19-positive participants who reported disease recovery. Our findings suggest that monitoring COVID-19 evolution via longitudinal audio data has potential in the tracking of individuals' disease progression and recovery. An audio-based COVID-19 progression monitoring system was developed using deep learning techniques, with strong performance showing high consistency between the predicted trajectory and the test results over time, especially for recovery trend predictions. This has good potential in the postpeak and postpandemic era that can help guide medical treatment and optimize hospital resource allocations. The changes in longitudinal audio samples, referred to as audio dynamics, are associated with COVID-19 progression; thus, modeling the audio dynamics can potentially capture the underlying disease progression process and further aid COVID-19 progression prediction. This framework provides a flexible, affordable, and timely tool for COVID-19 tracking, and more importantly, it also provides a proof of concept of how telemonitoring could be applicable to respiratory diseases monitoring, in general.

Sections du résumé

BACKGROUND
Recent work has shown the potential of using audio data (eg, cough, breathing, and voice) in the screening for COVID-19. However, these approaches only focus on one-off detection and detect the infection, given the current audio sample, but do not monitor disease progression in COVID-19. Limited exploration has been put forward to continuously monitor COVID-19 progression, especially recovery, through longitudinal audio data. Tracking disease progression characteristics and patterns of recovery could bring insights and lead to more timely treatment or treatment adjustment, as well as better resource management in health care systems.
OBJECTIVE
The primary objective of this study is to explore the potential of longitudinal audio samples over time for COVID-19 progression prediction and, especially, recovery trend prediction using sequential deep learning techniques.
METHODS
Crowdsourced respiratory audio data, including breathing, cough, and voice samples, from 212 individuals over 5-385 days were analyzed, alongside their self-reported COVID-19 test results. We developed and validated a deep learning-enabled tracking tool using gated recurrent units (GRUs) to detect COVID-19 progression by exploring the audio dynamics of the individuals' historical audio biomarkers. The investigation comprised 2 parts: (1) COVID-19 detection in terms of positive and negative (healthy) tests using sequential audio signals, which was primarily assessed in terms of the area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity, with 95% CIs, and (2) longitudinal disease progression prediction over time in terms of probability of positive tests, which was evaluated using the correlation between the predicted probability trajectory and self-reported labels.
RESULTS
We first explored the benefits of capturing longitudinal dynamics of audio biomarkers for COVID-19 detection. The strong performance, yielding an AUROC of 0.79, a sensitivity of 0.75, and a specificity of 0.71 supported the effectiveness of the approach compared to methods that do not leverage longitudinal dynamics. We further examined the predicted disease progression trajectory, which displayed high consistency with longitudinal test results with a correlation of 0.75 in the test cohort and 0.86 in a subset of the test cohort with 12 (57.1%) of 21 COVID-19-positive participants who reported disease recovery. Our findings suggest that monitoring COVID-19 evolution via longitudinal audio data has potential in the tracking of individuals' disease progression and recovery.
CONCLUSIONS
An audio-based COVID-19 progression monitoring system was developed using deep learning techniques, with strong performance showing high consistency between the predicted trajectory and the test results over time, especially for recovery trend predictions. This has good potential in the postpeak and postpandemic era that can help guide medical treatment and optimize hospital resource allocations. The changes in longitudinal audio samples, referred to as audio dynamics, are associated with COVID-19 progression; thus, modeling the audio dynamics can potentially capture the underlying disease progression process and further aid COVID-19 progression prediction. This framework provides a flexible, affordable, and timely tool for COVID-19 tracking, and more importantly, it also provides a proof of concept of how telemonitoring could be applicable to respiratory diseases monitoring, in general.

Identifiants

pubmed: 35653606
pii: v24i6e37004
doi: 10.2196/37004
pmc: PMC9217153
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't

Langues

eng

Sous-ensembles de citation

IM

Pagination

e37004

Informations de copyright

©Ting Dang, Jing Han, Tong Xia, Dimitris Spathis, Erika Bondareva, Chloë Siegele-Brown, Jagmohan Chauhan, Andreas Grammenos, Apinan Hasthanasombat, R Andres Floto, Pietro Cicuta, Cecilia Mascolo. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 21.06.2022.

Références

Inform Med Unlocked. 2020;20:100378
pubmed: 32839734
Lancet Infect Dis. 2020 Aug;20(8):911-919
pubmed: 32353347
IEEE Open J Eng Med Biol. 2020 Sep 24;1:268-274
pubmed: 35402954
Pattern Recognit. 2022 Feb;122:108289
pubmed: 34483372
J Intern Med. 2020 Jul;288(1):128-138
pubmed: 32220033
BMJ. 2020 Oct 23;371:m3862
pubmed: 33097561
BMJ Innov. 2021 Apr;7(2):356-362
pubmed: 34192022
Eur Radiol. 2020 Sep;30(9):5214-5216
pubmed: 32377812
Clin Infect Dis. 2020 Jul 28;71(15):793-798
pubmed: 32221523
Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:2601-2605
pubmed: 31946429
Nat Microbiol. 2020 Oct;5(10):1299-1305
pubmed: 32651556
IEEE Open J Eng Med Biol. 2020 Sep 29;1:275-281
pubmed: 34812418
J Infect. 2020 May;80(5):e1-e6
pubmed: 32171869
Sensors (Basel). 2021 Aug 28;21(17):
pubmed: 34502679
J Med Internet Res. 2021 Feb 19;23(2):e20545
pubmed: 33556031
J Healthc Inform Res. 2021;5(2):201-217
pubmed: 33723525
J Intern Med. 2020 Sep;288(3):335-344
pubmed: 32352202
J Heart Lung Transplant. 2020 May;39(5):405-407
pubmed: 32362390
J Infect. 2020 Aug;81(2):e102-e103
pubmed: 32425274

Auteurs

Ting Dang (T)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Jing Han (J)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Tong Xia (T)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Dimitris Spathis (D)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Erika Bondareva (E)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Chloë Siegele-Brown (C)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Jagmohan Chauhan (J)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.
Electronics and Computer Science, University of Southampton, Southampton, United Kingdom.

Andreas Grammenos (A)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Apinan Hasthanasombat (A)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

R Andres Floto (RA)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Pietro Cicuta (P)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Cecilia Mascolo (C)

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH