Modular Clinical Decision Support Networks (MoDN)-Updatable, interpretable, and portable predictions for evolving clinical environments.


Journal

PLOS digital health
ISSN: 2767-3170
Titre abrégé: PLOS Digit Health
Pays: United States
ID NLM: 9918335064206676

Informations de publication

Date de publication:
Jul 2023
Historique:
received: 18 08 2022
accepted: 12 06 2023
medline: 17 7 2023
pubmed: 17 7 2023
entrez: 17 7 2023
Statut: epublish

Résumé

Clinical Decision Support Systems (CDSS) have the potential to improve and standardise care with probabilistic guidance. However, many CDSS deploy static, generic rule-based logic, resulting in inequitably distributed accuracy and inconsistent performance in evolving clinical environments. Data-driven models could resolve this issue by updating predictions according to the data collected. However, the size of data required necessitates collaborative learning from analogous CDSS's, which are often imperfectly interoperable (IIO) or unshareable. We propose Modular Clinical Decision Support Networks (MoDN) which allow flexible, privacy-preserving learning across IIO datasets, as well as being robust to the systematic missingness common to CDSS-derived data, while providing interpretable, continuous predictive feedback to the clinician. MoDN is a novel decision tree composed of feature-specific neural network modules that can be combined in any number or combination to make any number or combination of diagnostic predictions, updatable at each step of a consultation. The model is validated on a real-world CDSS-derived dataset, comprising 3,192 paediatric outpatients in Tanzania. MoDN significantly outperforms 'monolithic' baseline models (which take all features at once at the end of a consultation) with a mean macro F1 score across all diagnoses of 0.749 vs 0.651 for logistic regression and 0.620 for multilayer perceptron (p < 0.001). To test collaborative learning between IIO datasets, we create subsets with various percentages of feature overlap and port a MoDN model trained on one subset to another. Even with only 60% common features, fine-tuning a MoDN model on the new dataset or just making a composite model with MoDN modules matched the ideal scenario of sharing data in a perfectly interoperable setting. MoDN integrates into consultation logic by providing interpretable continuous feedback on the predictive potential of each question in a CDSS questionnaire. The modular design allows it to compartmentalise training updates to specific features and collaboratively learn between IIO datasets without sharing any data.

Identifiants

pubmed: 37459285
doi: 10.1371/journal.pdig.0000108
pii: PDIG-D-22-00242
pmc: PMC10351690
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e0000108

Informations de copyright

Copyright: © 2023 Trottet et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Déclaration de conflit d'intérêts

The authors have declared that no competing interests exist.

Références

JAMA. 2019 Mar 19;321(11):1069-1080
pubmed: 30874755
Clin Microbiol Infect. 2018 Aug;24(8):845-855
pubmed: 29684634
Lancet. 2022 Feb 12;399(10325):620
pubmed: 35151388
JAMA Netw Open. 2021 Mar 1;4(3):e211276
pubmed: 33704476
BMC Med Inform Decis Mak. 2018 Dec 29;18(1):139
pubmed: 30594159
J Rural Health. 2014 Spring;30(2):186-95
pubmed: 24689543
J Am Med Inform Assoc. 2021 Mar 1;28(3):605-615
pubmed: 33260202
BMC Med. 2018 Aug 27;16(1):150
pubmed: 30145981
J Am Med Inform Assoc. 2001 Nov-Dec;8(6):527-34
pubmed: 11687560
J Am Med Inform Assoc. 2008 Jan-Feb;15(1):107-13
pubmed: 17947627
Int J Health Care Qual Assur. 2014;27(8):707-18
pubmed: 25417376
Int J Med Inform. 2017 Jun;102:71-79
pubmed: 28495350
Circulation. 2015 Nov 17;132(20):1920-30
pubmed: 26572668
Int J Hypertens. 2019 Jan 23;2019:7320365
pubmed: 30809391
Nat Biomed Eng. 2018 Oct;2(10):719-731
pubmed: 31015651
NPJ Digit Med. 2020 Feb 6;3:17
pubmed: 32047862
J Am Med Inform Assoc. 2016 Apr;23(e1):e1
pubmed: 27071919
Science. 2015 Jul 3;349(6243):37-8
pubmed: 26138968
Sci Rep. 2016 May 17;6:26094
pubmed: 27185194
PLOS Digit Health. 2023 Jan 19;2(1):e0000170
pubmed: 36812607
Yearb Med Inform. 2016 Aug 02;Suppl 1:S103-16
pubmed: 27488402
J Am Med Inform Assoc. 2017 Jan;24(1):198-208
pubmed: 27189013
Front Med (Lausanne). 2019 Mar 01;6:34
pubmed: 30881956
JAMA Netw Open. 2022 Sep 1;5(9):e2233946
pubmed: 36173632
NPJ Digit Med. 2021 Oct 28;4(1):154
pubmed: 34711955
Neural Comput. 1998 Sep 15;10(7):1895-1923
pubmed: 9744903
Lancet Digit Health. 2021 Apr;3(4):e213-e216
pubmed: 33610488
Clin Infect Dis. 2019 Nov 13;69(11):1926-1934
pubmed: 30715250
JMIR Med Inform. 2018 Feb 23;6(1):e11
pubmed: 29475824
N Engl J Med. 1978 Apr 6;298(14):773-5
pubmed: 342963
NPJ Digit Med. 2018 May 8;1:18
pubmed: 31304302
BMJ Glob Health. 2020 Feb 28;5(2):e002067
pubmed: 32181003
Lancet. 2018 Dec 1;392(10162):2331-2332
pubmed: 30318263

Auteurs

Cécile Trottet (C)

Intelligent Global Health Research Group, Machine Learning and Optimization Laboratory, Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland.

Thijs Vogels (T)

Intelligent Global Health Research Group, Machine Learning and Optimization Laboratory, Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland.

Kristina Keitel (K)

Division of Pediatric Emergency Medicine, Department of Pediatrics, Inselspital, Bern University Hospital, University of Bern, Switzerland.

Alexandra V Kulinkina (AV)

Digital Health Unit, Swiss Center for International Health, Swiss Tropical and Public Health Institute, Allschwil, Switzerland.
University of Basel, Basel, Switzerland.

Rainer Tan (R)

Clinical Research Unit, Swiss Tropical and Public Health Institute, Allschwil, Switzerland.
Ifakara Health Institute, Ifakara, Tanzania.
Center for Primary Care and Public Health (Unisanté), Lausanne, Switzerland.

Ludovico Cobuccio (L)

Clinical Research Unit, Swiss Tropical and Public Health Institute, Allschwil, Switzerland.

Martin Jaggi (M)

Machine Learning and Optimization Laboratory, Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland.

Mary-Anne Hartley (MA)

Intelligent Global Health Research Group, Machine Learning and Optimization Laboratory, Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland.
Laboratory of Intelligent Global Health Technologies, Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT, USA.

Classifications MeSH