Privacy-Preserving Federated Model Predicting Bipolar Transition in Patients With Depression: Prediction Model Development Study.
bipolar disorder
data standardization
depression
differential privacy
federated learning
Journal
Journal of medical Internet research
ISSN: 1438-8871
Titre abrégé: J Med Internet Res
Pays: Canada
ID NLM: 100959882
Informations de publication
Date de publication:
20 07 2023
20 07 2023
Historique:
received:
01
02
2023
accepted:
29
06
2023
revised:
10
03
2023
medline:
21
7
2023
pubmed:
20
7
2023
entrez:
20
7
2023
Statut:
epublish
Résumé
Mood disorder has emerged as a serious concern for public health; in particular, bipolar disorder has a less favorable prognosis than depression. Although prompt recognition of depression conversion to bipolar disorder is needed, early prediction is challenging due to overlapping symptoms. Recently, there have been attempts to develop a prediction model by using federated learning. Federated learning in medical fields is a method for training multi-institutional machine learning models without patient-level data sharing. This study aims to develop and validate a federated, differentially private multi-institutional bipolar transition prediction model. This retrospective study enrolled patients diagnosed with the first depressive episode at 5 tertiary hospitals in South Korea. We developed models for predicting bipolar transition by using data from 17,631 patients in 4 institutions. Further, we used data from 4541 patients for external validation from 1 institution. We created standardized pipelines to extract large-scale clinical features from the 4 institutions without any code modification. Moreover, we performed feature selection in a federated environment for computational efficiency and applied differential privacy to gradient updates. Finally, we compared the federated and the 4 local models developed with each hospital's data on internal and external validation data sets. In the internal data set, 279 out of 17,631 patients showed bipolar disorder transition. In the external data set, 39 out of 4541 patients showed bipolar disorder transition. The average performance of the federated model in the internal test (area under the curve [AUC] 0.726) and external validation (AUC 0.719) data sets was higher than that of the other locally developed models (AUC 0.642-0.707 and AUC 0.642-0.699, respectively). In the federated model, classifications were driven by several predictors such as the Charlson index (low scores were associated with bipolar transition, which may be due to younger age), severe depression, anxiolytics, young age, and visiting months (the bipolar transition was associated with seasonality, especially during the spring and summer months). We developed and validated a differentially private federated model by using distributed multi-institutional psychiatric data with standardized pipelines in a real-world environment. The federated model performed better than models using local data only.
Sections du résumé
BACKGROUND
Mood disorder has emerged as a serious concern for public health; in particular, bipolar disorder has a less favorable prognosis than depression. Although prompt recognition of depression conversion to bipolar disorder is needed, early prediction is challenging due to overlapping symptoms. Recently, there have been attempts to develop a prediction model by using federated learning. Federated learning in medical fields is a method for training multi-institutional machine learning models without patient-level data sharing.
OBJECTIVE
This study aims to develop and validate a federated, differentially private multi-institutional bipolar transition prediction model.
METHODS
This retrospective study enrolled patients diagnosed with the first depressive episode at 5 tertiary hospitals in South Korea. We developed models for predicting bipolar transition by using data from 17,631 patients in 4 institutions. Further, we used data from 4541 patients for external validation from 1 institution. We created standardized pipelines to extract large-scale clinical features from the 4 institutions without any code modification. Moreover, we performed feature selection in a federated environment for computational efficiency and applied differential privacy to gradient updates. Finally, we compared the federated and the 4 local models developed with each hospital's data on internal and external validation data sets.
RESULTS
In the internal data set, 279 out of 17,631 patients showed bipolar disorder transition. In the external data set, 39 out of 4541 patients showed bipolar disorder transition. The average performance of the federated model in the internal test (area under the curve [AUC] 0.726) and external validation (AUC 0.719) data sets was higher than that of the other locally developed models (AUC 0.642-0.707 and AUC 0.642-0.699, respectively). In the federated model, classifications were driven by several predictors such as the Charlson index (low scores were associated with bipolar transition, which may be due to younger age), severe depression, anxiolytics, young age, and visiting months (the bipolar transition was associated with seasonality, especially during the spring and summer months).
CONCLUSIONS
We developed and validated a differentially private federated model by using distributed multi-institutional psychiatric data with standardized pipelines in a real-world environment. The federated model performed better than models using local data only.
Identifiants
pubmed: 37471130
pii: v25i1e46165
doi: 10.2196/46165
pmc: PMC10401196
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e46165Informations de copyright
©Dong Yun Lee, Byungjin Choi, Chungsoo Kim, Egill Fridgeirsson, Jenna Reps, Myoungsuk Kim, Jihyeong Kim, Jae-Won Jang, Sang Youl Rhee, Won-Woo Seo, Seunghoon Lee, Sang Joon Son, Rae Woong Park. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 20.07.2023.
Références
JCO Clin Cancer Inform. 2020 Mar;4:184-200
pubmed: 32134684
Transl Psychiatry. 2021 Dec 20;11(1):642
pubmed: 34930903
Int J Med Inform. 2018 Apr;112:59-67
pubmed: 29500022
Neuropsychiatr Dis Treat. 2020 Jul 12;16:1695-1704
pubmed: 32764945
Am J Psychiatry. 2001 Aug;158(8):1265-70
pubmed: 11481161
BMC Fam Pract. 2010 Jan 05;11:1
pubmed: 20051110
Stud Health Technol Inform. 2019 Aug 21;264:1488-1489
pubmed: 31438195
J Med Syst. 2018 Nov 13;42(12):260
pubmed: 30421323
J Am Med Inform Assoc. 2018 Aug 1;25(8):969-975
pubmed: 29718407
Int J Med Inform. 2007 May-Jun;76(5-6):407-11
pubmed: 17081800
World J Gastroenterol. 2016 Oct 14;22(38):8540-8548
pubmed: 27784966
Sci Rep. 2022 Mar 15;12(1):4451
pubmed: 35292697
J Affect Disord. 2016 Nov 01;204:205-13
pubmed: 27371906
J Clin Psychiatry. 2007 Jan;68(1):47-51
pubmed: 17284129
Bipolar Disord. 2011 May;13(3):227-37
pubmed: 21676126
J Anxiety Disord. 2008;22(2):344-50
pubmed: 17420113
Curr Psychiatry Rep. 2015 Aug;17(8):606
pubmed: 26112914
Nat Med. 2021 Oct;27(10):1735-1743
pubmed: 34526699
Shanghai Arch Psychiatry. 2018 Apr 25;30(2):93-101
pubmed: 29736129
Brainlesion. 2019;11383:92-104
pubmed: 31231720
J Affect Disord. 2014 Oct;168:210-23
pubmed: 25063960
Lancet. 2018 Nov 10;392(10159):1789-1858
pubmed: 30496104
NPJ Digit Med. 2020 Sep 14;3:119
pubmed: 33015372
Eur Arch Psychiatry Clin Neurosci. 2018 Dec;268(8):741-748
pubmed: 30032467
Stud Health Technol Inform. 2015;216:574-8
pubmed: 26262116
Int J Law Psychiatry. 2018 Sep - Oct;60:40-44
pubmed: 30217329
BMJ Health Care Inform. 2020 Mar;27(1):
pubmed: 32229499
Am J Psychiatry. 2013 Nov;170(11):1249-62
pubmed: 24030475
Acta Psychiatr Scand. 2018 May;137(5):422-432
pubmed: 29498031
Comput Biol Med. 2019 Sep;112:103375
pubmed: 31382212
Arch Gen Psychiatry. 2012 Sep;69(9):943-51
pubmed: 22566563
Acta Psychiatr Scand. 2017 Apr;135(4):273-284
pubmed: 28097648
Br J Psychiatry. 2007 Mar;190:189-91
pubmed: 17329735
Neuropsychopharmacology. 2021 Jan;46(2):455-461
pubmed: 32927464