Neuroimaging-based classification of PTSD using data-driven computational approaches: A multisite big data study from the ENIGMA-PGC PTSD consortium.


Journal

NeuroImage
ISSN: 1095-9572
Titre abrégé: Neuroimage
Pays: United States
ID NLM: 9215515

Informations de publication

Date de publication:
01 Dec 2023
Historique:
received: 15 03 2023
revised: 10 09 2023
accepted: 16 10 2023
medline: 27 11 2023
pubmed: 20 10 2023
entrez: 20 10 2023
Statut: ppublish

Résumé

Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group. We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality. We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60 % test AUC for s-MRI, 59 % for rs-fMRI and 56 % for d-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75 % AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance. These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable.

Sections du résumé

BACKGROUND BACKGROUND
Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group.
METHODS METHODS
We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality.
RESULTS RESULTS
We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60 % test AUC for s-MRI, 59 % for rs-fMRI and 56 % for d-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75 % AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance.
CONCLUSION CONCLUSIONS
These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable.

Identifiants

pubmed: 37858907
pii: S1053-8119(23)00563-3
doi: 10.1016/j.neuroimage.2023.120412
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Pagination

120412

Subventions

Organisme : NIMH NIH HHS
ID : R01 MH111671
Pays : United States
Organisme : NIMH NIH HHS
ID : R01 MH117601
Pays : United States
Organisme : NIMH NIH HHS
ID : R01 MH119227
Pays : United States
Organisme : NCCIH NIH HHS
ID : R01 AT011267
Pays : United States
Organisme : NINDS NIH HHS
ID : R61 NS120249
Pays : United States
Organisme : NIMH NIH HHS
ID : R01 MH129832
Pays : United States

Informations de copyright

Copyright © 2023 The Author(s). Published by Elsevier Inc. All rights reserved.

Déclaration de conflit d'intérêts

Declaration of Competing Interest Dr. Thompson received partial grant support from Biogen, Inc., and Amazon, Inc., for work unrelated to the current study; Dr. Lebois reports unpaid membership on the Scientific Committee for International Society for the Study of Trauma and Dissociation (ISSTD), grant support from the National Institute of Mental Health, K01 MH118467 and the Julia Kasparian Fund for Neuroscience Research, McLean Hospital. Dr. Lebois also reports spousal IP payments from Vanderbilt University for technology licensed to Acadia Pharmaceuticals unrelated to the present work. ISSTD and NIMH were not involved in the analysis or preparation of the manuscript; Dr. Etkin reports salary and equity from Alto Neuroscience, equity from Mindstrong Health and Akili Interactive. Other authors have no conflicts of interest to declare.

Auteurs

Xi Zhu (X)

Department of Psychiatry, Columbia University Medical Center, New York, NY, USA; New York State Psychiatric Institute, New York, NY, USA.

Yoojean Kim (Y)

New York State Psychiatric Institute, New York, NY, USA.

Orren Ravid (O)

New York State Psychiatric Institute, New York, NY, USA.

Xiaofu He (X)

Department of Psychiatry, Columbia University Medical Center, New York, NY, USA.

Benjamin Suarez-Jimenez (B)

University of Rochester, Rochester, NY, USA.

Sigal Zilcha-Mano (S)

University of Haifa, Haifa, Israel.

Amit Lazarov (A)

Tel-Aviv University, Tel Aviv, Israel.

Seonjoo Lee (S)

Department of Psychiatry, Columbia University Medical Center, New York, NY, USA; New York State Psychiatric Institute, New York, NY, USA.

Chadi G Abdallah (CG)

Baylor College of Medicine, Houston, TX, USA; Yale University School of Medicine, New Haven, CT, USA.

Michael Angstadt (M)

University of Michigan, Ann Arbor, MI, USA.

Christopher L Averill (CL)

Baylor College of Medicine, Houston, TX, USA; Yale University School of Medicine, New Haven, CT, USA.

C Lexi Baird (CL)

Duke University, Durham, NC, USA.

Lee A Baugh (LA)

Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA.

Jennifer U Blackford (JU)

Munroe-Meyer Institute, University of Nebraska Medical Center, Omaha, NE, USA.

Jessica Bomyea (J)

University of California San Diego, La Jolla, CA, USA.

Steven E Bruce (SE)

Center for Trauma Recovery, Department of Psychological Sciences, University of Missouri-St. Louis, St. Louis, MO, USA.

Richard A Bryant (RA)

School of Psychology, University of New South Wales, Sydney, NSW, Australia.

Zhihong Cao (Z)

Department of Radiology, The Affiliated Yixing Hospital of Jiangsu University, Yixing, Jiangsu, China.

Kyle Choi (K)

University of California San Diego, La Jolla, CA, USA.

Josh Cisler (J)

Department of Psychiatry, University of Texas at Austin, Austin, TX, USA.

Andrew S Cotton (AS)

University of Toledo, Toledo, OH, USA.

Judith K Daniels (JK)

University of Groningen, Groningen, The Netherlands.

Nicholas D Davenport (ND)

Minneapolis VA Health Care System, Minneapolis, MN, USA.

Richard J Davidson (RJ)

University of Wisconsin-Madison, Madison, WI, USA.

Michael D DeBellis (MD)

Duke University, Durham, NC, USA.

Emily L Dennis (EL)

University of Utah School of Medicine, Salt Lake City, UT, USA.

Maria Densmore (M)

Departments of Psychology and Psychiatry, Neuroscience Program, Western University, London, ON, Canada; Department of Psychology, University of British Columbia, Okanagan, Kelowna, British Columbia, Canada.

Terri deRoon-Cassini (T)

Medical College of Wisconsin, Milwaukee, WI, USA.

Seth G Disner (SG)

Minneapolis VA Health Care System, Minneapolis, MN, USA.

Wissam El Hage (WE)

UMR 1253, CIC 1415, University of Tours, CHRU de Tours, INSERM, France.

Amit Etkin (A)

Stanford University, Stanford, CA, USA.

Negar Fani (N)

Emory University Department of Psychiatry and Behavioral Sciences, Atlanta, GA, USA.

Kelene A Fercho (KA)

Civil Aerospace Medical Institute, US Federal Aviation Administration, Oklahoma City, OK, USA.

Jacklynn Fitzgerald (J)

Marquette University, Milwaukee, WI, USA.

Gina L Forster (GL)

Brain Health Research Centre, Department of Anatomy, University of Otago, Dunedin, New Zealand.

Jessie L Frijling (JL)

Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.

Elbert Geuze (E)

Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands.

Atilla Gonenc (A)

Cognitive and Clinical Neuroimaging Core, McLean Hospital, Belmont, MA, USA.

Evan M Gordon (EM)

Department of Radiology, Washington University School of Medicine, St. Louis, MO, USA.

Staci Gruber (S)

Cognitive and Clinical Neuroimaging Core, McLean Hospital, Belmont, MA, USA.

Daniel W Grupe (DW)

University of Wisconsin-Madison, Madison, WI, USA.

Jeffrey P Guenette (JP)

Division of Neuroradiology, Brigham and Women's Hospital, Boston, MA, USA.

Courtney C Haswell (CC)

Duke University, Durham, NC, USA.

Ryan J Herringa (RJ)

School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, USA.

Julia Herzog (J)

Heidelberg University, Heidelberg, Germany.

David Bernd Hofmann (DB)

University of Münster, Münster, Germany.

Bobak Hosseini (B)

University of Illinois at Chicago, Chicago, IL, USA.

Anna R Hudson (AR)

Ghent University, Ghent, Belgium.

Ashley A Huggins (AA)

Duke University, Durham, NC, USA.

Jonathan C Ipser (JC)

University of Cape Town, Cape Town, South Africa.

Neda Jahanshad (N)

Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA.

Meilin Jia-Richards (M)

Department of Psychology and Neuroscience, Baylor University, Waco, TX, USA.

Tanja Jovanovic (T)

Wayne State University School of Medicine, Detroit, MI, USA.

Milissa L Kaufman (ML)

Division of Women's Mental Health, McLean Hospital, Belmont, MA, USA.

Mitzy Kennis (M)

Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands.

Anthony King (A)

University of Michigan, Ann Arbor, MI, USA.

Philipp Kinzel (P)

Department of Child and Adolescent Psychiatry, Psychosomatic and Psychotherapy, Ludwig Maximilian University of Munich, Munich, Germany; Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA.

Saskia B J Koch (SBJ)

Donders Institute for Brain, Cognition and Behavior, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, The Netherlands.

Inga K Koerte (IK)

Department of Child and Adolescent Psychiatry, Psychosomatic and Psychotherapy, Ludwig Maximilian University of Munich, Munich, Germany; Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA.

Sheri M Koopowitz (SM)

University of Cape Town, Cape Town, South Africa.

Mayuresh S Korgaonkar (MS)

Westmead Institute for Medical Research, Westmead, NSW, Australia.

John H Krystal (JH)

Yale University School of Medicine, New Haven, CT, USA.

Ruth Lanius (R)

Department of Neuroscience, Western University, London, ON, Canada.

Christine L Larson (CL)

University of Wisconsin-Milwaukee, Milwaukee, WI, USA.

Lauren A M Lebois (LAM)

McLean Hospital, Belmont, MA, USA; Harvard Medical School, Boston, MA, USA.

Gen Li (G)

Institute of Psychology, Chinese Academy of Sciences, Beijing, China.

Israel Liberzon (I)

Psychiatry and Behavioral Science, Texas A&M University Health Science Center, College Station, TX, USA.

Guang Ming Lu (GM)

Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, China.

Yifeng Luo (Y)

Department of Radiology, The Affiliated Yixing Hospital of Jiangsu University, Yixing, Jiangsu, China.

Vincent A Magnotta (VA)

University of Iowa, Iowa City, IA, USA.

Antje Manthey (A)

Charité Universitätsmedizin Berlin Campus Charite Mitte: Charite Universitatsmedizin Berlin, Berlin, Germany.

Adi Maron-Katz (A)

Stanford University, Stanford, CA, USA.

Geoffery May (G)

VISN 17 Center of Excellence for Research on Returning War Veterans, Waco, TX, USA.

Katie McLaughlin (K)

Harvard University, Boston, MA, USA.

Sven C Mueller (SC)

Ghent University, Ghent, Belgium.

Laura Nawijn (L)

Department of Psychiatry, Amsterdam University Medical Centers, VU University Medical Center, VU University, Amsterdam, The Netherlands.

Steven M Nelson (SM)

Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA.

Richard W J Neufeld (RWJ)

Departments of Psychology and Psychiatry, Neuroscience Program, Western University, London, ON, Canada; Department of Psychology, University of British Columbia, Okanagan, Kelowna, British Columbia, Canada.

Jack B Nitschke (JB)

University of Wisconsin-Madison, Madison, WI, USA.

Erin M O'Leary (EM)

University of Toledo, Toledo, OH, USA.

Bunmi O Olatunji (BO)

Department of Psychology, Vanderbilt University, Nashville, TN, USA.

Miranda Olff (M)

Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.

Matthew Peverill (M)

University of Washington, Seattle, WA, USA.

K Luan Phan (KL)

Department of Psychiatry and Behavioral Health, Ohio State University, Columbus, OH, USA.

Rongfeng Qi (R)

Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, China.

Yann Quidé (Y)

School of Psychology, University of New South Wales, Sydney, NSW, Australia; Neuroscience Research Australia, Randwick, NSW, Australia.

Ivan Rektor (I)

Masaryk University, Brno, Czechia.

Kerry Ressler (K)

McLean Hospital, Belmont, MA, USA; Harvard Medical School, Boston, MA, USA.

Pavel Riha (P)

Masaryk University, Brno, Czechia.

Marisa Ross (M)

Northwestern Neighborhood and Networks Initiative, Northwestern University Institute for Policy Research, Evanston, IL, USA.

Isabelle M Rosso (IM)

McLean Hospital, Belmont, MA, USA; Harvard Medical School, Boston, MA, USA.

Lauren E Salminen (LE)

Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA.

Kelly Sambrook (K)

University of Washington, Seattle, WA, USA.

Christian Schmahl (C)

Heidelberg University, Heidelberg, Germany.

Martha E Shenton (ME)

Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA.

Margaret Sheridan (M)

University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.

Chiahao Shih (C)

University of Toledo, Toledo, OH, USA.

Maurizio Sicorello (M)

Heidelberg University, Heidelberg, Germany.

Anika Sierk (A)

Charité Universitätsmedizin Berlin Campus Charite Mitte: Charite Universitatsmedizin Berlin, Berlin, Germany.

Alan N Simmons (AN)

Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA.

Raluca M Simons (RM)

University of South Dakota, Vermillion, SD, USA.

Jeffrey S Simons (JS)

University of South Dakota, Vermillion, SD, USA.

Scott R Sponheim (SR)

Minneapolis VA Health Care System, Minneapolis, MN, USA; University of Minnesota, Minneapolis, MN, USA.

Murray B Stein (MB)

University of California San Diego, La Jolla, CA, USA.

Dan J Stein (DJ)

University of Cape Town, Cape Town, South Africa.

Jennifer S Stevens (JS)

Emory University Department of Psychiatry and Behavioral Sciences, Atlanta, GA, USA.

Thomas Straube (T)

University of Münster, Münster, Germany.

Delin Sun (D)

Duke University, Durham, NC, USA.

Jean Théberge (J)

Departments of Psychology and Psychiatry, Neuroscience Program, Western University, London, ON, Canada; Department of Psychology, University of British Columbia, Okanagan, Kelowna, British Columbia, Canada.

Paul M Thompson (PM)

Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA.

Sophia I Thomopoulos (SI)

Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA.

Nic J A van der Wee (NJA)

Leiden University Medical Center, Leiden, The Netherlands.

Steven J A van der Werff (SJA)

Leiden University Medical Center, Leiden, The Netherlands.

Theo G M van Erp (TGM)

University of California, Irvine, Irvine, CA, USA.

Sanne J H van Rooij (SJH)

Emory University Department of Psychiatry and Behavioral Sciences, Atlanta, GA, USA.

Mirjam van Zuiden (M)

Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.

Tim Varkevisser (T)

Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands.

Dick J Veltman (DJ)

Department of Psychiatry, Amsterdam University Medical Centers, VU University Medical Center, VU University, Amsterdam, The Netherlands.

Robert R J M Vermeiren (RRJM)

Leiden University Medical Center, Leiden, The Netherlands.

Henrik Walter (H)

Charité Universitätsmedizin Berlin Campus Charite Mitte: Charite Universitatsmedizin Berlin, Berlin, Germany.

Li Wang (L)

Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.

Xin Wang (X)

University of Toledo, Toledo, OH, USA.

Carissa Weis (C)

Medical College of Wisconsin, Milwaukee, WI, USA.

Sherry Winternitz (S)

Division of Women's Mental Health, McLean Hospital, Belmont, MA, USA.

Hong Xie (H)

University of Toledo, Toledo, OH, USA.

Ye Zhu (Y)

Institute of Psychology, Chinese Academy of Sciences, Beijing, China.

Melanie Wall (M)

Department of Psychiatry, Columbia University Medical Center, New York, NY, USA; New York State Psychiatric Institute, New York, NY, USA.

Yuval Neria (Y)

Department of Psychiatry, Columbia University Medical Center, New York, NY, USA.

Rajendra A Morey (RA)

Duke University, Durham, NC, USA.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH