Natural language processing for mental health interventions: a systematic review and research framework.


Journal

Translational psychiatry
ISSN: 2158-3188
Titre abrégé: Transl Psychiatry
Pays: United States
ID NLM: 101562664

Informations de publication

Date de publication:
06 10 2023
Historique:
received: 07 03 2022
accepted: 04 09 2023
revised: 31 08 2023
medline: 9 10 2023
pubmed: 6 10 2023
entrez: 5 10 2023
Statut: epublish

Résumé

Neuropsychiatric disorders pose a high societal cost, but their treatment is hindered by lack of objective outcomes and fidelity metrics. AI technologies and specifically Natural Language Processing (NLP) have emerged as tools to study mental health interventions (MHI) at the level of their constituent conversations. However, NLP's potential to address clinical and research challenges remains unclear. We therefore conducted a pre-registered systematic review of NLP-MHI studies using PRISMA guidelines (osf.io/s52jh) to evaluate their models, clinical applications, and to identify biases and gaps. Candidate studies (n = 19,756), including peer-reviewed AI conference manuscripts, were collected up to January 2023 through PubMed, PsycINFO, Scopus, Google Scholar, and ArXiv. A total of 102 articles were included to investigate their computational characteristics (NLP algorithms, audio features, machine learning pipelines, outcome metrics), clinical characteristics (clinical ground truths, study samples, clinical focus), and limitations. Results indicate a rapid growth of NLP MHI studies since 2019, characterized by increased sample sizes and use of large language models. Digital health platforms were the largest providers of MHI data. Ground truth for supervised learning models was based on clinician ratings (n = 31), patient self-report (n = 29) and annotations by raters (n = 26). Text-based features contributed more to model accuracy than audio markers. Patients' clinical presentation (n = 34), response to intervention (n = 11), intervention monitoring (n = 20), providers' characteristics (n = 12), relational dynamics (n = 14), and data preparation (n = 4) were commonly investigated clinical categories. Limitations of reviewed studies included lack of linguistic diversity, limited reproducibility, and population bias. A research framework is developed and validated (NLPxMHI) to assist computational and clinical researchers in addressing the remaining gaps in applying NLP to MHI, with the goal of improving clinical utility, data access, and fairness.

Identifiants

pubmed: 37798296
doi: 10.1038/s41398-023-02592-2
pii: 10.1038/s41398-023-02592-2
pmc: PMC10556019
doi:

Types de publication

Systematic Review Research Support, Non-U.S. Gov't Research Support, N.I.H., Extramural Research Support, U.S. Gov't, Non-P.H.S.

Langues

eng

Sous-ensembles de citation

IM

Pagination

309

Subventions

Organisme : NIMH NIH HHS
ID : R44 MH124334
Pays : United States
Organisme : NIMH NIH HHS
ID : R01 MH125179
Pays : United States
Organisme : Bill & Melinda Gates Foundation
ID : INV-004841
Pays : United States
Organisme : NIMH NIH HHS
ID : K23 MH134068
Pays : United States
Organisme : NCATS NIH HHS
ID : KL2 TR001446
Pays : United States

Informations de copyright

© 2023. Springer Nature Limited.

Références

Cogn Behav Ther. 2015;44(1):21-32
pubmed: 25244051
Psychother Res. 2021 Mar;31(3):302-312
pubmed: 32558625
Lancet. 2018 Nov 10;392(10159):1789-1858
pubmed: 30496104
Ment Health Serv Res. 2005 Mar;7(1):5-20
pubmed: 15832690
J Couns Psychol. 2020 Jul;67(4):438-448
pubmed: 32614225
Assessment. 2017 Mar;24(2):157-172
pubmed: 26358713
Proc IEEE Int Conf Acoust Speech Signal Process. 2019 May;2019:6605-6609
pubmed: 36704712
IEEE J Biomed Health Inform. 2017 Sep;21(5):1449-1459
pubmed: 27542187
NPJ Digit Med. 2020 Jun 3;3:82
pubmed: 32550644
Schizophr Res. 2023 Sep;259:38-47
pubmed: 35811267
Front Psychol. 2019 May 14;10:1065
pubmed: 31156504
Psychol Sci. 2018 Oct;29(10):1716-1723
pubmed: 30020863
Patient Educ Couns. 2021 Aug;104(8):2098-2105
pubmed: 33468364
Eur J Psychotraumatol. 2020 Mar 17;11(1):1726672
pubmed: 32284819
Public Health. 2015 Jun;129(6):611-20
pubmed: 26025176
Psychotherapy (Chic). 2015 Mar;52(1):19-30
pubmed: 24866972
Psychol Med. 2022 Apr;52(5):957-967
pubmed: 32744201
JAMA Netw Open. 2020 Mar 2;3(3):e200265
pubmed: 32119094
World Psychiatry. 2017 Oct;16(3):287-298
pubmed: 28941113
Evid Based Ment Health. 2020 Feb;23(1):21-26
pubmed: 32046989
J Subst Abuse Treat. 2016 Jun;65:43-50
pubmed: 26944234
J Couns Psychol. 2016 Apr;63(3):343-350
pubmed: 26784286
Annu Int Conf IEEE Eng Med Biol Soc. 2022 Jul;2022:2668-2671
pubmed: 36085663
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
Lancet. 2007 Sep 29;370(9593):1164-74
pubmed: 17804061
IEEE J Biomed Health Inform. 2017 Mar;21(2):476-487
pubmed: 26625437
Trans Assoc Comput Linguist. 2016;4:463-476
pubmed: 28344978
JMIR Form Res. 2020 Sep 23;4(9):e17424
pubmed: 32769074
JAMA Psychiatry. 2020 Jan 1;77(1):35-43
pubmed: 31436785
J Consult Clin Psychol. 2005 Aug;73(4):590-598
pubmed: 16173846
J Pediatr Psychol. 2019 Apr 1;44(3):289-299
pubmed: 30698755
Nat Rev Cancer. 2018 Aug;18(8):500-510
pubmed: 29777175
Annu Rev Clin Psychol. 2019 May 7;15:207-231
pubmed: 30550721
PLoS One. 2021 Oct 22;16(10):e0258639
pubmed: 34679105
Psychother Res. 2021 Mar;31(3):281-288
pubmed: 32172682
PLoS One. 2015 Dec 02;10(12):e0143055
pubmed: 26630392
KDD. 2019 Aug;2019:2487-2495
pubmed: 33859865
JAMA Psychiatry. 2020 Sep 1;77(9):889-890
pubmed: 32459326
BMC Public Health. 2022 Mar 18;22(1):530
pubmed: 35300638
Health Informatics J. 2022 Oct-Dec;28(4):14604582221142442
pubmed: 36426508
World Psychiatry. 2018 Feb;17(1):67-75
pubmed: 29352548
Soc Sci Med. 2021 Aug;283:114176
pubmed: 34214846
World Psychiatry. 2018 Feb;17(1):30-38
pubmed: 29352529
Proc ACM Int Conf Multimodal Interact. 2020 Oct;2020:406-413
pubmed: 34337616
Behav Res Methods. 2021 Oct;53(5):2069-2082
pubmed: 33754322
Schizophrenia (Heidelb). 2022 Apr 12;8(1):36
pubmed: 35853894
JMIR Form Res. 2021 Feb 9;5(2):e26190
pubmed: 33502999
J Couns Psychol. 2017 Jul;64(4):385-393
pubmed: 28318277
Psychol Bull. 2015 Jul;141(4):747-68
pubmed: 25961373
Health Serv Res. 2010 Oct;45(5 Pt 2):1456-67
pubmed: 21054366
J Affect Disord. 2018 Apr 1;230:84-86
pubmed: 29407543
Health Aff (Millwood). 2009 May-Jun;28(3):w490-501
pubmed: 19366722
Clin Psychol Rev. 2012 Jun;32(4):280-91
pubmed: 22466509
Front Psychiatry. 2019 Oct 18;10:746
pubmed: 31681047
BMJ. 2009 Jun 29;338:b2393
pubmed: 19564179
JAMA Psychiatry. 2020 Jun 1;77(6):637-644
pubmed: 31825494
JAMA Netw Open. 2020 Mar 2;3(3):e201210
pubmed: 32191329
Lancet. 2007 Sep 8;370(9590):841-50
pubmed: 17826169
Psychother Res. 2021 Mar;31(3):326-338
pubmed: 32619163
PeerJ Comput Sci. 2016 Apr;2:
pubmed: 28286867
Interspeech. 2019 Sep;2019:1423-1427
pubmed: 36811082
Nat Med. 2020 Jul;26(7):1084-1088
pubmed: 32632194
Interspeech. 2018 Sep;2018:3413-3417
pubmed: 34307639
BMJ. 2021 Sep 30;374:n2061
pubmed: 34593508
J Med Internet Res. 2018 Jun 26;20(6):e10148
pubmed: 29945856
Psychother Res. 2009 Jul;19(4-5):418-28
pubmed: 19034715
J Am Med Inform Assoc. 2020 Dec 9;27(12):2011-2015
pubmed: 32594179
Lancet Glob Health. 2020 Nov;8(11):e1352
pubmed: 33069297
Annu Rev Clin Psychol. 2018 May 7;14:91-118
pubmed: 29401044
Front Psychiatry. 2020 Aug 19;11:846
pubmed: 32973586
PLoS One. 2020 Jan 15;15(1):e0225695
pubmed: 31940347
Psychother Res. 2023 Jul;33(6):757-767
pubmed: 36525586
Acta Neurol Scand. 2020 May;141(5):388-396
pubmed: 31889296
JMIR Med Inform. 2022 Nov 8;10(11):e38168
pubmed: 36346654
Clin Exp Ophthalmol. 2019 Jan;47(1):128-139
pubmed: 30155978
Front Digit Health. 2021 Dec 06;3:779091
pubmed: 34939068
World Psychiatry. 2018 Oct;17(3):276-277
pubmed: 30192103
Internet Interv. 2021 Nov 23;26:100486
pubmed: 34877263
Psychol Med. 2023 Feb;53(3):918-926
pubmed: 34154682
Psychother Res. 2018 Mar;28(2):165-182
pubmed: 28714778
NPJ Digit Med. 2020 Mar 24;3:43
pubmed: 32219184
Behav Res Methods. 2022 Apr;54(2):690-711
pubmed: 34346043
J Psychopharmacol. 2015 Jun;29(6):669-77
pubmed: 25922420
Am Psychol. 2014 Apr;69(3):218-29
pubmed: 24393136
J Psycholinguist Res. 2021 Feb;50(1):143-153
pubmed: 33484369
Proc Natl Acad Sci U S A. 2022 Mar 29;119(13):e2114737119
pubmed: 35316132
Int J Med Inform. 2022 Apr;160:104716
pubmed: 35183870
Prog Neuropsychopharmacol Biol Psychiatry. 2019 Jan 10;88:112-120
pubmed: 30017778
Psychother Res. 2009 Jul;19(4-5):502-10
pubmed: 19585370
Schizophr Res. 2023 Sep;259:97-103
pubmed: 35568676
Comput Speech Lang. 2022 Sep;75:
pubmed: 35479611
J Psychiatr Res. 2021 Apr;136:39-46
pubmed: 33549901
Interspeech. 2019 Sep;2019:1901-1905
pubmed: 36703954
Psychotherapy (Chic). 2021 Jun;58(2):324-339
pubmed: 33734743
NPJ Digit Med. 2019 Jun 3;2:45
pubmed: 31304391
Psychother Res. 2010 Sep;20(5):546-63
pubmed: 20665338
Am J Psychiatry. 2008 Sep;165(9):1102-8
pubmed: 18765491
J Couns Psychol. 2021 Jan;68(1):77-87
pubmed: 32352823
J Fam Psychol. 2012 Oct;26(5):816-27
pubmed: 22888778
J Med Internet Res. 2021 Jul 14;23(7):e28244
pubmed: 34259637
JAMA Psychiatry. 2021 Jun 1;78(6):593-594
pubmed: 33688937
Implement Sci. 2014 Apr 24;9:49
pubmed: 24758152
Psychother Res. 2021 Jan;31(1):92-116
pubmed: 32862761
Interspeech. 2018 Sep;2018:2344-2348
pubmed: 34307638
Nat Rev Neurosci. 2008 Oct;9(10):788-96
pubmed: 18784657

Auteurs

Matteo Malgaroli (M)

Department of Psychiatry, New York University, Grossman School of Medicine, New York, NY, 10016, USA. matteo.malgaroli@nyulangone.org.

Thomas D Hull (TD)

Talkspace, New York, NY, 10025, USA.

James M Zech (JM)

Talkspace, New York, NY, 10025, USA.
Department of Psychology, Florida State University, Tallahassee, FL, 32306, USA.

Tim Althoff (T)

Department of Computer Science, University of Washington, Seattle, WA, 98195, USA.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH