Vickybot, a Chatbot for Anxiety-Depressive Symptoms and Work-Related Burnout in Primary Care and Health Care Professionals: Development, Feasibility, and Potential Effectiveness Studies.
PRESTO
anxiety
burnout
chatbot
depression
digital
health care workers
primary care
primary care digital support tool in mental health
smartphone
symptom
Journal
Journal of medical Internet research
ISSN: 1438-8871
Titre abrégé: J Med Internet Res
Pays: Canada
ID NLM: 100959882
Informations de publication
Date de publication:
03 04 2023
03 04 2023
Historique:
received:
07
10
2022
accepted:
31
01
2023
revised:
19
12
2022
medline:
5
4
2023
pubmed:
1
2
2023
entrez:
31
1
2023
Statut:
epublish
Résumé
Many people attending primary care (PC) have anxiety-depressive symptoms and work-related burnout compounded by a lack of resources to meet their needs. The COVID-19 pandemic has exacerbated this problem, and digital tools have been proposed as a solution. We aimed to present the development, feasibility, and potential effectiveness of Vickybot, a chatbot aimed at screening, monitoring, and reducing anxiety-depressive symptoms and work-related burnout, and detecting suicide risk in patients from PC and health care workers. Healthy controls (HCs) tested Vickybot for reliability. For the simulation study, HCs used Vickybot for 2 weeks to simulate different clinical situations. For feasibility and effectiveness study, people consulting PC or health care workers with mental health problems used Vickybot for 1 month. Self-assessments for anxiety (Generalized Anxiety Disorder 7-item) and depression (Patient Health Questionnaire-9) symptoms and work-related burnout (based on the Maslach Burnout Inventory) were administered at baseline and every 2 weeks. Feasibility was determined from both subjective and objective user-engagement indicators (UEIs). Potential effectiveness was measured using paired 2-tailed t tests or Wilcoxon signed-rank test for changes in self-assessment scores. Overall, 40 HCs tested Vickybot simultaneously, and the data were reliably transmitted and registered. For simulation, 17 HCs (n=13, 76% female; mean age 36.5, SD 9.7 years) received 98.8% of the expected modules. Suicidal alerts were received correctly. For the feasibility and potential effectiveness study, 34 patients (15 from PC and 19 health care workers; 76% [26/34] female; mean age 35.3, SD 10.1 years) completed the first self-assessments, with 100% (34/34) presenting anxiety symptoms, 94% (32/34) depressive symptoms, and 65% (22/34) work-related burnout. In addition, 27% (9/34) of patients completed the second self-assessment after 2 weeks of use. No significant differences were found between the first and second self-assessments for anxiety (t The chatbot was useful in screening for the presence and severity of anxiety and depressive symptoms, and for detecting suicidal risk. Potential effectiveness was shown to reduce work-related burnout but not anxiety or depressive symptoms. Subjective perceptions of use contrasted with low objective-use metrics. Our results are promising but suggest the need to adapt and enhance the smartphone-based solution to improve engagement. A consensus on how to report UEIs and validate digital solutions, particularly for chatbots, is required.
Sections du résumé
BACKGROUND
Many people attending primary care (PC) have anxiety-depressive symptoms and work-related burnout compounded by a lack of resources to meet their needs. The COVID-19 pandemic has exacerbated this problem, and digital tools have been proposed as a solution.
OBJECTIVE
We aimed to present the development, feasibility, and potential effectiveness of Vickybot, a chatbot aimed at screening, monitoring, and reducing anxiety-depressive symptoms and work-related burnout, and detecting suicide risk in patients from PC and health care workers.
METHODS
Healthy controls (HCs) tested Vickybot for reliability. For the simulation study, HCs used Vickybot for 2 weeks to simulate different clinical situations. For feasibility and effectiveness study, people consulting PC or health care workers with mental health problems used Vickybot for 1 month. Self-assessments for anxiety (Generalized Anxiety Disorder 7-item) and depression (Patient Health Questionnaire-9) symptoms and work-related burnout (based on the Maslach Burnout Inventory) were administered at baseline and every 2 weeks. Feasibility was determined from both subjective and objective user-engagement indicators (UEIs). Potential effectiveness was measured using paired 2-tailed t tests or Wilcoxon signed-rank test for changes in self-assessment scores.
RESULTS
Overall, 40 HCs tested Vickybot simultaneously, and the data were reliably transmitted and registered. For simulation, 17 HCs (n=13, 76% female; mean age 36.5, SD 9.7 years) received 98.8% of the expected modules. Suicidal alerts were received correctly. For the feasibility and potential effectiveness study, 34 patients (15 from PC and 19 health care workers; 76% [26/34] female; mean age 35.3, SD 10.1 years) completed the first self-assessments, with 100% (34/34) presenting anxiety symptoms, 94% (32/34) depressive symptoms, and 65% (22/34) work-related burnout. In addition, 27% (9/34) of patients completed the second self-assessment after 2 weeks of use. No significant differences were found between the first and second self-assessments for anxiety (t
CONCLUSIONS
The chatbot was useful in screening for the presence and severity of anxiety and depressive symptoms, and for detecting suicidal risk. Potential effectiveness was shown to reduce work-related burnout but not anxiety or depressive symptoms. Subjective perceptions of use contrasted with low objective-use metrics. Our results are promising but suggest the need to adapt and enhance the smartphone-based solution to improve engagement. A consensus on how to report UEIs and validate digital solutions, particularly for chatbots, is required.
Identifiants
pubmed: 36719325
pii: v25i1e43293
doi: 10.2196/43293
pmc: PMC10131622
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e43293Subventions
Organisme : Department of Health
Pays : United Kingdom
Informations de copyright
©Gerard Anmella, Miriam Sanabra, Mireia Primé-Tous, Xavier Segú, Myriam Cavero, Ivette Morilla, Iria Grande, Victoria Ruiz, Ariadna Mas, Inés Martín-Villalba, Alejandro Caballo, Julia-Parisad Esteva, Arturo Rodríguez-Rey, Flavia Piazza, Francisco José Valdesoiro, Claudia Rodriguez-Torrella, Marta Espinosa, Giulia Virgili, Carlota Sorroche, Alicia Ruiz, Aleix Solanes, Joaquim Radua, María Antonieta Also, Elisenda Sant, Sandra Murgui, Mireia Sans-Corrales, Allan H Young, Victor Vicens, Jordi Blanch, Elsa Caballeria, Hugo López-Pelayo, Clara López, Victoria Olivé, Laura Pujol, Sebastiana Quesada, Brisa Solé, Carla Torrent, Anabel Martínez-Aran, Joana Guarch, Ricard Navinés, Andrea Murru, Giovanna Fico, Michele de Prisco, Vicenzo Oliva, Silvia Amoretti, Casimiro Pio-Carrino, María Fernández-Canseco, Marta Villegas, Eduard Vieta, Diego Hidalgo-Mazzei. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 03.04.2023.
Références
Curr Treat Options Psychiatry. 2018 Sep;5(3):345-362
pubmed: 30397577
J Psychiatr Res. 2022 May;149:10-17
pubmed: 35217315
J Affect Disord. 2016 Aug;200:58-66
pubmed: 27128358
Soc Psychiatry Psychiatr Epidemiol. 2010 Feb;45(2):201-10
pubmed: 19452110
Psychol Med. 2020 Apr;50(5):838-848
pubmed: 30944054
Bipolar Disord. 2022 Sep;24(6):580-614
pubmed: 35839276
Lancet. 2021 Nov 6;398(10312):1700-1712
pubmed: 34634250
Lancet Psychiatry. 2020 Apr;7(4):e15-e16
pubmed: 32085839
Rev Psiquiatr Salud Ment (Engl Ed). 2020 Apr - Jun;13(2):90-94
pubmed: 32389516
Depress Anxiety. 2021 May;38(5):528-544
pubmed: 33393724
Eur Neuropsychopharmacol. 2021 Sep;50:118-120
pubmed: 34246052
Arch Intern Med. 2006 May 22;166(10):1092-7
pubmed: 16717171
BJPsych Open. 2016 May 13;2(3):204-209
pubmed: 27703777
Rev Psiquiatr Salud Ment (Engl Ed). 2020 Apr - Jun;13(2):105-110
pubmed: 32376131
BMJ Open. 2014 Jan 09;4(1):e003440
pubmed: 24413342
BMC Fam Pract. 2015 Mar 19;16:38
pubmed: 25880219
Rev Psiquiatr Salud Ment (Engl Ed). 2021 Apr 29;:
pubmed: 33933665
JMIR Mhealth Uhealth. 2021 Dec 1;9(12):e15433
pubmed: 34855618
Front Psychiatry. 2019 Feb 28;10:94
pubmed: 30873053
J Affect Disord. 2020 Oct 1;275:80-81
pubmed: 32658829
Psychol Trauma. 2020 Oct;12(7):812-819
pubmed: 32853011
J Affect Disord. 2018 Dec 1;241:436-445
pubmed: 30145515
Annu Rev Psychol. 2001;52:397-422
pubmed: 11148311
Psychiatr Serv. 2019 Jul 1;70(7):538-544
pubmed: 30914003
World Psychiatry. 2017 Oct;16(3):287-298
pubmed: 28941113
J Health Care Chaplain. 2021 Jul-Sep;27(3):129-145
pubmed: 31588868
Internet Interv. 2016 May;4(2):152-158
pubmed: 27398319
JMIR Form Res. 2022 Aug 11;6(8):e39129
pubmed: 35802001
Curr Opin Psychiatry. 2022 Mar 1;35(2):130-135
pubmed: 34966117
Lancet Digit Health. 2020 Jan;2(1):e25-e36
pubmed: 33328037
J Med Internet Res. 2017 Jan 05;19(1):e10
pubmed: 28057609
Psychiatr Serv. 2011 Feb;62(2):152-61
pubmed: 21285093
Eur Neuropsychopharmacol. 2021 Nov;52:1-2
pubmed: 34120055
Int J Med Inform. 2021 Jun;150:104440
pubmed: 33799055
Lancet. 2022 May 14;399(10338):1903-1916
pubmed: 35512727
Rev Psiquiatr Salud Ment (Engl Ed). 2020 Jul 13;:
pubmed: 32674993
Rev Psiquiatr Salud Ment (Engl Ed). 2020 Jul - Sep;13(3):174-175
pubmed: 32653319
Curr Psychiatry Rep. 2019 Nov 28;21(12):131
pubmed: 31776806
Dialogues Clin Neurosci. 2003 Jun;5(2):115-28
pubmed: 22034245
Aten Primaria. 2005 Sep 30;36(5):246-7
pubmed: 16194491
Int J Environ Res Public Health. 2016 Nov 24;13(12):
pubmed: 27886138
J Am Med Inform Assoc. 2021 Apr 23;28(5):985-997
pubmed: 33463680
Lancet Psychiatry. 2020 Mar;7(3):e14
pubmed: 32035030
J Affect Disord. 2020 Aug 1;273:422-424
pubmed: 32425275
Am J Prev Med. 2009 May;36(5):452-7
pubmed: 19362699
JMIR Ment Health. 2017 Jun 06;4(2):e19
pubmed: 28588005
Psychosom Med. 2001 Jul-Aug;63(4):679-86
pubmed: 11485122
JMIR Form Res. 2021 Apr 21;5(4):e21678
pubmed: 33881403
Stud Health Technol Inform. 2021 Dec 15;284:259-263
pubmed: 34920522
Lancet. 2019 Jul 13;394(10193):93
pubmed: 31305255
JMIR Mhealth Uhealth. 2021 Nov 26;9(11):e28577
pubmed: 34842552
JMIR Mhealth Uhealth. 2018 Jun 20;6(6):e10042
pubmed: 29925491
JMIR Mhealth Uhealth. 2020 Apr 1;8(4):e15608
pubmed: 32234708
N Engl J Med. 2020 Apr 30;382(18):1679-1681
pubmed: 32160451
BMC Psychiatry. 2012 Mar 12;12:18
pubmed: 22409935
J Med Internet Res. 2022 Feb 2;24(2):e31565
pubmed: 35107440
J Affect Disord. 2017 Aug 15;218:15-22
pubmed: 28456072
Acta Psychiatr Scand. 2020 Apr;141(4):350-355
pubmed: 31930477
J Clin Psychiatry. 2021 Feb 23;82(2):
pubmed: 33988922
Front Public Health. 2022 Jul 14;10:865712
pubmed: 35910893
JMIR Mhealth Uhealth. 2019 Apr 11;7(4):e11500
pubmed: 30973342
Aten Primaria. 2005 Sep 30;36(5):239-45
pubmed: 16194490
JMIR Mhealth Uhealth. 2020 Aug 7;8(8):e16862
pubmed: 32540843
Br J Psychiatry. 2007 Feb;190:172-3
pubmed: 17267936
Eur Psychiatry. 2022 Jun 15;:1-21
pubmed: 35703080
Psychiatr Res Clin Pract. 2021 Summer;3(2):57-66
pubmed: 34414359
Health Qual Life Outcomes. 2010 Jan 20;8:8
pubmed: 20089179
J Affect Disord. 2021 Mar 1;282:488-494
pubmed: 33422826
Rev Psiquiatr Salud Ment (Engl Ed). 2021 Apr-Jun;14(2):90-105
pubmed: 33309957
Can J Psychiatry. 2019 Jul;64(7):456-464
pubmed: 30897957
JMIR Form Res. 2022 Jun 8;6(6):e34951
pubmed: 35675115
JAMA Netw Open. 2020 Mar 2;3(3):e203976
pubmed: 32202646
BMJ Open. 2017 Jan 13;7(1):e012816
pubmed: 28087546
Rev Psiquiatr Salud Ment (Engl Ed). 2021 Apr-Jun;14(2):106-112
pubmed: 32622882
Eur Neuropsychopharmacol. 2022 Oct;63:17-34
pubmed: 36041245
J Gen Intern Med. 2001 Sep;16(9):606-13
pubmed: 11556941
NPJ Digit Med. 2022 May 11;5(1):61
pubmed: 35545663
J Affect Disord. 2009 Dec;119(1-3):52-8
pubmed: 19361865
Rev Psiquiatr Salud Ment (Engl Ed). 2021 Jan-Mar;14(1):16-26
pubmed: 32962948
World Psychiatry. 2019 Feb;18(1):97-98
pubmed: 30600619
Acta Psychiatr Scand. 2019 Oct;140(4):293-294
pubmed: 31535365
Eur Neuropsychopharmacol. 2022 Mar;56:4-12
pubmed: 34875491