A Chatbot Versus Physicians to Provide Information for Patients With Breast Cancer: Blind, Randomized Controlled Noninferiority Trial.
cancer
chatbot
clinical trial
Journal
Journal of medical Internet research
ISSN: 1438-8871
Titre abrégé: J Med Internet Res
Pays: Canada
ID NLM: 100959882
Informations de publication
Date de publication:
27 11 2019
27 11 2019
Historique:
received:
07
08
2019
accepted:
23
10
2019
revised:
14
10
2019
entrez:
28
11
2019
pubmed:
28
11
2019
medline:
8
7
2020
Statut:
epublish
Résumé
The data regarding the use of conversational agents in oncology are scarce. The aim of this study was to verify whether an artificial conversational agent was able to provide answers to patients with breast cancer with a level of satisfaction similar to the answers given by a group of physicians. This study is a blind, noninferiority randomized controlled trial that compared the information given by the chatbot, Vik, with that given by a multidisciplinary group of physicians to patients with breast cancer. Patients were women with breast cancer in treatment or in remission. The European Organisation for Research and Treatment of Cancer Quality of Life Group information questionnaire (EORTC QLQ-INFO25) was adapted and used to compare the quality of the information provided to patients by the physician or the chatbot. The primary outcome was to show that the answers given by the Vik chatbot to common questions asked by patients with breast cancer about their therapy management are at least as satisfying as answers given by a multidisciplinary medical committee by comparing the success rate in each group (defined by a score above 3). The secondary objective was to compare the average scores obtained by the chatbot and physicians for each INFO25 item. A total of 142 patients were included and randomized into two groups of 71. They were all female with a mean age of 42 years (SD 19). The success rates (as defined by a score >3) was 69% (49/71) in the chatbot group versus 64% (46/71) in the physicians group. The binomial test showed the noninferiority (P<.001) of the chatbot's answers. This is the first study that assessed an artificial conversational agent used to inform patients with cancer. The EORTC INFO25 scores from the chatbot were found to be noninferior to the scores of the physicians. Artificial conversational agents may save patients with minor health concerns from a visit to the doctor. This could allow clinicians to spend more time to treat patients who need a consultation the most. Clinicaltrials.gov NCT03556813, https://tinyurl.com/rgtlehq.
Sections du résumé
BACKGROUND
The data regarding the use of conversational agents in oncology are scarce.
OBJECTIVE
The aim of this study was to verify whether an artificial conversational agent was able to provide answers to patients with breast cancer with a level of satisfaction similar to the answers given by a group of physicians.
METHODS
This study is a blind, noninferiority randomized controlled trial that compared the information given by the chatbot, Vik, with that given by a multidisciplinary group of physicians to patients with breast cancer. Patients were women with breast cancer in treatment or in remission. The European Organisation for Research and Treatment of Cancer Quality of Life Group information questionnaire (EORTC QLQ-INFO25) was adapted and used to compare the quality of the information provided to patients by the physician or the chatbot. The primary outcome was to show that the answers given by the Vik chatbot to common questions asked by patients with breast cancer about their therapy management are at least as satisfying as answers given by a multidisciplinary medical committee by comparing the success rate in each group (defined by a score above 3). The secondary objective was to compare the average scores obtained by the chatbot and physicians for each INFO25 item.
RESULTS
A total of 142 patients were included and randomized into two groups of 71. They were all female with a mean age of 42 years (SD 19). The success rates (as defined by a score >3) was 69% (49/71) in the chatbot group versus 64% (46/71) in the physicians group. The binomial test showed the noninferiority (P<.001) of the chatbot's answers.
CONCLUSIONS
This is the first study that assessed an artificial conversational agent used to inform patients with cancer. The EORTC INFO25 scores from the chatbot were found to be noninferior to the scores of the physicians. Artificial conversational agents may save patients with minor health concerns from a visit to the doctor. This could allow clinicians to spend more time to treat patients who need a consultation the most.
TRIAL REGISTRATION
Clinicaltrials.gov NCT03556813, https://tinyurl.com/rgtlehq.
Identifiants
pubmed: 31774408
pii: v21i11e15787
doi: 10.2196/15787
pmc: PMC6906616
doi:
Banques de données
ClinicalTrials.gov
['NCT03556813']
Types de publication
Journal Article
Randomized Controlled Trial
Langues
eng
Sous-ensembles de citation
IM
Pagination
e15787Informations de copyright
©Jean-Emmanuel Bibault, Benjamin Chaix, Arthur Guillemassé, Sophie Cousin, Alexandre Escande, Morgane Perrin, Arthur Pienkowski, Guillaume Delamon, Pierre Nectoux, Benoît Brouard. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 27.11.2019.
Références
Eur J Cancer. 2010 Oct;46(15):2726-38
pubmed: 20674333
JAMA Intern Med. 2016 May 1;176(5):619-25
pubmed: 26974260
JMIR Cancer. 2019 May 02;5(1):e12856
pubmed: 31045505
Ann Med. 2016 Nov;48(7):509-515
pubmed: 27348761
J Am Med Inform Assoc. 2018 Sep 1;25(9):1248-1258
pubmed: 30010941