Conversational ontology operator: patient-centric vaccine dialogue management engine for spoken conversational agents.
Dialogue management
Human computer interaction
Natural language processing
Ontology
Patient provider communication
Question-answering
Semantic web
Software agents
Vaccines
Journal
BMC medical informatics and decision making
ISSN: 1472-6947
Titre abrégé: BMC Med Inform Decis Mak
Pays: England
ID NLM: 101088682
Informations de publication
Date de publication:
14 12 2020
14 12 2020
Historique:
entrez:
15
12
2020
pubmed:
16
12
2020
medline:
16
2
2021
Statut:
epublish
Résumé
Previously, we introduced our Patient Health Information Dialogue Ontology (PHIDO) that manages the dialogue and contextual information of the session between an agent and a health consumer. In this study, we take the next step and introduce the Conversational Ontology Operator (COO), the software engine harnessing PHIDO. We also developed a question-answering subsystem called Frankenstein Ontology Question-Answering for User-centric Systems (FOQUS) to support the dialogue interaction. We tested both the dialogue engine and the question-answering system using application-based competency questions and questions furnished from our previous Wizard of OZ simulation trials. Our results revealed that the dialogue engine is able to perform the core tasks of communicating health information and conversational flow. Inter-rater agreement and accuracy scores among four reviewers indicated perceived, acceptable responses to the questions asked by participants from the simulation studies, yet the composition of the responses was deemed mediocre by our evaluators. Overall, we present some preliminary evidence of a functioning ontology-based system to manage dialogue and consumer questions. Future plans for this work will involve deploying this system in a speech-enabled agent to assess its usage with potential health consumer users.
Sections du résumé
BACKGROUND
Previously, we introduced our Patient Health Information Dialogue Ontology (PHIDO) that manages the dialogue and contextual information of the session between an agent and a health consumer. In this study, we take the next step and introduce the Conversational Ontology Operator (COO), the software engine harnessing PHIDO. We also developed a question-answering subsystem called Frankenstein Ontology Question-Answering for User-centric Systems (FOQUS) to support the dialogue interaction.
METHODS
We tested both the dialogue engine and the question-answering system using application-based competency questions and questions furnished from our previous Wizard of OZ simulation trials.
RESULTS
Our results revealed that the dialogue engine is able to perform the core tasks of communicating health information and conversational flow. Inter-rater agreement and accuracy scores among four reviewers indicated perceived, acceptable responses to the questions asked by participants from the simulation studies, yet the composition of the responses was deemed mediocre by our evaluators.
CONCLUSIONS
Overall, we present some preliminary evidence of a functioning ontology-based system to manage dialogue and consumer questions. Future plans for this work will involve deploying this system in a speech-enabled agent to assess its usage with potential health consumer users.
Identifiants
pubmed: 33317519
doi: 10.1186/s12911-020-01267-y
pii: 10.1186/s12911-020-01267-y
pmc: PMC7734717
doi:
Substances chimiques
Vaccines
0
Types de publication
Journal Article
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
259Subventions
Organisme : NLM NIH HHS
ID : R01 LM011829
Pays : United States
Organisme : NLM NIH HHS
ID : R00 LM012104
Pays : United States
Organisme : NIAID NIH HHS
ID : R01 AI130460
Pays : United States
Références
J Med Internet Res. 2010 Feb 17;12(1):e4
pubmed: 20164043
J Biomed Inform. 2006 Oct;39(5):556-71
pubmed: 16464643
J Biomed Semantics. 2015 May 01;6:23
pubmed: 25973167
BMC Bioinformatics. 2019 Dec 23;20(Suppl 21):706
pubmed: 31865902
Behav Res Methods Instrum Comput. 2002 Aug;34(3):342-53
pubmed: 12395550
Stud Health Technol Inform. 2019;257:17-23
pubmed: 30741166
Vaccine. 2016 Feb 24;34(9):1187-92
pubmed: 26812078
AMIA Jt Summits Transl Sci Proc. 2020 May 30;2020:43-52
pubmed: 32477622
J Med Internet Res. 2009 May 14;11(2):e16
pubmed: 19632970
J Med Internet Res. 2012 Jun 14;14(3):e80
pubmed: 22698679
Stud Health Technol Inform. 2016;225:432-6
pubmed: 27332237