Experience with an Affective Robot Assistant for Children with Hearing Disabilities.
Deep learning
Emotion recognition
Human-robot interaction
Machine learning
Physiological signals
Social robots
Journal
International journal of social robotics
ISSN: 1875-4791
Titre abrégé: Int J Soc Robot
Pays: Netherlands
ID NLM: 101622429
Informations de publication
Date de publication:
2023
2023
Historique:
accepted:
10
09
2021
medline:
23
11
2021
pubmed:
23
11
2021
entrez:
22
11
2021
Statut:
ppublish
Résumé
This study presents an assistive robotic system enhanced with emotion recognition capabilities for children with hearing disabilities. The system is designed and developed for the audiometry tests and rehabilitation of children in a clinical setting and includes a social humanoid robot (Pepper), an interactive interface, gamified audiometry tests, sensory setup and a machine/deep learning based emotion recognition module. Three scenarios involving conventional setup, tablet setup and setup with the robot+tablet are evaluated with 16 children having cochlear implant or hearing aid. Several machine learning techniques and deep learning models are used for the classification of the three test setups and for the classification of the emotions (pleasant, neutral, unpleasant) of children using the recorded physiological signals by E4 wristband. The results show that the collected signals during the tests can be separated successfully and the positive and negative emotions of children can be better distinguished when they interact with the robot than in the other two setups. In addition, the children's objective and subjective evaluations as well as their impressions about the robot and its emotional behaviors are analyzed and discussed extensively.
Identifiants
pubmed: 34804256
doi: 10.1007/s12369-021-00830-5
pii: 830
pmc: PMC8594648
doi:
Types de publication
Journal Article
Langues
eng
Pagination
643-660Informations de copyright
© The Author(s), under exclusive licence to Springer Nature B.V. 2021.
Références
Autism Res. 2016 Feb;9(2):165-83
pubmed: 26483270
Front Robot AI. 2020 Dec 21;7:532279
pubmed: 33501307
Physiol Behav. 2012 May 15;106(2):298-304
pubmed: 22330325
IEEE Trans Inf Technol Biomed. 2010 Mar;14(2):215-23
pubmed: 20064760
Am Psychol. 1995 May;50(5):372-85
pubmed: 7762889
Int Conf Affect Comput Intell Interact Workshops. 2017 Oct;2017:216-221
pubmed: 29862131
Sensors (Basel). 2018 Jun 11;18(6):
pubmed: 29891829
Pediatrics. 2019 Jul;144(1):
pubmed: 31243158
J Child Health Care. 2021 Sep;25(3):412-426
pubmed: 32840383
Sensors (Basel). 2019 Oct 16;19(20):
pubmed: 31623279
PLoS One. 2019 Mar 20;14(3):e0212928
pubmed: 30893343
Autism Res. 2017 Jul;10(7):1306-1323
pubmed: 28464438
J Med Internet Res. 2019 May 10;21(5):e13203
pubmed: 31094357
Comput Methods Programs Biomed. 2017 Mar;140:93-110
pubmed: 28254094
Psychophysiology. 2019 Nov;56(11):e13441
pubmed: 31332802
Sensors (Basel). 2020 Jan 21;20(3):
pubmed: 31973140
Curr Robot Rep. 2021;2(1):9-19
pubmed: 34977592
Psychiatry Clin Neurosci. 2019 Feb;73(2):50-62
pubmed: 30565801
Sensors (Basel). 2019 Apr 18;19(8):
pubmed: 31003456
J Autism Dev Disord. 2017 Oct;47(10):3079-3096
pubmed: 28685411
IEEE Trans Neural Netw Learn Syst. 2014 Mar;25(3):609-20
pubmed: 24807454
Sci Rep. 2018 Sep 12;8(1):13657
pubmed: 30209261
Sensors (Basel). 2016 Jan 18;16(1):
pubmed: 26797612
Paediatr Respir Rev. 2021 Dec;40:46-51
pubmed: 33386280
Annu Int Conf IEEE Eng Med Biol Soc. 2015 Aug;2015:2896-9
pubmed: 26736897
Sensors (Basel). 2020 Feb 11;20(4):
pubmed: 32054042
ScientificWorldJournal. 2013 Aug 18;2013:618649
pubmed: 24023532
Sensors (Basel). 2017 Aug 23;17(9):
pubmed: 28832507
Front Comput Neurosci. 2016 Aug 19;10:85
pubmed: 27594831
J Physiol Anthropol. 2015 Jun 18;34:25
pubmed: 26084816
Sensors (Basel). 2016 Nov 24;16(12):
pubmed: 27886155
Sensors (Basel). 2015 Jul 20;15(7):17507-33
pubmed: 26205268
Yearb Med Inform. 2018 Aug;27(1):98-109
pubmed: 30157512
Annu Rev Psychol. 2009;60:1-25
pubmed: 18729725