Absolute Eye Gaze Estimation With Biosensors in Hearing Aids.
EarEOG
electrooculography
eye gaze estimation
head tracking
hearing aids
hearing-impaired
inertial sensors
Journal
Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481
Informations de publication
Date de publication:
2019
2019
Historique:
received:
03
07
2019
accepted:
15
11
2019
entrez:
11
1
2020
pubmed:
11
1
2020
medline:
11
1
2020
Statut:
epublish
Résumé
People with hearing impairment typically have difficulties following conversations in multi-talker situations. Previous studies have shown that utilizing eye gaze to steer audio through beamformers could be a solution for those situations. Recent studies have shown that in-ear electrodes that capture electrooculography in the ear (EarEOG) can estimate the eye-gaze relative to the head, when the head was fixed. The head movement can be estimated using motion sensors around the ear to create an estimate of the absolute eye-gaze in the room. In this study, an experiment was designed to mimic a multi-talker situation in order to study and model the EarEOG signal when participants attempted to follow a conversation. Eleven hearing impaired participants were presented speech from the DAT speech corpus (Bo Nielsen et al., 2014), with three targets positioned at -30°, 0° and +30° azimuth. The experiment was run in two setups: one where the participants had their head fixed in a chinrest, and the other where they were free to move their head. The participants' task was to focus their visual attention on an LED-indicated target that changed regularly. A model was developed for the relative eye-gaze estimation, taking saccades, fixations, head movement and drift from the electrode-skin half-cell into account. This model explained 90.5% of the variance of the EarEOG when the head was fixed, and 82.6% when the head was free. The absolute eye-gaze was also estimated utilizing that model. When the head was fixed, the estimation of the absolute eye-gaze was reliable. However, due to hardware issues, the estimation of the absolute eye-gaze when the head was free had a variance that was too large to reliably estimate the attended target. Overall, this study demonstrated the potential of estimating absolute eye-gaze using EarEOG and motion sensors around the ear.
Identifiants
pubmed: 31920477
doi: 10.3389/fnins.2019.01294
pmc: PMC6915090
doi:
Types de publication
Journal Article
Langues
eng
Pagination
1294Informations de copyright
Copyright © 2019 Favre-Félix, Graversen, Bhuiyan, Skoglund, Rotger-Griful, Rank, Dau and Lunner.
Références
Cereb Cortex. 2015 Jul;25(7):1697-706
pubmed: 24429136
Conf Proc IEEE Eng Med Biol Soc. 2018 Jul;2018:5470-5474
pubmed: 30441575
PLoS One. 2018 Jan 5;13(1):e0190420
pubmed: 29304120
Neuroimage. 2017 Aug 1;156:435-444
pubmed: 28412441
Med Biol Eng Comput. 2002 May;40(3):332-8
pubmed: 12195981
J Comp Psychol. 2008 Aug;122(3):235-51
pubmed: 18729652
J Acoust Soc Am. 2014 Jan;135(1):407-20
pubmed: 24437781
Conf Proc IEEE Eng Med Biol Soc. 2015;2015:3161-4
pubmed: 26736963
Sci Rep. 2017 Jul 5;7(1):4640
pubmed: 28680049
IEEE Trans Biomed Eng. 2019 Jan;66(1):150-158
pubmed: 29993415
Nature. 2012 May 10;485(7397):233-6
pubmed: 22522927