Decoding the Attended Speaker From EEG Using Adaptive Evaluation Intervals Captures Fluctuations in Attentional Listening.
AAD
EEG
attentional fluctuations
listening effort
online attended speaker decoding
selective auditory attention
speech envelope tracking
Journal
Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481
Informations de publication
Date de publication:
2020
2020
Historique:
received:
06
11
2019
accepted:
15
05
2020
entrez:
3
7
2020
pubmed:
3
7
2020
medline:
3
7
2020
Statut:
epublish
Résumé
Listeners differ in their ability to attend to a speech stream in the presence of a competing sound. Differences in speech intelligibility in noise cannot be fully explained by the hearing ability which suggests the involvement of additional cognitive factors. A better understanding of the temporal fluctuations in the ability to pay selective auditory attention to a desired speech stream may help in explaining these variabilities. In order to better understand the temporal dynamics of selective auditory attention, we developed an online auditory attention decoding (AAD) processing pipeline based on speech envelope tracking in the electroencephalogram (EEG). Participants had to attend to one audiobook story while a second one had to be ignored. Online AAD was applied to track the attention toward the target speech signal. Individual temporal attention profiles were computed by combining an established AAD method with an adaptive staircase procedure. The individual decoding performance over time was analyzed and linked to behavioral performance as well as subjective ratings of listening effort, motivation, and fatigue. The grand average attended speaker decoding profile derived in the online experiment indicated performance above chance level. Parameters describing the individual AAD performance in each testing block indicated significant differences in decoding performance over time to be closely related to the behavioral performance in the selective listening task. Further, an exploratory analysis indicated that subjects with poor decoding performance reported higher listening effort and fatigue compared to good performers. Taken together our results show that online EEG based AAD in a complex listening situation is feasible. Adaptive attended speaker decoding profiles over time could be used as an objective measure of behavioral performance and listening effort. The developed online processing pipeline could also serve as a basis for future EEG based near real-time auditory neurofeedback systems.
Identifiants
pubmed: 32612507
doi: 10.3389/fnins.2020.00603
pmc: PMC7308709
doi:
Types de publication
Journal Article
Langues
eng
Pagination
603Informations de copyright
Copyright © 2020 Jaeger, Mirkovic, Bleichner and Debener.
Références
Exp Aging Res. 2016;42(1):50-66
pubmed: 26683041
J Acoust Soc Am. 2007 Jul;122(1):418-35
pubmed: 17614500
J Neural Eng. 2017 Jun;14(3):036020
pubmed: 28384124
Spat Vis. 1997;10(4):433-6
pubmed: 9176952
Neuroimage. 2019 Aug 1;196:261-268
pubmed: 30978494
Ear Hear. 2013 Jul-Aug;34(4):385-401
pubmed: 24005840
Front Neurosci. 2018 May 01;12:262
pubmed: 29765298
Neuron. 2013 Mar 6;77(5):980-91
pubmed: 23473326
Front Psychol. 2012 Jul 16;3:238
pubmed: 22811672
Front Neurosci. 2016 Jul 27;10:349
pubmed: 27512364
Int J Audiol. 2006 Sep;45(9):503-12
pubmed: 17005493
Cereb Cortex. 2015 Jul;25(7):1697-706
pubmed: 24429136
J Neural Eng. 2015 Aug;12(4):046007
pubmed: 26035345
Eur J Neurosci. 2020 Mar;51(5):1234-1241
pubmed: 29205588
Front Syst Neurosci. 2014 Feb 21;8:26
pubmed: 24600357
J Exp Psychol. 1952 Jul;44(1):51-5
pubmed: 14955590
Ear Hear. 2013 Jan-Feb;34(1):15-28
pubmed: 22941406
Brain Topogr. 2018 Sep;31(5):811-826
pubmed: 29488040
Nature. 2012 May 10;485(7397):233-6
pubmed: 22522927
Sci Rep. 2015 Nov 17;5:16743
pubmed: 26572314
J Acoust Soc Am. 1967 Sep;42(3):609-12
pubmed: 6073974
J Neural Eng. 2018 Dec;15(6):066017
pubmed: 30207293
J Neurophysiol. 2013 Jun;109(12):3082-93
pubmed: 23515789
Hear Res. 2014 Oct;316:73-81
pubmed: 25124153
Front Neurosci. 2013 Dec 23;7:252
pubmed: 24391535
Nat Neurosci. 2006 Jul;9(7):971-8
pubmed: 16767087
Front Hum Neurosci. 2016 Nov 30;10:604
pubmed: 27965557
J Neurosci. 2009 Dec 9;29(49):15564-74
pubmed: 20007480
Front Hum Neurosci. 2013 Apr 04;7:115
pubmed: 23576968
J Acoust Soc Am. 1994 Feb;95(2):1053-64
pubmed: 8132899
Neuroimage. 2019 Feb 1;186:33-42
pubmed: 30367953
J Neural Eng. 2014 Aug;11(4):046015
pubmed: 24963838
Proc Natl Acad Sci U S A. 2001 Nov 6;98(23):13367-72
pubmed: 11698688
Neuroimage. 2017 Aug 1;156:435-444
pubmed: 28412441
Neuroimage. 2014 Jan 15;85 Pt 2:761-8
pubmed: 23791839
J Neurosci Methods. 2015 Jul 30;250:126-36
pubmed: 25596422
J Neurophysiol. 2017 Jan 1;117(1):18-27
pubmed: 27707813
J Neural Eng. 2016 Oct;13(5):056014
pubmed: 27618842
Hear Res. 2014 Aug;314:10-9
pubmed: 24821552
J Neurosci. 2010 Jan 13;30(2):620-8
pubmed: 20071526
Proc Natl Acad Sci U S A. 2008 Apr 22;105(16):6173-8
pubmed: 18427123
J Neurosci. 2013 Mar 27;33(13):5728-35
pubmed: 23536086
Nat Rev Neurosci. 2013 Oct;14(10):693-707
pubmed: 24052177
J Neurosci. 2015 Feb 4;35(5):2161-72
pubmed: 25653371
J Acoust Soc Am. 1997 Mar;101(3):1660-70
pubmed: 9069633
Exp Aging Res. 2016;42(1):67-82
pubmed: 26683042
Ear Hear. 2008 Apr;29(2):139-57
pubmed: 18595182
J Acoust Soc Am. 2017 Jun;141(6):4680
pubmed: 28679238
Sci Rep. 2019 Aug 8;9(1):11538
pubmed: 31395905
Front Neurosci. 2019 Mar 19;13:153
pubmed: 30941002
Hear Res. 2019 Jun;377:260-270
pubmed: 31003037
Neuron. 2007 Jun 21;54(6):1001-10
pubmed: 17582338
Conf Proc IEEE Eng Med Biol Soc. 2013;2013:2184-7
pubmed: 24110155
J Acoust Soc Am. 1994 May;95(5 Pt 1):2670-80
pubmed: 8207140
Int J Audiol. 2014 Jul;53(7):433-40
pubmed: 24673660
IEEE Trans Neural Syst Rehabil Eng. 2017 Nov;25(11):1970-1977
pubmed: 28600256
Ear Hear. 2018 Mar/Apr;39(2):204-214
pubmed: 28938250
Trends Amplif. 2008 Dec;12(4):283-99
pubmed: 18974202
PLoS One. 2013;8(1):e53398
pubmed: 23408924
Science. 1973 Oct 12;182(4108):177-80
pubmed: 4730062
Proc Natl Acad Sci U S A. 2012 Jul 17;109(29):11854-9
pubmed: 22753470
J Assoc Res Otolaryngol. 2011 Jun;12(3):395-405
pubmed: 21128091
J Neurosci. 2020 Mar 18;40(12):2562-2572
pubmed: 32094201
Proc Natl Acad Sci U S A. 1993 Sep 15;90(18):8722-6
pubmed: 8378354
Front Hum Neurosci. 2019 Apr 26;13:141
pubmed: 31105543
Proc Natl Acad Sci U S A. 2011 Sep 13;108(37):15516-21
pubmed: 21844339
Int J Audiol. 2019 Jul;58(7):408-416
pubmed: 31032678
J Neurosci Methods. 2004 Mar 15;134(1):9-21
pubmed: 15102499
IEEE Trans Neural Syst Rehabil Eng. 2017 May;25(5):402-412
pubmed: 27244743