Validity and reliability of self-reported and neural measures of listening effort.
EEG
frontal midline theta power
hearing impairment
repeatability
speech-in-noise perception
Journal
The European journal of neuroscience
ISSN: 1460-9568
Titre abrégé: Eur J Neurosci
Pays: France
ID NLM: 8918110
Informations de publication
Date de publication:
Dec 2023
Dec 2023
Historique:
revised:
17
10
2023
received:
10
03
2023
accepted:
23
10
2023
medline:
5
12
2023
pubmed:
21
11
2023
entrez:
20
11
2023
Statut:
ppublish
Résumé
Listening effort can be defined as a measure of cognitive resources used by listeners to perform a listening task. Various methods have been proposed to measure this effort, yet their reliability remains unestablished, a crucial step before their application in research or clinical settings. This study encompassed 32 participants undertaking speech-in-noise tasks across two sessions, approximately a week apart. They listened to sentences and word lists at varying signal-to-noise ratios (SNRs) (-9, -6, -3 and 0 dB), then retaining them for roughly 3 s. We evaluated the test-retest reliability of self-reported effort ratings, theta (4-7 Hz) and alpha (8-13 Hz) oscillatory power, suggested previously as neural markers of listening effort. Additionally, we examined the reliability of correct word percentages. Both relative and absolute reliability were assessed using intraclass correlation coefficients (ICC) and Bland-Altman analysis. We also computed the standard error of measurement (SEM) and smallest detectable change (SDC). Our findings indicated heightened frontal midline theta power for word lists compared to sentences during the retention phase under high SNRs (0 dB, -3 dB), likely indicating a greater memory load for word lists. We observed SNR's impact on alpha power in the right central region during the listening phase and frontal theta power during the retention phase in sentences. Overall, the reliability analysis demonstrated satisfactory between-session variability for correct words and effort ratings. However, neural measures (frontal midline theta power and right central alpha power) displayed substantial variability, even though group-level outcomes appeared consistent across sessions.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
4357-4370Subventions
Organisme : Danmarks Frie Forskningsfond
Organisme : Independent Research Fund Denmark, Technology and Production Sciences (FTP)
ID : DNRF121
Informations de copyright
© 2023 The Authors. European Journal of Neuroscience published by Federation of European Neuroscience Societies and John Wiley & Sons Ltd.
Références
Ala, T. S., Graversen, C., Wendt, D., Alickovic, E., Whitme, W. M., & Lunner, T. (2020). An exploratory study of EEG alpha oscillation and pupil dilation in hearing-aid users during effortful listening to continuous speech. PLoS ONE, 15(7), e0235782. https://doi.org/10.1371/journal.pone.0235782
Alhanbali, S., Dawes, P., Lloyd, S., & Munro, K. J. (2017). Self-reported listening-related effort and fatigue in hearing-impaired adults. Ear and Hearing, 38(1), e39-e48. https://doi.org/10.1097/AUD.0000000000000361
Alhanbali, S., Dawes, P., Millman, R. E., & Munro, K. J. (2019). Measures of listening effort are multidimensional. Ear and Hearing, 40(5), 1084-1097. https://doi.org/10.1097/AUD.0000000000000697
Atkinson, G., & Nevill, A. (2000). Typical error versus limits of agreement. Sports Medicine (Auckland, N.Z.), 30(5), 375-381. https://doi.org/10.2165/00007256-200030050-00005
Atkinson, G., & Nevill, A. M. (1998). Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Medicine (Auckland, N.Z.), 26(4), 217-238. https://doi.org/10.2165/00007256-199826040-00002
Biurrun Manresa, J. A., Fritsche, R., Vuilleumier, P. H., Oehler, C., Mørch, C. D., Arendt-Nielsen, L., Andersen, O. K., & Curatolo, M. (2014). Is the conditioned pain modulation paradigm reliable? A test-retest assessment using the nociceptive withdrawal reflex. PLoS ONE, 9(6), e100241. https://doi.org/10.1371/journal.pone.0100241
Bland, J. M., & Altman, D. G. (1996). Statistics notes: Measurement error. BMJ, 312(7047), 1654. https://doi.org/10.1136/bmj.312.7047.1654
Bland, J. M., & Altman, D. G. (1999). Measuring agreement in method comparison studies. Statistical Methods in Medical Research, 8(2), 135-160. https://doi.org/10.1177/096228029900800204
Bruton, A., Conway, J. H., & Holgate, S. T. (2000). Reliability: What is it, and how is it measured? Physiotherapy, 86(2), 94-99. https://doi.org/10.1016/S0031-9406(05)61211-4
Cañete, O. M., Nielsen, S. G., & Fuentes-López, E. (2023). Self-reported listening effort in adults with and without hearing loss: The Danish version of the effort assessment scale (D-EAS). Disability and Rehabilitation, 45(1), 98-105. https://doi-org.zorac.aub.aau.dk/10.1080/09638288.2021.2022781
Cavanagh, J. F., & Frank, M. J. (2014). Frontal theta as a mechanism for cognitive control. Trends in Cognitive Sciences, 18(8), 414-421. https://doi.org/10.1016/j.tics.2014.04.012
Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9-21. https://doi.org/10.1016/j.jneumeth.2003.10.009
Dimitrijevic, A., Smith, M. L., Kadis, D. S., & Moore, D. R. (2019). Neural indices of listening effort in noisy environments. Scientific Reports, 9(1), 1-10. https://doi.org/10.1038/s41598-019-47643-1
Downing, S. M. (2004). Reliability: On the reproducibility of assessment data. Medical Education, 38(9), 1006-1012. https://doi.org/10.1111/j.1365-2929.2004.01932.x
Edwards, B. (2016). A model of auditory-cognitive processing and relevance to clinical applicability. Ear and Hearing, 37(Suppl 1), 85S-91S. https://doi.org/10.1097/AUD.0000000000000308
Geerinck, A., Alekna, V., Beaudart, C., Bautmans, I., Cooper, C., de Souza Orlandi, F., Konstantynowicz, J., Montero-Errasquín, B., Topinková, E., Tsekoura, M., Reginster, J. Y., & Bruyère, O. (2019). Standard error of measurement and smallest detectable change of the sarcopenia quality of life (SarQoL) questionnaire: An analysis of subjects from 9 validation studies. PLoS ONE, 14(4), e0216065. https://doi.org/10.1371/journal.pone.0216065
Giuliani, N. P., Brown, C. J., & Wu, Y. H. (2021). Comparisons of the sensitivity and reliability of multiple measures of listening effort. Ear and Hearing, 42(2), 465-474. https://doi.org/10.1097/AUD.0000000000000950
Goldstone, R. L. (1998). Perceptual learning. Annual Review of Psychology, 49, 585-612. https://doi.org/10.1146/annurev.psych.49.1.585
Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (task load index): Results of empirical and theoretical research. Advances in Psychology, 52(C), 139-183. https://doi.org/10.1016/S0166-4115(08)62386-9
Hoechstetter, K., Bornfleth, H., Weckesser, D., Ille, N., Berg, P., & Scherg, M. (2004). BESA source coherence: A new method to study cortical oscillatory coupling. Brain Topography, 16(4), 233-238. https://doi.org/10.1023/B:BRAT.0000032857.55223.5d
Hsieh, L. T., & Ranganath, C. (2014). Frontal midline theta oscillations during working memory maintenance and episodic encoding and retrieval. NeuroImage, 85 Pt 2(02), 721-729. https://doi.org/10.1016/j.neuroimage.2013.08.003
Jensen, O., & Tesche, C. D. (2002). Frontal theta activity in humans increases with memory load in a working memory task. The European Journal of Neuroscience, 15(8), 1395-1399. https://doi.org/10.1046/j.1460-9568.2002.01975.x
Johnson, J., Xu, J., Cox, R., & Pendergraf, P. (2015). A comparison of two methods for measuring listening effort as part of an Audiologic test battery. American Journal of Audiology, 24(3), 419-431. https://doi.org/10.1044/2015_AJA-14-0058
Lamb, K. (2016). Test-retest reliability in quantitative physical education research: A commentary. European Physical Education Review, 4(2), 145-152. https://doi.org/10.1177/1356336X9800400205
Mackersie, C. L., Macphee, I. X., & Heldt, E. W. (2015). Effects of hearing loss on heart rate variability and skin conductance measured during sentence recognition in noise. Ear and Hearing, 36(1), 145-154. https://doi.org/10.1097/AUD.0000000000000091
Martin Bland, J., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet, 327(8476), 307-310. https://doi.org/10.1016/S0140-6736(86)90837-8
McGarrigle, R., Munro, K. J., Dawes, P., Stewart, A. J., Moore, D. R., Barry, J. G., & Amitay, S. (2014). Listening effort and fatigue: What exactly are we measuring? A British Society of Audiology Cognition in Hearing Special Interest Group ‘white paper’.
Mokkink, L. B., de Vet, H., Diemeer, S., & Eekhout, I. (2023). Sample size recommendations for studies on reliability and measurement error: An online application based on simulation studies. Health Services & Outcomes Research Methodology, 23, 241-265.
Mullen, T., Kothe, C., Chi, Y. M., Ojeda, A., Kerth, T., Makeig, S., Cauwenberghs, G., & Jung, T. P. (2013). Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG. Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference, 2013, 2184-2187.
Ohlenforst, B., Wendt, D., Kramer, S. E., Naylor, G., Zekveld, A. A., & Lunner, T. (2018). Impact of SNR, masker type and noise reduction processing on sentence recognition performance and listening effort as indicated by the pupil dilation response. Hearing Research, 365, 90-99. https://doi.org/10.1016/j.heares.2018.05.003
Overend, T., Anderson, C., Sawant, A., Perryman, B., & Locking-Cusolito, H. (2010). Relative and absolute reliability of physical function measures in people with end-stage renal disease. Physiotherapy Canada. Physiotherapie Canada, 62(2), 122-128. https://doi.org/10.3138/physio.62.2.122
Paul, B. T., Chen, J., Le, T., Lin, V., & Dimitrijevic, A. (2021). Cortical alpha oscillations in cochlear implant users reflect subjective listening effort during speech-in-noise perception. PLoS ONE, 16(7), e0254162. https://doi.org/10.1371/journal.pone.0254162
Peelle, J. E. (2018). Listening effort: How the cognitive consequences of acoustic challenge are reflected in brain and behavior. Ear and Hearing, 39(2), 204-214. https://doi.org/10.1097/AUD.0000000000000494
Pichora-Fuller, M. K., Kramer, S. E., Eckert, M. A., Edwards, B., Hornsby, B. W. Y., Humes, L. E., Lemke, U., Lunner, T., Matthen, M., Mackersie, C. L., Naylor, G., Phillips, N. A., Richter, M., Rudner, M., Sommers, M. S., Tremblay, K. L., & Wingfield, A. (2016). Hearing impairment and cognitive energy: The framework for understanding effortful listening (FUEL). Ear and Hearing, 37(Suppl 1), 5S-27S. https://doi.org/10.1097/AUD.0000000000000312
Pion-Tonachini, L., Kreutz-Delgado, K., & Makeig, S. (2019). ICLabel: An automated electroencephalographic independent component classifier, dataset, and website. NeuroImage, 198, 181-197. https://doi.org/10.1016/j.neuroimage.2019.05.026
Ries, J. D., Echternach, J. L., Nof, L., & Blodgett, M. G. (2009). Test-retest reliability and minimal detectable change scores for the timed “up & go” test, the six-minute walk test, and gait speed in people with Alzheimer disease. Physical Therapy, 89(6), 569-579. https://doi.org/10.2522/ptj.20080258
Rönnberg, J., Lunner, T., Zekveld, A., Sörqvist, P., Danielsson, H., Lyxell, B., Dahlström, Ö., Signoret, C., Stenfelt, S., Pichora-Fuller, M. K., & Rudner, M. (2013). The ease of language understanding (ELU) model: Theoretical, empirical, and clinical advances. Frontiers in Systems Neuroscience, 7(JUNE), 31. https://doi.org/10.3389/fnsys.2013.00031
Völker, J. M., Arguissain, F. G., Andersen, O. K., & Biurrun Manresa, J. (2021). Variability and effect sizes of intracranial current source density estimations during pain: Systematic review, experimental findings, and future perspectives. Human Brain Mapping, 42(8), 2461-2476. https://doi.org/10.1002/hbm.25380
Wagener, K., Josvassen, J. L., & Ardenkjaer, R. (2009). Design, optimization and evaluation of a Danish sentence test in noise: Diseño, optimización y evaluación de la prueba Danesa de frases en ruido. International Journal of Audiology, 42(1), 10-17. https://doi.org/10.3109/14992020309056080
White, B. E., & Langdon, C. (2021). The cortical organization of listening effort: New insight from functional near-infrared spectroscopy. NeuroImage, 240, 118324. https://doi.org/10.1016/j.neuroimage.2021.118324
Wisniewski, M. G. (2017). Indices of effortful listening can be mined from existing electroencephalographic data. Ear and Hearing, 38(1), e69-e73. https://doi.org/10.1097/AUD.0000000000000354
Wisniewski, M. G., Iyer, N., Thompson, E. R., & Simpson, B. D. (2018). Sustained frontal midline theta enhancements during effortful listening track working memory demands. Hearing Research, 358, 37-41. https://doi.org/10.1016/j.heares.2017.11.009
Wisniewski, M. G., Thompson, E. R., Iyer, N., Estepp, J. R., Goder-Reiser, M. N., & Sullivan, S. C. (2015). Frontal midline θ power as an index of listening effort. Neuroreport, 26(2), 94-99. https://doi.org/10.1097/WNR.0000000000000306
Wisniewski, M. G., Zakrzewski, A. C., Bell, D. R., & Wheeler, M. (2021). EEG power spectral dynamics associated with listening in adverse conditions. Psychophysiology, 58(9), e13877. https://doi.org/10.1111/psyp.13877
Zhang, L., Schlaghecken, F., Harte, J., & Roberts, K. L. (2021). The influence of the type of background noise on perceptual learning of speech in noise. Frontiers in Neuroscience, 15, 484. https://doi.org/10.3389/fnins.2021.646137