Speakers exhibit a multimodal Lombard effect in noise.
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
18 08 2021
18 08 2021
Historique:
received:
12
03
2021
accepted:
29
07
2021
entrez:
19
8
2021
pubmed:
20
8
2021
medline:
20
8
2021
Statut:
epublish
Résumé
In everyday conversation, we are often challenged with communicating in non-ideal settings, such as in noise. Increased speech intensity and larger mouth movements are used to overcome noise in constrained settings (the Lombard effect). How we adapt to noise in face-to-face interaction, the natural environment of human language use, where manual gestures are ubiquitous, is currently unknown. We asked Dutch adults to wear headphones with varying levels of multi-talker babble while attempting to communicate action verbs to one another. Using quantitative motion capture and acoustic analyses, we found that (1) noise is associated with increased speech intensity and enhanced gesture kinematics and mouth movements, and (2) acoustic modulation only occurs when gestures are not present, while kinematic modulation occurs regardless of co-occurring speech. Thus, in face-to-face encounters the Lombard effect is not constrained to speech but is a multimodal phenomenon where the visual channel carries most of the communicative burden.
Identifiants
pubmed: 34408178
doi: 10.1038/s41598-021-95791-0
pii: 10.1038/s41598-021-95791-0
pmc: PMC8373897
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
16721Informations de copyright
© 2021. The Author(s).
Références
Cognition. 2018 Nov;180:38-51
pubmed: 29981967
Top Cogn Sci. 2012 Apr;4(2):232-48
pubmed: 22389109
J Acoust Soc Am. 1989 Feb;85(2):894-900
pubmed: 2926004
J Mem Lang. 2013 Apr;68(3):
pubmed: 24403724
J Speech Lang Hear Res. 2010 Jun;53(3):588-608
pubmed: 20008681
Curr Biol. 2011 Aug 23;21(16):R614-5
pubmed: 21854996
Philos Trans R Soc Lond B Biol Sci. 2014 Sep 19;369(1651):20130302
pubmed: 25092670
Philos Trans R Soc Lond B Biol Sci. 2014 Sep 19;369(1651):20130292
pubmed: 25092660
Cogn Sci. 2009;33(1):115
pubmed: 20126430
J Speech Lang Hear Res. 2017 Jan 1;60(1):212-222
pubmed: 27960196
Philos Trans R Soc Lond B Biol Sci. 2014 Sep 19;369(1651):20130296
pubmed: 25092664
Proc Biol Sci. 2021 Jul 28;288(1955):20210500
pubmed: 34284631
J Speech Lang Hear Res. 2019 Sep 20;62(9):3204-3219
pubmed: 31479385
J Exp Psychol Gen. 2020 Feb;149(2):391-404
pubmed: 31368760
Neuroimage. 2010 Jan 1;49(1):875-84
pubmed: 19733670
J Acoust Soc Am. 2018 Aug;144(2):1059
pubmed: 30180713
Front Psychol. 2018 Jun 28;9:1109
pubmed: 30002643
Cognition. 1986 Feb;22(1):1-39
pubmed: 3709088
J Acoust Soc Am. 1992 May;91(5):2936-46
pubmed: 1629486
Psychol Res. 2020 Oct;84(7):1897-1911
pubmed: 31079227