Prosodic discrimination skills mediate the association between musical aptitude and vocal emotion recognition ability.
Musical aptitude
Musical expertise
Prosodic discrimination skills
Vocal emotion recognition
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
16 Jul 2024
16 Jul 2024
Historique:
received:
22
10
2023
accepted:
04
07
2024
medline:
17
7
2024
pubmed:
17
7
2024
entrez:
16
7
2024
Statut:
epublish
Résumé
The current study tested the hypothesis that the association between musical ability and vocal emotion recognition skills is mediated by accuracy in prosody perception. Furthermore, it was investigated whether this association is primarily related to musical expertise, operationalized by long-term engagement in musical activities, or musical aptitude, operationalized by a test of musical perceptual ability. To this end, we conducted three studies: In Study 1 (N = 85) and Study 2 (N = 93), we developed and validated a new instrument for the assessment of prosodic discrimination ability. In Study 3 (N = 136), we examined whether the association between musical ability and vocal emotion recognition was mediated by prosodic discrimination ability. We found evidence for a full mediation, though only in relation to musical aptitude and not in relation to musical expertise. Taken together, these findings suggest that individuals with high musical aptitude have superior prosody perception skills, which in turn contribute to their vocal emotion recognition skills. Importantly, our results suggest that these benefits are not unique to musicians, but extend to non-musicians with high musical aptitude.
Identifiants
pubmed: 39014043
doi: 10.1038/s41598-024-66889-y
pii: 10.1038/s41598-024-66889-y
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
16462Informations de copyright
© 2024. The Author(s).
Références
Martins, M., Pinheiro, A. P. & Lima, C. F. Does music training improve emotion recognition abilities? A critical review. Emot. Rev. 13, 199–210. https://doi.org/10.1177/17540739211022035 (2021).
doi: 10.1177/17540739211022035
Nussbaum, C. & Schweinberger, S. R. Links between musicality and vocal emotion perception. Emot. Rev. 13, 211–224. https://doi.org/10.1177/17540739211022803 (2021).
doi: 10.1177/17540739211022803
Lima, C. F. & Castro, S. L. Speaking to the trained ear: Musical expertise enhances the recognition of emotions in speech prosody. Emotion 11, 1021–1031. https://doi.org/10.1037/a0024521 (2011).
doi: 10.1037/a0024521
pubmed: 21942696
Thompson, W. F., Schellenberg, E. G. & Husain, G. Decoding speech prosody: Do music lessons help?. Emotion 4, 46–64. https://doi.org/10.1037/1528-3542.4.1.46 (2004).
doi: 10.1037/1528-3542.4.1.46
pubmed: 15053726
Parsons, C. E. et al. Music training and empathy positively impact adults’ sensitivity to infant distress. Front. Psychol. 5, 1440. https://doi.org/10.3389/fpsyg.2014.01440 (2014).
doi: 10.3389/fpsyg.2014.01440
pubmed: 25566122
pmcid: 4271597
Pralus, A. et al. Emotional prosody in congenital amusia: Impaired and spared processes. Neuropsychologia 134, 107234. https://doi.org/10.1016/j.neuropsychologia.2019.107234 (2019).
doi: 10.1016/j.neuropsychologia.2019.107234
pubmed: 31647961
Lima, C. F. et al. Impaired socio-emotional processing in a developmental music disorder. Sci. Rep. 6, 34911. https://doi.org/10.1038/srep34911 (2016).
doi: 10.1038/srep34911
pubmed: 27725686
pmcid: 5057155
Schirmer, A. & Kotz, S. A. Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends Cogn. Sci. 10, 24–30. https://doi.org/10.1016/j.tics.2005.11.009 (2006).
doi: 10.1016/j.tics.2005.11.009
pubmed: 16321562
Jansen, N., Harding, E. E., Loerts, H., Başkent, D. & Lowie, W. The relation between musical abilities and speech prosody perception: A meta-analysis. J. Phonet. 101, 101278. https://doi.org/10.1016/j.wocn.2023.101278 (2023).
doi: 10.1016/j.wocn.2023.101278
Juslin, P. N. & Laukka, P. Communication of emotions in vocal expression and music performance: Different channels, same code?. Psychol. Bull. 129, 770–814. https://doi.org/10.1037/0033-2909.129.5.770 (2003).
doi: 10.1037/0033-2909.129.5.770
pubmed: 12956543
Grandjean, D., Bänziger, T. & Scherer, K. R. Intonation as an interface between language and affect. in Understanding Emotions, Vol. 156, 235–247 (Elsevier, 2006).
Peretz, I., Vuvan, D., Lagrois, M. -É. & Armony, J. L. Neural overlap in processing music and speech. Philos. Trans. R. Soc. Lond. B 370, 20140090. https://doi.org/10.1098/rstb.2014.0090 (2015).
doi: 10.1098/rstb.2014.0090
Patel, A. D. Language, music, syntax and the brain. Nat. Neurosci. 6, 674–681 (2003).
doi: 10.1038/nn1082
pubmed: 12830158
Juslin, P. N. & Timmers, R. Expression and communication of emotion in music performance. in Handbook of Music and Emotion: Theory, Research, Applications, 453–489 (Oxford University Press, 2010).
Juslin, P. N. & Laukka, P. Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening. J. New Music Res. 33, 217–238. https://doi.org/10.1080/0929821042000317813 (2004).
doi: 10.1080/0929821042000317813
Bowling, D. L. A vocal basis for the affective character of musical mode in melody. Front. Psychol. 4, 464. https://doi.org/10.3389/fpsyg.2013.00464 (2013).
doi: 10.3389/fpsyg.2013.00464
pubmed: 23914179
pmcid: 3728488
Curtis, M. E. & Bharucha, J. J. The minor third communicates sadness in speech, mirroring its use in music. Emotion 10, 335–348. https://doi.org/10.1037/a0017928 (2010).
doi: 10.1037/a0017928
pubmed: 20515223
Vidas, D., Dingle, G. A. & Nelson, N. L. Children’s recognition of emotion in music and speech. Music Sci. https://doi.org/10.1177/2059204318762650 (2018).
doi: 10.1177/2059204318762650
Werner, S. & Keller, E. Prosodic aspects of speech. In Fundamentals of Speech Synthesis and Speech Recognition: Basic Concepts, State of the Art, the Future Challenges (ed. Keller, E.) 23–40 (Wiley, 1994).
Moreno, S. et al. Musical training influences linguistic abilities in 8-year-old children: More evidence for brain plasticity. Cereb. Cortex 19, 712–723. https://doi.org/10.1093/cercor/bhn120 (2009).
doi: 10.1093/cercor/bhn120
pubmed: 18832336
Chobert, J., Francois, C., Velay, J.-L. & Besson, M. Twelve months of active musical training in 8- to 10-year-old children enhances the preattentive processing of syllabic duration and voice onset time. Cereb. Cortex 24, 956–967. https://doi.org/10.1093/cercor/bhs377 (2012).
doi: 10.1093/cercor/bhs377
pubmed: 23236208
François, C., Chobert, J., Besson, M. & Schön, D. Music training for the development of speech segmentation. Cereb. Cortex 23, 2038–2043. https://doi.org/10.1093/cercor/bhs180 (2013).
doi: 10.1093/cercor/bhs180
pubmed: 22784606
Nan, Y. et al. Piano training enhances the neural processing of pitch and improves speech perception in Mandarin-speaking children. Proc. Natl. Acad. Sci. USA 115, E6630–E6639. https://doi.org/10.1073/pnas.1808412115 (2018).
doi: 10.1073/pnas.1808412115
pubmed: 29941577
pmcid: 6048476
Degé, F. & Schwarzer, G. The effect of a music program on phonological awareness in preschoolers. Front. Psychol. 2, 124. https://doi.org/10.3389/fpsyg.2011.00124 (2011).
doi: 10.3389/fpsyg.2011.00124
pubmed: 21734895
pmcid: 3121007
Vidal, M. M., Lousada, M. & Vigário, M. Music effects on phonological awareness development in 3-year-old children. Appl. Psycholinguist. 41, 299–318. https://doi.org/10.1017/s0142716419000535 (2020).
doi: 10.1017/s0142716419000535
Schön, D., Magne, C. & Besson, M. The music of speech: Music training facilitates pitch processing in both music and language. Psychophysiology 41, 341–349. https://doi.org/10.1111/1469-8986.00172.x (2004).
doi: 10.1111/1469-8986.00172.x
pubmed: 15102118
Chartrand, J.-P. & Belin, P. Superior voice timbre processing in musicians. Neurosci. Lett. 405, 164–167. https://doi.org/10.1016/j.neulet.2006.06.053 (2006).
doi: 10.1016/j.neulet.2006.06.053
pubmed: 16860471
Parbery-Clark, A., Skoe, E., Lam, C. & Kraus, N. Musician enhancement for speech-in-noise. Ear Hear. 30, 653–661 (2009).
doi: 10.1097/AUD.0b013e3181b412e9
pubmed: 19734788
Neves, L., Correia, A. I., Castro, S. L., Martins, D. & Lima, C. F. Does music training enhance auditory and linguistic processing? A systematic review and meta-analysis of behavioral and brain evidence. Neurosci. Biobehav. Rev. 140, 104777. https://doi.org/10.1016/j.neubiorev.2022.104777 (2022).
doi: 10.1016/j.neubiorev.2022.104777
pubmed: 35843347
Globerson, E., Amir, N., Golan, O., Kishon-Rabin, L. & Lavidor, M. Psychoacoustic abilities as predictors of vocal emotion recognition. Atten. Percept. Psychophys. 75, 1799–1810. https://doi.org/10.3758/s13414-013-0518-x (2013).
doi: 10.3758/s13414-013-0518-x
pubmed: 23893469
Most, T. Perception of the prosodic characteristics of spoken language by individuals with hearing loss. Oxford Handb. Deaf Stud. Lang. 79, 79–93 (2015).
Bigand, E. & Poulin-Charronnat, B. Are we “experienced listeners”? A review of the musical capacities that do not depend on formal musical training. Cognition 100, 100–130. https://doi.org/10.1016/j.cognition.2005.11.007 (2006).
doi: 10.1016/j.cognition.2005.11.007
pubmed: 16412412
Mosing, M. A., Madison, G., Pedersen, N. L., Kuja-Halkola, R. & Ullén, F. Practice does not make perfect: No causal effect of music practice on music ability. Psychol. Sci. 25, 1795–1803. https://doi.org/10.1177/0956797614541990 (2014).
doi: 10.1177/0956797614541990
pubmed: 25079217
Law, L. N. C. & Zentner, M. R. Assessing musical abilities objectively: Construction and validation of the profile of music perception skills. PLoS ONE 7, e52508. https://doi.org/10.1371/journal.pone.0052508 (2012).
doi: 10.1371/journal.pone.0052508
pubmed: 23285071
pmcid: 3532219
Mankel, K. & Bidelman, G. M. Inherent auditory skills rather than formal music training shape the neural encoding of speech. Proc. Natl. Acad. Sci. USA 115, 13129–13134. https://doi.org/10.1073/pnas.1811793115 (2018).
doi: 10.1073/pnas.1811793115
pubmed: 30509989
pmcid: 6304957
Correia, A. I. et al. Enhanced recognition of vocal emotions in individuals with naturally good musical abilities. Emotion 22, 894–906. https://doi.org/10.1037/emo0000770 (2022).
doi: 10.1037/emo0000770
pubmed: 32718172
Juslin, P. N. & Scherer, K. Vocal expression of affect. In The New Handbook of Methods in Nonverbal Behavior Research (eds Harrigan, J. A. et al.) 65–135 (Oxford University Press, 2005).
doi: 10.1093/oso/9780198529613.003.0003
Patel, A. D. Music, Language, and the Brain (Oxford University Press, 2008).
Laukka, P. et al. Investigating individual differences in emotion recognition ability using the ERAM test. Acta Psychol. 220, 103422. https://doi.org/10.1016/j.actpsy.2021.103422 (2021).
doi: 10.1016/j.actpsy.2021.103422
Bänziger, T., Grandjean, D. & Scherer, K. R. Emotion recognition from expressions in face, voice, and body: The multimodal emotion recognition test (MERT). Emotion 9, 691–704. https://doi.org/10.1037/a0017088 (2009).
doi: 10.1037/a0017088
pubmed: 19803591
Srinivasan, R. J. & Massaro, D. W. Perceiving prosody from the face and voice: Distinguishing statements from echoic questions in English. Lang. Speech 46, 1–22 (2003).
doi: 10.1177/00238309030460010201
pubmed: 14529109
Patel, A. D., Foxton, J. M. & Griffiths, T. D. Musically tone-deaf individuals have difficulty discriminating intonation contours extracted from speech. Brain Cogn. 59, 310–313. https://doi.org/10.1016/j.bandc.2004.10.003 (2005).
doi: 10.1016/j.bandc.2004.10.003
pubmed: 16337871
Leitman, D. I. et al. Sensory contributions to impaired prosodic processing in schizophrenia. Biol. Psychiatry 58, 56–61. https://doi.org/10.1016/j.biopsych.2005.02.034 (2005).
doi: 10.1016/j.biopsych.2005.02.034
pubmed: 15992523
Arias, P., Rachman, L., Lind, A. & Aucouturier, J. J. IRCAM Neutral-Content Voices (Audio Corpus). https://archive.org/details/NeutralContentSaidEmotionallyDataBaseUploadedVersion (2015).
Rachman, L. et al. DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech. Behav. Res. Methods 50, 323–343. https://doi.org/10.3758/s13428-017-0873-y (2018).
doi: 10.3758/s13428-017-0873-y
pubmed: 28374144
Audacity Team. Audacity(R): Free Audio Editor and Recorder (2021).
Limesurvey GmbH. LimeSurvey: An Open Source Survey Tool. http://www.limesurvey.org (2022).
Mamassian, P. Confidence forced-choice and other metaperceptual tasks. Perception 49, 616–635. https://doi.org/10.1177/0301006620928010 (2020).
doi: 10.1177/0301006620928010
pubmed: 32552488
Hautus, M., Macmillan, N. A. & Creelman, C. D. Detection Theory: A User’s Guide (Routledge Taylor & Francis Group, 2021).
doi: 10.4324/9781003203636
Livingston, S. A. Item Analysis. In Handbook of Test Development 435–456 (Routledge, 2011).
Vokey, J. R. Single-step simple ROC curve fitting via PCA. Can. J. Exp. Psychol. 70, 301–305. https://doi.org/10.1037/cep0000095 (2016).
doi: 10.1037/cep0000095
pubmed: 27269769
Aujla, H. do′: Sensitivity at the optimal criterion location. Behav. Res. 55, 2532–2558. https://doi.org/10.3758/s13428-022-01913-5 (2022).
doi: 10.3758/s13428-022-01913-5
Strauss, H., Reiche, S., Dick, M. & Zentner, M. R. Online assessment of musical ability in 10 minutes: Development and validation of the Micro-PROMS. Behav. Res. https://doi.org/10.3758/s13428-023-02130-4 (2023).
doi: 10.3758/s13428-023-02130-4
Soranzo, A. & Grassi, M. Psychoacoustics: A comprehensive MATLAB toolbox for auditory testing. Front. Psychol. 5, 712. https://doi.org/10.3389/fpsyg.2014.00712 (2014).
doi: 10.3389/fpsyg.2014.00712
pubmed: 25101013
pmcid: 4104800
Hodson, G. Construct jangle or construct mangle? Thinking straight about (nonredundant) psychological constructs. J. Theor. Soc. Psychol. 5, 576–590. https://doi.org/10.1002/jts5.120 (2021).
doi: 10.1002/jts5.120
Leek, M. R. Adaptive procedures in psychophysical research. Percept. Psychophys. 63, 1279–1292. https://doi.org/10.3758/BF03194543 (2001).
doi: 10.3758/BF03194543
pubmed: 11800457
Bänziger, T., Mortillaro, M. & Scherer, K. R. Introducing the Geneva multimodal expression corpus for experimental research on emotion perception. Emotion 12, 1161–1179. https://doi.org/10.1037/a0025827 (2012).
doi: 10.1037/a0025827
pubmed: 22081890
Kuder, G. F. & Richardson, M. W. The theory of the estimation of test reliability. Psychometrika 2, 151–160. https://doi.org/10.1007/BF02288391 (1937).
doi: 10.1007/BF02288391
Zentner, M. R. & Strauss, H. Assessing musical ability quickly and objectively: Development and validation of the Short-PROMS and the Mini-PROMS. Ann. N. Y. Acad. Sci. 1400, 33–45. https://doi.org/10.1111/nyas.13410 (2017).
doi: 10.1111/nyas.13410
pubmed: 28704888
Hayes, A. F. The PROCESS macro for SPSS and SAS (version 2.13)[Software] (2013).
Preacher, K. J. & Hayes, A. F. SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behav. Res. Method. Instrum. Comput. 36, 717–731. https://doi.org/10.3758/bf03206553 (2004).
doi: 10.3758/bf03206553
Schoemann, A. M., Boulton, A. J. & Short, S. D. Determining power and sample size for simple and complex mediation models. Soc. Psychol. Pers. Sci. 8, 379–386. https://doi.org/10.1177/1948550617715068 (2017).
doi: 10.1177/1948550617715068
Swaminathan, S. & Schellenberg, E. G. Musical competence and phoneme perception in a foreign language. Psychon. Bull. Rev. 24, 1929–1934. https://doi.org/10.3758/s13423-017-1244-5 (2017).
doi: 10.3758/s13423-017-1244-5
pubmed: 28204984
Twaite, J. T. Examining Relationships Between Basic Emotion Perception and Musical Training in the Prosodic, Facial, and Lexical Channels of Communication and in Music. Dissertation. City University of New York (2016).
Scharinger, M., Knoop, C. A., Wagner, V. & Menninghaus, W. Neural processing of poems and songs is based on melodic properties. NeuroImage 257, 119310. https://doi.org/10.1016/j.neuroimage.2022.119310 (2022).
doi: 10.1016/j.neuroimage.2022.119310
pubmed: 35569784
Tursunov, A., Kwon, S. & Pang, H.-S. Discriminating emotions in the valence dimension from speech using timbre features. Appl. Sci. 9, 2470. https://doi.org/10.3390/app9122470 (2019).
doi: 10.3390/app9122470
Johnstone, T. & Scherer, K. R. The effects of emotions on voice quality. in Proceedings of the 14th International Congress of Phonetic Sciences, 2029–2032.
Laukkanen, A.-M., Vilkman, E., Alku, P. & Oksanen, H. On the perception of emotions in speech: The role of voice quality. Logop 22, 157–168. https://doi.org/10.3109/14015439709075330 (1997).
doi: 10.3109/14015439709075330
Ladd, D. R., Silverman, K. E. A., Tolkmitt, F., Bergmann, G. & Scherer, K. R. Evidence for the independent function of intonation contour type, voice quality, and F0 range in signaling speaker affect. J. Acoust. Soc. Am. 78, 435–444. https://doi.org/10.1121/1.392466 (1985).
doi: 10.1121/1.392466
Sares, A. G., Foster, N. E. V., Allen, K. & Hyde, K. L. Pitch and time processing in speech and tones: The effects of musical training and attention. J. Speech Lang. Hear. Res. 61, 496–509. https://doi.org/10.1044/2017_JSLHR-S-17-0207 (2018).
doi: 10.1044/2017_JSLHR-S-17-0207
pubmed: 29466555
Escoffier, N., Zhong, J., Schirmer, A. & Qiu, A. Emotional expressions in voice and music: Same code, same effect?. Hum. Brain Mapp. 34, 1796–1810. https://doi.org/10.1002/hbm.22029 (2013).
doi: 10.1002/hbm.22029
pubmed: 22505222
Fiveash, A., Bedoin, N., Gordon, R. L. & Tillmann, B. Processing rhythm in speech and music: Shared mechanisms and implications for developmental speech and language disorders. Neuropsychology 35, 771–791. https://doi.org/10.1037/neu0000766 (2021).
doi: 10.1037/neu0000766
pubmed: 34435803
pmcid: 8595576
Kirschner, S. & Tomasello, M. Joint music making promotes prosocial behavior in 4-year-old children. Evol. Hum. Behav. 31, 354–364. https://doi.org/10.1016/j.evolhumbehav.2010.04.004 (2010).
doi: 10.1016/j.evolhumbehav.2010.04.004
Cho, E. The relationship between small music ensemble experience and empathy skill: A survey study. Psychol. Music 49, 600–614. https://doi.org/10.1177/0305735619887226 (2021).
doi: 10.1177/0305735619887226
Rabinowitch, T.-C., Cross, I. & Burnard, P. Long-term musical group interaction has a positive influence on empathy in children. Psychol. Music 41, 484–498. https://doi.org/10.1177/0305735612440609 (2013).
doi: 10.1177/0305735612440609
Dibben, N., Coutinho, E., Vilar, J. A. & Estévez-Pérez, G. Do individual differences influence moment-by-moment reports of emotion perceived in music and speech prosody?. Front. Behav. Neurosci. 12, 184. https://doi.org/10.3389/fnbeh.2018.00184 (2018).
doi: 10.3389/fnbeh.2018.00184
pubmed: 30210316
pmcid: 6119718
Trimmer, C. G. & Cuddy, L. L. Emotional intelligence, not music training, predicts recognition of emotional speech prosody. Emotion 8, 838–849. https://doi.org/10.1037/a0014080 (2008).
doi: 10.1037/a0014080
pubmed: 19102595
Correia, A. I. et al. Can musical ability be tested online?. Behav. Res. 54, 955–969. https://doi.org/10.3758/s13428-021-01641-2 (2022).
doi: 10.3758/s13428-021-01641-2
Olderbak, S., Riggenmann, O., Wilhelm, O. & Doebler, P. Reliability generalization of tasks and recommendations for assessing the ability to perceive facial expressions of emotion. Psychol. Assess. 33, 911–926. https://doi.org/10.1037/pas0001030 (2021).
doi: 10.1037/pas0001030
pubmed: 33914567
Vuoskoski, J. K. & Thompson, W. F. Who enjoys listening to sad music and why?. Music Percept. 29, 311–317. https://doi.org/10.1525/mp.2012.29.3.311 (2012).
doi: 10.1525/mp.2012.29.3.311