Vocal melody and musical background are simultaneously processed by the brain for musical predictions.
HD EEG
chords
early mismatch responses
lyrics
musical predictions
Journal
Annals of the New York Academy of Sciences
ISSN: 1749-6632
Titre abrégé: Ann N Y Acad Sci
Pays: United States
ID NLM: 7506858
Informations de publication
Date de publication:
06 2022
06 2022
Historique:
received:
20
09
2021
accepted:
18
01
2022
pubmed:
2
3
2022
medline:
22
6
2022
entrez:
1
3
2022
Statut:
ppublish
Résumé
Musical pleasure is related to the capacity to predict and anticipate the music. By recording early cerebral responses of 16 participants with electroencephalography during periods of silence inserted in known and unknown songs, we aimed to measure the contribution of different musical attributes to musical predictions. We investigated the mismatch between past encoded musical features and the current sensory inputs when listening to lyrics associated with vocal melody, only background instrumental material, or both attributes grouped together. When participants were listening to chords and lyrics for known songs, the brain responses related to musical violation produced event-related potential responses around 150-200 ms that were of a larger amplitude than for chords or lyrics only. Microstate analysis also revealed that for chords and lyrics, the global field power had an increased stability and a longer duration. The source localization identified that the right superior temporal and frontal gyri and the inferior and medial frontal gyri were activated for a longer time for chords and lyrics, likely caused by the increased complexity of the stimuli. We conclude that grouped together, a broader integration and retrieval of several musical attributes at the same time recruit larger neuronal networks that lead to more accurate predictions.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
126-140Informations de copyright
© 2022 New York Academy of Sciences.
Références
Rohrmeier, M.A. & S. Koelsch. 2012. Predictive information processing in music cognition. A critical review. Int. J. Psychophysiol. 83: 164-175.
Salimpoor, V.N., D.H. Zald, R.J. Zatorre, et al. 2015. Predictions and the brain: how musical sounds become rewarding. Trends Cogn. Sci. 19: 86-91.
Blood, A.J. & R.J. Zatorre. 2001. Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc. Natl. Acad. Sci. USA 98: 11818-11823.
Ferreri, L., E. Mas-Herrero, R.J. Zatorre, et al. 2019. Dopamine modulates the reward experiences elicited by music. Proc. Natl. Acad. Sci. USA 116: 3793-3798.
Menon, V. & D.J. Levitin. 2005. The rewards of music listening: response and physiological connectivity of the mesolimbic system. Neuroimage 28: 175-184.
Salimpoor, V.N., M. Benovoy, K. Larcher, et al. 2011. Anatomically distinct dopamine release during anticipation and experience of peak emotion to music. Nat. Neurosci. 14: 257-262.
Zald, D.H. & R.J. Zatorre. 2011. Music. In Neurobiology of Sensation and Reward. J.A. Gottfried, Ed.: 405-428. Boca Raton, FL: CRC Press/Taylor & Francis.
Cheung, V.K.M., P.M.C. Harrison, L. Meyer, et al. 2019. Uncertainty and surprise jointly predict musical pleasure and amygdala, hippocampus, and auditory cortex activity. Curr. Biol. 29: 4084-4092.e4.
Egermann, H., M.T. Pearce, G.A. Wiggins, et al. 2013. Probabilistic models of expectation violation predict psychophysiological emotional responses to live concert music. Cogn. Affect. Behav. Neurosci. 13: 533-553.
Gold, B.P., E. Mas-Herrero, Y. Zeighami, et al. 2019. Musical reward prediction errors engage the nucleus accumbens and motivate learning. Proc. Natl. Acad. Sci. USA 116: 3310-3315.
Huron, D.B. 2006. Sweet Anticipation: Music and the Psychology of Expectation. MIT Press.
Koelsch, S., S. Kilches, N. Steinbeis, et al. 2008. Effects of unexpected chords and of performer's expression on brain responses and electrodermal activity. PLoS One 3: e2631.
Mas-Herrero, E., A. Dagher & R.J. Zatorre. 2018. Modulating musical reward sensitivity up and down with transcranial magnetic stimulation. Nat. Hum. Behav. 2: 27-32.
Mas-Herrero, E., A. Dagher, M. Farrés-Franch, et al. 2021. Unraveling the temporal dynamics of reward signals in music-induced pleasure with TMS. J. Neurosci. 41: 3889-3899.
Steinbeis, N., S. Koelsch & J.A. Sloboda. 2006. The role of harmonic expectancy violations in musical emotions: evidence from subjective, physiological, and neural responses. J. Cogn. Neurosci. 18: 1380-1393.
Krumhansl, C.L. 1997. An exploratory study of musical emotions and psychophysiology. Can. J. Exp. Psychol. 51: 336-353.
Meyer, L.B. 1956. Emotion and Meaning in Music. Chicago, IL: University of Chicago Press.
Sloboda, J. 1991. Music structure and emotional response: some empirical findings. Psychol. Music 19: 110-120.
Di Liberto, G.M., C. Pelofi, R. Bianco, et al. 2020. Cortical encoding of melodic expectations in human temporal cortex. eLife 9: e51784.
Folstein, J.R. & C. Van Petten. 2008. Influence of cognitive control and mismatch on the N2 component of the ERP: a review. Psychophysiology 45: 152-170.
Yu, X., T. Liu & D. Gao. 2015. The mismatch negativity: an indicator of perception of regularities in music. Behav. Neurol. 2015: 469508.
Näätänen, R., P. Paavilainen, K. Alho, et al. 1987. The mismatch negativity to intensity changes in an auditory stimulus sequence. Electroencephalogr. Clin. Neurophysiol. Suppl. 40: 125-131.
Guo, S. & S. Koelsch. 2016. Effects of veridical expectations on syntax processing in music: event-related potential evidence. Sci. Rep. 6: 19064.
Dehaene-Lambertz, G. 1997. Electrophysiological correlates of categorical phoneme perception in adults. Neuroreport 8: 919-924.
Lappe, C., O. Steinsträter & C. Pantev. 2013. Rhythmic and melodic deviations in musical sequences recruit different cortical areas for mismatch detection. Front. Hum. Neurosci. 7: 260.
Tervaniemi, M., M. Huotilainen & E. Brattico. 2014. Melodic multi-feature paradigm reveals auditory profiles in music-sound encoding. Front. Hum. Neurosci. 8: 496.
Virtala, P., M. Huotilainen, E. Partanen, et al. 2014. Musicianship facilitates the processing of Western music chords-an ERP and behavioral study. Neuropsychologia 61: 247-258.
Garza Villarreal, E.A., E. Brattico, S. Leino, et al. 2011. Distinct neural responses to chord violations: a multiple source analysis study. Brain Res. 1389: 103-114.
Brattico, E., T. Tupala, E. Glerean, et al. 2013. Modulated neural processing of Western harmony in folk musicians. Psychophysiology 50: 653-663.
Walsh, K.S., D.P. McGovern, A. Clark, et al. 2020. Evaluating the neurophysiological evidence for predictive processing as a model of perception. Ann. N.Y. Acad. Sci. 1464: 242-268.
Liberto, G.M.D., G. Marion & S.A. Shamma. 2021. The music of silence. Part II: music listening induces imagery responses. J. Neurosci. 41:7449-7460.
Gabriel, D., T.C. Wong, M. Nicolier, et al. 2016. Don't forget the lyrics! Spatiotemporal dynamics of neural mechanisms spontaneously evoked by gaps of silence in familiar and newly learned songs. Neurobiol. Learn. Mem. 132: 18-28.
Brunet, D., M.M. Murray & C.M. Michel. 2011. Spatiotemporal analysis of multichannel EEG: CARTOOL. Comput. Intell. Neurosci. 2011: 813870.
Lehmann, D., H. Ozaki & I. Pal. 1987. EEG alpha map series: brain micro-states by space-oriented adaptive segmentation. Electroencephalogr. Clin. Neurophysiol. 67: 271-288.
Pourtois, G., S. Delplanque, C. Michel, et al. 2008. Beyond conventional event-related brain potential (ERP): exploring the time-course of visual emotion processing using topographic and principal component analyses. Brain Topogr. 20: 265-277.
Rosburg, T., V. Marinou, J. Haueisen, et al. 2004. Effects of lorazepam on the neuromagnetic mismatch negativity (MMNm) and auditory evoked field component N100m. Neuropsychopharmacology 29: 1723-1733.
Michel, C.M. & M.M. Murray. 2012. Towards the utilization of EEG as a brain imaging tool. Neuroimage 61: 371-385.
James, C.E., M.S. Oechslin, C.M. Michel, et al. 2017. Electrical neuroimaging of music processing reveals mid-latency changes with level of musical expertise. Front. Neurosci. 11: 613.
Pascual-Marqui, R.D., C.M. Michel & D. Lehmann. 1995. Segmentation of brain electrical activity into microstates: model estimation and validation. IEEE Trans. Biomed. Eng. 42: 658-665.
Brodbeck, V., A. Kuhn, F. von Wegner, et al. 2012. EEG microstates of wakefulness and NREM sleep. Neuroimage 62: 2129-2139.
Khanna, A., A. Pascual-Leone, C.M. Michel, et al. 2015. Microstates in resting-state EEG: current status and future directions. Neurosci. Biobehav. Rev. 49: 105-113.
Menendez, R.G.D.P., S.G. Andino, G. Lantz, et al. 2001. Noninvasive localization of electromagnetic epileptic activity. I. Method descriptions and simulations. Brain Topogr. 14: 131-137.
Michel, C.M. & D. Brunet. 2019. EEG source imaging: a practical review of the analysis steps. Front. Neurol. 10: 325.
Sammler, D., A. Baird, R. Valabrègue, et al. 2010. The relationship of lyrics and tunes in the processing of unfamiliar songs: a functional magnetic resonance adaptation study. J. Neurosci. 30: 3572-3578.
Eulitz, C. & A. Lahiri. 2004. Neurobiological evidence for abstract phonological representations in the mental lexicon during speech recognition. J. Cogn. Neurosci. 16: 577-583.
Uhlig, M., M.T. Fairhurst & P.E. Keller. 2013. The importance of integration and top-down salience when listening to complex multi-part musical stimuli. Neuroimage 77: 52-61.
Inui, K., H. Okamoto, K. Miki, et al. 2006. Serial and parallel processing in the human auditory cortex: a magnetoencephalographic study. Cereb. Cortex 16: 18-30.
Bregman, A.S. 1990. Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: A Bradford Book.
Erickson, R. 1975. Sound Structure in Music. Berkeley, CA: University of California Press.
Koelsch, S. & S. Jentschke. 2010. Differences in electric brain responses to melodies and chords. J. Cogn. Neurosci. 22: 2251-2262.
Giard, M.H., F. Perrin, J. Pernier, et al. 1990. Brain generators implicated in the processing of auditory stimulus deviance: a topographic event-related potential study. Psychophysiology 27: 627-640.
Alho, K. 1995. Cerebral generators of mismatch negativity (MMN) and its magnetic counterpart (MMNm) elicited by sound changes. Ear Hear. 16: 38-51.
Caclin, A., E. Brattico, M. Tervaniemi, et al. 2006. Separate neural processing of timbre dimensions in auditory sensory memory. J. Cogn. Neurosci. 18: 1959-1972.
Pakarinen, S., R. Lovio, M. Huotilainen, et al. 2009. Fast multi-feature paradigm for recording several mismatch negativities (MMNs) to phonetic and acoustic changes in speech sounds. Biol. Psychol. 82: 219-226.
Nagel, F., R. Kopiez, O. Grewe, et al. 2008. Psychoacoustical correlates of musically induced chills. Music. Sci. 12: 101-113.
Gavazzi, G., T. Marzi, F. Giganti, et al. 2021. Pleasure plays the music: visual attention and expertise. PsyArXiv. https://doi.org/10.31234/osf.io/me3c7
Gottlieb, J., P.-Y. Oudeyer, M. Lopes, et al. 2013. Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends Cogn. Sci. 17: 585-593.
Brattico, E., M. Tervaniemi, R. Näätänen, et al. 2006. Musical scale properties are automatically processed in the human auditory cortex. Brain Res. 1117: 162-174.
Opitz, B., T. Rinne, A. Mecklinger, et al. 2002. Differential contribution of frontal and temporal cortices to auditory change detection: fMRI and ERP results. Neuroimage 15: 167-174.
Maess, B., S. Koelsch, T.C. Gunter, et al. 2001. Musical syntax is processed in Broca's area: an MEG study. Nat. Neurosci. 4: 540-545.
Halpern, A.R. 2003. Cerebral substrates of musical imagery. In The Cognitive Neuroscience of Music. I. Peretz & R.J. Zatorre, Eds.: 217-230. Oxford: Oxford University Press.
Gelding, R.W., W.F. Thompson & B.W. Johnson. 2019. Musical imagery depends upon coordination of auditory and sensorimotor brain activity. Sci. Rep. 9: 16823.
Jongsma, M.L.A., N.J.H.M. Gerrits, C.M. van Rijn, et al. 2012. Event related potentials to digit learning: tracking neurophysiologic changes accompanying recall performance. Int. J. Psychophysiol. 85: 41-48.
Halpern, A.R. & R.J. Zatorre. 1999. When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. Cereb. Cortex 9: 697-704.
Peretz, I. & R.J. Zatorre. 2005. Brain organization for music processing. Annu. Rev. Psychol. 56: 89-114.
Platel, H., J.-C. Baron, B. Desgranges, et al. 2003. Semantic and episodic memory of music are subserved by distinct neural networks. Neuroimage 20: 244-256.
Rogalsky, C., F. Rong, K. Saberi, et al. 2011. Functional anatomy of language and music perception: temporal and structural factors investigated using functional magnetic resonance imaging. J. Neurosci. 31: 3843-3852.
Stewart, L., T. Overath, J.D. Warren, et al. 2008. fMRI evidence for a cortical hierarchy of pitch pattern processing. PLoS One 3: e1470.
Liégeois-Chauvel, C., I. Peretz, M. Babaï, et al. 1998. Contribution of different cortical areas in the temporal lobes to music processing. Brain 121: 1853-1867.
Aron, A.R., P.C. Fletcher, E.T. Bullmore, et al. 2003. Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans. Nat. Neurosci. 6: 115-116.
Forstmann, B.U., S. Jahfari, H.S. Scholte, et al. 2008. Function and structure of the right inferior frontal cortex predict individual differences in response inhibition: a model-based approach. J. Neurosci. 28: 9790-9796.
Stevens, A.A., P. Skudlarski, J.C. Gatenby, et al. 2000. Event-related fMRI of auditory and visual oddball tasks. Magn. Reson. Imaging 18: 495-502.
Anurova, I., V.V. Nikouline, R.J. Ilmoniemi, et al. 2001. Evidence for dissociation of spatial and nonspatial auditory information processing. Neuroimage 14: 1268-1277.
Anurova, I., D. Artchakov, A. Korvenoja, et al. 2003. Differences between auditory evoked responses recorded during spatial and nonspatial working memory tasks. Neuroimage 20: 1181-1192.
Zatorre, R.J. & A.R. Halpern. 2005. Mental concerts: musical imagery and auditory cortex. Neuron 47: 9-12.
Zatorre, R.J., A.R. Halpern, D.W. Perry, et al. 1996. Hearing in the mind's ear: a PET investigation of musical imagery and perception. J. Cogn. Neurosci. 8: 29-46.
Seger, C.A., B.J. Spiering, A.G. Sares, et al. 2013. Corticostriatal contributions to musical expectancy perception. J. Cogn. Neurosci. 25: 1062-1077.
Critchley, H.D. 2005. Neural mechanisms of autonomic, affective, and cognitive integration. J. Comp. Neurol. 493: 154-166.
Gebauer, L., M.L. Kringelbach & P. Vuust. 2012. Ever-changing cycles of musical pleasure: the role of dopamine and anticipation. Psychomusicol.: Music Mind Brain 22: 152-167.
Paavilainen, P., P. Arajärvi & R. Takegata. 2007. Preattentive detection of nonsalient contingencies between auditory features. Neuroreport 18: 159-163.
Quiroga-Martinez, D.R., B. Tillmann, E. Brattico, et al. 2021. Listeners with congenital amusia are sensitive to context uncertainty in melodic sequences. Neuropsychologia 158: 107911.
Ylinen, S., K. Strelnikov, M. Huotilainen, et al. 2009. Effects of prosodic familiarity on the automatic processing of words in the human brain. Int. J. Psychophysiol. 73: 362-368.
Beauchemin, M., L. De Beaumont, P. Vannasing, et al. 2006. Electrophysiological markers of voice familiarity. Eur. J. Neurosci. 23: 3081-3086.
Näätänen, R. 2001. The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm). Psychophysiology 38: 1-21.
Albouy, P., L. Benjamin, B. Morillon, et al. 2020. Distinct sensitivity to spectrotemporal modulation supports brain asymmetry for speech and melody. Science 367: 1043-1047.
Näätänen, R., P. Paavilainen, T. Rinne, et al. 2007. The mismatch negativity (MMN) in basic research of central auditory processing: a review. Clin. Neurophysiol. 118: 2544-2590.
Winkler, I., G. Karmos & R. Näätänen. 1996. Adaptive modeling of the unattended acoustic environment reflected in the mismatch negativity event-related potential. Brain Res. 742: 239-252.
Vuust, P., L. Ostergaard, K.J. Pallesen, et al. 2009. Predictive coding of music-brain responses to rhythmic incongruity. Cortex 45: 80-92.
Bonnel, A.-M., F. Faita, I. Peretz, et al. 2001. Divided attention between lyrics and tunes of operatic songs: evidence for independent processing. Percept. Psychophys. 63: 1201-1213.
Vuust, P., K.J. Pallesen, C. Bailey, et al. 2005. To musicians, the message is in the meter pre-attentive neuronal responses to incongruent rhythm are left-lateralized in musicians. Neuroimage 24: 560-564.
Berridge, K.C. & M.L. Kringelbach. 2008. Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology (Berl.) 199: 457-480.
Hansen, N.C., M.J. Dietz & P. Vuust. 2017. Commentary: predictions and the brain: how musical sounds become rewarding. Front. Hum. Neurosci. 11: 168.
Chabin, T., D. Gabriel, T. Chansophonkul, et al. 2020. Cortical patterns of pleasurable musical chills revealed by high-density EEG. Front. Neurosci. 14: 565815.
Brown, S., M.J. Martinez & L.M. Parsons. 2004. Passive music listening spontaneously engages limbic and paralimbic systems. Neuroreport 15: 2033-2037.
Loui, P., S. Patterson, M.E. Sachs, et al. 2017. White matter correlates of musical anhedonia: implications for evolution of music. Front. Psychol. 8: 1664.
Sachs, M.E., R.J. Ellis, G. Schlaug, et al. 2016. Brain connectivity reflects human aesthetic responses to music. Soc. Cogn. Affect. Neurosci. 11: 884-891.