Timbral effects on consonance disentangle psychoacoustic mechanisms and suggest perceptual origins for musical scales.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
19 Feb 2024
19 Feb 2024
Historique:
received:
15
12
2022
accepted:
11
12
2023
medline:
19
2
2024
pubmed:
19
2
2024
entrez:
18
2
2024
Statut:
epublish
Résumé
The phenomenon of musical consonance is an essential feature in diverse musical styles. The traditional belief, supported by centuries of Western music theory and psychological studies, is that consonance derives from simple (harmonic) frequency ratios between tones and is insensitive to timbre. Here we show through five large-scale behavioral studies, comprising 235,440 human judgments from US and South Korean populations, that harmonic consonance preferences can be reshaped by timbral manipulations, even as far as to induce preferences for inharmonic intervals. We show how such effects may suggest perceptual origins for diverse scale systems ranging from the gamelan's slendro scale to the tuning of Western mean-tone and equal-tempered scales. Through computational modeling we show that these timbral manipulations dissociate competing psychoacoustic mechanisms underlying consonance, and we derive an updated computational model combining liking of harmonicity, disliking of fast beats (roughness), and liking of slow beats. Altogether, this work showcases how large-scale behavioral experiments can inform classical questions in auditory perception.
Identifiants
pubmed: 38369535
doi: 10.1038/s41467-024-45812-z
pii: 10.1038/s41467-024-45812-z
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1482Informations de copyright
© 2024. The Author(s).
Références
Brown, S. & Jordania, J. Universals in the world’s musics. Psychol. Music 41, 229–248 (2013).
doi: 10.1177/0305735611425896
Mehr, S. A. et al. Universality and diversity in human song. Science 366 https://doi.org/10.1126/science.aax0868 (2019).
Savage, P. E., Brown, S., Sakai, E. & Currie, T. E. Statistical universals reveal the structures and functions of human music. Proc. Natl Acad. Sci. 112, 8987–8992 (2015).
pubmed: 26124105
pmcid: 4517223
doi: 10.1073/pnas.1414495112
Chiba, G. et al. Small-integer ratios predominate throughout the world’s musical scales. https://doi.org/10.31234/osf.io/5bghm (2019).
Gill, K. Z. & Purves, D. A biological rationale for musical scales. PLoS ONE 4 https://doi.org/10.1371/journal.pone.0008144 (2009).
Hall, D. The objective measurement of goodness-of-fit for tunings and temperaments. J. Math. Music 17, 274–290 (1973).
Huron, D. Interval-class content in equally tempered pitch-class sets: common scales exhibit optimum tonal consonance. Music Percept. 11, 289–305 (1994).
doi: 10.2307/40285624
Huron, D. Tone and voice: a derivation of the rules of voice-leading from perceptual principles. Music Percept. 19, 1–64 (2001).
doi: 10.1525/mp.2001.19.1.1
Bowling, D. L. & Purves, D. A biological rationale for musical consonance. Proc. Natl Acad. Sci. 112, 11155–11160 (2015).
pubmed: 26209651
pmcid: 4568680
doi: 10.1073/pnas.1505768112
Eerola, T. & Lahdelma, I. The anatomy of consonance/dissonance: evaluating acoustic and cultural predictors across multiple datasets with chords. Music Sci. 4 https://doi.org/10.1177/20592043211030471 (2021).
Euler, L. Tentamen Novae Theoria Musicae (Ex Typographia Academiae Scientiarum, 1739).
Friedman, R. S., Kowalewski, D. A., Vuvan, D. T. & Neill, W. T. Consonance preferences within an unconventional tuning system. Music Percept. 38, 313–330 (2021).
doi: 10.1525/mp.2021.38.3.313
McDermott, J. H., Schultz, A. F., Undurraga, E. A. & Godoy, R. A. Indifference to dissonance in native Amazonians reveals cultural variation in music perception. Nature 535, 547–550 (2016).
pubmed: 27409816
doi: 10.1038/nature18635
Rameau, J.-P. Treatise on Harmony (Jean-Baptiste-Christophe Ballard, 1722).
Sethares, W. A. Tuning, Timbre, Spectrum, Scale (Springer, 2005).
Smit, E. A. & Milne, A. J. The need for composite models of music perception: consonance in tuning systems (familiar or unfamiliar) cannot be explained by a single predictor. Music Percept. 38, 335–336 (2021).
doi: 10.1525/mp.2021.38.3.335
Stolzenburg, F. Harmony perception by periodicity detection. J. Math. Music 9, 215–238 (2015).
doi: 10.1080/17459737.2015.1033024
Tenney, J. A History of “Consonance” and “Dissonance” (Excelsior Music Publishing Company, 1988).
Terhardt, E. Pitch, consonance, and harmony. J. Acoust. Soc. Am. 55, 1061–1069 (1974).
pubmed: 4833699
doi: 10.1121/1.1914648
Harrison, P. M. C. & Pearce, M. T. Simultaneous consonance in music perception and composition. Psychol. Rev. 127, 216–244 (2020).
pubmed: 31868392
doi: 10.1037/rev0000169
Stumpf, C. Tonpsychologie (Verlag S. Hirzel, 1890).
Stumpf, C. Konsonanz und dissonanz. Beiträge Zur Akustik Und Musikwissenschaft, Vol. 1, 1–108 (J. A. Barth, 1898).
Krueger, F. Differenztöne und Konsonanz. Arch. Ges. Psychol. 2, 1–80 (1904).
Krueger, F. Die Theorie der Konsonanz. Psychol. Stud. 5, 294–411 (1910).
Preyer, W. Akustische Untersuchungen 44–61 (Verlag G. Fischer, 1879).
Helmholtz, H. L. F. On the Sensations of Tone as a Physiological Basis for the Theory of Music (A. J. Ellis, trans.) (Longmans, Green and Co., 1875).
McDermott, J. H., Lehr, A. J. & Oxenham, A. J. Individual differences reveal the basis of consonance. Curr. Biol. 20, 1035–1041 (2010).
pubmed: 20493704
pmcid: 2885564
doi: 10.1016/j.cub.2010.04.019
McBride, J. & Tlusty, T. Convergent evolution in a large cross-cultural database of musical scales. PsyArXiv https://doi.org/10.31234/osf.io/eh5b3 (2021).
Johnson-Laird, P. N., Kang, O. E. & Leong, Y. C. On musical dissonance. Music Percept. 30, 19–35 (2012).
doi: 10.1525/mp.2012.30.1.19
Ambrazevičius, R. Dissonance/roughness and tonality perception in Lithuanian traditional Schwebungsdiaphonie. J. Interdiscip. Music Stud. 8, 39–53 (2017).
Sethares, W. A. Local consonance and the relationship between timbre and scale. J. Acoust. Soc. Am. 94, 1218–1228 (1993).
doi: 10.1121/1.408175
Plomp, R. & Levelt, W. J. M. Tonal consonance and critical bandwidth. J. Acoust. Soc. Am. 38, 548–560 (1965).
pubmed: 5831012
doi: 10.1121/1.1909741
Kaestner, G. Untersuchungen über den Gefühlseindruck unanalysierter Zweiklänge. Psychol. Stud. 4, 473–504 (1909).
McLachlan, N., Marco, D., Light, M. & Wilson, S. Consonance and pitch. J. Exp. Psychol. Gen. 142, 1142–1158 (2013).
pubmed: 23294344
doi: 10.1037/a0030830
Nordmark, J. & Fahlén, L. E. Beat theories of musical consonance. STL-QPSR 29, 111–122 (1988).
Parncutt, R., Engel, I. & Radovanovic, L. Consonance and dissonance of simultaneous trichords in Western music: a listening experiment to test models of harmonicity and roughness. Psychol. Top. 32, 13–34 (2023).
Loui, P. New music system reveals spectral contribution to statistical learning. Cognition 224, 105071 (2022).
pubmed: 35227982
doi: 10.1016/j.cognition.2022.105071
Bowling, D. L., Purves, D. & Gill, K. Z. Vocal similarity predicts the relative attraction of musical chords. Proc. Natl Acad. Sci. 115, 216–221 (2018).
pubmed: 29255031
doi: 10.1073/pnas.1713206115
McPherson, M. J. et al. Perceptual fusion of musical notes by native Amazonians suggests universal representations of musical intervals. Nat. Commun. 11, 2786 (2020).
pubmed: 32493923
pmcid: 7270137
doi: 10.1038/s41467-020-16448-6
Harrison, P. M. C. et al. Gibbs Sampling with People. Adv. Neural Inf. Process. Syst. https://doi.org/10.48550/arXiv.2008.02595 (2020).
doi: 10.48550/arXiv.2008.02595
Hutchinson, W. & Knopoff, L. The acoustic component of Western consonance. J. New Music Res. 7, 1–29 (1978).
Harrison, P. M. C. & Pearce, M. T. An energy-based generative sequence model for testing sensory theories of Western harmony. In Proceedings of the 19th International Society for Music Information Retrieval Conference 160–167 (2018).
Vassilakis, P. N. Perceptual and Physical Properties of Amplitude Fluctuation and their Musical Significance. Unpublished doctoral dissertation, University of California (2001).
Boersma, P. Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound. Proc. Inst. Phon. Sci. 17, 97–110 (1993).
Milne, A. J. A Computational Model of the Cognition of Tonality. Unpublished doctoral dissertation, The Open University (2013).
Schwartz, D. A., Howe, C. Q. & Purves, D. The statistical structure of human speech sounds predicts musical universals. J. Neurosci. 23, 7160–7168 (2003).
pubmed: 12904476
pmcid: 6740660
doi: 10.1523/JNEUROSCI.23-18-07160.2003
Kameoka, A. & Kuriyagawa, M. Consonance theory part I: consonance of dyads. J. Acoust. Soc. Am. 45, 1451–1459 (1969).
pubmed: 5803168
doi: 10.1121/1.1911623
Lahdelma, I. & Eerola, T. Cultural familiarity and musical expertise impact the pleasantness of consonance/dissonance but not its perceived tension. Sci. Rep. 10, 8693 (2020).
pubmed: 32457382
pmcid: 7250829
doi: 10.1038/s41598-020-65615-8
Popescu, T. et al. The pleasantness of sensory dissonance is mediated by musical style and expertise. Sci. Rep. 9 https://doi.org/10.1038/s41598-018-35873-8 (2019).
Bigand, E. & Poulin-Charronnat, B. Are we “experienced listeners”? A review of the musical capacities that do not depend on formal musical training. Cognition 100, 100–130 (2006).
pubmed: 16412412
doi: 10.1016/j.cognition.2005.11.007
Müllensiefen, D., Gingras, B., Musil, J. & Stewart, L. The musicality of non-musicians: an index for assessing musical sophistication in the general population. PLoS ONE 9 https://doi.org/10.1371/journal.pone.0089642 (2014).
Young, R. W. Inharmonicity of plain wire piano strings. J. Acoust. Soc. Am. 24, 267–273 (1952).
doi: 10.1121/1.1906888
Cousineau, M., McDermott, J. H. & Peretz, I. The basis of musical consonance as revealed by congenital amusia. Proc. Natl Acad. Sci. 109, 19858–19863 (2012).
pubmed: 23150582
pmcid: 3511708
doi: 10.1073/pnas.1207989109
Li, G. The effect of inharmonic and harmonic spectra in Javanese Gamelan tuning (1): a theory of the Sléndro. In Proceedings of the 7th WSEAS International Conference on Acoustics & Music: Theory & Applications 65–71 (2006).
Schneider, A. Sound, pitch, and scale: from “tone measurements” to sonological analysis in ethnomusicology. Ethnomusicology 45, 489–519 (2001).
doi: 10.2307/852868
Rahn, J. Perceptual aspects of tuning in a Balinese gamelan angklung for North American students. Can. Univ. Music Rev./Revue de Musique Des Universités Canadiennes 16, 1–43 (1996).
Vos, J. Purity ratings of tempered fifths and major thirds. Music Percept. 3, 221–257 (1986).
doi: 10.2307/40285335
Roberts, L. A. Consonance judgements of musical chords by musicians and untrained listeners. Acta Acust. United Acust. 62, 163–171 (1986).
Roberts, L. A. & Mathews, M. V. Intonation sensitivity for traditional and nontraditional chords. J. Acoust. Soc. Am. 75, 952–959 (1984).
pubmed: 6707326
doi: 10.1121/1.390560
Dobbins, P. A. & Cuddy, L. L. Octave discrimination: an experimental confirmation of the “stretched” subjective octave. J. Acoust. Soc. Am. 72, 411–415 (1982).
pubmed: 7119283
doi: 10.1121/1.388093
McKinney, M. F. & Delgutte, B. A possible neurophysiological basis of the octave enlargement effect. J. Acoust. Soc. Am. 106, 2679–2692 (1999).
pubmed: 10573885
doi: 10.1121/1.428098
Ohgushi, K. The origin of tonality and a possible explanation of the octave enlargement phenomenon. J. Acoust. Soc. Am. 73, 1694–1700 (1983).
pubmed: 6863747
doi: 10.1121/1.389392
Sethares, W. A., Milne, A. J., Tiedje, S., Prechtl, A. & Plamondon, J. Spectral tools for dynamic tonality and audio morphing. Comput. Music J. 33, 71–84 (2009).
doi: 10.1162/comj.2009.33.2.71
Plamondon, J., Milne, A. & Sethares, W. Dynamic tonality: extending the framework of tonality into the 21st century. In Proceedings of the CMS South Central Chapter Conference (2009).
Milne, A. J., Laney, R. & Sharp, D. B. Testing a spectral model of tonal affinity with microtonal melodies and inharmonic spectra. Music. Sci. 20, 465–494 (2016).
doi: 10.1177/1029864915622682
Vassilakis, P. N. Auditory roughness as a means of musical expression. in Selected Reports in Ethnomusicology: Perspectives in Systematic Musicology, Vol. 12 (Kendall. R. A. & Savage, R. H.) 119–144 (Department of Ethnomusicology, University of California, 2005).
Sievers, B., Polansky, L., Casey, M. & Wheatley, T. Music and movement share a dynamic structure that supports universal expressions of emotion. Proc. Natl Acad. Sci. USA 110, 70–75 (2013).
pubmed: 23248314
doi: 10.1073/pnas.1209023110
Pearce, M. T., Müllensiefen, D. & Wiggins, G. A. The role of expectation and probabilistic learning in auditory boundary perception: a model comparison. Perception 39, 1365–1389 (2010).
pubmed: 21180358
doi: 10.1068/p6507
Bidelman, G. M. & Krishnan, A. Neural correlates of consonance, dissonance, and the hierarchy of musical pitch in the human brainstem. J. Neurosci. 29, 13165–13171 (2009).
pubmed: 19846704
pmcid: 2804402
doi: 10.1523/JNEUROSCI.3900-09.2009
Wright, J. K. & Bregman, A. S. Auditory stream segregation and the control of dissonance in polyphonic music. Contemp. Music Rev. 2, 63–92 (1987).
doi: 10.1080/07494468708567054
van de Geer, W. J., Levelt, W. J. M. & Plomp, R. The connotation of musical consonance. Acta Psychol. 20, 308–319 (1962).
doi: 10.1016/0001-6918(62)90028-8
Smit, E. A., Milne, A. J., Dean, R. T. & Weidemann, G. Perception of affect in unfamiliar musical chords. PLoS ONE 14 https://doi.org/10.1371/journal.pone.0218570 (2019).
Lahdelma, I. & Eerola, T. Theoretical proposals on how vertical harmony may convey nostalgia and longing in music. Empir. Musicol. Rev. 10, 245–263 (2015).
doi: 10.18061/emr.v10i3.4534
Arnal, L. H., Flinker, A., Kleinschmidt, A., Giraud, A. L. & Poeppel, D. Human screams occupy a privileged niche in the communication soundscape. Curr. Biol. 25, 2051–2056 (2015).
pubmed: 26190070
pmcid: 4562283
doi: 10.1016/j.cub.2015.06.043
Hastie, T., Friedman, J. & Tibshirani, R. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (Springer, 2001).
Jacoby, N. et al. Universal and non-universal features of musical pitch perception revealed by singing. Curr. Biol. 29, 3229–3243.e12 (2019).
pubmed: 31543451
pmcid: 9907018
doi: 10.1016/j.cub.2019.08.020
Eerola, T. & Lahdelma, I. Register impacts perceptual consonance through roughness and sharpness. Psychon. Bull. Rev. 29, 800–808 (2022).
pubmed: 34921342
doi: 10.3758/s13423-021-02033-5
Woods, K. J. P., Siegel, M. H., Traer, J. & Mcdermott, J. H. Headphone screening to facilitate web-based auditory experiments. Atten. Percept. Psychophys. 79, 2064–2072 (2017).
pubmed: 28695541
pmcid: 5693749
doi: 10.3758/s13414-017-1361-2
Chmielewski, M. & Kucker, S. C. An MTurk crisis? Shifts in data quality and the impact on study results. Soc. Psychol. Personal. Sci. 11, 464–473 (2020).
doi: 10.1177/1948550619875149
Lee, H., Hoeger, F., Schoenwiesner, M., Park, M. & Jacoby, N. Cross-cultural mood perception in pop songs and its alignment with mood detection algorithms. ArXiv http://arxiv.org/abs/2108.00768 (2021).
McDermott, J. H., Schemitsch, M. & Simoncelli, E. P. Summary statistics in auditory perception. Nat. Neurosci. 16, 493–498 (2013).
pubmed: 23434915
pmcid: 4143328
doi: 10.1038/nn.3347
Parncutt, R. Harmony: A Psychoacoustical Approach (Springer-Verlag, 1989).
Daniel, P. & Weber, R. Psychoacoustical roughness: implementation of an optimized model. Acta Acust. United Acust. 83, 113–123 (1997).
Wang, Y. S., Shen, G. Q., Guo, H., Tang, X. L. & Hamade, T. Roughness modelling based on human auditory perception for sound quality evaluation of vehicle interior noise. J. Sound Vib. 332, 3893–3904 (2013).
doi: 10.1016/j.jsv.2013.02.030
de Cheveigné, A. Pitch perception models. in Pitch: Neural Coding and Perception (eds Plack, C. J. & Oxenham, A. J.) 169–233 (Springer, 2005).
Parncutt, R. Revision of Terhardt’s psychoacoustical model of the root(s) of a musical chord. Music Percept. 6, 65–93 (1988).
doi: 10.2307/40285416
Jadoul, Y., Thompson, B. & de Boer, B. Introducing Parselmouth: a Python interface to Praat. J. Phon. 71, 1–15 (2018).
doi: 10.1016/j.wocn.2018.07.001
Rowan, T. Functional Stability Analysis of Numerical Algorithms. Doctoral thesis, Department of Computer Sciences, University of Texas at Austin (1990).