Does task-irrelevant music affect gaze allocation during real-world scene viewing?
Eye tracking
Gaze control
Music
Semantic informativeness
Visual salience
Journal
Psychonomic bulletin & review
ISSN: 1531-5320
Titre abrégé: Psychon Bull Rev
Pays: United States
ID NLM: 9502924
Informations de publication
Date de publication:
Dec 2021
Dec 2021
Historique:
accepted:
02
05
2021
pubmed:
24
6
2021
medline:
15
12
2021
entrez:
23
6
2021
Statut:
ppublish
Résumé
Gaze control manifests from a dynamic integration of visual and auditory information, with sound providing important cues for how a viewer should behave. Some past research suggests that music, even if entirely irrelevant to the current task demands, may also sway the timing and frequency of fixations. The current work sought to further assess this idea as well as investigate whether task-irrelevant music could also impact how gaze is spatially allocated. In preparation for a later memory test, participants studied pictures of urban scenes in silence or while simultaneously listening to one of two types of music. Eye tracking was recorded, and nine gaze behaviors were measured to characterize the temporal and spatial aspects of gaze control. Findings showed that while these gaze behaviors changed over the course of viewing, music had no impact. Participants in the music conditions, however, did show better memory performance than those who studied in silence. These findings are discussed within theories of multimodal gaze control.
Identifiants
pubmed: 34159530
doi: 10.3758/s13423-021-01947-4
pii: 10.3758/s13423-021-01947-4
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1944-1960Informations de copyright
© 2021. The Psychonomic Society, Inc.
Références
Auer, K., Vitouch, O., Koreimann, S., Pesjak, G., Leitner, G., & Hitz, M. (2012). When music drives vision: Influences of film music on viewers’ eye movements. Proceedings of the 12
Batten, J., & Smith, T. J. (2018). Looking at sound: Sound design and the audiovisual influences on gaze. In T. Dwyer, C. Perkins, S. Redmond, & J. Sita (Eds.), Seeing into screens: Eye tracking and the moving image. Bloomsbury.
Becker, R. A., Chambers, J. M., & Wilks, A. R. (1988) The new S language. Wadsworth & Brooks/Cole.
Berto, R., Massaccesi, S., & Pasini, M. (2008). Do eye movements measured across high and low fascination photographs differ? Addressing Kaplan's fascination hypothesis. Journal of Environmental Psychology, 28, 185–191.
Borji, A., & Itti, L. (2013). State-of-the-Art in Visual Attention Modeling. Pattern Analysis and Machine Intelligence, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 185–207.
Cassidy, G. G., & MacDonald, R. A. R. (2010). The effects of music on time perception and performance of a driving game. Scandinavian Journal of Psychology, 51, 455–464.
pubmed: 20602740
Cohen, A. J. (2001). Music as a source of emotion in film. In P. Juslin & J. Sloboda (Eds.), Music and emotion: Theory and research (pp. 249–272).
Cohen, A.J. (2014). Film music from the perspective of cognitive science. In D. Neumeyer (Ed.), The Oxford handbook of film music studies. Oxford University Press.
Colonius, H., & Arndt, P. (2001). A two-stage model for visual-auditory interaction in saccadic latencies. Perception & Psychophysics, 63, 126–147.
Corneil, B. D., Van Wanrooij, M., Munoz, D. P., & Van Opstal, A. J. (2002). Auditory- visual interactions subserving goal-directed saccades in a complex scene. Journal of Neurophysiology, 88, 438–454.
pubmed: 12091566
Coutrot, A., Guyander, N., Ionescu, G., & Caplier, A. (2012). Influence of soundtrack on eye movements during video exploration. Journal of Eye Movement Research, 5(2), 1–10.
Day, R.-F., Lin, C.-H., Huang, W.-H., & Chuang, S.-H. (2009). Effects of music tempo and task difficulty on multi-attribute decision-making: An eye-tracking approach. Computers in Human Behavior, 25, 120–143.
Di Stasi, L. L., Marchitto, M., Antoli, A., & Canas, J. J. (2013). Saccade peak velocity as an alternative index of operator attention: Short review. European Review of Applied Psychology, 63, 335–343.
Einhäuser, W., & Nuthmann, A. (2016). Salient in space, salient in time: Fixation probability predicts fixation duration during natural scene viewing. Journal of Vision, 16, 13–13.
pubmed: 27627736
Faber, M., Krasich, K., Bixler, R. E., Brockmole, J. R., & D’Mello, S. K. (2020). The eye–mind wandering link: Identifying gaze indices of mind wandering across tasks. Journal of Experimental Psychology: Human Perception and Performance, 46, 1201.
pubmed: 32730072
Fachner, J. (2011). Time is the key - music and altered states of consciousness. In E. Cardenas, M. Winkelmann, C. Tart, & S. Krippner (Eds.), Altering consciousness: A multidisciplinary perspective. Vol. 1: History, culture and the humanities (pp. 355–376). Praeger.
Franěk, M., Šefara, D., Petružálek, J., Cabal, J., & Myška, K. (2018). Differences in eye movements while viewing images with various levels of restorativeness. Journal of Environmental Psychology, 57, 10–16.
Franěk, M., Šefara. D., Petružálek, J., Mlejnek, R., & van Noorden, L. (2018). Eye movements in scene perception while listening to slow and fast music. Journal of Eye Movement Research, 11(2), 8.
Frens, M. A., Van Opstal, A. J., & Van der Willigen, R. F. (1995). Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements. Perception & Psychophysics, 57, 802–816.
Garcia-Diaz, A., Leboran, V., Fdez-Vidal, X. R., & Pardo, X. M. (2012). On the relationship between optical variability, visual saliency, and eye fixations: A computational approach. Journal of Vision, 12, 17–17.
pubmed: 22693335
Harel, J., Koch, C., & Perona, P. (2007). Graph-based visual saliency. In B. Schölkopf, J. Platt, & T. Hofmann (Eds.), Advances in neural information processing systems (pp. 545–552). MIT Press. https://doi.org/10.7551/mitpress/7503.001.0001
Hayes, T. R., & Henderson, J. M. (2019). Scene semantics involuntarily guide attention during visual search. Psychonomic Bulletin & Review, 26, 1683–1689.
Henderson, J. M., & Hayes, T. R. (2017). Meaning-based guidance of attention in scenes as revealed by meaning maps. Nature Human Behaviour, 1, 743.
pubmed: 31024101
pmcid: 7455012
Henderson, J. M., & Hayes, T. R. (2018). Meaning guides attention in real-world scene images: Evidence from eye movements and meaning maps. Journal of Vision, 18, 10–10.
pubmed: 30029216
pmcid: 6012218
Herbert, R. (2011). Music listening: Absorption, dissociation and trancing. Ashgate.
Herbert, R. (2012). Musical and non-musical involvement in daily life: The case of absorption. Musicae Scientiae, 16, 41–66.
Hollingworth A. (2006). Scene and position specificity in visual memory for objects. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 58–69.
pubmed: 16478340
Hou, X., Harel, J., & Koch, C. (2012). Image signature: Highlighting sparse salient regions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 194–201.
Jeffreys, H. (1961). Theory of Probability (3rd Ed.). Oxford University Press.
Judd, T., Durand, F., & Torralba, A. (2012). A benchmark of computational models of saliency to predict human fixations. (Tech. Rep. No. MITCSAIL-TR-2012-001). Cambridge, MA: MIT Computer Science and Artificial Intelligence Laboratory.
Kam, J. W., & Handy, T. C. (2013). The neurocognitive consequences of the wandering mind: a mechanistic account of sensory-motor decoupling. Frontiers in Psychology, 4, 725.
pubmed: 24133472
pmcid: 3796327
Kämpfe, J., Sedlmeier, P., & Renkewitz, F. (2011). The impact of background music on adult listeners: A meta-analysis. Psychology of Music, 39, 424–448.
Koelsch, S., Bashevkin, T., Kristensen, J., Tvedt, J., & Jenstschke, S. (2019). Heroic music stimulates empowering thoughts during mind-wandering. Scientific Reports, 9, Article 10317.
pubmed: 31311967
Krasich, K., McManus, R., Hutt, S., Faber, M., D'Mello, S. K., & Brockmole, J. R. (2018). Gaze-based signatures of mind wandering during real-world scene processing. Journal of Experimental Psychology: General, 147, 1111–1124.
Land, M. F., & Lee, D. N. (1994). Where we look when we steer. Nature, 369 (6483), 742–744.
pubmed: 8008066
Mera, M., & Stumpf, S. (2014). Eye-tracking film music. Music and the Moving Image, 7, 3–23.
Morey, R. D., Romeijn, J. W., & Rouder, J. N. (2016). The philosophy of Bayes factors and the quantification of statistical evidence. Journal of Mathematical Psychology, 72, 6–18.
Murray, S., Krasich, K., Schooler, J. W., & Seli, P. (2020). What’s in a task? Complications in the study of the task-unrelated-thought variety of mind wandering. Perspectives on Psychological Science, 15(3), 572–588.
Najemnik, J., & Geisler, W. S. (2005). Optimal eye movement strategies in visual search. Nature, 43, 387–391. Vision Research, 10, 1286–1294.
Najemnik, J., & Geisler, W. S. (2009). Simple summation rule for optimal fixation selection in visual search. Vision Research, 10, 1286–1294.
Neider, M. B., & Zelinsky, G. J. (2006). Scene context guides eye movements during visual search. Vision Research. 46, 614–621.
pubmed: 16236336
Olshausen, B. A., & Field, D. J. (2005). How close are we to understanding V1?. Neural Computation, 17, 1665–1699.
pubmed: 15969914
Parkhurst, D. J., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107–123.
pubmed: 11804636
Quigley, C., Onat, S., Harding, S., Cooke, M., & Konig, P. (2008). Audio-visual integration during overt visual attention. Journal of Eye Movement Research, 1(4), 1–17.
Raftery, A. E. (1995). Bayesian model selection in social research. In P. V. Marsden (Ed.), Sociological Methodology 1995 (pp. 111–196). Blackwell.
Ranti, C., Jones, W., Klin, A., & Shultz, S. (2020). Blink rate patterns provide a reliable measure of individual engagement with scene content. Scientific Reports, 10, Article 8267.
pubmed: 32427957
Reichle, E. D., Reineberg, A. E., & Schooler, J. W. (2010). Eye movements during mindless reading. Psychological Science, 21, 1300 –1310.
pubmed: 20679524
Riche, N., Mancas, M., Duvinage, M., Mibulumukini, M., Gosselin, B., & Dutoit, T. (2013). RARE2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis. Signal Processing: Image Communication, 28, 642–658.
Schäfer, T., & Fachner, J. (2015). Listening to music reduces eye movements. Attention, Perception, & Psychophysics, 77, 551–559.
Schooler, J. W., Smallwood, J., Christoff, K., Handy, T. C., Reichle, E. D., & Sayette, M. A. (2011). Meta-awareness, perceptual decoupling and the wandering mind. Trends in cognitive sciences, 15, 319–326.
pubmed: 21684189
Shinoda, H., Hayhoe, M. M., & Shrivastava, A. (2001). What controls attention in natural environments? Vision Research, 41, 3535–3545.
pubmed: 11718793
Shultz, S., Klin, A., & Jones, W. (2011). Inhibition of eye blinking reveals subjective perceptions of stimulus salience. Proceedings of the National Academy of Sciences, 108, 21270–21275.
Smallwood, J. (2013). Distinguishing how from why the mind wanders: a process–occurrence framework for self-generated mental activity. Psychological bulletin, 139, 519.
pubmed: 23607430
Smallwood, J., & Schooler, J. W. (2006). The restless mind. Psychological Bulletin, 132, 946.
pubmed: 17073528
Smilek, D., Carriere, J. S., & Cheyne, J. A. (2010). Out of mind, out of sight: Eye blinking as indicator and embodiment of mind wandering. Psychological Science, 21, 786 –789
pubmed: 20554601
Taruffi, L., Pehrs, C., Skouras, S., & Koelsch, S. (2017). Effects of sad and happy music on mind-wandering and the default mode network. Scientific Reports, 7, Article 14396.
pubmed: 29089542
Tatler, B. W., Brockmole, J. R., & Carpenter, R. H. S. (2017). LATEST: A Model of Saccadic Decisions in Space and Time. Psychological Review, 124, 267–300.
pubmed: 28358564
Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychological Review, 113, 766.
pubmed: 17014302
Ünal, A. B., Steg, L., & Epstude, K. (2012). The influence of music on mental effort and driving performance. Accident Analysis & Prevention, 48, 271–278.
Uzzaman, S., & Joordens, S. (2011). The eyes know what you are thinking: Eye movements as an objective measure of mind wandering. Consciousness and Cognition, 20, 1882–1886.
pubmed: 21968150
Valtchanov, D., & Ellard, C. G., (2015). Cognitive and affective responses to natural scenes: Effects of low level visual properties on preference, cognitive load, and eye-movements. Journal of Environmental Psychology, 43, 184–195.
Võ, M. L. H., & Henderson, J. M. (2009). Does gravity matter? Effects of semantic and syntactic inconsistencies on the allocation of attention during scene perception. Journal of Vision, 9, 24–24.
pubmed: 19757963
Wallengren, A.-K., & Strukelj, A. (2015). Film music and visual attention: A pilot experiment using eye-tracking. Music and the Moving Image, 8, 69–80.
Walther, D. & Koch, C. (2006). Modeling attention to salient proto-objects. Neural Networks, 19, 1395–1407.
pubmed: 17098563
Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E. J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, 291–298.
pubmed: 26168519
Yarbus, A. L. (1967). Eye movements during perception of complex objects. Plenum.
Zhang, H., Anderson, N. C., & Miller, K. F. (2020). Refixation patterns of mind-wandering during real-world scene perception. Journal of Experimental Psychology: Human Perception and Performance, 47(1), 36–52. https://doi.org/10.1037/xhp0000877
doi: 10.1037/xhp0000877
pubmed: 32969691