Visual exploration dynamics are low-dimensional and driven by intrinsic factors.
Journal
Communications biology
ISSN: 2399-3642
Titre abrégé: Commun Biol
Pays: England
ID NLM: 101719179
Informations de publication
Date de publication:
17 09 2021
17 09 2021
Historique:
received:
25
02
2021
accepted:
17
08
2021
entrez:
18
9
2021
pubmed:
19
9
2021
medline:
15
12
2021
Statut:
epublish
Résumé
When looking at visual images, the eyes move to the most salient and behaviourally relevant objects. Saliency and semantic information significantly explain where people look. Less is known about the spatiotemporal properties of eye movements (i.e., how people look). We show that three latent variables explain 60% of eye movement dynamics of more than a hundred observers looking at hundreds of different natural images. The first component explaining 30% of variability loads on fixation duration, and it does not relate to image saliency or semantics; it approximates a power-law distribution of gaze steps, an intrinsic dynamic measure, and identifies observers with two viewing styles: static and dynamic. Notably, these viewing styles were also identified when observers look at a blank screen. These results support the importance of endogenous processes such as intrinsic dynamics to explain eye movement spatiotemporal properties.
Identifiants
pubmed: 34535744
doi: 10.1038/s42003-021-02608-x
pii: 10.1038/s42003-021-02608-x
pmc: PMC8448835
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
1100Subventions
Organisme : Fundação Bial (Bial Foundation)
ID : 361/18
Organisme : Fundação Bial (Bial Foundation)
ID : 361/18
Informations de copyright
© 2021. The Author(s).
Références
Itti, L., Koch, C. & Niebur, E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 1254–1259, 1254–1259 (1998).
doi: 10.1109/34.730558
Carmi, R. & Itti, L. Visual causes versus correlates of attentional selection in dynamic scenes. Vis. Res. 46, 4333–4345 (2006).
pubmed: 17052740
doi: 10.1016/j.visres.2006.08.019
Elazary, L. & Itti, L. Interesting objects are visually salient. J. Vis. 8, 1–15 (2008).
pubmed: 18484809
doi: 10.1167/8.3.3
Wolfe, J. M. Guided Search 2.0 A revised model of visual search. Psychon. Bull. Rev. 1, 202–238 (1994).
pubmed: 24203471
doi: 10.3758/BF03200774
Yarbus, A. L. Eye Movements and Vision (Plenum Press, 1967).
Torralba, A., Oliva, A., Castelhano, M. S. & Henderson, J. M. Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychol. Rev. 113, 766–786 (2006).
pubmed: 17014302
doi: 10.1037/0033-295X.113.4.766
Itti, L. Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Vis. Cogn. 12, 1093–1123 (2005).
doi: 10.1080/13506280444000661
Kümmerer, M., Wallis, T. S. A. & Bethge, M. Information-theoretic model comparison unifies saliency metrics. Proc. Natl Acad. Sci. USA 112, 16054–16059 (2015).
pubmed: 26655340
pmcid: 4702965
doi: 10.1073/pnas.1510393112
Poynter, W., Barber, M., Inman, J. & Wiggins, C. Individuals exhibit idiosyncratic eye-movement behavior profiles across tasks. Vis. Res. 89, 32–38 (2013).
pubmed: 23867568
doi: 10.1016/j.visres.2013.07.002
Andrews, T. J. & Coppola, D. M. Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments. Vis. Res. 39, 2947–2953 (1999).
pubmed: 10492820
doi: 10.1016/S0042-6989(99)00019-X
Castelhano, M. S. & Henderson, J. M. Stable individual differences across images in human saccadic eye movements. Can. J. Exp. Psychol. Can. Psychol. Exp.érimentale 62, 1–14 (2008).
doi: 10.1037/1196-1961.62.1.1
Boot, W. R., Becic, E. & Kramer, A. F. Stable individual differences in search strategy? The effect of task demands and motivational factors on scanning strategy in visual search. J. Vis. 9, 7–7 (2009).
pubmed: 19757946
doi: 10.1167/9.3.7
Rayner, K., Li, X., Williams, C. C., Cave, K. R. & Well, A. D. Eye movements during information processing tasks: individual differences and cultural effects. Vis. Res. 47, 2714–2726 (2007).
pubmed: 17614113
doi: 10.1016/j.visres.2007.05.007
Privitera, C. M. & Stark, L. W. Algorithms for defining visual regions-of-interest: comparison with eye fixations. IEEE Trans. Pattern Anal. Mach. Intell. 22, 970–982 (2000).
doi: 10.1109/34.877520
Bargary, G. et al. Individual differences in human eye movements: an oculomotor signature? Vis. Res. 141, 157–169 (2017).
pubmed: 28373058
doi: 10.1016/j.visres.2017.03.001
Hoppe, S., Loetscher, T., Morey, S. A. & Bulling, A. Eye movements during everyday behavior predict personality traits. Front. Hum. Neurosci. 12, 105 (2018).
Kennedy, D. P. et al. Genetic influence on eye movements to complex scenes at short timescales. Curr. Biol. 27, 3554–3560.e3 (2017).
pubmed: 29129535
pmcid: 5875185
doi: 10.1016/j.cub.2017.10.007
Stephen, D. G. & Mirman, D. Interactions dominate the dynamics of visual cognition. Cognition 115, 154–165 (2010).
pubmed: 20070957
pmcid: 2830330
doi: 10.1016/j.cognition.2009.12.010
Christensen, K., Danon, L., Scanlon, T. & Bak, P. Unified scaling law for earthquakes. Proc. Natl Acad. Sci. USA 99, 2509–2513 (2002).
pubmed: 11875203
pmcid: 128569
doi: 10.1073/pnas.012581099
Papale, P. Global time-size distribution of volcanic eruptions on Earth. Sci. Rep. 8, 6838 (2018).
pubmed: 29717232
pmcid: 5931572
doi: 10.1038/s41598-018-25286-y
Gabaix, X. Power Laws in economics: an introduction. J. Econ. Perspect. 30, 185–206 (2016).
doi: 10.1257/jep.30.1.185
Austin, D., Bowen, W. D. & McMillan, J. I. Intraspecific variation in movement patterns: modeling individual behaviour in a large marine predator. Oikos 105, 15–30 (2004).
doi: 10.1111/j.0030-1299.1999.12730.x
Ramos-Fernández, G. et al. Lévy walk patterns in the foraging movements of spider monkeys (Ateles geoffroyi). Behav. Ecol. Sociobiol. 55, 223–230 (2004).
doi: 10.1007/s00265-003-0700-6
Plenz, D. & Thiagarajan, T. C. The organizing principles of neuronal avalanches: cell assemblies in the cortex? Trends Neurosci. 30, 101–110 (2007).
pubmed: 17275102
doi: 10.1016/j.tins.2007.01.005
He, B. J. Scale-free brain activity: past, present, and future. Trends Cogn. Sci. 18, 480–487 (2014).
pubmed: 24788139
pmcid: 4149861
doi: 10.1016/j.tics.2014.04.003
Tomasi, D. G., Shokri-Kojori, E. & Volkow, N. D. Brain network dynamics adhere to a power law. Front. Neurosci. 11, 72 (2017).
Bullmore, E. & Sporns, O. Complex brain networks: graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10, 186–198 (2009).
pubmed: 19190637
doi: 10.1038/nrn2575
Zhou, B., Lapedriza, A., Khosla, A., Oliva, A. & Torralba, A. Places: a 10 million image database for scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40, 1452–1464 (2018).
pubmed: 28692961
doi: 10.1109/TPAMI.2017.2723009
Choe, K. W., Blake, R. & Lee, S.-H. Pupil size dynamics during fixation impact the accuracy and precision of video-based gaze estimation. Vis. Res. 118, 48–59 (2016).
pubmed: 25578924
doi: 10.1016/j.visres.2014.12.018
Wang, C.-A. & Munoz, D. P. Coordination of pupil and saccade responses by the superior colliculus. J. Cogn. Neurosci. 33, 919–932 (2021).
pubmed: 34449845
doi: 10.1162/jocn_a_01688
Joshi, S., Li, Y., Kalwani, R. M. & Gold, J. I. Relationships between pupil diameter and neuronal activity in the Locus Coeruleus, Colliculi, and Cingulate cortex. Neuron 89, 221–234 (2016).
pubmed: 26711118
doi: 10.1016/j.neuron.2015.11.028
Katsini, C., Fidas, C., Belk, M., Avouris, N. & Samaras, G. Influences of users’ cognitive strategies on graphical password composition. in Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems—CHI EA ’17 2698–2705 (ACM Press, 2017).
Shiferaw, B., Downey, L. & Crewther, D. A review of gaze entropy as a measure of visual scanning efficiency. Neurosci. Biobehav. Rev. 96, 353–366 (2019).
pubmed: 30621861
doi: 10.1016/j.neubiorev.2018.12.007
Wallot, S. & Kelty-Stephen, D. Constraints are the solution, not the problem. Front. Hum. Neurosci. 8, 324 (2014).
Rhodes, T., Kello, C. T. & Kerster, B. Intrinsic and extrinsic contributions to heavy tails in visual foraging. Vis. Cogn. 22, 809–842 (2014).
doi: 10.1080/13506285.2014.918070
Isaacowitz, D. M. The gaze of the optimist. Personal. Soc. Psychol. Bull. 31, 407–415 (2005).
doi: 10.1177/0146167204271599
Rauthmann, J. F., Seubert, C. T., Sachse, P. & Furtner, M. R. Eyes as windows to the soul: gazing behavior is related to personality. J. Res. Pers. 46, 147–156 (2012).
doi: 10.1016/j.jrp.2011.12.010
Risko, E. F. & Kingstone, A. Eyes wide shut: implied social presence, eye tracking, and attention. Atten., Percept., Psychophys. 73, 291–296 (2011).
doi: 10.3758/s13414-010-0042-1
Baranes, A., Oudeyer, P.-Y. & Gottlieb, J. Eye movements reveal epistemic curiosity in human observers. Vis. Res. 117, 81–90 (2015).
pubmed: 26518743
doi: 10.1016/j.visres.2015.10.009
Wallot, S., Coey, C. A. & Richardson, M. J. Interdependence of saccadic and fixational fluctuations. Ecol. Psychol. 27, 68–86 (2015).
doi: 10.1080/10407413.2015.991666
Krauzlis, R. J. The control of voluntary eye movements: new perspectives. Neuroscientist 11, 124–137 (2005).
pubmed: 15746381
doi: 10.1177/1073858404271196
Krauzlis, R. J., Bollimunta, A., Arcizet, F. & Wang, L. Attention as an effect not a cause. Trends Cogn. Sci. 18, 457–464 (2014).
pubmed: 24953964
pmcid: 4186707
doi: 10.1016/j.tics.2014.05.008
Krauzlis, R. J., Goffart, L. & Hafed, Z. M. Neuronal control of fixation and fixational eye movements. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 372, 20160205 (2017).
Corbetta, M. & Shulman, G. L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201–215 (2002).
pubmed: 11994752
doi: 10.1038/nrn755
Corbetta, M., Patel, G. & Shulman, G. L. The reorienting system of the human brain: from environment to theory of mind. Neuron 58, 306–324 (2008).
pubmed: 18466742
pmcid: 2441869
doi: 10.1016/j.neuron.2008.04.017
Munoz, D. P., Armstrong, I. T., Hampton, K. A. & Moore, K. D. Altered control of visual fixation and saccadic eye movements in attention-deficit hyperactivity disorder. J. Neurophysiol. 90, 503–514 (2003).
pubmed: 12672781
doi: 10.1152/jn.00192.2003
Pappalardo, L. et al. Returners and explorers dichotomy in human mobility. Nat. Commun. 6, 8166 (2015).
pubmed: 26349016
doi: 10.1038/ncomms9166
Cona, G. et al. Archetypes of human cognition defined by time preference for reward and their brain correlates: an evolutionary trade-off approach. Neuroimage 185, 322–334 (2019).
pubmed: 30355533
doi: 10.1016/j.neuroimage.2018.10.050
Gallagher, T., Bjorness, T., Greene, R., You, Y.-J. & Avery, L. The geometry of locomotive behavioral states in C. elegans. PLoS One 8, e59865 (2013).
pubmed: 23555813
pmcid: 3610905
doi: 10.1371/journal.pone.0059865
Szekely, P., Korem, Y., Moran, U., Mayo, A. & Alon, U. The mass-longevity triangle: Pareto optimality and the geometry of life-history trait space. PLoS Comput. Biol. 11, e1004524 (2015).
pubmed: 26465336
pmcid: 4605829
doi: 10.1371/journal.pcbi.1004524
Foulsham, T. & Underwood, G. What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. J. Vis. 8, 6 (2008).
pubmed: 18318632
doi: 10.1167/8.2.6
Parkhurst, D., Law, K. & Niebur, E. Modeling the role of salience in the allocation of overt visual attention. Vis. Res. 42, 107–123 (2002).
pubmed: 11804636
doi: 10.1016/S0042-6989(01)00250-4
Koehler, K., Guo, F., Zhang, S. & Eckstein, M. P. What do saliency models predict? J. Vis. 14, 14–14 (2014).
pubmed: 24618107
pmcid: 3954044
doi: 10.1167/14.3.14
Linkenkaer-Hansen, K., Nikouline, V. V., Palva, J. M. & Ilmoniemi, R. J. Long-range temporal correlations and scaling behavior in human brain oscillations. J. Neuroscience 21, 1370–1377 (2001).
doi: 10.1523/JNEUROSCI.21-04-01370.2001
He, B. J., Zempel, J. M., Snyder, A. Z. & Raichle, M. E. The temporal structures and functional significance of scale-free brain activity. Neuron 66, 353–369 (2010).
pubmed: 20471349
pmcid: 2878725
doi: 10.1016/j.neuron.2010.04.020
Shriki, O. et al. Neuronal avalanches in the resting MEG of the human brain. J. Neurosci. 33, 7079–7090 (2013).
pubmed: 23595765
pmcid: 3665287
doi: 10.1523/JNEUROSCI.4286-12.2013
Palva, J. M. et al. Neuronal long-range temporal correlations and avalanche dynamics are correlated with behavioral scaling laws. Proc. Natl Acad. Sci. USA 110, 3585–3590 (2013).
pubmed: 23401536
pmcid: 3587255
doi: 10.1073/pnas.1216855110
de Haas, B., Iakovidis, A. L., Schwarzkopf, D. S. & Gegenfurtner, K. R. Individual differences in visual salience vary along semantic dimensions. Proc. Natl. Acad. Sci. USA https://doi.org/10.1073/pnas.1820553116 (2019).
Smith, S. M. et al. Correspondence of the brain’s functional architecture during activation and rest. Proc. Natl Acad. Sci. USA 106, 13040–13045 (2009).
pubmed: 19620724
pmcid: 2722273
doi: 10.1073/pnas.0905267106
Cole, M. W., Bassett, D. S., Power, J. D., Braver, T. S. & Petersen, S. E. Intrinsic and task-evoked network architectures of the human brain. Neuron 83, 238–251 (2014).
pubmed: 24991964
pmcid: 4082806
doi: 10.1016/j.neuron.2014.05.014
Betti, V. et al. Natural scenes viewing alters the dynamics of functional connectivity in the human brain. Neuron 79, 782–797 (2013).
pubmed: 23891400
pmcid: 3893318
doi: 10.1016/j.neuron.2013.06.022
Spadone, S. et al. Dynamic reorganization of human resting-state networks during visuospatial attention. Proc. Natl Acad. Sci. USA 112, 8112–8117 (2015).
pubmed: 26080395
pmcid: 4491799
doi: 10.1073/pnas.1415439112
Berkes, P., Orban, G., Lengyel, M. & Fiser, J. Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331, 83–87 (2011).
pubmed: 21212356
pmcid: 3065813
doi: 10.1126/science.1195870
Raichle, M. E. The restless brain. Brain Connect 1, 3–12 (2011).
pubmed: 22432951
pmcid: 3621343
doi: 10.1089/brain.2011.0019
Clemens, I. A. H., Selen, L. P. J., Pomante, A., MacNeilage, P. R. & Medendorp, W. P. Eye movements in darkness modulate self-motion perception. Eneuro 4, ENEURO.0211–16.2016 (2017).
doi: 10.1523/ENEURO.0211-16.2016
Johansson, R., Holsanova, J., Dewhurst, R. & Holmqvist, K. Eye movements during scene recollection have a functional role, but they are not reinstatements of those produced during encoding. J. Exp. Psychol. Hum. Percept. Perform. 38, 1289–1314 (2012).
pubmed: 22201467
doi: 10.1037/a0026585
Johansson, R. & Johansson, M. Look here, eye movements play a functional role in memory retrieval. Psychol. Sci. 25, 236–242 (2014).
pubmed: 24166856
doi: 10.1177/0956797613498260
Altmann, G. T. M. Language-mediated eye movements in the absence of a visual world: the ‘blank screen paradigm. Cognition 93, B79–B87 (2004).
pubmed: 15147941
doi: 10.1016/j.cognition.2004.02.005
Van Someren, E. J. W., Van Der Werf, Y. D., Roelfsema, P. R., Mansvelder, H. D. & Lopes da Silva, F. H. Slow brain oscillations of sleep, resting state, and vigilance. Prog. Brain Res. https://doi.org/10.1016/B978-0-444-53839-0.00001-6 (2011).
Anderson, T. J. & MacAskill, M. R. Eye movements in patients with neurodegenerative disorders. Nat. Rev. Neurol. 9, 74–85 (2013).
pubmed: 23338283
doi: 10.1038/nrneurol.2012.273
Fraser, K. C., Lundholm Fors, K., Kokkinakis, D. & Nordlund, A. An analysis of eye-movements during reading for the detection of mild cognitive impairment. in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing 1016–1026 (Association for Computational Linguistics, 2017).
Biondi, J., Fernandez, G., Castro, S. & Agamennoni, O. Eye movement behavior identification for Alzheimer’s disease diagnosis. J. Integr. Neurosci. 17, 349–354 (2018).
Cirilli, L., de Timary, P., Lefèvre, P. & Missal, M. Individual differences in impulsivity predict anticipatory eye movements. PLoS One 6, e26699 (2011).
pubmed: 22046334
pmcid: 3202566
doi: 10.1371/journal.pone.0026699
Monaco, M., Costa, A., Caltagirone, C. & Carlesimo, G. A. Forward and backward span for verbal and visuo-spatial data: standardization and normative data from an Italian adult population. Neurol. Sci. 34, 749–754 (2013).
pubmed: 22689311
doi: 10.1007/s10072-012-1130-x
Venneri, A. et al. Shortened stroop color-word test: its application in normal aging and Alzheimer’s disease. Neurobiol. Aging 13, S3–S4 (1992).
doi: 10.1016/0197-4580(92)90135-K
Rey, A. & Osterrieth, P. A. Translations of excerpts from Andre Rey"s Psychological examination of traumatic encephalopathy and P. A. Osterrieth"s The Complex Figure Copy Test. Clin. Neuropsychol. 7, 4–21 (1993).
McCrae, R. R. & Costa, P. T. Validation of the five-factor model of personality across instruments and observers. J. Pers. Soc. Psychol. 52, 81–90 (1987).
pubmed: 3820081
doi: 10.1037/0022-3514.52.1.81
Costa, P. T. & McCrae, R. R. NEO PI/FFI Manual Supplement for Use with the NEO Personality Inventory and the NEO Five-Factor Inventory. Odessa, FL.: Psychological Assessment Resources (1989).
Mercer Moss, F. J., Baddeley, R. & Canagarajah, N. Eye movements to natural images as a function of sex and personality. PLoS One 7, e47870 (2012).
pubmed: 23248740
pmcid: 3511485
doi: 10.1371/journal.pone.0047870
Carver, C. S. & White, T. L. Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS Scales. J. Pers. Soc. Psychol. 67, 319–333 (1994).
doi: 10.1037/0022-3514.67.2.319
Lovibond, P. F. & Lovibond, S. H. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav. Res. Ther. 33, 335–343 (1995).
pubmed: 7726811
doi: 10.1016/0005-7967(94)00075-U
Vater, C., Roca, A. & Williams, A. M. Effects of anxiety on anticipation and visual search in dynamic, time-constrained situations. Sport. Exerc. Perform. Psychol. 5, 179–192 (2016).
Engbert, R. & Kliegl, R. Microsaccades uncover the orientation of covert attention. Vis. Res. 43, 1035–1045 (2003).
pubmed: 12676246
doi: 10.1016/S0042-6989(03)00084-1
Stuart, S. et al. Eye-tracker algorithms to detect saccades during static and dynamic tasks: a structured review. Physiol. Meas. https://doi.org/10.1088/1361-6579/ab02ab (2019).
doi: 10.1088/1361-6579/ab02ab
pubmed: 31567124
pmcid: 8072263
Just, M. A. & Carpenter, P. A. A theory of reading: from eye fixations to comprehension. Psychol. Rev. 87, 329–354 (1980).
pubmed: 7413885
doi: 10.1037/0033-295X.87.4.329
Unsworth, N. & Robison, M. K. Pupillary correlates of lapses of sustained attention. Cogn. Affect. Behav. Neurosci. 16, 601–615 (2016).
pubmed: 27038165
doi: 10.3758/s13415-016-0417-4
Krejtz, K., Duchowski, A. T., Niedzielska, A., Biele, C. & Krejtz, I. Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze. PLoS One 13, e0203629 (2018).
pubmed: 30216385
pmcid: 6138399
doi: 10.1371/journal.pone.0203629
Kaiser, H. F. The application of electronic computers to factor analysis. Educ. Psychol. Meas. 20, 141–151 (1960).
doi: 10.1177/001316446002000116
Rousseeuw, P. J. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987).
doi: 10.1016/0377-0427(87)90125-7
Clauset, A., Shalizi, C. R. & Newman, M. E. J. Power-law distributions in empirical data. SIAM Rev. 51, 661–703 (2009).
doi: 10.1137/070710111
Harel, J., Koch, C. & Perona, P. Graph-Based Visual Saliency (2006).