How Reliably Do Eye Parameters Indicate Internal Versus External Attentional Focus?
Eye behavior
Fixation disparity
Internal attentional focus
Internally directed cognition
LSTM
Machine learning
Microsaccades
Pupillometry
Journal
Cognitive science
ISSN: 1551-6709
Titre abrégé: Cogn Sci
Pays: United States
ID NLM: 7708195
Informations de publication
Date de publication:
04 2021
04 2021
Historique:
revised:
15
03
2021
received:
23
10
2020
accepted:
19
03
2021
entrez:
20
4
2021
pubmed:
21
4
2021
medline:
18
9
2021
Statut:
ppublish
Résumé
Eye behavior is increasingly used as an indicator of internal versus external focus of attention both in research and application. However, available findings are partly inconsistent, which might be attributed to the different nature of the employed types of internal and external cognition tasks. The present study, therefore, investigated how consistently different eye parameters respond to internal versus external attentional focus across three task modalities: numerical, verbal, and visuo-spatial. Three eye parameters robustly differentiated between internal and external attentional focus across all tasks. Blinks, pupil diameter variance, and fixation disparity variance were consistently increased during internally directed attention. We also observed substantial attentional focus effects on other parameters (pupil diameter, fixation disparity, saccades, and microsaccades), but they were moderated by task type. Single-trial analysis of our data using machine learning techniques further confirmed our results: Classifying the focus of attention by means of eye tracking works well across participants, but generalizing across tasks proves to be challenging. Based on the effects of task type on eye parameters, we discuss what eye parameters are best suited as indicators of internal versus external attentional focus in different settings.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e12977Subventions
Organisme : Austrian Science Fund FWF
ID : P 29801
Pays : Austria
Informations de copyright
© 2021 The Authors. Cognitive Science published by Wiley Periodicals LLC on behalf of Cognitive Science Society (CSS).
Références
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., … Zheng, X. (2015). TensorFlow: Large-scale machine learning on heterogeneous systems. https://arxiv.org/abs/1603.04467.
Ahn, S., Kelton, C., Balasubramanian, A., & Zelinsky, G. (2020). Towards predicting reading comprehension from gaze behavior. ACM Symposium on Eye Tracking Research and Applications, 1-5. https://doi.org/10.1145/3379156.3391335
Alghofaili, R., Sawahata, Y., Huang, H., Wang, H.-C., Shiratori, T., & Yu, L.-F. (2019). Lost in style: Gaze-driven adaptive aid for VR navigation. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1-12. https://doi.org/10.1145/3290605.3300578
Annerer-Walcher, S., Körner, C., Beaty, R. E., & Benedek, M. (2020). Eye behavior predicts susceptibility to visual distraction during internally directed cognition. Attention, Perception, & Psychophysics, 82, 3432-3444. https://doi.org/10.3758/s13414-020-02068-1
Annerer-Walcher, S., Körner, C., & Benedek, M. (2018). Eye behavior does not adapt to expected visual distraction during internally directed cognition. PLoS One, 13(9). https://doi.org/10.1371/journal.pone.0204963
Beaty, R. E., Thakral, P. P., Madore, K. P., Benedek, M., & Schacter, D. L. (2018). Core network contributions to remembering the past, imagining the future, and thinking creatively. Journal of Cognitive Neuroscience, 30(12), 1939-1951. https://doi.org/10.1162/jocn_a_01327
Benedek, M., Stoiser, R., Walcher, S., & Körner, C. (2017). Eye behavior associated with internally versus externally directed cognition. Frontiers in Psychology, 8, 1092. https://doi.org/10.3389/fpsyg.2017.01092
Berkovsky, S., Taib, R., Koprinska, I., Wang, E., Zeng, Y., Li, J., & Kleitman, S. (2019). Detecting personality traits using eye-tracking data. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1-12. https://doi.org/10.1145/3290605.3300451
Berman, B. D., Horovitz, S. G., Morel, B., & Hallett, M. (2012). Neural correlates of blink suppression and the buildup of a natural bodily urge. NeuroImage, 59(2), 1441-1450. https://doi.org/10.1016/j.neuroimage.2011.08.050
Ceh, S. M., Annerer-Walcher, S., Körner, C., Rominger, C., Kober, S. E., Fink, A., & Benedek, M. (2020). Neurophysiological indicators of internal attention: An electroencephalography-eye-tracking coregistration study. Brain and Behavior, 10, e01790. https://doi.org/10.1002/brb3.1790
Chollet, F. (2015). Keras (2.1.5) [Python]. Retrieved from https://github.com/fchollet/keras
Chun, M. M., Golomb, J. D., & Turk-Browne, N. B. (2011). A taxonomy of external and internal attention. Annual Review of Psychology, 62(1), 73-101. https://doi.org/10.1146/annurev.psych.093008.100427
Engbert, R., Sinn, P., Mergenthaler, K., & Trukenbrod, H. (2015). Microsaccade Toolbox for R. Retrieved from http://read.psych.uni-potsdam.de/index.php?option=com_content&view=article&id=140:eNgbert-et-al-2015-microsaccade-toolbox-for-r&catid=26:pUblications&Itemid=34
Ferreira, F., Apel, J., & Henderson, J. M. (2008). Taking a new look at looking at nothing. Trends in Cognitive Sciences, 12(11), 405-410. https://doi.org/10.1016/j.tics.2008.07.007
Fox, J., & Weisberg, S. (2011). An R companion to applied regression (2nd ed.). Thousand Oaks, CA: Sage.
Franklin, M. S., Broadway, J. M., Mrazek, M. D., Smallwood, J., & Schooler, J. W. (2013). Window to the wandering mind: Pupillometry of spontaneous thought while reading. Quarterly Journal of Experimental Psychology, 66(12), 2289-2294. https://doi.org/10.1080/17470218.2013.858170
Fukuda, K. (2001). Eye blinks: New indices for the detection of deception. International Journal of Psychophysiology, 40(3), 239-245. https://doi.org/10.1016/S0167-8760(00)00192-6
Gao, X., Yan, H., & Sun, H.-J. (2015). Modulation of microsaccade rate by task difficulty revealed through between- and within-trial comparisons. Journal of Vision, 15(3), 1-15. https://doi.org/10.1167/15.3.3
Grandchamp, R., Braboszcz, C., & Delorme, A. (2014). Oculometric variations during mind wandering. Frontiers in Psychology, 5, 31. https://doi.org/10.3389/fpsyg.2014.00031
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735-1780. https://doi.org/10.1162/neco.1997.9.8.1735
Hope, R. M. (2013). Rmisc: Ryan miscellaneous. Retrieved from https://CRAN.R-project.org/package=Rmisc
Huang, M. X., Li, J., Ngai, G., Leong, H. V., & Bulling, A. (2019). Moment-to-moment detection of internal thought from eye vergence behavior. https://arxiv.org/abs/1901.06572.
Johansson, R., Holsanova, J., & Holmqvist, K. (2006). Pictures and spoken descriptions elicit similar eye movements during mental imagery, both in light and in complete darkness. Cognitive Science, 30(6), 1053-1079. https://doi.org/10.1207/s15516709cog0000_86
Jubera-García, E., Gevers, W., & Van Opstal, F. (2020). Influence of content and intensity of thought on behavioral and pupil changes during active mind-wandering, off-focus, and on-task states. Attention, Perception, & Psychophysics, 82(3), 1125-1135. https://doi.org/10.3758/s13414-019-01865-7
Killingsworth, M. A., & Gilbert, D. T. (2010). A wandering mind is an unhappy mind. Science, 330(6006), 932-932. https://doi.org/10.1126/science.1192439
Konishi, M., Brown, K., Battaglini, L., & Smallwood, J. (2017). When attention wanders: Pupillometric signatures of fluctuations in external attention. Cognition, 168, 16-26. https://doi.org/10.1016/j.cognition.2017.06.006
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13). https://doi.org/10.18637/jss.v082.i13
Laeng, B., & Sulutvedt, U. (2014). The eye pupil adjusts to imaginary light. Psychological Science, 25(1), 188-197. https://doi.org/10.1177/0956797613503556
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444. https://doi.org/10.1038/nature14539
Makovac, E., Fagioli, S., Watson, D. R., Meeten, F., Smallwood, J., Critchley, H. D., & Ottaviani, C. (2019). Response time as a proxy of ongoing mental state: A combined fMRI and pupillometry study in generalized anxiety disorder. NeuroImage, 191, 380-391. https://doi.org/10.1016/j.neuroimage.2019.02.038
Martinez-Conde, S., Macknik, S. L., Troncoso, X. G., & Hubel, D. H. (2009). Microsaccades: A neurophysiological analysis. Trends in Neurosciences, 32(9), 463-475. https://doi.org/10.1016/j.tins.2009.05.006
Martinez-Conde, S., Otero-Millan, J., & Macknik, S. L. (2013). The impact of microsaccades on vision: Towards a unified theory of saccadic function. Nature Reviews Neuroscience, 14(2), 83-96. https://doi.org/10.1038/nrn3405
The Matplotlib Development Team. (2020). Matplotlib. Retrieved from https://matplotlib.org/
Morey, R. D., & Rouder, J. N. (2018). BayesFactor: Computation of Bayes Factors for common designs. . R package version 0.9.12-4.2. Retrieved from https://cran.r-project.org/package=BayesFactor
Myers, G. A., & Stark, L. (1990). Topology of the near response triad. Ophthalmic & Physiological Optics: The Journal of the British College of Ophthalmic Opticians (Optometrists), 10(2), 175-181.
NumPy. (2020). NumPy. Retrieved from https://numpy.org/
Palinko, O., Kun, A. L., Shyrokov, A., & Heeman, P. (2010). Estimating cognitive load using remote eye tracking in a driving simulator. Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications - ETRA ’10.
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., … Duchesnay, E. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825-2830.
Peirce, J. W. (2007). PsychoPy-Psychophysics software in Python. Journal of Neuroscience Methods, 162(1-2), 8-13. https://doi.org/10.1016/j.jneumeth.2006.11.017
Pelagatti, C., Binda, P., & Vannucci, M. (2018). Tracking the dynamics of mind wandering: Insights from pupillometry. Journal of Cognition, 1(1). https://doi.org/10.5334/joc.41
Piquado, T., Isaacowitz, D., & Wingfield, A. (2010). Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology, 47(3), 560-569. https://doi.org/10.1111/j.1469-8986.2009.00947.x
Poletti, M., & Rucci, M. (2016). A compact field guide to the study of microsaccades: Challenges and functions. Vision Research, 118, 83-97. https://doi.org/10.1016/j.visres.2015.01.018
Putze, F., Scherer, M., Schultz, T., Putze, F., Scherer, M., & Schultz, T. (2016). Starring into the void? Classifying internal vs. external attention from EEG. Proceedings of 9th Nordic Conference on Human-Computer Interaction (NordiCHI), 1-4.
Python Software Foundation. (2020). Opencv-python. Retrieved from https://pypi.org/project/opencv-python/
The Python Software Foundation. (2020). Python. Retrieved from https://www.python.org/
R Core Team. (2020). R: A language and environment for statistical computing. Retrieved from https://www.R-project.org/
RStudio Team. (2020). RStudio: Integrated development for R. RStudio. Retrieved from http://www.rstudio.com/
Salvi, C., Bricolo, E., Franconeri, S. L., Kounios, J., & Beeman, M. (2015). Sudden insight is associated with shutting out visual inputs. Psychonomic Bulletin & Review, 22(6), 1814-1819. https://doi.org/10.3758/s13423-015-0845-0
Schacter, D. L., Addis, D. R., & Buckner, R. L. (2007). Remembering the past to imagine the future: The prospective brain. Nature Reviews Neuroscience, 8(9), 657-661. https://doi.org/10.1038/nrn2213
The SciPy Community. (2020). SciPy [Python]. Retrieved from https://www.scipy.org/
Shin, Y. S., Chang, W. D., Park, J., Im, C. H., Lee, S. I., Kim, I. Y., & Jang, D. P. (2015). Correlation between inter-blink interval and episodic encoding during movie watching. PLoS One, 10(11), e0141242. https://doi.org/10.1371/journal.pone.0141242
Shultz, S., Klin, A., & Jones, W. (2011). Inhibition of eye blinking reveals subjective perceptions of stimulus salience. Proceedings of the National Academy of Sciences, 108(52), 21270-21275. https://doi.org/10.1073/pnas.1109304108
Siegenthaler, E., Costela, F. M., Mccamy, M. B., Di Stasi, L. L., Otero-Millan, J., Sonderegger, A., … Martinez-Conde, S. (2014). Task difficulty in mental arithmetic affects microsaccadic rates and magnitudes. European Journal of Neuroscience, 39(2), 287-294. https://doi.org/10.1111/ejn.12395
Sims, S. (2020). A neural architecture for detecting user confusion in eye-tracking data.. University of British Columbia.
Smallwood, J., Brown, K. S., Tipper, C., Giesbrecht, B., Franklin, M. S., Mrazek, M. D., … Schooler, J. W. (2011). Pupillometric evidence for the decoupling of attention from perceptual input during offline thought. PLoS One, 6(3). https://doi.org/10.1371/journal.pone.0018298
Smallwood, J., & Schooler, J. W. (2006). The restless mind. Psychological Bulletin, 132(6), 946-958. https://doi.org/10.1037/0033-2909.132.6.946
Smilek, D., Carriere, J. S., & Cheyne, J. A. (2010). Out of mind, out of sight: Eye blinking as indicator and embodiment of mind wandering. Psychological Science, 21(6), 786-789. https://doi.org/10.1177/0956797610368063
Startsev, M., Agtzidis, I., & Dorr, M. (2019). 1D CNN with BLSTM for automated classification of fixations, saccades, and smooth pursuits. Behavior Research Methods, 51(2), 556-572. https://doi.org/10.3758/s13428-018-1144-2
Todd, P. M., & Hills, T. T. (2020). Foraging in mind. Current Directions in Psychological Science, 29(3), 309-315. https://doi.org/10.1177/0963721420915861
Tsai, Y.-F., Viirre, E., Strychacz, C., Chase, B., & Jung, T.-P. (2007). Task performance and eye activity: Predicting behavior relating to cognitive workload. Aviation, Space, and Environmental Medicine, 78(5), B176-B185.
Unsworth, N., & Robison, M. K. (2017). The importance of arousal for variation in working memory capacity and attention control: A latent variable pupillometry study. Journal of Experimental Psychology: Learning Memory and Cognition, 43(12), 1962-1987. https://doi.org/10.1037/xlm0000421
Unsworth, N., & Robison, M. K. (2018). Tracking arousal state and mind wandering with pupillometry. Cognitive, Affective and Behavioral Neuroscience, 18(4), 638-664. https://doi.org/10.3758/s13415-018-0594-4
Unsworth, N., Robison, M. K., & Miller, A. L. (2018). Pupillary correlates of fluctuations in sustained attention. Journal of Cognitive Neuroscience, 30(9), 1241-1253. https://doi.org/10.1162/jocn_a_01251
Vortmann, L.-M., Schult, M., Benedek, M., Walcher, S., & Putze, F. (2019). Real-time multimodal classification of internal and external attention. Adjunct of the 2019 International Conference on Multimodal Interaction, 1-7. https://doi.org/10.1145/3351529.3360658
Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14(5), 779-804. https://doi.org/10.3758/BF03194105
Walcher, S., Körner, C., & Benedek, M. (2017). Looking for ideas: Eye behavior during goal-directed internally focused cognition. Consciousness and Cognition, 53, 165-175. https://doi.org/10.1016/j.concog.2017.06.009
Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E.-J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6(3), 291-298. https://doi.org/10.1177/1745691611406923
Wickham, H. (2019). Welcome to the {tidyverse}. Journal of Open Source Software, 4(43), 1686. https://doi.org/10.21105/joss.01686