Expanding horizons of cross-linguistic research on reading: The Multilingual Eye-movement Corpus (MECO).
Journal
Behavior research methods
ISSN: 1554-3528
Titre abrégé: Behav Res Methods
Pays: United States
ID NLM: 101244316
Informations de publication
Date de publication:
12 2022
12 2022
Historique:
accepted:
14
12
2021
pubmed:
4
2
2022
medline:
15
12
2022
entrez:
3
2
2022
Statut:
ppublish
Résumé
Scientific studies of language behavior need to grapple with a large diversity of languages in the world and, for reading, a further variability in writing systems. Yet, the ability to form meaningful theories of reading is contingent on the availability of cross-linguistic behavioral data. This paper offers new insights into aspects of reading behavior that are shared and those that vary systematically across languages through an investigation of eye-tracking data from 13 languages recorded during text reading. We begin with reporting a bibliometric analysis of eye-tracking studies showing that the current empirical base is insufficient for cross-linguistic comparisons. We respond to this empirical lacuna by presenting the Multilingual Eye-Movement Corpus (MECO), the product of an international multi-lab collaboration. We examine which behavioral indices differentiate between reading in written languages, and which measures are stable across languages. One of the findings is that readers of different languages vary considerably in their skipping rate (i.e., the likelihood of not fixating on a word even once) and that this variability is explained by cross-linguistic differences in word length distributions. In contrast, if readers do not skip a word, they tend to spend a similar average time viewing it. We outline the implications of these findings for theories of reading. We also describe prospective uses of the publicly available MECO data, and its further development plans.
Identifiants
pubmed: 35112286
doi: 10.3758/s13428-021-01772-6
pii: 10.3758/s13428-021-01772-6
pmc: PMC8809631
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
2843-2863Informations de copyright
© 2022. The Psychonomic Society, Inc.
Références
Balota, D. A., Yap, M. J., Hutchison, K. A., Cortese, M. J., Kessler, B., Loftis, B., ... & Treiman, R. (2007). The English lexicon project. Behavior Research Methods, 39(3), 445–459.
doi: 10.3758/BF03193014
Beymer, D., & Russell, D. M. (2005). WebGazeAnalyzer: a system for capturing and analyzing web reading behavior using eye gaze. In CHI'05 extended abstracts on Human factors in computing systems (pp. 1913–1916).
Brysbaert, M. (2019). How many words do we read per minute? A review and meta-analysis of reading rate. Journal of Memory and Language, 109, 104047.
doi: 10.1016/j.jml.2019.104047
Brysbaert, M., Drieghe, D., & Vitu, F. (2005). Word skipping: Implications for theories of eye movement control in reading. In G. Underwood (Ed.), Cognitive processes in eye guidance (pp. 53–77). : Oxford University Press.
doi: 10.1093/acprof:oso/9780198566816.003.0003
Brysbaert, M., & Stevens, M. (2018). Power analysis and effect size in mixed effects models: A tutorial. Journal of Cognition, 1(1):9.
doi: 10.5334/joc.10
Carr, J. W., Pescuma, V. N., Furlan, M., Ktori, M., & Crepaldi, D. (2021). Algorithms for the automated correction of vertical drift in eye-tracking data. Behavior Research Methods, 1-24.
Cohen, A. L. (2013). Software for the automatic correction of recorded eye fixation locations in reading experiments. Behavior Research Methods, 45(3), 679–683.
doi: 10.3758/s13428-012-0280-3
Cop, U., Dirix, N., Drieghe, D., & Duyck, W. (2017). Presenting GECO: An eyetracking corpus of monolingual and bilingual sentence reading. Behavior Research Methods, 49(2), 602– 615. Retrieved from http://expsy.ugent.be/downloads/geco/
doi: 10.3758/s13428-016-0734-0
Daniels, P. T., & Bright, W. (Eds.). (1996). The world's writing systems. Oxford University Press on Demand.
Daniels, P. T., & Share, D. L. (2018). Writing system variation and its consequences for reading and dyslexia. Scientific Studies of Reading, 22(1), 101–116.
doi: 10.1080/10888438.2017.1379082
Drieghe, D., Brysbaert, M., Desmet, T., & De Baecke, C. (2004). Word skipping in reading: On the interplay of linguistic and visual factors. European Journal of Cognitive Psychology, 16(1-2), 79–103.
doi: 10.1080/09541440340000141
Dryer, Matthew S. & Haspelmath, Martin (eds.) (2013). The World Atlas of Language Structures Online. Leipzig: Max Planck Institute for Evolutionary Anthropology. (Available online at http://wals.info, Accessed on 2021-08-30.)
Feng, G., Miller, K., Shu, H., & Zhang, H. (2009). Orthography and the development of reading processes: An eye-movement study of Chinese and English. Child Development, 80(3), 720–735.
doi: 10.1111/j.1467-8624.2009.01293.x
Frank, S. L., Monsalve, I. F., Thompson, R. L., & Vigliocco, G. (2013). Reading time data for evaluating broad-coverage models of English sentence processing. Behavior Research Methods, 45(4), 1182–1190.
doi: 10.3758/s13428-012-0313-y
Frost, R. (2012). Towards a universal model of reading. Behavioral and Brain Sciences, 35(5), 263–279.
doi: 10.1017/S0140525X11001841
Fukuda, R., & Fukuda, T. (2009). Comparison of reading capacity for Japanese, German, and English. Perceptual and Motor Skills, 108(1), 281–296.
doi: 10.2466/pms.108.1.281-296
Hagger, M. S., Chatzisarantis, N. L., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., ... & Calvillo, D. P. (2016). A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science, 11(4), 546–573.
doi: 10.1177/1745691616652873
Hothorn, T., Hornik, K., & Zeileis, A. (2006). Unbiased recursive partitioning: A conditional inference framework. Journal of Computational and Graphical statistics, 15(3), 651–674.
doi: 10.1198/106186006X133933
Husain, S., Vasishth, S., & Srinivasan, N. (2014). Integration and prediction difficulty in Hindi sentence comprehension: Evidence from an eye-tracking corpus. Journal of Eye Movement Research, 8(2), 1–12.
doi: 10.16910/jemr.8.2.3
Inhoff, A. W., & Radach, R. (1998). Definition and computation of oculomotor measures in the study of cognitive processes. In: G. Underwood (ed.), Eye Guidance in Reading and Scene Perception, (pp. 29–53). Oxford: Elsevier.
Kennedy, A., Heller, D., Pynte, J., & Radach, R. (Eds.). (2000). Reading as a perceptual process. Elsevier.
doi: 10.1016/B978-008043642-5/50001-2
Keuleers, E., & Balota, D. A. (2015). Megastudies, crowdsourcing, and large datasets in psycholinguistics: An overview of recent developments. Quarterly Journal of Experimental Psychology, 68(8), 1457–1468.
doi: 10.1080/17470218.2015.1051065
Kliegl, R., Grabner, E., Rolfs, M., & Engbert, R. (2004). Length, frequency, and predictability effects of words on eye movements in reading. European Journal of Cognitive Psychology, 16(1-2), 262–284.
doi: 10.1080/09541440340000213
Kliegl, R., Nuthmann, A., & Engbert, R. (2006). Tracking the mind during reading: The influence of past, present, and future words on fixation durations. Journal of Experimental Psychology: General, 135(1), 12.
doi: 10.1037/0096-3445.135.1.12
Koda, K., & Zehler, A. M. (Eds.). (2008). Learning to read across languages: Cross-linguistic relationships in first- and second-language literacy development. Routledge.
doi: 10.4324/9780203935668
Kuperman, V., Matsuki, K., & Van Dyke, J. A. (2018). Contributions of reader- and text-level characteristics to eye-movement patterns during passage reading. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(11), 1687.
Kuperman, V., Siegelman, N., Schroder, S., Acarturk, C., Alexeeva, S, Amenta, S., An, H., Bertram, R., Bondarini, R., Brysbaert, M., Chernova, D., Da Fonesca, S. M., Dirix, N., Duyck, W., Fella, A., Frost, R., Gattei, C., Kalaitzi, A., Kwon, N., Marelli, M., … Usual, K. A. (in press). Text reading in English as a second language: Evidence from the Multilingual Eye Movements Corpus (MECO). Studies in Second Language Acquisition.
Langfelder, P., & Horvath, S. (2012). Fast R functions for robust correlations and hierarchical clustering. Journal of statistical software, 46(11).
Laurinavichyute, A. K., Sekerina, I. A., Alexeeva, S., Bagdasaryan, K., & Kliegl, R. (2019). Russian Sentence Corpus: Benchmark measures of eye movements in reading in Russian. Behavior Research Methods, 51(3), 1161–1178.
doi: 10.3758/s13428-018-1051-6
Liversedge, S. P., Blythe, H. I., & Drieghe, D. (2012). Beyond isolated word recognition. Behavioral and Brain Sciences, 35(5), 293–294.
doi: 10.1017/S0140525X12000210
Liversedge, S. P., Drieghe, D., Li, X., Yan, G., Bai, X., & Hyönä, J. (2016). Universality in eye movements and reading: A trilingual investigation. Cognition, 147, 1–20.
doi: 10.1016/j.cognition.2015.10.013
Luke, S. G., & Christianson, K. (2018). The Provo Corpus: A large eye-tracking corpus with predictability norms. Behavior Research Methods, 50(2), 826–833.
doi: 10.3758/s13428-017-0908-4
ManyBabies Consortium (2020). Quantifying sources of variability in infancy research using the infant-directed-speech preference. Advances in Methods and Practices in Psychological Science, 3(1), 24–52.
doi: 10.1177/2515245919900809
Marian, V., Blumenfeld, H. K., & Kaushanskaya, M. (2007). The Language Experience and Proficiency Questionnaire (LEAP-Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research, 50(4), 940–967.
doi: 10.1044/1092-4388(2007/067)
Matsuki, K., Kuperman, V., & Van Dyke, J. A. (2016). The Random Forests statistical technique: An examination of its value for the study of reading. Scientific Studies of Reading, 20(1), 20–33.
doi: 10.1080/10888438.2015.1107073
Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., ... & Stewart, L. A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic reviews, 4(1), 1–9.
doi: 10.1186/2046-4053-4-1
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716.
Pan, J., Yan, M., Richter, E. M., Shu, H., & Kliegl, R. (2021). The Beijing Sentence Corpus: A Chinese sentence corpus with eye movement data and predictability norms. Behavior Research Methods, 1–12.
Papadopoulos, T. C., Csépe, V., Aro, M., Caravolas, M., Diakidoy, I. A., & Olive, T. (2021). Methodological Issues in Literacy Research Across Languages: Evidence From Alphabetic Orthographies. Reading Research Quarterly, 56, S351–S370.
doi: 10.1002/rrq.407
Pynte, J., & Kennedy, A. (2006). An influence over eye movements in reading exerted from beyond the level of the word: Evidence from reading English and French. Vision Research, 46(22), 3786–3801.
doi: 10.1016/j.visres.2006.07.004
Radach, R., & Heller, D. (2000). Relations between spatial and temporal aspects of eye movement control. In A. Kennedy, R. Radach, D. Heller, & J. Pynte (Eds.), Reading as a perceptual process. Oxford: Elsevier
Radach, R., & Kennedy, A. (2013). Eye movements in reading: Some theoretical context. Quarterly Journal of Experimental Psychology, 66(3), 429–452.
doi: 10.1080/17470218.2012.750676
Radach, R., Reilly, R., & Inhoff, A. (2007). Models of oculomotor control in reading: Toward a theoretical foundation of current debates. Eye Movements, 237–269.
Rau, A. K., Moll, K., Snowling, M. J., & Landerl, K. (2015). Effects of orthographic consistency on eye movement behavior: German and English children and adults process the same words differently. Journal of Experimental Child Psychology, 130, 92–105.
doi: 10.1016/j.jecp.2014.09.012
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372.
doi: 10.1037/0033-2909.124.3.372
Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62(8), 1457–1506.
doi: 10.1080/17470210902816461
Rayner, K., Chace, K. H., Slattery, T. J., & Ashby, J. (2006). Eye movements as reflections of comprehension processes in reading. Scientific studies of reading, 10(3), 241–255.
doi: 10.1207/s1532799xssr1003_3
Rayner, K. & Liversedge, S.P. (2011). Linguistic and cognitive influences on eye movements during reading. In S. Liversedge, I. Gilchrist, & S. Everling (Eds.), The Oxford Handbook of Eye Movements (pp. 751–766). : Oxford University Press.
Rayner, K., & McConkie, G. W. (1976). What guides a reader's eye movements? Vision Research, 16, 829–837.
doi: 10.1016/0042-6989(76)90143-7
Rayner, K., Pollatsek, A., Ashby, J., & Clifton, C., Jr. (2012). Psychology of reading. : Psychology Press.
doi: 10.4324/9780203155158
Reilly, R. G., & O'Regan, J. K. (1998). Eye movement control during reading: A simulation of some word-targeting strategies. Vision Research, 38(2), 303–317.
doi: 10.1016/S0042-6989(97)87710-3
Schroeder, S. (2019). popEye: Analysis of eye-tracking data from reading experiments. R package version 0.6.4.
Schuster, S., Hawelka, S., Hutzler, F., Kronbichler, M., & Richlan, F. (2016). Words in context: The effects of length, frequency, and predictability on brain responses during natural reading. Cerebral Cortex, 26(10), 3889–3904.
doi: 10.1093/cercor/bhw184
Seymour, P. H., Aro, M., Erskine, J. M., & Collaboration with COST Action A8 Network. (2003). Foundation literacy acquisition in European orthographies. British Journal of Psychology, 94(2), 143–174.
doi: 10.1348/000712603321661859
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. https://doi.org/10.1177/0956797611417632
doi: 10.1177/0956797611417632
Share, D. L. (2008). On the Anglocentricities of current reading research and practice: The perils of overreliance on an "outlier" orthography. Psychological Bulletin, 134(4), 584.
doi: 10.1037/0033-2909.134.4.584
Share, D. L. (2014). Alphabetism in reading science. Frontiers in Psychology, 5, 752.
doi: 10.3389/fpsyg.2014.00752
Špakov, O., Istance, H., Hyrskykari, A., Siirtola, H., & Räihä, K. J. (2019). Improving the performance of eye trackers with limited spatial accuracy and low sampling rates for reading analysis by heuristic fixation-to-word mapping. Behavior Research Methods, 51(6), 2661–2687.
doi: 10.3758/s13428-018-1120-x
Spearman, Charles, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3, 271–295.
Staub, A. (2021). How reliable are individual differences in eye movements in reading?. Journal of Memory and Language, 116, 104190.
doi: 10.1016/j.jml.2020.104190
Sun, F., & Feng, D. (1999). Eye movements in reading Chinese and English text. In J. Wang, A. W. Inhoff, & H.-C. Chen (Eds.), Reading Chinese script: A cognitive analysis (pp. 189– 205). : Lawrence Erlbaum.
Tang, S., Reilly, R. G., & Vorstius, C. (2012). EyeMap: a software system for visualizing and analyzing eye movement data in reading. Behavior research methods, 44(2), 420–438.
doi: 10.3758/s13428-011-0156-y
Verhoeven, L., & Perfetti, C. (Eds.). (2017). Learning to read across languages and writing systems. Cambridge University Press.
Vitu, F. (2011). On the role of visual and oculomotor processes in reading. In S. P. Liversedge, I. D. Gilchrist, & S. Everling (Eds.), The Oxford handbook of eye movements (pp. 731–749). Oxford University Press.
Weiß, R. H. (2006). Grundintelligenzskala 2 mit Wortschatztest and Zahlenfolgetest [Basic intelligence scale 2 with vocabulary knowledge test and sequential number test]. Göttingen, Germany: Hogrefe.
Whitford, V., & Titone, D. (2012). Second-language experience modulates first-and second-language word frequency effects: Evidence from eye movement measures of natural paragraph reading. Psychonomic Bulletin & Review, 19(1), 73–80.
doi: 10.3758/s13423-011-0179-5
Ziegler, J. C., & Goswami, U. (2005). Reading acquisition, developmental dyslexia, and skilled reading across languages: a psycholinguistic grain size theory. Psychological Bulletin, 131(1), 3–29.
doi: 10.1037/0033-2909.131.1.3