The Interaction of Linguistic and Visual Cues for the Processing of Case in Russian by Russian-German Bilinguals: An Eye Tracking Study.
Bilingualism
Event representations
Grammatical case processing
Visual World eye tracking
Visual processing
Journal
Topics in cognitive science
ISSN: 1756-8765
Titre abrégé: Top Cogn Sci
Pays: United States
ID NLM: 101506764
Informations de publication
Date de publication:
21 Feb 2024
21 Feb 2024
Historique:
revised:
29
01
2024
received:
07
07
2023
accepted:
01
02
2024
medline:
21
2
2024
pubmed:
21
2
2024
entrez:
21
2
2024
Statut:
aheadofprint
Résumé
Modulation of visual attention in the Visual World Paradigm relies on parallel processing of linguistic and visual information. Previous studies have argued that the human linguistic capacity includes an aspect of anticipation of upcoming material. Such anticipation can be triggered by both lexical and grammatical/morphosyntactic cues. In this study, we investigated the relationship between comprehension and prediction by testing how subtle changes in visual representations can affect the processing of grammatical case cues in Russian by Russian-German bilingual children (n = 49, age 8-13). The linguistic manipulation followed previous designs, contrasting SVO and OVS sentences, where the first NP (NP1) was marked with nominative or accusative case, respectively. Three types of visual displays were compared: (i) individual referents (potential agent/theme); (ii) pairs of referents (NP1 + potential agent/theme); and (iii) events (representing interactions between the referents). Participants were significantly more sensitive to the case manipulation when presented with events compared to the other two types of visual display. This suggests that they were able to quickly integrate the thematic role information signaled by grammatical case in the event representations. However, they were less likely to use the case information to anticipate upcoming arguments when the target pictures represented individual referents or pairs of noninteracting referents. We hypothesize that the process of argument anticipation is mediated by the activation of syntactic templates (SVO or OSV, depending on the case marking on NP1). The relatively weak anticipation effect observed may be attributed to the absence, or weak representation, of the noncanonical OVS template in the bilingual children's long-term memory.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Subventions
Organisme : Research Council of Norway
ID : 316103
Organisme : UiT The Arctic University of Norway
ID : 2062165
Informations de copyright
© 2024 The Authors. Topics in Cognitive Science published by Wiley Periodicals LLC on behalf of Cognitive Science Society.
Références
Allopenna, P., Magnuson, J., & Tanenhaus, M. (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38(4), 419-439. https://doi.org/10.1006/jmla.1997.2558.
Altmann, G., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73(3), 247-264.
Altmann, G., & Kamide, Y. (2007). The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing. Journal of Memory and Language, 57(4), 502-518. https://doi.org/10.1016/j.jml.2006.12.004.
Bader, M., & Häussler, J. (2010). Word order in German: A corpus study. Lingua, 120(3), 717-762. https://doi.org/10.1016/j.lingua.2009.05.007.
Bailyn, J. F. (1995). A configurational approach to Russian “free” word order. [Ph.D. dissertation], Cornell University.
Betancourt, M. (2018). Calibrating model-based inferences and decisions. arXiv: 1803.08393 [stat.ME]. https://arxiv.org/abs/1803.08393
Bivon, R. (1971). Element order. Cambridge: Cambridge University Press.
Bürkner, P.-C. (2020). brms: Bayesian regression models using ‘Stan’. Vienna: R Foundation for Statistical Computing. https://cran.r-project.org/package=brms
Carignan, C., Coretta, S., Frahm, J., Harrington, J., Hoole, P., Joseph, A., Kunay, E., & Voit, D. (2021). Planting the seed for sound change: Evidence from real-time MRI of velum kinematics in German. Language, 97(2), 333-364.
Dahan, D., & Tanenhaus, M. (2005). Looking at the rope when looking for the snake: Conceptually mediated eye movements during spoken-word recognition. Psychonomic Bulletin & Review, 12, 453-459. https://doi.org/10.3758/BF03193787.
Falk H., Audring, J., & Jackendoff, R. (2022). A parallel architecture perspective on pre-activation and prediction in language processing. Cognition, 224, 105050. https://doi.org/10.1016/j.cognition.2022.105050.
Hoberg, U. (1981). Die Wortstellung in der Geschriebenen Deutschen Gegenwartssprache. Hueber.
Huettig, F. (2015). Four central questions about prediction in language processing. Brain Research, 1626, 118-135.
Huettig, F., & Altmann, G. (2005). Word meaning and the control of eye fixation: Semantic competitor effects and the visual world paradigm. Cognition, 96(1), B23-B32. https://doi.org/10.1016/j.cognition.2004.10.003.
Huettig, F., Audring, J., & Jackendoff, R. (2022). A parallel architecture perspective on pre-activation and prediction in language processing. Cognition, 224, 105050.
Huettig, F., & Mani, N. (2016). Is prediction necessary to understand language? Probably not. Language, Cognition and Neuroscience, 31, 19-31. https://doi.org/10.1080/23273798.2015.1072223.
Jackendoff, R. (2023). The parallel architecture in language and elsewhere. Topics in Cognitive Science. https://doi.org/10.1111/tops.12698.
Kamide, Y., Scheepers, C., & Altmann, G. T. (2003). Integration of syntactic and semantic information in predictive processing: Cross-linguistic evidence from German and English. Journal of Psycholinguistic Research, 32, 37-55.
Knoeferle, P., & Crocker, M. (2007). The influence of recent scene events on spoken comprehension: Evidence from eye movements. Journal of Memory and Language, 57, 519-543.
Knoeferle, P., Crocker, M., Scheepers, C., & Pickering, M. (2005). The influence of the immediate visual context on incremental thematic role-assignment: Evidence from eye-movements in depicted events. Cognition, 95, 95-127.
Kruschke, J. K. (2014). Doing Bayesian data analysis: A tutorial with R, JAGS, and Stan (2nd ed.). Amsterdam: Academic Press.
Magnuson, J. S. (2019). Fixations in the visual world paradigm: Where, when, why? Journal of Cultural Cognitive Scicene, 3, 113-139. https://doi.org/10.1007/s41809-019-00035-3.
Mitrofanova, N., Minor, S., Westergaard, M., Sauerman, A., Gagarina, N., Ozge, D., Sekerina, I. (submitted). Processing of Grammatical Case in Russian and German by Monolingual and Bilingual Preschoolers: Evidence from Eye-tracking.
Myung, J.-Y., Blumstein, S., & Sedivy, J. (2006). Playing on the typewriter, typing on the piano: Manipulation knowledge of objects. Cognition, 98(3), 223-243. https://doi.org/10.1016/j.cognition.2004.11.010.
Özge, D., Kornfilt, J., Münster, K., Knoeferle, P., Küntay, A., & Snedeker, J. (2016). Predictive use of case markers in German children. In Proceedings of the 40th Annual Boston University Conference on Language Development (pp. 291-303). Somerville, MA: Cascadilla Press.
Özge, D., Küntay, A., & Snedeker, J. (2019). Why wait for the verb? Turkish speaking children use case markers for incremental language comprehension. Cognition, 183, 152-180.
R Core Team. (2020). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. http://www.R-project.org
Sirotinina, O. B. (1965). Porjadok slov v russkom jazyke. Saratov State University.
Slioussar, N. (2011). Russian and the EPP requirement in the tense domain. Lingua, 121, 2048-2068.
Stan Development Team. (2017). Stan: A C++ library for probability and sampling. Version 2.14.0. http://mc-stan.org/
Yee, E., & Sedivy, J. C. (2006). Eye movements to pictures reveal transient semantic activation during spoken word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(1), 1-14. https://doi.org/10.1037/0278-7393.32.1.1.
Zhang, L., & Knoeferle, P. (2012). Visual context effects on thematic role assignment in children versus adults: Evidence from eye tracking in German. In Proceedings of the Annual Meeting of the Cognitive Science Society.