Automatic mental simulation in native and non-native speakers.
Bilingualism
Color match
Language comprehension
Mental simulation
Non-native speaker
Perceptual symbols system
Sentence-picture verification task
Journal
Memory & cognition
ISSN: 1532-5946
Titre abrégé: Mem Cognit
Pays: United States
ID NLM: 0357443
Informations de publication
Date de publication:
14 Feb 2024
14 Feb 2024
Historique:
accepted:
24
06
2023
medline:
14
2
2024
pubmed:
14
2
2024
entrez:
14
2
2024
Statut:
aheadofprint
Résumé
Pictures of objects are verified faster when they match the implied orientation, shape, and color in a sentence-picture verification task, suggesting that people mentally simulate these features during language comprehension. Previous studies had an unintended correlation between match status and the required response, which may have influenced participants' responses by eliciting strategic use of this correlation. We removed this correlation by including color-matching filler trials and investigated if the color-match effect was still obtained. In both a native sample (Experiment 1) and a non-native sample (Experiment 2), we found strong evidence for a color-match advantage on median reaction time and error rates. Our results are consistent with the view that color is automatically simulated during language comprehension as predicted by the grounded cognition framework.
Identifiants
pubmed: 38353910
doi: 10.3758/s13421-024-01533-8
pii: 10.3758/s13421-024-01533-8
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Informations de copyright
© 2024. The Author(s).
Références
Ahlberg, D. K., Bischoff, H., Kaup, B., Bryant, D., & Strozyk, J. V. (2018). Grounded cognition: Comparing language x space interactions in first and second language. Applied Psycholinguistics, 39(2), 437–459. https://doi.org/10.1017/S014271641700042X
doi: 10.1017/S014271641700042X
Ahn, S., & Jiang, N. (2018). Automatic semantic integration during L2 sentential reading. Bilingualism: Language and Cognition, 21(2), 375–383. https://doi.org/10.1017/S1366728917000256
Ambrosi, S., Kalénine, S., Blaye, A., & Bonthoux, F. (2011). Modality switching cost during property verification by 7 years of age. International Journal of Behavioral Development, 35(1), 78–83. https://doi.org/10.1177/0165025410371603
doi: 10.1177/0165025410371603
Balota, D. A., & Lorch, R. F. (1986). Depth of automatic spreading activation: Mediated priming effects in pronunciation but not in lexical decision. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12(3), 336–345. https://doi.org/10.1037/0278-7393.12.3.336
doi: 10.1037/0278-7393.12.3.336
Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22(4), 577–660.
doi: 10.1017/S0140525X99002149
pubmed: 11301525
Barsalou, L. W., Simmons, W. K., Barbey, A. K., & Wilson, C. D. (2003). Grounding conceptual knowledge in modality-specific systems. Trends in Cognitive Sciences, 7(2), 84–91. https://doi.org/10.1016/S1364-6613(02)00029-3
doi: 10.1016/S1364-6613(02)00029-3
pubmed: 12584027
Bergen, B., Lau, T., Narayan, S., Stojanovic, D., & Wheeler, K. (2010). Body part representations in verbal semantics. Memory & Cognition, 38(7), 969–981. https://doi.org/10.3758/MC.38.7.969
doi: 10.3758/MC.38.7.969
Borghi, A. M. (2004). Object concepts and action: Extracting affordances from objects parts. Acta Psychologica, 115(1), 69–96. https://doi.org/10.1016/j.actpsy.2003.11.004
doi: 10.1016/j.actpsy.2003.11.004
pubmed: 14734242
Borghi, A. M., Glenberg, A. M., & Kaschak, M. P. (2004). Putting words in perspective. Memory & cognition, 32(6), 863–873. https://doi.org/10.3758/BF03196865
doi: 10.3758/BF03196865
Chen, D., Wang, R., Zhang, J., & Liu, C. (2020). Perceptual representations in L1, L2 and L3 comprehension: Delayed sentence–picture verification. Journal of Psycholinguistic Research, 49(1), 41–57. https://doi.org/10.1007/s10936-019-09670-x
doi: 10.1007/s10936-019-09670-x
pubmed: 31468246
Connell, L. (2005). Colour and stability in embodied representations. In B., Bara, L., Barsalou,, & M. Bucciarelli, (Eds.), Proceedings of the Twenty-Seventh Annual Conference of the Cognitive Science Society (pp. 482-487), Lawrence Erlbaum.
Connell, L. (2007). Representing object colour in language comprehension. Cognition, 102(3), 476–485. https://doi.org/10.1016/j.cognition.2006.02.009
doi: 10.1016/j.cognition.2006.02.009
pubmed: 16616075
Connell, L., & Lynott, D. (2011). Modality switching costs emerge in concept creation as well as retrieval. Cognitive Science, 35(4), 763–778. https://doi.org/10.1111/j.1551-6709.2010.01168.x
doi: 10.1111/j.1551-6709.2010.01168.x
pubmed: 21564270
de Koning, B., Wassenburg, S. I., Bos, L. T., & van der Schoot, M. (2017). Mental simulation of four visual object properties: Similarities and differences as assessed by the sentence-picture verification task. Journal of Cognitive Psychology, 29(4), 420–432. https://doi.org/10.1080/20445911.2017.1281283
doi: 10.1080/20445911.2017.1281283
den Heyer, K., Briand, K., & Dannenbring, G. L. (1983). Strategic factors in a lexical-decision task: Evidence for automatic and attention-driven processes. Memory & Cognition, 11(4), 374–81. https://doi.org/10.3758/bf03202452
doi: 10.3758/bf03202452
Dijkstra, T., & van Heuven, W. J. B. (2002). The architecture of the bilingual word recognition system: From identification to decision. Bilingualism: Language and Cognition, 5(3), 175–197. https://doi.org/10.1017/S1366728902003012
Dudschig, C., De La Vela, I., & Kaup, B. (2014). Embodiment and second-language: Automatic activation of motor responses during processing spatially associated L2 words and emotion L2 words in a vertical Stroop paradigm. Brain & Language, 132, 14–21. https://doi.org/10.1016/j.bandl.2014.02.002
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41, 1149–1160. https://doi.org/10.3758/BRM.41.4.1149
doi: 10.3758/BRM.41.4.1149
pubmed: 19897823
Foroni, F. (2015). Do we embody second language? Evidence for ‘partial’ simulation during processing of a second language. Brain and Cognition, 99, 8–16. https://doi.org/10.1016/j.bandc.2015.06.006
doi: 10.1016/j.bandc.2015.06.006
pubmed: 26188846
Garcia, J., Kimeldorf, D. J., & Koelling, R. A. (1955). Conditioned aversion to saccharin resulting from exposure to gamma radiation. Science, 122, 157–158. https://doi.org/10.1126/science.122.3179.1089
doi: 10.1126/science.122.3179.1089
pubmed: 14396377
Hoeben-Mannaert, L. N., Dijkstra, K., & Zwaan, R. A. (2017). Is color an integral part of a rich mental simulation? Memory & Cognition, 45(6), 974–982. https://doi.org/10.3758/s13421-017-0708-1
doi: 10.3758/s13421-017-0708-1
Kogan, B., Muñoz, E., Ibáñez, A., & García, A. M. (2020). Too late to be grounded? Motor resonance for action words acquired after middle childhood. Brain and Cognition, 138, Article 105509. https://doi.org/10.1016/j.bandc.2019.105509
Kroll, J. F., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence for asymmetric connections between bilingual memory representations. Journal of Memory and Language, 33, 149–174.
doi: 10.1006/jmla.1994.1008
Loftus, G. R., & Masson, M. E. J. (1994). Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review, 1, 476–490. https://doi.org/10.3758/BF03210951
doi: 10.3758/BF03210951
Marques, J. F. (2006). Specialization and semantic organization: Evidence for multiple semantics linked to sensory modalities. Memory & Cognition, 34(1), 60–67. https://doi.org/10.3758/BF03193386
doi: 10.3758/BF03193386
McNamara, T. P. (1992). Theories of priming: I. Associative distance and lag. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18(6), 1173–1190. https://doi.org/10.1037/0278-7393.18.6.1173
Monaco, E., Jost, L. B., Gygax, P. M., & Annoni, J.-M. (2019). Embodied semantics in a second language: Critical review and clinical implications. Frontiers in Human Neuroscience, 13, 1–21. https://doi.org/10.3389/fnhum.2019.00110
doi: 10.3389/fnhum.2019.00110
Morey, R. D., Kaschak, M. P., Diez-Alamo, A., Glenberg, A. M., Zwaan, R. A., Lakens, D., Ibanez, A., Garcia, A., Gianelli, C., Jones, J. L., Madden, J., Alifano, F., Bergen, B., Bloxsom, N. G., Bub, D. N., Cai, Z., Chartier, C. R., Chatterjee, A., Conwell, E., . . . Ziv-Crispel, N. (2021). A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE). Psychonomic Bulletin & Review, https://doi.org/10.3758/s13423-021-01927-8
Neely, J. H. (1977). Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited-capacity attention. Journal of Experimental Psychology: General, 106(3), 226–254. https://doi.org/10.1037/0096-3445.106.3.226
doi: 10.1037/0096-3445.106.3.226
Neely, J. H., Keefe, D. E., & Ross, K. L. (1989). Semantic priming in the lexical decision task: Roles of prospective prime-generated expectancies and retrospective semantic matching. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15(6), 1003–1019. https://doi.org/10.1037/0278-7393.15.6.1003
doi: 10.1037/0278-7393.15.6.1003
pubmed: 2530303
Norman, T., & Peleg, O. (2022). The reduced embodiment of a second language. Bilingualism: Language and Cognition, 25(3), 406-416. https://doi.org/10.1017/S1366728921001115
Parise, C. V., Spence, C., & Ernst, M. O. (2012). When correlation implies causation in multisensory integration. Current Biology, 22(1), 46–49. https://doi.org/10.1016/j.cub.2011.11.039
doi: 10.1016/j.cub.2011.11.039
pubmed: 22177899
Pecher, D., van Dantzig, S., & Schifferstein, H. N. J. (2009). Concepts are not represented by conscious imagery. Psychonomic Bulletin & Review, 16(5), 914–919. https://doi.org/10.3758/PBR.16.5.914
doi: 10.3758/PBR.16.5.914
Pecher, D., van Dantzig, S., Zwaan, R. A., & Zeelenberg, R. (2009). Language comprehenders retain implied shape and orientation of objects. The Quarterly Journal of Experimental Psychology, 62(6), 1108–1114. https://doi.org/10.1080/17470210802633255
doi: 10.1080/17470210802633255
pubmed: 19142833
Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2003). Verifying different-modality properties for concepts produces switching costs. Psychological Science, 14(2), 119–124. https://doi.org/10.1111/1467-9280.t01-1-01429
doi: 10.1111/1467-9280.t01-1-01429
pubmed: 12661672
Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2004). Sensorimotor simulations underlie conceptual representations: Modality-specific effects of prior activation. Psychonomic Bulletin & Review, 11(1), 164–167. https://doi.org/10.3758/BF03206477
doi: 10.3758/BF03206477
Pecher, D., Zeelenberg, R., & Raaijmakers, J. G. W. (2002). Associative priming in a masked perceptual identification task: Evidence for automatic processes. Quarterly Journal of Experimental Psychology, 55A(4), 1157–1173. https://doi.org/10.1080/02724980244000143
doi: 10.1080/02724980244000143
Potter, M. C., So, K. F., Von Eckhart, B., & Feldman, L. B. (1984). Lexical and conceptual representation in beginning and proficient bilinguals. Journal of Verbal Learning and Verbal Behavior, 23, 23–38.
doi: 10.1016/S0022-5371(84)90489-4
Reber, A. S. (1967). Implicit learning of artificial grammars. Journal of Verbal Learning & Verbal Behavior, 6(6), 855–863. https://doi.org/10.1016/S0022-5371(67)80149-X
doi: 10.1016/S0022-5371(67)80149-X
Sato, M., Schafer, A. J., & Bergen, B. K. (2013). One word at a time: Mental representations of object shape change incrementally during sentence processing. Language and Cognition, 5(4), 345–373. https://doi.org/10.1515/langcog-2013-0022
doi: 10.1515/langcog-2013-0022
Solomon, K. O., & Barsalou, L. W. (2004). Perceptual simulation in property verification. Memory & Cognition, 32(2), 244–259. https://doi.org/10.3758/bf03196856
doi: 10.3758/bf03196856
Spivey, M., & Geng, J. J. (2001). Oculomotor mechanisms activated by imagery and memory: Eye movements to absent objects. Psychological research, 65(4), 235–241. https://doi.org/10.1007/s004260100059
doi: 10.1007/s004260100059
pubmed: 11789427
Stanfield, R. A., & Zwaan, R. A. (2001). The effect of implied orientation derived from verbal context on picture recognition. Psychological Science, 12(2), 153–156. https://doi.org/10.1111/1467-9280.00326
doi: 10.1111/1467-9280.00326
pubmed: 11340925
Taylor, L. J., & Zwaan, R. A. (2008). Motor resonance and linguistic focus. Quarterly Journal of Experimental Psychology, 61(6), 896–904. https://doi.org/10.1080/17470210701625519
doi: 10.1080/17470210701625519
Van Dantzig, S., Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2008). Perceptual processing affects conceptual processing. Cognitive Science, 32(3), 579–590. https://doi.org/10.1080/03640210802035365
doi: 10.1080/03640210802035365
pubmed: 21635347
van Heuven, W. J. B., & Dijkstra, T. (2010). Language comprehension in the bilingual brain: fMRI and ERP support for psycholinguistic models. Brain Research Review, 64(1), 104–122. https://doi.org/10.1016/j.brainresrev.2010.03.002
doi: 10.1016/j.brainresrev.2010.03.002
Vermeulen, N., Corneille, O., & Niedenthal, P. M. (2008). Sensory load incurs conceptual processing costs. Cognition, 109(2), 287–294. https://doi.org/10.1016/j.cognition.2008.09.004
doi: 10.1016/j.cognition.2008.09.004
pubmed: 18996513
Vermeulen, N., Niedenthal, P. M., & Luminet, O. (2007). Switching between sensory and affective systems incurs processing costs. Cognitive Science, 31(1), 183–192. https://doi.org/10.1080/03640210709336990
doi: 10.1080/03640210709336990
pubmed: 21635293
Wheeler, K. B., & Stojanovic, D. (2006). Non-native language processing engages mental imagery. Proceedings of the Annual Meeting of the Cognitive Science Society, 28, 882-887. Retrieved from https://escholarship.org/uc/item/59r7r8zt
Winter, B., & Bergen, B. (2012). Language comprehenders represent object distance both visually and auditorily. Language and Cognition, 4(1), 1–16. https://doi.org/10.1515/langcog-2012-0001
doi: 10.1515/langcog-2012-0001
Zeelenberg, R., & Pecher, D. (2003). Evidence for long-term cross-language repetition priming in conceptual implicit memory tasks. Journal of Memory and Language, 49, 80–94.
doi: 10.1016/S0749-596X(03)00020-2
Zeelenberg, R., Wagenmakers, E. M., & Shiffrin, R. M. (2004). Nonword repetition priming in lexical decision reverses as a function of study task and speed stress. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30(1), 270–277. https://doi.org/10.1037/0278-7393.30.1.270
doi: 10.1037/0278-7393.30.1.270
pubmed: 14736311
Zhao, T., Huang, Y., Chen, D., Jiao, L., Marmolejo-Ramos, F., Wang, R., & Xie, J. (2019). The modality switching costs of Chinese-English bilinguals in the processing of L1 and L2. Quarterly Journal of Experimental Psychology, 7(3), 396–412. https://doi.org/10.1177/1747021819878089
doi: 10.1177/1747021819878089
Zwaan, R. A., & Pecher, D. (2012). Revisiting mental simulation in language comprehension: Six replication attempts. PLoS ONE, 79(12), 1–10. https://doi.org/10.1371/journal.pone.0051382
doi: 10.1371/journal.pone.0051382
Zwaan, R. A., Pecher, D., Paolacci, G., Bouwmeester, S., Verkoeijen, P., Dijkstra, K., & Zeelenberg, R. (2018). Participant nonnaiveté and the reproducibility of cognitive psychology. Psychonomic Bulletin & Review, 25(5), 1968–1972. https://doi.org/10.3758/s13423-017-1348-y
doi: 10.3758/s13423-017-1348-y
Zwaan, R. A., Stanfield, R. A., & Yaxley, R. H. (2002). Language comprehenders mentally represent the shapes of objects. Psychological Science, 13(2), 168–171. https://doi.org/10.1111/1467-9280.00430
doi: 10.1111/1467-9280.00430
pubmed: 11934002
Zwaan, R. A., & Taylor, L. J. (2006). Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology: General, 135(1), 1–11. https://doi.org/10.1037/0096-3445.135.1.1
doi: 10.1037/0096-3445.135.1.1
pubmed: 16478313