Music reading experience modulates eye movement pattern in English reading but not in Chinese reading.
Journal
Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288
Informations de publication
Date de publication:
01 06 2022
01 06 2022
Historique:
received:
09
02
2022
accepted:
19
05
2022
entrez:
1
6
2022
pubmed:
2
6
2022
medline:
7
6
2022
Statut:
epublish
Résumé
Here we tested the hypothesis that in Chinese-English bilinguals, music reading experience may modulate eye movement planning in reading English but not Chinese sentences due to the similarity in perceptual demands on processing sequential symbol strings separated by spaces between music notation and English sentence reading. Chinese-English bilingual musicians and non-musicians read legal, semantically incorrect, and syntactically (and semantically) incorrect sentences in both English and Chinese. In English reading, musicians showed more dispersed eye movement patterns in reading syntactically incorrect sentences than legal sentences, whereas non-musicians did not. This effect was not observed in Chinese reading. Musicians also had shorter saccade lengths when viewing syntactically incorrect than correct musical notations and sentences in an unfamiliar alphabetic language (Tibetan), whereas non-musicians did not. Thus, musicians' eye movement planning was disturbed by syntactic violations in both music and English reading but not in Chinese reading, and this effect was generalized to an unfamiliar alphabetic language. These results suggested that music reading experience may modulate perceptual processes in reading differentially in bilinguals' two languages, depending on their processing similarities.
Identifiants
pubmed: 35650229
doi: 10.1038/s41598-022-12978-9
pii: 10.1038/s41598-022-12978-9
pmc: PMC9397380
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
9144Informations de copyright
© 2022. The Author(s).
Références
McGugin, R., McKeeff, W., Tong, T. & Gauthier, J. Irrelevant objects of expertise compete with faces during visual search. Atten. Percept. Psycho. 73(2), 309–317 (2011).
doi: 10.3758/s13414-010-0006-5
Gauthier, I., Curran, T., Curby, K. M. & Collins, D. Perceptual interference supports a non-modular account of face processing. Nat. Neurosci. 6(4), 428–432 (2003).
pubmed: 12627167
doi: 10.1038/nn1029
Liu, T., Chuk, T., Yeh, S. L. & Hsiao, J. H. Transfer of perceptual expertise: The case of simplified and traditional Chinese character recognition. Cogn. Sci. 40(8), 1941–1968 (2016).
pubmed: 26864826
doi: 10.1111/cogs.12307
Liu, T., Yeh, S. L. & Hsiao, J. H. Transfer of the left-side bias effect in perceptual expertise: The case of simplified and traditional Chinese character recognition. PLoS ONE 13(4), e0194405 (2018).
pubmed: 29608570
pmcid: 5880342
doi: 10.1371/journal.pone.0194405
Li, S. T. K. & Hsiao, J. H. Music reading expertise modulates hemispheric lateralization in english word processing but not in chinese character processing. Cognition 176, 159–173 (2018).
pubmed: 29558721
doi: 10.1016/j.cognition.2018.03.010
Li, S. T. K., Chung, S. & Hsiao, J. H. Music-reading expertise modulates the visual span for English letters but not Chinese characters. J. Vis. 19(4), 1–16 (2019).
doi: 10.1167/19.4.10
Chan, A. B. & Hsiao, J. H. Information distribution within musical segments. Music Percept. 34(2), 218–242 (2016).
doi: 10.1525/mp.2016.34.2.218
Lavidor, M. & Ellis, A. W. Mixed-case effects in lateralized word recognition. Brain Cogn. 45, 192–195 (2001).
doi: 10.1016/S0278-2626(01)80063-4
Hsiao, J. H. & Lam, S. M. The modulation of visual and task characteristics of a writing system on hemispheric lateralization in visual word recognition—A computational exploration. Cognitive Sci. 37(5), 861–890 (2013).
doi: 10.1111/cogs.12033
Hsiao, J. H. & Liu, J. Y. W. Position of phonetic components may influence how written words are processed in the brain: Evidence from Chinese phonetic compound pronunciation. Cogn. Affect. Behav. Neurosci. 10(4), 552–559 https://doi.org/10.3758/CABN.10.4.552 (2010).
doi: 10.3758/CABN.10.4.552
pubmed: 21098814
Hsiao, J. H. & Cheung, K. Visual Similarity of Words Alone Can Modulate Hemispheric Lateralization in Visual Word Recognition: Evidence From Modeling Chinese Character Recognition. Cogn. Sci. 40(2), 351–372 https://doi.org/10.1111/cogs.12233 (2016).
doi: 10.1111/cogs.12233
pubmed: 25818722
Chung, H. K. S., Leung, J. C. Y., Wong, V. M. Y. & Hsiao, J. H. When is the right hemisphere holistic and when is it not? The case of Chinese character recognition. Cognition 178, 50–56 https://doi.org/10.1016/j.cognition.2018.04.022 (2018).
doi: 10.1016/j.cognition.2018.04.022
pubmed: 29775858
Tso, R. V. Y., Chan, R. T. C. & Hsiao, J. H-W. Holistic but with reduced right-hemisphere involvement: The case of dyslexia in Chinese character recognition. Psychon. Bull. Rev. 27(3), 553–562 https://doi.org/10.3758/s13423-020-01721-y (2020).
doi: 10.3758/s13423-020-01721-y
pubmed: 32144579
Chung, H. K. S., Liu, J. Y. W. & Hsiao, J. H. How does reading direction modulate perceptual asymmetry effects?. Q. J. Exp. Psychol. 70(8), 1559–1574 https://doi.org/10.1080/17470218.2016.1193549 (2017).
doi: 10.1080/17470218.2016.1193549
Lam, S. M. & Hsiao, J. H. Bilingual experience modulates hemispheric lateralization in visual word processing. Biling. Lang. Cogn. 17(30), 589–609 (2014).
doi: 10.1017/S1366728913000734
Rayner, K. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372–422 (1998).
pubmed: 9849112
doi: 10.1037/0033-2909.124.3.372
Schon, D., Magne, C. & Besson, M. The music of speech: Music training facilitates pitch processing in both music and language. Psychophysiology 41(3), 341–349 (2004).
pubmed: 15102118
doi: 10.1111/1469-8986.00172.x
Tillmann, B. Music and language perception: expectations, structural integration, and cognitive sequencing. Top. Cogn. Sci. 4(4), 568–584 (2012).
pubmed: 22760955
doi: 10.1111/j.1756-8765.2012.01209.x
Waters, A. J., Underwood, G. & Findlay, J. M. Studying expertise in music reading: Use of a pattern-matching paradigm. Percept. Psychophys. 59(4), 477–488 (1997).
pubmed: 9158323
doi: 10.3758/BF03211857
Wells, J. B., Christiansen, M. H., Race, D. S., Acheson, D. J. & MacDonald, M. C. Experience and sentence processing: Statistical learning and relative clause comprehension. Cognitive Psychol. 58(2), 250–271 (2009).
doi: 10.1016/j.cogpsych.2008.08.002
Patel, A. D., Gibson, E., Ratner, J., Besson, M. & Holcomb, P. J. Processing syntactic relations in language and music: An event-related potential study. J. Cogn. Neurosci. 10(6), 717–733 (1998).
pubmed: 9831740
doi: 10.1162/089892998563121
Jentschke, S., Koelsch, S., Sallat, S. & Friederici, A. D. Children with specific language impairment also show impairment of music-syntactic processing. J. Cognitive Neurosci. 20(11), 1940–1951 (2008).
doi: 10.1162/jocn.2008.20135
Yu, M. X. et al. The shared neural basis of music and language. Neurosci. 357, 208–219 (2017).
doi: 10.1016/j.neuroscience.2017.06.003
Dittinger, E. et al. Professional music training and novel word learning: from faster semantic encoding to longer-lasting word representation. J. Cogn. Neurosci. 28(10), 1584–1602 (2016).
pubmed: 27315272
doi: 10.1162/jocn_a_00997
Oldfield, R. C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9, 97–113 (1971).
pubmed: 5146491
doi: 10.1016/0028-3932(71)90067-4
Lemhöfer, K. & Broersma, M. Introducing LexTALE: a quick and valid lexical test for advanced learners of English. Behav. Res. Methods 44, 325–343 (2012).
pubmed: 21898159
doi: 10.3758/s13428-011-0146-0
Lau, E. Y. Y., Ip, M. S. M., Lee, T. M. C., Yeung, A. W. M. & Eskes, G. A. Neurocognitive and psychosocial outcomes of obstructive sleep apnea in Hong Kong Chinese: similar to or different from western populations?. J. Sleep Disord.: Treat. Care 2, 3 (2016).
Müllensiefen, D., Gingras, B., Musil, J. & Stewart, L. The musicality of non-musicians: An index for assessing musical sophistication in the general population. PLoS One 9(2), e89642 (2014).
pubmed: 24586929
pmcid: 3935919
doi: 10.1371/journal.pone.0089642
Kelly, C. & Kelly, L. Interesting things for ESL/EFL students (Fun English Study). http://www.manythings.org (1997).
Brysbaert, M., New, B. & Keuleers, E. Adding part-of-speech information to the SUBTLEX-US word frequencies. Behav. Res. Methods 44, 991–997 (2012).
pubmed: 22396136
doi: 10.3758/s13428-012-0190-4
Ho, H. H. & Kwan, T. W. Hong Kong, mainland China & Taiwan: Chinese character frequency-A trans-regional, diachronic survey. http://humanum.arts.cuhk.edu.hk/Lexis/chifreq/ (2001).
Academia Sinica, Institute of Linguistics. Contemporary Chinese Word Frequency Database. http://elearning.ling.sinica.edu.tw/CWordfreq.html (2005).
Estrella, J. Radio free Asia. http://www.rfa.org/tibetan/ (2017).
Chuk, T., Chan, A. B. & Hsiao, J. H. Understanding eye movements in face recognition using hidden Markov models. J. Vis. 14(11), 8–8 (2014).
pubmed: 25228627
doi: 10.1167/14.11.8
Coviello, E., Lanckriet, G. R. & Chan, A. B. The variational hierarchical EM algorithm for clustering hidden Markov models. In Adv. Neur. (ed. Barlett, P.) 404–412 (Curran Associates Inc, 2012).
Coviello, E., Chan, A. B. & Lanckriet, G. R. G. Clustering hidden Markov models with variational HEM. J. Mach. Learn. Res. 15, 697–747 (2014).
Chuk, T., Crookes, K., Hayward, W. G., Chan, A. B. & Hsiao, J. H. Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures. Cognition 169, 102–117 (2017).
pubmed: 28869811
doi: 10.1016/j.cognition.2017.08.003
Joseph, H. S. S. L., Liversedge, S. P., Blythe, H. I., White, S. J. & Rayner, K. Word length and landing position effects during reading in children and adults. Vision Res. 49(16), 2078–2086 (2009).
pubmed: 19481566
doi: 10.1016/j.visres.2009.05.015
Chuk, T., Chan, A. B. & Hsiao, J. H. Is having similar eye movement patterns during face learning and recognition beneficial for recognition performance? Evidence from hidden Markov modeling. Vision Res. 141, 204–216 (2017).
pubmed: 28435123
doi: 10.1016/j.visres.2017.03.010
Chan, C., Chan, A., Lee, T. & Hsiao, J. H. Eye-movement patterns in face recognition are associated with cognitive decline in older adults. Psychon. B. Rev. 25(6), 2200–2207 (2018).
doi: 10.3758/s13423-017-1419-0
Zhang, J., Chan, A. B., Lau, E. Y. Y. & Hsiao, J. H. Individuals with insomnia misrecognize angry faces as fearful faces while missing the eyes: An eye-tracking study. Sleep 42(2), p.zsy220 (2019).
doi: 10.1093/sleep/zsy220
Chan, F. H. F., Barry, T. J., Chan, A. B. & Hsiao, J. H. Understanding visual attention to face emotions in social anxiety using hidden Markov models. Cognition Emotion 34(8), 1704–1710 (2020).
pubmed: 32552552
doi: 10.1080/02699931.2020.1781599
Chan, F. H. F., Jackson, T., Hsiao, J. H., Chan, A. B. & Barry, T. J. The interrelation between interpretation biases, threat expectancies and pain-related attentional processing. Eur. J. Pain 24(10), 1956–1967 (2020).
pubmed: 32794630
doi: 10.1002/ejp.1646
Chan, F. H. F., Suen, H., Hsiao, J. H., Chan, A. B. & Barry, T. J. Interpretation biases and visual attention in the processing of ambiguous information in chronic pain. Eur. J. Pain 24(7), 1242–1256 (2020).
pubmed: 32223046
doi: 10.1002/ejp.1565
An, J. & Hsiao, J. H. Modulation of mood on eye movement pattern and performance in face recognition. Emotion 21(3), 617–630 (2021).
pubmed: 31944785
doi: 10.1037/emo0000724
Hsiao, J. H., An, J., Zheng, Y. & Chan, A. B. Do portrait artists have enhanced face processing abilities? Evidence from hidden Markov modeling of eye movements. Cognition 211, 104616 (2021).
pubmed: 33592393
doi: 10.1016/j.cognition.2021.104616
Hsiao, J. H., Chan, A. B., An, J., Yeh, S.-L. & Jingling, L. Understanding the collinear masking effect in visual search through eye tracking. Psychon. B. Rev. 28(6), 1933–1943 (2021).
doi: 10.3758/s13423-021-01944-7
Hsiao, J. H., Lan, H., Zheng, Y. & Chan, A. B. Eye Movement analysis with Hidden Markov Models (EMHMM) with co-clustering. Behav. Res. Methods 53(6), 2473–2486 (2021).
pubmed: 33929699
pmcid: 8613150
doi: 10.3758/s13428-021-01541-5
Zheng, Y., Ye, X. & Hsiao, J. H. Does adding video and subtitles to an audio lesson facilitate its comprehension?. Learn. Instr. 77, 101542 (2022).
doi: 10.1016/j.learninstruc.2021.101542
Lee, H. H., Chen, Z. L., Yeh, S. L., Hsiao, J. H. W. & Wu, A. Y. A. When eyes wander around: mind-wandering as revealed by eye movement analysis with hidden Markov models. Sensors 21(22), 7569 (2021).
pubmed: 34833644
pmcid: 8622810
doi: 10.3390/s21227569
Chan, F. H. F., Suen, H., Chan, A. B., Hsiao, J. H. & Barry, T. J. The effects of attentional and interpretation biases on later pain outcomes among younger and older adults: a prospective study. Eur. J. Pain 26(1), 181–196 (2022).
pubmed: 34399011
doi: 10.1002/ejp.1853
Tatler, B. W. The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. J. Vis. 7(14), 4–4 (2007).
pubmed: 18217799
doi: 10.1167/7.14.4
Su, I. R. Transfer of sentence processing strategies: a comparison of L2 learners of Chinese and English. Appl. Psycholinguist. 22(1), 83–112 (2001).
doi: 10.1017/S0142716401001059
Pan, J., Laubrock, J. & Yan, M. Parafoveal processing in silent and oral reading: reading mode influences the relative weighting of phonological and semantic information in Chinese. J. Exp. Psychol. Learn. 42(8), 1257–1273 (2016).
doi: 10.1037/xlm0000242
Pan, J., Yan, M. & Yeh, S.-L. Accessing semantic information from above: parafoveal processing during the reading of vertically presented sentences in traditional Chinese. Cognitive Sci. 46(2), e13104 (2022).
doi: 10.1111/cogs.13104
Yan, M., Pan, J., Bélanger, N. & Shu, H. Chinese deaf readers have early access to parafoveal semantics. J. Exp. Psychol. Learn. 41(1), 254–261 (2015).
doi: 10.1037/xlm0000035
Yan, M., Richter, E. M., Shu, H. & Kliegl, R. Readers of Chinese extract semantic information from parafoveal words. Psychon. B. Rev. 16(3), 561–566 (2009).
doi: 10.3758/PBR.16.3.561
Yan, M., Zhou, W., Shu, H. & Kliegl, R. Lexical and sublexical semantic preview benefits in Chinese reading. J. Exp. Psychol. Learn. 38, 1069–1075 (2012).
doi: 10.1037/a0026935
Hohenstein, S. & Kliegl, R. Semantic preview benefit during reading. J. Exp. Psychol. Learn. 40, 166–190 (2014).
doi: 10.1037/a0033670
Hohenstein, S., Laubrock, J. & Kliegl, R. Semantic preview benefit in eye movements during reading: A parafoveal fast-priming study. J. Exp. Psychol. Learn. 36, 1150–1170 (2010).
doi: 10.1037/a0020233
Kim, Y. S., Radach, R. & Vorstius, C. Eye movements and parafoveal processing during reading in Korean. Read. Writ. 25, 1053–1078 (2012).
doi: 10.1007/s11145-011-9349-0
Wang, A., Yeon, J., Zhou, W., Shu, H. & Yan, M. Cross-language parafoveal semantic processing: Evidence from Korean-Chinese bilinguals. Psychon. B. Rev. 23(1), 285–290 (2016).
doi: 10.3758/s13423-015-0876-6
Yan, M., Wang, A., Song, H. & Kliegl, R. Parafoveal processing of phonology and semantics during the reading of Korean sentences. Cognition 193, 104009 (2019).
pubmed: 31295626
doi: 10.1016/j.cognition.2019.104009
Bogush, A. M., Korolova, T. M. & Popova, O. V. A Comparative analysis of English and Chinese Reading: Phonetics, Vocabulary and Grammar 255–281 (Arab World Engl. J, 2020).
Okada, B. M. & Slevc, L. R. Individual differences in musical training and executive functions: A latent variable approach. Mem. Cogn. 46(7), 1076–1092 (2018).
doi: 10.3758/s13421-018-0822-8
Criscuolo, A., Bonett, L., Sarkamo, T., Kliuchko, M. & Brattico, E. On the association between musical training, intelligence and executive functions in adulthood. Front. Psychol. 10, 1704 (2019).
pubmed: 31417454
pmcid: 6682658
doi: 10.3389/fpsyg.2019.01704
Mualem, O. & Lavidor, M. Music education intervention improves vocal emotion recognition. Int. J. Music Educ. 33(4), 413–425 (2015).
doi: 10.1177/0255761415584292
Weiss, A. H., Biron, T., Lieder, I., Granot, R. Y. & Ahissar, M. Spatial vision is superior in musicians when memory plays a role. J. Vis. 14(9), 18–18 (2014).
pubmed: 25146576
doi: 10.1167/14.9.18
Kanan, C., Bseiso, D., Ray, N., Hsiao, J. H. & Cottrell, G. Humans have idiosyncratic and task-specific scanpaths for judging faces. Vision Res. 108, 67–76 (2015).
pubmed: 25641371
doi: 10.1016/j.visres.2015.01.013
Degé, F., Kubicek, C. & Schwarzer, G. Music lessons and intelligence: A relation mediated by executive functions. Music Percept. 29(2), 195–201 (2011).
doi: 10.1525/mp.2011.29.2.195
Rodrigues, A. C., Loureiro, M. A. & Caramelli, P. Long-term musical training may improve different forms of visual attention ability. Brain Cogn. 82(3), 229–235 (2013).
pubmed: 23694752
doi: 10.1016/j.bandc.2013.04.009
Kemper, S. & Liu, C. J. Eye movements of young and older adults during reading. Psychol. Aging 22(1), 84–93 (2007).
pubmed: 17385986
pmcid: 2258421
doi: 10.1037/0882-7974.22.1.84
Yang, H., Ma, W. Y., Gong, D. K., Hu, J. H. & Yao, D. Z. A longitudinal study on children’s music training experience and academic development. Sci. Rep. 4, 1–7 (2014).