The AudioMaze: An EEG and motion capture study of human spatial navigation in sparse augmented reality.
EEG ERP
effective connectivity
navigation
Journal
The European journal of neuroscience
ISSN: 1460-9568
Titre abrégé: Eur J Neurosci
Pays: France
ID NLM: 8918110
Informations de publication
Date de publication:
12 2021
12 2021
Historique:
revised:
21
12
2020
received:
22
07
2020
accepted:
19
01
2021
pubmed:
27
1
2021
medline:
9
4
2022
entrez:
26
1
2021
Statut:
ppublish
Résumé
Spatial navigation is one of the fundamental cognitive functions central to survival in most animals. Studies in humans investigating the neural foundations of spatial navigation traditionally use stationary, desk-top protocols revealing the hippocampus, parahippocampal place area (PPA), and retrosplenial complex to be involved in navigation. However, brain dynamics, while freely navigating the real world remain poorly understood. To address this issue, we developed a novel paradigm, the AudioMaze, in which participants freely explore a room-sized virtual maze, while EEG is recorded synchronized to motion capture. Participants (n = 16) were blindfolded and explored different mazes, each in three successive trials, using their right hand as a probe to "feel" for virtual maze walls. When their hand "neared" a virtual wall, they received directional noise feedback. Evidence for spatial learning include shortening of time spent and an increase of movement velocity as the same maze was repeatedly explored. Theta-band EEG power in or near the right lingual gyrus, the posterior portion of the PPA, decreased across trials, potentially reflecting the spatial learning. Effective connectivity analysis revealed directed information flow from the lingual gyrus to the midcingulate cortex, which may indicate an updating process that integrates spatial information with future action. To conclude, we found behavioral evidence of navigational learning in a sparse-AR environment, and a neural correlate of navigational learning was found near the lingual gyrus.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Pagination
8283-8307Informations de copyright
© 2021 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.
Références
Adrian, E. D., & Matthews, B. H. C. (1934). The berger rhythm: Potential changes from the occipital lobes in man. Brain, 57, 355-385. https://doi.org/10.1093/brain/57.4.355
Akalin Acar, Z., Acar, C. E., & Makeig, S. (2016). Simultaneous head tissue conductivity and EEG source location estimation. Neuroimage, 124, 168-180.
Akalin Acar, Z., & Makeig, S. (2013). Effects of forward model errors on EEG source localization. Brain Topography, 26, 378-396. https://doi.org/10.1007/s10548-012-0274-6
Alexander, W. H., & Brown, J. W. (2011). Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience, 14, 1338-1344.
Babiloni, C., Vecchio, F., Mirabella, G., Buttiglione, M., Sebastiano, F., Picardi, A., Di Gennaro, G., Quarato, P. P., Grammaldo, L. G., Buffo, P., Esposito, V., Manfredi, M., Cantore, G., & Eusebi, F. (2009). Hippocampal, amygdala, and neocortical synchronization of theta rhythms is related to an immediate recall during rey auditory verbal learning test. Human Brain Mapping, 30, 2077-2089. https://doi.org/10.1002/hbm.20648
Bell, A. J., & Sejnowski, T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7, 1129-1159.
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57, 289-300.
Bischof, W. F., & Boulanger, P. (2003). Spatial navigation in virtual reality environments: AN EEG analysis. CyberPsychology & Behavior, 6, 487-495. https://doi.org/10.1089/109493103769710514
Blum, S., Jacobsen, N. S. J., Bleichner, M. G., & Debener, S. (2019). A riemannian modification of artifact subspace reconstruction for EEG artifact handling. Frontiers in Human Neuroscience, 13, 141.
Bohbot, V. D., Copara, M. S., Gotman, J., & Ekstrom, A. D. (2017). Low-frequency theta oscillations in the human hippocampus during real-world and virtual navigation. Nature Communications, 8, 14415.
Bohbot, V. D., Lerch, J., Thorndycraft, B., Iaria, G., & Zijdenbos, A. P. (2007). Gray matter differences correlate with spontaneous strategies in a human virtual navigation task. Journal of Neuroscience, 27, 10078-10083.
Botvinick, M. M. (2007). Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function. Cognitive, Affective, & Behavioural Neuroscience, 7, 356-366. https://doi.org/10.3758/CABN.7.4.356
Buzsaki, G. (2005). Theta rhythm of navigation: Link between path integration and landmark navigation, episodic and semantic memory. Hippocampus, 15, 827-840. https://doi.org/10.1002/hipo.20113
Buzsáki, G. (2005). Theta rhythm of navigation: Link between path integration and landmark navigation, episodic and semantic memory. Hippocampus, 15, 827-840. https://doi.org/10.1002/hipo.20113
Caplan, J. B., Madsen, J. R., Schulze-Bonhage, A., Aschenbrenner-Scheibe, R., Newman, E. L., & Kahana, M. J. (2003). Human theta oscillations related to sensorimotor integration and spatial learning. Journal of Neuroscience, 23, 4726-4736.
Challis, J. H. (1995). A procedure for determining rigid body transformation parameters. Journal of Biomechanics, 28, 733-737.
Chang, C.-Y., Hsu, S.-H., Pion-Tonachini, L., & Jung, T.-P. (2018a). Evaluation of artifact subspace reconstruction for automatic EEG artifact removal. Conference Proceedings - IEEE Engineering in Medicine and Biology Society, 2018, 1242-1245.
Chang, C.-Y., Hsu, S.-H., Pion-Tonachini, L., & Jung, T.-P. (2018b) Evaluation of Artifact Subspace Reconstruction for Automatic EEG Artifact Removal.
Chang, C.-Y., Hsu, S.-H., Pion-Tonachini, L., & Jung, T.-P. (2019). Evaluation of Artifact Subspace Reconstruction for Automatic Artifact Components Removal in Multi-channel EEG Recordings. IEEE Trans. Biomed. Eng.
Chiu, T.-C., Gramann, K., Ko, L.-W., Duann, J.-R., Jung, T.-P., & Lin, C.-T. (2012). Alpha modulation in parietal and retrosplenial cortex correlates with navigation performance. Psychophysiology, 49, 43-55. https://doi.org/10.1111/j.1469-8986.2011.01270.x
Collins, D. L., Neelin, P., Peters, T. M., & Evans, A. C. (1994). Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space. Journal of Computer Assisted Tomography, 18, 192-205. https://doi.org/10.1097/00004728-199403000-00005
de Araújo, D. B., Baffa, O., & Wakai, R. T. (2002). Theta oscillations and human navigation: A magnetoencephalography study. Journal of Cognitive Neuroscience, 14, 70-78.
Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134, 9-21.
Delorme, A., Palmer, J., Onton, J., Oostenveld, R., & Makeig, S. (2012). Independent EEG sources are dipolar. PLoS One, 7, e30135. https://doi.org/10.1371/journal.pone.0030135
Duann, J.-R., Ide, J. S., Luo, X., & Li, C. R. (2009). Functional connectivity delineates distinct roles of the inferior frontal cortex and presupplementary motor area in stop signal inhibition. Journal of Neuroscience, 29, 10171-10179.
Ekstrom, A. D., Caplan, J. B., Ho, E., Shattuck, K., Fried, I., & Kahana, M. J. (2005). Human hippocampal theta activity during virtual navigation. Hippocampus, 15, 881-889. https://doi.org/10.1002/hipo.20109
Ekstrom, A. D., Kahana, M. J., Caplan, J. B., Fields, T. A., Isham, E. A., Newman, E. L., & Fried, I. (2003). Cellular networks underlying human spatial navigation. Nature, 425, 184-188. https://doi.org/10.1038/nature01964
Epstein, R. A. (2008). Parahippocampal and retrosplenial contributions to human spatial navigation. Trends in Cognitive Sciences. (Regul. Ed.), 12, 388-396.
Epstein, R., Graham, K. S., & Downing, P. E. (2003). Viewpoint-specific scene representations in human parahippocampal cortex. Neuron, 37, 865-876. https://doi.org/10.1016/S0896-6273(03)00117-X
Epstein, R. A., Higgins, J. S., Jablonski, K., & Feiler, A. M. (2007). Visual scene processing in familiar and unfamiliar environments. Journal of Neurophysiology, 97, 3670-3683.
Epstein, R. A., Higgins, J. S., & Thompson-Schill, S. L. (2005). Learning places from views: Variation in scene processing as a function of experience and navigational ability. Journal of Cognitive Neuroscience, 17, 73-83. https://doi.org/10.1162/0898929052879987
Epstein, R., & Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature, 392, 598-601. https://doi.org/10.1038/33402
Epstein, R. A., Patai, E. Z., Julian, J. B., & Spiers, H. J. (2017). The cognitive map in humans: Spatial navigation and beyond. Nature Neuroscience, 20, 1504-1513.
Evans, A. C., Collins, D. L., Mills, S. R., Brown, E. D., Kelly, R. L., & Peters, T. M. (1993). 3D statistical neuroanatomical models from 305 MRI volumes. In 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference. Presented at the 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference, IEEE, pp. 1813-1817.
Ewbank, M. P., Schluppeck, D., & Andrews, T. J. (2005). fMR-adaptation reveals a distributed representation of inanimate objects and places in human visual cortex. NeuroImage, 28, 268-279. https://doi.org/10.1016/j.neuroimage.2005.06.036
Gabard-Durnam, L. J., Mendez Leal, A. S., Wilkinson, C. L., & Levin, A. R. (2018). The Harvard automated processing pipeline for electroencephalography (HAPPE): Standardized Processing Software for Developmental and High-Artifact Data. Frontiers in Neuroscience, 12, 97. https://doi.org/10.3389/fnins.2018.00097
Ghaem, O., Mellet, E., Crivello, F., Tzourio, N., Mazoyer, B., Berthoz, A., & Denis, M. (1997). Mental navigation along memorized routes activates the hippocampus, precuneus, and insula. NeuroReport, 8, 739-744. https://doi.org/10.1097/00001756-199702100-00032
Goeke, C., Kornpetpanee, S., Köster, M., Fernández-Revelles, A. B., Gramann, K., & König, P. (2015). Cultural background shapes spatial reference frame proclivity. Scientific Reports, 5, 11426.
Golub, G. H., & Reinsch, C. (1971). Singular value decomposition and least squares solutions. In F. L. Bauer, A. S. Householder, F. W. J. Olver, H. Rutishauser, K. Samelson, & E. Stiefel (Eds.), Handbook for automatic computation (pp. 134-151). Springer Berlin Heidelberg.
Gramann, K. (2013). Embodiment of spatial reference frames and individual differences in reference frame proclivity. Spatial Cognition & Computation, 13, 1-25. https://doi.org/10.1080/13875868.2011.589038
Gramann, K., Gwin, J. T., Ferris, D. P., Oie, K., Jung, T.-P., Lin, C.-T., Liao, L.-D., & Makeig, S. (2011). Cognition in action: Imaging brain/body dynamics in mobile humans. Reviews in the Neurosciences, 22, 593-608.
Gramann, K., Jung, T.-P., Ferris, D. P., Lin, C.-T., & Makeig, S. (2014). Toward a new cognitive neuroscience: Modeling natural brain dynamics. Frontiers in Human Neuroscience, 8, 444.
Gramann, K., Müller, H. J., Eick, E.-M., & Schönebeck, B. (2005). Evidence of separable spatial representations in a virtual navigation task. Journal of Experimental Psychology: Human Perception and Performance, 31, 1199-1223.
Gramann, K., Onton, J., Riccobon, D., Mueller, H. J., Bardins, S., & Makeig, S. (2010). Human brain dynamics accompanying use of egocentric and allocentric reference frames during navigation. Journal of Cognitive Neuroscience, 22, 2836-2849.
Grön, G., Wunderlich, A. P., Spitzer, M., Tomczak, R., & Riepe, M. W. (2000). Brain activation during human navigation: Gender-different neural networks as substrate of performance. Nature Neuroscience, 3, 404-408. https://doi.org/10.1038/73980
Groppe, D. M., Urbach, T. P., & Kutas, M. (2011). Mass univariate analysis of event-related brain potentials/fields I: A critical tutorial review. Psychophysiology, 48, 1711-1725. https://doi.org/10.1111/j.1469-8986.2011.01273.x
Gwin, J. T., Gramann, K., Makeig, S., & Ferris, D. P. (2010). Removal of movement artifact from high-density EEG recorded during walking and running. Journal of Neurophysiology, 103, 3526-3534.
Iaria, G., Petrides, M., Dagher, A., Pike, B., & Bohbot, V. D. (2003). Cognitive strategies dependent on the hippocampus and caudate nucleus in human navigation: Variability and change with practice. Journal of Neuroscience, 23, 5945-5952. https://doi.org/10.1523/JNEUROSCI.23-13-05945.2003
Janzen, G., & van Turennout, M. (2004). Selective neural representation of objects relevant for navigation. Nature Neuroscience, 7, 673-677.
Jasper, H. H., & Andrews, H. L. (1938). Electro-encephalography III. Normal differentiation of occipital and Precentral regions in man. Archives of Neurology & Psychiatry, 39, 96. https://doi.org/10.1001/archneurpsyc.1938.02270010106010
Kahana, M. J., Seelig, D., & Madsen, J. R. (2001). Theta returns. Current Opinion in Neurobiology, 11, 739-744.
Kahana, M. J., Sekuler, R., Caplan, J. B., Kirschen, M., & Madsen, J. R. (1999). Human theta oscillations exhibit task dependence during virtual maze navigation. Nature, 399, 781-784. https://doi.org/10.1038/21645
Khamassi, M., Quilodran, R., Enel, P., Dominey, P. F., & Procyk, E. (2015). Behavioral regulation and the modulation of information coding in the lateral prefrontal and cingulate cortex. Cerebral Cortex, 25, 3197-3218. https://doi.org/10.1093/cercor/bhu114
Klopp, J., Marinkovic, K., Clarke, J., Chauvel, P., Nenov, V., & Halgren, E. (2001). Timing and localization of movement-related spectral changes in the human peri-Rolandic cortex: Intracranial recordings. NeuroImage, 14, 391-405. https://doi.org/10.1006/nimg.2001.0828
Koshiyama, D., Miyakoshi, M., Joshi, Y. B., Molina, J. L., Tanaka-Koshiyama, K., Sprock, J., Braff, D. L., Swerdlow, N. R., & Light, G. A. (2020). Abnormal effective connectivity underlying auditory mismatch negativity impairments in schizophrenia. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 5, 1028-1039.
Kothe, C. A., & Makeig, S. (2013). BCILAB: A platform for brain-computer interface development. Journal of Neural Engineering, 10, 056014.
Lancaster, J. L., Woldorff, M. G., Parsons, L. M., Liotti, M., Freitas, C. S., Rainey, L., Kochunov, P. V., Nickerson, D., Mikiten, S. A., & Fox, P. T. (2000). Automated Talairach atlas labels for functional brain mapping. Human Brain Mapping, 10, 120-131.
Li, C. R., Huang, C., Constable, R. T., & Sinha, R. (2006). Imaging response inhibition in a stop-signal task: Neural correlates independent of signal monitoring and post-response processing. Journal of Neuroscience, 26, 186-192.
Lin, C. T., Chiu, T. C., & Gramann, K. (2015). EEG correlates of spatial orientation in the human retrosplenial complex. NeuroImage, 120, 123-132. https://doi.org/10.1016/j.neuroimage.2015.07.009
Loo, S. K., Miyakoshi, M., Tung, K., Lloyd, E., Salgari, G., Dillon, A., Chang, S., Piacentini, J., & Makeig, S. (2019). Neural activation and connectivity during cued eye blinks in Chronic Tic Disorders. NeuroImage Clinical, 24, 101956.
Maguire, E. A., Burgess, N., Donnett, J. G., Frackowiak, R. S., Frith, C. D., & O’Keefe, J. (1998). Knowing where and getting there: A human navigation network. Science, 280, 921-924. https://doi.org/10.1126/science.280.5365.921
Maguire, E. A., Frackowiak, R. S., & Frith, C. D. (1997). Recalling routes around london: Activation of the right hippocampus in taxi drivers. Journal of Neuroscience, 17, 7103-7110. https://doi.org/10.1523/JNEUROSCI.17-18-07103.1997
Makeig, S., Bell, A., Jung, T.-P., & Sejnowski, T. (1996). Independent component analysis of electroencephalographic data. Advances in Neural Information Processing Systems, 8, 145-151.
Makeig, S., Gramann, K., Jung, T.-P., Sejnowski, T. J., & Poizner, H. (2009). Linking brain, mind and behavior. International Journal of Psychophysiology, 73, 95-100.
Makeig, S., & Onton, J. (2011). ERP features and EEG dynamics, Oxford Handbooks Online. Oxford University Press.
McNaughton, B. L., Barnes, C. A., & O’Keefe, J. (1983). The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats. Experimental Brain Research, 52, 41-49.
Moffat, S. D., Kennedy, K. M., Rodrigue, K. M., & Raz, N. (2007). Extra hippocampal contributions to age differences in human spatial navigation. Cerebral Cortex, 17, 1274-1282. https://doi.org/10.1093/cercor/bhl036
Mullen, T. (2014). The Dynamic Brain: Modeling Neural Dynamics and Interactions From Human Electrophysiological Recordings (Doctoral dissertation).
Mullen, T. R., Kothe, C. A. E., Chi, Y. M., Ojeda, A., Kerth, T., Makeig, S., Jung, T.-P., & Cauwenberghs, G. (2015). Real-time neuroimaging and cognitive monitoring using wearable dry EEG. IEEE Transactions on Biomedical Engineering, 62, 2553-2567.
Nachev, P., Kennard, C., & Husain, M. (2008). Functional role of the supplementary and pre-supplementary motor areas. Nature Reviews Neuroscience, 9, 856-869.
Nichols, T., & Hayasaka, S. (2003). Controlling the familywise error rate in functional neuroimaging: A comparative review. Statistical Methods in Medical Research, 12, 419-446. https://doi.org/10.1191/0962280203sm341ra
O’Craven, K. M., & Kanwisher, N. (2000). Mental imagery of faces and places activates corresponding stimulus-specific brain regions. Journal of Cognitive Neuroscience, 12, 1013-1023.
Onton, J., & Makeig, S. (2006). Information-based modeling of event-related brain dynamics. Progress in Brain Research, 159, 99-120.
Patel, A. N., Jung, T. P., & Sejnowski, T. J.(2019). A wearable multi-modal bio-sensing system towards real-world applications. IEEE Transactions on Biomedical Engineering, 66, 1137-1147.
Paus, T. (2001). Primate anterior cingulate cortex: Where motor control, drive and cognition interface. Nature Reviews Neuroscience, 2, 417-424.
Piaget, J., & Inhelder, B. (1956) The Child’s Conception of Space. British Journal of Educational Studies. Translation by Langdon, F.J. & Lunzer, J.L. : Routledge & K. Paul. ISBN 0-415-16889 9.
Pion-Tonachini, L., Kreutz-Delgado, K., & Makeig, S. (2019). ICLabel: An automated electroencephalographic independent component classifier, dataset, and website. NeuroImage, 198, 181-197. https://doi.org/10.1016/j.neuroimage.2019.05.026
Plechawska-Wojcik, M., Kaczorowska, M., & Zapala, D. (2019). The artifact subspace reconstruction (ASR) for EEG signal correction. A comparative study. In Świątek, J., Borzemski, L., & Wilimowska, Z. (eds), Information systems architecture and technology: proceedings of 39th international conference on information systems architecture and technology - ISAT 2018: part II, Advances in intelligent systems and computing. Springer International Publishing, Cham, pp. 125-135
Procyk, E., Wilson, C. R. E., Stoll, F. M., Faraut, M. C. M., Petrides, M., & Amiez, C. (2016). Midcingulate motor map and feedback detection: Converging data from humans and monkeys. Cerebral Cortex, 26, 467-476.
Rosenbaum, R. S., Ziegler, M., Winocur, G., Grady, C. L., & Moscovitch, M. (2004). I have often walked down this street before": fMRI studies on the hippocampus and other structures during mental navigation of an old environment. Hippocampus, 14, 826-835. https://doi.org/10.1002/hipo.10218
Rousseeuw, P. J. (1987). Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics, 20, 53-65. https://doi.org/10.1016/0377-0427(87)90125-7
Rushworth, M. F. S., Kolling, N., Sallet, J., & Mars, R. B. (2012). Valuation and decision-making in frontal cortex: One or many serial or parallel systems? Current Opinion in Neurobiology, 22, 946-955.
Schelter, B., Timmer, J., & Eichler, M. (2009). Assessing the strength of directed influences among neural signals using renormalized partial directed coherence. Journal of Neuroscience Methods, 179, 121-130.
Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S., & Puce, A. (2008). Neuronal oscillations and visual amplification of speech. Trends in Cognitive Sciences (Regul., Ed.), 12, 106-113.
Shackman, A. J., Salomons, T. V., Slagter, H. A., Fox, A. S., Winter, J. J., & Davidson, R. J. (2011). The integration of negative affect, pain and cognitive control in the cingulate cortex. Nature Reviews Neuroscience, 12, 154-167.
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013). The expected value of control: An integrative theory of anterior cingulate cortex function. Neuron, 79, 217-240. https://doi.org/10.1016/j.neuron.2013.07.007
Snider, J., Plank, M., Lynch, G., Halgren, E., & Poizner, H. (2013). Human cortical θ during free exploration encodes space and predicts subsequent memory. Journal of Neuroscience, 33, 15056-15068.
Spiers, H. J., & Maguire, E. A. (2006). Thoughts, behaviour, and brain dynamics during navigation in the real world. NeuroImage, 31(4), 1826-1840. https://doi.org/10.1016/j.neuroimage.2006.01.037
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyer, B., & Joliot, M. (2002). Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage, 15, 273-289. https://doi.org/10.1006/nimg.2001.0978
Vann, S. D., Aggleton, J. P., & Maguire, E. A. (2009). What does the retrosplenial cortex do? Nature Reviews Neuroscience, 10(11), 792-802. https://doi.org/10.1038/nrn2733
Wiener, S. I., Paul, C. A., & Eichenbaum, H. (1989). Spatial and behavioral correlates of hippocampal neuronal activity. Journal of Neuroscience, 9, 2737-2763.
Wolbers, T., & Hegarty, M. (2010). What determines our navigational abilities? Trends in Cognitive Sciences (regul. Ed.), 14, 138-146.