The brain hierarchically represents the past and future during multistep anticipation.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
22 Oct 2024
22 Oct 2024
Historique:
received:
18
08
2023
accepted:
01
10
2024
medline:
23
10
2024
pubmed:
23
10
2024
entrez:
22
10
2024
Statut:
epublish
Résumé
Memory for temporal structure enables both planning of future events and retrospection of past events. We investigated how the brain flexibly represents extended temporal sequences into the past and future during anticipation. Participants learned sequences of environments in immersive virtual reality. Pairs of sequences had the same environments in a different order, enabling context-specific learning. During fMRI, participants anticipated upcoming environments multiple steps into the future in a given sequence. Temporal structure was represented in the hippocampus and across higher-order visual regions (1) bidirectionally, with graded representations into the past and future and (2) hierarchically, with further events into the past and future represented in successively more anterior brain regions. In hippocampus, these bidirectional representations were context-specific, and suppression of far-away environments predicted response time costs in anticipation. Together, this work sheds light on how we flexibly represent sequential structure to enable planning over multiple timescales.
Identifiants
pubmed: 39438448
doi: 10.1038/s41467-024-53293-3
pii: 10.1038/s41467-024-53293-3
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
9094Informations de copyright
© 2024. The Author(s).
Références
Tolman, E. C. Cognitive maps in rats and men. Psychol. Rev. 55, 189–208 (1948).
pubmed: 18870876
doi: 10.1037/h0061626
Stachenfeld, K. L., Botvinick, M. M. & Gershman, S. J. The hippocampus as a predictive map. Nat. Neurosci. 20, 1643–1653 (2017).
pubmed: 28967910
doi: 10.1038/nn.4650
Behrens, T. E. J. et al. What is a cognitive map? organizing knowledge for flexible behavior. Neuron 100, 490–509 (2018).
pubmed: 30359611
doi: 10.1016/j.neuron.2018.10.002
Momennejad, I. Learning structures: predictive representations, replay, and generalization. Curr. Opin. Behav. Sci. 32, 155–166 (2020).
pubmed: 35419465
pmcid: 9004662
doi: 10.1016/j.cobeha.2020.02.017
Buckner, R. L. The role of the hippocampus in prediction and imagination. Annu. Rev. Psychol. 61, 27–48 (2010).
pubmed: 19958178
doi: 10.1146/annurev.psych.60.110707.163508
Clark, A. Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 36, 181–204 (2013).
pubmed: 23663408
doi: 10.1017/S0140525X12000477
Friston, K. A theory of cortical responses. Philos. Trans. R. Soc. B Biol. Sci. 360, 815–836 (2005).
doi: 10.1098/rstb.2005.1622
Summerfield, C. & Egner, T. Expectation (and attention) in visual cognition. Trends Cogn. Sci. 13, 403–409 (2009).
pubmed: 19716752
doi: 10.1016/j.tics.2009.06.003
Lisman, J. & Redish, A. D. Prediction, sequences and the hippocampus. Philos. Trans. R. Soc. B Biol. Sci. 364, 1193–1201 (2009).
doi: 10.1098/rstb.2008.0316
Ouden, H. E. M., den, Daunizeau, J., Roiser, J., Friston, K. J. & Stephan, K. E. Striatal Prediction Error Modulates Cortical Coupling. J. Neurosci. 30, 3210–3219 (2010).
doi: 10.1523/JNEUROSCI.4458-09.2010
De Lange, F. P., Heilbron, M. & Kok, P. How do expectations shape perception? Trends Cogn. Sci. 22, 764–779 (2018).
pubmed: 30122170
doi: 10.1016/j.tics.2018.06.002
Lee, C. S., Aly, M. & Baldassano, C. Anticipation of temporally structured events in the brain. eLife 10, e64972 (2021).
pubmed: 33884953
pmcid: 8169103
doi: 10.7554/eLife.64972
Kok, P., Jehee, J. F. M. & de Lange, F. P. Less is more: expectation sharpens representations in the primary visual cortex. Neuron 75, 265–270 (2012).
pubmed: 22841311
doi: 10.1016/j.neuron.2012.04.034
Kok, P., Failing, M. F. & de Lange, F. P. Prior expectations evoke stimulus templates in the primary visual cortex. J. Cogn. Neurosci. 26, 1546–1554 (2014).
pubmed: 24392894
doi: 10.1162/jocn_a_00562
Gavornik, J. P. & Bear, M. F. Learned spatiotemporal sequence recognition and prediction in primary visual cortex. Nat. Neurosci. 17, 732–737 (2014).
pubmed: 24657967
pmcid: 4167369
doi: 10.1038/nn.3683
Hindy, N. C., Ng, F. Y. & Turk-Browne, N. B. Linking pattern completion in the hippocampus to predictive coding in visual cortex. Nat. Neurosci. 19, 665–667 (2016).
pubmed: 27065363
pmcid: 4948994
doi: 10.1038/nn.4284
Schapiro, A. C., Kustner, L. V. & Turk-Browne, N. B. Shaping of object representations in the human medial temporal lobe based on temporal regularities. Curr. Biol. 22, 1622–1627 (2012).
pubmed: 22885059
pmcid: 3443305
doi: 10.1016/j.cub.2012.06.056
Davachi, L. & DuBrow, S. How the hippocampus preserves order: the role of prediction and context. Trends Cogn. Sci. 19, 92–99 (2015).
pubmed: 25600586
pmcid: 4380862
doi: 10.1016/j.tics.2014.12.004
Brown, T. I. et al. Prospective representation of navigational goals in the human hippocampus. Science 352, 1323–1326 (2016).
pubmed: 27284194
doi: 10.1126/science.aaf0784
Kok, P. & Turk-Browne, N. B. Associative prediction of visual shape in the hippocampus. J. Neurosci. 38, 6888–6899 (2018).
pubmed: 29986875
pmcid: 6070666
doi: 10.1523/JNEUROSCI.0163-18.2018
Aitken, F. & Kok, P. Hippocampal representations switch from errors to predictions during acquisition of predictive associations. Nat. Commun. 13, 3294 (2022).
pubmed: 35676285
pmcid: 9178037
doi: 10.1038/s41467-022-31040-w
Brunec, I. K. & Momennejad, I. Predictive representations in hippocampal and prefrontal hierarchies. J. Neurosci. 42, 299–312 (2022).
pubmed: 34799416
pmcid: 8802932
doi: 10.1523/JNEUROSCI.1327-21.2021
Singer, T., Critchley, H. D. & Preuschoff, K. A common role of insula in feelings, empathy and uncertainty. Trends Cogn. Sci. 13, 334–340 (2009).
pubmed: 19643659
doi: 10.1016/j.tics.2009.05.001
Momennejad, I. & Howard, M. W. Predicting the future with multi-scale successor representations. 449470 Preprint at https://doi.org/10.1101/449470 (2018).
Hasson, U., Chen, J. & Honey, C. J. Hierarchical process memory: memory as an integral component of information processing. Trends Cogn. Sci. 19, 304–313 (2015).
pubmed: 25980649
pmcid: 4457571
doi: 10.1016/j.tics.2015.04.006
Hasson, U., Yang, E., Vallines, I., Heeger, D. J. & Rubin, N. A hierarchy of temporal receptive windows in human cortex. J. Neurosci. 28, 2539–2550 (2008).
pubmed: 18322098
pmcid: 2556707
doi: 10.1523/JNEUROSCI.5487-07.2008
Lerner, Y., Honey, C. J., Silbert, L. J. & Hasson, U. Topographic mapping of a hierarchy of temporal receptive windows using a narrated story. J. Neurosci. 31, 2906–2915 (2011).
pubmed: 21414912
pmcid: 3089381
doi: 10.1523/JNEUROSCI.3684-10.2011
Baldassano, C. et al. Discovering event structure in continuous narrative perception and memory. Neuron 95, 709–721.e5 (2017).
pubmed: 28772125
pmcid: 5558154
doi: 10.1016/j.neuron.2017.06.041
Aly, M., Chen, J., Turk-Browne, N. B. & Hasson, U. Learning naturalistic temporal structure in the posterior medial network. J. Cogn. Neurosci. 30, 1345–1365 (2018).
pubmed: 30004848
pmcid: 6211568
doi: 10.1162/jocn_a_01308
Foster, D. J. & Wilson, M. A. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440, 680–683 (2006).
pubmed: 16474382
doi: 10.1038/nature04587
Diba, K. & Buzsáki, G. Forward and reverse hippocampal place-cell sequences during ripples. Nat. Neurosci. 10, 1241–1242 (2007).
pubmed: 17828259
pmcid: 2039924
doi: 10.1038/nn1961
Jadhav, S. P., Kemere, C., German, P. W. & Frank, L. M. Awake hippocampal sharp-wave ripples support spatial memory. Science 336, 1454–1458 (2012).
pubmed: 22555434
pmcid: 4441285
doi: 10.1126/science.1217230
Ólafsdóttir, H. F., Bush, D. & Barry, C. The role of hippocampal replay in memory and planning. Curr. Biol. 28, R37–R50 (2018).
pubmed: 29316421
pmcid: 5847173
doi: 10.1016/j.cub.2017.10.073
Wimmer, G. E., Liu, Y., Vehar, N., Behrens, T. E. J. & Dolan, R. J. Episodic memory retrieval success is associated with rapid replay of episode content. Nat. Neurosci. 23, 1025–1033 (2020).
pubmed: 32514135
pmcid: 7610376
doi: 10.1038/s41593-020-0649-z
Montagrin, A. et al. The hippocampus dissociates present from past and future goals. Nat. Commun. 15, 4815 (2024).
pubmed: 38844456
pmcid: 11156658
doi: 10.1038/s41467-024-48648-9
Manning, J. R., Polyn, S. M., Baltuch, G. H., Litt, B. & Kahana, M. J. Oscillatory patterns in temporal lobe reveal context reinstatement during memory search. Proc. Natl Acad. Sci. USA 108, 12893–12897 (2011).
pubmed: 21737744
pmcid: 3150951
doi: 10.1073/pnas.1015174108
Sederberg, P. B., Howard, M. W. & Kahana, M. J. A context-based theory of recency and contiguity in free recall. Psychol. Rev. 115, 893–912 (2008).
pubmed: 18954208
pmcid: 2585999
doi: 10.1037/a0013396
Crivelli-Decker, J. et al. Goal-oriented representations in the human hippocampus during planning and navigation. Nat. Commun. 14, 2946 (2023).
pubmed: 37221176
pmcid: 10206082
doi: 10.1038/s41467-023-35967-6
Tarder-Stoll, H., Baldassano, C. & Aly, M. Consolidation enhances sequential multistep anticipation but diminishes access to perceptual features. Psychological Science 35, 1178–1199 (2024).
Epstein, R. A. Parahippocampal and retrosplenial contributions to human spatial navigation. Trends Cogn. Sci. 12, 388–396 (2008).
pubmed: 18760955
pmcid: 2858632
doi: 10.1016/j.tics.2008.07.004
Steel, A., Billings, M. M., Silson, E. H. & Robertson, C. E. A network linking scene perception and spatial memory systems in posterior cerebral cortex. Nat. Commun. 12, 2632 (2021).
pubmed: 33976141
pmcid: 8113503
doi: 10.1038/s41467-021-22848-z
Baldassano, C., Beck, D. M. & Fei-Fei, L. Differential connectivity within the Parahippocampal Place Area. NeuroImage 75, 228–237 (2013).
pubmed: 23507385
doi: 10.1016/j.neuroimage.2013.02.073
Silson, E. H. et al. A posterior–anterior distinction between scene perception and scene construction in human medial parietal cortex. J. Neurosci. 39, 705–717 (2019).
pubmed: 30504281
pmcid: 6343650
doi: 10.1523/JNEUROSCI.1219-18.2018
Himberger, K. D., Chien, H.-Y. & Honey, C. J. Principles of temporal processing across the cortical hierarchy. Neuroscience 389, 161–174 (2018).
pubmed: 29729293
doi: 10.1016/j.neuroscience.2018.04.030
Dayan, P. Improving generalization for temporal difference learning: the successor representation. Neural Comput 5, 613–624 (1993).
doi: 10.1162/neco.1993.5.4.613
Momennejad, I. et al. The successor representation in human reinforcement learning. Nat. Hum. Behav. 1, 680–692 (2017).
pubmed: 31024137
pmcid: 6941356
doi: 10.1038/s41562-017-0180-8
Ekman, M., Kusch, S. & de Lange, F. P. Successor-like representation guides the prediction of future events in human visual cortex and hippocampus. eLife 12, e78904 (2023).
pubmed: 36729024
pmcid: 9894584
doi: 10.7554/eLife.78904
Gershman, S. J. The successor representation: its computational logic and neural substrates. J. Neurosci. J. Soc. Neurosci. 38, 7193–7200 (2018).
doi: 10.1523/JNEUROSCI.0151-18.2018
Deuker, L., Bellmund, J. L., Navarro Schröder, T. & Doeller, C. F. An event map of memory space in the hippocampus. eLife 5, e16534 (2016).
pubmed: 27710766
pmcid: 5053807
doi: 10.7554/eLife.16534
Fernandez, C., Jiang, J., Wang, S.-F., Choi, H. L. & Wagner, A. D. Representational integration and differentiation in the human hippocampus following goal-directed navigation. eLife 12, e80281 (2023).
pubmed: 36786678
pmcid: 9928422
doi: 10.7554/eLife.80281
Michelmann, S., Hasson, U. & Norman, K. A. Evidence that event boundaries are access points for memory retrieval. Psychol. Sci. 34, 326–344 (2023).
pubmed: 36595492
pmcid: 10152118
doi: 10.1177/09567976221128206
Elliott Wimmer, G. & Büchel, C. Learning of distant state predictions by the orbitofrontal cortex in humans. Nat. Commun. 10, 2554 (2019).
pubmed: 31186425
pmcid: 6560030
doi: 10.1038/s41467-019-10597-z
Turk-Browne, N. B., Simon, M. G. & Sederberg, P. B. Scene representations in parahippocampal cortex depend on temporal context. J. Neurosci. 32, 7202–7207 (2012).
pubmed: 22623664
pmcid: 3373994
doi: 10.1523/JNEUROSCI.0942-12.2012
Aminoff, E., Gronau, N. & Bar, M. The parahippocampal cortex mediates spatial and nonspatial associations. Cereb. Cortex 17, 1493–1503 (2007).
pubmed: 16990438
doi: 10.1093/cercor/bhl078
Bar, M., Aminoff, E. & Schacter, D. L. Scenes unseen: the parahippocampal cortex intrinsically subserves contextual associations, not scenes or places per se. J. Neurosci. 28, 8539–8544 (2008).
pubmed: 18716212
pmcid: 2707255
doi: 10.1523/JNEUROSCI.0987-08.2008
Aminoff, E. M., Kveraga, K. & Bar, M. The role of the parahippocampal cortex in cognition. Trends Cogn. Sci. 17, 379–390 (2013).
pubmed: 23850264
pmcid: 3786097
doi: 10.1016/j.tics.2013.06.009
Marchette, S. A., Vass, L. K., Ryan, J. & Epstein, R. A. Outside looking in: landmark generalization in the human navigational system. J. Neurosci. 35, 14896–14908 (2015).
pubmed: 26538658
pmcid: 4635136
doi: 10.1523/JNEUROSCI.2270-15.2015
Koch, G. E., Paulus, J. P. & Coutanche, M. N. Neural patterns are more similar across individuals during successful memory encoding than during failed memory encoding. Cereb. Cortex 30, 3872–3883 (2020).
pubmed: 32147702
pmcid: 7264691
doi: 10.1093/cercor/bhaa003
Chen, H.-T., Manning, J. R. & van der Meer, M. A. A. Between-subject prediction reveals a shared representational geometry in the rodent hippocampus. Curr. Biol. 31, 4293–4304.e5 (2021).
pubmed: 34428470
doi: 10.1016/j.cub.2021.07.061
Aly, M. & Turk-Browne, N. B. Attention promotes episodic encoding by stabilizing hippocampal representations. Proc. Natl Acad. Sci. USA 113, E420–E429 (2016).
pubmed: 26755611
pmcid: 4743819
doi: 10.1073/pnas.1518931113
Aly, M. & Turk-Browne, N. B. Attention stabilizes representations in the human hippocampus. Cereb. Cortex 26, 783–796 (2016).
pubmed: 25766839
Günseli, E. & Aly, M. Preparation for upcoming attentional states in the hippocampus and medial prefrontal cortex. eLife 9, e53191 (2020).
pubmed: 32255423
pmcid: 7237206
doi: 10.7554/eLife.53191
Lee, A. C., Yeung, L.-K. & Barense, M. D. The hippocampus and visual perception. Front. Hum. Neurosci. 6, https://doi.org/10.3389/fnhum.2012.00091 (2012).
McCormick, C., Dalton, M. A., Zeidman, P. & Maguire, E. A. Characterising the hippocampal response to perception, construction and complexity. Cortex 137, 1–17 (2021).
pubmed: 33571913
pmcid: 8048772
doi: 10.1016/j.cortex.2020.12.018
Ruiz, N. A., Meager, M. R., Agarwal, S. & Aly, M. The medial temporal lobe is critical for spatial relational perception. J. Cogn. Neurosci. 32, 1780–1795 (2020).
pubmed: 32427068
doi: 10.1162/jocn_a_01583
Leferink, C. A. et al. Organization of pRF size along the AP axis of the hippocampus and adjacent medial temporal cortex is related to specialization for scenes versus faces. Cereb. Cortex 34, bhad429 (2024).
pubmed: 37991278
doi: 10.1093/cercor/bhad429
Knapen, T. Topographic connectivity reveals task-dependent retinotopic processing throughout the human brain. Proc. Natl Acad. Sci. USA 118, e2017032118 (2021).
pubmed: 33372144
doi: 10.1073/pnas.2017032118
Silson, E. H., Zeidman, P., Knapen, T. & Baker, C. I. Representation of contralateral visual space in the human hippocampus. J. Neurosci. 41, 2382–2392 (2021).
pubmed: 33500275
pmcid: 7984600
doi: 10.1523/JNEUROSCI.1990-20.2020
Chen, J. et al. Shared memories reveal shared structure in neural activity across individuals. Nat. Neurosci. 20, 115–125 (2017).
pubmed: 27918531
doi: 10.1038/nn.4450
Favila, S. E. & Aly, M. Hippocampal mechanisms resolve competition in memory and perception. bioRxiv 2023.10.09.561548 https://doi.org/10.1101/2023.10.09.561548 (2023).
DuBrow, S. & Davachi, L. Temporal memory is shaped by encoding stability and intervening item reactivation. J. Neurosci. 34, 13998–14005 (2014).
pubmed: 25319696
pmcid: 4198540
doi: 10.1523/JNEUROSCI.2535-14.2014
Clewett, D. & Davachi, L. The ebb and flow of experience determines the temporal structure of memory. Curr. Opin. Behav. Sci. 17, 186–193 (2017).
pubmed: 29276730
pmcid: 5739077
doi: 10.1016/j.cobeha.2017.08.013
Peirce, J. et al. PsychoPy2: experiments in behavior made easy. Behav. Res. Methods 51, 195–203 (2019).
pubmed: 30734206
pmcid: 6420413
doi: 10.3758/s13428-018-01193-y
Alsbury-Nealy, K. et al. OpenMaze: An open-source toolbox for creating virtual navigation experiments. Behav. Res. Methods 54, 1374–1387 (2022).
pubmed: 34471962
doi: 10.3758/s13428-021-01664-9
Bates, D., Mächler, M., Bolker, B. & Walker, S. Fitting Linear Mixed-Effects Models using lme4. Preprint at https://doi.org/10.48550/arXiv.1406.5823 (2014).
Esteban, O. et al. fMRIPrep: a robust preprocessing pipeline for functional MRI. Nat. Methods 16, 111–116 (2019).
pubmed: 30532080
doi: 10.1038/s41592-018-0235-4
Esteban, O. et al. nipy/nipype: 1.8.3. Zenodo https://doi.org/10.5281/zenodo.6834519 (2022).
Gorgolewski, K. et al. Nipype: a flexible, lightweight and extensible neuroimaging data processing framework in python. Front. Neuroinformatics 5, (2011).
Tustison, N. J. et al. N4ITK: improved N3 Bias correction. IEEE Trans. Med. Imaging 29, 1310–1320 (2010).
pubmed: 20378467
pmcid: 3071855
doi: 10.1109/TMI.2010.2046908
Avants, B. B., Epstein, C. L., Grossman, M. & Gee, J. C. Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 12, 26–41 (2008).
pubmed: 17659998
doi: 10.1016/j.media.2007.06.004
Zhang, Y., Brady, M. & Smith, S. Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans. Med. Imaging 20, 45–57 (2001).
pubmed: 11293691
doi: 10.1109/42.906424
Dale, A. M., Fischl, B. & Sereno, M. I. Cortical surface-based analysis: i. segmentation and surface reconstruction. NeuroImage 9, 179–194 (1999).
pubmed: 9931268
doi: 10.1006/nimg.1998.0395
Klein, A. et al. Mindboggling morphometry of human brains. PLOS Comput. Biol. 13, e1005350 (2017).
pubmed: 28231282
pmcid: 5322885
doi: 10.1371/journal.pcbi.1005350
Fonov, V., Evans, A., McKinstry, R., Almli, C. & Collins, D. Unbiased nonlinear average age-appropriate brain templates from birth to adulthood. NeuroImage 47, S102 (2009).
doi: 10.1016/S1053-8119(09)70884-5
Glasser, M. F. et al. The minimal preprocessing pipelines for the human connectome project. NeuroImage 80, 105–124 (2013).
pubmed: 23668970
doi: 10.1016/j.neuroimage.2013.04.127
Jenkinson, M., Bannister, P., Brady, M. & Smith, S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. NeuroImage 17, 825–841 (2002).
pubmed: 12377157
doi: 10.1006/nimg.2002.1132
Power, J. D. et al. Methods to detect, characterize, and remove motion artifact in resting state fMRI. NeuroImage 84, 320–341 (2014).
pubmed: 23994314
doi: 10.1016/j.neuroimage.2013.08.048
Behzadi, Y., Restom, K., Liau, J. & Liu, T. T. A component based noise correction method (CompCor) for BOLD and perfusion based fMRI. NeuroImage 37, 90–101 (2007).
pubmed: 17560126
doi: 10.1016/j.neuroimage.2007.04.042
Lanczos, C. Evaluation of noisy data. J. Soc. Ind. Appl. Math. Ser. B Numer. Anal. 1, 76–85 (1964).
doi: 10.1137/0701007
Abraham, A. et al. Machine learning for neuroimaging with scikit-learn. Front. Neuroinformatics 8, 10.3389/fninf.2014.00014 (2014).
Tarhan, L. & Konkle, T. Reliability-based voxel selection. NeuroImage 207, 116350 (2020).
pubmed: 31733373
doi: 10.1016/j.neuroimage.2019.116350
Hasson, U., Nir, Y., Levy, I., Fuhrmann, G. & Malach, R. Intersubject synchronization of cortical activity during natural vision. Science 303, 1634–1640 (2004).
pubmed: 15016991
doi: 10.1126/science.1089506
Simony, E. et al. Dynamic reconfiguration of the default mode network during narrative comprehension. Nat. Commun. 7, 12141 (2016).
pubmed: 27424918
pmcid: 4960303
doi: 10.1038/ncomms12141
Wang, L., Mruczek, R. E. B., Arcaro, M. J. & Kastner, S. Probabilistic maps of visual topography in human cortex. Cereb. Cortex 25, 3911–3931 (2015).
pubmed: 25452571
doi: 10.1093/cercor/bhu277
Smith, S. M. & Nichols, T. E. Threshold-free cluster enhancement: addressing problems of smoothing, threshold dependence and localisation in cluster inference. NeuroImage 44, 83–98 (2009).
pubmed: 18501637
doi: 10.1016/j.neuroimage.2008.03.061
Julian, J. B., Fedorenko, E., Webster, J. & Kanwisher, N. An algorithmic method for functionally defining regions of interest in the ventral visual pathway. NeuroImage 60, 2357–2364 (2012).
pubmed: 22398396
doi: 10.1016/j.neuroimage.2012.02.055