Synthetic Spatial Foraging With Active Inference in a Geocaching Task.

active inference free energy principle geocaching goal-directed behavior navigation spatial foraging uncertainty

Journal

Frontiers in neuroscience
ISSN: 1662-4548
Titre abrégé: Front Neurosci
Pays: Switzerland
ID NLM: 101478481

Informations de publication

Date de publication:
2022
Historique:
received: 26 10 2021
accepted: 14 01 2022
entrez: 25 2 2022
pubmed: 26 2 2022
medline: 26 2 2022
Statut: epublish

Résumé

Humans are highly proficient in learning about the environments in which they operate. They form flexible spatial representations of their surroundings that can be leveraged with ease during spatial foraging and navigation. To capture these abilities, we present a deep Active Inference model of goal-directed behavior, and the accompanying belief updating. Active Inference rests upon optimizing Bayesian beliefs to maximize model evidence or marginal likelihood. Bayesian beliefs are probability distributions over the causes of observable outcomes. These causes include an agent's actions, which enables one to treat planning as inference. We use simulations of a geocaching task to elucidate the belief updating-that underwrites spatial foraging-and the associated behavioral and neurophysiological responses. In a geocaching task, the aim is to find hidden objects in the environment using spatial coordinates. Here, synthetic agents learn about the environment via inference and learning (e.g., learning about the likelihoods of outcomes given latent states) to reach a target location, and then forage locally to discover the hidden object that offers clues for the next location.

Identifiants

pubmed: 35210988
doi: 10.3389/fnins.2022.802396
pmc: PMC8861269
doi:

Types de publication

Journal Article

Langues

eng

Pagination

802396

Informations de copyright

Copyright © 2022 Neacsu, Convertino and Friston.

Déclaration de conflit d'intérêts

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Références

Nature. 1995 Oct 26;377(6551):725-8
pubmed: 7477260
Cereb Cortex. 2015 Oct;25(10):3434-45
pubmed: 25056572
Nat Rev Neurosci. 2019 Aug;20(8):482-494
pubmed: 31171839
J Neurosci. 1995 Jan;15(1 Pt 1):47-60
pubmed: 7823151
Neuron. 2014 Jun 4;82(5):950-65
pubmed: 24908481
Cogn Affect Behav Neurosci. 2015 Dec;15(4):837-53
pubmed: 25917000
Cogn Affect Behav Neurosci. 2019 Apr;19(2):225-230
pubmed: 30607832
Netw Neurosci. 2017;1(4):381-414
pubmed: 29417960
Neural Comput. 2017 Dec;29(12):3311-3326
pubmed: 28957023
J R Soc Interface. 2017 Nov;14(136):
pubmed: 29167370
J R Soc Interface. 2020 May;17(166):20200026
pubmed: 32429823
Nature. 2021 Dec;600(7887):100-104
pubmed: 34614503
Behav Brain Sci. 2018 Mar 08;42:e35
pubmed: 29514723
Neuron. 2018 Nov 21;100(4):916-925.e3
pubmed: 30318411
Front Psychol. 2013 Dec 11;4:907
pubmed: 24376428
Philos Trans R Soc Lond B Biol Sci. 2009 May 12;364(1521):1193-201
pubmed: 19528000
Science. 2012 Apr 6;336(6077):95-8
pubmed: 22491854
Philos Trans R Soc Lond B Biol Sci. 2014 Nov 5;369(1655):
pubmed: 25267823
Biol Cybern. 2018 Aug;112(4):323-343
pubmed: 29572721
J Neurosci. 2009 Dec 2;29(48):15104-14
pubmed: 19955362
Neurosci Biobehav Rev. 2017 Jun;77:388-402
pubmed: 28416414
Prog Neurobiol. 2010 Apr;90(4):385-417
pubmed: 19941931
Neural Comput. 2017 Jan;29(1):1-49
pubmed: 27870614
Psychol Rev. 2012 Apr;119(2):431-40
pubmed: 22329683
Biosystems. 2001 Jul-Aug;61(2-3):133-41
pubmed: 11716973
Curr Opin Psychol. 2019 Oct;29:1-5
pubmed: 30359960
Neural Netw. 2002 Jun-Jul;15(4-6):495-506
pubmed: 12371507
PLoS Comput Biol. 2019 Jul 24;15(7):e1007060
pubmed: 31339878
Nat Neurosci. 2013 Feb;16(2):130-8
pubmed: 23354386
Nat Rev Neurosci. 2018 Jul;19(7):419-427
pubmed: 29752468
J Exp Psychol Learn Mem Cogn. 2022 Apr;48(4):547-568
pubmed: 34110879
Behav Brain Funct. 2005 May 04;1:6
pubmed: 15953384
Trends Cogn Sci. 2012 Oct;16(10):485-8
pubmed: 22940577
Cereb Cortex. 1998 Jul-Aug;8(5):437-50
pubmed: 9722087
Soc Cogn Affect Neurosci. 2021 Aug 6;16(8):782-794
pubmed: 32232360
Front Comput Neurosci. 2020 May 19;14:41
pubmed: 32508611
Nat Neurosci. 2008 Apr;11(4):410-6
pubmed: 18368048
BMC Neurosci. 2016 Jan 11;17:3
pubmed: 26754043
Curr Biol. 2014 Apr 14;24(8):R330-9
pubmed: 24735859
Philos Trans R Soc Lond B Biol Sci. 2017 Jan 5;372(1711):
pubmed: 27872367
Science. 2003 Mar 21;299(5614):1898-902
pubmed: 12649484
Neurosci Biobehav Rev. 2016 Sep;68:862-879
pubmed: 27375276
Comput Methods Programs Biomed. 2020 Jan;183:105076
pubmed: 31546195
Elife. 2019 May 10;8:
pubmed: 31074743
Vision Res. 2000;40(10-12):1489-506
pubmed: 10788654
J Neurosci. 1998 Feb 15;18(4):1613-21
pubmed: 9454866
Nat Rev Neurosci. 2013 Jul;14(7):488-501
pubmed: 23783199
Front Neurosci. 2014 Apr 21;8:81
pubmed: 24795556
Cognition. 2016 Mar;148:85-96
pubmed: 26752603
Neuropsychopharmacology. 2022 Jan;47(1):134-146
pubmed: 34408279
Cogn Affect Behav Neurosci. 2008 Dec;8(4):475-84
pubmed: 19033242
Prog Neurobiol. 2017 Sep;156:164-188
pubmed: 28576664
Vision Res. 2002 Jan;42(1):107-23
pubmed: 11804636
Sci Rep. 2015 Dec 09;5:18009
pubmed: 26648311
Neural Comput. 2017 Oct;29(10):2633-2683
pubmed: 28777724
J Neurosci. 2020 Jul 1;40(27):5273-5282
pubmed: 32457071
J Math Psychol. 2020 Dec;99:102447
pubmed: 33343039

Auteurs

Victorita Neacsu (V)

Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, United Kingdom.

Laura Convertino (L)

Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, United Kingdom.
School of Life and Medical Sciences, Institute of Cognitive Neuroscience, University College London, London, United Kingdom.

Karl J Friston (KJ)

Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, United Kingdom.

Classifications MeSH