Mental control of uncertainty.

Bayesian inference Information theory Numerosity Perception Rational inattention

Journal

Cognitive, affective & behavioral neuroscience
ISSN: 1531-135X
Titre abrégé: Cogn Affect Behav Neurosci
Pays: United States
ID NLM: 101083946

Informations de publication

Date de publication:
06 2023
Historique:
accepted: 01 09 2022
medline: 1 8 2023
pubmed: 29 9 2022
entrez: 28 9 2022
Statut: ppublish

Résumé

Can you reduce uncertainty by thinking? Intuition suggests that this happens through the elusive process of attention: if we expend mental effort, we can increase the reliability of our sensory data. Models based on "rational inattention" formalize this idea in terms of a trade-off between the costs and benefits of attention. This paper surveys the origin of these models in economics, their connection to rate-distortion theory, and some of their recent applications to psychology and neuroscience. We also report new data from a numerosity judgment task in which we manipulate performance incentives. Consistent with rational inattention, people are able to improve performance on this task when incentivized, in part by increasing the reliability of their sensory data.

Identifiants

pubmed: 36168079
doi: 10.3758/s13415-022-01034-8
pii: 10.3758/s13415-022-01034-8
doi:

Types de publication

Journal Article Research Support, U.S. Gov't, Non-P.H.S.

Langues

eng

Sous-ensembles de citation

IM

Pagination

465-475

Informations de copyright

© 2022. The Psychonomic Society, Inc.

Références

Anderson, B.A., Laurent, P.A., & Yantis, S. (2011). Value-driven attentional capture. Proceedings of the National Academy of Sciences, 108, 10367–10371.
Attneave, F. (1954). Some informational aspects of visual perception. Psychological Review, 61, 183–193.
pubmed: 13167245
Bates, C.J., Lerch, R.A., Sims, C.R., & Jacobs, R.A. (2019). Adaptive allocation of human visual working memory capacity during statistical and categorical learning. Journal of Vision, 19, 11.
pubmed: 30802280
Beierholm, U., Guitart-Masip, M., Economides, M., Chowdhury, R., Düzel, E., Dolan, R., & Dayan, P. (2013). Dopamine modulates reward-related vigor. Neuropsychopharmacology, 38, 1495–1503.
pubmed: 23419875 pmcid: 3682144
Berger, T. (1971). Rate Distortion Theory: A Mathematical Basis for Data Compression. NJ: Prentice-Hall.
Bishop, C.M. (2006). Pattern Recognition and Machine Learning. Springer.
Bourgeois, A., Chelazzi, L., & Vuilleumier, P. (2016). How motivation and reward learning modulate selective attention. Progress in Brain Research, 229, 325–342.
pubmed: 27926446
Brissenden, J.A., Adkins, T.J., Hsu, Y.T., & Lee, T.G. (2021). Reward influences the allocation but not the availability of resources in visual working memory. bioRxiv.
Broadbent, D.E. (1958). Perception and Communication. Oxford University Press.
Carrasco, M. (2011). Visual attention: the past 25 years. Vision Research, 51, 1484–1525.
pubmed: 21549742 pmcid: 3390154
Christ, R.E. (1969). Effects of payoff and probability on recall of multisymbol displays. The Journal of General Psychology, 80, 81–92.
pubmed: 28147959
Davison, M., & McCarthy, D. (1980). Reinforcement for errors in a signal-detection procedure. Journal of the Experimental Analysis of Behavior, 34, 35–47.
pubmed: 16812178 pmcid: 1332943
Dehaene, S. (2003). The neural basis of the Weber-Fechner law: a logarithmic mental number line. Trends in Cognitive Sciences, 7, 145–147.
pubmed: 12691758
Della Libera, C., & Chelazzi, L. (2009). Learning to attend and to ignore is a matter of gains and losses. Psychological Science, 20, 778–784.
pubmed: 19422618
Denti, T., Marinacci, M., & Montrucchio, L. (2020). A note on rational inattention and rate distortion theory. Decisions in Economics and Finance, 43, 75–89.
Dix, A., & Li, S.-C. (2020). Incentive motivation improves numerosity discrimination: Insights from pupillometry combined with drift-diffusion modelling. Scientific Reports, 10, 1–11.
Engelmann, J. B., & Pessoa, L. (2007). Motivation Sharpens Exogenous Spatial Attention. Emotion, 7, 668–674.
Fehr, E., & Tyran, J.-R. (2001). Does money illusion matter? American Economic Review, 91, 1239–1262.
Feldman, H., & Friston, K. (2010). Attention, uncertainty, and free-energy. Frontiers in Human Neuroscience, 4, 215.
pubmed: 21160551 pmcid: 3001758
FitzGerald, T.H., Dolan, R.J., & Friston, K. (2015). Dopamine, reward learning, and active inference. Frontiers in Computational Neuroscience, 9, 136.
pubmed: 26581305 pmcid: 4631836
Friston, K.J., Shiner, T., FitzGerald, T., Galea, J.M., Adams, R., Brown, H., ..., Bestmann, S. (2012). Dopamine, affordance and active inference. PLOS Computational Biology, 8, e1002327.
pubmed: 22241972 pmcid: 3252266
Frömer, R., Lin, H., Wolf, C.D., Inzlicht, M., & Shenhav, A. (2021). Expectations of reward and efficacy guide cognitive control allocation. Nature Communications, 12, 1–11.
Gabaix, X., & Laibson, D. (2017). Myopia and discounting. Technical report, National bureau of economic research.
Gershman, S.J., & Bhui, R. (2020). Rationally inattentive intertemporal choice. Nature Communications, 11, 1–8.
Gong, M., & Li, S. (2014). Learned reward association improves visual working memory. Journal of Experimental psychology. Human Perception and Performance, 40, 841–856.
pubmed: 24392741
Grujic, N., Brus, J., Burdakov, D., & Polania, R. (2022). Rational inattention in mice. Science Advances, 8, eabj8935.
pubmed: 35245128 pmcid: 8896787
Hamid, A.A., Pettibone, J.R., Mabrouk, O.S., Hetrick, V.L., Schmidt, R., Vander Weele, C.M., ..., Berke, J.D. (2016). Mesolimbic dopamine signals the value of work. Nature Neuroscience, 19, 117–126.
pubmed: 26595651
Hébert, B.M., & Woodford, M. (2019). Rational inattention when decisions take time. Technical report, National Bureau of Economic Research.
Itthipuripat, S., Vo, V.A., Sprague, T.C., & Serences, J.T. (2019). Value-driven attentional capture enhances distractor representations in early visual cortex. PLoS Biology, 17, e3000186.
pubmed: 31398186 pmcid: 6703696
Itti, L., & Baldi, P. (2009). Bayesian surprise attracts human attention. Vision Research, 49, 1295–1306.
pubmed: 18834898
Kersten, D., Mamassian, P., & Yuille, A. (2004). Object perception as Bayesian inference. Annual Review of Psychology, 55, 271–304.
pubmed: 14744217
Keynes, J.M. (1936) The general theory of employment, interest and money. Harcourt: Brace, & World.
Knill, D.C., & Richards, W. (1996). Perception as Bayesian Inference. Cambridge University Press.
Kool, W., & Botvinick, M. (2012). A labor/leisure tradeoff in cognitive control. Journal of Experimental psychology. General, 143, 131–141.
pubmed: 23230991 pmcid: 3739999
Kool, W., & Botvinick, M. (2018). Mental labour. Nature Human Behaviour, 2, 899–908.
pubmed: 30988433
Kool, W., Cushman, F.A., & Gershman, S.J. (2016). When does model-based control pay off? PLoS Computational Biology, 12, e1005090.
pubmed: 27564094 pmcid: 5001643
Kool, W., Gershman, S.J., & Cushman, F.A. (2017). Cost-benefit arbitration between multiple reinforcement-learning systems. Psychological Science, 28, 1321–1333.
pubmed: 28731839
Lai, L., & Gershman, S.J. (2021). Policy compression: An information bottleneck in action selection. In Psychology of Learning and Motivation, (Vol. 74 pp. 195–232): Elsevier.
Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology, 21, 451–468.
pubmed: 7790827
Lavie, N., & Tsal, Y. (1994). Perceptual load as a major determinant of the locus of selection in visual attention. Perception & Psychophysics, 56, 183–197.
Luo, T.Z., & Maunsell, J.H. (2015). Neuronal modulations in visual cortex are associated with only one of multiple components of attention. Neuron, 86, 1182–1188.
pubmed: 26050038 pmcid: 4458699
Mackowiak, B., Matejka, F., & Wiederholt, M. (2018). Rational inattention: a disciplined behavioral model. CEPR Discussion Papers, 13243.
Mackowiak, B., & Wiederholt, M. (2009). Optimal sticky prices under rational inattention. American Economic Review, 99, 769–803.
Manohar, S.G., Finzi, R.D., Drew, D., & Husain, M. (2017). Distinct motivational effects of contingent and noncontingent rewards. Psychological Science, 28, 1016–1026.
pubmed: 28488927
Martin, D.W., & Richards, E. (1972). Locus of selectivity in a visual memory task using a color value indicator. Perception & Psychophysics, 12, 65–68.
Meyniel, F., Sigman, M., & Mainen, Z.F. (2015). Confidence as Bayesian probability: From neural origins to behavior. Neuron, 88, 78–92.
pubmed: 26447574
Mikhael, J.G., Lai, L., & Gershman, S.J. (2021). Rational inattention and tonic dopamine. PLOS Computational Biology.
Miller, G.A. (1956). The magic number seven plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63, 91–97.
Nevin, J.A., Olson, K., Mandell, C., & Yarensky, P. (1975). Differential reinforcement and signal detection. Journal of the Experimental Analysis of Behavior, 24, 355–367.
pubmed: 1194831 pmcid: 1333437
Niv, Y., Daw, N.D., Joel, D., & Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology, 191, 507–520.
pubmed: 17031711
Petzschner, F.H., & Glasauer, S. (2011). Iterative Bayesian estimation as an explanation for range and regression effects: a study on human path integration. Journal of Neuroscience, 31, 17220–17229.
pubmed: 22114288
Petzschner, F.H., Glasauer, S., & Stephan, K.E. (2015). A Bayesian perspective on magnitude estimation. Trends in Cognitive Sciences, 19, 285–293.
pubmed: 25843543
Rigoux, L., Stephan, K.E., Friston, K.J., & Daunizeau, J. (2014). Bayesian model selection for group studies—revisited. NeuroImage, 84, 971–985.
pubmed: 24018303
Serences, J.T. (2008). Value-based modulations in human visual cortex. Neuron, 60, 1169–1181.
pubmed: 19109919 pmcid: 3384552
Shafir, E., Diamond, P., & Tversky, A. (1997). Money illusion. The Quarterly Journal of Economics, 112, 341–374.
Shannon, C. (1959). Coding theorems for a discrete source with a fidelity criterion. IRE National Convention Record, 4, 142–163.
Shannon, C.E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27, 379–423.
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T.L., Cohen, J.D., & Botvinick, M.M. (2017). Toward a rational and mechanistic account of mental effort. Annual Review of Neuroscience, 40, 99–124.
pubmed: 28375769
Shi, Z., Church, R.M., & Meck, W.H. (2013). Bayesian optimization of time perception. Trends in Cognitive Sciences, 17, 556–564.
pubmed: 24139486
Sims, C.A. (1998). Stickiness. In Carnegie-Rochester Conference Series on Public Policy, (Vol. 49 pp. 317–356): Elsevier.
Sims, C.A. (2003). Implications of rational inattention. Journal of Monetary Economics, 50, 665–690.
Sims, C.R. (2016). Rate-distortion theory and human perception. Cognition, 152, 181–198.
pubmed: 27107330
Taub, H.A. (1965). Effects of differential value on recall of visual symbols1. Journal of Experimental Psychology, 69, 135–143.
pubmed: 14279769
Teghtsoonian, R., & Teghtsoonian, M. (1978). Range and regression effects in magnitude scaling. Perception & Psychophysics, 24, 305–314.
Thaler, R. (1981). Some empirical evidence on dynamic inconsistency. Economics Letters, 8, 201–207.
Thomas, P.M., FitzGibbon, L., & Raymond, J.E. (2016). Value conditioning modulates visual working memory processes. Journal of experimental psychology. Human perception and performance, 42, 6–10.
pubmed: 26523489
Tolkmitt, F., & Christ, R.E. (1970). Differential payoff and locus of selectivity in a visual memory task. Perception & Psychophysics, 7, 47–50.
Tomassini, A., Ruge, D., Galea, J.M., Penny, W., & Bestmann, S. (2016). The role of dopamine in temporal uncertainty. Journal of Cognitive Neuroscience, 28, 96–110.
pubmed: 26401816
Treisman, A.M. (1960). Contextual cues in selective listening. Quarterly Journal of Experimental Psychology, 12, 242–248.
Van den Berg, R., & Ma, W.J. (2018). A resource-rational theory of set size effects in human visual working memory. ELife, 7, e34963.
Wallis, G., Stokes, M.G., Arnold, C., & Nobre, A.C. (2015). Reward boosts working memory encoding over a brief temporal window. Visual Cognition, 23, 291–312.
Westbrook, A., & Braver, T.S. (2015). Cognitive effort: a neuroeconomic approach. Cognitive, Affective, & Behavioral Neuroscience, 15, 395–415.
Woodford, M. (2009). Information-constrained state-dependent pricing. Journal of Monetary Economics, 56, S100–S124.
Wyart, V., Nobre, A.C., & Summerfield, C. (2012). Dissociable prior influences of signal probability and relevance on visual contrast sensitivity. Proceedings of the National Academy of Sciences, 109, 3593–3598.
Xiang, Y., Graeber, T., Enke, B., & Gershman, S.J. (2021). Confidence and central tendency in perceptual judgment. Attention, Perception, & Psychophysics, 83, 3024–3034.

Auteurs

Samuel J Gershman (SJ)

Department of Psychology and Center for Brain Science, Harvard University, MA, Cambridge, USA. gershman@fas.harvard.edu.

Taylor Burke (T)

Department of Psychology and Center for Brain Science, Harvard University, MA, Cambridge, USA.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH