Surprising sounds influence risky decision making.
Journal
Nature communications
ISSN: 2041-1723
Titre abrégé: Nat Commun
Pays: England
ID NLM: 101528555
Informations de publication
Date de publication:
13 Sep 2024
13 Sep 2024
Historique:
received:
23
02
2023
accepted:
14
08
2024
medline:
14
9
2024
pubmed:
14
9
2024
entrez:
13
9
2024
Statut:
epublish
Résumé
Adaptive behavior depends on appropriate responses to environmental uncertainty. Incidental sensory events might simply be distracting and increase errors, but alternatively can lead to stereotyped responses despite their irrelevance. To evaluate these possibilities, we test whether task-irrelevant sensory prediction errors influence risky decision making in humans across seven experiments (total n = 1600). Rare auditory sequences preceding option presentation systematically increase risk taking and decrease choice perseveration (i.e., increased tendency to switch away from previously chosen options). The risk-taking and perseveration effects are dissociable by manipulating auditory statistics: when rare sequences end on standard tones, including when rare sequences consist only of standard tones, participants are less likely to perseverate after rare sequences but not more likely to take risks. Computational modeling reveals that these effects cannot be explained by increased decision noise but can be explained by value-independent risky bias and perseveration parameters, decision biases previously linked to dopamine. Control experiments demonstrate that both surprise effects can be eliminated when tone sequences are presented in a balanced or fully predictable manner, and that surprise effects cannot be explained by erroneous beliefs. These findings suggest that incidental sounds may influence many of the decisions we make in daily life.
Identifiants
pubmed: 39271674
doi: 10.1038/s41467-024-51729-4
pii: 10.1038/s41467-024-51729-4
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
8027Subventions
Organisme : U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (NIMH)
ID : R01MH124110
Organisme : U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (NIMH)
ID : R01MH124110
Organisme : National Science Foundation (NSF)
ID : DGE-2139841
Informations de copyright
© 2024. The Author(s).
Références
Kakade, S. & Dayan, P. Dopamine: generalization and bonuses. Neural Netw. 15, 549–559 (2002).
pubmed: 12371511
doi: 10.1016/S0893-6080(02)00048-5
Clewett, D., DuBrow, S. & Davachi, L. Transcending time in the brain: how event memories are constructed from experience. Hippocampus 29, 162–183 (2019).
pubmed: 30734391
pmcid: 6629464
doi: 10.1002/hipo.23074
Swallow, K. M. & Jiang, Y. V. The attentional boost effect: transient increases in attention to one task enhance performance in a second task. Cognition 115, 118–132 (2010).
pubmed: 20080232
pmcid: 2830300
doi: 10.1016/j.cognition.2009.12.003
Tobler, P. N., Fiorillo, C. D. & Schultz, W. Adaptive coding of reward value by dopamine neurons. Science 307, 1642–1645 (2005).
pubmed: 15761155
doi: 10.1126/science.1105370
Parkhurst, D., Law, K. & Niebur, E. Modeling the role of salience in the allocation of overt visual attention. Vis. Res. 42, 107–123 (2002).
pubmed: 11804636
doi: 10.1016/S0042-6989(01)00250-4
Hakim, N., Feldmann-Wüstefeld, T., Awh, E. & Vogel, E. K. Perturbing neural representations of working memory with task-irrelevant interruption. J. Cogn. Neurosci. 32, 558–569 (2020).
pubmed: 31617823
doi: 10.1162/jocn_a_01481
Li, X. & Camerer, C. F. Predictable effects of visual salience in experimental decisions and games. Q. J. Econ. 137, 1849–1900 (2022).
doi: 10.1093/qje/qjac025
Schröger, E. & Wolff, C. Behavioral and electrophysiological effects of task-irrelevant sound change: a new distraction paradigm. Cogn. Brain Res. 7, 71–87 (1998).
doi: 10.1016/S0926-6410(98)00013-5
Garrido, M. I., Dolan, R. J. & Sahani, M. Surprise leads to noisier perceptual decisions. i-Perception 2, 112–120 (2011).
pubmed: 23145228
pmcid: 3485781
doi: 10.1068/i0411
Dantzer, R. Behavioral, physiological and functional aspects of stereotyped behavior: a review and a re-interpretation. J. Anim. Sci. 62, 1776–1786 (1986).
pubmed: 3525490
doi: 10.2527/jas1986.6261776x
Randrup, A. & Munkvad, I. Pharmacology and physiology of stereotyped behavior. J. Psychiatr. Res. 11, 1–10 (1974).
pubmed: 4218871
doi: 10.1016/0022-3956(74)90062-4
Tomov, M. S., Truong, V. Q., Hundia, R. A. & Gershman, S. J. Dissociable neural correlates of uncertainty underlie different exploration strategies. Nat. Commun. 11, 2371 (2020).
pubmed: 32398675
pmcid: 7217879
doi: 10.1038/s41467-020-15766-z
Gershman, S. J. Uncertainty and exploration. Decision 6, 277–286 (2019).
pubmed: 33768122
doi: 10.1037/dec0000101
Kobayashi, K. & Hsu, M. Neural mechanisms of updating under reducible and irreducible uncertainty. J. Neurosci. 37, 6972–6982 (2017).
pubmed: 28626019
pmcid: 5518424
doi: 10.1523/JNEUROSCI.0535-17.2017
Rutledge, R. B., Skandali, N., Dayan, P. & Dolan, R. J. A computational and neural model of momentary subjective well-being. Proc. Natl Acad. Sci. USA 111, 12252–12257 (2014).
pubmed: 25092308
pmcid: 4143018
doi: 10.1073/pnas.1407535111
Tom, S. M., Fox, C. R., Trepel, C. & Poldrack, R. A. The neural basis of loss aversion in decision-making under risk. Science 315, 515–518 (2007).
pubmed: 17255512
doi: 10.1126/science.1134239
Sokol-Hessner, P. et al. Thinking like a trader selectively reduces individuals’ loss aversion. Proc. Natl Acad. Sci. USA 106, 5035–5040 (2009).
pubmed: 19289824
pmcid: 2656558
doi: 10.1073/pnas.0806761106
Brooks, H. R. & Sokol-Hessner, P. Quantifying the immediate computational effects of preceding outcomes on subsequent risky choices. Sci. Rep. 10, 9878 (2020).
pubmed: 32555293
pmcid: 7303130
doi: 10.1038/s41598-020-66502-y
Wacongne, C. et al. Evidence for a hierarchy of predictions and prediction errors in human cortex. Proc. Natl Acad. Sci. USA 108, 20754–20759 (2011).
pubmed: 22147913
pmcid: 3251061
doi: 10.1073/pnas.1117807108
Chennu, S. et al. Expectation and attention in hierarchical auditory prediction. J. Neurosci. 33, 11194–11205 (2013).
pubmed: 23825422
pmcid: 3718380
doi: 10.1523/JNEUROSCI.0114-13.2013
Kahneman, D. & Tversky, A. Prospect theory: an analysis of decision under risk. Econometrica 47, 263–291 (1979).
doi: 10.2307/1914185
Peterson, J. C., Bourgin, D. D., Agrawal, M., Reichman, D. & Griffiths, T. L. Using large-scale experiments and machine learning to discover theories of human decision-making. Science 372, 1209–1214 (2021).
pubmed: 34112693
doi: 10.1126/science.abe2629
Tversky, A. & Kahneman, D. Advances in prospect theory: cumulative representation of uncertainty. J. Risk Uncertain. 5, 297–323 (1992).
doi: 10.1007/BF00122574
Fennema, H. & Wakker, P. Original and cumulative prospect theory: a discussion of empirical differences. J. Behav. Decis. Mak. 10, 53–64 (1997).
doi: 10.1002/(SICI)1099-0771(199703)10:1<53::AID-BDM245>3.0.CO;2-1
Edwards, W. The theory of decision making. Psychol. Bull. 51, 380–417 (1954).
pubmed: 13177802
doi: 10.1037/h0053870
Harless, D. W. & Camerer, C. F. The predictive utility of generalized expected utility theories. Econometrica 62, 1251–1289 (1994).
doi: 10.2307/2951749
Von Neumann, J. & Morgenstern, O. Theory of Games and Economic Behavior (Princeton University Press, 1944).
Barto, A., Mirolli, M. & Baldassarre, G. Novelty or surprise? Front. Psychol. 4, 907 (2013).
Todorovic, A., van Ede, F., Maris, E. & de Lange, F. P. Prior expectation mediates neural adaptation to repeated sounds in the auditory cortex: an MEG study. J. Neurosci. 31, 9118–9123 (2011).
pubmed: 21697363
pmcid: 6623501
doi: 10.1523/JNEUROSCI.1425-11.2011
Modirshanechi, A., Becker, S., Brea, J. & Gerstner, W. Surprise and novelty in the brain. Curr. Opin. Neurobiol. 82, 102758 (2023).
pubmed: 37619425
doi: 10.1016/j.conb.2023.102758
Bekinschtein, T. A. et al. Neural signature of the conscious processing of auditory regularities. Proc. Natl Acad. Sci. USA 106, 1672–1677 (2009).
pubmed: 19164526
pmcid: 2635770
doi: 10.1073/pnas.0809667106
Lecaignard, F., Bertrand, O., Caclin, A. & Mattout, J. Neurocomputational underpinnings of expected surprise. J. Neurosci. 42, 474–486 (2022).
pubmed: 34819342
pmcid: 8802931
doi: 10.1523/JNEUROSCI.0601-21.2021
Chernoff, C. S., Hynes, T. J. & Winstanley, C. A. Noradrenergic contributions to cue-driven risk-taking and impulsivity. Psychopharmacology 238, 1765–1779 (2021).
pubmed: 33649970
doi: 10.1007/s00213-021-05806-x
Stalnaker, T. A. et al. Dopamine neuron ensembles signal the content of sensory prediction errors. eLife 8, e49315 (2019).
pubmed: 31674910
pmcid: 6839916
doi: 10.7554/eLife.49315
Valdés-Baizabal, C., Carbajal, G. V., Pérez-González, D. & Malmierca, M. S. Dopamine modulates subcortical responses to surprising sounds. PLoS Biol. 18, e3000744 (2020).
pubmed: 32559190
pmcid: 7329133
doi: 10.1371/journal.pbio.3000744
Sharpe, M. J. et al. Dopamine transients are sufficient and necessary for acquisition of model-based associations. Nat. Neurosci. 20, 735–742 (2017).
pubmed: 28368385
pmcid: 5413864
doi: 10.1038/nn.4538
Suarez, J. A., Howard, J. D., Schoenbaum, G. & Kahnt, T. Sensory prediction errors in the human midbrain signal identity violations independent of perceptual distance. eLife 8, e43962 (2019).
pubmed: 30950792
pmcid: 6450666
doi: 10.7554/eLife.43962
Gershman, S. J. & Uchida, N. Believing in dopamine. Nat. Rev. Neurosci. 20, 703–714 (2019).
pubmed: 31570826
pmcid: 7472313
doi: 10.1038/s41583-019-0220-7
Schultz, W. Behavioral dopamine signals. Trends Neurosci. 30, 203–210 (2007).
pubmed: 17400301
doi: 10.1016/j.tins.2007.03.007
Chew, B. et al. Endogenous fluctuations in the dopaminergic midbrain drive behavioral choice variability. Proc. Natl Acad. Sci. USA 116, 18732–18737 (2019).
pubmed: 31451671
pmcid: 6744888
doi: 10.1073/pnas.1900872116
Soutschek, A. et al. Dopaminergic D1 receptor stimulation affects effort and risk preferences. Biol. Psychiatry 87, 678–685 (2020).
pubmed: 31668477
doi: 10.1016/j.biopsych.2019.09.002
Rigoli, F., Rutledge, R. B., Chew, B., Ousdal, O. T., Dayan, P. & Dolan, R. J. Dopamine increases a value-independent gambling propensity. Neuropsychopharmacology 41, 2658–2667 (2016).
pubmed: 27149935
pmcid: 5026733
doi: 10.1038/npp.2016.68
Rutledge, R. B., Skandali, N., Dayan, P. & Dolan, R. J. Dopaminergic modulation of decision making and subjective well-being. J. Neurosci. 35, 9811–9822 (2015).
pubmed: 26156984
pmcid: 4495239
doi: 10.1523/JNEUROSCI.0702-15.2015
Jaskir, A. & Frank, M. J. On the normative advantages of dopamine and striatal opponency for learning and choice. eLife 12, e85107 (2023).
pubmed: 36946371
pmcid: 10198727
doi: 10.7554/eLife.85107
Rutledge, R. B. et al. Dopaminergic drugs modulate learning rates and perseveration in Parkinson’s patients in a dynamic foraging task. J. Neurosci. 29, 15104–15114 (2009).
pubmed: 19955362
pmcid: 3376711
doi: 10.1523/JNEUROSCI.3524-09.2009
Kanen, J. W., Ersche, K. D., Fineberg, N. A., Robbins, T. W. & Cardinal, R. N. Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive-compulsive disorder: remediating effects of dopaminergic D2/3 receptor agents. Psychopharmacology 236, 2337–2358 (2019).
pubmed: 31324936
pmcid: 6820481
doi: 10.1007/s00213-019-05325-w
Bari, B. A. & Gershman, S. J. Undermatching is a consequence of policy compression. J. Neurosci. 43, 447–457 (2023).
pubmed: 36639891
pmcid: 9864556
doi: 10.1523/JNEUROSCI.1003-22.2022
Voon, V. et al. Dopamine agonists and risk: impulse control disorders in Parkinson’s disease. Brain 134, 1438–1446 (2011).
pubmed: 21596771
pmcid: 3097893
doi: 10.1093/brain/awr080
Brown, H. R. et al. Crowdsourcing for cognitive science—the utility of smartphones. PLoS ONE 9, e100662 (2014).
pubmed: 25025865
pmcid: 4099129
doi: 10.1371/journal.pone.0100662
Timmer, M. H. M., Sescousse, G., Esselink, R. A. J., Piray, P. & Cools, R. Mechanisms underlying dopamine-induced risky choice in Parkinson’s disease with and without depression (history). Comput. Psychiatr. 2, 11–27 (2018).
pubmed: 30090860
doi: 10.1162/CPSY_a_00011
Wetzel, N., Schröger, E. & Widmann, A. The dissociation between the P3a event-related potential and behavioral distraction. Psychophysiology 50, 920–930 (2013).
pubmed: 23763292
doi: 10.1111/psyp.12072
Dalton, P. & Lavie, N. Auditory attentional capture: effects of singleton distractor sounds. J. Exp. Psychol. Hum. Percept. Perform. 30, 180–93 (2004).
pubmed: 14769076
doi: 10.1037/0096-1523.30.1.180
Jenni, N. L., Larkin, J. D. & Floresco, S. B. Prefrontal dopamine D1 and D2 receptors regulate dissociable aspects of decision making via distinct ventral striatal and amygdalar circuits. J. Neurosci. 37, 6200–6213 (2017).
pubmed: 28546312
pmcid: 6705698
doi: 10.1523/JNEUROSCI.0030-17.2017
Segalowitz, S. J. & Barnes, K. L. The reliability of ERP components in the auditory oddball paradigm. Psychophysiology 30, 451–459 (1993).
pubmed: 8416071
doi: 10.1111/j.1469-8986.1993.tb02068.x
Ergen, M., Marbach, S., Brand, A., Başar-Eroğlu, C. & Demiralp, T. P3 and delta band responses in visual oddball paradigm in schizophrenia. Neurosci. Lett. 440, 304–308 (2008).
pubmed: 18571323
doi: 10.1016/j.neulet.2008.05.054
Ostwald, D. et al. Evidence for neural encoding of Bayesian surprise in human somatosensation. NeuroImage 62, 177–188 (2012).
pubmed: 22579866
doi: 10.1016/j.neuroimage.2012.04.050
Restuccia, D. et al. Somatosensory mismatch negativity in healthy children. Dev. Med. Child Neurol. 51, 991–998 (2009).
pubmed: 19909309
doi: 10.1111/j.1469-8749.2009.03367.x
Gershman, S. J. & Tzovaras, B. G. Dopaminergic genes are associated with both directed and random exploration. Neuropsychologia 120, 97–104 (2018).
pubmed: 30347192
doi: 10.1016/j.neuropsychologia.2018.10.009
Thompson, W. R. On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika 25, 285–294 (1933).
doi: 10.1093/biomet/25.3-4.285
Daw, N. D., O’Doherty, J. P., Dayan, P., Seymour, B. & Dolan, R. J. Cortical substrates for exploratory decisions in humans. Nature 441, 876–879 (2006).
pubmed: 16778890
pmcid: 2635947
doi: 10.1038/nature04766
Dubois, M. et al. Human complex exploration strategies are enriched by noradrenaline-modulated heuristics. eLife 10, e59907 (2021).
pubmed: 33393461
pmcid: 7815309
doi: 10.7554/eLife.59907
Speekenbrink, M. & Konstantinidis, E. Uncertainty and exploration in a restless bandit problem. Top. Cogn. Sci. 7, 351–367 (2015).
pubmed: 25899069
doi: 10.1111/tops.12145
Bornstein, A. M., Khaw, M. W., Shohamy, D. & Daw, N. D. Reminders of past choices bias decisions for reward in humans. Nat. Commun. 8, 15958 (2017).
pubmed: 28653668
pmcid: 5490260
doi: 10.1038/ncomms15958
Decker, J. H., Otto, A. R., Daw, N. D. & Hartley, C. A. From creatures of habit to goal-directed learners: tracking the developmental emergence of model-based reinforcement learning. Psychol. Sci. 27, 848–858 (2016).
pubmed: 27084852
pmcid: 4899156
doi: 10.1177/0956797616639301
Cockburn, J., Man, V., Cunningham, W. & O’Doherty, J. P. Novelty and uncertainty regulate the balance between exploration and exploitation through distinct mechanisms in the human brain. Neuron 110, 2691–2702 (2022).
pubmed: 35809575
doi: 10.1016/j.neuron.2022.05.025
Lee, S. W., Shimojo, S. & O’Doherty, J. P. Neural computations underlying arbitration between model-based and model-free learning. Neuron 81, 687–699 (2014).
pubmed: 24507199
pmcid: 3968946
doi: 10.1016/j.neuron.2013.11.028
Pisupati, S., Chartarifsky-Lynn, L., Khanal, A. & Churchland, A. K. Lapses in perceptual decisions reflect exploration. eLife 10, e55490 (2021).
pubmed: 33427198
pmcid: 7846276
doi: 10.7554/eLife.55490
Payzan-LeNestour, E., Pradier, L., Doran, J., Nave, G. & Balleine, B. Impact of ambient sound on risk perception in humans: neuroeconomic investigations. Sci. Rep. 11, 5392 (2021).
pubmed: 33686093
pmcid: 7940636
doi: 10.1038/s41598-021-84359-7
Woods, K. J. P., Siegel, M. H., Traer, J. & McDermott, J. H. Headphone screening to facilitate web-based auditory experiments. Atten. Percept. Psychophys. 79, 2064–2072 (2017).
pubmed: 28695541
pmcid: 5693749
doi: 10.3758/s13414-017-1361-2
Anwyl-Irvine, A. L., Massonnié, J., Flitton, A., Kirkham, N. & Evershed, J. K. Gorilla in our midst: an online behavioral experiment builder. Behav. Res. Methods 52, 388–407 (2020).