Flexible control as surrogate reward or dynamic reward maximization.
Flexible control
Information theory
Instrumental divergence
Intrinsic reward
Journal
Cognition
ISSN: 1873-7838
Titre abrégé: Cognition
Pays: Netherlands
ID NLM: 0367541
Informations de publication
Date de publication:
12 2022
12 2022
Historique:
received:
10
03
2022
revised:
16
08
2022
accepted:
19
08
2022
pubmed:
15
9
2022
medline:
5
10
2022
entrez:
14
9
2022
Statut:
ppublish
Résumé
The utility of a given experience, like interacting with a particular friend or tasting a particular food, fluctuates continually according to homeostatic and hedonic principles. Consequently, to maximize reward, an individual must be able to escape or attain outcomes as preferences change, by switching between actions. Recent work on human and artificial intelligence has defined such flexible instrumental control in information theoretic terms and postulated that it may serve as a reward surrogate. Another possibility, however, is that the adaptability afforded by flexible control is tacitly implemented by planning for dynamic changes in outcome values. In the current study, an expected utility model that computes decision values over a range of possible monetary gains and losses associated with sensory outcomes provided the best fit to behavioral choice data and performed best in terms of earned rewards. Moreover, consistent with previous work on perceived control and personality, individual differences in dimensional schizotypy were correlated with behavioral choice preferences in conditions with the greatest and lowest levels of flexible control. These results contribute to a growing literature on the role of instrumental control in goal-directed choice.
Identifiants
pubmed: 36103799
pii: S0010-0277(22)00250-5
doi: 10.1016/j.cognition.2022.105262
pii:
doi:
Types de publication
Journal Article
Research Support, U.S. Gov't, Non-P.H.S.
Langues
eng
Sous-ensembles de citation
IM
Pagination
105262Informations de copyright
Copyright © 2022 The Author. Published by Elsevier B.V. All rights reserved.
Déclaration de conflit d'intérêts
Declaration of Competing Interest There are no conflicts of interests.