Variations on a theme by Rachlin: Probability discounting.
additive utility theory
delay discounting
probability discounting
subjective probability
utility
Journal
Journal of the experimental analysis of behavior
ISSN: 1938-3711
Titre abrégé: J Exp Anal Behav
Pays: United States
ID NLM: 0203727
Informations de publication
Date de publication:
Jan 2023
Jan 2023
Historique:
revised:
22
11
2022
received:
17
05
2022
accepted:
26
11
2022
pubmed:
21
12
2022
medline:
25
1
2023
entrez:
20
12
2022
Statut:
ppublish
Résumé
Rachlin and colleagues laid the groundwork for treating the discounting of probabilistic goods as a variant of the discounting of delayed goods. This approach was seminal for a large body of subsequent research. The present paper finds the original development problematic: In converting probability to delay, the authors incorrectly dropped trial duration. The subsumption of probability by delay is also empirically questionable, as those are different functions of variables such as magnitude of outcome and commodity versus money. A variant of Rachlin's theme treats human discounting studies as psychophysical matching experiments, in which one compound stimulus is adjusted to equal another. It is assumed that a function of amount (its utility) is multiplied by a function of probability (its weight). Conjoint measurement establishes the nature of these functions, yielding a logarithmic transform on amount, and a Prelec function on probability. This model provides a good and parsimonious account of probability discounting in diverse data sets. Variant representations of the data are explored. By inserting the probabilistically discounted utility into the additive utility theory of delay discounting, a general theory of probabilistic intertemporal choice is achieved.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
140-155Informations de copyright
© 2022 Society for the Experimental Analysis of Behavior.
Références
Ainslie, G. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82(4), 463-496. https://doi.org/10.1037/h0076860
Albers, W., Selten, R., Pope, R., & Vogt, B. (2000). Experimental evidence for attractions to chance. German Economic Review, 1(2), 113-130.
Anderson, M. A. B., & Dallery, J. (2021). Effects of amount on probability discounting: A replication and extension. Behavioural Processes, 190, 104448. https://doi.org/10.1016/j.beproc.2021.104448
Anderson, N. H. (1970). Functional measurement and psychophysical judgment. Psychological Review, 77, 153-170. https://doi.org/10.1037/h0029064
Bateson, M., & Kacelnik, A. (1996). Rate currencies and the foraging starling: The fallacy of the averages revisited. Behavioural Ecology, 7(3), 341-352. https://doi.org/10.1093/beheco/7.3.341
Baum, W. M. (1979). Matching, undermatching, and overmatching in studies of choice. Journal of the Experimental Analysis of Behavior, 32(2), 269-281. https://doi.org/10.1901/jeab.1979.32-269
Berry, M. S., Repke, M. A., Nickerson, N. P., Conway, L. G., 3rd, Odum, A. L., & Jordan, K. E. (2015). Making time for nature: Visual exposure to natural environments lengthens subjective time perception and reduces impulsivity. PloS One, 10(11), e0141030. https://doi.org/10.1371/journal.pone.0141030
Białaszek, W., Marcowski, P., & Cox, D. J. (2020). Comparison of multiplicative and additive hyperbolic and hyperboloid discounting models in delayed lotteries involving gains and losses. PloS One, 15(5), e0233337. https://doi.org/10.1371/journal.pone.0233337
Białaszek, W., Marcowski, P., & Ostaszewski, P. (2018). Risk inherent in delay accounts for magnitude effects in intertemporal decision making. Current Psychology, 1-16. https://doi.org/10.1007/s12144-018-0092-4
Bizo, L. A., Chu, J. Y., Sanabria, F., & Killeen, P. R. (2006). The failure of Weber's law in time perception and production. Behavioural Processes, 71(2-3), 201-210. https://doi.org/10.1016/j.beproc.2005.11.006
Blanchard, T. C., Pearson, J. M., & Hayden, B. Y. (2013). Postreward delays and systematic biases in measures of animal temporal discounting. Proceedings of the National Academy of Sciences of the United States of America, 110(38), 15491-15496. https://doi.org/10.1073/pnas.1310446110
Burnham, K. P., & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). Springer-Verlag.
Burnham, K. P., & Anderson, D. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33(2), 261-304. https://doi.org/10.1177/0049124104268644
Cox, D. J., & Dallery, J. (2016). Effects of delay and probability combinations on discounting in humans. Behavioural Processes, 131, 15-23. https://doi.org/10.1016/j.beproc.2016.08.002
Dai, J., & Busemeyer, J. R. (2014). A probabilistic, dynamic, and attribute-wise model of intertemporal choice. Journal of Experimental Psychology: General, 143(4), 1489-1514. https://doi.org/10.1037/a0035976
Daston, L. J. (1980). Probabilistic expectation and rationality in classical probability theory. Historia Mathematica, 7(3), 234-260. https://doi.org/10.1016/0315-0860(80)90025-7
Dehaene, S. (2011). The number sense: How the mind creates mathematics. Oxford University Press.
DeHart, W. B., & Odum, A. L. (2015). The effects of the framing of time on delay discounting. Journal of the Experimental Analysis of Behavior, 103(1), 10-21. https://doi.org/10.1002/jeab.125
Ebert, J., & Prelec, D. (2007). The fragility of time: Time-insensitivity and valuation of the near and far future. Management Science, 53, 1423-1438. https://doi.org/10.1287/mnsc.1060.0671
Estle, S. J., Green, L., Myerson, J., & Holt, D. D. (2006). Differential effects of amount on temporal and probability discounting of gains and losses. Memory & Cognition, 34, 914-928. https://doi.org/10.3758/BF03193437
Feigenson, L., Dehaene, S., & Spelke, E. (2004). Core systems of number. Trends in Cognitive Sciences, 8(7), 307-314. https://doi.org/10.1016/j.tics.2004.05.002
Fletcher, H., & Munson, W. A. (1933). Loudness, its definition, measurement and calculation. Bell System Technical Journal, 12(4), 377-430.
Green, L., & Myerson, J. (2010). Experimental and correlational analyses of delay and probability discounting. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 67-92). American Psychological Association. https://doi.org/10.1037/12069-003
Green, L., & Myerson, J. (2013). How many impulsivities? A discounting perspective. Journal of the Experimental Analysis of Behavior, 99(1), 3-13. https://doi.org/10.1002/jeab.1
Green, L., & Myerson, J. (2019). On the complexity of discounting, choice situations, and people. Perspectives on Behavior Science, 42(3), 433-443. https://doi.org/10.1007/s40614-019-00209-y
Green, L., Myerson, J., & McFadden, E. (1997). Rate of temporal discounting decreases with amount of reward. Memory & Cognition, 25, 715-723. https://doi.org/10.3758/BF03211314
Green, L., Myerson, J., Oliveira, L., & Chang, S. E. (2014). Discounting of delayed and probabilistic losses over a wide range of amounts. Journal of the Experimental Analysis of Behavior, 101(2), 186-200. https://doi.org/10.1002/jeab.56
Green, L., Myerson, J., & Ostaszewski, P. (1999). Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25(2), 418-427. https://doi.org/10.1037/0278-7393.25.2.418
Green, P. E., Krieger, A. M., & Wind, Y. (2001). Thirty years of conjoint analysis: Reflections and prospects. Interfaces, 31(3_supplement), S56-S73. https://doi.org/10.1287/inte.31.3s.56.9676
Guilford, J. P. (1954). Psychometric methods. McGraw-Hill.
He, L., Zhao, W. J., & Bhatia, S. (2022). An ontology of decision models. Psychological Review, 129(1), 49-72. https://doi.org/10.1037/rev0000231
Killeen, P. R. (1968). On the measurement of reinforcement frequency in the study of preference. Journal of the Experimental Analysis of Behavior, 11(3), 263-269. https://doi.org/10.1901/jeab.1968.11-263
Killeen, P. R. (2009). An additive-utility model of delay discounting. Psychological Review, 116, 602-619. https://doi.org/10.1037/a0016414
Killeen, P. R. (2019). The behavioral psychophysics of SS Stevens. In D. Zilio & K. Carrara (Eds.), Behaviorismos (Vol. 3, pp. 22-37). Paradigma.
Killeen, P. R. (in press). Discounting, gambling, and the portfolio of desires. Psychological Review.
Killeen, P. R., & Grondin, S. (2022). A trace theory of time perception. Psychological Review, 129(4), 603-639. https://doi.org/10.1037/rev0000308
Loewenstein, G. F., Weber, E. U., Hsee, C. K., & Welch, N. (2001). Risk as feelings. Psychological Bulletin, 127, 267-286. https://doi.org/10.1037//0033-2909.127.2.267
Luce, R. D. (2001). Reduction invariance and Prelec's weighting functions. Journal of Mathematical Psychology, 45(1), 167-179. https://doi.org/10.1006/jmps.1999.1301
Luce, R. D., & Tukey, J. W. (1964). Simultaneous conjoint measurement: A new type of fundamental measurement. Journal of Mathematical Psychology, 1(1), 1-27. https://doi.org/10.1016/0022-2496(64)90015-X
Luckman, A., Donkin, C., & Newell, B. R. (2020). An evaluation and comparison of models of risky intertemporal choice. Psychological Review, 127(6), 1097-1138. https://doi.org/10.1037/rev0000223
MacKay, D. M. (1963). Psychophysics of perceived intensity: A theoretical basis for Fechner's and Stevens' laws. Science, 139, 1213-1216. https://doi.org/10.1126/science.139.3560.1213-a
Marco, R., Miranda, A., Schlotz, W., Melia, A., Mulligan, A., Muller, U., Andreou, P., Butler, L., Christiansen, H., Gabriels, I., Medad, S., Albrecht, B., Uebel, H., Asherson, P., Banaschewski, T., Gill, M., Kuntsi, J., Mulas, M., Oades, R., … Sonuga-Barke, E. J. (2009). Delay and reward choice in ADHD: An experimental test of the role of delay aversion. Neuropsychology, 23(3), 367-380. https://doi.org/10.1037/a0014914
Mazur, J. E. (1991). Choice with probabilistic reinforcement: Effects of delay and conditioned reinforcers. Journal of the Experimental Analysis of Behavior, 55(1), 63-77. https://doi.org/10.1901/jeab.1991.55-63
Mazur, J. E. (2001). Hyperbolic value addition and general models of animal choice. Psychological Review, 108(1), 96-112. https://www.ncbi.nlm.nih.gov/pubmed/11212635
Mazur, J. E., & Biondi, D. R. (2011). Effects of time between trials on rats' and pigeons' choices with probabilistic delayed reinforcers. Journal of the Experimental Analysis of Behavior, 95(1), 41-56. https://doi.org/10.1901/jeab.2011.95-41
McDiarmid, C. G., & Rilling, M. E. (1965). Reinforcement delay and reinforcement rate as determinants of schedule preference. Psychonomic Science, 2(1-12), 195-196. https://doi.org/10.3758/BF03343402
McKerchar, T. L., & Mazur, J. E. (2023). Consumer choices with variations in item price, delay, and opportunity cost. Journal of the Experimental Analysis of Behavior (this issue). https://doi.org/10.1002/jeab.806
Mellers, B. A., & Biagini, K. (1994). Similarity and choice. Psychological Review, 101, 505-518. https://doi.org/10.1037/0033-295X.101.3.505
Miller, K. J., Sorensen, L. B., Ojemann, J. G., & den Nijs, M. (2009). Power-law scaling in the brain surface electric potential. PLoS Computational Biology, 5(12), e1000609. https://doi.org/10.1371/journal.pcbi.1000609
Moyer, R. S. (1973). Comparing objects in memory: Evidence suggesting an internal psychophysics. Perception & Psychophysics, 13(2), 180-184. https://doi.org/10.3758/BF03214124
Myerson, J., Baumann, A. A., & Green, L. (2017). Individual differences in delay discounting: Differences are quantitative with gains, but qualitative with losses. Journal of Behavioral Decision Making, 30(2), 359-372. https://doi.org/10.1002/bdm.1947
Myerson, J., Green, L., Hanson, J. S., Holt, D. D., & Estle, S. J. (2003). Discounting delayed and probabilistic rewards: Processes and traits. Journal of Economic Psychology, 24, 619-635. https://doi.org/10.1016/S0167-4870(03)00005-9
Myerson, J., Green, L., & Morris, J. (2011). Modeling the effect of reward amount on probability discounting. Journal of the Experimental Analysis of Behavior, 95(2), 175-187. https://doi.org/10.1901/jeab.2011.95-175
Nieder, A., & Miller, E. K. (2003). Coding of cognitive magnitude: Compressed scaling of numerical information in the primate prefrontal cortex. Neuron, 37(1), 149-157. https://doi.org/10.1016/s0896-6273(02)01144-3
Parducci, A. (1965). Category judgment: A range-frequency model. Psychological Review, 72(6), 407-418. https://doi.org/10.1037/h0022602
Parker, S., & Schneider, B. (1988). Conjoint scaling of the utility of money using paired comparisons. Social Science Research, 17(3), 277-286. https://doi.org/10.1016/0049-089X(88)90017-8
Pierce, W. D., & Epling, W. F. (1983). Choice, matching, and human behavior: A review of the literature. The Behavior Analyst, 6(1), 57-76. https://doi.org/10.1007/BF03391874
Poulton, E. C. (1989). Bias in quantifying judgements. Lawrence Erlbaum Associates.
Prelec, D. (1998). The probability weighting function. Econometrica, 66, 497-527. https://doi.org/10.2307/2998573
Rachlin, H. (1989). Judgment, decision, and choice: A cognitive/behavioral synthesis. WH Freeman/Times Books/Henry Holt & Co.
Rachlin, H., Brown, J., & Cross, D. (2000). Discounting in judgments of delay and probability. Journal of Behavioral Decision Making, 13, 145-159. https://psycnet.apa.org/doi/10.1002/(SICI)1099-0771(200004/06)13:2%3C145::AID-BDM320%3E3.0.CO;2-4
Rachlin, H., Logue, A. W., Gibbon, J., & Frankel, M. (1986). Cognition and behavior in studies of choice. Psychological Review, 93(1), 33. https://doi.org/10.1037/0033-295X.93.1.33
Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55(2), 233-244. https://doi.org/10.1901/jeab.1991.55-233
Rachlin, H., Safin, V., Arfer, K. B., & Yen, M. (2015). The attraction of gambling. Journal of the Experimental Analysis of Behavior, 103(1), 260-266. https://doi.org/10.1002/jeab.113
Robles, E., Vargas, P. A., & Bejarano, R. (2009). Within-subject differences in degree of delay discounting as a function of order of presentation of hypothetical cash rewards. Behavioural Processes, 81(2), 260-263. https://doi.org/10.1016/j.beproc.2009.02.018
Rosenbaum, D. A., Fournier, L. R., Levy-Tzedek, S., McBride, D. M., Rosenthal, R., Sauerberger, K., VonderHaar, R. L., Wasserman, E., & Zentall, T. R. (2019). Sooner rather than later: Precrastination rather than procrastination. Current Directions in Psychological Science, 28(3), 229-233. https://doi.org/10.1177/0963721419833652
Rung, J. M., Frye, C. C. J., DeHart, W. B., & Odum, A. L. (2019). Evaluating the effect of delay spacing on delay discounting: Carry-over effects on steepness and the form of the discounting function. Journal of the Experimental Analysis of Behavior, 112(3), 254-272. https://doi.org/10.1002/jeab.556
Scheres, A., Lee, A., & Sumiya, M. (2008). Temporal reward discounting and ADHD: Task and symptom specific effects. The Journal of Neural Transmission (Vienna), 115(2), 221-226. https://doi.org/10.1007/s00702-007-0813-610.1007/s00702-007-0813-6
Scheres, A., Tontsch, C., Thoeny, A. L., & Kaczkurkin, A. (2010). Temporal reward discounting in attention-deficit/hyperactivity disorder: The contribution of symptom domains, reward magnitude, and session length. Biological Psychiatry, 67(7), 641-648. https://doi.org/10.1016/j.biopsych.2009.10.033
Sjoberg, E. A., Ramos, S., Lopez-Tolsa, G. E., Johansen, E. B., & Pellon, R. (2021). The irrelevancy of the inter-trial interval in delay-discounting experiments on an animal model of ADHD. Behavioural Brain Research, 408, 113236. https://doi.org/10.1016/j.bbr.2021.113236
Smethells, J. R., & Reilly, M. P. (2015). Intertrial interval duration and impulsive choice. Journal of the Experimental Analysis of Behavior, 103(1), 153-165. https://doi.org/10.1002/jeab.131
Stein, J. S., Craft, W. H., Paluch, R. A., Gatchalian, K. M., Greenawald, M. H., Quattrin, T., Mastrandrea, L. D., Epstein, L. H., & Bickel, W. K. (2021). Bleak present, bright future: II. Combined effects of episodic future thinking and scarcity on delay discounting in adults at risk for type 2 diabetes. Journal of Behavioral Medicine, 44(2), 222-230. https://doi.org/10.1007/s10865-020-00178-7
Stevens, S. S. (1986/1975). Psychophysics: Introduction to its perceptual, neural, and social prospects (2nd ed.). Transaction.
Takahashi, T. (2011). Psychophysics of the probability weighting function. Physica A: Statistical Mechanics and its Applications, 390(5), 902-905. https://doi.org/10.1016/j.physa.2010.10.004
Takahashi, T., Ikeda, K., & Hasegawa, T. (2007). A hyperbolic decay of subjective probability of obtaining delayed rewards. Behavioral and Brain Functions, 3(1), 52. https://doi.org/10.1186/1744-9081-3-52
Takahashi, T., Oono, H., & Radford, M. H. B. (2007). Comparison of probabilistic choice models in humans. Behavioral and Brain Functions, 3(1), 20. https://doi.org/10.1186/1744-9081-3-20
Treutwein, B. (1995). Adaptive psychophysical procedures. Vision Research, 35(17), 2503-2522. https://www.ncbi.nlm.nih.gov/pubmed/8594817
Treutwein, B. (1997). YAAP: Yet another adaptive procedure. Spatial Vision, 11(1), 129-134. PMID: 18095394
Vanderveldt, A., Green, L., & Myerson, J. (2015). Discounting of monetary rewards that are both delayed and probabilistic: Ddelay and probability combine multiplicatively, not additively. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(1), 148-162. https://doi.org/10.1037/xlm0000029
Vanderveldt, A., Green, L., & Rachlin, H. (2017). Discounting by probabilistic waiting. Journal of Behavioral Decision Making, 30(1), 39-53. https://doi.org/10.1002/bdm.1917
Walsh, V. (2003). A theory of magnitude: Common cortical metrics of time, space and quantity. Trends in Cognitive Sciences, 7(11), 483-488. https://doi.org/10.1016/j.tics.2003.09.002
Wearden, J., & Burgess, I. (1982). Matching since Baum (1979). Journal of the Experimental Analysis of Behavior, 38(3), 339-348. https://doi.org/10.1901/jeab.1982.38-339