Pigeons prefer to invest early for future reinforcers.
future control
pigeons
precurrent behavior
response investment
stimulus control
Journal
Journal of the experimental analysis of behavior
ISSN: 1938-3711
Titre abrégé: J Exp Anal Behav
Pays: United States
ID NLM: 0203727
Informations de publication
Date de publication:
05 2021
05 2021
Historique:
revised:
14
02
2021
received:
24
10
2019
accepted:
08
03
2021
pubmed:
5
5
2021
medline:
29
10
2021
entrez:
4
5
2021
Statut:
ppublish
Résumé
Five pigeons were trained in a series of conditions in which food was delivered after 25 responses, but only when a different (Investing) response had been made before the 25 responses had been completed. If an Investing response was not made, the 25 responses ended in blackout. In various conditions, effective Investing responses either had to be made before the first of the 25 responses, or anywhere within the 25 responses; and effective Investing responses either resulted in a stimulus change or did not. Pigeons Invested even when the consequences were temporally and spatially distant, but Investing was most likely when it produced an immediate stimulus change. When given the choice, pigeons preferred to make Investing responses at the beginning of a trial. These findings again demonstrate that behavior may be maintained by events that are separated in time and space from the present.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
650-666Informations de copyright
© 2021 Society for the Experimental Analysis of Behavior.
Références
Autor, S. M. (1969). The strength of conditioned reinforcers as a function of the frequency and probability of reinforcement. In D. P. Hendry (Ed.), Conditioned reinforcement. Dorsey Press.
Azrin, N. H., Hake, D. F., Holz, W. C., & Hutchinson, R. R. (1965). Motivational aspects of escape from punishment. Journal of the Experimental Analysis of Behavior, 8, 31-44. https://doi.org/10.1901/jeab.1965.8-31
Bischof-Köhler, D. (1985). Zur Phylogenese menschlicher Motivation. In L. H. Eckensberger & E. D. Lantermann (Eds.), Emotion und Reflexivität (pp. 3-47). Urban & Schwarzenberg.
Blough, D.S. (1959). Delayed matching in the pigeon. Journal of the Experimental Analysis of Behavior, 2, 151-160.
Bourjade, M., Call, J., Pele, M., Maumy, M., & Dufour, V. (2014). Bonobos and orangutans, but not chimpanzees, flexibly plan for the future in a token-exchange task. Animal Cognition, 17, 1329-1340. https://doi.org/10.1007/s10071-014-0768-6
Brinker, R. P., & Treadway, J. T. (1975). Preference and discrimination between response-dependent and response-independent schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 24, 73-77. https://doi.org/10.1901/jeab.1975.24-73
Catania, A. C. (1992). Learning (3rd ed.). Englewood Clifs, NJ: Prentice-Hall.
Cowie, S. (2018). Behavioral time travel: Control by past, present, and potential events. Behavior Analysis: Research and Practice, 18, 174-183. https://doi.org/10.1037/bar0000122
Cowie, S., & Davison, M. (2016). Control by reinforcers across time and space: A review of recent choice research. Journal of the Experimental Analysis of Behavior, 105, 246-269. https://doi.org/10.1002/jeab.200
Cowie, S., Davison, M., & Elliffe, D. (2011). Reinforcement: Food signals the time and location of future food. Journal of the Experimental Analysis of Behavior, 96, 63-86. https://doi.org/10.1901/jeab.2011.96-63
Cowie, S., Davison, M., & Elliffe, D. (2017). Control by past and present stimuli depends on the discriminated reinforcer differential. Journal of the Experimental Analysis of Behavior, 108, 184-203. https://doi.org/10.1002/jeab.268
Davison, M. (1988). Delay of reinforcers in a concurrent-chain schedule: An extension of the hyperbolic-decay model. Journal of the Experimental Analysis of Behavior, 50(2), 219-236. https://doi.org/10.1901/jeab.1988.50-219.
Davis, H., & Memmott, J. (1982). Counting behavior in animals: A critical evaluation. Psychological Bulletin, 92, 547-571. https://doi.org/10.1037/0033-2909.92.3.547
Davison, M. (1968). Some effects of Selective Punishment on Sequential Interresponse Times in Fixed-Ratio Performance. Unpublished Doctoral Dissertation, The University of Otago, N.Z.
Davison, M. C. (1970). A choice technique to assess the effects of selective punishment on fixed-ratio performance. Journal of the Experimental Analysis of Behavior, 13, 57-64. https://doi.org/10.1901/jeab.1970.13-57
Davison, M. (2017). Killeen and Jacobs (2016) are not wrong. The Behavior Analyst, 40, 57-64. https://doi.org/10.1007/s40614-017-0118-5
Davison, M., & Baum, W. M. (2006). Do conditional reinforcers count? Journal of the Experimental Analysis of Behavior, 86, 269-283. https://doi.org/10.1901/jeab.2006.56-05
Davison, M., & Baum, W. M. (2010). Stimulus effects on local preference: Stimulus-response contingencies, stimulus-food pairing, and stimulus-food correlation. Journal of the Experimental Analysis of Behavior, 93, 45-59. https://doi.org/10.1901/jeab.2010.93-45
Davison, M., & Cowie, S. (2019). Timing or counting? Control by contingency reversals at fixed times or numbers of responses. Journal of Experimental Psychology: Animal Learning and Cognition, 45(2), 222. https://doi.org/10.1037/xan0000201
Fantino, E. (1969). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723-730. https://doi.org/10.1901/jeab.1969.12-723
Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement, Appleton-Century-Crofts.
Grace, R. C. (1995). Independence of reinforcement delay and magnitude in concurrent chains. Journal of the Experimental Analysis of Behavior, 63, 255-276. https://doi.org/10.1901/jeab.1995.63-255
Grace, R. C. (1996). Choice between fixed and variable delays to reinforcement in the adjusting-delay procedure and concurrent chains. Journal of Experimental Psychology: Animal Behavior Processes, 22, 362-383. https://doi.org/10.1037/0097-7403.22.3.362
Hodos, W., Ross, G. S., & Brady, J. V. (1962). Complex response patterns during temporally spaced responding. Journal of the Experimental Analysis of Behavior, 5, 473-479.
Jans, J. E., & Catania, A. C. (1980). Short-term remembering of discriminative stimuli in pigeons. Journal of the Experimental Analysis of Behavior, 34, 177-183. https://doi.org/10.1901/jeab.1980.34-177
JASP Team (2018). JASP (Version 0.9) [Computer software]. https://jasp-stats.org (accessed 15.04.19).
Jeffreys, H. (1961). Theory of probability. Oxford University Press.
Kabadayi, C., & Osvath, M. (2017). Ravens parallel great apes in flexible planning for tool-use and bartering. Science, 357(6347), 202-204. https://doi.org/10.1126/science.aam8138
Kamil, A. C., Balda, R. P., Olson, D. J., & Good, S. (1993). Returns to emptied cache sites by Clark's nutcrackers, Nucifraga columbiana: A puzzle revisited. Animal Behaviour, 45(2), 241-252. https://doi.org/10.1006/anbe.1993.1030
Kaplan, P. S., & Hearst, E. (1982). Bridging temporal gaps between CS and US in autoshaping: Insertion of other stimuli before, during, and after CS. Journal of Experimental Psychology: Animal Behavior Processes, 8(2), 187-203. https://doi.org/10.1037/0097-7403.8.2.187.
Killeen, P. R., & Jacobs, K. W. (2017). Coal is not black, snow is not white, food is not a reinforcer: The roles of affordances and dispositions in the analysis of behavior. The Behavior Analyst, 40, 17-38. https://doi.org/10.1007/s40614-016-0080-7
Laties, V. G., Weiss, B., Clark, R. L., & Reynolds, M. D. (1965). Overt "mediating" behavior during temporally spaced responding. Journal of the Experimental Analysis of Behavior, 8, 107-116. https://doi.org/10.1901/jeab.1965.8-107
Laties, V. G., Weiss, B., & Weiss, A. B. (1969). Further observations of overt "mediating" behavior and the discrimination of time. Journal of the Experimental Analysis of Behavior, 12, 43-57. https://doi.org/10.1901/jeab.1969.12-43
Lattal, K. A., & Gleeson, S. (1990). Response acquisition with delayed reinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 16, 27-39. https://psycnet.apa.org/doi/10.1037/0097-7403.16.1.27
Lieberman, D. A., McIntosh, D. C., & Thomas, G. V. (1979). Learning when reward is delayed: A marking hypothesis. Journal of Experimental Psychology: Animal Behavior Processes, 5, 224. https://psycnet.apa.org/doi/10.1037/0097-7403.5.3.224
Lind, J. (2018). What can associative learning do for planning? Royal Society Open Science, 5, 180778. https://doi.org/10.1098/rsos.180778
Lind, J., Enquist, M., & Ghirlanda, S. (2015). Animal memory: A review of delayed matching-to sample data. Behavioural Processes 117, 52-58. https://doi.org/10.1016/j.beproc.2014.11.019
Masson, M. E. (2011). A tutorial on a practical Bayesian alternative to null-hypothesis significance testing. Behavior Research Methods, 43, 679-690. https://doi.org/10.3758/s13428-010-0049-5
Mazur, J. E., & Logue, A. W. (1978). Choice in a “self-control” paradigm: Effects of a fading procedure. Journal of the Experimental Analysis of Behavior, 30, 11-17. https://doi.org/10.1901/jeab.1978.30-11
McMillan, N., & Roberts, W. A. (2012). Pigeons make errors as a result of interval timing in a visual, but not a visual-spatial, midsession reversal task. Journal of Experimental Psychology: Animal Behavior Processes, 38, 440. https://psycnet.apa.org/doi/10.1037/a0030192
Moore, J. (1976). Choice and percentage reinforcement in pigeons. Animal Learning & Behavior, 4, 441-450. https://doi.org/10.3758/BF03214437
Neuringer, A. J. (1969). Delayed reinforcement versus reinforcement after a fixed interval. Journal of the Experimental Analysis of Behavior, 12(3), 375-383. https://doi.org/10.1901/jeab.1969.12-375
Oliveira-Castro, J. M., Coelho, D. S., & Oliveira-Castro, G. A. (1999). Decrease of precurrent behavior as training increases: Effects of task complexity. The Psychological Record, 49(2), 299-325. https://doi.org/10.1007/BF03395322.
Parsons, J. A., Taylor, D. C., & Joyce, T. M. (1981). Precurrent self- prompting operants in children: "Remembering". Journal of the Experimental Analysis of Behavior, 36, 253-266.
Polson, D. A., & Parsons, J. A. (1994). Precurrent contingencies: Behavior reinforced by altering reinforcement probability for other behavior. Journal of the Experimental Analysis of Behavior, 61, 427-439. https://doi.org/10.1901/jeab.1994.61-427
Premack D. (2007). Human and animal cognition: Continuity and discontinuity. Proceedings of the. National Academy of Sciences, 104(13) 861-867. https://doi.org/10.1073/pnas.0706147104)30.
Raby, C. R., Alexis, D. M., Dickinson, A., & Clayton, N. S. (2007). Planning for the future by western scrub jays. Nature, 445, 919-921. https://doi.org/10.1038/nature05575
Rachlin, H., & Green, L. (1972). Commitment, choice and self-control. Journal of the Experimental Analysis of Behavior, 17(1), 15-22. https://doi.org/10.1901/jeab.1972.17-15
Redshaw, J., Taylor, A. H., & Suddendorf, T. (2017). Flexible planning in ravens? Trends in Cognitive Sciences, 21, 821-822. https://doi.org/10.1016/j.tics.2017.09.001
Rescorla, R. (1982). Effect of a stimulus intervening between CS and US in autoshaping. Journal of Experimental Psychology, 8, 131-141. https://psycnet.apa.org/doi/10.1037/0097-7403.8.2.131
Richardson, W. K., & Donahoe, J. W. (1967). A test of the independence of the approach and avoidance gradients. Psychonomic Science, 9, 569-570. https://doi.org/10.3758/BF03327893
Rosenbaum, D. A., Gong, L., & Potts, C. A. (2014). Pre-crastination: Hastening subgoal completion at the expense of extra physical effort. Psychological Science, 25, 1487-1496. https://doi.org/10.1177%2F0956797614532657
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D. & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225-237. https://doi.org/10.3758/PBR.16.2.225
Shahan, T. A. (2010). Conditioned reinforcement and response strength. Journal of the Experimental Analysis of Behavior, 93, 269-289. https://doi.org/10.1901/jeab.2010.93-269z
Shahan, T. A. (2017). Moving beyond reinforcement and response strength. The Behavior Analyst, 40, 107-121. https://doi.org/10.1007/s40614-017-0092-y
Sidman, M. (1962). Time out from avoidance as a reinforcer: A study of response interaction. Journal of the Experimental Analysis of Behavior, 5, 423-434. https://doi.org/10.1901/jeab.1962.5-423
Skinner, B. F. (1968). The technology of teaching. Prentice-Hall.
Skinner, B. F. (1948). ‘Superstition' in the pigeon. Journal of Experimental Psychology, 38(2), 168-172.
Skinner, B. F. (1953). Science and human behavior, The Macmillan Company.
Skinner, B. F. (1969). Contingencies of reinforcement: A theoretical analysis, Englewood Cliffs, NJ: Prentice-Hall.
Snyderman, M. (1983). Delay and amount of reward in a concurrent chain. Journal of the Experimental Analysis of Behavior, 39, 437-447. https://doi.org/10.1901/jeab.1983.39-437
Stagner, J. P., & Zentall, T. R. (2010). Suboptimal choice behavior by pigeons. Psychonomic Bulletin & Review, 17, 412-416. https://doi.org/10.3758/PBR.17.3.412
Suddendorf, T., & Corballis, M. C. (2010). Behavioural evidence for mental time travel in nonhuman animals. Behavioural Brain Research, 215, 292-298. https://doi.org/10.1016/j.bbr.2009.11.044
Thomas, G. V., Robertson, D., & Lieberman, D. A. (1987). Marking effects in Pavlovian trace conditioning. Journal of Experimental Psychology, 13, 126-135. https://psycnet.apa.org/doi/10.1037/0097-7403.13.2.126
Thomas, J. R. (1966). Avoidance of a return to the first component of a chain from the terminal component. Journal of the Experimental Analysis of Behavior, 9(4), 435-441. https://doi.org/10.1901/jeab.1966.9-435
Torgrud, L. J., & Holborn, S. W. (1989). Effectiveness and persistence of precurrent mediating behavior in delayed matching to sample and oddity matching with children. Journal of the Experimental Analysis of Behavior, 52, 181-191. https://doi.org/10.1901/jeab.1989.52-181
Wagenmakers, E. J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779-804. https://doi.org/10.3758/BF03194105
Wasserman, E. A., & Brzykcy, S. J. (2015). Pre-crastination in the pigeon. Psychonomic Bulletin & Review, 22, 1130-1134. https://doi.org/10.3758/s13423-014-0758-3
Westfall, P. H., Johnson, W. O., & Utts, J. M. (1997). A Bayesian perspective on the Bonferroni adjustment. Biometrika, 84, 419-427. https://doi.org/10.1093/biomet/84.2.419
Wilkenfield, J., Nickel, M., Blakely, E., & Poling, A. (1992). Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures. Journal of the Experimental Analysis of Behavior, 58, 431-443. https://doi.org/10.1901/jeab.1992.58-431
Williams, B. A., & Dunn, R. (1991). Preference for conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 55, 37-46. https://doi.org/10.1901/jeab.1991.55-37