Incentive disengagement and the adaptive significance of frustrative nonreward.
Adaptive function of frustration
Frustrative nonreward
Grief
Incentive disengagement
Journal
Learning & behavior
ISSN: 1543-4508
Titre abrégé: Learn Behav
Pays: United States
ID NLM: 101155056
Informations de publication
Date de publication:
09 2022
09 2022
Historique:
accepted:
15
02
2022
pubmed:
4
3
2022
medline:
15
9
2022
entrez:
3
3
2022
Statut:
ppublish
Résumé
Mammals respond to an unexpected reward omission or reduction with a variety of behavioral and physiological responses consistent with an aversive emotion traditionally called frustrative nonreward. This review focuses on two aspects of frustrative nonreward, namely (1) the evidence for an aversive emotional state activated by the surprising omission or reduction of a rewarding outcome, and (2) the adaptive value of frustration. Frustrative nonreward has been mainly studied in terms of its mechanisms, across development in rats and across vertebrate species in comparative research. However, its adaptive function remains obscure. Following Domjan's approach to animal learning, this article explores a specific adaptive function hypothesis of frustrative nonreward called the incentive disengagement hypothesis. According to this hypothesis, the adaptive function of frustrative nonreward is to break an attachment to a site, situation, or stimulus that no longer yields appetitive resources (especially food and fluids) to promote the search for rewards in alternative locations. This function is of particular relevance given that mammals are especially vulnerable to reward loss due to their high metabolic rate and the energy demands of their relatively large brain.
Identifiants
pubmed: 35237945
doi: 10.3758/s13420-022-00519-3
pii: 10.3758/s13420-022-00519-3
doi:
Types de publication
Journal Article
Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
372-388Informations de copyright
© 2022. The Psychonomic Society, Inc.
Références
Amsel, A. (1992). Frustration theory. Cambridge University Press.
doi: 10.1017/CBO9780511665561
Amsel, A., & Roussel, J. (1952). Motivational properties of frustration: I. Effect on a running response of the addition of frustration to the motivational complex. Journal of Experimental Psychology, 43, 363–368. https://doi.org/10.1037/h0059393
doi: 10.1037/h0059393
pubmed: 14946348
Amsel, A., & Stanton, M. (1980). The ontogeny and phylogeny of the paradoxical reward effects. In J. S. Rosenblatt, R. A. Hinde, C. Beer, & M. Busnel (Eds.), Advances in the study of behavior (pp. 227–272). Academic Press.
Anderson, J. R. (2017). Comparative evolutionary thanatology of grief, with special reference to nonhuman primates. Japanese Review of Cultural Anthropology, 18, 173–189. https://doi.org/10.14890/jrca.18.1_173
doi: 10.14890/jrca.18.1_173
Archer, J. (2001). Grief from an evolutionary perspective. In M. S. Stroebe, R. O. Hansson, W. Stroebe, & H. Schut (Eds.), Handbook of bereavement research: Consequences, coping, and care (pp. 263–283). American Psychological Association. https://doi.org/10.1037/10436-011
doi: 10.1037/10436-011
Barton, R. A., & Harvey, P. H. (2000). Parallel adaptive radiations in two major clades of placental mammals. Nature, 405, 1055–1058. https://doi.org/10.1038/35016580
doi: 10.1038/35016580
pubmed: 10890446
Becker, H. C., & Flaherty, C. F. (1982). Influence of ethanol on contrast in consummatory behavior. Psychopharmacology, 77, 253–258. https://doi.org/10.1007/bf00464576
doi: 10.1007/bf00464576
pubmed: 6812148
Becker, H. C., Jarvis, M. F., Wagner, G. C., & Flaherty, C. F. (1984). Medial and lateral amygdalectomy differentially influences consummatory negative contrast. Physiology & Behavior, 33, 707–712. https://doi.org/10.1016/0031-9384(84)90035-0
doi: 10.1016/0031-9384(84)90035-0
Bentosela, M., Ruetti, E., Muzio, R. N., Mustaca, A. E., & Papini, M. R. (2006). Administration of corticosterone after the first downshift session enhances consummatory successive negative contrast. Behavioral Neuroscience, 120, 131–136. https://doi.org/10.1037/0735-7044.120.2.371
doi: 10.1037/0735-7044.120.2.371
Bentosela, M., Jakovcevic, A., Elgier, A. M., Mustaca, A. E., & Papini, M. R. (2009). Incentive contrast in domestic dogs (Canis familiaris). Journal of Comparative Psychology, 123, 125–130. https://doi.org/10.1037/a0013340
doi: 10.1037/a0013340
pubmed: 19450019
Boissy, A., Aubert, A., Désiré, L., Greiveldinger, L., Delval, E., & Veissier, I. (2011). Cognitive sciences to relate ear postures to emotions in sheep. Animal Welfare, 20, 47–56.
Brusatte, S. L., O’Connor, J. K., & Jarvis, E. D. (2015). The origin and diversification of birds. Current Biology, 25, R888–R898. https://doi.org/10.1016/j.cub.2015.08.003
doi: 10.1016/j.cub.2015.08.003
pubmed: 26439352
Cain, C. K. (2019). Avoidance problems reconsidered. Current Opinion in Behavioral Sciences, 26, 9–17. https://doi.org/10.1016/j.cobeha.2018.09.002
doi: 10.1016/j.cobeha.2018.09.002
pubmed: 30984805
Cándido, A., Maldonado, A., Megías, J. L., & Catena, A. (1992). Successive negative contrast in one-way avoidance learning in rats. Quarterly Journal of Experimental Psychology, 45B, 15–32.
Castejón, E., Fuentes-Verdugo, E., Pellón, R. & Torres, C. (under review). Physical activity reduces alcohol consumption induced by reward downshift.
Catania, C. (1970). Reinforcement schedules and psychophysical judgment: A study of some temporal properties of behavior. In W. N. Schoenfeld (Ed.), The theory of reinforcement schedules (pp. 1–42). Appleton-Century-Crofts.
Conrad, S. E., & Papini, M. R. (2018). Reward shifts in forced-choice and free-choice autoshaping with rats. Journal of Experimental Psychology: Animal Learning and Cognition, 44, 422–440. https://doi.org/10.1037/xan0000187
doi: 10.1037/xan0000187
Conrad, S. E., Guarino, S., & Papini, M. R. (2020). Surprising nonreward and response effort: Extinction after progressive-ratio training in rats and pigeons. Learning and Motivation, 72, 101676. https://doi.org/10.1016/j.lmot.2020.101676
doi: 10.1016/j.lmot.2020.101676
Cotton, W. D., Cotton, J. E., & Hunt, A. P. (1998). Evidence for social behavior in ornithopod dinosaurs from the Dakota group of northeastern New Mexico, U.S.A. Ichnos, 6, 141–149. https://doi.org/10.1080/10420949809386445
doi: 10.1080/10420949809386445
Couvillon, P. A., & Bitterman, M. E. (1985). Effect of experience with a preferred food on consummatory responding for a less preferred food in goldfish. Animal Learning & Behavior, 13, 433–438. https://doi.org/10.3758/BF03208020
doi: 10.3758/BF03208020
Crespi, L. P. (1942). Quantitative variation in incentive contrast studies involving discrete-trial procedures. American Journal of Psychology, 55, 467–517. https://doi.org/10.1007/BF03394329
doi: 10.1007/BF03394329
Crump, A., Bethell, E. J., Earley, R., Lee, V. E., Mendl, M., Oldham, L., Turner, S. P., & Arnott, G. (2020). Emotion in animal contests. Proceedings of the Royal Society B: Biological Sciences, 287, 1939. https://doi.org/10.1098/rspb.2020.1715
doi: 10.1098/rspb.2020.1715
Daly, H. B. (1974). Reinforcing properties of escape from frustration aroused in various learning situations. Psychology of Learning and Motivation, 8, 187–231. https://doi.org/10.1016/S0079-7421(08)60455-7
doi: 10.1016/S0079-7421(08)60455-7
Daneri, M. F., Papini, M. R., & Muzio, R. N. (2007). Common toads (Bufo arenarum) learn to anticipate and avoid hypertonic saline solutions. Journal of Comparative Psychology, 121, 419–427. https://doi.org/10.1037/0735-7036.121.4.419
doi: 10.1037/0735-7036.121.4.419
pubmed: 18085926
Davis, M., & Whalen, P. (2001). The amygdala: Vigilance and emotion. Molecular Psychiatry, 6, 13–34. https://doi.org/10.1038/sj.mp.4000812
doi: 10.1038/sj.mp.4000812
pubmed: 11244481
Delfour, F., & Charles, A. (2021). Understanding and assessing emotions in marine mammals under professional care. International Journal of Comparative Psychology, 34. https://doi.org/10.5070/P4341050855
Domjan, M. (1977). Attenuation and enhancement of neophobia for edible substances. In L. M. Barker, M. R. Best, & M. Domjan (Eds.), Learning mechanisms in food selection (pp. 151–179). Baylor University Press.
Domjan, M. (1990). Modification of sexual behavior through conditioning: An avian model. In J. R. Feierman (Ed.), Pedophilia: Biosocial dimensions (pp. 242–273). Springer-Verlag.
doi: 10.1007/978-1-4613-9682-6_10
Domjan, M. (1994). Formulation of a behavior system for sexual conditioning. Psychonomic Bulletin & Review, 1, 421–428. https://doi.org/10.3758/BF03210946
doi: 10.3758/BF03210946
Domjan, M., & Gutiérrez, G. (2019). The behavior system for sexual learning. Behavioural Processses, 162, 184–196. https://doi.org/10.1016/j.beproc.2019.01.013
doi: 10.1016/j.beproc.2019.01.013
Domjan, M., Mahometa, M. J., & Matthews, R. N. (2012). Learning in intimate connections: Conditioned fertility and its role in sexual competition. Socioaffective Neuroscience & Psychology, 2, 17333. https://doi.org/10.3402/snp.v2i0.17333
doi: 10.3402/snp.v2i0.17333
Domonkos, E., Hodosy, J., Ostatnikova, D., & Celec, P. (2018). On the role of testosterone in anxiety-like behavior across life in experimental rodents. Frontiers in Endocrinology, 9, 441. https://doi.org/10.3389/fendo.2018.00441
doi: 10.3389/fendo.2018.00441
pubmed: 30127767
pmcid: 6088149
Donaire, R., Conrad, S. E., Thompson, J. B., Papini, M. R., & Torres, C. (2018). Augmented voluntary consumption of ethanol induced by reward downshift increases locomotor activity of male Wistar rats in the elevated plus maze. Behavioural Processes, 150, 59–65. https://doi.org/10.1016/j.beproc.2018.02.013
doi: 10.1016/j.beproc.2018.02.013
pubmed: 29454084
Donaire, R., Morón, I., Blanco, S., Villatoro, A., Gámiz, F., Papini, M. R., & Torres, C. (2019). Lateral habenula lesions disrupt appetitive extinction, but do not affect voluntary alcohol consumption. Neuroscience Letters, 11, 184–190. https://doi.org/10.1016/j.neulet.2019.03.044
doi: 10.1016/j.neulet.2019.03.044
Donaire, R., Papini, M. R., & Torres, C. (2020). Effects of alcohol consumption induced by reward loss on behavior in the hole-board test. Behavioural Processes, 176, 104135. https://doi.org/10.1016/j.beproc.2020.104135
doi: 10.1016/j.beproc.2020.104135
pubmed: 32437853
Donaire, R., Cándido, C., Papini, M. R., & Torres, C. (2022). Frustrative nonreward and emotional selfmedication: Factors modulating alcohol consumption following reward downshift in rats. Physiology & Behavior, 245, 113688. https://doi.org/10.1016/j.physbeh.2021.113688
Dudley, R. T., & Papini, M. R. (1995). Pavlovian performance of rats following unexpected reward omissions. Learning and Motivation, 26, 63–82. https://doi.org/10.1016/0023-9690(95)90011-X
doi: 10.1016/0023-9690(95)90011-X
Dzik, V., Cavalli, C., Iglesias, M., & Bentosela, M. (2019). Do dogs experience frustration? New contributions on successive negative contrast in domestic dogs (Canis familiaris). Behavioural Processes, 162, 14–19. https://doi.org/10.1016/j.beproc.2019.01.007
doi: 10.1016/j.beproc.2019.01.007
pubmed: 30684734
Elliott, M. H. (1928). The effect of change of reward on the maze performance of rats. University of California Publications in Psychology, 4, 19–30.
Flaherty, C. F. (1991). Incentive contrast and selected animal models of anxiety. In L. Dachowski & C. F. Flaherty (Eds.), Current topics in animal learning: Brain, emotion, and cognition (pp. 207–243). Lawrence Erlbaum Associates.
Flaherty, C. F. (1996). Incentive relativity. Cambridge University Press.
Flaherty, C. F., & Checke, S. (1982). Anticipation of incentive gain. Animal Learning & Behavior, 10, 177–182. https://doi.org/10.3758/BF03212267
doi: 10.3758/BF03212267
Flaherty, C. F., Blitzer, R., & Collier, G. H. (1978). Open-field behaviors elicited by reward reduction. American Journal of Psychology, 91, 429–443. https://doi.org/10.2307/1421690
doi: 10.2307/1421690
Flaherty, C. F., Becker, H. C., & Driscoll, C. (1982). Conditions under which amobarbital sodium influences contrast in consummatory behavior. Physiological Psychology, 10, 122–128. https://doi.org/10.3758/BF03327016
doi: 10.3758/BF03327016
Flaherty, C. F., Becker, H. C., & Pohorecky, L. (1985). Correlation of corticosterone elevation and negative contrast varies as a function of postshift day. Animal Learning & Behavior, 13, 309–314. https://doi.org/10.3758/BF03200025
doi: 10.3758/BF03200025
Flaherty, C. F., Grigson, P. S., & Rowan, G. A. (1986). Chlordiazepoxide and the determinants of contrast. Animal Learning & Behavior, 14, 315–321. https://doi.org/10.3758/BF03200073
doi: 10.3758/BF03200073
Flaherty, C. F., Grigson, P. S., & Lind, S. (1990). Chlordiazepoxide and the moderation of the initial response to reward reduction. Quarterly Journal of Experimental Psychology, 42B, 87–105. https://doi.org/10.1080/14640749008401873
doi: 10.1080/14640749008401873
Flaherty, C. F., Clark, S., & Coppotelli, C. (1996). Lack of tolerance to the contrast-reducing actions of chlordiazepoxide with repeated reward reductions. Physiology & Behavior, 60, 645–652. https://doi.org/10.1016/S0031-9384(96)80043-6
doi: 10.1016/S0031-9384(96)80043-6
Flaherty, C. F., Coppotelli, C., Hsu, D., & Otto, T. (1998). Excitotoxic lesions of the hippocampus disrupt runway but not consummatory contrast. Behavioural Brain Research, 93, 1–9. https://doi.org/10.1016/s0166-4328(97)00138-1
doi: 10.1016/s0166-4328(97)00138-1
pubmed: 9659981
Freidín, E., & Mustaca, A. E. (2004). Frustration and sexual behavior in male rats. Learning & Behavior, 32, 311–320. https://doi.org/10.3758/bf03196030
doi: 10.3758/bf03196030
Freidin, E., Kamenetzky, G., & Mustaca, A. E. (2005). Anxiolytic-like effect of ejaculation upon frustration. Learning & Behavior, 33, 277–286. https://doi.org/10.3758/bf03192857
doi: 10.3758/bf03192857
Freidín, E., Cuello, M. I., & Kacelnik, A. (2009). Successive negative contrast in a bird: starlings’ behaviour after unpredictable negative changes in food quality. Animal Behaviour, 77, 857–865. https://doi.org/10.1016/j.anbehav.2008.12.010
doi: 10.1016/j.anbehav.2008.12.010
Friedman, A., Lax, E., Dikshtein, Y., Abraham, L., Flaumenhaft, Y., Sudai, E., Ben-Tzion, M., & Yadid, G. (2011). Electrical stimulation of the lateral habenula produces an inhibitory effect on sucrose self-administration. Neuropharmacology, 60, 381–387. https://doi.org/10.1016/j.neuropharm.2010.10.006
doi: 10.1016/j.neuropharm.2010.10.006
pubmed: 20955718
Galatzer-Levy, I. R., Bonanno, G. A., Bush, D. E., & LeDoux, J. E. (2013). Heterogeneity in threat extinction learning: Substantive and methodological considerations for identifying individual difference in response to stress. Frontiers in Behavioral Neuroscience, 7, 1–7. https://doi.org/10.3389/fnbeh.2013.00055
doi: 10.3389/fnbeh.2013.00055
Gallup Jr., G. G. (1965). Aggression in rats as a function of frustrative nonreward in a straight alley. Psychonomic Science, 3, 99–100.
doi: 10.3758/BF03343040
Gilpin, N. W., Herman, M. A., & Roberto, M. (2015). The central amygdala as an integrative hub for anxiety and alcohol use disorders. Biological Psychiatry, 77, 859–869. https://doi.org/10.1016/j.biopsych.2014.09.008
doi: 10.1016/j.biopsych.2014.09.008
pubmed: 25433901
Gould, S., & Vrba, E. (1982). Exaptation—a missing term in the science of form. Paleobiology, 8, 4–15. https://doi.org/10.1017/S0094837300004310
doi: 10.1017/S0094837300004310
Gray, J. A., & McNaughton, N. (2000). The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system. Oxford University Press.
Guarino, S., Conrad, S. E., & Papini, M. R. (2020a). Control of free-choice consummatory behavior by absolute reward value. Learning and Motivation, 72, 101682. https://doi.org/10.1016/j.lmot.2020.101682
doi: 10.1016/j.lmot.2020.101682
Guarino, S., Conrad, S. E., & Papini, M. R. (2020b). Frustrative nonreward: Chemogenetic inactivation of the central amygdala abolishes the effect of reward downshift without affecting alcohol intake. Neurobiology of Learning and Memory, 169, 107173. https://doi.org/10.1016/j.nlm.2020.107173
doi: 10.1016/j.nlm.2020.107173
pubmed: 32001338
Gutiérrez, G., & Domjan, M. (1996). Learning and male-male sexual competition in Japanese quail (Coturnix japonica). Journal of Comparative Psychology, 110, 170–175. https://doi.org/10.1037/0735-7036.110.2.170
doi: 10.1037/0735-7036.110.2.170
pubmed: 8681530
Hollis, K. L., Pharr, V. L., Dumas, M. J., Britton, G. B., & Field, J. (1997). Classical conditioning provides paternity advantage for territorial male blue gouramis (Trichogaster trichopterus). Journal of Comparative Psychology, 111, 219–225. https://doi.org/10.1037/0735-7036.111.3.219
doi: 10.1037/0735-7036.111.3.219
Horner, J. (1992). Dinosaur behavior and growth. Paleontological Society Special Publications, 6, 135. https://doi.org/10.1017/S247526220000695X
doi: 10.1017/S247526220000695X
Hu, H., Cui, Y., & Yang, Y. (2020). Circuits and functions of the lateral habenula in health and in disease. Nature Reviews Neuroscience, 21, 277–295. https://doi.org/10.1038/s41583-020-0292-4
doi: 10.1038/s41583-020-0292-4
pubmed: 32269316
Jakovcevic, A., Elgier, A. M., Mustaca, A. E., & Bentosela, M. (2013). Frustration behaviors in domestic dogs. Journal of Applied Animal Welfare Science, 16, 19–34. https://doi.org/10.1080/10888705.2013.740974 .
doi: 10.1080/10888705.2013.740974
pubmed: 23282291
Janak, P. H., & Tye, K. M. (2015). From circuits to behaviour in the amygdala. Nature, 517, 284–292. https://doi.org/10.1038/nature14188
doi: 10.1038/nature14188
pubmed: 25592533
pmcid: 4565157
Jerison, H. J. (1973). Evolution of the brain and intelligence. Academic Press.
Jiménez-García, A. M., Ruíz-Leyva, L., Cendán, C. M., Torres, C., Papini, M. R., & Morón, I. (2016). Hypoalgesia induced by reward devaluation in rats. PLoS ONE, 11, e0164331. https://doi.org/10.1371/journal.pone.0164331
doi: 10.1371/journal.pone.0164331
pubmed: 27764142
pmcid: 5072740
Justel, N., Ruetti, E., Mustaca, A. E., & Papini, M. R. (2011). Effects of pretraining treatment with testosterone on successive and anticipatory negative contrast. Physiology & Behavior, 105, 933–937. https://doi.org/10.1016/j.physbeh.2011.11.012
doi: 10.1016/j.physbeh.2011.11.012
Justel, N., Ruetti, E., Bentosela, M., Mustaca, A. E., & Papini, M. R. (2012). Effects of testosterone administration and gonadectomy on incentive downshift and open field activity in rats. Physiology & Behavior, 106, 657–663. https://doi.org/10.1016/j.physbeh.2012.05.003
doi: 10.1016/j.physbeh.2012.05.003
Kawasaki, K., & Iwasaki, T. (1997). Corticosterone levels during extinction of runway response in rats. Life Sciences, 61, 1721–1728. https://doi.org/10.1016/s0024-3205(97)00778-9
doi: 10.1016/s0024-3205(97)00778-9
pubmed: 9363988
Kawasaki, K., Glueck, A. C., Annicchiarico, I., & Papini, M. R. (2015). Function of the centromedial amygdala in reward devaluation and open-field activity. Neuroscience, 303, 73–81. https://doi.org/10.1016/j.neuroscience.2015.06.053
doi: 10.1016/j.neuroscience.2015.06.053
pubmed: 26141844
Kenney, J. W., Scott, I. C., Josselyn, S. A., & Frankland, P. W. (2017). Contextual fear conditioning in zebrafish. Learning & Memory, 24, 516–523. https://doi.org/10.1101/lm.045690.117
doi: 10.1101/lm.045690.117
Kielan-Jaworowska, Z. (1986). Brain evolution in Mesozoic mammals. In K. M. Flanagan & J. A. Lillegraven (Eds.), Vertebrates, phylogeny, and philosophy (pp. 21–34). University of Wyoming Press.
Klinger, E. (1975). Consequences of commitment to and disengagement from incentives. Psychological Review, 82, 1–25. https://doi.org/10.1037/h0076171
doi: 10.1037/h0076171
Kobre, K. R., & Lipsitt, L. P. (1972). A negative contrast effect in newborns. Journal of Experimental Child Psychology, 14, 81–91. https://doi.org/10.1016/0022-0965(72)90033-1
doi: 10.1016/0022-0965(72)90033-1
pubmed: 5061607
Krusemark, E. A., Novak, L. R., Gitelman, D. R., & Li, W. (2013). When the sense of smell meets emotion: Anxiety-state-dependent olfactory processing and neural circuitry adaptation. Journal of Neuroscience, 33, 15324–15332. https://doi.org/10.1523/JNEUROSCI.1835-13.2013
doi: 10.1523/JNEUROSCI.1835-13.2013
pubmed: 24068799
Lal, P., Tanabe, H., Suster, M. L., Ailani, D., Kotani, Y., Muto, A., Itoh, M., Iwasaki, M., Wada, H., Yaksi, E., & Kawakam, K. (2018). Identification of a neuronal population in the telencephalon essential for fear conditioning in zebrafish. BMC Biology, 16, 45. https://doi.org/10.1186/s12915-018-0502-y
doi: 10.1186/s12915-018-0502-y
pubmed: 29690872
pmcid: 5978991
Lewis, M., Alessandri, S. M., & Sullivan, M. W. (1990). Violation of expectancy, loss of control, and anger expressions in young infants. Developmental Psychology, 26, 745–751. https://doi.org/10.1037/0012-1649.26.5.745
doi: 10.1037/0012-1649.26.5.745
Liao, R. M., & Chuang, F. J. (2003). Differential effects of diazepam infused into the amygdala and hippocampus on negative contrast. Pharmacology, Biochemistry & Behavior, 74, 953–960. https://doi.org/10.1016/s0091-3057(03)00023-6
doi: 10.1016/s0091-3057(03)00023-6
Lin, J., Roman, C., & Reilly, S. (2009). Insular cortex and consummatory successive negative contrast in the rat. Behavioral Neuroscience, 123, 810–814. https://doi.org/10.1037/a0016460
doi: 10.1037/a0016460
pubmed: 19634939
pmcid: 2771552
Lopez Seal, M. F., Cuenya, L., Suarez, A. B., & Mustaca, A. E. (2013). Consummatory suppression due to incentive downshift is not a consequence of enhanced search behavior. Behavioural Processes, 98, 69–71. https://doi.org/10.1016/j.beproc.2013.05.004
doi: 10.1016/j.beproc.2013.05.004
pubmed: 23694741
Lori, A., Maddox, S. A., Sharma, S., Andero, R., Ressler, K. J., & Smith, A. K. (2019). Dynamic patterns of threat-associated gene expression in the amygdala and blood. Frontiers in Psychiatry, 9, 778. https://doi.org/10.3389/fpsyt.2018.00778
doi: 10.3389/fpsyt.2018.00778
pubmed: 30705647
pmcid: 6344436
Lowes, G., & Bitterman, M. E. (1967). Reward and learning in the goldfish. Science, 157, 455–457. https://doi.org/10.1126/science.157.3787.455
doi: 10.1126/science.157.3787.455
pubmed: 6028036
Madsen, O., Scally, M., Duady, C. J., Kao, D. J., DeBry, R. W., Adkins, R., Amrine, H. M., Stanhope, M. J., de Jong, W. W., & Springer, M. S. (2001). Parallel adaptive radiations in two major clades of placental mammals. Nature, 409, 610–614. https://doi.org/10.1038/35054544
doi: 10.1038/35054544
pubmed: 11214318
Manzo, L., Gómez, M. J., Callejas-Aguilera, J. E., Fernández-Teruel, A., Papini, M. R., & Torres, C. (2014). Anti-anxiety self-medication induced by incentive loss in rats. Physiology & Behavior, 123, 86–92. https://doi.org/10.1016/j.physbeh.2013.10.002
doi: 10.1016/j.physbeh.2013.10.002
Manzo, L., Donaire, R., Sabariego, M., Papini, M. R., & Torres, C. (2015a). Anti-anxiety self-medication in rats: Oral consumption of chlordiazepoxide and ethanol after reward devaluation. Behavioural Brain Research, 278, 90–97. https://doi.org/10.1016/j.bbr.2014.09.017
doi: 10.1016/j.bbr.2014.09.017
pubmed: 25242284
Manzo, L., Gómez, M., Callejas-Aguilera, J. E., Fernández-Teruel, A., Papini, M. R., & Torres, C. (2015b). Partial reinforcement reduces vulnerability to anti-anxiety self-medication during appetitive extinction. International Journal of Comparative Psychology, 28(1). https://doi.org/10.5070/P4281025521
Marcet-Rius, M., Cozzi, A., Bienboire-Frosini, C., Teruel, E., Chabaud, C., Monneret, P., Leclerq, J., Lafont-Lecuelle, C., & Pageat, P. (2018). Selection of putative indicators of positive emotions triggered by object and social play in mini-pigs. Applied Animal Behaviour Science, 202, 13–19. https://doi.org/10.1016/j.applanim.2018.02.002
doi: 10.1016/j.applanim.2018.02.002
Mast, V. K., Fagen, J. W., Rovee-Collier, C. K., & Sullivan, M. W. (1980). Immediate and long-term memory for reinforcement context: The development of learned expectancies in early infancy. Child Development, 51, 700–707. https://doi.org/10.2307/1129455
doi: 10.2307/1129455
pubmed: 7418507
McLennan, D. A. (2008). The concept of co-option: Why evolution often looks miraculous. Evolution: Education and Outreach, 1, 247–258. https://doi.org/10.1007/s12052-008-0053-8
doi: 10.1007/s12052-008-0053-8
McMenamin, M. A. S. (2019). Cambrian chordates and vetulicolians. Geosciences, 9, 354. https://doi.org/10.3390/geosciences9080354
doi: 10.3390/geosciences9080354
Mitchell, C., & Flaherty, C. F. (1998). Temporal dynamics of corticosterone elevation in successive negative contrast. Physiology & Behavior, 64, 287–292. https://doi.org/10.1016/s0031-9384(98)00072-9
doi: 10.1016/s0031-9384(98)00072-9
Mustaca, A. E., & Papini, M. R. (2005). Consummatory successive negative contrast induces hypoalgesia. International Journal of Comparative Psychology, 18, 255–262.
Mustaca, A. E., Bentosela, M., & Papini, M. R. (2000a). Consummatory successive negative contrast in mice. Learning and Motivation, 31, 272–282. https://doi.org/10.1006/lmot.2000.1055
doi: 10.1006/lmot.2000.1055
Mustaca, A. E., Martínez, C., & Papini, M. R. (2000b). Surprising nonreward reduces aggressive behavior in rats. International Journal of Comparative Psychology, 13, 91–100.
Muzio, R. N., Pistone Creydt, V., Iurman, M., Rinaldi, M. A., Sirani, B., & Papini, M. R. (2011). Incentive or habit learning in amphibians? PLoS One, 6, e25798. https://doi.org/10.1371/journal.pone.0025798
doi: 10.1371/journal.pone.0025798
pubmed: 22087217
pmcid: 3210735
Nair, S. G., Strand, N. S., & Neumaier, J. F. (2013). DREADDing the lateral habenula: A review of methodological approaches for studying lateral habenula function. Brain Research, 1511, 93–101. https://doi.org/10.1016/j.brainres.2012.10.011
doi: 10.1016/j.brainres.2012.10.011
pubmed: 23085473
Norris, J. N., Perez-Acosta, A. M., Ortega, L. A., & Papini, M. R. (2009). Naloxone facilitates appetitive extinction and eliminates escape from frustration. Pharmacology, Biochemistry and Behavior, 94, 81–87. https://doi.org/10.1016/j.pbb.2009.07.012
doi: 10.1016/j.pbb.2009.07.012
pubmed: 19660490
Northcutt, R. G. (2006). Connections of the lateral and medial divisions of the goldfish telencephalic pallium. Journal of Comparative Neurology, 494, 903–943. https://doi.org/10.1002/cne.20853
doi: 10.1002/cne.20853
pubmed: 16385483
Ortega, L. A., Daniel, A. M., Davis, J. B., Fuchs, P. N., & Papini, M. R. (2011). Peripheral pain enhances the effects of incentive downshifts. Learning and Motivation, 42, 203–209. https://doi.org/10.1016/j.lmot.2011.03.003
doi: 10.1016/j.lmot.2011.03.003
Ortega, L. A., Prado-Rivera, M. A., Cárdenas-Poveda, D. C., McLinden, K. A., Glueck, A. C., Gutiérrez, G., Lamprea, M. R., & Papini, M. R. (2013). Tests of the aversive summation hypothesis in rats: Effects of restraint stress on consummatory successive negative contrast and extinction in the Barnes maze. Learning and Motivation, 44, 159–173. https://doi.org/10.1016/j.lmot.2013.02.001
doi: 10.1016/j.lmot.2013.02.001
Ortega, L. A., Glueck, A. C., Daniel, A. M., Prado-Rivera, M. A., White, M. M., & Papini, M. R. (2014). Memory interfering effects of chlordiazepoxide on consummatory successive negative contrast. Pharmacology, Biochemistry, and Behavior, 116, 96–106. https://doi.org/10.1016/j.pbb.2013.11.031
doi: 10.1016/j.pbb.2013.11.031
pubmed: 24316347
Ortega, L. A., Solano, J. L., Torres, C., & Papini, M. R. (2017). Reward loss and addiction: Opportunities for cross-pollination. Pharmacology, Biochemistry and Behavior, 154, 39–52. https://doi.org/10.1016/j.pbb.2017.02.001
doi: 10.1016/j.pbb.2017.02.001
pubmed: 28174137
Overmier, J. B., & Hollis, K. L. (1983). Teleostean telencephalon in learning. In R. E. Davis & G. Northcutt (Eds.), Fish neurobiology, Vol. 2: Higher brain areas and functions (pp. 265–284). University of Michigan.
Overmier, J. B., & Papini, M. R. (1986). Factors modulating the effects of teleost telencephalon ablation on retention, relearning, and extinction of instrumental avoidance behavior. Behavioral Neuroscience, 100, 190–199. https://doi.org/10.1037/0735-7044.100.2.190
doi: 10.1037/0735-7044.100.2.190
pubmed: 3964421
Papini, M. R. (1997). Role of reinforcement in spaced-trial operant learning in pigeons (Columba livia). Journal of Comparative Psychology, 111, 275–285. https://doi.org/10.1037/0735-7036.111.3.275
doi: 10.1037/0735-7036.111.3.275
Papini, M. R. (2002). Pattern and process in the evolution of learning. Psychological Review, 109, 186–201. https://doi.org/10.1037/0033-295X.109.1.186
doi: 10.1037/0033-295X.109.1.186
pubmed: 11863037
Papini, M. R. (2003). Comparative psychology of surprising nonreward. Brain, Behavior and Evolution, 62, 83–95. https://doi.org/10.1159/000072439
doi: 10.1159/000072439
pubmed: 12937347
Papini, M. R. (2006). Role of surprising nonreward in associative learning. Japanese Journal of Animal Psychology, 56, 35–54. https://doi.org/10.2502/janip.56.35
doi: 10.2502/janip.56.35
Papini, M. R. (2014). Diversity of adjustments to reward downshift in vertebrates. International Journal of Comparative Psychology, 27, 420–445.
doi: 10.46867/ijcp.2014.27.03.05
Papini, M. R. (2021). Comparative psychology. Evolution and development of the brain and behavior (3rd ed.). Taylor & Francis.
Papini, M. R. (2022). Mechanisms underlying absolute and relative reward value in vertebrates. In M. Krause, K. Hollis, & M. R. Papini (Eds.), Evolution of learning and memory mechanisms. Cambridge University Press.
Papini, M. R., & Dudley, R. T. (1997). Consequences of surprising reward omissions. Review of General Psychology, 1, 175–197. https://doi.org/10.1037/1089-2680.1.2.175
doi: 10.1037/1089-2680.1.2.175
Papini, M. R., & Hollingsworth, P. R. (1998). Role of nonreinforcement in the fixed-interval performance of pigeons. Psychonomic Bulletin & Review, 5, 84–90. https://doi.org/10.3758/BF03209460
doi: 10.3758/BF03209460
Papini, M. R., & Ramallo, P. (1990). Primary frustration in the red opossum (Lutreolina crassicaudata). International Journal of Comparative Psychology, 3, 235–242.
Papini, M. R., Mustaca, A. E., & Bitterman, M. E. (1988). Successive negative contrast in the consummatory responding of didelphid marsupials. Animal Learning & Behavior, 16, 53–57. https://doi.org/10.3758/BF03209043
doi: 10.3758/BF03209043
Papini, S., Galatzer-Levy, I. R., & Papini, M. R. (2014). Identifying profiles of recovery from reward devaluation in rats. Behavioural Brain Research, 275, 212–218. https://doi.org/10.1016/j.bbr.2014.09.006
doi: 10.1016/j.bbr.2014.09.006
pubmed: 25218308
pmcid: 4254109
Papini, M. R., Fuchs, P. N., & Torres, C. (2015). Behavioral neuroscience of psychological pain. Neuroscience and Biobehavioral Reviews, 48, 53–69. https://doi.org/10.1016/j.neubiorev.2014.11.012
doi: 10.1016/j.neubiorev.2014.11.012
pubmed: 25446953
Papini, M. R., Penagos-Corzo, J. C., & Pérez-Acosta, A. M. (2019). Avian emotions: Comparative perspectives on fear and frustration. Frontiers in Psychology, 9, 2707. https://doi.org/10.3389/fpsyg.2018.02707
doi: 10.3389/fpsyg.2018.02707
pubmed: 30705652
pmcid: 6344452
Pecoraro, N., Gomez, F., & Dallman, M. F. (2005). Glucocorticoids dose-dependently remodel energy stores and amplify incentive relativity effects. Psychoneuroendocrinology, 30, 815–825. https://doi.org/10.1016/j.psyneuen.2005.03.010
doi: 10.1016/j.psyneuen.2005.03.010
pubmed: 15905038
Pecoraro, N., de Jong, H., & Dallman, M. F. (2009). An unexpected reduction in sucrose concentration activates the HPA axis on successive post shift days without attenuation by discriminative contextual stimuli. Physiology & Behavior, 96, 651–661. https://doi.org/10.1016/j.physbeh.2008.12.018
doi: 10.1016/j.physbeh.2008.12.018
Pellegrini, S., & Mustaca, A. E. (2000). Consummatory successive negative contrast with solid food. Learning and Motivation, 31, 200–209. https://doi.org/10.1006/lmot.2000.1052
doi: 10.1006/lmot.2000.1052
Pellegrini, S., & Papini, M. R. (2007). Scaling relative incentive value in anticipatory behavior. Learning and Motivation, 38, 128–154. https://doi.org/10.1016/j.lmot.2006.08.002
doi: 10.1016/j.lmot.2006.08.002
Pellegrini, S., Lopez Seal, M. F., & Papini, M. R. (2008). Scaling relative incentive value: Different adjustments to incentive downshift in pigeons and rats. Behavioral Processes, 79, 182–188. https://doi.org/10.1016/j.beproc.2008.07.008
doi: 10.1016/j.beproc.2008.07.008
Portavella, M., Salas, C., Vargas, J. P., & Papini, M. R. (2003). Involvement of the telencephalon in spaced-trial avoidance learning in the goldfish (Carassius auratus). Physiology & Behavior, 80, 49–56. https://doi.org/10.1016/S0031-9384(03)00208-7
doi: 10.1016/S0031-9384(03)00208-7
Portavella, M., Torres, B., Salas, C., & Papini, M. R. (2004). Lesions of the medial pallium, but not of the lateral pallium, disrupt spaced-trial avoidance learning in goldfish (Carassius auratus). Neuroscience Letters, 362, 75–78. https://doi.org/10.1016/j.neulet.2004.01.083
doi: 10.1016/j.neulet.2004.01.083
pubmed: 15193757
Prados, J., Sansa, J., & Artigas, A. A. (2008). Partial reinforcement effects on learning and extinction of place preferences in the water maze. Learning & Behavior, 36, 311–318. https://doi.org/10.3758/LB.36.4.311
doi: 10.3758/LB.36.4.311
Proulx, C. D., Hikosaka, O., & Malinow, R. (2014). Reward processing by the lateral habenula in normal and depressive behaviors. Nature Neuroscience, 17, 1146–1152. https://doi.org/10.1038/nn.3779
doi: 10.1038/nn.3779
pubmed: 25157511
pmcid: 4305435
Quaranta, A. M., Siniscalchi, M., & Vallortigara, G. (2007). Asymmetric tail-wagging responses by dogs to different emotive stimuli. Current Biology, 17, 199–201. https://doi.org/10.1016/j.cub.2007.02.008
doi: 10.1016/j.cub.2007.02.008
Randle, E., & Sansom, R. S. (2019). Bite marks and predation of fossil jawless fish during the rise of jawed vertebrates. Proceedings of the Royal Society, B, 286, 20191596. https://doi.org/10.1098/rspb.2019.1596
doi: 10.1098/rspb.2019.1596
Rasmussen, K., & Reite, M. (1982). Loss-induced depression in an adult macaque monkey. American Journal of Psychiatry, 139, 679–681. https://doi.org/10.1176/ajp.139.5.679
doi: 10.1176/ajp.139.5.679
pubmed: 7200331
Reggente, M. A. L., Alves, F., Nicolau, C., Freitas, L., Cagnazzi, D., Baird, R. W., & Galli, P. (2016). Nurturant behavior toward dead conspecifics in free-ranging mammals: new records for odontocetes and a general review. Journal of Mammalogy, 97, 1428–1434. https://doi.org/10.1093/jmammal/gyw089
doi: 10.1093/jmammal/gyw089
Reimert, I., Bolhuis, J. E., Kemp, B., & Rodenburg, T. B. (2013). Indicators of positive and negative emotions and emotional contagion in pigs. Physiology & Behavior, 109, 42–50. https://doi.org/10.1016/j.physbeh.2012.11.002
doi: 10.1016/j.physbeh.2012.11.002
Reimert, I., Fong, S., Rodenburg, T. B., & Bolhuis, J. E. (2017). Emotional states and emotional contagion in pigs after exposure to a positive and negative treatment. Applied Animal Behaviour Science, 193, 37–42. https://doi.org/10.1016/j.applanim.2017.03.009
doi: 10.1016/j.applanim.2017.03.009
Romero, L. M., Levine, S., & Sapolsky, R. M. (1995). Adrenocorticotropin secretagog release: stimulation by frustration and paradoxically by reward presentation. Brain Research, 676, 151–156. https://doi.org/10.1016/0006-8993(95)00111-3
doi: 10.1016/0006-8993(95)00111-3
pubmed: 7796164
Rosen, A. J., & Tessel, R. E. (1970). Chlorpromazine, chlordiazepoxide and incentive shift performance in the rat. Journal of Comparative & Physiological Psychology, 72, 257–262. https://doi.org/10.1037/h0029467
doi: 10.1037/h0029467
Ruetti, E., Justel, N., Mustaca, A. E., & Papini, M. R. (2009). Postsession corticosterone administration enhances the effects of incentive downshift: Exploring the boundaries of this effect. Behavioral Neuroscience, 123, 127–144. https://doi.org/10.1037/a0013805
doi: 10.1037/a0013805
Ruta, M., Botha-Brink, J., Mitchell, S. A., & Benton, M. J. (2013). The radiation of cynodonts and the ground plan of mammalian morphological diversity. Proceedings of the Royal Society, B280, 20131865. https://doi.org/10.1098/rspb.2013.1865
doi: 10.1098/rspb.2013.1865
Sabariego, M., Morón, I., Gómez, M. J., Donaire, R., Tobeña, A., Fernández-Teruel, A., Martínez-Conejero, J. A., Esteban, F. J., & Torres, C. (2013). Incentive loss and hippocampal gene expression in inbred Roman high- (RHA-I) and Roman low- (RLA-I) avoidance rats. Behavioural Brain Research, 257, 62–70. https://doi.org/10.1016/j.bbr.2013.09.025
doi: 10.1016/j.bbr.2013.09.025
pubmed: 24055493
Salinas, J. A., Packard, M. G., & McGaugh, J. L. (1993). Amygdala modulates memory for changes in reward magnitude: Reversible post-training inactivation with lidocaine attenuates the response to a reduction in reward. Behavioural Brain Research, 59, 153–159. https://doi.org/10.1016/0166-4328(93)90162-J
doi: 10.1016/0166-4328(93)90162-J
pubmed: 8155283
Sastre, A., Lin, J.-Y., & Reilly, S. (2005). Failure to obtain instrumental successive negative contrast in tasks that support consummatory successive negative contrast. International Journal of Comparative Psychology, 18, 307–319.
Serres, A., Hao, Y., & Wang, D. (2020). Swimming features in captive odontocetes: Indicative of animals’ emotional state? Behavioural Processes, 170, 103998. https://doi.org/10.1016/j.beproc.2019.103998
doi: 10.1016/j.beproc.2019.103998
pubmed: 31705925
Sharma, N., Pokharel, S. S., Kohshima, S., & Sukumar, R. (2019). Behavioural responses of free-ranging Asian elephants (Elephas maximus) towards dying and dead conspecifics. Primates, 61, 129–138. https://doi.org/10.1007/s10329-019-00739-8
doi: 10.1007/s10329-019-00739-8
pubmed: 31428950
Silva, K. M., & Silva, F. J. (2022). A behavior systems framework: What it is and how to use it. In M. Krause, K. L. Hollis, & M. R. Papini (Eds.), Evolution of learning and memory mechanisms. Cambridge University Press.
Siniscalchi, M., Lusito, R., Vallortigara, G., & Quaranta, A. (2013). Seeing left-or right-asymmetric tail wagging produces different emotional responses in dogs. Current Biology, 23, 2279–2282. https://doi.org/10.1016/j.cub.2013.09.027
doi: 10.1016/j.cub.2013.09.027
pubmed: 24184108
Stout, S. C., Muzio, R. N., Boughner, R. L., & Papini, M. R. (2002). Aftereffects of the surprising presentation and omission of appetitive reinforcers on key pecking performance in pigeons. Journal of Experimental Psychology: Animal Behavior Processes, 28, 242–256. https://doi.org/10.1037/0097-7403.28.3.242
doi: 10.1037/0097-7403.28.3.242
pubmed: 12136701
Stout, S. C., Boughner, R. L., & Papini, M. R. (2003). Reexamining the frustration effect in rats: Aftereffects of surprising reinforcement and nonreinforcement. Learning and Motivation, 34, 437–456. https://doi.org/10.1016/S0023-9690(03)00038-9
doi: 10.1016/S0023-9690(03)00038-9
Striedter, G. F. (2005). Principles of brain evolution. Sinauer Associates.
Sun, P., Smith, A. S., Lei, K., Liu, Y., & Wang, Z. (2014). Breaking bonds in male prairie vole: Long-term effects on emotional and social behavior, physiology, and neurochemistry. Behavioural Brain Research, 265, 22–31. https://doi.org/10.1016/j.bbr.2014.02.016
doi: 10.1016/j.bbr.2014.02.016
pubmed: 24561258
pmcid: 3983777
Thomas, B. L., & Papini, M. R. (2001). Adrenalectomy eliminates the extinction spike in autoshaping with rats. Physiology & Behavior, 72, 543–547. https://doi.org/10.1016/S0031-9384(00)00448-0
doi: 10.1016/S0031-9384(00)00448-0
Tinklepaugh, O. L. (1928). An experimental study of representative factors in monkeys. Journal of Comparative Psychology, 8, 197–236. https://doi.org/10.1037/h0075798
doi: 10.1037/h0075798
Torres, C., & Papini, M.R. (2016). Emotional Self-Medication and addiction. En V.R. Preedy (Ed.), The Neuropathology Of Drug Addictions And Substance Misuse, Vol I (pp. 71-81). Elsevier Inc.
Torres, C., & Papini, M. R. (in press). The comparative psychology of frustrative nonreward. In L. Al-Shawaf & T. Shackelford (Eds.), The Oxford Handbook of Evolution and the Emotions. Oxford University Press.
Torres, C., Morales, A., Megías, J. L., Cándido, A., & Maldonado, A. (1994). Flumazenil antagonizes the effect of diazepam on negative contrast in one-way avoidance learning. Behavioral Pharmacology, 5, 637–641. https://doi.org/10.1097/00008877-199410000-00010
doi: 10.1097/00008877-199410000-00010
Trapold, M. A. (1970). Are expectancies based upon different positive reinforcing events discriminably different? Learning and Motivation, 1, 129–140. https://doi.org/10.1016/0023-9690(70)90079-2
doi: 10.1016/0023-9690(70)90079-2
Urcuioli, P. J. (2005). Behavioral and associative effects of differential outcomes in discrimination learning. Learning & Behavior, 33, 1–21. https://doi.org/10.3758/BF03196047
doi: 10.3758/BF03196047
Vogel, J. R., Mikulka, P. J., & Spear, N. E. (1968). Effects of shifts in sucrose and saccharine concentrations on licking behavior in the rat. Journal of Comparative and Physiological Psychology, 66, 661–666. https://doi.org/10.1037/h0026556
doi: 10.1037/h0026556
pubmed: 5721493
Wagner, A. R. (1969). Frustrative nonreward: A variety of punishment. In B. A. Campbell & R. M. Church (Eds.), Punishment and aversive behavior (pp. 157–181). Appleton-Century-Crofts.
Weaver, L. N., Varricchio, D. J., Sargis, E. J., Chen, M., Freimuth, W. J., & Wilson Mantilla, G. P. (2021). Early mammalian social behaviour revealed by multituberculates from a dinosaur nesting site. Nature Ecology & Evolution, 5, 32–37. https://doi.org/10.1038/s41559-020-01325-8
doi: 10.1038/s41559-020-01325-8
Yau, J. O. Y., & McNally, G. P. (2018). Brain mechanisms controlling Pavlovian fear conditioning. Journal of Experimental Psychology: Animal Learning and Cognition, 44, 341–357. https://doi.org/10.1037/xan0000181
doi: 10.1037/xan0000181
Zhang, B. (2017). Consequences of early adverse rearing experience (EARE) on development: Insights from non-human primate studies. Zoological Research, 38, 7–35. https://doi.org/10.13918/j.issn.2095-8137.2017.002
doi: 10.13918/j.issn.2095-8137.2017.002
pubmed: 28271667
pmcid: 5368383