Emergence of complex dynamics of choice due to repeated exposures to extinction learning.
ABA renewal
Decision-making
Operant conditioning
Pigeons
Trial-by-trial dynamics
Journal
Animal cognition
ISSN: 1435-9456
Titre abrégé: Anim Cogn
Pays: Germany
ID NLM: 9814573
Informations de publication
Date de publication:
Nov 2021
Nov 2021
Historique:
received:
18
11
2020
accepted:
27
04
2021
revised:
27
03
2021
pubmed:
13
5
2021
medline:
8
10
2021
entrez:
12
5
2021
Statut:
ppublish
Résumé
Extinction learning, the process of ceasing an acquired behavior in response to altered reinforcement contingencies, is not only essential for survival in a changing environment, but also plays a fundamental role in the treatment of pathological behaviors. During therapy and other forms of training involving extinction, subjects are typically exposed to several sessions with a similar structure. The effects of this repeated exposure are not well understood. Here, we studied the behavior of pigeons across several sessions of a discrimination-learning task in context A, extinction in context B, and a return to context A to test the context-dependent return of the learned responses (ABA renewal). By focusing on individual learning curves across animals, we uncovered a session-dependent variability of behavior: (1) during extinction, pigeons preferred the unrewarded alternative choice in one-third of the sessions, predominantly during the first one. (2) In later sessions, abrupt transitions of behavior at the onset of context B emerged, and (3) the renewal effect decayed as sessions progressed. We show that the observed results can be parsimoniously accounted for by a computational model based only on associative learning between stimuli and actions. Our work thus demonstrates the critical importance of studying the trial-by-trial dynamics of learning in individual sessions, and the power of "simple" associative learning processes.
Identifiants
pubmed: 33978856
doi: 10.1007/s10071-021-01521-4
pii: 10.1007/s10071-021-01521-4
pmc: PMC8492564
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1279-1297Subventions
Organisme : Deutsche Forschungsgemeinschaft
ID : 316803389
Informations de copyright
© 2021. The Author(s).
Références
Behav Processes. 2012 May;90(1):101-10
pubmed: 22425783
Q J Exp Psychol (Hove). 2020 Jan;73(1):104-114
pubmed: 31307281
Addiction. 2002 Feb;97(2):155-67
pubmed: 11860387
Anim Learn Behav. 2002 Aug;30(3):217-27
pubmed: 12391788
J Exp Anal Behav. 1969 Jan;12(1):73-80
pubmed: 16811341
Learn Behav. 2011 Mar;39(1):57-67
pubmed: 21279496
Alcohol. 2001 Jul;24(3):205-9
pubmed: 11557306
Science. 1970 Jul 17;169(3942):301-3
pubmed: 5450360
Proc Natl Acad Sci U S A. 2004 Sep 7;101(36):13124-31
pubmed: 15331782
Prog Neurobiol. 2021 Feb;197:101901
pubmed: 32846162
Physiol Behav. 2011 Apr 18;103(1):51-8
pubmed: 21134389
Psychol Rev. 2010 Jan;117(1):197-209
pubmed: 20063968
J Exp Anal Behav. 2005 Nov;84(3):327-38
pubmed: 16596968
Behav Processes. 2012 May;90(1):1-8
pubmed: 22465468
J Exp Psychol Anim Behav Process. 2006 Oct;32(4):441-53
pubmed: 17044746
J Exp Psychol Anim Behav Process. 2013 Jul;39(3):193-207
pubmed: 23627796
Psychol Rev. 1980 Nov;87(6):532-52
pubmed: 7443916
Learn Behav. 2009 Nov;37(4):357-64
pubmed: 19815932
Front Behav Neurosci. 2015 Feb 19;9:34
pubmed: 25745389
J Neurosci. 2012 Jan 11;32(2):726-37
pubmed: 22238108
Am J Psychiatry. 2005 Aug;162(8):1414-22
pubmed: 16055762
Behav Brain Sci. 2018 Mar 08;42:e35
pubmed: 29514723
J Neurosci Methods. 2008 Oct 30;175(1):104-7
pubmed: 18765252
Behav Processes. 2011 May;87(1):125-34
pubmed: 21172410
J Exp Psychol. 1953 Nov;46(5):349-52
pubmed: 13109138
J Exp Psychol Anim Learn Cogn. 2014 Jul;40(3):355-68
pubmed: 25545982
J Exp Psychol. 1961 Feb;61:111-21
pubmed: 13789830
J Exp Psychol Anim Behav Process. 2004 Oct;30(4):271-82
pubmed: 15506853
Nat Neurosci. 2004 Oct;7(10):1144-52
pubmed: 15361879
Science. 2004 Dec 10;306(5703):1944-7
pubmed: 15591205
J Exp Psychol Anim Behav Process. 2006 Jul;32(3):322-8
pubmed: 16834499
Behav Processes. 2017 May;138:29-33
pubmed: 28216120
Hippocampus. 2015 Feb;25(2):149-58
pubmed: 25160592
Learn Mem. 2020 Feb 18;27(3):114-118
pubmed: 32071257
Biol Psychiatry. 2006 Aug 15;60(4):322-8
pubmed: 16919522
J Appl Behav Anal. 2008 Spring;41(1):15-24
pubmed: 18468276
Science. 2003 Jun 6;300(5625):1578-81
pubmed: 12791995
Psychol Rev. 1951 Sep;58(5):313-23
pubmed: 14883244
J Exp Anal Behav. 1976 Sep;26(2):181-90
pubmed: 16811939
J Exp Psychol Anim Behav Process. 2010 Jul;36(3):343-53
pubmed: 20658865
Front Behav Neurosci. 2017 Jul 11;11:128
pubmed: 28744206
Behav Processes. 2010 May;84(1):400-11
pubmed: 20152889
Psychol Rev. 2007 Jul;114(3):784-805
pubmed: 17638506
Am J Psychol. 1949 Oct;62(4):587-90
pubmed: 15392573
Neuron. 2004 Sep 30;44(1):161-79
pubmed: 15450168
J Exp Psychol Anim Learn Cogn. 2019 Apr;45(2):125-142
pubmed: 30816735
J Exp Anal Behav. 2016 Mar;105(2):291-306
pubmed: 26813330
Front Hum Neurosci. 2017 May 23;11:266
pubmed: 28588466
Psychopharmacology (Berl). 2019 Jan;236(1):7-19
pubmed: 30350221
J Exp Psychol Anim Behav Process. 2013 Jan;39(1):56-66
pubmed: 23148868
J Exp Anal Behav. 2014 Jan;101(1):130-51
pubmed: 24170540
J Neurophysiol. 2007 Apr;97(4):3057-69
pubmed: 17202230
Neural Comput. 2006 Apr;18(4):760-93
pubmed: 16494690
Behav Processes. 2017 Apr;137:64-72
pubmed: 27720958
Learn Behav. 2013 Sep;41(3):285-97
pubmed: 23400807
Behav Processes. 2012 May;90(1):89-97
pubmed: 22425781
J Exp Anal Behav. 1960 Jul;3:241-3
pubmed: 13805883
J Exp Anal Behav. 2019 Nov;112(3):290-309
pubmed: 31709561
Behav Brain Res. 2014 May 15;265:93-100
pubmed: 24569011
Front Behav Neurosci. 2013 May 29;7:55
pubmed: 23754992
Learn Behav. 2014 Sep;42(3):281-8
pubmed: 24961749
J Vis Exp. 2014 Jun 02;(88):
pubmed: 24961391
Cell. 2018 Oct 18;175(3):709-722.e15
pubmed: 30245010
Behav Processes. 2017 Sep;142:64-69
pubmed: 28610910
Learn Mem. 2017 Jan 17;24(2):76-80
pubmed: 28096496
J Appl Behav Anal. 2017 Jul;50(3):675-697
pubmed: 28608584
Behav Brain Res. 2018 May 2;343:71-82
pubmed: 29378293
Learn Behav. 2018 Sep;46(3):256-264
pubmed: 29305769
J Exp Psychol Anim Behav Process. 2001 Jan;27(1):79-94
pubmed: 11199517
Eur J Neurosci. 2004 Dec;20(12):3397-403
pubmed: 15610172
Psychophysiology. 2015 Nov;52(11):1483-97
pubmed: 26338030
Nat Neurosci. 2005 Nov;8(11):1481-9
pubmed: 16251991
Psychol Rev. 2008 Jul;115(3):640-76
pubmed: 18729595
Biol Psychiatry. 2007 Sep 1;62(5):446-54
pubmed: 17217927
J Exp Psychol. 1951 Oct;42(4):273-81
pubmed: 14888834
J Exp Psychol Anim Behav Process. 1989 Oct;15(4):338-46
pubmed: 2794870
Pavlov J Biol Sci. 1986 Oct-Dec;21(4):160-72
pubmed: 3785990
J Exp Psychol Gen. 1985 Jun;114(2):159-97
pubmed: 3159828
Front Behav Neurosci. 2019 Nov 14;13:256
pubmed: 31798429
J Neurosci. 2005 May 4;25(18):4485-92
pubmed: 15872095
Behav Brain Res. 2019 Sep 16;370:111947
pubmed: 31102600