Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex.
ADHD
Dopamine
Functional MRI
Prediction errors
Reinforcement learning
Journal
NeuroImage. Clinical
ISSN: 2213-1582
Titre abrégé: Neuroimage Clin
Pays: Netherlands
ID NLM: 101597070
Informations de publication
Date de publication:
01 Mar 2024
01 Mar 2024
Historique:
received:
02
06
2023
revised:
06
02
2024
accepted:
28
02
2024
medline:
13
3
2024
pubmed:
13
3
2024
entrez:
12
3
2024
Statut:
aheadofprint
Résumé
Reward-based learning and decision-making are prime candidates to understand symptoms of attention deficit hyperactivity disorder (ADHD). However, only limited evidence is available regarding the neurocomputational underpinnings of the alterations seen in ADHD. This concerns flexible behavioral adaption in dynamically changing environments, which is challenging for individuals with ADHD. One previous study points to elevated choice switching in adolescent ADHD, which was accompanied by disrupted learning signals in medial prefrontal cortex. Here, we investigated young adults with ADHD (n = 17) as compared to age- and sex-matched controls (n = 17) using a probabilistic reversal learning experiment during functional magnetic resonance imaging (fMRI). The task requires continuous learning to guide flexible behavioral adaptation to changing reward contingencies. To disentangle the neurocomputational underpinnings of the behavioral data, we used reinforcement learning (RL) models, which informed the analysis of fMRI data. ADHD patients performed worse than controls particularly in trials before reversals, i.e., when reward contingencies were stable. This pattern resulted from 'noisy' choice switching regardless of previous feedback. RL modelling showed decreased reinforcement sensitivity and enhanced learning rates for negative feedback in ADHD patients. At the neural level, this was reflected in a diminished representation of choice probability in the left posterior parietal cortex in ADHD. Moreover, modelling showed a marginal reduction of learning about the unchosen option, which was paralleled by a marginal reduction in learning signals incorporating the unchosen option in the left ventral striatum. Taken together, we show that impaired flexible behavior in ADHD is due to excessive choice switching ('hyper-flexibility'), which can be detrimental or beneficial depending on the learning environment. Computationally, this resulted from blunted sensitivity to reinforcement of which we detected neural correlates in the attention-control network, specifically in the parietal cortex. These neurocomputational findings remain preliminary due to the relatively small sample size.
Identifiants
pubmed: 38471434
pii: S2213-1582(24)00027-5
doi: 10.1016/j.nicl.2024.103588
pmc: PMC10943992
pii:
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
103588Informations de copyright
Copyright © 2024. Published by Elsevier Inc.
Déclaration de conflit d'intérêts
Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Références
Neurosci Biobehav Rev. 2016 Dec;71:633-656
pubmed: 27608958
J Cogn Neurosci. 2016 Feb;28(2):199-209
pubmed: 26488590
Science. 2008 Feb 29;319(5867):1264-7
pubmed: 18309087
Nat Rev Neurosci. 2013 May;14(5):365-76
pubmed: 23571845
Psychopharmacology (Berl). 2021 Dec;238(12):3569-3584
pubmed: 34676440
J Atten Disord. 2015 May;19(5):355-67
pubmed: 25477020
Psychol Assess. 2006 Mar;18(1):1-14
pubmed: 16594807
Neuron. 2011 Mar 24;69(6):1204-15
pubmed: 21435563
Nervenarzt. 2002 Sep;73(9):830-8
pubmed: 12215873
Science. 2020 Mar 20;367(6484):1362-1366
pubmed: 32193325
J Cogn Neurosci. 2011 Jan;23(1):41-52
pubmed: 19925176
Neuroscientist. 2012 Oct;18(5):502-15
pubmed: 21636849
Elife. 2021 Dec 09;10:
pubmed: 34882092
Neuropsychology. 2020 Sep;34(6):686-698
pubmed: 32437194
Neuroimage. 2014 Apr 1;89:171-80
pubmed: 24291614
Science. 2004 Apr 16;304(5669):452-4
pubmed: 15087550
Child Neuropsychol. 2018 Feb;24(2):261-276
pubmed: 27937142
Front Behav Neurosci. 2010 Nov 04;4:170
pubmed: 21120145
Nature. 2006 Aug 31;442(7106):1042-5
pubmed: 16929307
J Atten Disord. 2013 Nov;17(8):690-8
pubmed: 22441889
Psychiatry Res. 2009 Aug 15;168(3):222-9
pubmed: 19545907
PLoS Comput Biol. 2012;8(3):e1002410
pubmed: 22412360
Dev Cogn Neurosci. 2019 Dec;40:100733
pubmed: 31770715
J Neurodev Disord. 2018 Dec 27;10(1):42
pubmed: 30587104
Psychopharmacology (Berl). 2010 Jul;210(4):511-9
pubmed: 20424828
Proc Natl Acad Sci U S A. 2007 Oct 9;104(41):16311-6
pubmed: 17913879
Proc Natl Acad Sci U S A. 2009 Jan 13;106(2):617-22
pubmed: 19104049
J Mem Lang. 2013 Apr;68(3):
pubmed: 24403724
Elife. 2020 Jun 02;9:
pubmed: 32484779
Clin Psychol Rev. 2013 Aug;33(6):795-811
pubmed: 23872284
JAMA Psychiatry. 2014 Oct;71(10):1165-73
pubmed: 25142296
J Am Acad Child Adolesc Psychiatry. 2015 May;54(5):394-402
pubmed: 25901776
Sci Rep. 2021 Aug 4;11(1):15810
pubmed: 34349186
Sci Rep. 2017 Feb 13;7:42066
pubmed: 28198813
Percept Mot Skills. 1993 Jun;76(3 Pt 1):1035-42
pubmed: 8321574
Biol Mood Anxiety Disord. 2013 Jun 19;3(1):12
pubmed: 23782813
Curr Opin Neurobiol. 2013 Apr;23(2):229-38
pubmed: 23267662
Hum Brain Mapp. 2013 Jun;34(6):1490-9
pubmed: 22344813
J Atten Disord. 2021 Jan;25(2):171-187
pubmed: 29806533
Nervenarzt. 2004 Sep;75(9):888-95
pubmed: 15378249
Front Neurosci. 2021 Jan 18;14:536596
pubmed: 33536865
J Child Psychol Psychiatry. 2008 Jul;49(7):691-704
pubmed: 18081766
Proc Natl Acad Sci U S A. 2015 Feb 3;112(5):1595-600
pubmed: 25605941
J Cogn Neurosci. 2001 Jul 1;13(5):698-710
pubmed: 11506665
J Abnorm Child Psychol. 2019 Dec;47(12):1889-1902
pubmed: 31292806
Neuroimage. 2023 Feb 15;267:119831
pubmed: 36586541
Nat Commun. 2018 Apr 26;9(1):1673
pubmed: 29700377
Eur J Neurosci. 2015 Feb;41(4):477-86
pubmed: 25546072
Biol Cybern. 2013 Dec;107(6):711-9
pubmed: 24085507
Front Comput Neurosci. 2022 Jul 18;16:849323
pubmed: 35923915
Dev Cogn Neurosci. 2023 Apr;60:101226
pubmed: 36905874
Nat Neurosci. 1998 Aug;1(4):304-9
pubmed: 10195164
Science. 2004 Dec 10;306(5703):1940-3
pubmed: 15528409
J Child Psychol Psychiatry. 2001 Jul;42(5):691-8
pubmed: 11464973
Nat Rev Dis Primers. 2015 Aug 06;1:15020
pubmed: 27189265
Neuroimage. 2005 Jul 1;26(3):839-51
pubmed: 15955494
J Neurosci. 2023 Mar 22;43(12):2178-2189
pubmed: 36823039
Neuropsychopharmacology. 2017 Feb;42(3):628-637
pubmed: 27301429
Cereb Cortex. 2015 Jul;25(7):1757-70
pubmed: 24451919
Am J Psychiatry. 2012 Mar;169(3):264-72
pubmed: 22294258
J Neurosci. 2016 Oct 26;36(43):10935-10948
pubmed: 27798176
Behav Res Methods. 2022 Dec;54(6):2993-3014
pubmed: 35167111
Cell Tissue Res. 2021 Jan;383(1):207-225
pubmed: 33515291
Neurosci Biobehav Rev. 2014 Jan;38:125-34
pubmed: 23928090
Brain Struct Funct. 2022 Jan;227(1):63-76
pubmed: 34596757