Pupil dilation as an implicit measure of appetitive Pavlovian learning.
associative learning
attention
eye-tracking
pupil dilation
reward
Journal
Psychophysiology
ISSN: 1540-5958
Titre abrégé: Psychophysiology
Pays: United States
ID NLM: 0142657
Informations de publication
Date de publication:
12 2019
12 2019
Historique:
received:
09
04
2019
revised:
20
07
2019
accepted:
22
07
2019
pubmed:
20
8
2019
medline:
28
8
2020
entrez:
20
8
2019
Statut:
ppublish
Résumé
Appetitive Pavlovian conditioning is a learning mechanism of fundamental biological and pathophysiological significance. Nonetheless, its exploration in humans remains sparse, which is partly attributed to the lack of an established psychophysiological parameter that aptly represents conditioned responding. This study evaluated pupil diameter and other ocular response measures (gaze dwelling time, blink duration and count) as indices of conditioning. Additionally, a learning model was used to infer participants' learning progress on the basis of their pupil dilation. Twenty-nine healthy volunteers completed an appetitive differential delay conditioning paradigm with a primary reward, while the ocular response measures along with other psychophysiological (heart rate, electrodermal activity, postauricular and eyeblink reflex) and behavioral (ratings, contingency awareness) parameters were obtained to examine the relation among different measures. A significantly stronger increase in pupil diameter, longer gaze duration and shorter eyeblink duration was observed in response to the reward-predicting cue compared to the control cue. The Pearce-Hall attention model best predicted the trial-by-trial pupil diameter. This conditioned response was corroborated by a pronounced heart rate deceleration to the reward-predicting cue, while no conditioning effect was observed in the electrodermal activity or startle responses. There was no discernible correlation between the psychophysiological response measures. These results highlight the potential value of ocular response measures as sensitive indices for representing appetitive conditioning.
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
e13463Informations de copyright
© 2019 The Authors. Psychophysiology published by Wiley Periodicals, Inc. on behalf of Society for Psychophysiological Research.
Références
Aaron, R. V., & Benning, S. D. (2016). Postauricular reflexes elicited by soft acoustic clicks and loud noise probes: Reliability, prepulse facilitation, and sensitivity to picture contents. Psychophysiology, 53(12), 1900-1908. https://doi.org/10.1111/psyp.12757
Anderson, B. A., Laurent, P. A., & Yantis, S. (2011). Value-driven attentional capture. Proceedings of the National Academy of Sciences of the United States of America, 108(25), 10367-10371. https://doi.org/10.1073/pnas.1104047108
Andreatta, M., & Pauli, P. (2015). Appetitive vs. aversive conditioning in humans. Frontiers in Behavioral Neuroscience, 9, 128. https://doi.org/10.3389/fnbeh.2015.00128
Aston-Jones, G., & Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience, 28, 403-450. https://doi.org/10.1146/annurev.neuro.28.061604.135709
Austin, A. J., & Duka, T. (2010). Mechanisms of attention for appetitive and aversive outcomes in Pavlovian conditioning. Behavioural Brain Research, 213(1), 19-26. https://doi.org/10.1016/j.bbr.2010.04.019
Bach, D. R. (2014). A head-to-head comparison of SCRalyze and Ledalab, two model-based methods for skin conductance analysis. Biological Psychology, 103, 63-68. https://doi.org/10.1016/j.biopsycho.2014.08.006
Bach, D. R., Castegnetti, G., Korn, C. W., Gerster, S., Melinscak, F., & Moser, T. (2018). Psychophysiological modeling: Current state and future directions. Psychophysiology, 55(11), e13214. https://doi.org/10.1111/psyp.13209
Bach, D. R., Flandin, G., Friston, K. J., & Dolan, R. J. (2010). Modelling event-related skin conductance responses. International Journal of Psychophysiology, 75(3), 349-356. https://doi.org/10.1016/j.ijpsycho.2010.01.005
Bach, D. R., Friston, K. J., & Dolan, R. J. (2013). An improved algorithm for model-based analysis of evoked skin conductance responses. Biological Psychology, 94(3), 490-497. https://doi.org/10.1016/j.biopsycho.2013.09.010
Bach, D. R., Symmonds, M., Barnes, G., & Dolan, R. J. (2017). Whole-brain neural dynamics of probabilistic reward prediction. Journal of Neuroscience, 37(14), 3789-3798. https://doi.org/10.1523/JNEUROSCI.2943-16.2017
Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009). Dissecting components of reward: ‘Liking’, ‘wanting’, and learning. Current Opinion in Pharmacology, 9(1), 65-73. https://doi.org/10.1016/j.coph.2008.12.014
Bitsios, P., Szabadi, E., & Bradshaw, C. M. (2004). The fear-inhibited light reflex: Importance of the anticipation of an aversive event. International Journal of Psychophysiology, 52(1), 87-95. https://doi.org/10.1016/j.ijpsycho.2003.12.006
Blechert, J., Testa, G., Georgii, C., Klimesch, W., & Wilhelm, F. H. (2016). The Pavlovian craver: Neural and experiential correlates of single trial naturalistic food conditioning in humans. Physiology & Behaviour, 158, 18-25. https://doi.org/10.1016/j.physbeh.2016.02.028
Blumenthal, T. D., Cuthbert, B. N., Filion, D. L., Hackley, S., Lipp, O. V., & van Boxtel, A. (2005). Committee report: Guidelines for human startle eyeblink electromyographic studies. Psychophysiology, 42(1), 1-15. https://doi.org/10.1111/j.1469-8986.2005.00271.x
Borkenau, P., & Ostendorf, F. (1993). NEO-Fünf-Faktoren Inventar (NEO-FFI) nach Costa und McCrae. Handanweisung. Göttingen, Bern, Toronto, Seattle: Hogrefe.
Bradley, M. M., Miccoli, L., Escrig, M. A., & Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology, 45(4), 602-607. https://doi.org/10.1111/j.1469-8986.2008.00654.x
Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10(4), 433-436. https://doi.org/10.1163/156856897X00357
Bray, S., & O'Doherty, J. P. (2007). Neural coding of reward-prediction error signals during classical conditioning with attractive faces. Journal of Neurophysiology, 97(4), 3036-3045. https://doi.org/10.1152/jn.01211.2006
Bray, S., Rangel, A., Shimojo, S., Balleine, B., & O'Doherty, J. P. (2008). The neural mechanisms underlying the influence of Pavlovian cues on human decision making. Journal of Neuroscience, 28(22), 5861-5868. https://doi.org/10.1523/JNEUROSCI.0897-08.2008
Brocher, A., & Graf, T. (2016). Pupil old/new effects reflect stimulus encoding and decoding in short-term memory. Psychophysiology, 53(12), 1823-1835. https://doi.org/10.1111/psyp.12770
Caffier, P. P., Erdmann, U., & Ullsperger, P. (2003). Experimental evaluation of eye-blink parameters as a drowsiness measure. European Journal of Applies Physiology, 89(3-4), 319-325. https://doi.org/10.1007/s00421-003-0807-5
Carver, C. S., & White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales. Journal of Personality and Social Psychology, 67(2), 319-333.
Castegnetti, G., Tzovara, A., Staib, M., Paulus, P. C., Hofer, N., & Bach, D. R. (2016). Modeling fear-conditioned bradycardia in humans. Psychophysiology, 53(6), 930-939. https://doi.org/10.1111/psyp.12637
Costa, P. T., & McCrae, R. R. (1992). Revised NEO Personality inventory and NEO five-factor inventory (Professional Manual). Odessa: Psychological Assessment Resources.
Delgado, M. R., Gillis, M. M., & Phelps, E. A. (2008). Regulating the expectation of reward via cognitive strategies. Nature Neuroscience, 11(8), 880-881. https://doi.org/10.1038/nn.2141
Delgado, M. R., Jou, R. L., & Phelps, E. A. (2011). Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers. Frontiers in Neuroscience, 5, 71. https://doi.org/10.3389/fnins.2011.00071
Depue, R. A., & Fu, Y. (2013). On the nature of extraversion: Variation in conditioned contextual activation of dopamine-facilitated affective, cognitive, and motor processes. Frontiers in Human Neuroscience, 7, 288. https://doi.org/10.3389/fnhum.2013.00288
Diederen, K. M., Spencer, T., Vestergaard, M. D., Fletcher, P. C., & Schultz, W. (2016). Adaptive prediction error coding in the human midbrain and striatum facilitates behavioral adaptation and learning efficiency. Neuron, 90(5), 1127-1138. https://doi.org/10.1016/j.neuron.2016.04.019
Ebner, N., Riediger, M., & Lindenberger, U. (2010). FACES-A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior Research Methods, 42(1), 351-362. https://doi.org/10.3758/BRM.42.1.351
Ebrahimi, C., Koch, S. P., Friedel, E., Crespo, I., Fydrich, T., Ströhle, A., … Schlagenhauf, F. (2017). Combining D-cycloserine with appetitive extinction learning modulates amygdala activity during recall. Neurobiology of Learning and Memory, 142(Pt B), 209-217. https://doi.org/10.1016/j.nlm.2017.05.008
Ebrahimi, C., Koch, S. P., Pietrock, C., Fydrich, T., Heinz, A., & Schlagenhauf, F. (2019). Opposing roles for amygdala and vmPFC in the return of appetitive conditioned responses in humans. Translational Psychiatry, 9(1), 148. https://doi.org/10.1038/s41398-019-0482-x
Eldar, E., Cohen, J. D., & Niv, Y. (2013). The effects of neural gain on attention and learning. Nature Neuroscience, 16(8), 1146-1153. https://doi.org/10.1038/nn.3428
Fullana, M. A., Harrison, B. J., Soriano-Mas, C., Vervliet, B., Cardoner, N., Àvila-Parcet, A., & Radua, J. (2016). Neural signatures of human fear conditioning: An updated and extended meta-analysis of fMRI studies. Molecular Psychiatry, 21(4), 500-508. https://doi.org/10.1038/mp.2015.88
Gable, P. A., & Harmon-Jones, E. (2009). Postauricular reflex responses to pictures varying in valence and arousal. Psychophysiology, 46(3), 487-490. https://doi.org/10.1111/j.1469-8986.2009.00794.x
Genheimer, H., Andreatta, M., Asan, E., & Pauli, P. (2017). Reinstatement of contextual conditioned anxiety in virtual reality and the effects of transcutaneous vagus nerve stimulation in humans. Scientific Reports, 7(1), 17786. https://doi.org/10.1038/s41598-017-18183-3
Glotzbach-Schoon, E., Andreatta, M., Mühlberger, A., & Pauli, P. (2015). Reinstatement of contextual anxiety in humans: Effects of state anxiety. International Journal of Psychophysiology, 98(3 Pt 2), 557-566. https://doi.org/10.1016/j.ijpsycho.2015.07.013
Goldinger, S. D., & Papesh, M. H. (2012). Pupil dilation reflects the creation and retrieval of memories. Current Directions in Psychological Science, 21(2), 90-95. https://doi.org/10.1177/0963721412436811
Gottfried, J. A., O’Doherty, J. P., & Dolan, R. J. (2002). Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. Journal of Neuroscience, 22(24), 10829-10837. https://doi.org/10.1523/JNEUROSCI.22-24-10829.2002
Granholm, E., & Steinhauer, S. R. (2004). Pupillometric measures of cognitive and emotional processes. International Journal of Psychophysiology, 52(1), 1-6. https://doi.org/10.1016/j.ijpsycho.2003.12.001
Grosshans, M., Loeber, S., & Kiefer, F. (2011). Implications from addiction research towards the understanding and treatment of obesity. Addiction Biology, 16(2), 189-198. https://doi.org/10.1111/j.1369-1600.2010.00300.x
Hermann, C., Ziegler, S., Birbaumer, N., & Flor, H. (2000). Pavlovian aversive and appetitive odor conditioning in humans: Subjective, peripheral, and electrocortical changes. Experimental Brain Research, 132(2), 203-215. https://doi.org/10.1007/s002210000343
Hogarth, L., Dickinson, A., Austin, A., Brown, C., & Duka, T. (2008). Attention and expectation in human predictive learning: The role of uncertainty. Quarterly Journal of Experimental Psychology, 61(11), 1658-1668. https://doi.org/10.1080/17470210701643439
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & van der Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford, UK: Oxford University Press.
Hooker, C. I., Verosky, S. C., Miyakawa, A., Knight, R. T., & D'Esposito, M. (2008). The influence of personality on neural mechanisms of observational fear and reward learning. Neuropsychologia, 46(11), 2709-2794. https://doi.org/10.1016/j.neuropsychologia.2008.05.005
Isaac, L., Vrijsen, J. N., Rinck, M., Speckens, A., & Becker, E. S. (2014). Shorter gaze duration for happy faces in current but not remitted depression: Evidence from eye movements. Psychiatry Research, 218(1-2), 79-86. https://doi.org/10.1016/j.psychres.2014.04.002
Joshi, S., Li, Y., Kalwani, R., & Gold, J. I. (2016). Relationships between pupil diameter and neuronal activity in the locus coeruleus, colliculi, and cingulate cortex. Neuron, 89(1), 221-234. https://doi.org/10.1016/j.neuron.2015.11.028
Just, M. A., Carpenter, P. A., & Miyake, A. (2003). Neuroindices of cognitive workload: Neuroimaging, pupillometric and event-related potential studies of brain work. Theoretical Issues in Ergonomics Science, 4(1), 56-88. https://doi.org/10.1080/14639220210159735
Kahneman, D., & Beatty, J. (1966). Pupil diameter and load on memory. Science, 154(3756), 1583-1585. https://doi.org/10.1126/science.154.3756.1583
Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J. D. (2011). Decoding the formation of reward predictions across learning. Journal of Neuroscience, 31(41), 14624-14630. https://doi.org/10.1523/JNEUROSCI.3412-11.2011
Khemka, S., Tzovara, A., Gerster, S., Quednow, B. B., & Bach, D. R. (2017). Modeling startle eyeblink electromyogram to assess fear learning. Psychophysiology, 54(2), 204-214. https://doi.org/10.1111/psyp.12775
Kiefer, F., & Dinter, C. (2013). New approaches to addiction treatment based on learning and memory. Current Topics in Behavioral Neurosciences, 13, 671-684. https://doi.org/10.1007/7854_2011_147
Kiiski, H. S., Cullen, B., Clavin, S. L., & Newell, F. N. (2016). Perceptual and social attributes underlining age-related preferences for faces. Frontiers in Human Neuroscience, 10, 437. https://doi.org/10.3389/fnhum.2016.00437
Kinner, V. L., Kuchinke, L., Dierolf, A. M., Merz, C. J., Otto, T., & Wolf, O. T. (2017). What our eyes tell us about feelings: Tracking pupillary responses during emotion regulation processes. Psychophysiology, 54(4), 508-518. https://doi.org/10.1111/psyp.12816
Kleiner, M., Brainard, D., Pelli, D., Ingling, A., Murray, R., & Broussard, C. (2007). What's new in Psychtoolbox-3. Perception, 36(14), 1-16.
Kloosterman, N. A., Meindertsma, T., van Loon, A. M., Lamme, V. A., Bonneh, Y. S., & Donner, T. H. (2015). Pupil size tracks perceptual content and surprise. European Journal of Neuroscience, 41(8), 1068-1078. https://doi.org/10.1111/ejn.12859
Klucken, T., Kruse, O., Wehrum-Osinsky, S., Hennig, J., Schweckendiek, J., & Stark, R. (2015). Impact of COMT Val158Met-polymorphism on appetitive conditioning and amygdala/prefrontal effective connectivity. Human Brain Mapping, 36(3), 1093-1101. https://doi.org/10.1002/hbm.22688
Klucken, T., Schweckendiek, J., Merz, C. J., Tabbert, K., Walter, B., Kagerer, S., … Stark, R. (2009). Neural activations of the acquisition of conditioned sexual arousal: Effects of contingency awareness and sex. Journal of Sexual Medicine, 6(11), 3071-3085. https://doi.org/10.1111/j.1743-6109.2009.01405.x
Klucken, T., Wehrum, S., Schweckendiek, J., Merz, C. J., Hennig, J., Vaitl, D., & Stark, R. (2013). The 5-HTTLPR polymorphism is associated with altered hemodynamic responses during appetitive conditioning. Human Brain Mapping, 34(10), 2549-2560. https://doi.org/10.1002/hbm.22085
Klucken, T., Wehrum-Osinsky, S., Schweckendiek, J., Kruse, O., & Stark, R. (2016). Altered appetitive conditioning and neural connectivity in participants with compulsive sexual behavior. Journal of Sexual Medicine, 13(4), 627-636. https://doi.org/10.1016/j.jsxm.2016.01.013
Koenig, S., Kadel, H., Uengoer, M., Schubö, A., & Lachnit, H. (2017). Reward draws the eye, uncertainty holds the eye: Associative learning modulates distractor interference in visual search. Frontiers in Behavioral Neuroscience, 11, 128. https://doi.org/10.3389/fnbeh.2017.00128
Koenig, S., Uengoer, M., & Lachnit, H. (2018). Pupil dilation indicates the coding of past prediction errors: Evidence for attentional learning theory. Psychophysiology, 55(4), e13020. https://doi.org/10.1111/psyp.13020
Konova, A. B., & Goldstein, R. Z. (2018). The emerging neuroscience of appetitive and drug cue extinction in humans. Psychopharmacology, 236(1), 407-414. https://doi.org/10.1007/s00213-018-5098-y
Korn, C. W., & Bach, D. R. (2016). A solid frame for the window on cognition: Modelling event-related pupil responses. Journal of Vision, 16(3), 28. https://doi.org/10.1167/16.3.28
Korn, C. W., Staib, M., Tzovara, A., Castegnetti, G., & Bach, D. R. (2017). A pupil size response model to assess fear learning. Psychophysiology, 54(3), 303-343. https://doi.org/10.1111/psyp.12801
Kruse, O., Tapia León, I., Stark, R., & Klucken, T. (2017). Neural correlates of appetitive extinction in humans. Social Cognitive and Affective Neuroscience, 12(1), 106-115. https://doi.org/10.1093/scan/nsw157
Laeng, B., Sirois, S., & Gredebäck, G. (2012). Pupillometry: A window to the preconscious? Perspectives on Psychological Science, 7(1), 18-27. https://doi.org/10.1177/1745691611427305
Lasaponara, S., Fortunato, G., Dragone, A., Pellegrino, M., Marson, F., Silvetti, M., … Doricchi, F. (2019). Expectancy modulates pupil size both during endogenous orienting and during re-orienting of spatial attention: A study with isoluminant stimuli. European Journal of Neuroscience. Advance online publication. https://doi.org/10.1111/ejn.14391
Laux, L., Glanzmann, P., Schaffner, P., & Spielberger, C. (1981). Das State-Trait-Angstinventar. Theoretische Grundlagen und Handanweisung. Weinheim: Beltz Test GmbH.
Le Pelley, M. E., Pearson, D., Griffiths, O., & Beesley, T. (2015). When goals conflict with values: Counterproductive attentional and oculomotor capture by reward-related stimuli. Journal of Experimental Psychology, 144(1), 158-171. https://doi.org/10.1037/xge0000037
Leuchs, L., Schneider, M., Czisch, M., & Spoormaker, V. I. (2017). Neural correlates of pupil dilation during human fear learning. NeuroImage, 147, 186-197. https://doi.org/10.1016/j.neuroimage.2016.11.072
Leuchs, L., Schneider, M., & Spoormaker, V. I. (2018). Measuring the conditioned response: A comparison of pupillometry, skin conductance, and startle electromyography. Psychophysiology, 56(1), e13283. https://doi.org/10.1111/psyp.13283
Li, S. S., & McNally, G. P. (2014). The conditions that promote fear learning: Prediction error and Pavlovian fear conditioning. Neurobiology of Learning and Memory, 108, 14-21. https://doi.org/10.1016/j.nlm.2013.05.002
Lonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., … Merz, C. J. (2017). Don't fear ‘fear conditioning’: Methodological considerations for the design and analysis of studies on human fear acquisition, extinction, and return of fear. Neuroscience and Biobehavioral Reviews, 77, 247-285. https://doi.org/10.1016/j.neubiorev.2017.02.026
Martin-Soelch, C., Linthicum, J., & Ernst, M. (2007). Appetitive conditioning: Neural bases and implications for psychopathology. Neuroscience and Biobehavioral Reviews, 31(3), 426-440. https://doi.org/10.1016/j.neubiorev.2006.11.002
Mathys, C. D., Daunizeau, J., Friston, K. J., & Stephan, K. E. (2011). A Bayesian foundation for individual learning under uncertainty. Frontiers in Human Neuroscience, 5, 39. https://doi.org/10.3389/fnhum.2011.00039
Mathys, C. D., Lomakina, E. I., Daunizeau, J., Iglesias, S., Brodersen, K. H., Friston, K. J., & Stephan, K. E. (2014). Uncertainty in perception and the hierarchical Gaussian filter. Frontiers in Human Neuroscience, 8, 825. https://doi.org/10.3389/fnhum.2014.00825
Metereau, E., & Dreher, J. C. (2013). Cerebral correlates of salient prediction error for different rewards and punishments. Cerebal Cortex, 23(2), 477-487. https://doi.org/10.1093/cercor/bhs037
Murphy, P. R., O'Connell, R. G., O'Sullivan, M., Robertson, I. H., & Balsters, J. H. (2014). Pupil diameter covaries with BOLD activity in human locus coeruleus. Human Brain Mapping, 35(8), 4140-4154. https://doi.org/10.1002/hbm.22466
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012). Rational regulation of learning dynamics by pupil-linked arousal systems. Nature Neuroscience, 15(7), 1040-1046. https://doi.org/10.1038/nn.3130
Ney, L. J., Wade, M., Reynolds, A., Zuj, D. V., Dymond, S., Matthews, A., & Felmingham, K. L. (2018). Critical evaluation of current data analysis strategies for psychophysiological measures of fear conditioning and extinction in humans. International Journal of Psychophysiology, 134, 95-107. https://doi.org/10.1016/j.ijpsycho.2018.10.010
O'Doherty, J. P., Buchanan, T. W., Seymour, B., & Dolan, R. J. (2006). Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron, 49(1), 157-166. https://doi.org/10.1016/j.neuron.2005.11.014
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38(2), 329-337. https://doi.org/10.1016/S0896-6273(03)00169-7
Pan, J., & Tompkins, W. J. (1985). A real-time QRS detection algorithm. IEEE Transaction on Bio-Medical Engineering, 32(3), 230-236. https://doi.org/10.1109/TBME.1985.325532
Pauli, W. M., Larsen, T., Collette, S., Tyszka, J. M., Seymour, B., & O'Doherty, J. P. (2015). Distinct contributions of ventromedial and dorsolateral subregions of the human substantia nigra to appetitive and aversive learning. Journal of Neuroscience, 35(42), 14220-14233. https://doi.org/10.1523/JNEUROSCI.2277-15.2015
Paulus, P. C., Castegnetti, G., & Bach, D. R. (2016). Modeling event-related heart period responses. Psychophysiology, 53(6), 837-846. https://doi.org/10.1111/psyp.12622
Pavlov, I. P. (1927). Conditioned reflexes. Oxford, UK: Oxford University Press.
Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87(6), 532-552. https://doi.org/10.1037/0033-295X.87.6.532
Prévost, C., McNamee, D., Jessup, R. K., Bossaerts, P., & O'Doherty, J. P. (2013). Evidence for model-based computations in the human amygdala during Pavlovian conditioning. PLOS Computational Biology, 9(2), e1002918. https://doi.org/10.1371/journal.pcbi.1002918
Rajkowski, J., Kubiak, P., & Aston-Jones, G. (1993). Correlations between locus coeruleus (LC) neural activity, pupil diameter and behavior in monkey support a role of LC in attention. Society for Neuroscience, Abstract, Washington, DC.
Reinhard, G., Lachnit, H., & Koenig, S. (2006). Tracking stimulus processing in Pavlovian pupillary conditioning. Psychophysiology, 43(1), 73-83. https://doi.org/10.1111/j.1469-8986.2006.00374.x
Rescorla, R. A. (1988). Pavlovian conditioning. It's not what you think it is. American Psychologist, 43(3), 151-160. https://doi.org/10.1037/0003-066X.43.3.151
Rigoux, L., Stephan, K. E., Friston, K. J., & Daunizeau, J. (2014). Bayesian model selection for group studies-Revisited. NeuroImage, 84, 971-985. https://doi.org/10.1016/j.neuroimage.2013.08.065
Robinson, T. E., & Berridge, K. C. (2000). The psychology and neurobiology of addiction: An incentive-sensitization view. Addiction, 95(Supp 2), S91-S117. https://doi.org/10.1046/j.1360-0443.95.8s2.19.x
Rothkirch, M., Stein, T., Sekutowicz, M., & Sterzer, P. (2012). A direct oculomotor correlate of unconscious visual processing. Current Biology, 22(13), 514-515. https://doi.org/10.1016/j.cub.2012.04.046
Sandt, A. R., Sloan, D. M., & Johnson, K. J. (2009). Measuring appetitive responding with the postauricular reflex. Psychophysiology, 46(3), 491-497. https://doi.org/10.1111/j.1469-8986.2009.00797.x
Schumacher, S., Oe, M., Wilhelm, F. H., Rufer, M., Heinrichs, M., Weidt, S., … Martin-Soelch, C. (2018). Does trait anxiety influence effects of oxytocin on eye-blink startle reactivity? A randomized, double-blind, placebo-controlled crossover study. PLOS One, 13(1), e0190809. https://doi.org/10.1371/journal.pone.0190809
Schweckendiek, J., Stark, R., & Klucken, T. (2016). Neuroticism and extraversion moderate neural responses and effective connectivity during appetitive conditioning. Human Brain Mapping, 37(8), 2992-3002. https://doi.org/10.1002/hbm.23221
Sescousse, G., Caldú, X., Segura, B., & Dreher, J. C. (2013). Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies. Neuroscience and Biobehavioral Reviews, 37(4), 681-696. https://doi.org/10.1016/j.neubiorev.2013.02.002
Seymour, B., Daw, N., Dayan, P., Singer, T., & Dolan, R. (2007). Differential encoding of losses and gains in the human striatum. Journal of Neuroscience, 27(18), 4826-4831. https://doi.org/10.1523/JNEUROSCI.0400-07.2007
Silvetti, M., Vassena, E., Abrahamse, E., & Verguts, T. (2018). Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner. PLOS Computational Biology, 14(8), e1006370. https://doi.org/10.1371/journal.pcbi.1006370
Sirois, S., & Brisson, J. (2014). Pupillometry. Wiley Interdisciplinary Reviews-Cognitive Science, 5(6), 679-692. https://doi.org/10.1002/wcs.1323
Sjouwerman, R., & Lonsdorf, T. B. (2018). Latency of skin conductance responses across stimulus modalities. Psychophysiology, 56, e13307. https://doi.org/10.1111/psyp.13307
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009). Bayesian model selection for group studies. NeuroImage, 46(4), 1004-1017. https://doi.org/10.1016/j.neuroimage.2009.03.025
Stern, J. A., Boyer, D., & Schroeder, D. (1994). Blink rate: A possible measure of fatigue. Human Factors, 36(2), 285-297. https://doi.org/10.1177/001872089403600209
Stern, J. A., Walrath, L. C., & Goldstein, R. (1984). The endogenous eyeblink. Psychophysiology, 21(1), 22-33. https://doi.org/10.1111/j.1469-8986.1984.tb02312.x
Stussi, Y., Delplanque, S., Corai, S., Pourtois, G., & Sander, D. (2018). Measuring Pavlovian appetitive conditioning in humans with the postauricular reflex. Psychophysiology, 55(8), e13073. https://doi.org/10.1111/psyp.13073
Talmi, D., Seymour, B., Dayan, P., & Dolan, R. J. (2009). Human Pavlovian-instrumental transfer. Journal of Neuroscience, 28(2), 360-368. https://doi.org/10.1523/JNEUROSCI.4028-07.2008
Tapia León, I., Kruse, O., Stalder, T., Stark, R., & Klucken, T. (2018). Neural correlates of participantive CS/UCS association in appetitive conditioning. Human Brain Mapping, 39(4), 1637-1646. https://doi.org/10.1002/hbm.23940
Todorov, A., Olivola, C. Y., Dotsch, R., & Mende-Siedlecki, P. (2015). Social attributions from faces: Determinants, consequences, accuracy, and functional significance. Annual Review of Psychology, 66, 519-545. https://doi.org/10.1146/annurev-psych-113011-143831
Tzovara, A., Korn, C. W., & Bach, D. R. (2018). Human Pavlovian fear conditioning conforms to probabilistic learning. PLOS Computational Biology, 14(8), e1006243. https://doi.org/10.1371/journal.pcbi.1006243
van den Akker, K., Havermans, R. C., & Jansen, A. (2015). Effects of occasional reinforced trials during extinction on the reacquisition of conditioned responses to food cues. Journal of Behavior Therapy and Experimental Psychiatry, 48, 50-58. https://doi.org/10.1016/j.jbtep.2015.02.001
van den Akker, K., Jansen, A., Frentz, F., & Havermans, R. C. (2013). Impulsivity makes more susceptible to overeating after contextual appetitive conditioning. Appetite, 70, 73-80. https://doi.org/10.1016/j.appet.2013.06.092
van den Akker, K., Nederkoorn, C., & Jansen, A. (2017a). Electrodermal responses during appetitive conditioning are sensitive to contingency instruction ambiguity. International Journal of Psychophysiology, 118, 40-47. https://doi.org/10.1016/j.ijpsycho.2017.06.004
van den Akker, K., Schyns, G., & Jansen, A. (2017b). Altered appetitive conditioning in overweight and obese women. Behavior Research and Therapy, 99, 78-88. https://doi.org/10.1016/j.brat.2017.09.006
van der Wel, P., & van Steenbergen, H. (2018). Pupil dilation as an index of effort in cognitive control tasks: A review. Psychonomic Bulletin and Review, 25(6), 2005-2015. https://doi.org/10.3758/s13423-018-1432-y
Varazzani, C., San-Galli, A., Gilardeau, S., & Bouret, S. (2015). Noradrenaline and dopamine neurons in the reward/effort trade-off: A direct electrophysiological comparison in behaving monkeys. Journal of Neuroscience, 35(20), 7866-7877. https://doi.org/10.1523/JNEUROSCI.0454-15.2015
Wardle, M. C., Lopez-Gamundi, P., & Flagel, S. B. (2018). Measuring appetitive conditioned responses in humans. Physiology and Behavior, 188, 140-150. https://doi.org/10.1016/j.physbeh.2018.02.004
Wilson, R. C., & Collins, A. G. E. (2019). Ten simple rules for the computational modeling of behavioral data. PsyArXiv. https://doi.org/10.31234/osf.io/46mbn
Wilson, R. C., & Niv, Y. (2012). Inferring relevance in a changing world. Frontiers in Human Neuroscience, 5, 189. https://doi.org/10.3389/fnhum.2011.00189
Yu, A. J., & Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron, 46(4), 681-692. https://doi.org/10.1016/j.neuron.2005.04.026