Aversive Pavlovian Control of Instrumental Behavior in Humans

Journal of Cognitive Neuroscience

Volumn 25, Issue 9, 2013, Pages 1428-1441

  Geurts, Dirk E M ^a   Huys, Quentin J M ^b,c   den Ouden, Hanneke E M ^a   Cools, Roshan ^a  

^a RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c GUY'S AND ST THOMAS' NHS FOUNDATION TRUST   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BEHAVIOR; ADULT; AMYGDALOID NUCLEUS; APPETITE; ARTICLE; AVERSION; BOLD SIGNAL; BRAIN SIZE; CAUDATE NUCLEUS; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; FEMALE; FRONTAL LOBE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; LINGUAL GYRUS; MALE; NERVE POTENTIAL; NUCLEAR MAGNETIC RESONANCE SCANNER; NUCLEUS ACCUMBENS; PAVLOVIAN INSTRUMENTAL TRANSFER; PRECUNEUS; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; VENTROMEDIAL PREFRONTAL CORTEX;

ADAPTATION, PSYCHOLOGICAL; ADULT; ANALYSIS OF VARIANCE; AVOIDANCE LEARNING; BRAIN; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; FEMALE; GENERALIZATION (PSYCHOLOGY); HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PHOTIC STIMULATION; TRANSFER (PSYCHOLOGY); YOUNG ADULT;

EID: 84880763365     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00425     Document Type: Article

References (53)

1. Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience, 9, 357-381.
2. Allman, M. J., DeLeon, I. G., Cataldo, M. F., Holland, P. C., & Johnson, A. W. (2010). Learning processes affecting human decision making: An assessment of reinforcer-selective Pavlovian-to-instrumental transfer following reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes, 36, 402-408.
3. Balleine, B. W., & Odoherty, J. P. (2010). Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology, 35, 48-69.
4. Bijttebier, P., Beck, I., Claes, L., & Vandereycken, W. (2009). Gray's reinforcement sensitivity theory as a framework for research on personality-psychopathology associations. Clinical Psychology Review, 29, 421-430.
5. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436.
6. Bray, S., Rangel, A., Shimojo, S., Balleine, B., & ODoherty, J. P. (2008). The neural mechanisms underlying the influence of Pavlovian cues on human decision making. Journal of Neuroscience, 28, 5861-5866.
7. Büchel, C., Wise, R. J., Mummery, C. J., Poline, J. B., & Friston, K. J. (1996). Nonlinear regression in parametric activation studies. Neuroimage, 4, 60-66.
8. Clark, L., & Manes, F. (2004). Social and emotional decisionmaking following frontal lobe injury. Neurocase, 10, 398-403.
9. Coccaro, E. F., Sripada, C. S., Yanowitch, R. N., & Phan, K. L. (2011). Corticolimbic function in impulsive aggressive behavior. Biological Psychiatry, 69, 1153-1159.
10. Corbit, L. H., & Balleine, B. W. (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of Pavlovian-instrumental transfer. Journal of Neuroscience, 25, 962-970.
11. Corbit, L. H., & Balleine, B. W. (2011). The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. Journal of Neuroscience, 31, 11786-11794.
12. Cornell, D. G., Warren, J., Hawk, G., Stafford, E., Oram, G., & Pine, D. (1996). Psychopathy in instrumental and reactive violent offenders. Journal of Consulting and Clinical Psychology, 64, 783-790.
13. Damasio, A. R. (1997). Towards a neuropathology of emotion and mood. Nature, 386, 769-770.
14. Damasio, A. R., & Everitt, B. (1996). The somatic marker hypothesis and the possible functions of the prefrontal cortex [and discussion]. Philosophical Transactions of the Royal Society of London, 351, 1413-1420.
15. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704-1711.
16. Dayan, P., & Huys, Q. J. M. (2008). Serotonin, inhibition, and negative mood. PLoS Computational Biology, 4, e4.
17. Dayan, P., Niv, Y., Seymour, B., & Daw, N. D. (2006). The misbehavior of value and the discipline of the will. Neural Networks: The Official Journal of the International Neural Network Society, 19, 1153-1160.
18. de Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009). Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. Journal of Neuroscience, 29, 11330-11338.
19. Di Giusto, J. A., Di Giusto, E. L., & King, M. G. (1974). Heart rate and muscle tension correlates of conditioned suppression in humans. Journal of Experimental Psychology, 103, 515-521.
20. Evans, J. S. B. T. (2008). Dual-processing accounts of reasoning, judgment, and social cognition. Annual Review of Psychology, 59, 255-278.
21. Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., et al. (2011). A selective role for dopamine in stimulus-reward learning. Nature, 469, 53-57.
22. Gitelman, D. R., Penny, W. D., Ashburner, J., & Friston, K. J. (2003). Modeling regional and psychophysiologic interactions in fMRI: The importance of hemodynamic deconvolution. Neuroimage, 19, 200-207.
23. Greene, J. D. (2001). An fMRI investigation of emotional engagement in moral judgment. Science, 293, 2105-2108.
24. Haber, S. N. (2003). The primate basal ganglia: Parallel and integrative networks. Journal of Chemical Neuroanatomy, 26, 317-330.
25. Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. Journal of Neuroscience, 20, 2369-2382.
26. Haber, S. N., & Knutson, B. (2010). The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology, 35, 4-26.
27. Hare, T. A., Camerer, C. F., Knoepfle, D. T., & Rangel, A. (2010). Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition. Journal of Neuroscience, 30, 583-590.
28. Hare, T. A., Camerer, C. F., & Rangel, A. (2009). Self-control in decision-making involves modulation of the vmPFC valuation system. Science, 324, 646-648.
29. Holland, P. C. (2004). Relations between Pavlovian- instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes, 30, 104-117.
30. Homayoun, H., & Moghaddam, B. (2009). Differential representation of Pavlovian-instrumental transfer by prefrontal cortex subregions and striatum. European Journal of Neuroscience, 29, 1461-1476.
31. Huys, Q. J. M., Cools, R., Gölzer, M., Friedel, E., Heinz, A., Dolan, R. J., et al. (2011). Disentangling the roles of approach, activation and valence in instrumental and Pavlovian responding. PLoS Computational Biology, 7, e1002028.
32. Huys, Q. J. M., Eshel, N., ONions, E., Sheridan, L., Dayan, P., & Roiser, J. P. (2012). Bonsai trees in your head: How the Pavlovian system sculpts goal-directed choices by pruning decision trees. PLoS Computational Biology, 8, e1002410.
33. Kable, J. W., & Glimcher, P. W. (2009). The neurobiology of decision: Consensus and controversy. Neuron, 63, 733-745.
34. Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J.-D. (2011). Decoding different roles for vmPFC and dlPFC in multiattribute decision making. Neuroimage, 56, 709-715.
35. Lim, S.-L., ODoherty, J. P., & Rangel, A. (2011). The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. Journal of Neuroscience, 31, 13214-13223.
36. Mayberg, H. S., Liotti, M., Brannan, S. K., McGinnis, S., Mahurin, R. K., Jerabek, P. A., et al. (1999). Reciprocal limbic-cortical function and negative mood: Converging PET findings in depression and normal sadness. American Journal of Psychiatry, 156, 675-682.
37. Monahan, J., Steadman, H. J., Silver, E., Appelbaum, P. S., Robbins, P. C., Mulvey, E. P., et al. (2001). Rethinking risk assessment: The MacArthur study of mental disorder and violence. New York: Oxford University Press.
38. Ongür, D., & Price, J. L. (2000). The organization of networks within the orbital andmedial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex (New York,N.Y.: 1991), 10, 206-219.
39. Patenaude, B., Smith, S. M., Kennedy, D. N., & Jenkinson, M. (2011). A Bayesian model of shape and appearance for subcortical brain segmentation. Neuroimage, 56, 907-922.
40. Poser, B. A., Versluis, M. J., Hoogduin, J. M., & Norris, D. G. (2006). BOLD contrast sensitivity enhancement and artifact reduction with multiecho EPI: Parallel-acquired inhomogeneity-desensitized fMRI. Magnetic Resonance in Medicine, 55, 1227-1235.
41. Rangel, A., Camerer, C., & Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience, 9, 545-556.
42. Rushworth, M. F. S., Noonan, M. P., Boorman, E.D., Walton, M. E., & Behrens, T. E. (2011). Frontal cortex and reward-guided learning and decision-making. Neuron, 70, 1054-1069.
43. Sharot, T., Riccardi, A. M., Raio, C. M., & Phelps, E. A. (2007). Neural mechanisms mediating optimism bias. Nature, 450, 102-105.
44. Talmi, D., Seymour, B., Dayan, P., & Dolan, R. J. (2008). Human Pavlovian-instrumental transfer. Journal of Neuroscience, 28, 360-368.
45. Trew, J. L. (2011). Exploring the roles of approach and avoidance in depression: An integrative model. Clinical Psychology Review, 31, 1156-1168.
46. Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211, 453-458.
47. Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., et al. (2002). Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage, 15, 273-289.
48. Valentin, V. V., Dickinson, A., & ODoherty, J. P. (2007). Determining the neural substrates of goal-directed learning in the human brain. Journal of Neuroscience, 27, 4019-4026.
49. Wallis, J. D. (2007). Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior. Annals of the New York Academy of Sciences, 1121, 447-460.
50. Weinstein, N. (1980). Unrealistic optimism about future life events. Journal of Personality and Social Psychology, 39, 806-820.
51. Worsley, K. J., & Friston, K. J. (1995). Analysis of fMRI timeseries revisited-Again. Neuroimage, 2, 173-181.
52. Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005). Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. The European Journal of Neuroscience, 22, 505-512.
53. Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005). The role of the dorsomedial striatum in instrumental conditioning. The European Journal of Neuroscience, 22, 513-523.