Avoidance-based human Pavlovian-to-instrumental transfer

European Journal of Neuroscience

Volumn 38, Issue 12, 2013, Pages 3740-3748

  Lewis, Andrea H ^a   Niznikiewicz, Michael A ^b   Delamater, Andrew R ^c   Delgado, Mauricio R ^a  

^a RUTGERS UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Goal directed; Instrumental; Motivation; Negative reinforcement; Striatum

Indexed keywords

ADULT; ARTICLE; AVERSION; AVOIDANCE BEHAVIOR; BRAIN CORTEX; COGNITION; CONDITIONING; CONTROLLED STUDY; CORPUS STRIATUM; CORRELATION ANALYSIS; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MOTIVATION; NEUROIMAGING; NORMAL HUMAN; PAVLOVIAN TO INSTRUMENTAL TRANSFER; PRIORITY JOURNAL; REINFORCEMENT;

GOAL-DIRECTED; INSTRUMENTAL; MOTIVATION; NEGATIVE REINFORCEMENT; STRIATUM;

ADOLESCENT; BRAIN MAPPING; CEREBRAL CORTEX; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; CORPUS STRIATUM; FEMALE; HUMANS; MALE; MOTIVATION; REINFORCEMENT (PSYCHOLOGY); YOUNG ADULT;

EID: 84890312150     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/ejn.12377     Document Type: Article

References (44)

1. Baker, T.B., Piper, M.E., McCarthy, D.E. & Majeskie, M.R. (2004) Addiction motivation reformulated: an affective processing model of negative reinforcement. Psychol. Rev., 111, 33-51.
2. Balleine, B.W. & Dickinson, A. (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419.
3. Bray, S., Rangel, A., Shimojo, S., Balleine, B. & O'Doherty, J.P. (2008) The neural mechanisms underlying the influence of Pavlovian cues on human decision making. J. Neurosci., 28, 5861-5866.
4. Büchel, C., Morris, J., Dolan, R.J. & Friston, K.J. (1998) Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron, 20, 947-957.
5. Cardinal, R.N. & Everitt, B.J. (2004) Neural and psychological mechanisms underlying appetitive learning: links to drug addiction. Curr. Opin. Neurobiol., 14, 156-162.
6. Cohen-Hatton, S.R., Haddon, J.E., George, D.N. & Honey, R.C. (2013) Pavlovian-to-instrumental transfer: paradoxical effects of the Pavlovian relationship explained. J. Exp. Psychol. Anim. B., 39, 14-23.
7. Corbit, L.H. & Balleine, B.W. (2005) Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J. Neurosci., 25, 962-970.
8. Corbit, L.H. & Balleine, B.W. (2011) The general and outcome-specific forms of Pavlovian instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J. Neurosci., 31, 11786-11794.
9. Corbit, L.H. & Janak, P.H. (2007) Inactivation of the lateral but not medial dorsal striatum eliminates the excitatory impact of pavlovian stimuli on instrumental responding. J. Neurosci., 27, 13977-13981.
10. Corbit, L.H. & Janak, P.H. (2010) Posterior dorsomedial striatum is critical for both selective instrumental and Pavlovian reward learning. Eur. J. Neurosci., 31, 1312-1321.
11. Delgado, M.R., Li, J., Schiller, D. & Phelps, E.A. (2008) The role of the striatum in aversive learning and aversive prediction errors. Philos. T. Roy. Soc., 363, 3787-3800.
12. Delgado, M.R., Jou, R.L. & Phelps, E.A. (2011) Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers. Front. Hum. Neurosci., 5, 71.
13. Dickinson, A. & Dearing, M.F. (1979) Appetitive-aversive interactions and inhibitory processes. In Dickson, A. & Boakes, R.A. (Eds), Mechanisms of Learning and Motivation. Erlbaum, Hillsdale, NJ, pp. 203-231.
14. Estes, W.K. & Skinner, B.F. (1941) Some quantitative properties of anxiety. J. Exp. Psychol., 29, 390-400.
15. Glasner, S.V., Overmier, J.B. & Balleine, B.W. (2005) The role of Pavlovian cues in alcohol seeking in dependent and nondependent rats. J. Stud. Alcohol, 66, 53-61.
16. Guerts, D.E.M., Huys, Q.J.M., den Ouden, H.E.M. & Cools, R. (2013) Aversive Pavlovian control of instrumental behavior in humans. J. Cognitive Neurosci., 25, 1428-1441.
17. Haber, S.N. & Knutson, B. (2010) The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacol., 35, 4-26.
18. Hogarth, L., Dickinson, A., Wright, A., Kouvaraki, M. & Duka, T. (2007) The role of drug expectancy in the control of human drug seeking. J. Exp. Psychol. Anim. B., 33, 484-496.
19. Holm, S. (1979) A simple sequentially rejective multiple test procedure. Scand. J. Stat., 6, 65-70.
20. Huys, Q.J., Cools, R., Gölzer, M., Friedel, E., Heinz, A., Dolan, R.J. & Dayan, P. (2011) Disentangling the roles of approach, activation and valence in instrumental and Pavlovian responding. PLoS Comput. Biol., 7, e1002028.
21. Jensen, J., McIntosh, A.R., Crawley, A.P., Mikulis, D.J., Remington, G. & Kapur, S. (2003) Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron, 40, 1251-1257.
22. Kim, H., Shimojo, S. & O'Doherty, J.P. (2006) Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol., 4, e233.
23. Klein, M. & Rilling, M. (1972) Effects of response-shock interval and shock intensity on free-operant avoidance responding in the pigeon. J. Exp. Anal. Behav., 18, 295-303.
24. Kruse, J.M., Overmier, J.B., Konz, W.A. & Rokke, E. (1983) Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific. Learn. Motiv., 14, 165-181.
25. LoLordo, V.M. (1967) Similarity of conditioned fear responses based upon different aversive events. J. Comp. Physiol. Psych., 64, 154-158.
26. Mackintosh, N.J. (1974) The Psychology of Animal Learning. Academic Press, Oxford, England.
27. Mackintosh, N.J. & Dickinson, A. (1979) Instrumental (Type II) conditioning. In Dickinson, A. & Boakes, R.A. (Eds), Mechanisms of Learning and Motivation: A Memorial Volume to Jerzy Konorski. Erlbaum, Hillsdale, NJ, pp. 143-169.
28. Nadler, N., Delgado, M.R. & Delamater, A.R. (2011) Pavlovian to instrumental transfer of control in a human learning task. Emotion, 11, 1112-1123.
29. Niznikiewicz, M. & Delgado, M.R. (2011) Two sides of the same coin: learning via positive and negative reinforcers in the human striatum. Dev. Cogn. Neurosci., 1, 494-505.
30. Pavlov, I.P. (1932) The reply of a physiologist to psychologists. Psychol. Rev., 39, 91-127.
31. Phelps, E.A. & LeDoux, J.E. (2005) Neural systems underlying emotion behavior: from animal models to human function. Neuron, 48, 175-187.
32. Prevost, C., Liljeholm, M., Tyszka, J.M. & O'Doherty, J.P. (2012) Neural correlates of specific and general Pavlovian-to-Instrumental Transfer within human amygdalar subregions: a high-resolution fMRI study. J. Neurosci., 32, 8383-8390.
33. Rescorla, R.A. & LoLordo, V.M. (1965) Inhibition of avoidance behavior. J. Comp. Physiol. Psych., 59, 406-412.
34. Rescorla, R.A. & Solomon, R.L. (1967) Two-process learning theory: relationship between Pavlovian conditioning and instrumental learning. Psychol. Rev., 74, 151-182.
35. Rice, W.R. (1989) Analyzing tables of statistical tests. Evolution, 43, 223-225.
36. Robinson, T.E. & Berridge, K.C. (2001) Incentive-sensitization and addiction. Addiction, 96, 103-114.
37. Seligman, M.E.P. & Johnston, J.C. (1973) A cognitive theory of avoidance learning. In McGuigan, F.J. & Lumsden, D.B. (Eds), Contemporary Approaches to Conditioning and Learning. V.H. Winston & Sons, Washington, D.C, pp. 69-110.
38. Sidman, M. (1953a) Avoidance conditioning with brief shock and no exteroceptive warning signal. Science, 118, 157-158.
39. Sidman, M. (1953b) Two temporal parameters of the maintenance of avoidance behavior by the white rat. J. Comp. Physiol. Psych., 46, 253-261.
40. Sidman, M. (1962) Classical avoidance without a warning stimulus. J. Exp. Anal. Behav., 5, 97-104.
41. Sinha, R. (2007) The role of stress in addiction relapse. Curr. Psychiatry Rep., 9, 388-395.
42. Talairach, J. & Tournoux, P. (1988) Co-Planar Stereotaxic Atlas of the Human Brain: An Approach to Medical Cerebral Imaging. Thieme Medical Publisher, New York.
43. Talmi, D., Seymour, B., Dayan, P. & Dolan, R.J. (2008) Human Pavlovian-instrumental transfer. J. Neurosci., 28, 360-368.
44. Ulrich, R.E., Holz, W.C. & Azrin, N.H. (1964) Stimulus control of avoidance behavior. J. Exp. Anal. Behav., 7, 129-133.