Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Behavioural Brain Research

Volumn 296, Issue , 2016, Pages 418-430

  Ahrens, Allison M ^a   Singer, Bryan F ^a   Fitzpatrick, Christopher J ^a   Morrow, Jonathan D ^a,b   Robinson, Terry E ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF MICHIGAN HEALTH SYSTEM   (United States)

Author keywords

Discriminative stimuli; Extinction; Goal tracking; Incentive motivation; Occasion setting; Pavlovian conditioning; Sign tracking

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; ATTENTION; BEHAVIOR ASSESSMENT; CONDITIONING; GOAL TRACKER; INSTRUMENTAL CONDITIONING; MALE; NERVOUS SYSTEM PARAMETERS; NONHUMAN; PAVLOVIAN CONDITIONING; PRIORITY JOURNAL; RAT; REINFORCEMENT; REWARD; SALIENCE NETWORK; SIGN TRACKER; TASK PERFORMANCE; ANIMAL; ANIMAL BEHAVIOR; CONDITIONED REFLEX; MOTIVATION; PHYSIOLOGY; SPRAGUE DAWLEY RAT;

ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, CLASSICAL; CUES; EXTINCTION, PSYCHOLOGICAL; MALE; MOTIVATION; RATS; RATS, SPRAGUE-DAWLEY;

EID: 84959417804     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2015.07.055     Document Type: Article

References (74)

1. Anselme P. Incentive salience attribution under reward uncertainty: a Pavlovian model. Behav. Processes 2014, 111C:6-18.
2. Anselme P., Robinson M.J., Berridge K.C. Reward uncertainty enhances incentive salience attribution as sign-tracking. Behav. Brain Res. 2013, 238:53-61.
3. Beckmann J.S., Chow J.J. Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence. Learn. Mem. 2015, 22(2):116-127.
4. Beckmann J.S., Marusich J.A., Gipson C.D., Bardo M.T. Novelty seeking, incentive salience and acquisition of cocaine self-administration in the rat. Behav. Brain Res. 2011, 216(1):159-165.
5. Berridge K.C. 'Liking' and 'wanting' food rewards: brain substrates and roles in eating disorders. Physiol. Behav. 2009, 97(5):537-550.
6. Boakes R.A. Performance on learning to associate a stimulus with positive reinforcement. Operant-Pavlovian Interactions 1977, 67-97. Earlbaum, Hillsdale, NJ. H. Davis, H. Hurwitz (Eds.).
7. Bouton M.E. Context, ambiguity, and unlearning: sources of relapse after behavioral extinction. Biol. Psychiatry 2002, 52(10):976-986.
8. Bouton M.E. Context and behavioral processes in extinction. Learn. Mem. 2004, 11(5):485-494.
9. Bouton M.E., Todd T.P., Leon S.P. Contextual control of discriminated operant behavior. J. Exp. Psychol. Anim. Learn. Cogn. 2014, 40(1):92-105.
10. Burns M., Domjan M. Topography of spatially directed conditioned responding: effects of context and trial duration. J. Exp. Psychol. Anim. Behav. Process 2001, 27(3):269-278.
11. Cardinal R.N., Parkinson J.A., Hall J., Everitt B.J. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 2002, 26(3):321-352.
12. Chang S.E., Wheeler D.S., Holland P.C. Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing. Neurobiol. Learn. Mem. 2012, 97(4):441-451.
13. Clark J.J., Collins A.L., Sanford C.A., Phillips P.E. Dopamine encoding of Pavlovian incentive stimuli diminishes with extended training. J. Neurosci. 2013, 33(8):3526-3532.
14. Clark J.J., Hollon N.G., Phillips P.E. Pavlovian valuation systems in learning and decision making. Curr. Opin. Neurobiol. 2012, 22(6):1054-1061.
15. Conklin C.A., Tiffany S.T. Applying extinction research and theory to cue-exposure addiction treatments. Addiction 2002, 97(2):155-167.
16. Crombag H.S., Bossert J.M., Koya E., Shaham Y. Review. Context-induced relapse to drug seeking: a review. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2008, 363(1507):3233-3243.
17. Danna C.L., Elmer G.I. Disruption of conditioned reward association by typical and atypical antipsychotics. Pharmacol. Biochem. Behav. 2010, 96(1):40-47.
18. Danna C.L., Shepard P.D., Elmer G.I. The habenula governs the attribution of incentive salience to reward predictive cues. Front. Hum. Neurosci. 2013, 7:781.
19. Delamater A.R. Issues in the extinction of specific stimulus-outcome associations in Pavlovian conditioning. Behav. Processes 2012, 90(1):9-19.
20. Delamater A.R. On the nature of CS and US representations in Pavlovian learning. Learn. Behav. 2012, 40(1):1-23.
21. Delamater A.R., Oakeshott S. Learning about multiple attributes of reward in Pavlovian conditioning. Ann. N. Y. Acad. Sci. 2007, 1104:1-20.
22. Deroche-Gamonet V., Belin D., Piazza P.V. Evidence for addiction-like behavior in the rat. Science 2004, 305(5686):1014-1017.
23. DiFeliceantonio A.G., Berridge K.C. Which cue to 'want'? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking. Behav. Brain Res. 2012, 230(2):399-408.
24. Domjan M. Stepping outside the box in considering the C/T ratio?. Behav. Processes 2003, 62(1-3):103-114.
25. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005, 8(11):1481-1489.
26. Fitzpatrick C.J., Gopalakrishnan S., Cogan E.S., Yager L.M., Meyer P.J., Lovic V., Saunders B.T., Parker C.C., Gonzales N.M., Aryee E., Flagel S.B., Palmer A.A., Robinson T.E., Morrow J.D. Variation in the form of Pavlovian conditioned approach behavior among outbred male Sprague-Dawley rats from different vendors and colonies: sign-tracking vs. goal-tracking. PLoS ONE 2013, 8(10):e75042.
27. Flagel S.B., Akil H., Robinson T.E. Individual differences in the attribution of incentive salience to reward-related cues: implications for addiction. Neuropharmacology 2009, 56(Suppl. 1):139-148.
28. Flagel S.B., Cameron C.M., Pickup K.N., Watson S.J., Akil H., Robinson T.E. A food predictive cue must be attributed with incentive salience for it to induce c-fos mRNA expression in cortico-striatal-thalamic brain regions. Neuroscience 2011, 196:80-96.
29. Flagel S.B., Clark J.J., Robinson T.E., Mayo L., Czuj A., Willuhn I., Akers C.A., Clinton S.M., Phillips P.E., Akil H. A selective role for dopamine in stimulus-reward learning. Nature 2011, 469(7328):53-57.
30. Flagel S.B., Robinson T.E., Clark J.J., Clinton S.M., Watson S.J., Seeman P., Phillips P.E., Akil H. An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: implications for addiction. Neuropsychopharmacology 2010, 35(2):388-400.
31. Flagel S.B., Waselus M., Clinton S.M., Watson S.J., Akil H. Antecedents and consequences of drug abuse in rats selectively bred for high and low response to novelty. Neuropharmacology 2014, 76(Pt B):425-436.
32. Flagel S.B., Watson S.J., Robinson T.E., Akil H. Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats. Psychopharmacology (Berl.) 2007, 191(3):599-607.
33. Garofalo S., di Pellegrino G. Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior. Front. Behav. Neurosci. 2015, 9:163.
34. Hearst E., Jenkins H. Sign-Tracking: The Stimulus-Reinforcer Relation and Directed Action 1974, Monograph of the Psychonomic Society, Austin.
35. Holland P.C. Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. J. Exp. Psychol. Anim. Behav. Processes 1977, 3:77-104.
36. Holland P.C. Occasion setting in Pavlovian conditioning. The Psychology of Learning and Motivation 1992, 28:69-125. Academic Press, Medin D. San Diego, CA.
37. Holland P.C., Asem J.S., Galvin C.P., Keeney C.H., Hsu M., Miller A., Zhou V. Blocking in autoshaped lever-pressing procedures with rats. Learn. Behav. 2014, 42(1):1-21.
38. Holland P.C., Bouton M.E. Hippocampus and context in classical conditioning. Curr. Opin. Neurobiol. 1999, 9(2):195-202.
39. Konorski J. Some new ideas concerning the physiological mechanisms of perception. Acta Biol. Exp. (Warsz.) 1967, 27:147-161.
40. Lomanowska A.M., Lovic V., Rankine M.J., Mooney S.J., Robinson T.E., Kraemer G.W. Inadequate early social experience increases the incentive salience of reward-related cues in adulthood. Behav. Brain Res. 2011, 220(1):91-99.
41. Lovic V., Saunders B.T., Yager L.M., Robinson T.E. Rats prone to attribute incentive salience to reward cues are also prone to impulsive action. Behav. Brain Res. 2011, 223(2):255-261.
42. Mahler S.V., Berridge K.C. Which cue to want? Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue. J. Neurosci. 2009, 29(20):6500-6513.
43. Meyer P.J., Cogan E.S., Robinson T.E. The form of a conditioned stimulus can influence the degree to which it acquires incentive motivational properties. PLoS ONE 2014, 9(6):e98163.
44. Meyer P.J., Lovic V., Saunders B.T., Yager L.M., Flagel S.B., Morrow J.D., Robinson T.E. Quantifying individual variation in the propensity to attribute incentive salience to reward cues. PLoS ONE 2012, 7(6):e38987.
45. Meyer P.J., Ma S.T., Robinson T.E. A cocaine cue is more preferred and evokes more frequency-modulated 50-kHz ultrasonic vocalizations in rats prone to attribute incentive salience to a food cue. Psychopharmacology (Berl.) 2012, 219(4):999-1009.
46. Morrow J.D., Maren S., Robinson T.E. Individual variation in the propensity to attribute incentive salience to an appetitive cue predicts the propensity to attribute motivational salience to an aversive cue. Behav. Brain Res. 2011, 220(1):238-243.
47. Morrow J.D., Saunders B.T., Maren S., Robinson T.E. Sign-tracking to an appetitive cue predicts incubation of conditioned fear in rats. Behav. Brain Res. 2014, 276:59-66.
48. Olshavsky M.E., Shumake J., Rosenthal A.A., Kaddour-Djebbar A., Gonzalez-Lima F., Setlow B., Lee H.J. Impulsivity, risk-taking, and distractibility in ratsexhibiting robust conditioned orienting behaviors. J. Exp. Anal. Behav. 2014, 102(2):162-178.
49. Paolone G., Angelakos C.C., Meyer P.J., Robinson T.E., Sarter M. Cholinergic control over attention in rats prone to attribute incentive salience to reward cues. J. Neurosci. 2013, 33(19):8321-8335.
50. Peters J., De Vries T.J. d-Cycloserine administered directly to infralimbic medial prefrontal cortex enhances extinction memory in sucrose-seeking animals. Neuroscience 2013, 230:24-30.
51. Rescorla R.A. Spontaneous recovery. Learn. Mem. 2004, 11(5):501-509.
52. Robinson M.J., Anselme P., Fischer A.M., Berridge K.C. Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues. Behav. Brain Res. 2014, 266:119-130.
53. Robinson T.E., Berridge K.C. Review. The incentive sensitization theory of addiction: some current issues. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2008, 363(1507):3137-3146.
54. Robinson T.E., Flagel S.B. Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biol. Psychiatry 2009, 65(10):869-873.
55. Robinson T.E., Yager L.M., Cogan E.S., Saunders B.T. On the motivational properties of reward cues: individual differences. Neuropharmacology 2014, 76(59):450-459.
56. Rosas J.M., Todd T.P., Bouton M.E. Context change and associative learning. Wiley Interdiscip. Rev. Cogn. Sci. 2013, 4(3):237-244.
57. Saunders B.T., O'Donnell E.G., Aurbach E.L., Robinson T.E. A cocaine context renews drug seeking preferentially in a subset of individuals. Neuropsychopharmacology 2014, 39(12):2816-2823.
58. Saunders B.T., Robinson T.E. A cocaine cue acts as an incentive stimulus in some but not others: implications for addiction. Biol. Psychiatry 2010, 67(8):730-736.
59. Saunders B.T., Robinson T.E. Individual variation in the motivational properties of cocaine. Neuropsychopharmacology 2011, 36(8):1668-1676.
60. Saunders B.T., Robinson T.E. The role of dopamine in the accumbens core in the expression of Pavlovian-conditioned responses. Eur. J. Neurosci. 2012, 36(4):2521-2532.
61. Saunders B.T., Robinson T.E. Individual variation in resisting temptation: implications for addiction. Neurosci. Biobehav. Rev. 2013, 37(9 Pt A):1955-1975.
62. Saunders B.T., Yager L.M., Robinson T.E. Cue-evoked cocaine craving: role of dopamine in the accumbens core. J. Neurosci. 2013, 33(35):13989-14000.
63. Stewart J., de Wit H., Eikelboom R. Role of unconditioned and conditioned drug effects in the self-administration of opiates and stimulants. Psychol. Rev. 1984, 91(2):251-268.
64. Timberlake W. Behavior systems, associationism, and Pavlovian conditioning. Psychon. Bull. Rev. 1994, 1(4):405-420.
65. Todd T.P., Vurbic D., Bouton M.E. Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning. Neurobiol. Learn. Mem. 2014, 108:52-64.
66. Tomie A., Aguado A.S., Pohorecky L.A., Benjamin D. Individual differences in pavlovian autoshaping of lever pressing in rats predict stress-induced corticosterone release and mesolimbic levels of monoamines. Pharmacol. Biochem. Behav. 2000, 65(3):509-517.
67. Tomie A., Grimes K.L., Pohorecky L.A. Behavioral characteristics and neurobiological substrates shared by Pavlovian sign-tracking and drug abuse. Brain Res. Rev. 2008, 58(1):121-135.
68. Troisi J.R. Perhaps more consideration of pavlovian-operant interaction may improve the clinical efficacy of behaviorally based drug treatment programs. Psychol. Rec. 2013, 63(4):863-893.
69. Tunstall B.J., Kearns D.N. Sign-tracking predicts increased choice of cocaine over food in rats. Behav. Brain Res. 2015, 281:222-228.
70. Wagner A.R., Brandon S.E. Evolution of a structured connectionist model of Pavlovian conditioning (AESOP). Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theory 1989, 149-189. Lawrence Erlbaum Associates, Inc., Hillsdale, NJ. S.B. Klein, Mowrer, R.R. Hillsdale (Eds.).
71. Yager L.M., Robinson T.E. Cue-induced reinstatement of food seeking in rats that differ in their propensity to attribute incentive salience to food cues. Behav. Brain Res. 2010, 214(1):30-34.
72. Yager L.M., Robinson T.E. A classically conditioned cocaine cue acquires greater control over motivated behavior in rats prone to attribute incentive salience to a food cue. Psychopharmacology (Berl.) 2013, 226(2):217-228.
73. Yager L.M., Pitchers K.K., Flagel S.B., Robinson T.E. Individual variation in the motivational and neurobiological effects of an opioid cue. Neuropsychopharmacology 2015, 40(5):1269-1277.
74. Zener K. The significance of behavior accompanying conditioned salivary secretion for theories of the conditioned response. Am. J. Psychol. 1937, 50:384-403.