Motivational control of sign-tracking behaviour: A theoretical framework

Neuroscience and Biobehavioral Reviews

Volumn 65, Issue , 2016, Pages 1-20

  Anselme, Patrick ^a,b  

^a UNIVERSITY OF LIÈGE   (Belgium)

^b RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

Dopamine; Incentive motivation; Learning; Reward uncertainty; Sign tracking

Indexed keywords

DOPAMINE;

ASSOCIATION; ATTENTION; BEHAVIOR; COMPUTER MODEL; COMPUTER SIMULATION; CONDITIONED REFLEX; DOPAMINE RELEASE; FRUSTRATION; HUMAN; LATENT INHIBITION; LEARNING ALGORITHM; MEMORY CONSOLIDATION; MOTIVATION; MOTIVATIONAL CONTROL; NEUROBIOLOGY; NONHUMAN; PLEASURE; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; REWARD; SIGN TRACKING BEHAVIOR; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; ANIMAL; CONDITIONING;

ANIMALS; CONDITIONING (PSYCHOLOGY); HUMANS; MOTIVATION; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84962243624     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2016.03.014     Document Type: Review

References (176)

1. Amsel A., Hancock W. Motivational properties of frustration: III: Relation of frustration effect to antedating goal factors. J. Exp. Psychol. 1957, 53:126-131.
2. Amsel A., Roussel J. Motivational properties of frustration: I: Effect on a running response of the addition of frustration to the motivational complex. J. Exp. Psychol. 1952, 43:363-368.
3. Amsel A., Ward J.S. Motivational properties of frustration: II: Frustration drive stimulus and frustration reduction in selective learning. J. Exp. Psychol. 1954, 48:37-47.
4. Amsel A. The role of frustrative nonreward in noncontinuous reward situations. Psychol. Bull. 1958, 55:102-119.
5. Amsel A. Frustration Theory 1992, Cambridge University Press, Cambridge.
6. Anselme P., Robinson M.J.F. 'Wanting', 'liking', and their relation to consciousness. J. Exp. Psychol. Anim. Learn. Cogn. 2016, (in press).
7. Anselme P., Robinson M.J.F., Berridge K.C. Reward uncertainty enhances incentive salience attribution as sign-tracking. Behav. Brain Res 2013, 238:53-61.
8. Anselme P. Some conceptual problems with the classical theory of behaviour. Behav. Process. 2007, 75:259-275.
9. Anselme P. Abnormal patterns of displacement activities: a review and reinterpretation. Behav. Process 2008, 79:48-58.
10. Anselme P. The effect of drugs on the processing of natural rewards. Neurosci. Biobehav. Rev. 2009, 33:314-335.
11. Anselme P. Dopamine motivation, and the evolutionary significance of gambling-like behaviour. Behav. Brain Res. 2013, 256:1-4.
12. Anselme P. Incentive salience attribution under reward uncertainty: a Pavlovian model. Behav. Process. 2015, 111:6-18.
13. Arcediano F., Escobar M., Matute H. Reversal from blocking in humans as a result of posttraining extinction of the blocking stimulus. Anim. Learn. Behav. 2001, 29:354-366.
14. Arcediano F., Escobar M., Miller R.R. Is stimulus competition an acquisition deficit or a performance deficit?. Psychon. Bull. Rev. 2004, 11:1105-1110.
15. Baddeley A. Human Memory: Theory and Practice 1990, Lawrence Erlbaum Associates.
16. Balleine B. Instrumental performance following a shift in primary motivation depends on incentive learning. J. Exp. Psychol. Anim. Behav. Process. 1992, 18:236-250.
17. Barela P.B. Theoretical mechanisms underlying the trial-spacing effect in Pavlovian fear conditioning. J. Exp. Psychol. Anim. Behav. Process. 1999, 25:177-193.
18. Bauer C.M., Glassman L.W., Cyr N.E., Romero L.M. Effects of predictable and unpredictable food restriction on the stress response in molting and non-molting European starlings (Sturnus vulgaris). Comp. Biochem. Physiol. A 2011, 160:390-399.
19. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Rev. 1998, 28:309-369.
20. Berridge K.C. From prediction error to incentive salience: mesolimbic computation of reward motivation. Eur. J. Neurosci 2012, 35:1124-1143.
21. Blaisdell A.P., Gunther U., Miller R.R. Recovery from blocking achieved by extinguishing the blocking CS. Anim. Learn. Behav. 1999, 27:63-76.
22. Blaiss C.A., Janak P.H. The nucleus accumbens core and shell are critical for the expression but not the consolidation, of Pavlovian conditioned approach. Behav. Brain Res. 2009, 200:22-32.
23. Boakes R.A. Performance on learning to associate a stimulus with positive reinforcement. Operant Pavlovian Interactions 1977, 67-97. Erlbaum Associates, Hillsdale, NJ. H. Davis, H.M.B. Hurvitz (Eds.).
24. Bouton M.E., Sunsay C. Importance of trials versus accumulating time across trials in partially reinforced appetitive conditioning. J. Exp. Psychol. Anim. Behav. Process. 2003, 29:62-77.
25. Bowman E.M., Brown V.J. Effects of excitotoxic lesions of the rat ventral striatum on the perception of reward cost. Exp. Brain Res. 1998, 123:439-448.
26. Breen R.B., Zuckerman M. 'Chasing' in gambling behavior: personality and cognitive determinants. Person. Indiv. Diff. 1999, 27:1097-1111.
27. Brunborg G.S., Johnsen B.J., Pallesen S., Molde H., Mentzoni R.A., Myrseth H. The relationship between aversive conditioning and risk-avoidance in gambling. J. Gambl. Studies 2010, 26:545-559.
28. Cagniard B., Balsam P.D., Brunner D., Zhuang X. Mice with chronically elevated dopamine exhibit enhanced motivation but not learning, for food reward. Neuropsychopharmacology 2006, 31:1362-1370.
29. Cagniard B., Beeler J.A., Britt J.P., McGehee D.S., Marinelli M., Zuhang X. Dopamine scales performance in the absence of new learning. Neuron 2006, 51:541-547.
30. Cannon C.M., Bseikri M.R. Is dopamine required for natural reward? Physiol. Behav 2004, 81:741-748.
31. Capaldi E.J., Stanley L.R. Temporal properties of reinforcement aftereffects. J. Exp. Psychol. 1963, 65:169-175.
32. Capaldi E.J. A sequential theory of instrumental training. The Psychology of Learning and Motivation 1967, 67-156. Academic Press, New York. K.W. Spence, J.T. Spence (Eds.).
33. Chappell D., Geis G., Schafer S., Siegel L. Forcible rape: a comparative study of offenses known to the police in Boston and Los Angeles. Studies in the Sociology of Sex 1971, 169-190. Appleton-Century-Crofts, New York. J.M. Henslin (Ed.).
34. Collins L., Pearce J.M. Predictive accuracy and the effects of partial reinforcement on serial autoshaping. J. Exp. Psychol. Anim. Behav. Process. 1985, 11:548-564.
35. Collins L., Young D.B., Davies K., Pearce J.M. The influence of partial reinforcement on serial autoshaping with pigeons. Q. J. Exp. Psychol. 1983, 35B:275-290.
36. Couvillon P.A., Brandon S.E., Woodard W.T., Bitterman M.E. Performance of pigeons in patterned sequences of rewarded and nonrewarded trials. J. Exp. Psychol. Anim. Behav. Process. 1980, 6:137-154.
37. Crawford L.L., Steirn J.N., Pavlik W.B. Within- and between-subjects partial reinforcement effects with an autoshaped response using Japanese quail (Coturnix coturnix japonica). Anim. Learn. Behav 1985, 13:85-92.
38. Cresswell W. Testing the mass-dependent predation hypothesis: in European blackbirds poor foragers have higher overwinter body reserves. Anim. Behav. 2003, 65:1035-1044.
39. Cuthill I.C., Hunt S., Cleary C., Clark C. Colour bands dominance, and body mass regulation in male zebra finches (Taeniopygia guttata). Proc. R. Soc. Lond. 1997, 264:1093-1099.
40. Davey G.C., Phillips S., Cleland G.G. The topography of signal-centered behaviour in the rats: the effects of liquid and solid food reinforcers. Behav. Anal. Letters 1981, 1:331-337.
41. Davey G.C.L., Cleland G.G., Oakley D.A. Applying Konorski's model of classical conditioning to signal-centered behavior in the rat: some functional similarities between hunger CRs and sign-tracking. Anim. Learn. Behav 1982, 10:257-262.
42. Davis M. The role of the amygdala in fear and anxiety. Annu. Rev. Neurosci. 1992, 15:353-375.
43. Day J.J., Wheeler R.A., Roitman M.F., Carelli R.M. Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm. Eur. J. Neurosci. 2006, 23:1341-1351.
44. Dayan P., Balleine B.W. Reward motivation, and reinforcement learning. Neuron 2002, 36:285-298.
45. Dayan P., Berridge K.C. Model-based and model-free Pavlovian reward learning: revaluation, revision, and revelation. Cogn. Affect. Behav. Neurosci. 2014, 14:473-492.
46. de Lafuente V., Romo R. Dopamine neurons code subjective sensory experience and uncertainty of perceptual decisions. Proc. Natl. Acad. Sci. USA 2011, 108:19767-19771.
47. Denniston J.C., Savastano H.I., Miller R.R. The extended comparator hypothesis: learning by contiguity, responding by relative strength. Handbook of Contemporary Learning 2001, 65-117. Erlbaum, Mahwah, NJ. R.R. Mowrer, S.B. Klein (Eds.).
48. DiFeliceantonio A.G., Berridge K.C. Which cue to 'want'? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking. Behav. Brain Res. 2012, 230:399-408.
49. Dickinson A., Balleine B.W. The role of learning in the operation of motivational systems. Learning, Motivation and Emotion, Vol. 3 of Steven's Handbook of Experimental Psychology 2002, 497-533. John Wiley & Sons, New York. H. Pashler, C.R. Gallistel (Eds.).
50. Dickinson A., Dawson G.R. The role of the instrumental contingency in the motivational control of performance. Q. J. Exp. Psychol. 1987, 77-93.
51. Dickinson A., Pearce J.M. Preference and response suppression under different correlations between shock and a positive reinforcer in rats. Learn. Motiv. 1976, 7:66-85.
52. Dickinson A., Smith J., Mirenowicz J. Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav. Neurosci. 2000, 114:468-483.
53. Dodd M.L., Klos K.J., Bower J.H., Geda Y.E., Josephs K.A., Ahlskog J.E. Pathological gambling caused by drugs used to treat Parkinson disease. Arch. Neurol. 2005, 62:1377-1381.
54. Doremus-Fitzwater T.L., Spear L.P. Amphetamine-induced incentive sensitization of sign-tracking behavior in adolescent and adult female rats. Behav. Neurosci 2011, 125:661-667.
55. Dreher J.-C., Kohn P., Berman K.F. Neural coding of distinct statistical properties of reward information in humans. Cereb. Cortex 2006, 16:561-573.
56. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
57. Fitzgerald R.D. Effects of partial reinforcement with acid on the classically conditioned salivary response in dogs. J. Comp. Physiol. Psychol. 1963, 56:1056-1060.
58. Flagel S.B., Watson S.J., Robinson T.E., Akil H. Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats. Psychopharmac 2007, 191:599-607.
59. Flagel S.B., Clark J.J., Robinson T.E., Mayo L., Czuj A., Willuhn I., Akers C.A., Clinton S.M., Phillips P.E.M., Akil H. A selective role for dopamine in stimulus-reward learning. Nature 2011, 469:53-57.
60. Flagel S.B., Cameron C.M., Pickup K.N., Watson S.J., Akil H., Robinson T.E. A food predictive cue must be attributed with incentive salience for it to induce c-Fos mRNA expression in cortico-striatal-thalamic brain regions. Neuroscience 2011, 196:80-96.
61. Flaherty C.F. Incentive Relativity 1996, Cambridge University Press, Cambridge.
62. Foree D.D., LoLordo V.M. Signalled and unsignalled free-operant avoidance in the pigeon. J. Exp. Anal. Behav. 1970, 13:283-290.
63. Gallistel C.R., Gibbon J. Time, rate, and conditioning. Psychol. Rev. 2000, 107:289-344.
64. Gallistel C.R. Conditioning from an information processing perspective. Behav. Process. 2003, 62:89-101.
65. Genn R.F., Ahn S., Phillips A.G. Attenuated dopamine efflux in the rat nucleus accumbens during successive negative contrast. Behav. Neurosci. 2004, 118:869-873.
66. Gibbon J., Balsam P. Spreading associations in time. Autoshaping and Conditioning Theory 1981, 219-253. Academic Press, New York. C.M. Locurto, H.S. Terrace, J. Gibbon (Eds.).
67. Gibbon J., Farrell L., Locurto C.M., Duncan H.J., Terrace H.S. Partial reinforcement in autoshaping with pigeons. Anim. Learn. Behav. 1980, 8:45-59.
68. Gibbon J. Scalar expectancy theory and Weber's law in animal timing. Psychol. Rev 1977, 84:279-325.
69. Gonzalez R.C., Bitterman M.E. Spaced-trials partial reinforcement effect as a function of contrast. J. Comp. Physiol. Psychol. 1969, 67:94-103.
70. Gonzalez R.C., Bainbridge P., Bitterman M.E. Discrete trials lever pressing in the rat as a function of pattern reinforcement, effortfulness of response, and amount of reward. J. Comp. Physiol. Psychol. 1966, 61:110-122.
71. Gonzalez F.A. Effects of partial reinforcement (25%) in an autoshaping procedure. Bull. Psychon. Soc. 1973, 2:299-301.
72. Goodrich K.P. Performance in different segments of an instrumental response chain as a function of reinforcement schedule. J. Exp. Psychol. 1959, 57:57-63.
73. Gosler A.G. Environmental and social determinants of winter fat storage in the great tit Parus major. J. Anim. Ecol. 1996, 65:1-17.
74. Gottlieb D.A. Acquisition with partial and continuous reinforcement in pigeon autoshaping. Learn. Behav. 2004, 32:321-334.
75. Gottlieb D.A. Acquisition with partial and continuous reinforcement in rat magazine approach. J. Exp. Psychol. Anim. Behav. Process. 2005, 31:319-333.
76. Gottlieb D.A. Effects of reinforcement and time between reinforced trials on terminal response rate in pigeon autoshaping. Behav. Process. 2006, 72:6-13.
77. Gottlieb D.A. Is the number of trials a primary determinant of conditioned responding?. J. Exp. Psychol. Anim. Behav. Process. 2008, 34:185-201.
78. Haftorn S. Variation in body weight: wing length and tail length in the great tit Parus major. Nor. J. Zool. 1976, 4:241-271.
79. Hake M. Fattening strategies in dominance-structured greenfinch (Carduelis chloris) flocks in winter. Behav. Ecol. Sociobiol 1996, 39:71-76.
80. Hart A.S., Clark J.J., Phillips P.E.M. Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning. Neurobiol. Learn. Mem. 2015, 117:84-92.
81. Henke P.G. Dissociation of the frustration effect and the partial reinforcement extinction effect after limbic lesions in rats. J. Comp. Physiol. Psychol. 1977, 91:1032-1038.
82. Holland P.C. Unblocking in Pavlovian appetitive conditioning. J. Exp. Psychol. Anim. Behav. Process. 1984, 10:476-497.
83. Howe M.W., Tierney P.L., Sandberg S.G., Phillips P.E.M., Graybiel A.M. Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 2013, 500:575-579.
84. Hug J.J., Amsel A. Frustration theory and partial reinforcement effects: the acquisition-extinction paradox. Psychol. Rev. 1969, 76:419-421.
85. Hull C.L. Principles of Behavior 1943, Appleton-Century, New York.
86. Kakade S., Dayan P. Acquisition and extinction in autoshaping. Psychol. Rev. 2002, 109:533-544.
87. Kamin L.J. Predictability, surprise, attention, and conditioning. Punishment and Aversive Behavior 1969, Appleton-Century-Crofts, New York. B.A. Campbell, R.M. Church (Eds.).
88. Kaveri S., Nakahara H. Dual reward prediction components yield Pavlovian sign- and goal-tracking. PLoS One 2014, 9:e108142.
89. Khallad Y., Moore J. Blocking, unblocking, and overexpectation in autoshaping with pigeons. J. Exp. Anal. Behav. 1996, 65:575-591.
90. King J.R., Farner D.S. The adaptive role of winter fattening in the white crowned sparrow with comments on its regulation. Am. Nat. 1966, 100:403-418.
91. Kremer E.F. The Rescorla-Wagner model: losses in associative strength in compound conditioned stimuli. J. Exp. Psychol. Anim. Behav. Process. 1978, 4:22-36.
92. Laude J.R., Stagner J.P., Zentall T.R. Suboptimal choice by pigeons may result from the diminishing effect of nonreinforcement. J. Exp. Psychol. Anim. Learn. Cogn. 2014, 40:12-21.
93. Lesaint F., Sigaud O., Flagel S.B., Robinson T.E., Khamassi M. Modelling individual differences in the form of Pavlovian conditioned approach responses: a dual learning systems approach with factored representations. PLoS Comput. Biol. 2014, 10:e1003466.
94. Leszczuk M.H., Flaherty C.F. Lesions of the nucleus accumbens reduce instrumental but not consummatory negative contrast in rats. Behav. Brain Res. 2000, 116:61-79.
95. Linnet J., Mouridsen K., Peterson E., Møller A., Doudet D.J., Gjedde A. Striatal dopamine release codes uncertainty in pathological gambling. Psychiatry Res. 2012, 204:55-60.
96. MacLeod R., Lind J., Clark J., Cresswell W. Mass regulation in response to predation risk indicate population declines. Ecol. Lett. 2007, 10:945-955.
97. Mackintosh N.J. A theory of attention: variations in the associability of stimuli with reinforcement. Psychol. Rev 1975, 82:276-298.
98. Mahler S.V., Berridge K.C. Which cue to 'want'? Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue. J. Neurosci. 2009, 29:6500-6513.
99. Maki W.S., Leith C.R. Shared attention in pigeons. J. Exp. Anal. Behav. 1973, 19:345-349.
100. Matzel L.D., Schachtman T.R., Miller R.R. Recovery of an overshadowed association achieved by extinction of the overshadowing stimulus. Learn. Motiv. 1985, 16:398-412.
101. McCain G., McVean G. Effects of prior reinforcement or nonreinforcement on later performance in a double alley. J. Exp. Psychol. 1967, 73:620-627.
102. McCain G. The partial reinforcement effect after minimal acquisition: single pellet reward. Psychon. Sci 1968, 13:151-152.
103. McClure S.M., Daw N.D., Montague P.R. A computational substrate for incentive salience. Trends in Neurosci. 2003, 26:423-428.
104. Meyer P.J., Lovic V., Saunders B.T., Yager L.M., Flagel S.B., Morrow J.D., Robinson T.E. Quantifying individual variation in the propensity to attribute incentive salience to reward cues. PLoS One 2012, 7:e38987.
105. Meyer P.J., Cogan E.S., Robinson T.E. The form of a conditioned stimulus can influence the degree to which it acquires incentive motivational properties. PLoS One 2014, 9:e98163.
106. Mikulka P.J., Lehr R., Pavlik W.B. Effect of reinforcement schedules on reward shifts. J. Exp. Psychol. 1967, 74:57-61.
107. Miller R.R., Matzel L.D. The comparator hypothesis: a response rule for the expression of associations. The Psychology of Learning and Motivation 1988, 22:51-92. Academic Press, San Diego.
108. Mirenowicz J., Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 1994, 72:1024-1027.
109. Mowrer O.H. Integrity therapy A self-help approach. Psychother: Theory, Res. Pract. 1966, 3:114-119.
110. Overmier J.B., Seligman M.E.P. Effects of inescapable shock upon subsequent escape and avoidance responding. J. Comp. Physiol. Psychol. 1967, 63:28-33.
111. Paolone G., Angelakos C.C., Meyer P.J., Robinson T.E., Sarter M. Cholinergic control over attention in rats prone to attribute incentive salience to reward cues. J. Neurosci. 2013, 33:8321-8335.
112. Papini M.R., Dudley R.T. Effects of the number of trials per session on autoshaping in rats. Learn. Motiv. 1993, 24:175-193.
113. Papini M.R., Overmier J.B. Autoshaping in pigeons: effects of partial reinforcement on acquisition and extinction. Rev. Interam. Psicol 1984, 18:75-86.
114. Papini M.R., Overmier J.B. Partial reinforcement and autoshaping of the pigeon's key-peck behavior. Learn. Motiv 1985, 16:109-123.
115. Papini M.R. Role of surprising nonreward in associative learning. Jpn. J. Anim. Psychol. 2006, 56:35-54.
116. Papini M.R. Diversity of adjustments to reward downshifts in vertebrates. Int. J. Comp. Psychol. 2014, 27:420-445.
117. Pavlov I.P. Conditioned Reflexes 1927, University Press, Oxford: Oxford.
118. Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev 1980, 87:532-552.
119. Pearce J.M., Kaye H., Hall G. Predictive accuracy and stimulus associability: development of a model for Pavlovian conditioning. Quantitative Analyses of Behavior 1982, III:241-255. Ballinger, Cambridge, MA.
120. Peciña S., Cagniard B., Berridge K.C., Aldridge J.W., Zhuang X. Hyperdopaminergic mutant mice have higher 'wanting' but not 'liking' for sweet rewards. Behav. Neurosci 2003, 23:9395-9402.
121. Pelchat M.L., Grill H.J., Rozin P., Jacobs J. Quality of acquired responses to tastes by Rattus norvegicus depends on type of associated discomfort. J. Comp. Psychol. 1983, 97:140-153.
122. Pellegrini S., Muzio R.N., Mustaca A.E., Papini M.R. Successive negative contrast after partial reinforcement in the consummatory behavior of rats. Learn. Motiv. 2004, 35:303-321.
123. Peters D.P., McHose J.H. Effects of varied preshift reward magnitude on successive negative contrast effects in rats. J. Comp. Physiol. Psychol. 1974, 86:85-95.
124. Phillips A.G., Vacca G., Ahn S. A top-down perspective on dopamine motivation, and memory. Pharmacol. Biochem. Behav. 2008, 90:236-249.
125. Polo V., Bautista M.L. Daily routines of body mass gain in birds: 2: An experiment with reduced food availability. Anim. Behav 2006, 72:517-522.
126. Powell D.A., Churchwell J., Burriss L. Medial prefrontal lesions and Pavlovian eyeblink and heart rate conditioning: effects of partial reinforcement on delay and trace conditioning in rabbits (Oryctolagus cuniculus). Behav. Neurosci 2005, 119:180-189.
127. Pravosudov V.V., Grubb T.C. Management of fat reserves and food caches in tufted titmice (Parus bicolor) in relation to unpredictable food supply. Behav. Ecol. 1997, 8:332-339.
128. Preuschoff K., Bossaerts P., Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006, 51:381-390.
129. Ratikainen I.I., Wright J. Adaptive management of body mass by Siberian jays. Anim. Behav. 2013, 85:427-434.
130. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreniforcement. Classical Conditioning II: Current Theory and Research 1972, 64-99. Appleton-Century-Crofts, New-York. A.H. Black, W.F. Prokasy (Eds.).
131. Rescorla R.A. Probability of shock in the presence and absence of CS in fear conditioning. J. Comp. Physiol. Psychol. 1968, 66:1-5.
132. Rescorla R.A. Variations in the effectiveness of reinforcement and nonreinforcement following prior inhibitory conditioning. Learn. Motiv. 1971, 2:113-123.
133. Rescorla R.A. Pavlovian conditioning: it's not what you think it is. Am. Psychol 1988, 43:151-160.
134. Reynolds W.F., Pavlik W.B. Running speed as a function of deprivation period and reward magnitude. J. Comp. Physiol. Psychol. 1960, 53:615-618.
135. Reynolds W.F. Acquisition and extinction of the conditioned eyelid response following partial and continuous reinforcement. J. Exp. Psychol. 1958, 55:335-341.
136. Robbins T.W., Everitt B.J. Neurobehavioural mechanisms of reward and motivation. Curr. Opin. Neurobiol. 1996, 6:228-236.
137. Robinson T.E., Berridge K.C. The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res. Rev 1993, 18:247-291.
138. Robinson M.J.F., Berridge K.C. Instant transformation of learned repulsion into motivational 'wanting'. Curr. Biol 2013, 23:282-289.
139. Robinson T.E., Flagel S.B. Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biol. Psychol. 2009, 65:869-873.
140. Robinson M.J.F., Warlow S.M., Berridge K.C. Optogenetic excitation of central amygdala amplifies and narrows incentive motivation to pursue one reward above another. J. Neurosci. 2014, 34:16567-16580.
141. Robinson M.J.F., Anselme P., Fischer A.M., Berridge K.C. Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues. Behav. Brain Res 2014, 266:119-130.
142. Robinson M.J.F., Anselme P., Suchomel K., Berridge K.C. Amphetamine-induced sensitization and reward uncertainty similarly enhance the incentive salience of conditioned cues. Behav. Neurosci. 2015, 129:502-511.
143. Ross L.E. The decremental effect of partial reinforcement during acquisition of the conditioned eyelid response. J. Exp. Psychol. 1959, 57:74-82.
144. Rosse R.B., Fay-McCarthy M., Collins J.P., Risher-Flowers D., Alim T.N., Deutsch S.I. Transient compulsive foraging behavior associated with crack cocaine use. Am. J. Psychiatr. 1993, 150:155-156.
145. Sadler E.W. A within- and between-subjects comparison of partial reinforcement in classical salivary conditioning. J. Comp. Physiol. Psychol. 1968, 66:695-698.
146. Saunders B.T., Robinson T.E. The role of dopamine in the accumbens core in the expression of Pavlovian-conditioned responses. Eur. J. Neurosci 2012, 36:2521-2532.
147. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 1993, 13:900-913.
148. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998, 80:1-27.
149. Shallice T., McLeod P., Lewis K. Isolating cognitive modules with the dual-task paradigm: are speech perception and production separate processes. Q. J. Exp. Psychol. 1985, 37A:507-532.
150. Singer B.F., Scott-Railton J., Vezina P. Unpredictable saccharin reinforcement enhances locomotor responding to amphetamine. Behav. Brain Res. 2012, 226:340-344.
151. Skinner B.F. The Behavior of Organisms 1938, Appleton, New York.
152. Smith K.S., Berridge K.C., Aldridge J.W. Disentangling pleasure from incentive salience and learning signals in brain reward circuitry. Proc. Natl. Acad. Sci. 2011, 108:E255-E264.
153. Snyder C.R. The Psychology of Hope: You can Get There from Here 1994, Free Press, New York.
154. Snyder C.R. To hope, to lose, and to hope again. J.Pers. Interpers. Loss 1996, 1:1-16.
155. Sodano R., Wulfert E. Cue reactivity in active pathological, abstinent pathological, and regular gamblers. J. Gambl. Stud. 2010, 26:53-65.
156. Stagner J.P., Zentall T.R. Suboptimal choice behavior by pigeons. Psychon. Bull. Rev. 2010, 17:412-416.
157. Stickgold R., Walker M.P. Memory consolidation and reconsolidation: what is the role of sleep?. Trends in Neurosci. 2005, 28:408-415.
158. Stout S.C., Miller R.R. Sometimes-competing retrieval (SOCR): A formalization of the comparator hypothesis. Psychol. Rev. 2007, 114:759-783.
159. Sunsay C., Rebec G.V. Real-time dopamine efflux in the nucleus accumbens core during Pavlovian conditioning. Behav. Neurosci 2008, 122:358-367.
160. Sunsay C., Rebec G.V. Extinction and reinstatement of phasic dopamine signals in the nucleus accumbens core during Pavlovian conditioning. Behav. Neuroci. 2014, 128:579-587.
161. Sutton R.S., Barto A.G. Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 1981, 88:135-170.
162. Tan C.O., Bullock D. A local circuit model of learned striatal and dopamine cell responses under probabilistic schedules of reward. J. Neurosci. 2008, 28:10062-10074.
163. Thomas E., Wagner A.R. Partial reinforcement of the classically conditioned eyelid response in the rabbit. J. Comp. Physiol. Psychol. 1964, 58:157-158.
164. Tindell A.J., Berridge K.C., Zhang J., Peciña S., Aldridge J.W. Ventral pallidal neurons code incentive motivation: amplification by mesolimbic sensitization and amphetamine. Eur. J. Neurosci 2005, 22:2617-2634.
165. Tindell A.J., Smith K.S., Berridge K.C., Aldridge J.W. Dynamic computation of incentive salience: 'Wanting' what was never 'liked'. J. Neurosci. 2009, 29:12220-12228.
166. Toates F. How sexual desire works. The Enigmatic Urge 2014, University Press, Cambridge: Cambridge.
167. Vardaris R.M., Fitzgerald R.D. Effects of partial reinforcement on a classically conditioned eyeblink response in dogs. J. Comp. Physiol. Psychol. 1969, 67:531-534.
168. Voon V., Hassan K., Zurowski M., de Souza M., Thomsen T., Fox S., Lang A.E., Miyasaki J. Prevalence of repetitive and reward-seeking behaviors in Parkinson disease. Neurology 2006, 67:1254-1257.
169. Wall A.M., Goodrich K.P. Differential responding on reinforcement and nonreinforcement trials occurring in fixed repeated patterns. Psychon. Sci. 1964, 1:193-194.
170. Wasserman E.A., Hunter N.B., Gutowski K.A., Bader S.A. Autoshaping chicks with heat reinforcement: the role of stimulus-reinforcer and response-reinforcer relations. J. Exp. Psychol. Anim. Behav. Process. 1975, 104:158-169.
171. Williams B.A., McDevitt M.A. Inhibition and superconditioning. Psychol. Sci. 2002, 13:454-459.
172. Witter M.S., Swaddle J.P. Dominance, competition, and energetic reserves in the European starling. Sturnus vulgaris. Behav. Ecol. 1995, 6:343-348.
173. Zack M., Featherstone R.E., Mathewson S., Fletcher P.J. Chronic exposure to a gambling-like schedule of reward predictive stimuli can promote sensitization to amphetamine in rats. Front. Behav. Neurosci. 2014, 8:36.
174. Zentall T.R., Sherburne L.M., Zhang Z. Shared attention in pigeons: retrieval failure does not account for the element superiority effect. Learn. Motiv. 1997, 28:280-308.
175. Zentall T.R. Selective and divided attention in animals. Behav. Process. 2005, 69:1-15.
176. Zhang J., Berridge K.C., Tindell A.J., Smith K.S., Aldridge J.W. A neural computational model of incentive salience. PLoS Comput. Biol. 2009, 5:e1000437.