Theory of reward systems

Learning and Memory: A Comprehensive Reference

Volumn , Issue , 2007, Pages 701-720

  Ostlund, S B ^a   Winterbauer, N E ^a   Balleine, B W ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Goal directed action; Incentive learning; Instrumental conditioning; Pavlovian conditioning; Secondary reward; Sensory reward; Value

Indexed keywords

EID: 84890889583     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-012370509-9.00089-9     Document Type: Chapter

References (82)

1. C.D. Adams Variations in the sensitivity of instrumental responding to reinforcer devalaution Q. J. Exp. Psychol. B 34 1981 77-98.
2. C.D. Adams., A. Dickinson Instrumental responding following reinforcer devaluation Q. J. Exp. Psychol. B 33 1981 109-121.
3. E.A. Asratyan Conditioned reflex theory and motivational behavior Acta Neurobiol. Exp. 34 1974 15-31.
4. B. Balleine Instrumental performance following a shift in primary motivation depends on incentive learning J Exp Psychol Anim Behav Process 18 1992 236-250.
5. B.W. Balleine Incentive processes in instrumental conditioning R.M.S. Klein. Handbook of Contemporary Learning Theories 2001 Lawrence Erlbaum Associates Hillsdale, NJ 307-366.
6. B. Balleine., A. Dickinson Instrumental performance following reinforcer devaluation depends upon incentive learning Q. J. Exp. Psychol. B 43 1991 279-296.
7. B.W. Balleine., A. Dickinson The role of cholecystokinin in the motivational control of instrumental action Behav. Neurosci. 108 1994 590-605.
8. B.W. Balleine., A. Dickinson Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates Neuropharmacology 37 1998 407-419.
9. B.W. Balleine., A. Dickinson The role of incentive learning in instrumental outcome revaluation by specific satiety Anim. Learn. Behav. 26 1998 46-59.
10. B. Balleine., J. Ball., A. Dickinson Benzodiazepine-induced outcome revaluation and the motivational control of instrumental action in rats Behav. Neurosci. 108 1994 573-589.
11. B. Balleine., A. Davies., A. Dickinson Cholecystokinin attenuates incentive learning in rats Behav. Neurosci. 109 1995 312-319.
12. B. Balleine., C. Garner., A. Dickinson Instrumental outcome devaluation is attenuated by the anti-emetic ondansetron B Q. J. Exp. Psychol. 48 1995 235-251.
13. D.E.C. Berlyne Contact, Arousal and Curiosity 1960 McGraw-Hill New York.
14. I.L. Bernstein Taste aversion learning: A contemporary perspective Nutrition 15 1999 229-234.
15. K. Berridge., H.J. Grill., R. Norgren Relation of consummatory responses and preabsorptive insulin release to palatability and learned taste aversions J. Comp. Physiol. Psychol. 95 1981 363-382.
16. R.C. Bolles Reinforcement, expectancy, and learning Psychol. Rev. 79 1972 394-409.
17. B.R. Bugelski The Psychology of Learning 1956 Holt New York.
18. R. Bugelski Extinction with and without sub-goal reinforcement J. Comp. Psychol. 26 1938 121-134.
19. R.M. Church Systematic effect of random error in the yoked control design Psychol. Bull. 1964 62.
20. R.M. Colwill Associative representations of instrumental contingencies D.L. Medin. The Psychology of Learning and Motivation 1994 Academic Press New York 1-72.
21. R.M. Colwill., D.K. Motzkin Encoding of the unconditioned stimulus in Pavlovian conditioning Anim. Learn. Behav. 22 1994 384-394.
22. R.M. Colwill., R.A. Rescorla Instrumental responding remains sensitive to reinforcer devaluation after extensive training J. Exp. Psychol. Anim. Behav. Process. 11 1985 520-536.
23. R.M. Colwill., R.A. Rescorla Postconditioning devaluation of a reinforcer affects instrumental responding J. Exp. Psychol. Anim. Behav. Process. 11 1985 120-132.
24. R.M. Colwill., R.A. Rescorla Associative structures in instrumental learning The Psychology of Learning and Motivation 1986 Academic Press Orlando pp. 55-104.
25. R.M. Colwill., R.A. Rescorla Associations between the discriminative stimulus and the reinforcer in instrumental learning J. Exp. Psychol. Anim. Behav. Process. 14 1988 155-164.
26. R.M. Colwill., R.A. Rescorla Effect of reinforcer devaluation on discriminative control of instrumental behavior J. Exp. Psychol. Anim. Behav. Process. 16 1990 40-47.
27. W.F. Crowder., J.B. Morris., M.H. McDaniel Secondary reinforcement or response facilitation? I. Resistance to extinction J. Psychol. 48 1959 299-302.
28. W.F. Crowder., K. Gill Jr., C.C. Hodge., F.A. Nash Jr. Secondary reinforcement or response facilitation? II. Response acquisition J. Psychol. 48 1959 303-306.
29. W.F. Crowder., B.R. Gay., M.G. Bright., M.F. Lee Secondary reinforcement or response facilitation? III. Reconditioning J. Psychol. 48 1959 307-310.
30. W.F. Crowder., B.R. Gay., W.C. Fleming., R.W. Hurst Secondary reinforcement or response facilitation? IV. The retention method J. Psychol. 48 1959 311-314.
31. A. Damasio Descartes’ Error 1994 G.P. Putnam’s Sons New York.
32. J. Davis., M.E. Bitterman Differential reinforcement of other behavior (DRO): A yoked-control comparison J. Exp. Anal. Behav. 15 1971 237-241.
33. A.R. Delamater Outcome-selective effects of intertrial reinforcement in Pavlovian appetitive conditioning with rats Anim. Learn. Behav. 23 1995 31-39.
34. A. Dickinson Actions and habits: The development of behavioural autonomy Philos. Trans. R. Soc. Lond. B 308 1985 67-78.
35. A. Dickinson Expectancy theory in animal conditioning S.B. Klein., R.R. Mowrer Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theories 1989 Lawrence Erlbaum Associates Hillsdale, NJ 279-308.
36. A. Dickinson Instrumental conditioning N.J. Mackintosh. Animal Cognition and Learning 1994 Academic Press London 4-79.
37. A. Dickinson., B.W. Balleine Motivational control of goal-directed action Anim. Learn. Behav. 22 1994 1-18.
38. A.B. Dickinson., B. Balleine Motivational control of instrumental action Curr. Dir. Psychol. Sci. 4 1995 162-167.
39. A. Dickinson., B.W. Balleine The role of learning in the operation of motivational systems C.R. Gallistel. Learning, Motivation and Emotion, Vol. 3 Stevens’ Handbook of Experimental Psychology 3rd edn. 2002 John Wiley New York 497-533.
40. A. Dickinson., J. Campos., Z. Varga., B.W. Balleine Bidirectional control of instrumental conditioning Q. J. Exp. Psychol. 49B 1996 289-306.
41. A. Dickinson., C.W. Mulatero Reinforcer specificity of the suppression of instrumental performance on a non-contingent schedule Behav. Process. 19 1989 167-180.
42. A. Dickinson., S. Squire., Z. Varga., J.W. Smith Omission learning after instrumental pretraining Q. J. Exp. Psychol. 51B 1998 271-286.
43. B.J. Everitt., P. Stacey Studies of instrumental behavior with sexual reinforcement in male rats (Rattus norvegicus): II. Effects of preoptic area lesions, castration and testosterone J. Comp. Psychol. 101 1987 407-419.
44. P.M. Fedorchak., R.C. Bolles Differential outcome effect using a biologically neutral outcome difference J. Exp. Psychol. Anim. Behav. Process. 12 1986 125-130.
45. J. Garcia Food for Tolman: Cognition and cathexis in concert T. Archer., L.-G. Nilsson Aversion, Avoidance and Anxiety 1989 Lawrence Erlbaum Associates Hillsdale, NJ 45-85.
46. R.W. Hendersen., J. Graham Avoidance of heat by rats: Effects of thermal context on the rapidity of extinction Learn. Motiv. 10 1979 351-363.
47. W.A. Hershberger An approach through the looking-glass Anim. Learn. Behav. 14 1986 443-451.
48. P.C. Holland Differential effects of omission contingencies on various components of pavlovian appetitive conditioned responding in rats J. Exp. Psychol. Anim. Behav. Process. 5 1979 178-193.
49. P.C. Holland Relations between Pavlovian-instrumental transfer and reinforcer devaluation J. Exp. Psychol. Anim. Behav. Process. 30 2004 104-117.
50. C.L. Hull Principles of Behavior 1943 Appleton New York.
51. C.L. Hull A Behavior System 1952 Wiley New York.
52. F.S. Keller., W.N. Schoenfeld Principles of Psychology: A Systematic Text in the Science of Behavior 1950 Appleton-Century-Crofts East Norwalk, CT.
53. A.S. Killcross., B.J. Everitt., T.W. Robins Symmetrical effects of amphetamine and alpha-flupenthixol on conditioned punishment and conditioned reinforcement: Contrasts with midazolam Psychopharmacology (Berl) 129 1997 141-152.
54. G.B. Kish Studies of sensory reinforcement W.K. Honig. Operant Behavior: Areas of Research and Application 1966 Appleton-Century-Crofts New York 109-159.
55. J. Konorski Integrative Activity of the Brain 1967 University of Chicago Press Chicago.
56. J.M. Kruse., J.B. Overmier., W.A. Konz., E. Rokke Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific Learn. Motiv. 14 1983 165-181.
57. C.L. Limebeer., L.A. Parker The antiemetic drug ondansetron interferes with lithium-induced conditioned rejection reactions, but not lithium-induced taste avoidance in rats J. Exp. Psychol. Anim. Behav. Process. 26 2000 371-384.
58. M. Lopez., B.W. Balleine., A. Dickinson Incentive learning and the motivational control of instrumental performance by thirst Anim. Learn. Behav. 20 1992 322-328.
59. O.H. Mowrer Learning Theory and the Symbolic Processes 1960 Wiley New York.
60. K.P. Myers., A. Sclafani Conditioned enhancement of flavor evaluation reinforced by intragastric glucose. II. Taste reactivity analysis Physiol. Behav. 74 2001 495-505.
61. J.A. Parkinson., A.C. Roberts., B.J. Everitt., P. Di Ciano Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus Q. J. Exp. Psychol. B 58 2005 19-30.
62. I.P. Pavlov Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex 1927 Oxford University Press London Anrep GV (trans.).
63. R.A. Rescorla Response-outcome versus outcome-response associations in instrumental learning Anim. Learn. Behav. 20 1992 223-232.
64. R.A. Rescorla Transfer of instrumental control mediated by a devalued outcome Anim. Learn. Behav. 22 1994 27-33.
65. R.A. Rescorla., R.M. Colwill Associations with anticipated and obtained outcomes in instrumental learning Anim. Learn. Behav. 17 1989 291-303.
66. R.A. Rescorla., R.L. Solomon Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning Psychol. Rev. 74 1967 151-182.
67. T.W. Robbins., M. Cador., J.R. Taylor., B.J. Everitt Limbic-striatal interactions in reward-related processes Neurosci. Biobehav. Rev. 13 1989 155-162.
68. F.D. Sheffield Relation between classical and instrumental conditioning W.F. Prokasy. Classical Conditioning 1965 Appleton-Century-Crofts New York 302-322.
69. B.F. Skinner The Behavior of Organisms: An Experimental Analysis 1938 D. Appleton-Century New York, London.
70. K.W. Spence Behavior Theory and Conditioning 1956 Yale University Press New Haven.
71. J.R. Taylor., T.W. Robbins Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens Psychopharmacology (Berl.) 84 1984 405-412.
72. M.A. Trapold Are expectancies based upon different positive reinforcing events discriminably different? Learn. Motiv. 1 1970 129-140.
73. M.A. Trapold., J.B. Overmier The second learning process in instrumental conditioning A.A. Black., W.F. Prokasy Classical Conditioning: II. Current Research and Theory 1972 Appleton-Century-Crofts New York 427-452.
74. G.I. Ward Secondary reinforcement with cue stimulus effects reduced Proc. WV Acad. Sci. 32 1960 205-208.
75. E.L. Wike Secondary Reinforcement: Selected Experiments 1966 Harper and Row New York.
76. D.R. Williams., H. Williams Auto-maintenance in the pigeon: Sustained pecking despite contingent non-reinforcement J. Exp. Anal. Behav. 12 1969 511-520.
77. Winterbauer NE (2006) Conditioned Reinforcement. PhD Thesis, University of California at Los Angeles.
78. J.C. Woodson., B.W. Balleine An assessment of factors contributing to instrumental performance for sexual reward in the rat Q. J. Exp. Psychol. B 55 2002 75-88.
79. L.B. Wyckoff Toward a quantitative theory of secondary reinforcement Psychol. Rev. 66 1959 68-78.
80. L.B. Wyckoff., J. Sidowski., D.J. Chambliss An experimental study of the relationship between secondary reinforcing and cue effects of a stimulus J. Comp. Physiol. Psychol. 51 1958 103-109.
81. H.H. Yin., B.J. Knowlton., B.W. Balleine Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning Eur. J. Neurosci. 22 2005 505-512.
82. D.W. Zimmerman Patterns of responding in a chained schedule altered by conditioned reinforcement Psychonom. Sci. 16 1969 120-126.