Learning about multiple attributes of reward in Pavlovian conditioning

Annals of the New York Academy of Sciences

Volumn 1104, Issue , 2007, Pages 1-20

  Delamater, Andrew R ^a   Oakeshott, Stephen ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

CS US interval; Pavlovian instrumental transfer; Sensory specific learning; Temporal learning; Trace conditioning

Indexed keywords

ANIMAL EXPERIMENT; BRAIN DAMAGE; CONDITIONING; CONFERENCE PAPER; CONTROLLED STUDY; DISSOCIATION; LEARNING; LEARNING THEORY; NEUROPHYSIOLOGY; NONHUMAN; PAVLOVIAN CONDITIONING; RAT; REWARD; STATE DEPENDENT LEARNING; ANIMAL; BIOLOGICAL MODEL; BRAIN; CONDITIONED REFLEX; DECISION MAKING; DISCRIMINATION LEARNING; HISTOLOGY; HUMAN; PHYSIOLOGY; REVIEW; TIME;

ANIMALS; ASSOCIATION LEARNING; BRAIN; CONDITIONING, CLASSICAL; DECISION MAKING; DISCRIMINATION LEARNING; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NEUROPHYSIOLOGY; REWARD; TIME FACTORS;

EID: 34447619721     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1196/annals.1390.008     Document Type: Conference Paper

References (40)

1. PAVLOV, I.P. 1927. Conditioned Reflexes. Oxford University Press. Oxford.
2. ROZEBOOM, W.W. 1958. "What is learned?" - An empirical enigma. Psychol. Rev. 65: 22-33.
3. MACKINTOSH, N.J. 1975. A theory of attention: variations in the associability of stimuli with reinforcement. Psychol. Rev. 82: 276-298.
4. PEARCE, J.M. & G. HALL. 1980. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87: 532-552.
5. RESCORLA, R.A. & A.R. WAGNER. 1972. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In Classical Conditioning II: Current Research and Theory. A.H. Black & W.F. Prokasy, Eds.: 64-99. Appleton-Century-Crofts. New York.
6. HALL, G. 2002. Associative structures in Pavlovian and instrumental conditioning. In Steven's Handbook of Experimental Psychology. Third edition. Vol 3: Learning, Motivation, and Emotion. H. Pashler & R. Gallistel, Eds.: 1-45. John Wiley & Sons. New York.
7. BLUNDELL, P., G. HALL & S. KILLCROSS. 2001. Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. J. Neurosci. 21: 9018-9026.
8. CORBIT, L.H. & B.W. BALLEINE. 2005. Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of Pavlovian-instrumental transfer. J. Neurosci. 25: 962-970.
9. DELAMATER, A.R. 1995. Outcome-selective effects of intertrial reinforcement in a Pavlovian appetitive conditioning paradigm with rats. Anim. Learn. Behav. 23: 31-39.
10. DELAMATER, A.R. 1996. Effects of several extinction treatments upon the integrity of Pavlovian stimulus-outcome associations. Anim. Learn. Behav. 24: 437-449.
11. HOLLAND, P.C. 2004. Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J. Exp. Psychol. Anim. Behav. Process 30: 104-117.
12. KRUSE, J.M. et al. 1983. Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific. Learn. Motiv. 14: 165-181.
13. SCHNEIDERMAN, N., Ed. 1972. Response System Divergences in Aversive Classical Conditioning. Appleton-Century-Crofts. New York.
14. TIMBERLAKE, W., G. WAHL & D. KING. 1982. Stimulus and response contingencies in the misbehavior of rats. J. Exp. Psychol. Anim. Behav. Process 8: 62-85.
15. KONORSKI, J. 1967. Integrative Activity of the Brain. University of Chicago Press. Chicago.
16. GIBBON, J. & P.D. BALSAM. 1981. The spread of association in time. In Autoshaping and Conditioning Theory. C.M. Locurto, H.S. Terrace & J. Gibbon, Eds.: 219-254. Academic Press. New York.
17. DELAMATER, A.R. & P.C. HOLLAND. The influence of CS-US interval on several different indices of learning in appetitive conditioning. J. Exp. Psychol. Anim. Behav. Processes. In press.
18. CHURCH, R.M. 2002. Temporal learning. In Steven's Handbook of Experimental Psychology Third edition. Vol 3: Learning, Motivation, and Emotion. H. Pashler & R. Gallistel, Eds.: 365-393. John Wiley & Sons. New York.
19. ZENTALL, T.R., E.D. KLEIN & R.A. SINGER. 2004. Evidence for detection of one duration sample and default responding to others by pigeons may result from an artifact of retention-test ambiguity. J. Exp. Psychol. Anim. Behav. Processes 30: 129-134.
20. DELAMATER, A.R. 2004. Experimental extinction in Pavlovian conditioning: behavioural and neuroscience perspectives. Q. J. Exp. Psychol. Sect. B Comp. Physiol. Psychol. 57: 97-132.
21. RESCORLA, R.A. 1996. Preservation of Pavlovian associations through extinction. Q. J. Exp. Psychol. Sect. B Comp. Physiol. Psychol. 49: 245-258.
22. RESCORLA, R.A. 2001. Experimental extinction. In Handbook of Contemporary Learning Theories. R.R. Mowrer & S.B. Klein, Eds.: 119-154. Lawrence Erlbaum Associates. Mahwah, NJ.
23. OHYAMA, T.J. et al. 1999. Temporal control during maintenance and extinction of conditioned keypecking in ring doves. Anim. Learn. Behav. 27: 89-98.
24. NADER, K. 2003. Memory traces unbound. Trends. Neurosci. 26: 65-72.
25. BALSAM, P.D., M.R. DREW & C. YANG. 2002. Timing at the start of associative learning. Learn. Motiv. 33: 141-155.
26. KIRKPATRICK, K. & R.M. CHURCH. 2000. Independent effects of stimulus and cycle duration in conditioning: the role of timing processes. Anim. Learn. Behav. 28: 373-388.
27. DREW, M.R. et al. 2005. Temporal control of conditioned responding in goldfish. J. Exp. Psychol. Anim. Behav. Process 31: 31-39.
28. ROESCH, M.R., A.R. TAYLOR & G. SCHOENBAUM. 2006. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51: 509-520.
29. GEWIRTZ, J.C., S.E. BRANDON & A.R. WAGNER. 1998. Modulation of the acquisition of the rabbit eyeblink conditioned response by conditioned contextual stimuli. J. Exp. Psychol. Anim. Behav. Process. 24(1): 106-117.
30. OSTLUND, S.B. & B.W. BALLEINE. 2005. Lesions of the orbitofrontal cortex disrupt Pavlovian, but not instrumental, outcome-encoding. Program No. 71.20. Abstract Viewer/Itinerary Planner. Washington, DC: Society for Neuroscience.
31. SADDORIS, M.P., M. GALLAGHER & G. SCHOENBAUM. 2005. Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron 46: 321-331.
32. SCHOENBAUM, G. & M. ROESCH. 2005. Orbitofrontal cortex, associative learning, and expectancies. Neuron 47: 633-636.
33. HADDON, J.E. & S. KILLCROSS. Contextual control of choice performance: behavioral, neurobiological and neuro-chemical influences. This volume.
34. HORVITZ, J.C. et al. A "Good Parent" Function for Dopamine in Response Acquisition and Expression. This volume.
35. CHOI, W.Y., P.D. BALSAM & J.C. HORVITZ. 2005. Extended habit training reduces dopamine mediation of appetitive response expression. J. Neurosci. 25: 6729-6733.
36. BERRIDGE, K.C. 2007. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 191: 391-431.
37. WYVELL, C.L. & K.C. BERRIDGE. 2000. Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J. Neurosci. 20: 8122-8130.
38. GRILL, H.J. & R. NORGREN. 1978. The taste reactivity test. I. Mimetic responses to gustatory stimuli in neurologically normal rats. Brain. Res. 143: 263-279.
39. DELAMATER, A.R., V.M. LOLORDO & K.C. BERRIDGE. 1986. Control of fluid palatability by exteroceptive Pavlovian signals. J. Exp. Psychol. Anim. Behav. Process 12: 143-152.
40. HOLLAND, P.C. 1990. Event representations in Pavlovian conditioning: image and action. Cognition. 37: 105-131.