On the nature of CS and US representations in Pavlovian learning

Learning and Behavior

Volumn 40, Issue 1, 2012, Pages 1-23

  Delamater, Andrew R ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Conditional discrimination learning; Connectionist models; Multimodal processing; Sensory specific associations

Indexed keywords

ANIMAL; ARTICLE; CONDITIONED REFLEX; DISCRIMINATION LEARNING; LEARNING; PHYSIOLOGY;

ANIMALS; ASSOCIATION LEARNING; CONDITIONING, CLASSICAL; DISCRIMINATION LEARNING;

EID: 84857198174     PISSN: 15434494     EISSN: 15434508     Source Type: Journal    
DOI: 10.3758/s13420-011-0036-4     Document Type: Article

References (107)

1. Arcediano, F., & Miller, R. R. (2002). Some constraints for models of timing: A temporal coding hypothesis perspective. Learning and Motivation, 33, 105-123.
2. Balsam, P. D., & Gallistel, C. R. (2009). Temporal maps and informativeness in associative learning. Trends in Neurosciences, 32, 73-78.
3. Balsam, P. D., Drew, M. R., & Yang, C. (2002). Timing at the start of associative learning. Learning and Motivation, 33, 141-155.
4. Bellingham, W. P., Gillette-Bellingham, K., & Kehoe, E. J. (1985). Summation and configuration in patterning schedules with the rat and rabbit. Animal Learning & Behavior, 13, 152-164. (Pubitemid 15229965)
5. Berridge, K. C. (2009). 'Liking' and 'wanting' food rewards: Brain substrates and roles in eating disorders. Physiology & Behavior, 97, 537-550.
6. Betts, S. L., Brandon, S. E., & Wagner, A. R. (1996). Dissociation of the blocking of conditioned eyeblink and conditioned fear following a shift in US locus. Animal Learning & Behavior, 24, 459-470. (Pubitemid 27014176)
7. Blough, D. S. (1975). Steady state data and a quantitative model of operant generalization and discrimination. Journal of Experimental Psychology: Animal Behavior Processes, 1, 3-21.
8. Blundell, P., Hall, G., & Killcross, S. (2001). Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. Journal of Neuroscience, 21, 9018-9026. (Pubitemid 33054863)
9. Church, R. M., & Broadbent, H. A. (1990). Alternative representations of time, number, and rate. Cognition, 37, 55-81.
10. Cole, S., & McNally, G. P. (2007). Opioid receptors mediate direct predictive fear learning: Evidence from one-trial blocking. Learning & Memory, 14, 229-235. (Pubitemid 46625625)
11. Cole, S., & McNally, G. P. (2009). Complementary roles for amygdala and periaqueductal gray in temporal-difference fear learning. Learning & Memory, 16, 1-7.
12. Cole, R. P., Barnet, R. C., & Miller, R. R. (1995). Temporal encoding in trace conditioning. Animal Learning & Behavior, 23, 144-153.
13. Colwill, R. M., & Motzkin, D. K. (1994). Encoding of the unconditioned stimulus in Pavlovian conditioning. Animal Learning & Behavior, 22, 384-394. (Pubitemid 24332572)
14. Colwill, R. M., & Rescorla, R. A. (1990). Effect of reinforcer devaluation on discriminative control of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes, 16, 40-47.
15. Corbit, L. H., & Balleine, B. W. (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of Pavlovian-instrumental transfer. Journal of Neuroscience, 25, 962-970. (Pubitemid 40171012)
16. Delamater, A. R. (1995). Outcome-selective effects of intertrial reinforcement in a Pavlovian appetitive conditioning paradigm with rats. Animal Learning & Behavior, 23, 31-39.
17. Delamater, A. R. (1997). Selective reinstatement of stimulus-outcome associations. Animal Learning & Behavior, 25, 400-412. (Pubitemid 27527676)
18. Delamater, A. R. (1998). Associative mediational processes in the acquired equivalence and distinctiveness of cues. Journal of Experimental Psychology: Animal Behavior Processes, 24, 467-482. (Pubitemid 128737318)
19. Delamater, A. R. (2007). The role of the orbitofrontal cortex in sensory-specific encoding of associations in Pavlovian and instrumental conditioning. Annals of the New York Academy of Sciences, 1121, 152-173.
20. Delamater, A. R., & Holland, P. C. (2008). The influence of CS-US interval on several different indices of learning in appetitive conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 34, 202-222. (Pubitemid 351671859)
21. Delamater, A. R., & Joseph, P. (2000). Common coding in symbolic matching tasks with humans: Training with a common consequence or antecedent. Quarterly Journal of Experimental Psychology, 53B, 255-274.
22. Delamater, A. R., & LoLordo, V. M. (1991). Event revaluation procedures and associative structures in Pavlovian conditioning. In L. Dachowski & C. F. Flaherty (Eds.), Current topics in animal learning: Brain, emotion, and cognition (pp. 55-94). NJ, Erlbaum: Hillsdale.
23. Delamater, A. R., & Oakeshott, S. (2007). Learning about multiple attributes of reward in Pavlovian conditioning. Annual of the New York Academy of Sciences, 1104, 1-20. (Pubitemid 47092734)
24. Delamater, A. R., LoLordo, V. M., & Berridge, K. C. (1986). Control of fluid palatability by exteroceptive Pavlovian signals. Journal of Experimental Psychology: Animal Behavior Processes, 12, 143-152.
25. Delamater, A. R., Sosa, W., & Katz, M. (1999). Elemental and configural processes in patterning discrimination learning. Quarterly Journal of Experimental Psychology, 52B, 97-124.
26. Delamater, A. R., Kranjec, A., & Fein, M. (2010). Differential outcome effects in Pavlovian biconditional and ambiguous occasion setting tasks. Journal of Experimental Psychology: Animal Behavior Processes, 36, 471-481.
27. Desgranges, B., Ramirez-Amaya, V., Ricaño-Cornejo, I., Levy, F., & Ferreira, G. (2010). Flavor preference learning increases olfactory and gustatory convergence onto single neurons in the basolateral amygdala but not in the insular cortex in rats. Plos One, 5, 1-8.
28. Dickinson, A., & Dearing, M. F. (1979). Appetitive-aversive interactions and inhibitory processes. In A. Dickinson & R. A. Boakes (Eds.), Mechanisms of learning and motivation (pp. 203-231). Hillsdale, NJ: Erlbaum.
29. Dwyer, D. M. (2008). Microstructural analysis of conditioned and unconditioned responses to maltodextrin. Learning & Behavior, 36, 149-157.
30. Dwyer, D. M., Pincham, H. L., Thein, T., & Harris, J. A. (2009). A learned flavor preference persists despite the extinction of conditioned hedonic reactions to the cue flavors. Learning & Behavior, 37, 305-310.
31. Gallistel, C. R., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107, 289-344.
32. Gewirtz, J. C., Brandon, S. E., & Wagner, A. R. (1998). Modulation of the acquisition of the rabbit eyeblink conditioned response by conditioned contextual stimuli. Journal of Experimental Psychology: Animal Behavior Processes, 24, 106-117. (Pubitemid 128738263)
33. Gibbon, J., & Balsam, P. D. (1981). The spread of association in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.), Autoshaping and conditioning theory (pp. 219-253). New York: Academic Press.
34. Gibson, J. J., & Gibson, E. J. (1955). Perceptual learning: Differentiation or enrichment? Psychological Review, 62, 32-41.
35. Gluck, M. A., & Myers, C. E. (1993). Hippocampal mediation of stimulus representation: a computational theory. Hippocampus, 3, 491-516. (Pubitemid 23322862)
36. Grand, C., & Honey, R. C. (2008). Solving XOR. Journal of Experimental Psychology Animal Behavior Processes, 34, 486-493.
37. Hall, G. (1996). Learning about associatively activated stimulus representations: Implications for acquired equivalence and perceptual learning. Animal Learning & Behavior, 24, 233-255. (Pubitemid 26275227)
38. Hall, G. (2002). Associative structures in Pavlovian and instrumental conditioning. In R. Gallistel (Ed.), Stevens' handbook of experimental psychology: Vol. 3. Learning, motivation, and emotion (pp. 1-45). New York: Wiley.
39. Harris, J. A. (2006). Elemental representations of stimuli in associative learning. Psychological Review, 113, 584-605. (Pubitemid 44118170)
40. Harris, J. A., Shand, F. L., Carroll, L. Q., & Westbrook, R. F. (2004). Persistence of preference for a flavor presented in simultaneous compound with sucrose. Journal of Experimental Psychology: Animal Behavior Processes, 30, 177-189. (Pubitemid 38956337)
41. Harris, J. A., Livesey, E. J., Gharaei, S., & Westbrook, R. F. (2008). Negative patterning is easier than a biconditional discrimination. Journal of Experimental Psychology: Animal Behavior Processes, 34, 494-500.
42. Harris, J. A., Gharaei, S., & Moore, C. A. (2009). Representations of single and compound stimuli in negative and positive patterning. Learning & Behavior, 37, 230-245.
43. Haselgrove, M., Robinson, J., Nelson, A., & Pearce, J. M. (2008). Analysis of an ambiguous-feature discrimination. Quarterly Journal of Experimental Psychology, 61, 1710-1725.
44. Haselgrove, M., Esber, G. R., Pearce, J. M., & Jones, P. M. (2010). Two kinds of attention in Pavlovian conditioning: Evidence for a hybrid model of learning. Journal of Experimental Psychology: Animal Behavior Processes, 36, 456-470.
45. Hearst, E. (1984). The feature-positive effect in pigeons: Conditionality, overall predictiveness, and type of feature. Bulletin of the Psychonomic Society, 26, 73-76.
46. Holland, P. C. (1985). The nature of conditioned inhibition in serial and simultaneous feature negative discriminations. In R. R. Miller & N. E. Spear (Eds.), Information processing in animals: Conditioned inhibition (pp. 267-298). Hillsdale, NJ: Erlbaum.
47. Holland, P. C. (1990). Event representations in Pavlovian conditioning: Image and action. Cognition, 37, 105-131.
48. Holland, P. C. (1991). Transfer of control in ambiguous discriminations. Journal of Experimental Psychology: Animal Behavior Processes, 17, 231-248.
49. Holland, P. C. (1998). Amount of training affects associatively-activated event representation. Neuropharmacology, 37, 461-469.
50. Holland, P. C, & Reeve, C. E. (1991). Acquisition and transfer of control by an ambiguous cue. Animal Learning & Behavior, 19, 113-124.
51. Holland, P. C, & Rescorla, R. A. (1975). The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 1, 355-363.
52. Holland, P. C, Lasseter, H, & Agarwal, I. (2008). Amount of training and cue-evoked taste-reactivity responding in reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes, 34, 119-132. (Pubitemid 351240978)
53. Honey, R. C. (2000). Associative priming in Pavlovian conditioning. Quarterly Journal of Experimental Psychology, 53B, 1-23.
54. Honey, R. C, & Hall, G. (1989). Acquired equivalence and distinctiveness of cues. Journal of Experimental Psychology: Animal Behavior Processes, 15, 338-346.
55. Honey, R. C, & Ward-Robinson, J. (2001). Transfer between contextual conditional discriminations: An examination of how stimulus conjuctions are represented. Journal of Experimental Psychology: Animal Behavior Processes, 27, 196-205. (Pubitemid 33777966)
56. Honey, R. C, & Ward-Robinson, J. (2002). Acquired equivalence and distinctiveness of cues: I. Exploring a neural network approach. Journal of Experimental Psychology: Animal Behavior Processes, 28, 378-387. (Pubitemid 44220034)
57. Honey, R. C, Close, J., & Lin, T. E. (2010). Acquired distinctiveness and equivalence: A synthesis. In C. J. Mitchell & M. E. Le Pelley (Eds.), Attention and associative learning: From brain to behaviour (pp. 159-186). Oxford: Oxford University Press.
58. Jenkins, H. M., & Sainsbury, R. S. (1969). The development of stimulus control through differential reinforcement. In N. J. Mackintosh & W. K. Honig (Eds.), Fundamental issues in associative learning (pp. 239-273). Halifax, NS, Canada: Dalhousie University Press.
59. Kehoe, E. J. (1988). A layered network model of associative learning: Learning to learn and configuration. Psychological Review, 95, 411-433.
60. Kendler, H. H. (1952). "What is learned?" - A theoretical blind alley. Psychological Review, 59, 269-277.
61. Kerfoot, E. C, Agarwal, I., Lee, H. J., & Holland, P. C. (2007). Control of appetitive and aversive taste-reactivity responses by an auditory conditioned stimulus in a devaluation task: A FOS and behavioral analysis. Learning & Memory, 14, 581-589. (Pubitemid 47481691)
62. Kim, J. J., Krupa, D. J., & Thompson, R. F. (1998). Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. Science, 279, 570-573. (Pubitemid 28067287)
63. Konorski, J. (1967). Integrative activity of the brain. Chicago: University of Chicago Press.
64. Kruse, J. M., Overmier, J. B., Konz, W. A., & Rokke, E. (1983). Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific. Learning & Motivation, 14, 165-181.
65. Le Pelley, M. E. (2004). The role of associative history in models of associative learning: A selective review and a hybrid model. The Quarterly Journal of Experimental Psychology: B Comparative and Physiological Psychology, 57, 193-244.
66. Mackintosh, N. J. (1975). A theory of attention: Variation in the associability of stimuli with reinforcement. Psychological Review, 82, 276-298.
67. McCloskey, M., & Cohen, N. J. (1989). Catastrophic interference in connectionist networks: The sequential learning problem. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 24, pp. 109-164). New York: Academic Press.
68. McLaren, I. P. L., & Mackintosh, N. J. (2000). An elemental model of associative learning: I. Latent inhibition and perceptual learning. Animal Learning & Behavior, 26, 211-246.
69. McLaren, I. P. L., & Mackintosh, N. J. (2002). Associative learning and elemental representation: II. Generalization and discrimination. Animal Learning & Behavior, 30, 177-200.
70. Nadler, N, Delgado, M. R., & Delamater, A. R. (2011). Pavlovian to instrumental transfer of control in a human learning task. Emotion. Advance online publication. doi:10.1037/a0022760.
71. Nakajima, S., & Kobayashi, H. (2000). Differential outcomes effect on instrumental serial feature-ambiguous discrimination in rats. Psychological Record, 50, 189-198.
72. O'Reilly, R. C., & Munakata, Y. (2000). Computational explorations in cognitive neuroscience: Understanding the mind by simulating the brain. Cambridge, MA: MIT Press.
73. O'Reilly, R. C. (1996). Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm. Neural Computation, 8, 895-938. (Pubitemid 126449951)
74. O'Reilly, R. C., & Rudy, J. W. (2001). Conjunctive representations in learning and memory: Principles of cortical and hippocampal function. Psychological Review, 108, 311-345. (Pubitemid 33610299)
75. Ostlund, S. B., & Balleine, B. W. (2007). Orbitofrontal cortex mediates outcome encoding in pavlovian but not instrumental conditioning. Journal of Neuroscience, 27, 4819-4825. (Pubitemid 46699058)
76. Ostlund, S. B., & Balleine, B. W. (2008). Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. Journal of Neuroscience, 28, 4398-4405.
77. Pearce, J. M. (1987). A model for stimulus generalization in Pavlovian conditioning. Psychological Review, 94, 61-73.
78. Pearce, J. M. (1994). Similarity and discrimination: A selective review and a connectionist model. Psychological Review, 101, 587-607. (Pubitemid 24976818)
79. Pearce, J. M. (2002). Evaluation and development of a connectionist theory of configural learning. Animal Learning & Behavior, 30, 73-95. (Pubitemid 34651253)
80. Pearce, J. M., & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532-552.
81. Pearce, J. M., & Mackintosh, N. J. (2010). Two theories of attention: A review and a possible integration. In C. J. Mitchell & M. E. Le Pelley (Eds.), Learning and attention (pp. 11-39). Oxford: Oxford University Press.
82. Pearce, J. M., & Redhead, E. S. (1993). The influence of an irrelevant stimulus on two discriminations. Journal of Experimental Psychology: Animal Behavior Processes, 19, 180-190.
83. Pearce, J. M., Esber, G. R., George, D. N., & Haselgrove, M. (2008). The nature of discrimination learning in pigeons. Learning & Behavior, 36, 188-199.
84. Poremba, A., Saunders, R. C., Crane, A. M., Cook, M., Sokoloff, L., & Mishkin, M. (2003). Functional mappinjg of the primate auditory system. Science, 299, 568-572. (Pubitemid 36135155)
85. Redhead, E. S., & Pearce, J. M. (1995). Stimulus salience and negative patterning. Quarterly Journal of Experimental Psychology, 48B, 67-83.
86. Rescorla, R. A. (1976). Stimulus generalization: Some predictions from a model of Pavlovian conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 2, 88-96.
87. Rescorla, R. A. (1980a). Pavlovian second-order conditioning: Studies in associative learning. Hillsdale, NJ: Erlbaum.
88. Rescorla, R. A. (1980b). Simultaneous associations. In P. Harzem & M. Zeiler (Eds.), Advances in analysis of behavior (Vol. 2, pp. 47-80). New York: Wiley.
89. Rescorla, R. A. (1985). Conditioned inhibition and facilitation. In R. R. Miller & N. E. Spear (Eds.), Information processing in animals: Conditioned inhibition (pp. 299-326). Hillsdale, NJ: Erlbaum.
90. Rescorla, R. A. (1999). Summation and overexpectation with qualitatively different outcomes. Animal Learning & Behavior, 27, 50-62. (Pubitemid 29130010)
91. Rescorla, R. A., & Solomon, R. L. (1967). Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychological Review, 74, 151-182.
92. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). Appleton-Century- Crofts: New York.
93. Rozeboom, W. W. (1958). "What is learned?" An empirical enigma. Psychological Review, 65, 22-33.
94. Rumelhart, D. E., McClelland, J. L., & the PDP Research Group. (1986a). Parallel distributed processing: Explorations in the microstructure of cognition. Cambridge, MA: MIT Press.
95. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986b). Learning internal representations by error propagation. In D. E. Rumelhart, J. L. McClelland, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: Foundations (pp. 318-362). Cambridge, MA: MIT Press.
96. Saddoris, M. P., Holland, P. C, & Gallagher, M. (2009). Associatively learned representations of taste outcomes activate taste-encoding neural ensembles in gustatory cortex. Journal of Neuroscience, 29, 15386-15396.
97. Schmajuk, N. A., & DiCarlo, J. J. (1992). Stimulus configuration, classical conditioning, and hippocampal function. Psychological Review, 99, 268-305.
98. Schmajuk, N. A., Lamoureux, J. A., & Holland, P. C. (1998). Occasion setting: A neural network approach. Psychological Review, 105, 3-32. (Pubitemid 128459556)
99. Smith, K. S., Berridge, K. C, & Aldridge, J. W. (2011). Disentangling pleasure from incentive salience and learning signals in brain reward circuitry. Proceedings of the National Academy of Sciences.
100. Wagner, A. R. (1978). Expectancies and the priming of STM. In S. H. Hulse, H. Fowler, & W. K. Honig (Eds.), Cognitive processes in animal behavior (pp. 177-209). Hillsdale, NJ: Erlbaum.
101. Wagner, A. R. (2003). Context-sensitive elemental theory. Quarterly Journal of Experimental Psychology, 56B, 7-29. (Pubitemid 37353299)
102. Wagner, A. R. (2008). Evolution of an elemental theory of Pavlovian conditioning. Learning & Behavior, 36, 253-265.
103. Wagner, A. R., & Brandon, S. E. (1989). Evolution of a structured connectionist model of Pavlovian conditioning (AESOP). In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 149-189). Hillsdale, NJ: Erlbaum.
104. Wagner, A. R., & Brandon, S. E. (2001). A componential theory of Pavlovian conditioning. In R. R. Mowrer & S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 23-64). Mahwah, NJ: Erlbaum.
105. Watt, A., & Honey, R. C. (1997). Combining CSs associated with the same or different USs. Quarterly Journal of Experimental Psychology, 50, 350-367. (Pubitemid 127458190)
106. Williams, D. A., Mehta, R., Poworoznyk, T. M., Orihel, J. S., George, D. N., & Pearce, J. M. (2002). Acquisition of superexcitatory properties by an irrelevant background stimulus. Journal of Experimental Psychology: Animal Behavior Processes, 28, 284-297. (Pubitemid 44220043)
107. Zentall, T. R., Steirn, J. N, Sherburne, L. M., & Urcuioli, P. J. (1991). Common coding in pigeons assessed through partial versus total reversals of many-to-one conditional and simple discriminations. Journal of Experimental Psychology: Animal Behavior Processes, 17, 194-201.