An elemental model of retrospective revaluation without within-compound associations

Learning and Behavior

Volumn 42, Issue 1, 2014, Pages 22-38

  Connor, Patrick C ^a   Lolordo, Vincent M ^a   Trappenberg, Thomas P ^a  

^a DALHOUSIE UNIVERSITY   (Canada)

Author keywords

Associative learning; Classical conditioning; Cue competition; Generalization; Retrieval

Indexed keywords

ACTION POTENTIAL; ANIMAL; ARTIFICIAL NEURAL NETWORK; ASSOCIATION; CONDITIONED REFLEX; INHIBITION (PSYCHOLOGY); NERVE CELL; PHYSIOLOGY; PSYCHOLOGICAL MODEL;

ACTION POTENTIALS; ANIMALS; CONDITIONING, CLASSICAL; CUES; INHIBITION (PSYCHOLOGY); MODELS, PSYCHOLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 84899055319     PISSN: 15434494     EISSN: 15434508     Source Type: Journal    
DOI: 10.3758/s13420-013-0112-z     Document Type: Article

References (69)

1. Aitken, M.; Dickinson, A. (2005). Simulations of a modified SOP model applied to retrospective revaluation of human causal learning. Learning & Behavior, 33(2), 147-159.
2. Amundson, J.; Escobar, M.; Miller, R. (2003). Proactive interference between cues trained with a common outcome in first-order pavlovian conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 29(4), 311.
3. Blaisdell, A. P.; Gunther, L. M.; Miller, R. R. (1999). Recovery from blocking achieved by extinguishing the blocking CS. Animal Learning Behavior, 27(1), 63-76.
4. Brandon, S. E.; Wagner, A. R. (1998). Occasion setting: Influences of conditioned emotional responses and configural cues. In N. A. Schmajuk & P. C. Holland (Eds.), Occasion setting: Associative learning and cognition in animals (pp. 343-382). Washington, DC: American Psychological Association.
5. Chapman, G. (1991). Trial order affects cue interaction in contingency judgment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 17(5), 837.
6. Cole, R.; Barnet, R.; Miller, R. (1995). Effect of relative stimulus validity: Learning or performance deficit? Journal of Experimental Psychology: Animal Behavior Processes, 21(4), 293.
7. Cole, R.; Denniston, J.; Miller, R. (1996). Reminder-induced attenuation of the effect of relative stimulus validity. Learning & Behavior, 24(3), 256-265.
8. Connor, P.; Trappenberg, T. (2011). Characterizing a brain-based value-function approximator. In C. Butz & P. Lingras (Eds.), Advances in artificial intelligence (Vol. 6657, pp. 92-103). Springer Berlin Heidelberg.
9. Dawson, M. (2008). Connectionism and classical conditioning. Comparative Cognition and Behavior Reviews, 3, 1-115.
10. Delamater, A. R.; Sosa, W.; Katz, M. (1999). Elemental and configural processes in patterning discrimination learning. The Quarterly Journal of Experimental Psychology: Section B, 52(2), 97-124.
11. Denniston, J.; Miller, R.; Matute, H. (1996). Biological significance as a determinant of cue competition. Psychological Science, 7(6), 325-331.
12. Denniston, J. C.; Savastano, H. I.; Miller, R. R. (2001). The extended comparator hypothesis: Learning by contiguity, responding by relative strength. In R. R. Mowrer & S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 65-117). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
13. Dickinson, A.; Burke, J. (1996). Within-compound associations mediate the retrospective revaluation of causality judgements. The Quarterly Journal of Experimental Psychology Section B, 49(1), 60-80.
14. Dopson, J.; Pearce, J.; Haselgrove, M. (2009). Failure of retrospective revaluation to influence blocking. Journal of Experimental Psychology: Animal Behavior Processes, 35(4), 473.
15. Escobar, M.; Pineño, O.; Matute, H. (2002). A comparison between elemental and compound training of cues in retrospective revaluation. Learning & Behavior, 30(3), 228-238.
16. Espinet, A.; Iraola, J.; Bennett, C.; Mackintosh, N. (1995). Inhibitory associations between neutral stimuli in flavor-aversion conditioning. Animal Learning & Behavior, 23(4), 361-368.
17. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. Journal of Cognitive Neuroscience, 17(1), 51-72.
18. Frank, M. J.; Fossella, J. A. (2011). Neurogenetics and pharmacology of learning, motivation, and cognition. Neuropsychopharmacology: Official publication of the American College of Neuropsychopharmacology, 36(1), 133-152.
19. Ghirlanda, S. (2005). Retrospective revaluation as simple associative learning. Journal of Experimental Psychology. Animal Behavior Processes, 31(1), 107-111.
20. Gruber, A. J.; Powell, E. M.; O'Donnell, P. (2009). Cortically activated interneurons shape spatial aspects of cortico-accumbens processing. Journal of Neurophysiology, 101(4), 1876-1882.
21. Harris, J. A. (2006). Elemental representations of stimuli in associative learning. Psychological Review, 113(3), 584-605.
22. Harris, J. A.; Gharaei, S.; Moore, C. A. (2009). Representations of single and compound stimuli in negative and positive patterning. Learning & Behavior, 37(3), 230-245.
23. Houk, J. C.; Adams, J. L.; Barto, A. G. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In Models of information processing in the basal ganglia (pp. 249-270). MIT Press.
24. Houwer, J. D.; Beckers, T. (2002). Higher-order retrospective revaluation in human causal learning. Quarterly Journal of Experimental Psychology: Section B, 55(2), 137-151.
25. Jamieson, R.; Crump, M.; Hannah, S. (2012). An instance theory of associative learning. Learning & Behavior, 40(1), 61-82.
26. Kasprow, W.; Cacheiro, H.; Balaz, M.; Miller, R. (1982). Reminder-induced recovery of associations to an overshadowed stimulus. Learning and Motivation, 13(2), 155-166.
27. Kasprow, W.; Catterson, D.; Schachtman, T.; Miller, R. (1984). Attenuation of latent inhibition by post-acquisition reminder. The Quarterly Journal of Experimental Psychology, 36(1), 53-63.
28. Kasprow, W.; Schachtman, T. R.; Miller, R. R. (1987). The comparator hypothesis of conditioned response generation: Manifest conditioned excitation and inhibition as a function of relative excitatory strengths of CS and conditioning context at the time of testing. Journal of Experimental Psychology. Animal Behavior Processes, 13(4), 395-406.
29. Kaufman, M. A.; Bolles, R. C. (1981). A nonassociative aspect of overshadowing. Bulletin of the Psychonomic Society, 18(6), 318-320.
30. Kraemer, P.; Lariviere, N.; Spear, N. (1988). Expression of a taste aversion conditioned with an odor-taste compound: Overshadowing is relatively weak in weanlings and decreases over a retention interval in adults. Learning & Behavior, 16(2), 164-168.
31. Kutlu, M.; Schmajuk, N. (2012). Solving pavlov's puzzle: Attentional, associative, and flexible configural mechanisms in classical conditioning. Learning & Behavior, 40(3), 269-291.
32. Le Pelley, M. E. (2004). The role of associative history in models of associative learning: A selective review and a hybrid model. The Quarterly Journal of Experimental Psychology Section B, 57(3), 193-243.
33. Le Pelley, M. E.; McLaren, I. P. L. (2001). Retrospective revaluation in humans: Learning or memory? The Quarterly Journal of Experimental Psychology Section B, 54(4), 311-352.
34. Liljeholm, M.; Balleine, B. W. (2006). Stimulus salience and retrospective revaluation. Journal of Experimental Psychology: Animal Behavior Processes, 32(4), 481-487.
35. Liljeholm, M.; Balleine, B. W. (2009). Mediated conditioning versus retrospective revaluation in humans: The influence of physical and functional similarity of cues. The Quarterly Journal of Experimental Psychology, 62(3), 470-482.
36. Lysle, D. T.; Fowler, H. (1985). Inhibition as a "slave" process: Deactivation of conditioned inhibition through extinction of conditioned excitation. Journal of Experimental Psychology. Animal Behavior Processes, 11(1), 71-94.
37. Matzel, L. D.; Schachtman, T.; Miller, R. R. (1985). Recovery of an overshadowed association achieved by extinction of the overshadowing stimulus. Learning and Motivation, 16, 398-412.
38. McLaren, I.; Forrest, C.; McLaren, R. (2012). Elemental representation and configural mappings: Combining elemental and configural theories of associative learning. Learning & Behavior, 40(3), 320-333.
39. McLaren, I. P. L. (1993). APECS: A solution to the sequential learning problem. In Proceedings of the xvth annual convention of the cognitive science society (pp. 717-722).
40. McLaren, I. P. L. (2011). APECS: An adaptively parameterised model of associative learning and memory. In E. Alonso & E. Mondragon (Eds.), Computational neuroscience for advancing artificial intelligence: Models, methods and applications (pp. 145-164). Hershey: IGI Global.
41. Melchers, K.; Lachnit, H.; Shanks, D. (2004). Within-compound associations in retrospective revaluation and in direct learning: A challenge for comparator theory. Quarterly Journal of Experimental Psychology Section B, 57(1), 25-54.
42. Miller, R. R.; Barnet, R.; Grahame, N. (1992). Responding to a conditioned stimulus depends on the current associative status of other cues present during training of that specific stimulus. Journal of Experimental Psychology: Animal Behavior Processes; Journal of Experimental Psychology: Animal Behavior Processes, 18(3), 251.
43. Miller, R. R.; Matzel, L. D. (1988). The comparator hypothesis: A response rule for the expression of associations. Psychology of Learning and Motivation, 22, 51-92.
44. Pan, W.; Schmidt, R.; Wickens, J.; Hyland, B. (2008). Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. The Journal of Neuroscience, 28(39), 9619-9631.
45. Pineño, O.; Urushihara, K.; Miller, R. R. (2005). Spontaneous recovery from forward and backward blocking. Journal of experimental psychology Animal behavior processes, 31(2), 172-183.
46. Plenz, D. (2003). When inhibition goes incognito: Feedback interaction between spiny projection neurons in striatal function. Trends in Neurosciences, 26(8), 436-443.
47. Redhead, E. S.; Pearce, J. M. (1995). Stimulus salience and negative patterning. The Quarterly Journal of Experimental Psychology, 48(1), 67-83.
48. Rescorla, R. A.; Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton Century Crofts.
49. Reynolds, J.; Wickens, J. (2002). Dopamine-dependent plasticity of corticostriatal synapses. Neural Networks, 15(4-6), 507-521.
50. Rueda-Orozco, P. E.; Mendoza, E.; Hernandez, R.; Aceves, J. J.; Ibanez-Sandoval, O.; Galarraga, E.; Connor, P. C.; LoLordo, V. M.; Trappenberg, T. P. (2009). Diversity in long-term synaptic plasticity at inhibitory synapses of striatal spiny neurons. Learning & Memory, 16(8), 474-478.
51. Schachtman, T.; Gee, J.; Kasprow, W.; Miller, R. (1983). Reminder-induced recovery from blocking as a function of the number of compound trials. Learning and Motivation, 14(2), 154-164.
52. Schultz, W.; Dayan, P.; Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593-1599.
53. Shanks, D. (1985). Forward and backward blocking in human contingency judgement. The Quarterly Journal of Experimental Psychology Section B, 37(1), 1-21.
54. Shen, W.; Flajolet, M.; Greengard, P.; Surmeier, D. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science, 321(5890), 848-851.
55. Shevill, I.; Hall, G. (2004). Retrospective revaluation effects in the conditioned suppression procedure. Quarterly Journal of Experimental Psychology Section B, 57(4), 331-347.
56. Stout, S. C.; Miller, R. R. (2007). Sometimes-competing retrieval (SOCR): A formalization of the comparator hypothesis. Psychological Review, 114(3), 759.
57. Taverna, S.; Ilijic, E.; Surmeier, D. J. (2008). Recurrent collateral connections of striatal medium spiny neurons are disrupted in models of Parkinson's disease. Journal of Neuroscience, 28(21), 5504-5512.
58. Tepper, J. M.; Wilson, C. J.; Koos, T. (2008). Feedforward and feedback inhibition in neostriatal GABAergic spiny neurons. Brain Research Reviews, 58(2), 272-281.
59. Tunstall, M. J.; Oorschot, D. E.; Kean, A.; Wickens, J. R. (2002). Inhibitory interactions between spiny projection neurons in the rat striatum. Journal of Neurophysiology, 88(3), 1263-1269.
60. Urcelay, G.; Perelmuter, O.; Miller, R. (2008). Pavlovian backward conditioned inhibition in humans: Summation and retardation tests. Behavioural Processes, 77(3), 299-305.
61. Usher, M.; McClelland, J. (2001). The time course of perceptual choice: The leaky, competing accumulator model. Psychological Review, 108(3), 550.
62. Van Hamme, L.; Wasserman, E. A. (1994). Cue competition in causality judgments: The role of nonpresentation of compound stimulus elements. Learning and Motivation, 25(2), 127-151.
63. Wagner, A. R. (1981). SOP: A model of automatic memory processing in animal behavior. In N. E. Spears & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms (pp. 5-47). Hillsdale, NJ: Earlbaum.
64. Wagner, A. R. (2003). Context-sensitive elemental theory. The Quarterly Journal of Experimental Psychology: Section B, 56(1), 7-29.
65. Wagner, A. R.; Brandon, S. E. (2001). A componential theory of Pavlovian conditioning. In R. R. Mowrer & S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 23-64). Mahwah, NJ: Earlbaum.
66. Wasserman, E.; Berglan, L. (1998). Backward blocking and recovery from overshadowing in human causal judgement: The role of within-compound associations. The Quarterly Journal of Experimental Psychology Section B, 51(2), 121-138.
67. Witnauer, J. E.; Miller, R. R. (2011). The role of within-compound associations in learning about absent cues. Learning & Behavior, 39(2), 146-162.
68. Woodbury, C. B. (1943). The learning of stimulus patterns by dogs. Journal of Comparative Psychology, 35, 29-40.
69. Yung, K. K.; Smith, A. D.; Levey, A. I.; Bolam, J. P. (1996). Synaptic connections between spiny neurons of the direct and indirect pathways in the neostriatum of the rat: Evidence from dopamine receptor and neuropeptide immunostaining. The European Journal of Neuroscience, 8(5), 861-869.