Critical evidence for the prediction error theory in associative learning

Scientific Reports

Volumn 5, Issue , 2015, Pages

  Terao, Kanta ^a   Matsumoto, Yukihisa ^a,b   Mizunami, Makoto ^a  

^a HOKKAIDO UNIVERSITY   (Japan)

^b TOKYO MEDICAL AND DENTAL UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; BRAIN; CONDITIONED REFLEX; GRYLLIDAE; HUMAN; LEARNING; PHYSIOLOGY; REWARD;

ANIMALS; BRAIN; CONDITIONING, CLASSICAL; GRYLLIDAE; HUMANS; LEARNING; REWARD;

EID: 84924610483     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep08929     Document Type: Article

References (40)

1. Schultz, W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57, 87-115 (2006).
2. Kamin, L. [Predictability, surprise, attention and conditioning] Punishment and aversive behavior [Campbell, B. A. & Church, R.M. (eds.)] [279-298] (Appleton-Century-Crofts, New York, 1969).
3. Rescorla, R. A.Wagner, A. R. [A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement] Classical Conditioning II [Black, A. & Prokasy,W. R. (eds.)] [64-99] (Academic Press, New York, 1972).
4. Steinberg, E. E. et al. A causal link between prediction errors, dopamine neurons and learning. Nat. Neurosci. 16, 966-973 (2013).
5. Waelti, P., Dickinson, A. & Schultz, W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43-48 (2001).
6. Miller, R. R., Barnet, R. C. & Grahame, N. J. Assessment of the Rescorla-Wagner model. Psychol. Bull. 117, 363-386 (1995).
7. Pearce, J. M. [Associative learning] Animal Learning & Cognition [35-91] (Psychology press, New York, 2008).
8. Mazur, J. E. [Chapter 4: Theories and research on classical conditioning] Learning and behavior [75-100] (Pearson education, Boston, 2013).
9. Mackintosh, N. J. A theory of attention: Variations in the associability of stimuli with reinforcement. Psychol. Rev. 82, 276-298 (1975).
10. Pearce, J. M. & Hall, G. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532-552 (1980).
11. Miller, R. R. & Matzel, L. D. The comparator hypothesis: a response rule for the expression of associations. Psychol. Learn. Motiv. 22, 51-92 (1988).
12. Heisenberg, M. Mushroom body memoir: from maps to models. Nat. Rev. Neurosci. 4, 266-275 (2003).
13. Menzel, R., Leboulle, G. & Eisenhardt, D. Small brains, bright minds. Cell 124, 237-239 (2006).
14. Davis, R. L. Traces of Drosophila memory. Neuron 70, 8-19 (2011).
15. Kandel, E. R. Themolecular biology of memory storage: a dialogue between genes and synapses. Science 294, 1030-1038 (2001).
16. Crow, T. Pavlovian conditioning of Hermissenda: current cellular, molecular, and circuit perspectives. Learn. Mem. 11, 229-38 (2004).
17. Couvillon, P. A. & Arakaki, L. Intramodal blocking in honeybees. Anim. Learn. Behav. 25, 277-282 (1997).
18. Couvillon, P. A., Campos, A. C., Bass, T. D. & Bitterman, M. E. Intermodal blocking in honeybees. Q. J. Exp. Psychol. B. 54, 369-381 (2001).
19. Smith, B. H. & Cobey, S. The olfactory memory of the honeybee Apis mellifera. II. Blocking between odorants in binary mixtures. J. Exp. Biol. 195, 91-108 (1994).
20. Thorn, R. S. & Smith, B. H. The olfactory memory of the honeybee Apis mellifera. III. Bilateral sensory input is necessary for induction and expression of olfactory blocking. J. Exp. Biol. 200, 2045-2055 (1997).
21. Hosler, J. S. & Smith, B. H. Blocking and the detection of odor components in blends. J. Exp. Biol. 203, 2797-2806 (2000).
22. Guerrieri, F., Lachnit, H., Gerber, B. & Giurfa, M. Olfactory blocking and odorant similarity in the honeybee. Learn. Mem. 12, 86-95 (2005).
23. Blaser, R. E., Couvillon, P. A. & Bitterman, M. E. Blocking and pseudoblocking: new control experiments with honeybees. Q. J. Exp. Psychol. 59, 68-76 (2006).
24. Blaser, R. E., Couvillon, P. A. & Bitterman,M. E.Within-subjects experiments on blocking and facilitation in honeybees (Apis mellifera). J. Comp. Psychol. 122, 373-378 (2008).
25. Sahley, C., Rudy, J. W. & Gelperin, A. An analysis of associative learning in a terrestrial mollusc. J. Comp. Physiol. A. 144, 1-8 (1981).
26. Rogers, R. F. Matzel, L. D. Higher-order associative processing in Hermissenda suggests multiple sites of neuronal modulation. Learn. Mem. 2, 279-298 (1996).
27. Acebes, F., Solar, P., Carnero, S. & Loy, I. Blocking of conditioning of tentacle lowering in the snail (Helix aspersa). Q. J. Exp. Psychol. 62, 1315-1327 (2009).
28. Prados, J., et al. Blocking in rats, humans and snails using a within-subjects design. Behav. Process. 100, 23-31 (2013).
29. Mizunami, M., Matsumoto, Y., Watanabe, H. & Nishino, H. [Chapter 41: Olfactory and visual learning in cockroaches and crickets] Invertebrate Learning and Memory, [Menzel, R. & Benjamin, P. R. (eds.)] [547-558] (Springer, Berlin, 2013).
30. Unoki, S., Matsumoto, Y. & Mizunami, M. Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. Eur. J. Neurosci. 22, 1409-1416 (2005).
31. Unoki, S., Matsumoto, Y. & Mizunami, M. Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. Eur. J. Neurosci. 24, 2031-2038 (2006).
32. Nakatani, Y. et al. Why the carrot is more effective than the stick: Different dynamics of punishment memory and reward memory and its possible biological basis. Neurobiol. Learn. Mem. 92, 370-380 (2009).
33. Mizunami, M. et al. Roles of octopaminergic and dopaminergic neurons in appetitive and aversive memory recall in an insect. BMC Biol. 7, 46 (2009).
34. Matsumoto, Y., Hirashima, D. & Mizunami, M. Analysis and modeling of neural processes underlying sensory preconditioning. Neurobiol. Learn. Mem. 101, 103-113 (2013).
35. Roeder, T., Degen, J. & Gewecke, M. Epinastine, a highly specific antagonist of insect neuronal octopamine receptors. Eur. J. Pharmacol. 349, 171-177 (1998).
36. Brembs, B. & Heisenberg, M. Conditioning with compound stimuli in Drosophila melanogaster in the flight simulator. J. Exp. Biol. 204, 2849-2859 (2001).
37. Young, J. M., Wessnitzer, J., Armstrong, J. D. & Webb, B. Elemental and nonelemental olfactory learning in Drosophila. Neurobiol. Learn. Mem. 96, 339-352 (2011).
38. Goel, P. & Gelperin, A. A neuronal network for the logic of Limax learning. J. Comput. Neurosci. 21, 259-270 (2006).
39. Liu, C. et al. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 488, 512-516 (2012).
40. Matsumoto, Y.Mizunami, M. Temporal determinants of long-term retention of olfactory memory in the cricket Gryllus bimaculatus. J. Exp. Biol. 205, 1429-1437 (2002).