Why the carrot is more effective than the stick: Different dynamics of punishment memory and reward memory and its possible biological basis

Neurobiology of Learning and Memory

Volumn 92, Issue 3, 2009, Pages 370-380

  Nakatani, Yoshihiro ^a   Matsumoto, Yukihisa ^a   Mori, Yasuhiro ^a   Hirashima, Daisuke ^a   Nishino, Hiroshi ^b   Arikawa, Kentaro ^c   Mizunami, Makoto ^a  

^a TOHOKU UNIVERSITY   (Japan)

^b HOKKAIDO UNIVERSITY   (Japan)

^c GRADUATE UNIVERSITY FOR ADVANCED STUDIES   (Japan)

Author keywords

Dopamine; Human; Insect; Memory dynamics; Octopamine; Reinforcement

Indexed keywords

ALPHA ADRENERGIC RECEPTOR; DOPAMINE RECEPTOR; OCTOPAMINE RECEPTOR; UNCLASSIFIED DRUG;

ANIMAL EXPERIMENT; ARTICLE; COLOR DISCRIMINATION; CONDITIONING; CONTROLLED STUDY; GRYLLUS BIMACULATUS; INSECT; LEARNING; MALE; MEMORY; MEMORY CONSOLIDATION; NONHUMAN; OLFACTORY MEMORY; PATTERN RECOGNITION; REINFORCEMENT; REWARD; SIGNAL TRANSDUCTION; VISUAL MEMORY;

ANIMALS; ASSOCIATION LEARNING; COLOR; CONDITIONING, CLASSICAL; DOPAMINE ANTAGONISTS; GRYLLIDAE; LEARNING; MALE; MEMORY; MODELS, ANIMAL; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; PUNISHMENT; RECEPTORS, BIOGENIC AMINE; REWARD; SEROTONIN ANTAGONISTS; TIME FACTORS;

EID: 69249184036     PISSN: 10747427     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.nlm.2009.05.003     Document Type: Article

References (51)

1. Baumrind D., Larzelere R.E., and Cowan P.A. Ordinary physical punishment; Is it harmful?. Psychological Bulletin 128 (2002) 580-589
2. Chittka L., and Wells H. Color vision in bees: Mechanisms, ecology and evolution. In: Prete F. (Ed). Complex worlds from simpler nervous systems (2004), MIT press, Cambridge 165-192
3. Daw N.D., Kakade S., and Dayan P. Opponent interactions between serotonin and dopamine. Neural Network 15 (2002) 603-616
4. Degen J., Gewecke M., and Roeder T. The pharmacology of a dopamine receptor in the locust nervous tissue. The European Journal of Pharmacology 396 (2000) 59-65
5. Degen J., Gewecke M., and Roeder T. Octopamine receptors in the honey bee and locust nervous system: Pharmacological similarities between homologous receptors of distantly related species. British Journal of Pharmacology 130 (2000) 587-594
6. Davis R.L. Olfactory memory formation in Drosophila: From molecular to systems neuroscience. Annual Review of Neuroscience 28 (2005) 275-302
7. Domjan M. The essentials of conditioning and learning (2005), Wadsworth, Belmont
8. Driscoll M.P. Psychology of learning for instruction (2005), Pearson, Boston
9. Farooqui T., Robinson K., Vaessin H., and Smith B.H. Modulation of early olfactory processing by an octopaminergic reinforcement pathway in the honeybee. The Journal of Neuroscience 23 (2003) 5370-5380
10. Frisch V.K. The dance language and orientation of bees (1967), Harvard University Press, Cambridge
11. Garcia J., Hankins W.G., and Rusiniak K.W. Behavioral regulation of the milieu interne in man and rat. Science 185 (1974) 824-831
12. Gershoff E.T. Corporal punishment by parents and associated child behaviors and experiences: A meta-analytic and theoretical review. Psychological Bulletin 128 (2002) 539-579
13. Gershoff, E.T. (2002b). Corporal punishment, physical abuse, and the burden of proof: Reply to Baumrind Larzelere, and Cowan (2002), Holden (2002), and Parke (2002). Psychological Bulletin 128, 602-611.
14. Giurfa M. Cognitive neuroethology: Dissecting non-elemental learning in a honeybee brain. Current Opinion in Neurobiology 13 (2003) 1-10
15. Gould J.L., and Gould C.G. The honey bee (1988), Scientific American Library, New York
16. Harley C.W. Norepinephrine and dopamine as learning signals. Neural Plasticity 11 (2004) 1-14
17. Hammer M. An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees. Nature 366 (1993) 59-63
18. Hammer M., and Menzel R. Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learning and Memory 5 (1998) 146-156
19. Heisenberg M. Mushroom body memoir: From maps to models. Nature Reviews Neuroscience 4 (2003) 266-275
20. Holden G.W. Perspectives on the effects of corporal punishment: Comment on Gershoff (2002). Psychological Bulletin 128 (2002) 590-595
21. Homberg U. Neurotransmitters and neuropeptides in the brain of the locust. Microscopic Research Techniques 56 (2002) 189-209
22. Honjo K., and Furukubo-Tokunaga K. Distinctive neuronal networks and biochemical pathways for appetitive and aversive memory in Drosophila larvae. Journal of Neuroscience 29 (2009) 852-862
23. Kim Y.C., Lee H.G., and Han K.A. D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. The Journal of Neuroscience 27 (2007) 7640-7647
24. Kinoshita M., Shimada N., and Arikawa K. Colour vision of the foraging swallowtail butterfly Papilio xuthus. The Journal of Experimental Biology 202 (1999) 95-102
25. Liu G., Seiler H., Wen A., Zars T., Ito K., Wolf R., et al. Distinct memory traces for two visual features in the Drosophila brain. Nature 439 (2006) 551-556
26. Lieberman D.A. Learning and memory: An integrative approach (2004), Wardsworth, Belmont
27. Matsumoto Y., and Mizunami M. Temporal determinants of long-term retention of olfactory memory in the cricket Gryllus bimaculatus. The Journal of Experimental Biology 205 (2002) 1429-1437
28. Matsumoto Y., Noji S., and Mizunami M. Time course of protein synthesis-dependent phase of olfactory memory in the cricket Gryllus bimaculatus. Zoological Science 20 (2003) 409-416
29. Matsumoto Y., Unoki S., Aonuma H., and Mizunami M. Nitric oxide-cGMP cascade is critical for cAMP-dependent long-term memory formation. Learning and Memory 13 (2006) 35-44
30. Menzel R. Memory dynamics in the honeybee. The Journal of Comparative Physiology Part A 185 (1999) 323-340
31. Menzel R., and Giurfa M. Dimensions of cognition in an insect, the honeybee. Behavioral and Cognitive Neuroscience Reviews 5 (2006) 24-40
32. Menzel R., and Backhaus W. Color vision in honey bees: Phenomena and physiological mechanisms. In: Stavenga D.G., and Hardie R.C. (Eds). Facets of vision (1989), Springer, Berlin 281-297
33. Müller U. Prolonged activation of cAMP-dependent protein kinase during conditioning induces long-term memory in honeybees. Neuron 27 (2000) 159-168
34. Mustard J.A., Blenau W., Hamilton I.S., Ward V.K., Ebert P.R., and Mercer A.R. Analysis of two D1-like dopamine receptors from the honey bee Apis mellifera reveals agonist-independent activity. Molecular Brain Research 113 (2003) 67-77
35. Peine H.A., and Howarth R. Children and parents (1975), Penguin Books, Boltimore
36. Riemensperger T., Voller T., Stock P., Buchner E., and Fiala A. Punishment prediction by dopaminergic neurons in Drosophila. Current Biology 15 (2005) 1953-1960
37. Roeder T., Degen J., and Gewecke M. Epinastine, a highly specific antagonist of insect neuronal octopamine receptors. The European Journal of Pharmacology 349 (1998) 171-177
38. Saifullah A.S., and Tomioka K. Serotonin sets the day state in the neurons that control coupling between the optic lobe circadian pacemakers in the cricket Gryllus bimaculatus. The Journal of Experimental Biology 205 (2002) 1305-1314
39. Schwaerzel M., Monastirioti M., Scholz H., Friggi-Grelin F., Birman S., and Heisenberg M. Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. The Journal of Neuroscience 23 (2003) 10495-10502
40. Schroll C., Riemensperger T., Bucher D., Ehmer J., Voller T., Erbguth K., et al. Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Current Biology 16 (2006) 1741-1747
41. Schultz W. Behavioral dopamine signals. Trends in Neuroscience 3 (2007) 203-210
42. Sinakevitch I., Niwa M., and Strausfeld N.J. Octopamine-like immunoreactivity in the honey bee and cockroaches: comparative organization in the brain and subesophageal ganglion. The Journal of Comparative Neurology 488 (2005) 233-254
43. Sitaraman D., Zars M., Laferriere H., Chen Y.C., Sable-Smith A., Kitamoto T., et al. Serotonin is necessary for place memory in Drosophila. Proceedings of the National Academy of Science USA 105 (2008) 5579-5584
44. Solomon S.G., and Lennie P. The machinery of colour vision. Nature Reviews Neuroscience 8 (2007) 276-286
45. Tempel B.L., Bonini N., Dawson D.R., and Quinn W.G. Reward learning in normal and mutant Drosophila. Proceedings of the National Academy of Science USA 80 (1983) 1482-1486
46. Unoki S., Matsumoto Y., and Mizunami M. Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. The European Journal of Neuroscience 22 (2005) 1409-1416
47. Unoki S., Matsumoto Y., and Mizunami M. Roles of octopaminargic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. The European Journal of Neuroscience 24 (2006) 2031-2038
48. Vergoz V., Roussel E., Sandoz J., and Giurfa M. Aversive learning in honeybees revealed by the olfactory conditioning of the sting extension reflex. PLoS ONE 2 (2007) e288
49. Walters G.C., and Crusec J.E. Punishment (1977), Freeman, San Francisco
50. Wise R.A. Dopamine, learning and motivation. Nature Reviews Neuroscience 5 (2004) 483-494
51. Zufall F., Schmitt M., and Menzel R. Spectral and polarized sensitivity of photoreceptors in the compound eye of the cricket (Gryllus bimaculatus). The Journal of Comparative Physiology Part A 164 (1989) 597-608