The roles of dopamine and related compounds in reward-seeking behavior across animal phyla

Frontiers in Behavioral Neuroscience

Volumn 4, Issue OCT, 2010, Pages

  Barron, Andrew B ^a   Søvik, Eirik ^a   Cornish, Jennifer L ^a  

^a MACQUARIE UNIVERSITY   (Australia)

Author keywords

Biogenic amine; Catecholamine; Dopamine; Motivation; Nucleus accumbens; Octopamine; Reward

Indexed keywords

EID: 83755169947     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2010.00163     Document Type: Review

References (109)

1. Alcaro, A., Huber, R., and Panksepp, J. (2007). Behavioral functions of the mesolimbic dopaminergic system: an affective neuroethological perspective. Brain Res. Rev. 56, 283-321.
2. Andretic, R., van Swinderen, B., and Greenspan, R. J. (2005). Dopaminergic modulation of arousal in Drosophila. Curr. Biol. 15, 1165-1175.
3. Barron, A. B., Maleszka, R., Van Der Meer, R. K., and Robinson, G. E. (2007). Octopamine modulates honey bee dance behavior. Proc. Natl. Acad. Sci. U.S.A. 104, 1703-1707.
4. Beggs, K. T., Glendining, K. A., Marechal, N. M., Vergoz, V., Nakamura, I., Slessor, K. N., and Mercer, A. R. (2007). Queen pheromone modulates brain dopamine function in worker honey bees. Proc. Natl. Acad. Sci. U.S.A. 2460-2464.
5. Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28, 309-369.
6. Berridge, K. C., Robinson, T. E., and Aldridge, J. W. (2009). Dissecting components of reward: 'liking', 'wanting', and learning. Curr. Opin. Pharmcol. 9, 65-73.
7. Best, J. B., and Rubinstein, I. (1962). Maze learning and associated behavior in planaria. J. Comp. Psychol. 55, 560-566.
8. Bitterman, M. E., Menzel, R., Fietz, A., and Schäfer, S. (1983). Classical conditioning of proboscis extension in honeybees Apis mellifera. J. Comp. Physiol. 97, 107-119.
9. Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., and Byrne, J. H. (2002). Operant reward learning in Aplysia: neuronal correlates and mechanisms. Science 296, 1706-1709.
10. Burchett, S. A., and Hicks, T. P. (2006). The mysterious trace amines: protean neuromodulators of synaptic transmission in mammalian brain. Prog. Neurobiol. 79, 223-246.
11. Burrows, M. (1996). The Neurobiology of an Insect Brain. Oxford: Oxford University Press.
12. Buttarelli, F. R., Pellicano, C., and Pontieri, F. E. (2008). Neuropharmacology and behavior in planarians: translations to mammals. Comp. Biochem. Physiol. 147, 399-408.
13. Buttarelli, F. R., Pontieri, F. E., Margotta, V., and Palladini, G. (2000). Acetylcholine/dopamine interaction in planaria. Comp. Biochem. Physiol. 125, 225-231.
14. Carlezon, W. A., and Chartoff, E. H. (2007). Intracranial self-stimulation (ICSS) in rodents to study the neurobiology of motivation. Nat. Protoc. 2, 2987-2995.
15. Carroll, S. B. (2005). Endless Forms Most Beautiful: The New Science of Evo Devo. New York: W.W. Norton.
16. Chung, J.-M., and Spencer, A. N. (1996). Effect of dopamine on a voltage-gated ion channel in a jellyfish motor neuron. J. Biochem. Mol. Biol. 29, 151-155.
17. Claridge-Chang, A., Roorda, R. D., Vrontou, E., Sjulson, L., Li, H., Hirsh, J., and Miesenböck, G. (2009). Writing memories with light-addressable reinforcement circuitry. Cell 139, 405-415.
18. de Belle, J. S., and Heisenberg, M. (1994). Associative odor learning in Drosophila abolished by chemical ablation of mushroom bodies. Science 263, 692-695.
19. Diaconescu, A. O., Menon, M., Jensen, J., Kapur, S., and McIntosh, A. R. (2010). Dopamine-induced changes in neural network patterns supporting aversive conditioning. Brain Res. 1313, 143-161.
20. Dubnau, J., Chiang, A. S., and Tully, T. (2003). Neural substrates of memory: From synapse to system. J. Neurobiol. 54, 238-253.
21. Esch, T., and Kristan, W. B. (2001). How the leech decides to swim or crawl. Am. Zool. 41, 1438.
22. Esch, T., and Kristan, W. B. (2002). Decision-making in the leech nervous systern. Integr. Comp. Biol. 42, 716-724.
23. Evans, P. D., and Maqueira, B. (2003). Insect octopamine receptors: a new classification scheme based on studies of cloned Drosophila G-protein coupled receptors. Invert. Neurosci. 2005, 111-118.
24. Fadok, J. P., Dickerson, T. M. K., and Palmiter, R. D. (2009). Dopamine is necessary for cue-dependent fear conditioning. J. Neurosci. 29, 11089-11097.
25. Farooqui, T., Robinson, K., Vaessin, H., and Smith, B. H. (2003). Modulation of early olfactory processing by an octopaminergic reinforcement pathway in the honeybee. J. Neurosci. 23, 5370-5380.
26. Farris, S. M. (2008). Evolutionary convergence of higher brain centers spanning the Protostome-Deuterostome boundary. Brain Behav. Evol. 72, 106-122.
27. Fernald, R. D. (2006). Casting a genetic light on the evolution of eyes. Science 313, 1914-1918.
28. Fitzpatrick, M.J., and Sokolowski, M.B. (2004). In search of food: exploring the evolutionary link between cGMP-dependent protein kinase (PKG) and behaviour. Integr. Comp. Biol. 44, 28-36.
29. Friesen, W. O., and Kristan, W. B. (2007). Leech locomotion: swimming, crawling, and decisions. Curr. Opin. Neurobiol. 17, 704-711.
30. Grillner, S., Deliagina, T. O. E., el Manira, A., Hill, R. H., Lansner, A., Orlovsky, G. N., and Wallén, P. (1995). Neural networks that co-ordinate locomotion and body orientation in lamprey. Trends Neurosci. 18, 270-279.
31. Hammer, M. (1993). An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees. Nature 366, 59-63.
32. Hammer, M. (1997). The neural basis of associative reward learning in honeybees. Trends Neurosci. 20, 245-252.
33. Hammer, M., and Menzel, R. (1998). Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learn. Mem. 5, 146-156.
34. Hanai, K., and Kitajima, M. (1984). Two types of surface amine receptors modulating the feeding response in Hydra japonica: the depressing action of dopamine and related amines. Chem. Senses 9, 355-367.
35. Heisenberg, M. (1998). What do the mushroom bodies do for the insect brain? An introduction. Learn. Mem. 5, 1-10.
36. Hills, T., Brockie, P. J., and Maricq, A. V. (2004). Dopamine and glutamate control area-restricted search behavior in Caenorhabditis elegans. J. Neurosci. 24, 1217-1225.
37. Hills, T. T. (2006). Animal foraging and the evolution of goal-directed cognition. Cogn. Sci. 30, 3-41.
38. Hollerman, J. R., and Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1, 304-309.
39. Honjo, K., and Furukubo-Tokunaga, K. (2009). Distinctive neuronal networks and biochemical pathways for appetitive and aversive memory in Drosophila larvae. J. Neurosci. 29, 852-862.
40. Ikemoto, S., and Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Rev. 31, 6-41.
41. Jordan, L. M., Liu, J., Hedlund, P. B., Akay, T., and Pearson, K. G. (2008). Descending command systems for the initiation of locomotion in mammals. Brain Res. Rev. 57, 183-191.
42. Kabotyanski, E. A., Baxter, D. A., Cushman, S. J., and Byrne, J. H. (2000). Modulation of fictive feeding by dopamine and serotonin in Aplysia. J. Neurophysiol. 83, 374-392.
43. Kaczer, L., and Maldonado, H. (2009). Contrasting role of octopamine in appetitive and aversive learning in the crab Chasmagnathus. PLoS ONE 4, e6223. doi: 10.1371/journal.pone.0006223.
44. Kaira, S. P. (1997). Appetite and body weight regulation: is it all in the brain? Neuron 19, 227-230.
45. Kandel, E. R. (2006). Search of Memory: the Emergence of a New Science of Mind. New York: W.W. Norton and Company.
46. Kass-Simon, G., and Pierobon, P. (2007). Cnidarian chemical neurotransmission, an updated overview. Comp. Biochem. Physiol. A 146, 9-25.
47. Kim, Y.-C., Lee, H.-G., and Han, K.-A. (2007). D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. J. Neurosci. 27, 7640-7647.
48. Kim, Y. C., Lee, H. G., Seong, C. S., and Han, K. A. (2003). Expression of a D1 dopamine receptor dDA1/DmDOP1 in the central nervous system of Drosophila melanogaster. Gene Expr. Patterns 3, 237-245.
49. Koob, G. F., and Le Moal, M. (1997). Drug abuse: hedonic homeostatic dysregulation. Science 278, 52-58.
50. Krashes, M. J., DasGupta, S., Vreede, A., White, B., Armstrong, J. D., and Waddell, S. (2009). A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell 139, 416-427.
51. Krashes, M. J., Keene, A. C., Leung, B., Armstrong, J. D., and Waddell, S. (2007). Sequential use of mushroom body neuron subsets during Drosophila odor memory processing. Neuron 53, 103-115.
52. Krashes, M. J., and Waddell, S. (2008). Rapid consolidation to a radish and protein synthesis-dependent long-term memory after single-session appetitive olfactory conditioning in Drosophila. J. Neurosci. 28, 3103-3113.
53. Kravitz, E. A. (2000). Serotonin and aggression: insights gained from a lobster model system and speculations on the role of amine neurons in a complex behavior. J. Comp. Physiol. A 186, 221-238.
54. Kume, K., Kume, S., Park, S. K., Hirsh, J., and Jackson, R. F. (2005). Dopamine is a regulator of arousal in the fruit fly. J. Neurosci. 25, 7377-7384.
55. Kusayama, T., and Watanabe, S. (2000). Reinforcing effects of methamphetamine in planarians. Neuroreport 11, 2511-2513.
56. Kuwabara, M. (1957). Bildung des bedingten Reflexes von Pavlovs Typusbei der Honigbiene, Apis mellifica. J. Fac. Sci. Hokkaido Univ. Ser. VI Zool. 13, 458-464.
57. Lechner, H. A., Baxter, D. A., and Byrne, J. H. (2000a). Classical conditioning of feeding in Aplysia: I. Behavioral analysis. J. Neurosci. 20, 3369-3376.
58. Lechner, H. A., Baxter, D. A., and Byrne, J. H. (2000b). Classical conditioning of feeding in Aplysia: II. Neurophysiological correlates. J. Neurosci. 20, 3377-3386.
59. Lorenz, K. Z. (1965). Evolution and Modification of Behaviour. Chicago: University of Chicago Press.
60. Mallatt, J., Craig, C. W., and Yoder, M. J. (2010). Nearly complete rRNA genes assembled from across the metazoan animals: effects of more taxa, a structure-based alignment, and paired-sites evolutionary models on phylogeny reconstruction. Mol. Phylogenet. Evol. 55, 1-17.
61. Maqueira, B., Chatwin, H., and Evans, P. D. (2005). Identification and characterization of a novel family of Drosophila beta-adrenergic-like octopamine G-protein coupled receptors. J. Neurochem. 94, 547-560.
62. Margulies, C., Tully, T., and Dubnau, J. (2005). Deconstructing memory in Drosophila. Curr. Biol. 15, R700-R713.
63. Menzel, R. (2001). Searching for the memory trace in a mini-brain, the honeybee. Learn. Mem. 8, 53-62.
64. Mercer, A. R., and Menzel, R. (1982). The effects of biogenic amines on conditioned and unconditioned responses to olfactory stimuli in the honeybee Apis mellifera. J. Comp. Physiol. A 145, 363-368.
65. Mizunami, M., Unoki, S., Mori, Y., Hirashima, D., Hatano, A., and Matsumoto, Y. (2009). Roles of octopaminergic and dopaminergic neurons in appetitive and aversive memory recall in an insect. BMC Biol. 7, 46. doi: 10.1186/1741-7007-7-46.
66. Monastirioti, M., Linn, C. E., and White, K. (1996). Characterization of Drosophila tyramine beta-hydroxylase gene and isolation of mutant flies lacking octopamine. J. Neurosci. 16, 3900-3911.
67. Monti, J. M., and Monti, D. (2007). The involvement of dopamine in the modulation of sleep and waking. Sleep Med. Rev. 11, 113-133.
68. Pavlova, G. A. (2001). Effects of serotonin, dopamine and ergometrine on locomotion in the pulmonate mollusc Helix lucorum. J. Exp. Biol. 204, 1625-1633.
69. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., and Frith, C. D. (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442, 1042-1045.
70. Pfluger, H. J., and Stevenson, P. A. (2005). Evolutionary aspects of octopaminergic systems with emphasis on arthropods. Arthropod Struct. Dev. 34, 379-396.
71. Pichaud, F., and Desplan, C. (2002). Pax genes and eye organogenesis. Curr. Opin. Genet. Dev. 12, 430-434.
72. Pruessner, J. C., Champagne, F., Meaney, M. J., and Dagher, A. (2004). Dopamine release in response to a psychological stress in humans and its relationship to early life maternal care: a positron emission tomography study using [11C]raclopride. J. Neurosci. 24, 2825-2831.
73. Qin, J., and Wheeler, A. R. (2007). Maze exploration and learning in C. elegans. Lab Chip 7, 186-192.
74. Raffa, R. B., Holland, L. J., and Schulingkamp, R. J. (2001). Quantitative assessment of dopamine D2 antagonist activity using invertebrate (Planaria) locomotion as a functional endpoint. J. Pharmacol. Toxicol. Methods 45, 223-226.
75. Rescorla, R., and Wagner, A. (1972). "A theory of pavlovian conditioning: variations in the effectiveness of reinforcment and nonreinforcement, " in Classical Conditioning II: Current Theory And Research, eds A. Black, and W. Prokasy (New York: Appleton-Century-Crofts), 64-99.
76. Reyes, F. D., Mozzachiodi, R., Baxter, D. A., and Byrne, J. H. (2005). Reinforcement in an in vitro analog of appetitive classical conditioning of feeding behavior in Aplysia: blockade by a dopamine antagonist. Learn. Mem. 12, 216-220.
77. Rivard, L., Srinivasan, J., Stone, A., Ochoa, S., Sternberg, P. W., and Loer, C. M. (2010). A comparison of experience-dependent locomotory behaviors and biogenic amine neurons in nematode relatives of Caenorhabditis elegans. BMC Neurosci. 11, 22. doi: 10.1186/1471-2202-11-22.
78. Roeder, T. (2005). Tyramine and octopamine: ruling behavior and metabolism. Annu. Rev. Entomol. 50, 447-477.
79. Roeder, T., Seifert, M., Kahler, C., and Gewecke, M. (2003). Tyramine and octopamine: antagonistic modulators of behavior and metabolism. Arch. Insect Biochem. Physiol. 54, 1-13.
80. Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., and Carelli, R. M. (2004). Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 24, 1265-1271.
81. Roitman, M. F., Wheeler, R. A., Wightman, R. M., and Carelli, R. M. (2008). Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat. Neurosci. 11, 1376-1377.
82. Routtenberg, A., and Lindy, J. (1965). Effects of availability of rewarding septal and hypothalmic stimulation on bar pressing for food under conditions of deprivation. J. Comp. Physiol. 60, 158-161.
83. Sawin, E. R., Ranganathan, R., and Horvitz, H. R. (2000). C. elegans locomotory rate is modulated by the environment through a dopaminergic pathway and by experience through a serotonergic pathway. Neuron 26, 619-631.
84. Scheiner, R., Plückhahn, S., Öney, B., Blenau, W., and Erber, J. (2002). Behavioural pharmacology of octopamine, tyramine and dopamine in honey bees. Behav. Brain Res. 136, 545-553.
85. Schroeter, U., Malun, D., and Menzel, R. (2007). Innervation pattern of suboesophageal ventral unpaired median neurones in the honeybee brain. Cell Tissue Res. 327, 647-667.
86. Schroll, C., Riemensperger, T., Bucher, D., Ehmer, J., Völler, T., Erbguth, K., Gerber, B., Hendel, T., Nagel, G., Buchner, E., and Fiala, A. (2006). Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Curr. Biol. 16, 1741-1747.
87. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
88. Schultz, W. (2000). Multiple reward signals in the brain. Nat. Rev. Neurosci. 1, 199-207.
89. Schultz, W. (2001). Reward signaling by dopamine neurons. Neuroscientist. 7, 293-302.
90. Schultz, W. (2007). Behavioral dopamine signals. Trends Neurosci. 30, 203-210.
91. Schultz, W., Apicella, P., and Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13, 900-913.
92. Schulz, D. J., Barron, A. B., and Robinson, G. E. (2002). A role for octopamine in honey bee division of labor. Brain Behav. Evol. 60, 350-359.
93. Schwaerzel, M., Monastirioti, M., Scholz, H., Friggi-Grelin, F., Birman, S., and Heisenberg, M. (2003). Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. J. Neurosci. 23, 10495-10502.
94. Selcho, M., Pauls, D., Han, K.-A., Stocker, R. F., and Thum, A. S. (2009). The role of dopamine in Drosophila larval classical olfactory conditioning. PLoS ONE 4, e5897. doi: 10.1371/journal.pone.0005897.
95. Shafer, J. N., and Corman, C. D. (1963). Response of planaria to shock. J. Comp. Psychol. 56, 601-603.
96. Sherrington, C. S. (1906). Integrated Action of the Nervous System. Cambridge: Cambridge University Press.
97. Skinner, B. F. (1938). The Behavior of Organisms: an Experimental Analysis. New York: Appleton-Century-Crofts.
98. Tatemoto, K., Carlquist, M., and Mutt, V. (1982). Neuropepide Y-a novel brain peptide with structural similarities to peptide YY and pancreatic polypeptide. Nature 296, 659-660.
99. Taylor, R. J., and Robbins, T. W. (1984). Enhanced behavioral control by conditioned reinforcers produced by intracerebral injetions of d-amphetamine in the rat. Psychopharmacology 84, 405-412.
100. Taylor, R. J., and Robbins, T. W. (1986). 6-hydroxydopamine lesions of the nucleus accumbens but not the caudate nucleus attenuate enhanced responding with conditioned reinforcement produced by intra-accumbens amphetamine. Psychopharmacology 90, 310-317.
101. Tinbergen, N. (1951). The Study of Instinct. New York: Oxford University Press.
102. Toth, A. L., and Robinson, G. E. (2007). Evo-devo and the evolution of social behavior. Trends Genet. 23, 334-341.
103. Unoki, S., Matsumoto, Y., and Mizunami, M. (2005). Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. Eur. J. Neurosci. 22, 1409-1416.
104. Unoki, S., Matsumoto, Y., and Mizunami, M. (2006). Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. Eur. J. Neurosci. 24, 2031-2038.
105. Vergoz, V., Roussel, E., Sandoz, J. C., and Giurfa, M. (2007). Aversive learning in honeybees revealed by the olfactory conditioning of the sting extension reflex. PLoS ONE 2, e288. doi: 210.1371/journal.pone.0000288.
106. Watson, K. K., and Platt, M. L. (2008). Neuroethology of reward and decision making. Phil Trans. R. Soc. Lond. B 363, 3825-3835.
107. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494.
108. Wise, R. A., and Rompre, P. P. (1989). Dopamine and reward. Annu. Rev. Psychol. 40, 191-225.
109. Wise, R. A., and Schwartz, H. V. (1981). Pimozide attenuates aquisition of lever pressing for food in rats. Pharmacol. Biochem. Behav. 15, 655-656.