A model study on the circuit mechanism underlying decision-making in Drosophila

Neural Networks

Volumn 24, Issue 4, 2011, Pages 333-344

  Wu, Zhihua ^a   Guo, Aike ^a,b  

^a INSTITUTE OF BIOPHYSICS   (China)

^b Shanghai Jiao Tong University Affiliated Sixth People s Hospital   (China)

Author keywords

Attention; Decision making; Dopamine modulation; Drosophila; Feature binding; Systems level circuit model

Indexed keywords

ATTENTION; DOPAMINE MODULATION; DROSOPHILA; FEATURE BINDING; SYSTEMS-LEVEL CIRCUIT MODEL;

BEHAVIORAL RESEARCH; BRAIN; CIRCUIT THEORY; FLIGHT SIMULATORS; NEURAL NETWORKS;

DECISION MAKING;

DOPAMINE;

ANIMAL EXPERIMENT; ARTICLE; ATTENTION; BRAIN FUNCTION; BRAIN REGION; CONTROLLED STUDY; DECISION MAKING; DOPAMINE RELEASE; DOPAMINERGIC SYSTEM; DROSOPHILA; MATHEMATICAL COMPUTING; MOTOR CORTEX; MUSHROOM BODY; NERVE CELL MEMBRANE POTENTIAL; NERVE CELL NETWORK; NONHUMAN; PRIORITY JOURNAL; VISUAL INFORMATION; VISUAL MEMORY;

ANIMALS; BEHAVIOR, ANIMAL; BRAIN; BRAIN MAPPING; COMPUTER SIMULATION; CONDITIONING, OPERANT; CUES; DECISION MAKING; DOPAMINE; DROSOPHILA; MEMORY; MODELS, NEUROLOGICAL; MUSHROOM BODIES; NERVE NET; NEURAL PATHWAYS; PHOTIC STIMULATION;

EID: 79951957425     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2011.01.002     Document Type: Article

References (86)

1. + channel in Kenyon cells isolated from the mushroom body of the cricket (Gryllus bimaculatus) brain. Journal of Neurophysiology 2008, 100:1211-1222.
2. Beck J.M., Ma W.J., Kiani R., Hanks T., Churchland A.K., Roitman J., Shadlen M.N., Latham P.E., Pouget A. Probabilistic population codes for Bayesian decision making. Neuron 2008, 60:1142-1152.
3. Brunel N., Wang X.J. Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. Journal of Computational Neuroscience 2001, 11(1):63-85.
4. Cassenaer S., Laurent G. Hebbian STDP in mushroom bodies facilitates the synchronous flow of olfactory information in locusts. Nature 2007, 448:709-713.
5. Cisek P. Integrated neural processes for defining potential actions and deciding between them: a computational model. Journal of Neuroscience 2006, 26:9761-9770.
6. Cohen J.D., Braver T.S., Brown J.W. Computational perspectives on dopamine function in prefrontal cortex. Current Opinion in Neurobiology 2002, 12:223-229.
7. Davis R.L. Olfactory memory formation in Drosophila: from molecular to systems neuroscience. Annual Review of Neuroscience 2005, 28:275-302.
8. Dayan P., Abbott L.A. Theoretical neuroscience: computational and mathematical modeling of neural systems 2001, MIT Press, Cambridge, MA.
9. Dill M., Heisenberg M. Visual pattern memory without shape recognition. Philosophical Transactions of the Royal Society of London. Series B 1995, 349(1328):143-152.
10. Durstewitz D., Seamans J.K., Sejnowski T.J. Dopamine mediated stabilization of delay-period activity in a network model of prefrontal cortex. Journal of Neurophysiology 2000, 83(3):1733-1750.
11. Egelhaaf M. On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly II: figure detection cells, a new class of visual interneurons. Biological Cybernetics 1985, 52:195-209.
12. Ernst R., Heisenberg M. The memory template in Drosophila pattern vision at the flight simulator. Vision Research 1999, 39:3920-3933.
13. Finelli L.A., Haney S., Bazhenov M., Stopfer M., Sejnowski T.J. Synaptic learning rules and sparse coding in a model sensory system. PLoS Computational Biology 2008, 4(4):e1000062. 10.1371/journal.pcbi.1000062.
14. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
15. Fuxe K., Dahlström A., Jonsson G., Marcellino D., Guescini M., Dam M., et al. The discovery of central monoamine neurons gave volume transmission to the wired brain. Progress in Neurobiology 2009, 10.1016/j.pneurobio.2009.10.012.
16. Gao S., Takemura S.Y., Ting C.Y., Huang S., Lu Z., Luan H., et al. The neural substrate of spectral preference in Drosophila. Neuron 2008, 60:328-342.
17. Gilbert C., Strausfeld N.J. Small-field neurons associated with oculomotor and optomotor control in muscoid flies: functional organization. Journal of Comparative Neurology 1992, 316:72-86.
18. Gorelova N., Seamans J.K., Yang C.R. Mechanisms of dopamine activation of fast-spiking interneurons that exert inhibition in rat prefrontal cortex. Journal of Neurophysiology 2002, 88:3150-3166.
19. Gold J.I., Shadlen M.N. The neural basis of decision making. Annual Review of Neuroscience 2007, 30:535-574.
20. Gruber A.J., Dayan P., Gutkin B.S., Solla S.A. Dopamine modulation in the basal ganglia locks the gate to working memory. Journal of Computational Neuroscience 2006, 20:153-166.
21. Guo A., Zhang K., Peng Y., Xi W. Heisenberg's roadmap guides our journey to the small cognitive world of Drosophila. Journal of Neurogenetics 2009, 23:100-103.
22. Guo A., Zhang K., Peng Y., Xi W. Research progress on Drosophila visual cognition in China. Sci. China Life Sci. 2010, 53:374-384.
23. Gruber A.J., Solla S.A., Surmeier D.J., Houk J.C. Modulation of striatal single units by expected rewards: a spiny neuron model displaying dopamine-induced bistability. Journal of Neurophysiology 2003, 90:1095-1114.
24. Han K.A., Millar N.S., Grotewiel M.S., Davis R.L. DAMB, a novel dopamine receptor expressed specifically in Drosophila mushroom bodies. Neuron 1996, 16:1127-1135.
25. Hearn M.G., Ren Y., McBride E.W., Reveillaud I., Beinborn M., Kopin A.S. Drosophila dopamine 2-like receptor: molecular characterization and identification of multiple alternatively spliced variants. Proceedings of the National Academy of Sciences USA 2002, 99:14554-14559.
26. Heisenberg M. Mushroom body memoir: from maps to models. Nature Reviews Neuroscience 2003, 4:266-275.
27. Heisenberg M., Wolf R. Vision in Drosophila: genetics of microbehavior. Studies of brain function 1984, vol. 12. Springer-Verlag, Berlin. V. Braitenberg (Ed.).
28. Heisenberg M., Wolf R., Brembs B. Flexibility in a single behavioral variable of Drosophila. Learning & Memory 2001, 8:1-10.
29. Huerta R., Nowotny T. Fast and robust learning by reinforcement signals: explorations in the insect brain. Neural Computation 2009, 21:2123-2151.
30. Huerta R., Nowotny T., Garcia-Sanchez M., Abarbanel H.D.I., Rabinovich M.I. Learning classification in the olfactory system of insects. Neural Computation 2004, 16:1601-1640.
31. Itti L., Koch C. Computational modeling of visual attention. Nature Reviews Neuroscience 2001, 2:194-203.
32. Joesch M., Plett J., Borst A., Reiff D.F. Response properties of motion-sensitive visual interneurons in the lobula plate of Drosophila melanogaster. Current Biology 2008, 18:368-374.
33. Keene A.C., Waddell S. Drosophila memory: dopamine signals punishment?. Current Biology 2005, 15:R932-R934.
34. Kepecs A., Uchida N., Zariwala H.A., Mainen Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 2008, 455:227-231.
35. Kim Y.C., Lee H.G., Han K.A. D1 Dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. Journal of Neuroscience 2007, 27:7640-7647.
36. Kim Y.C., Lee H.G., Seong C.S., Han K.A. Expression of a D1 dopamine receptor dDA1/DmDOP1 in the central nervous system of Drosophila melanogaster. Gene Expression Patterns 2003, 3:237-245.
37. Knill D.C., Pouget A. The Bayesian brain: the role of uncertainty in neural coding and computation. Trends in Neurosciences 2004, 27:712-719.
38. Körding K.P., Wolpert D.M. Bayesian decision theory in sensorimotor control. Trends in Cognitive Sciences 2006, 10:319-326.
39. Krashes M.J., DasGupta S., Vreede A., White B., Armstrong J.D., Waddell S. A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell 2009, 139:416-427.
40. A receptor RDL inhibits Drosophila olfactory associative learning. Neuron 2007, 56:1090-1102.
41. Liu G., Seiler H., Wen A., Zars T., Ito K., Wolf R., et al. Distinct memory traces for two visual features in the Drosophila brain. Nature 2006, 439:551-556.
42. Lo C.C., Wang X.-J. Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nature Neuroscience 2006, 9:956-963.
43. Mao Z., Davis R.L. Eight different types of dopaminergic neurons innervate the Drosophila mushroom body neuropil: anatomical and physiological heterogeneity. Frontiers in Neural Circuits 2009, 3:5.
44. Menzel R. Working memory in bees: also in flies?. Journal of Neurogenetics 2009, 23:92-99.
45. Montague P.R., Hyman S.E., Cohen J.D. Computational roles of dopamine in behavioural control. Nature 2004, 431:760-767.
46. Montague P.R., King-Casas B., Cohen J.D. Imaging valuation models in human choice. Annual Review of Neuroscience 2006, 29:417-448.
47. Nicola S.M., Surmeier D.J., Malenka R.C. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annual Review of Neuroscience 2000, 23:185-215.
48. Nitz D.A., van Swinderen B., Tononi G., Greenspan R.J. Electrophysiological correlates of rest and activity in Drosophila melanogaster. Current Biology 2002, 12:1934-1940.
49. Nordstrom K., Barnett P.D., O'Carroll D.C. Insect detection of small targets moving in visual clutter. PLoS Biology 2006, 4:e54.
50. Nowotny T., Huerta R., Abarbanel H.D.I., Rabinovich M.I. Self-organization in the olfactory system: rapid odor recognition in insects. Biological Cybernetics 2005, 93:436-446.
51. Olsen S.R., Wilson R. Cracking neural circuits in a tiny brain: new approaches for understanding the neural circuitry of Drosophila. Cell 2008, 31:512-520.
52. Pan Y., Zhou Y., Guo C., Gong H., Gong Z., Liu L. Differential roles of the fan-shaped body and the ellipsoid body in Drosophila visual pattern memory. Learning & Memory 2009, 16:289-295.
53. Perez-Orive J., Mazor O., Turner G.C., Cassenaer S., Wilson R.I., Laurent G. Oscillations and sparsening of odor representations in the mushroom body. Science 2002, 297:359-365.
54. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience 2008, 9:545-556.
55. Redgrave P., Gurney K. The short-latency dopamine signal: a role in discovering novel actions?. Nature Reviews Neuroscience 2006, 7:967-975.
56. Reynolds J.N.J., Hyland B.I., Wickens J.R. A cellular mechanism of reward-related learning. Nature 2001, 413:67-70.
57. Reynolds J.N.J., Wickens J.R. Dopamine-dependent plasticity of corticostriatal synapses. Neural Networks 2002, 15:507-521.
58. Riemensperger T., Voeller T., Stock P., Buchner E., Fiala A. Punishment prediction by dopaminergic neurons in Drosophila. Current Biology 2005, 15:1953-1960.
59. Roman G., Davis R.L. Molecular biology and anatomy of Drosophila olfactory associative learning. BioEssays 2001, 23:571-581.
60. Schroll C., Riemensperger T., Bucher D., Ehmer J., Voller T., Erbguth K., et al. Light induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae. Current Biology 2006, 16:1741-1747.
61. Schultz W. Multiple dopamine functions at different time courses. Annual Review of Neuroscience 2007, 30:259-288.
62. Schwaerzel M., Monastirioti M., Scholz H., Friggi-Grelin F., Birman S., Heisenberg M. Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in Drosophila. Journal of Neuroscience 2003, 23:10495-10502.
63. Seamans J.K., Gorelova N., Durstewitz D., Yang C.R. Bidirectional dopamine modulation of GABAergic inhibition in prefrontal cortical pyramidal neurons. Journal of Neuroscience 2001, 21:3628-3638.
64. Seamans J.K., Yang C.R. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Progress in Neurobiology 2004, 74:1-57.
65. Servan-Schreiber D., Printz H., Cohen J.D. A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. Science 1990, 249:892-895.
66. Smith D., Wessnitzer J., Webb B. A model of associative learning in the mushroom body. Biological Cybernetics 2008, 99:89-103. 10.1007/s00422-008-0241-1.
67. Soltani A., Wang X.-J. A biophysically based neural model of matching law behavior: melioration by stochastic synapses. Journal of Neuroscience 2006, 26:3731-3744.
68. Soltani A., Lee D., Wang X.-J. Neural mechanism for stochastic behavior during a competitive game. Neural Networks 2006, 19:1075-1090.
69. Sugrue L.P., Corrado G.S., Newsome W.T. Choosing the greater of two goods: neural currencies for valuation and decision making. Nature Reviews Neuroscience 2005, 6:363-375.
70. Sutton R.S., Barto A.G. Reinforcement learning: an introduction 1998, MIT Press, Cambridge, MA.
71. Tang S., Guo A. A choice behavior of Drosophila facing contradictory visual cues. Science 2001, 294:1543-1547.
72. Tang S., Wolf R., Xu S., Heisenberg M. Visual pattern recognition in Drosophila is invariant for retinal position. Science 2004, 305:1020-1022.
73. Trantham-Davidson H., Neely L.C., Lavin A., Seamans J.K. Mechanisms underlying differential D1 versus D2 dopamine receptor regulation of inhibition in prefrontal cortex. Journal of Neuroscience 2004, 24:10652-10659.
74. Treisman A. Feature binding, attention and object perception. Philosophical Transactions of the Royal Society of London. Series B 1998, 353:1295-1306.
75. Turner G.C., Bazhenov M., Laurent G. Olfactory representations by Drosophila mushroom body neurons. Journal of Neuroscience 2008, 99:734-746.
76. Unoki S., Matsumoto Y., Mizunami M. Roles of octopaminergic and dopaminergic neurons in mediating rewards and punishment signals in insect visual learning. European Journal of Neuroscience 2006, 24:2031-2038.
77. Usher M., McClelland J.L. The time course of perceptual choice: the leaky, competing accumulator model. Psychological Review 2001, 108:550-592.
78. van Swinderen B. The remote roots of consciousness in fruit-fly selective attention?. BioEssays 2005, 27:321-330.
79. van Swinderen B., Greenspan R.J. Salience modulates 20-30 Hz brain activity in Drosophila. Nature Neuroscience 2003, 6:579-586.
80. Wang X.-J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36:955-968.
81. Wolf R., Wittig T., Liu L., Wustmann G., Eyding D., Heisenberg M. Drosophila mushroom bodies are dispensable for visual, tactile, and motor learning. Learn. Mem. 1998, 5:166-178.
82. Wu Z., Gong Z., Feng C., Guo A. An emergent mechanism of selective visual attention in Drosophila. Biological Cybernetics 2000, 82:61-68.
83. Xi W., Peng Y., Guo J., Ye Y., Zhang K., Yu F., et al. Mushroom bodies modulate salience-based selective fixation behavior in Drosophila. European Journal of Neuroscience 2008, 27:1441-1451.
84. Yang C.H., Belawat P., Hafen E., Jan L.Y., Jan Y.N. Drosophila egg-laying site selection as a system to study simple decision-making processes. Science 2008, 319:1679-1683.
85. Yuan N., Lee D. Suppression of excitatory cholinergic synaptic transmission by Drosophila dopamine D1-like receptors. European Journal of Neuroscience 2007, 26:2417-2427.
86. Zhang K., Guo J., Peng Y., Xi W., Guo A. Dopamine-mushroom body circuit regulates saliency-based decision-making in Drosophila. Science 2007, 316:1901-1904.