Decision-making and action selection in insects: Inspiration from vertebrate-based theories

Frontiers in Behavioral Neuroscience

Volumn 9, Issue AUGUST, 2015, Pages

  Barron, Andrew B ^a   Gurney, Kevin N ^b   Meah, Lianne F S ^b   Vasilaki, Eleni ^b   Marshall, James A R ^b  

^a MACQUARIE UNIVERSITY   (Australia)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Basal ganglia; Cross inhibition; Lateral protocerebrum; Leaky competing accumulator model; Mushroom body; Mutual inhibition; Parallel inhibition; Protocerebral calycal tract

Indexed keywords

BASAL GANGLION; BRAIN FUNCTION; COMPUTER MODEL; DECISION MAKING; INFORMATION PROCESSING; INSECT; LEARNING; NONHUMAN; OLFACTORY CORTEX; OLFACTORY DISCRIMINATION; OLFACTORY NERVOUS SYSTEM; PREMOTOR CORTEX; REVIEW; THEORETICAL MODEL; VERTEBRATE;

EID: 84940192816     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2015.00216     Document Type: Review

References (115)

1. Abel, R., Rybak, J., and Menzel, R. (2001). Structure and response patterns of olfactory interneurons in the honeybee, apis mellifera. J. Comp. Neurol. 437, 363-383. doi: 10.1002/cne.1289
2. Alexander, M. E., and Wickens, J. R. (1993). Analysis of striatal dynamics the existence of two modes of behaviour. J. Theor. Biol. 163, 413-438. doi: 10.1006/jtbi.1993.1128
3. Bazhenov, M., Huerta, R., and Smith, B. (2013). A computational framework for understanding decision making through integration of basic learning rules. J. Neurosci. 33, 5686-5697. doi: 10.1523/JNEUROSCI.4145-12.2013
4. Bicker, G., Schäfer, S., and Kingan, T. (1985). Mushroom body feedback interneurones in the honeybee show GABA-like immunoreactivity. Brain Res. 360, 394-397. doi: 10.1016/0006-8993(85)91262-4
5. Bienenstock, E. L., Cooper, L. N., and Munroe, P. W. (1982). Theory of the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2, 32-48.
6. Bitterman, M. E., Menzel, R., Fietz, A., and Schäfer, S. (1983). Classical conditioning of proboscis extension in honeybees (apis mellifera). J. Comp. Physiol. 97, 107-119. doi: 10.1037/0735-7036.97.2.107
7. Bogacz, R. (2007). Optimal decision-making theories: linking neurobiology with behaviour. Trends Cogn. Sci. 11, 118-125. doi: 10.1016/j.tics.2006.12.006
8. Bogacz, R., and Gurney, K. (2007). The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 19, 442-477. doi: 10.1162/neco.2007.19.2.442
9. Bogacz, R., Brown, E., Moehlis, J., Holmes, P., and Cohen, J. D. (2006). The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol. Rev. 113, 700-765. doi: 10.1037/0033-295x.113.4.700
10. Bolam, J. P., and Bennett, B. D. (1995). "Microcircuitry of the neostriatum," in Molecular and Cellular Mechanisms of Neostriatal Function,, eds M. A. Ariano, D. J. Surmeier, and R. G. Austin (London: R G Landes Co), 1-20.
11. Bray, D. (2009). Wetware: A Computer in Every Living Cell. New Haven: Yale University Press.
12. Bray, D., Levin, M., and Lipkow, K. (2007). The chemotactic behavior of computer-based surrogate bacteria. Curr. Bio. 17, 12-19. doi: 10.1016/j.cub.2006.11.027
13. Brill, M. F., Rosenbaum, T., Reus, I., Kleineidam, C. J., Nawrot, M. P., and Rössler, W. (2013). Parallel processing via a dual olfactory pathway in the honeybee. J. Neurosci. 33, 2443-2456. doi: 10.1523/JNEUROSCI.4268-12.2013
14. Burke, C. J., Huetteroth, W., Owald, D., Perisse, E., Krashes, M. J., Das, G., et al. (2012). Layered reward signalling through octopamine and dopamine in drosophila. Nature 492, 433-437. doi: 10.1038/nature11614
15. Chevalier, G., and Deniau, J. M. (1990). Disinhibition as a basic process in the expression of striatal functions. Trends Neurosci.13, 277-280. doi: 10.1016/0166-2236(90)90109-n
16. Deniau, J. M., Kitai, S. T., Donoghue, J. P., and Grofova, I. (1982). Neuronal interactions in the substantia nigra pars reticulata through axon collateral of the projection neurons..Exp. Brain Res. 47, 105-113. doi: 10.1007/bf00235891
17. Denker, M., Finke, R., Schaupp, F., Grün, S., and Menzel, R. (2010). Neural correlates of odor learning in the honeybee antennal lobe. Eur. J. Neurosci. 31, 119-133. doi: 10.1111/j.1460-9568.2009.07046.x
18. Ditterich, J., Mazurek, M. E., and Shadlen, M. N. (2003). Microstimulation of visual cortex affects the speed of perceptual decisions. Nat. Neurosci. 6, 891-898. doi: 10.1038/nn1094
19. Faber, T., Joerges, J., and Menzel, R. (1999). Associative learning modifies neural representations of odors in the insect brain.Nature Neurosci. 2, 74-78. doi: 10.1038/4576
20. Faber, T., and Menzel, R. (2001). Visualizing mushroom body response to a conditioned odor in honeybees.Naturwissenschaften 88, 472-476. doi: 10.1007/s001140100263
21. Farooqui, T., Robinson, K., Vaessin, H., and Smith, B. H. (2003). Modulation of early olfactory processing by an octopaminergic reinforcement pathway in the honeybee. J. Neurosci. 23, 5370-5380.
22. Fernandez, P. C., Locatelli, F. F., Person-Rennell, N., Deleo, G., and Smith, B. H. (2009). Associative conditioning tunes transient dynamics of early olfactory processing. J. Neurosci. 29, 10191-10202. doi: 10.1523/JNEUROSCI.1874-09.2009
23. Fişek, M., and Wilson, R. I. (2014). Stereotyped connectivity and computations in higher-order olfactory neurons. Nat. Neurosci. 17, 280-288. doi: 10.1038/nn.3613
24. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated parkinsonism. J. Cogn. Neuroci. 17, 51-72. doi: 10.1162/0898929052880093
25. Frank, M. J., Samanta, J., Moustafa, A. A., and Sherman, S. J. (2007). Hold your horses: impulsivity, deep brain stimulation and medication in parkinsonism. Science 318, 1309-1312. doi: 10.1126/science.1146157
26. Frank, M. J., Seeberger, L. C., and O'reilly, R. C. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306, 1940-1943. doi: 10.1126/science.1102941
27. Fukai, T., and Tanaka, S. (1997). A sirnple neural network exhibiting selective activation of neuronal ensembles: from winner-take-all to winners-share-all. Neural Comput. 9, 77-97. doi: 10.1162/neco.1997.9.1.77
28. Galizia, C. G. (2014). Olfactory coding in the insect brain: data and conjectures. Eur. J. Neurosci. 39, 1784-1795. doi: 10.1111/ejn.12558
29. Galizia, C. G., and Menzel, R. (2001). The role of glomeruli in the neural representation of odours: results from optical recording studies. J. Insect Physiol. 47, 115-130. doi: 10.1016/s0022-1910(00)00106-2
30. Galizia, C. G., and Rössler, W. (2010). Parallel olfactory systems in insects: anatomy and function. Ann. Rev. Entomol. 55, 399-420. doi: 10.1146/annurev-ento-112408-085442
31. Ganeshina, O., and Menzel, R. (2001). GABA-immunoreactive neurons in the mushroom bodies of the honeybee: an electron microscopic study. J. Comp. Neurol. 437, 335-349. doi: 10.1002/cne.1287
32. Giurfa, M., and Sandoz, J. C. (2012). Invertebrate learning and memory: fifty years of olfactory conditioning of the proboscis extension response in honeybees. Learn. Mem. 19, 54-66. doi: 10.1101/lm.024711.111
33. Goldstein, E. B. (2007). Sensation and perception. Wadsworth: Thomson.
34. Grimaldi, D., and Engel, M. S. (2005). Evolution of the Insects. Cambridge: Cambridge University Press.
35. Grünewald, B. (1999a). Morphology of feedback neurons in the mushroom body of the honeybee apis mellifera. J. Comp. Neurol. 404, 114-126. doi: 10.1002/(sici)1096-9861(19990201)404:1<114::aid-cne9>3.3.co;2-r
36. Grünewald, B. (1999b). Physiological properties and response modulations of mushroom body feedback neurons during olfactory learning in the honeybee apis mellifera. J. Comp. Physiol. A Neural Behav. Physiol. 185, 565-576. doi: 10.1007/s003590050417
37. Gurney, K. N., Humphries, M. D., and Redgrave, P. (2015). A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface. PLoS Bio. 13:e1002034. doi: 10.1371/journal.pbio.1002034
38. Gurney, K. N., Humphries, M., Wood, R., Prescott, T. J., and Redgrave, P. (2004). Testing computational hypotheses of brain systems function: a case study with the basal ganglia. Network 15, 263-290. doi: 10.1088/0954-898x/15/4/003
39. Gurney, K. N., Prescott, T. J., and Redgrave, P. (2001). A computational model of action selection in the basal ganglia I: a new functional anatomy. Biol. Cybern. 84, 401-410. doi: 10.1007/pl00007984
40. Haehnel, M., and Menzel, R. (2010). Sensory representation and learning-related plasticity in mushroom body extrinsic feedback neurons of the protocerebral tract. Front. Syst. Neurosci. 4:161. doi: 10.3389/fnsys.2010.00161
41. Hammer, M. (1993). An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees.Nature 366, 59-63. doi: 10.1038/366059a0
42. Hammer, M., and Menzel, R. (1995). Learning and memory in the honeybee. J. Neurosci. 15, 1617-1630.
43. Hammer, M., and Menzel, R. (1998). Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learn. Mem. 5, 146-156.
44. Hammer, M., Menzel, R., and Schneider, U. (1993). "Octopamine local injections into the mushroom body calyces substitute for the unconditioned stimulus in honeybee olfactory conditioning," in Gene-brain-behaviour, eds N. Eisner and M. Heisenberg (Stuttgart: Thieme Verlag), 848.
45. Hu, A., Zhang, W., and Wang, Z. (2010). Functional feedback from mushroom bodies to antennal lobes in the drosophilaolfactory pathway. Proc. Natl. Acad. Sci. U S A 107, 10262-10267. doi: 10.1073/pnas.0914912107
46. Humphries, M. D., and Gurney, K. N. (2002). The role of intra-thalamic and thalamocortical circuits in action selection.Network 13, 131-156. doi: 10.1088/0954-898x/13/1/305
47. Ito, I., Ong, R. C. Y., Raman, B., and Stopfer, M. (2008). Sparse odor representation and olfactory learning. Nat. Neurosci. 11, 1177-1184. doi: 10.1038/nn.2192
48. Ito, K., Shinomiya, K., Ito, M., Armstrong, J. D., Boyan, G., Hartenstein, V., et al. (2014). A systematic nomenclature for the insect brain. Neuron 81, 755-765. doi: 10.1016/j.neuron.2013.12.017
49. Joerges, J., Küttner, A., Galizia, C. G., and Menzel, R. (1997). Representations of odours and odour mixtures visualized in the honeybee brain. Nature 387, 285-288. doi: 10.1038/387285a0
50. Kirschner, S., Kleineidam, C. J., Zube, C., Rybak, J., Grünewald, B., and Rössler, W. (2006). Dual olfactory pathway in the honeybee, apis mellifera. J. Comp. Neurol. 499, 933-952. doi: 10.1002/cne.21158
51. Kohonen, T. (1989). Self-Organization and Associative Memory. Berlin: Springer-Verlag.
52. Krofczik, S., Menzel, R., and Nawrot, M. P. (2008). Rapid odor processing in the honeybee antennal lobe network. Front. Comput. Neurosci. 2:9. doi: 10.3389/neuro.10.009.2008
53. Kuwabara, M. (1957). Bildung des bedingten reflexes von pavlovs typus bei der honigbiene (apis mellifica). J. Fac. Sci. Hokkaido Univ. 13, 458-464.
54. Lei, Z., Chen, K., Li, H., Liu, H., and Guo, A. (2013). The GABA system regulates the sparse coding of odors in the mushroom bodies of drosophila. Biochem. Biophys. Res. Commun. 436, 35-40. doi: 10.1016/j.bbrc.2013.05.036
55. Lepora, N. F., and Gurney, K. N. (2012). The basal ganglia optimize decision making over general perceptual hypotheses.Neural Comput. 24, 2924-2945. doi: 10.1162/neco_a_00360
56. Liang, L., Li, Y., Potter, C. J., Yizhar, O., Deisseroth, K., Tsien, R. W., et al. (2013). GABAergic projection neurons route selective olfactory inputs to specific higher-order neurons. Neuron 79, 917-931. doi: 10.1016/j.neuron.2013.06.014
57. Linster, C., Sachse, S., and Galizia, C. G. (2005). Computational modeling suggests that response properties rather than spatial position determine connectivity between olfactory glomeruli. J. Neurophysiol. 93, 3410-3417. doi: 10.1152/jn.01285.2004
58. Liu, X., and Davis, R. (2009). The GABAergic anterior paired lateral neuron suppresses and is suppressed by olfactory learning..Nat. Neurosci. 12, 53-59. doi: 10.1038/nn.2235
59. Marshall, J. A., Bogacz, R., and Gilchrist, I. D. (2012). Consistent implementation of decisions in the brain. PLoS One7:e43443. doi: 10.1371/journal.pone.0043443
60. Marshall, J. A. R., Favreau-Peigné, A., Fromhage, L., McNamara, J. M., Meah, L. F. S., and Houston, A. I. (2015). Cross inhibition improves activity selection when switching incurs time costs. Curr. Zool. 61, 242-250.
61. McHaffie, J. G., Stanford, T. R., Stein, B. E., Coizet, V., and Redgrave, P. (2005). Subcortical loops through the basal ganglia.Trends Neurosci. 28, 401-407. doi: 10.1016/j.tins.2005.06.006
62. Menzel, R. (2001). Searching for the memory trace in a mini-brain, the honeybee. Learn. Mem. 8, 53-62. doi: 10.1101/lm.38801
63. Menzel, R., and Giurfa, M. (2001). Cognitive architecture of a mini-brain: the honeybee. Trends Cogn. Sci. 5, 62-71. doi: 10.1016/s1364-6613(00)01601-6
64. Mink, J. W., and Thach, W. T. (1993). Basal ganglia intrinsic circuits and their role in behavior. Curr. Opin. Neurobiol. 3, 950-957. doi: 10.1016/0959-4388(93)90167-w
65. Mobbs, P. G. (1982). The brain of the honeybee apis mellifera I. The connections and spatial organization of the mushroom bodies. Philos. Trans. R. Soc. Lond. B Biol. Sci. 298, 309-354. doi: 10.1098/rstb.1982.0086
66. Oja, E. (1982). A simplified neuron model as a principal component analyzer. J. Math. Biol. 15, 267-273. doi: 10.1007/bf00275687
67. Okada, R., Rybak, J., Manz, G., and Menzel, R. (2007). Learning-related plasticity in PE1 and other mushroom body-extrinsic neurons in the honeybee brain. J. Neurosci. 27, 11736-11747. doi: 10.1523/jneurosci.2216-07.2007
68. Onn, S.-P., Fienberg, A. A., and Grace, A. A. (2003). Dopamine modulation of membrane excitability in striatal spiny neurons is altered in DARPP-32 knockout mice. J. Pharmacol. Exp. Ther. 306, 870-879. doi: 10.1124/jpet.103.050062
69. Pais, D., Hogan, P. M., Schlegel, T., Franks, N. R., Leonard, N. E., and Marshall, J. A. R. (2013). A mechanism for value-sensitive decision-making. PLoS One 8:e73216. doi: 10.1371/journal.pone.0073216
70. Palmer, M. J., and Harvey, J. (2014). Honeybee kenyon cells are regulated by a tonic GABA receptor conductance. J. Neurophysiol. 112, 2026-2035. doi: 10.1152/jn.00180.2014
71. Park, M. R., Falls, W. M., and Kitai, S. T. (1982). An intracellular HRP study of the rat globus pallidus. I. Responses and light microscopic analysis. J. Comp. Neurol. 211, 284-294. doi: 10.1002/cne.902110307
72. Parnas, M., Lin, A. C., Huetteroth, W., and Miesenböck, G. (2013). Odor discrimination in drosophila: from neural population codes to behavior. Neuron 79, 932-944. doi: 10.1016/j.neuron.2013.08.006
73. Perez-Orive, J., Mazor, O., Turner, G. C., Cassenaer, S., Wilson, R. I., and Laurent, G. (2002). Oscillations and sparsening of odor representations in the mushroom body. Science 297, 359-365. doi: 10.1126/science.1070502
74. Perry, C. J., and Barron, A. B. (2013). Neural mechanisms of reward in insects. Annu. Rev. Entomol. 58, 543-562. doi: 10.1146/annurev-ento-120811-153631
75. Pfeiffer, K., and Homberg, U. (2014). Organization and functional roles of the central complex in the insect brain. Ann. Rev. Entomol. 59, 165-184. doi: 10.1146/annurev-ento-011613-162031
76. Pirrone, A., Stafford, T., and Marshall, J. A. R. (2014). When natural selection should optimize speed-accuracy trade-offs.Front. Neurosci. 8:73. doi: 10.3389/fnins.2014.00073
77. Prescott, T. J., Montes-González, F., Gurney, K., Humphries, M. D., and Redgrave, P. (2006). A robot model of the basal ganglia: behavior and intrinsic processing. Neural Netw. 19, 31-61. doi: 10.1016/j.neunet.2005.06.049
78. Raccuglia, D., and Mueller, U. (2014). Temporal integration of cholinergic and GABAergic inputs in isolated insect mushroom body neurons exposes pairing-specific signal processing. J. Neurosci. 34, 16086-16092. doi: 10.1523/JNEUROSCI.0714-14.2014
79. Ratcliff, R. (1978). A theory of memory retrieval. Psychol. Rev. 85, 59-108. doi: 10.1037/0033-295x.85.2.59
80. Ratcliff, R. (1981). A theory of order relations in perceptual matching. Psychol. Rev. 88, 552-572. doi: 10.1037/0033-295x.88.6.552
81. Ratcliff, R. (1988). Continuous versus discrete information processing: modeling the accumulation of partial information.Psychol. Rev. 95, 238-255. doi: 10.1037/0033-295x.95.2.238
82. Ratcliff, R. (2002). A diffusion model account of reaction time and accuracy in a two choice brightness discrimination task: fitting real data and failing to fit fake but plausible data. Psychon. Bull. Rev. 9, 278-291. doi: 10.3758/bf03196283
83. Redgrave, P., Prescott, T. J., and Gurney, K. N. (1999). The basal ganglia: a vertebrate solution to the selection problem?Neuroscience 89, 1009-1023. doi: 10.1016/s0306-4522(98)00319-4
84. Richmond, P., Buesing, L., Giugliano, M., and Vasilaki, E. (2011). Democratic population decisions result in robust policy-gradient learning: a parametric study with GPU simulations. PLoS One 6:e18539. doi: 10.1371/journal.pone.0018539
85. Rybak, J., and Menzel, R. (1993). Anatomy of the mushroom bodies in the honey bee brain-the neuronal connections of the alpha-lobe. J. Comp. Neurol. 334, 444-465. doi: 10.1002/cne.903340309
86. Rybak, J., and Menzel, R. (1998). Integrative properties of the Pe1 neuron, a unique mushroom body output neuron. Learn. Mem. 5, 133-145.
87. Schmuker, M., Pfeil, T., and Nawrot, M. P. (2014). A neuromorphic network for generic multivariate data classification. Proc. Natl. Acad. Sci. U S A 111, 2081-2086. doi: 10.1073/pnas.1303053111
88. Schultz, W. (1997). Dopamine neurons and their role in reward mechanisms. Curr. Opin. Neurobiol. 7, 191-197. doi: 10.1016/s0959-4388(97)80007-4
89. Schultz, W. (2001). Reward signaling by dopamine neurons. Neuroscientist 7, 293-302. doi: 10.1177/107385840100700406
90. Schultz, W. (2007). Behavioral dopamine signals. Trends Neurosci. 30, 203-210. doi: 10.1016/j.tins.2007.03.007
91. Schwaerzel, M., Monastirioti, M., Scholz, H., Friggi-Grelin, F., Birman, S., and Heisenberg, M. (2003). Dopamine and octopamine differentiate between aversive and appetitive olfactory memories in drosophila. J. Neurosci. 23, 10495-10502.
92. Seeley, T. D. P., Visscher, K., Schlegel, T., Hogan, P. M., Franks, N. R., and Marshall, J. A. (2012). Stop signals provide cross inhibition in collective decision-making by honeybee swarms. Science 335, 108-111. doi: 10.1126/science.1210361
93. Seelig, J. D., and Jayaraman, V. (2015). Neural dynamics for landmark orientation and angular path integration. Nature 521, 186-191. doi: 10.1038/nature14446
94. Smith, B. H., Huerta, R., Bazhenov, M., and Sinakevitch, I. (2012). "Distributed plasticiity for olfactory learning and memory in the honey bee brain," in Honeybee Neurobiology and Behavior, eds G. C. Galizia, D. Eisenhardt, and M. Giurfa (New York: Springer), 393-409.
95. Søvik, E., Perry, C. J., and Barron, A. B. (2015). "Insect reward systems: comparing flies and bees," in Genomics, Physiology and Behaviour of Social Insects, eds A. Zayed and C. Kent (London: Academic Press), 189-226.
96. Stephenson-Jones, M., Ericsson, J., Robertson, B., and Grillner, S. (2012). Evolution of the basal ganglia: dual-output pathways conserved throughout vertebrate phylogeny. J. Comp. Neurol. 520, 2957-2973. doi: 10.1002/cne.23087
97. Strausfeld, N. J. (2012). Arthropod Brains: Evolution, Functional Elegance and Historical Significance. Cambridge, MA: Harvard University Press.
98. Strausfeld, N. J., and Hirth, J. (2013). Deep homology of arthropod central complex and vertebrate basal ganglia. Science 340, 157-161. doi: 10.1126/science.1231828
99. Strube-Bloss, M. F., Herrera-Valdez, M. A., and Smith, B. H. (2012a). Ensemble response in mushroom body output neurons of the honey bee outpaces spatiotemporal odor processing two synapses earlier in the antennal lobe. PLoS One 7:e50322. doi: 10.1371/journal.pone.0050322
100. Strube-Bloss, M. F., Nawrot, M. P., and Menzel, R. (2012b). Mushroom body output neurons encode odor-reward associations.J. Neurosci. 31, 3129-3140. doi: 10.1523/JNEUROSCI.2583-10.2011
101. Szyszka, P., Ditzen, M., Galkin, A., Galizia, C. G., and Menzel, R. (2005). Sparsening and temporal sharpening of olfactory representations in the honeybee mushroom bodies. J. Neurophysiol. 94, 3303-3313. doi: 10.1152/jn.00397.2005
102. Szyszka, P., Galkin, A., and Menzel, R. (2008). Associative and non-associative plasticity in kenyon cells of the honeybee mushroom body. Front. Syst. Neurosci. 2:3. doi: 10.3389/neuro.06.003.2008
103. Tepper, J. M., Koós, T., and Wilson, C. J. (2004). GABAergic microcircuits in the neostriatum. Trends Neurosci. 27, 662-669. doi: 10.1016/j.tins.2004.08.007
104. Tomkins, A., Vasilaki, E., Beste, C., Gurney, K., and Humphries, M. D. (2014). Transient and steady-state selection in the striatal microcircuit. Front. Comput. Neurosci. 7:192. doi: 10.3389/fncom.2013.00192
105. Turner, G. C., Bazhenov, M., and Laurent, G. (2008). Olfactory representations by drosophila mushroom body neurons. J. Neurophysiol. 99, 734-746. doi: 10.1152/jn.01283.2007
106. Usher, M., and McClelland, J. L. (2001). The time course of perceptual choice: the leaky, competing accumulator model.Psychol. Rev. 108, 550-592. doi: 10.1037/0033-295x.108.3.550
107. Vasilaki, E., Fremaux, N., Urbanczik, R., Senn, W., and Gerstner, W. (2009). Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS Comput. Biol. 5:e1000586. doi: 10.1371/journal.pcbi.1000586
108. Vehovszky, A., Szabó, H., and Elliott, C. J. H. (2005). Octopamine increases the excitability of neurons in the snail feeding system by modulation of inward sodium current but not outward potassium currents. BMC Neurosci. 6:70. doi: 10.1186/1471-2202-6-70
109. Vergoz, V., Roussel, E., Sandoz, J.-C., and Giurfa, M. (2007). Aversive learning in honeybees revealed by the olfactory conditioning of the sting extension reflex. PLoS One 2:e288. doi: 10.1371/journal.pone.0000288
110. Vickers, D. (1970). Evidence for an accumulator model of psychophysical discrimination. Ergonomics 13, 37-58. doi: 10.1080/00140137008931117
111. von der Malsburg, C. (1973). Self-organization of orientation selective cells in the striate cortex. Kybernetik 14, 85-100. doi: 10.1007/bf00288907
112. Wang, X.-J. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955-968. doi: 10.1016/s0896-6273(02)01092-9
113. Weisel-Eichler, A., and Libersat, F. (1996). Neuromodulation of flight initiation by octopamine in the cockroach periplaneta americana. J. Comp. Physiol. A 179, 103-112. doi: 10.1007/bf00193438
114. Wilson, C. J., and Kawaguchi, Y. (1996). The origins of the two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons. J. Neurosci. 16, 2397-2410.
115. Wilson, R. I. (2013). Early olfactory processing in drosophila: mechanisms and principles. Annu. Rev. Neurosci. 36, 217-241. doi: 10.1146/annurev-neuro-062111-150533