Cortical circuitry implementing graphical models

Neural Computation

Volumn 21, Issue 11, 2009, Pages 3010-3056

  Litvak, Shai ^a   Ullman, Shimon ^a  

^a WEIZMANN INSTITUTE OF SCIENCE   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BRAIN CORTEX; BRAIN MAPPING; COMPUTER GRAPHICS; NERVE TRACT; PHYSIOLOGY; PROBABILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; BRAIN MAPPING; CEREBRAL CORTEX; COMPUTER GRAPHICS; DATA INTERPRETATION, STATISTICAL; MARKOV CHAINS; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); NEURAL PATHWAYS;

EID: 77953750826     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2009.05-08-783     Document Type: Article

References (102)

1. Abbott, L.F., & Dayan, P. (1999). The effect of correlated variability on the accuracy of a population code. Neural Computation, 11(1), 91-101.
2. Abbott, L.F., & Nelson, S.B. (2000). Synaptic plasticity: Taming the beast. Nature Neuroscience, 3, 1178-1183.
3. Abbott, L.F., & Regehr, W.G. (2004). Synaptic computation. Nature, 431(7010), 796-803.
4. Aji, S.M., & McEliece, R.J. (2000). The generalized distributive law. IEEE Transactions on Information Theory, 46(2), 325-343.
5. Amirikian, B., & Georgopoulos, A.P. (2003). Modular organization of directionally tuned cells in the motor cortex: Is there a short-range order? Proceedings of the National Academy of Sciences, 100, 12474-12479.
6. Anderson, J.C., & Martin, K.A. (2002). Connection from cortical area V2 to MT in macaque monkey. Journal of Comparative Neurology, 443(1), 56-70.
7. Angelucci, A., Levitt, J.B., Walton, E.J., Hupe, J.M., Bullier, J., & Lund, J.S. (2002). Circuits for local and global signal integration in primary visual cortex. Journal of Neuroscience, 22(19), 8633-8646.
8. Beck, J.M., & Pouget, A. (2007). Exact inferences in a neural implementation of a hidden Markov model. Neural Computation, 19(5), 1344-1361.
9. Besag, J. (1974). Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society, 36(2), 192-326.
10. Binzegger, T., Douglas, R.J., & Martin, K.A. (2004). A quantitative map of the circuit of cat primary visual cortex. Journal of Neuroscience, 24(39), 8441-8453.
11. Buxhoeveden, D.P., & Casanova, M.F. (2002). The minicolumn hypothesis in neuroscience. Brain, 125(5), 935-951.
12. Carpenter, R.H., & Williams, M.L. (1995). Neural computation of log likelihood in control of saccadic eye movements. Nature, 377(6544), 59-62.
13. Cooper, G.F. (1990). The computational complexity of probabilistic inference using Bayesian belief networks. Artificial Intelligence, 42(2-3), 393-405.
14. Dayan, P., Hinton, G.E., Neal, R.M., & Zemel, R.S. (1995). The Helmholtz machine. Neural Computation, 7, 1022-1037.
15. DeFelipe, J., Hendry, S.H., Hashikawa, T., Molinari, M., & Jones, E.G. (1990). A microcolumnar structure of monkey cerebral cortex revealed by immunocytochemical studies of double bouquet cell axons. Neuroscience, 37(3), 655-673.
16. Deneve, S. (2008a). Bayesian spiking neurons I: Inference. Neural Computation, 20(1), 91-117.
17. Deneve, S. (2008b). Bayesian spiking neurons II: Learning. Neural Computation, 20(1), 118-145.
18. Douglas, R.J., & Martin, K.A.C. (2004). Neuronal circuits of the neocortex. Annual Review of Neuroscience, 27, 419-451.
19. Doya, K., Ishii, S., Alexandre, P., Rao, R.P.N. (Eds.). (2007). Bayesian brain. Cambridge, MA: MIT Press.
20. Eliasmith, C., & Anderson, C.H. (2003). Neural engineering: Computation, representation, and dynamics in neurobiological systems. Cambridge, MA: MIT Press.
21. Epshtein, B., & Ullman, S. (2005). Feature hierarchies for object classification. Proceedings of the International Conference on Computer Vision, 220-227.
22. Ernst, M.O., & Banks, M.S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), 429-433.
23. Felleman, D.J., & Van Essen, D.C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1(1), 1-47.
24. Freeman, W.T., Pasztor, E.C., & Carmichael, O.T. (2000). Learning low-level vision. International Journal of Computer Vision, 40(1), 25-47.
25. Friston, K. (2003). Learning and inference in the brain. Neural Networks, 16(9), 1325-1352.
26. Fujita, I. (2002). The inferior temporal cortex: Architecture, computation, and representation. Journal of Neurocytology, 31(3-5), 359-371.
27. Gawne, T.J., & Martin, J.M. (2002). Responses of primate visual cortical V4 neurons to simultaneously presented stimuli. Journal of Neurophysiology, 88(3), 1128-1135.
28. Gerstner, W., & Kistler, W.M. (2002). Spiking neuron models.Cambridge:Cambridge University Press.
29. Ghahramani, Z. (2002). An introduction to hidden Markov models and Bayesian networks. IJPRAI, 15(1), 9-42.
30. Gray, C.M., & McCormick, D.A. (1996). Chattering cells: Superficial pyramidal neurons contributing to the generation of synchronous oscillations in the visual cortex. Science, 274(5284), 109-113.
31. Gupta, A., Wang, Y., & Markram, H. (2000). Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. Science, 287(5451), 273-278.
32. Haas, J.S., Nowotny, T., & Abarbanel, H.D. (2006). Spike-timing-dependent plasticity of inhibitory synapses in the entorhinal cortex. Journal of Neurophysiology, 96(6), 3305-3313.
33. Hausser, M., & Mel, B. (2003). Dendrites: Bug or feature? Current Opinion in Neurobiology, 13(3), 372-383.
34. Hausser, M., & Roth, A. (1997). Estimating the time course of the excitatory synaptic conductance in neocortical pyramidal cells using a novel voltage jump method. Journal of Neuroscience, 17(20), 7606-7625.
35. Heskes, T. (2004). On the uniqueness of loopy belief propagation fixed points. Neural Computation, 16(11), 2379-2413.
36. Hinton, G., Dayan, P., Frey, B., & Radford, N. (1995). The wake-sleep algorithm for unsupervised neural networks. Science, 268, 1158-1160.
37. Hinton, G.E., & Sejnowski, T.J. (1983). Optimal perceptual inference. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 448-453). Piscataway, NJ: IEEE Press.
38. Hinton, G.E., & Sejnowski, T.J. (1986). Learning and relearning in Boltzmann machines. In D.E. Rumelhart & J.L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition, Vol. 1: Foundations (pp. 282-317). Cambridge, MA: MIT Press.
39. Holmgren, C.D., & Zilberter, Y. (2001). Coincident spiking activity induces long-term changes in inhibition of neocortical pyramidal cells. Journal of Neuroscience, 21(20), 8270-8277.
40. Huys, Q.J., Zemel, R.S., Natarajan, R., & Dayan, P. (2007). Fast population coding. Neural Computation, 19(2), 404-441.
41. Ichinohe, N., Fujiyama, F., Kaneko, T., & Rockland, K.S. (2003). Honeycomb-like mosaic at the border of layers 1 and 2 in the cerebral cortex. Journal of Neuroscience, 23(4), 1372-1382.
42. Ichinohe, N., & Rockland, K.S. (2004). Region specific micromodularity in the uppermost layers in primate cerebral cortex. Cerebral Cortex, 14(11), 1173-1184.
43. Jaimovich, A., Elidan, G., Margalit, H., & Friedman, N. (2006). Towards an integrated protein-protein interaction network: A relational Markov network approach. Journal of Computational Biology, 13(2), 145-164.
44. Jazayeri, M., & Movshon, J.A. (2006). Optimal representation of sensory information by neural populations. Nature Neuroscience, 9(5), 690-696.
45. Johnson, R.R., & Burkhalter, A. (1997). A polysynaptic feedback circuit in rat visual cortex. Journal of Neuroscience, 17(18), 7129-7140.
46. Jones, E.G. (2000). Microcolumns in the cerebral cortex. Proceedings of the National Academy of Sciences, 97, 5019-5021.
47. Jordan, M.I. (1999). Learning in graphical models. Cambridge, MA: MIT Press.
48. Jordan, M.I., & Sejnowski, T.J. (2001). Graphical models: Foundations of neural computation. Cambridge, MA: MIT Press.
49. Jordan, M.I., & Weiss, Y. (2002). Probabilistic inference in graphical models. In M. Arbib (Ed.), Handbook of neural networks and brain theory (2nd ed.). Cambridge, MA: MIT Press.
50. Kampa, B.M., Letzkus, J.J., & Stuart, G.J. (2006). Cortical feed-forward networks for binding different streams of sensory information. Nature Neuroscience, 9(12), 1472-1473.
51. Kisvarday, Z.F., Ferecsko, A.S., Kovacs, K., Buzas, P., Budd, J.M., & Eysel, U.T. (2002). One axon-multiple functions: Specificity of lateral inhibitory connections by large basket cells. Journal of Neurocytology, 31(3-5), 255-264.
52. Knill, D.C., & Richards, W. (1996). Perception as Bayesian inference. Cambridge: Cambridge University Press.
53. Koechlin, E., Anton, J.L., & Burnod, Y. (1999). Bayesian inference in populations of cortical neurons: A model of motion integration and segmentation in area MT. Biological Cybernetics, 80(1), 25-44.
54. Kording, K.P., & Wolpert, D.M. (2004). Bayesian integration in sensorimotor learning. Nature, 427(6971), 244-247.
55. Kschischang, F.R., Frey, B.J., & Loeliger, H.-A. (2001). Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47(2), 498-519.
56. Lampl, I., Ferster, D., Poggio, T., & Riesenhuber, M. (2004). Intracellular measurements of spatial integration and the MAX operation in complex cells of the cat primary visual cortex. Journal of Neurophysiology, 92(5), 2704-2713.
57. Lee, T., & Mumford, D. (2003). Hierarchical Bayesian inference in the visual cortex. Journal of Optical Society of America, 20(7), 1434-1448.
58. Lev, D.L., & White, E.L. (1997). Organization of pyramidal cell apical dendrites and composition of dendritic clusters in the mouse: Emphasis on primary motor cortex. European Journal of Neuroscience, 9(2), 280-290.
59. Ma, W.J., Beck, J.M., Latham, P.E., & Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nature Neuroscience, 9(11), 1432-1438.
60. Maass, W., & Natschlager, T. (2000). A model for fast analog computation based on unreliable synapses. Neural Comput., 12(7), 1679-1704.
61. MacKay, D.J.C. (2003). Information theory, inference, and learning algorithms. Cambridge: Cambridge University Press.
62. Markram, H., Toledo-Rodriguez, M., Wang, Y., Gupta, A., Silberberg, G., & Wu, C. (2004). Interneurons of the neocortical inhibitory system. Nature Reviews Neuroscience, 5(10), 793-807.
63. Markram, H., Wang, Y., & Tsodyks, M. (1998). Differential signaling via the same axon of neocortical pyramidal neurons. Proceedings of the National Academy of Sciences, 95, 5323-5328.
64. Mel, B.W., & Koch, C. (1990). Sigma-pi learning: On radial basis functions and cortical associative learning. In D. Touretzky (Ed.), Advances in Neural information processing systems, 2 (pp. 474-481). San Francisco: Morgan Kaufmann.
65. Meltzer, T., Yanover, C., & Weiss, Y. (2005). Globally optimal solutions for energy minimization in stereo vision using reweighted Belief Propagation. In Proceedings of the IEEE International Conference on Computer Vision (pp. 428-435). Piscataway, NJ: IEEE Press.
66. Mountcastle, V.B. (2003). Introduction: Computation in cortical columns. Cerebral Cortex, 13(1), 2-4.
67. Murphy, K., Weiss, Y., & Jordan, M. (1999). Loopy belief propagation for approximate inference: an empirical study. In Proceedings of the Conference on Uncertainty in Artificial Intelligence (pp. 467-475). San Francisco: Morgan Kaufmann.
68. Natschläger, T., Markram, H., & Maass, W. (2003). Computer models and analysis tools for neural microcircuits. In R. Kötter (Ed.), Neuroscience databases: A practical guide (pp. 123-138). Norwell, MA: Kluwer.
69. Ohki, K., Chung, S., Ch'ng, Y. H., Kara, P., & Reid, R.C. (2005). Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex. Nature, 433(7026), 597-603.
70. Ott, T., & Stoop, R. (2006). The neurodynamics of belief propagation on binary Markov random fields. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 18 (pp. 1057-1064). Cambridge, MA: MIT Press.
71. Pearl, J. (1987). Distributed revision of composite beliefs. Artificial Intelligence, 33(2), 173-215.
72. Pearl, J. (1988). Probabilistic reasoning in intelligent systems: Networks of plausible inference. San Mateo, CA: Morgan Kaufmann.
73. Peters, A., & Sethares, C. (1997). The organization of double bouquet cells in monkey striate cortex. Journal of Neurocytology, 26(12), 779-797.
74. Pouget, A., Dayan, P., & Zemel, R.S. (2003). Inference and computation with population codes. Annual Review of Neuroscience, 26, 381-410.
75. Rao, R.P. (2004a). Bayesian computation in recurrent neural circuits. Neural Computation, 16(1), 1-38.
76. Rao, R.P.N. (2004b). Bayesian computation in recurrent neural circuits. Neural Computation, 16(1), 1-38.
77. Rao, R.P. (2005a). Bayesian inference and attentional modulation in the visual cortex. Neuroreport, 16(16), 1843-1848.
78. Rao, R.P.N. (2005b). Hierarchical Bayesian inference in networks of spiking neurons. In L.K. Saul, Y. Weiss, & L. Bottou (Eds.), Advances in neural information processing systems, 17 (pp. 1113-1120). Cambridge, MA: MIT Press.
79. Rao, R.P., & Ballard, D.H. (1999). Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2(1), 79-87.
80. Rao, R.P.N., Olshausen, B.A., & Lewicki, M.S. (Eds). (2002). Probabilistic models of the brain: Perception and neural function. Cambridge, MA.: MIT Press.
81. Riesenhuber, M., & Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nature Neuroscience, 2(11), 1019-1025.
82. Rockland, K.S. (1997). Elements of cortical architecture: hierarchy revisited. In K.S. Rockland, J.H. Kaas, & A. Peters (Eds.), Cerebral cortex: Extrastriate cortex in primates (pp. 243-293). New York: Plenum Press.
83. Rockland, K.S., & Ichinohe, N. (2004). Some thoughts on cortical minicolumns. Exp. Brain. Res., 158(3), 265-277.
84. Sahani, M., & Dayan, P. (2003). Doubly distributional population codes: Simultaneous representation of uncertainty and multiplicity. Neural Computation, 15(10), 2255-2279.
85. Salin, P.A., Kennedy, H., & Bullier, J. (1995). Spatial reciprocity of connections between areas 17 and 18 in the cat. Canadian Journal of Physiology and Pharmacology, 73(9), 1339-1347.
86. Samejima, K., Doya, K., Ueda, K., & Kimura, M. (2004). Estimating internal variables and parameters of a learning agent by a particle filter. In S. Thrün, L. Saul, & B. Scholkopf (Eds.), Advances in neural information processing systems, 16 (pp. 1335-1342). Cambridge, MA.: MIT Press.
87. Seung, H.S., & Sompolinsky, H. (1993). Simple models for reading neuronal population codes. Proceedings of the National Academy of Science, 90, 10749-10753.
88. Song, S., Sjostrom, P.J., Reigl, M., Nelson, S., & Chklovskii, D.B. (2005). Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biology, 3(3), e68.
89. Stocker, A.A., & Simoncelli, E.P. (2006). Noise characteristics and prior expectations in human visual speed perception. Nature Neuroscience, 9(4), 578-585.
90. Ullman, S. (1995). Sequence seeking and counter streams: A computational model for bidirectional information flow in the visual cortex. Cerebral Cortex, 5(1), 1-11.
91. Wang, Y., Markram, H., Goodman, P.H., Berger, T.K., Ma, J., & Goldman-Rakic, P.S. (2006). Heterogeneity in the pyramidal network of the medial prefrontal cortex. Nature Neuroscience, 9(4), 534-542.
92. Weiss, Y. (1997). Belief propagation and revision in networks with Loops (No. AIM-1616). Cambridge, MA: Massachusetts Institute of Technology.
93. Weiss, Y., Simoncelli, E.P., & Adelson, E.H. (2002). Motion illusions as optimal percepts. Nature Neuroscience, 5(6), 598-604.
94. Wilson, H.R., & Cowan, J.D. (1972). Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical Journal, 12(1), 1-24.
95. Yang, T., & Shadlen, M.N. (2007). Probabilistic reasoning by neurons. Nature, 447(7148), 1075-1080.
96. Yedidia, J., Freeman, W., & Weiss, Y. (2003). Understanding belief propagation and its generalizations. In G. Lakemeyer & B. Nebel (Eds.), Exploring artificial intelligence in the new millennium (pp. 239-269). San Francisco: Morgan Kaufmann.
97. Yoshimura, Y., & Callaway, E.M. (2005). Fine-scale specificity of cortical networks depends on inhibitory cell type and connectivity. Nature Neuroscience, 8(11), 1552-1559.
98. Yoshimura, Y., Dantzker, J.L., & Callaway, E.M. (2005). Excitatory cortical neurons form fine-scale functional networks. Nature, 433(7028), 868-873.
99. Yu, A.J., Giese, M.A., & Poggio, T.A. (2002). Biophysiologically plausible implementations of the maximum operation. Neural Computation, 14(12), 2857-2881.
100. Yuille, A.L. (2002). CCCP algorithms to minimize the Bethe and Kikuchi free energies: Convergent alternatives to belief propagation. Neural Computation, 14(7), 1691-1722.
101. Zemel, R.S., Dayan, P., & Pouget, A. (1998). Probabilistic interpretation of population codes. Neural Computation, 10(2), 403-430.
102. Zhang, K., Ginzburg, I., McNaughton, B.L., & Sejnowski, T.J. (1998). Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. Journal of Neurophysiology, 79(2), 1017-1044.