Towards a cross-level theory of neural learning

AIP Conference Proceedings

Volumn 954, Issue , 2007, Pages 56-73

  Bell, Anthony J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Machine learning; Neuroscience; Reductionist hierarchy; Spiking neurons

Indexed keywords

EID: 71449107306     PISSN: 0094243X     EISSN: 15517616     Source Type: Conference Proceeding    
DOI: 10.1063/1.2821301     Document Type: Conference Paper

References (50)

1. Allen E.A et al. 2007. Transcranial magnetic stimulation elicits coupled neural and hemodynmaic consequences. Science, 317, 1918-21
2. Amari S.-I., Cichocki A. and Yang H.H. 1996. A New Learning Algorithm for Blind Signal Separation. Advances in Neural Information Processing Systems 8, 757-763, MIT Press, Cambridge MA
3. Amari S-I. 1997. Natural gradient works efficiently in learning. Neural Computation, 10, 251-276
4. Bell A.J. and Sejnowski T.J. 1995. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7, 6, 1129-1159
5. Bell A.J. and Sejnowski T.J. 1997. The 'independent' components of natural images are edge-filters. Vision Research, 37, 3327-3338
6. Bell A.J. Levels and loops: the future of Artificial Intelligence and Neuroscience. 1999. Phil. Trans. R. Soc. Land. B 354, 2013-2020
7. Bell A.J. 2002. The co-information lattice. 4th International Symposium on Independent Component Analysis and Blind Source Separation, Nara, Japan
8. Bell A.J. and Parra L.C. 2005. Maximising sensitivity in a spiking network. Advances in Neural Information Processing Systems 17, MIT Press
9. Berridge M.J. 1998. Neuronal calcium signaling. Neuron, 21, 13-26
10. Blanche T.J., Freiwald W.A. and Swindale N.V. 2006. Neural sparseness in cat and monkey visual cortex studied with silicon polytrode arrays. Society of Neuroscience Abstracts, Atlanta, Georgia
11. Buzsaki G. 2006. Rhythms of the brain. Oxford Univ. Press
12. Cardoso J.-F. 1997. Infomax and maximum likelihood for blind source separation. IEEE Signal Processing Letters, 4, 4, 112-114
13. Caticha A. and Cafaro C. 2008. From information geometry to Newtonian dynamics. In [31] (this volume)
14. Canolty R.T et al. 2006. High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex. Science, 313, 5793, 1626-28
15. Dan, Y. & Poo, M.-m 2004. Spike timing-dependent plasticity of neural circuits. Neuron 44, 23-30
16. Dewar R.C. 2005. Maximum entropy production and the fluctuation theorem J. Phys. A: Math. Gen., 38, L371-381
17. DeWeese M.R., Wehr M. and Zador A.M. 2003. Binary spiking in auditory cortex. J. Neurosci., 23, 7940
18. Ellis R. J. 2001. Macromolecular crowding: obvious but underappreciated. Trends in Biochem. Sci., 26, 10, 597-604
19. Ernst M.O. and Banks M.S. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 6870, 429-33
20. Fries P. 2005. A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn. Sci., 9, 474
21. Fries P., Nicotic D. and Singer W. 2007. The gamma cycle. Trends Neurosci., 30, 7, 309-16
22. Gerstner W. and Kistner W.M. 2002. Spiking neuron models. Cambridge University Press
23. Hancock J.F. Lipid rafts: contentious only from simplistic standpoints. 2006. Nature Rev. Molec. Cell Biol., 7, 456-462
24. Hinton G.E. and Sejnowski T.J. 1986. Learning and relearning in Boltzmann machines. In Rumelhart D.E. and McClelland J.L. (eds) Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press
25. Hinton G.E. et al. 2001. A New View of ICA, Proceedings of ICA 2001, San Diego, CA.
26. Hinton, G.E. 2002. Training Products of Experts by Minimizing Contrastive Divergence. Neural Computation, 14, 1771-1800
27. Hyvärinen A. and Hoyer P. 2001. A Two-Layer Sparse Coding Model Learns Simple and Complex Cell Receptive Fields and Topography from Natural Images. Vision Research, 41, 18, 2413-23
28. Jacobson K., Mouritsen O.G. and Anderson R.G.W. 2007. Lipid rafts: at a crossroads between cell biology and physics. Nature Cell Biol., 9, 1, 7-14
29. Karklin Y. and Lewicki M.S. 2005. A hierarchical Bayesian model for learning non-linear statistical regularities in non-stationary natural signals. Neural Computation, 17, 2, 397-423
30. Klyubin A.S., Polani D. and Nehaniv C.L. 2007. Representations of space and time in the maximization of information flow in the perception-action loop. Neural Computation, 19, 2387-2432
31. Knuth K.H. et al. 2007. Bayesian Inference and Maximum Entropy Methods in Science and Engineering, Saratoga Springs, NY, USA, AIP Conf. Proa, Melville NY:AIP
32. Knuth K.H., Erner P.M. and Frasso S. 2007. Designing intelligent instruments. [31] (this volume)
33. Koepsell K. et al. 2008. Retinal oscillations carry visual information to cortex, under review
34. Lakatos P. et al. 2005. An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. J. Neurophysiol., 94, 1904-11
35. Laughlin R.B. 2006. A different universe: reinventing physics from the bottom down. Basic Books, NY
36. Maturana H. and Varela F 1973. Autopoiesis and cognition: the realization of the living. Dordecht: D. Reidel
37. Moon T.K. and Gunther J.H. 2002. Contravariant adaptation on structured matrix spaces. Signal Processing, 82, 10, 1389-1410
38. Olshausen B. and Field D.F 1997. Emergence of simple-sell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609
39. Osindero S., Welling M. and Hinton, G.E. 2006. Topographic Product Models Applied To Natural Scene Statistics. Neural Computation, 18, 2
40. Parra L.C., Beck J. and Bell A.J. 2008. On the maximisation of information flow between spiking neurons under review
41. Radman T. et al. 2007. Spike timing amplifies the effect of electric fields on neurons: implications for endogenous field effects, J. Neurosci., 27, 3030-3036
42. Rieke F. and Baylor D.A. 1998. Single-photon detection by rod cells of the retina. Rev. Mod. Phys. 70, 1027-36
43. Sejnowski T.J. and Paulsen O. 2006. Network oscillations: emerging computational principles. J. Neurosci., 26, 6, 1673-76
44. Sheng M. and Hoogenraad C.C. 2007. The postsynaptic architecture of excitatory synapses: a more quantitative view, Annu. Rev. Biochem., 76, 823-47
45. Simoncelli E.P and Olshausen B.A. 2001. Natural image statistics and neural representation, Annu Rev Neurosci. 24, 1193-216
46. Spitzer J.J. and Poolman B. 2005. Electrochemical structure of the crowded cytoplasm. Trends in Biochem. Sci., 30, 10, 536-541
47. Theis F.J. 2005. Gradients on matrix manifolds and their chain rule. Neural Information Processing Letters, 9, 1, 1-13
48. van Hateren J.H. and Ruderman D.L. 1998. Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex. Proc. R. Soc. Lond. B, 265, 2315-2320
49. Welling, M., Hinton, G.E. and Osindero, S. 2003. Learning Sparse Topographic Representations with Products of Student-t Distributions. Advances in Neural Information Processing Systems 15, MIT Press, Cambridge, MA
50. Zinn-Justin J. 2002. Quantum field theory and critical phenomena. Oxford Univ. Press