A neuron as a signal processing device

Conference Record - Asilomar Conference on Signals, Systems and Computers

Volumn , Issue , 2013, Pages 362-366

  Hu, Tao ^a,b   Towfic, Zaid J ^a,c   Pehlevan, Cengiz ^a   Genkin, Alex ^a,d   Chklovskii, Dmitri B ^a  

^a HOWARD HUGHES MEDICAL INSTITUTE   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c Engineering IV   (United States)

^d AVG Consulting   (United States)

Author keywords

feature learning; leaky integrate fire; neuron; Oja algorithm; online matrix factorization; subspace tracking

Indexed keywords

COST FUNCTIONS; LEARNING ALGORITHMS; PHYSIOLOGICAL MODELS; PHYSIOLOGY; SIGNAL PROCESSING;

BIOPHYSICAL PARAMETERS; FEATURE LEARNING; ONLINE MATRIX; PHYSIOLOGICAL PROPERTIES; REGULARIZATION TERMS; SIGNAL PROCESSING DEVICES; SUBSPACE TRACKING; THEORETICAL FRAMEWORK;

NEURONS;

EID: 84901281540     PISSN: 10586393     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACSSC.2013.6810296     Document Type: Conference Paper

References (29)

1. A. J. Yu, "Optimal change-detection and spiking neurons, " in Advances in Neural Information Processing Systems, 2007, pp. 1545-1552.
2. M. Boerlin and S. Deneve, "Spike-based population coding and working memory, " PLoS Comput Biol, vol. 7, p. e1001080, Feb 2011.
3. J. P. Pfister, et al., "Synapses with short-term plasticity are optimal estimators of presynaptic membrane potentials, " Nat Neurosci, vol. 13, pp. 1271-5, Oct 2010.
4. E. Oja, "A simplified neuron model as a principal component analyzer, " Journal of Mathematical Biology, vol. 15, pp. 267-273, 1982.
5. A. Hyvärinen and E. Oja, "Independent component analysis by general nonlinear Hebbian-like learning rules, " Signal Processing, vol. 64, pp. 301-313, 1998.
6. A. Rakhlin, "Lecture notes on online convex optimization, " 2009.
7. S. Shalev-Shwartz, "Online Learning and Online Convex Optimization, " Foundations and Trends in Machine Learning, vol. 4, pp. 107-194, 2011.
8. E. Hazan, "The convex optimization approach to regret minimization, " in Optimization for Machine Learning, S. Sra, et al., Eds., ed: MIT press, 2011, pp. 287-303.
9. D. P. Bertsekas and J. N. Tsisiklis, Parallel and distributed computation: nmberical methods. Prentice-Hall, Englewood Cliffs, NJ. 1989.
10. D.M. Witten, R. Tibshirani, &T. Hastie. "A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis." Biostatistics 10.3 (2009): 515-534.
11. M. Lee, H. Shen, J. Z. Huang, and J. S. Marron, "Biclustering via sparse singular value decomposition", Biometrics vol. 66, pp. 1087-1095, 2010.
12. B. Yang, "Projection approximation subspace tracking, " IEEE Trans. Signal Process., vol. 44, pp. 95-107, Jan. 1995.
13. Y. Chi, Y. C. Eldar and R. Calderbank, "PETRELS: Parallel Subspace Estimation and Tracking by Recursive Least Squares From Partial Observations, " IEEE Trans. Signal Process., vol. 61, pp.5947-5959, 2013.
14. L. Balzano, R. Nowak, and B. Recht, "Online identification and tracking of subspaces from highly incomplete information" in Proceedings of Allerton, September 2010.
15. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images, " Nature, vol. 381, pp. 607-9, 1996.
16. S.P. Kasiviswanathan et al. "Online l1-Dictionary Learning with Application to Novel Document Detection." Advances in Neural Information Processing Systems 25. 2012.
17. N. Cesa-Bianchi, &G. Lugosi, "Learning Prediction. Games" Cambridge University Press (2006).
18. J.C. Magee, &E.P. Cook, "Somatic EPSP amplitude is independent of synapse location in hippocampal pyramidal neurons." Nature neuroscience, 3(9), 895-903, 2000.
19. T. Tateno, A. Harsch, &H.P.C. Robinson. "Threshold firing frequency-current relationships of neurons in rat somatosensory cortex: type 1 and type 2 dynamics." Journal of neurophysiology 92.4 (2004): 2283-2294.
20. S. Song, et al., "Highly nonrandom features of synaptic connectivity in local cortical circuits, " PLoS Biol, vol. 3, p. e68, 2005.
21. M. Crair and R. Malenka, "A critical period for long-term potentiation at thalamocortical synapses, " Nature, vol. 375, pp. 325-327, 1995.
22. A. Kirkwood, H. K. Lee, and M. F. Bear, "Co-regulation of long-term potentiation and experience-dependent synaptic plasticity in visual cortex by age and experience, " Nature, vol. 375, pp. 328-331, 1995.
23. C. Poo and J. S. Isaacson, "An early critical period for long-term plasticity and structural modification of sensory synapses in olfactory cortex, " J. Neurosci, vol. 27, pp. 7553-7558, 2007.
24. D. Liao, N.A. Hessler, &R. Malinow. "Activation of postsynaptically silent synapses during pairing-induced LTP in CA1 region of hippocampal slice." Nature 375.6530 (1995): 400-403.
25. G.A. Kerchner &R.A. Nicoll. "Silent synapses and the emergence of a postsynaptic mechanism for LTP." Nature Reviews Neuroscience 9.11 (2008): 813-825.
26. L. R. Varshney, et al., "Optimal information storage in noisy synapses under resource constraints, " Neuron, vol. 52, pp. 409-23, 2006.
27. Y. Mishchenko, et al., "Ultrastructural analysis of hippocampal neuropil from the connectomics perspective, " Neuron, vol. 67, pp. 1009-20, 2010.
28. D.H. Hubel, &T.N. Wiesel. Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology, London, 195, 215-243.
29. C. J. Rozell, D. H. Johnson, R. G. Baraniuk, and B.A. Olshausen, "Sparse coding via thresholding and local competition in neural circuits, " Neural Computation, vol. 20, pp. 2526-2563, 2008.