Efficient online learning of a non-negative sparse autoencoder

Proceedings of the 18th European Symposium on Artificial Neural Networks - Computational Intelligence and Machine Learning, ESANN 2010

Volumn , Issue , 2010, Pages 1-6

  Lemme, Andre ^a   Reinhart, R Felix ^a   Steil, Jochen J ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BATCH ALGORITHMS; BENCHMARK DATASETS; NON NEGATIVES; NON-NEGATIVE SPARSE CODING; NONNEGATIVE MATRIX FACTORIZATION; ONLINE LEARNING; RECONSTRUCTION ERROR; SPARSENESS CONSTRAINTS;

ALGORITHMS; LEARNING SYSTEMS; NEURAL NETWORKS;

E-LEARNING;

EID: 84863864196     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. M. Spratling. Learning Image Components for Object Recognition. Mach. Learn., 2006.
2. D. D. Lee, and H. S. Seung. Learning the parts of objects by nonnegative matrix factorization. Nature, pp. 788-791, 1999.
3. P. O. Hoyer. Non-negative sparse coding. Neural Networks for Signal Processing XII, pp. 557-565, 2002.
4. P. O. Hoyer. Non-negative Matrix Factorization with Sparseness Constraints. Journal of Machine Learning Research, pp. 1457-1469, 2004.
5. Y-lan Boureau and Y. Lecun. Sparse Feature Learning for Deep Belief Networks. NIPS, pp. 1-8, 2007.
6. B. Cao. Detect and Track Latent Factors with Online Nonnegative Matrix Factorization Matrix, pp. 2689-2694, 1999.
7. M. D. Plumbley and O. Erkki. A "nonnegative PCA" algorithm for independent component analysis. Neural Networks, pp. 66-76, 2004.
8. J. Triesch. A Gradient Rule for the Plasticity of a Neuron's Intrinsic Excitability. Neural Computation, pp. 65-70, 2005.
9. Variations of the MNIST database. http://www.iro.umontreal.ca/~lisa/ptwiki.
10. G. E. Hinton and S. Osindero. A fast learning algorithm for deep belief nets. Neural Computation, pp. 1527-54, 2006.
11. P. Vincent and H. Larochelle and Y. Bengio. Extracting and composing robust features with denoising autoencoders ICML'08, pp. 1096-1103, 2008.
12. J. J. Steil. Backpropagation-Decorrelation: online recurrent learning with O(N) complexity Proc. IJCNN, pp. 843-848, 2004.
13. J. Triesch. Synergies Between Intrinsic and Synaptic Plasticity Mechanisms. Neural Computation, pp. 885-909, 2007.
14. Y. Lecun and C. Cortes. The MNIST database of handwritten digits. http://yann.lecun.com/exdb/mnist.