SENSC: A stable and efficient algorithm for nonnegative sparse coding

Zidonghua Xuebao/ Acta Automatica Sinica

Volumn 35, Issue 10, 2009, Pages 1257-1271

  Li, Le ^a   Zhang, Yu Jin ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Hyper paraboloid; Nonnegative matrix factorization (NMF); Nonnegative sparse coding (NSC); Sparse coding (SC)

Indexed keywords

AUXILIARY FUNCTIONS; EFFICIENT ALGORITHM; GRADIENT PROJECTIONS; MULTIPLICATIVE UPDATES; NON-NEGATIVE SPARSE CODING; NONNEGATIVE MATRIX FACTORIZATION; OPTIMIZATION METHOD; OPTIMIZATION PARAMETER; PROJECTION FORMULAS; RESEARCH FIELDS; SPARSE CODING; STABILITY AND CONVERGENCE; STEP SIZE;

FACTORIZATION; FLUORINE CONTAINING POLYMERS; LIGHT MEASUREMENT; OPTIMIZATION;

ALGORITHMS;

EID: 70749129407     PISSN: 02544156     EISSN: None     Source Type: Journal    
DOI: 10.3724/SP.J.1004.2009.01257     Document Type: Article

References (17)

1. Olshausen B A, Field D J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 1996, 381(6583): 607-609.
2. Hoyer P O. Non-negative sparse coding. In: Proceedings of IEEE Workshop on Neural Networks for Signal Processing. Martigny, Switzerland: IEEE, 2002. 557-565.
3. Hoyer P O. Modeling receptive fields with non-negative sparse coding. Neurocomputing, 2003, 52-54: 547-552.
4. Palmer S E. Hierarchical structure in perceptual representation. Cognitive Psychology, 1977, 9(4): 441-474.
5. Wachsmuth E, Oram M W, Perrett D I. Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. Cerebral Cortex, 1994, 4(5): 509-522.
6. Logothetis N K, Sheinberg D L. Visual object recognition. Annual Review of Neuroscience, 1996, 19(1): 577-621.
7. Lee D D, Seung H S. Learning the parts of objects by non-negative matrix factorization. Nature, 1999, 401(6755): 788-791.
8. Hoyer P O, Hyvarinen A. A multi-layer sparse coding network learns contour coding from natural images. Vision Research, 2002, 42(12): 1593-1605.
9. Shang Li, Huang De-Shuang, Zheng Chun-Hou. Natural image denoising method based on non-negative sparse coding shrinkage. Journal of University of Science and Technology of China, 2006, 36(5): 497-501.
10. Shastri B J, Levine M D. Face recognition using localized features based on non-negative sparse coding. Machine Vision and Applications, 2007, 18(2): 107-122.
11. Liu W X, Zheng N N, Lu X F. Non-negative matrix factorization for visual coding. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing. Hong Kong, China: IEEE, 2003. 293-296.
12. Lee D D, Seung H S. Algorithms for non-negative matrix factorization. Advance in Neural Information Processing Systems. Cambridge: MIT Press, 2000. 556-562.
13. AT&T Laboratories Cambridge. The database of face[Online], available: http://www.cl.cam.ac.uk/research/dtg/archive/facedatabase.html, April 8, 2008.
14. Hoyer P O. Non-negative matrix factorization with sparseness constraints. The Journal of Machine Learning Research, 2004, 5(9): 1457-1469.
15. Bertsekas D P. Nonlinear Programming (Second Edition). Massachusetts: Athena Scientific, 1999.
16. Luenberger D G. Introduction to Linear and Nonlinear Programming. Massachusetts: Addison-Wesley, 1973.
17. Chen Bao-Lin. Theories and Algorithms of Optimization. Beijing: Tsinghua University Press, 1989.