Non-negative matrix factorization with sparseness constraints

Journal of Machine Learning Research

Volumn 5, Issue , 2004, Pages 1457-1469

  Hoyer, Patrik O ^a  

^a UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Data adaptive representations; Non negative matrix factorization; Sparseness

Indexed keywords

FACE RECOGNITION; FACTORIZATION; MATLAB;

ADAPTIVE REPRESENTATIONS; ANALYSIS PROBLEMS; LINEAR REPRESENTATION; MATLAB CODE; NON NEGATIVES; NONNEGATIVE MATRIX FACTORIZATION; SPARSENESS; SPARSENESS CONSTRAINTS;

MATRIX ALGEBRA;

EID: 84900510076     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (25)

1. A. J. Bell and T. J. Sejnowski. The 'independent components' of natural scenes are edge filters. Vision Research, 37:3327-3338, 1997.
2. J. P. Brunet, P. Tamayo, T. R. Golub, and J. P. Mesirov. Metagenes and molecular pattern discovery using matrix factorization. Proceedings of the National Academy of Sciences, 101:4164-4169, 2004.
3. G. Buchsbaum and O. Bloch. Color categories revealed by non-negative matrix factorization of munsell color spectra. Vision Research, 42:559-563, 2002.
4. ∗2003). MIT Press, 2004.
5. D. J. Field. Relations between the statistics of natural images and the response properties of cortical cells. Journal of the Optical Society of America, 4:2379-2394, 1987.
6. D. J. Field. What is the goal of sensory coding? Neural Computation, 6:559-601, 1994.
7. P. Földiák and M. P. Young. Sparse coding in the primate cortex. In Michael A. Arbib, editor, The Handbook of Brain Theory and Neural Networks, pages 895-898. The MIT Press, Cambridge, Massachusetts, 1995.
8. P. O. Hoyer. Non-negative sparse coding. In Neural Networks for Signal Processing XII (Proc. IEEE Workshop on Neural Networks for Signal Processing), pages 557-565, Martigny, Switzerland, 2002.
9. P. O. Hoyer. Modeling receptive fields with non-negative sparse coding. In E. De Schutter, editor, Computational Neuroscience: Trends in Research 2003. Elsevier, Amsterdam, 2003.
10. Also published in: Neurocomputing 52-54(2003), pp 547-552.
11. A. Hyvärinen, J. Karhunen, and E. Oja. Independent Component Analysis. Wiley Interscience, 2001.
12. K. Jung and E. Y. Kim. Automatic text extraction for content-based image indexing. Advances in Knowledge Discovery and Data Mining: Proceedings Lecture Notes in Artificial Intelligence, 3056:497-507, 2004.
13. P. M. Kim and B. Tidor. Subsystem identification through dimensionality reduction of large-scale gene expression data. Genome Research, 13:1706-1718, 2003.
14. D. D. Lee and H. S. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755):788-791, 1999.
15. ∗2000). MIT Press, 2001.
16. S. Z. Li, X. Hou, H. Zhang, and Q. Cheng. Learning spatially localized parts-based representations. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Vol. I, pages 207-212, Hawaii, USA, 2001.
17. W. Liu, N. Zheng, and X. Lu. Non-negative matrix factorization for visual coding. In Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP'2003), 2003.
18. E. Oja and M. Plumbley. Blind separation of positive sources by globally convergent gradient search. Neural Computation, 16(9):1811-1825, 2004.
19. B. A. Olshausen and D. J. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607-609, 1996.
20. P. Paatero and U. Tapper. Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values. Environmetrics, 5:111-126, 1994.
21. ∗99), pages 942-948. MIT Press, 2000.
22. M. Plumbley. Algorithms for non-negative independent component analysis. IEEE Transactions on Neural Networks, 14(3):534-543, 2003.
23. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger. Shiftable multiscale transforms. IEEE Transactions on Information Theory, 38:587-607, 1992.
24. J. V. Stone, J. Porrill, N. R. Porter, and I. D. Wilkinson. Spatiotemporal independent component analysis of event-related fMRI data using skewed probability density functions. Neuroimage, 15:407-421, 2002.
25. S. Thorpe. Localized versus distributed representations. In Michael A. Arbib, editor, The Handbook of Brain Theory and Neural Networks, pages 549-552. The MIT Press, Cambridge, Massachusetts, 1995.