FastNMF: Highly efficient monotonic fixed-point nonnegative matrix factorization algorithm with good applicability

Journal of Electronic Imaging

Volumn 18, Issue 3, 2009, Pages

  Li, Le ^a   Zhang, Yu Jin ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ACCURACY; BASIC PROPERTIES; DESIGN PHILOSOPHY; DIMENSIONALITY REDUCTION; EASE OF USE; FIXED-POINT ALGORITHMS; HIGHER EFFICIENCY; LEAST SQUARE; MINIMIZATION PROBLEMS; NON-NEGATIVE FACTORIZATION; NON-NEGATIVE MATRIX FACTORIZATION ALGORITHMS; NONNEGATIVE MATRIX FACTORIZATION;

APPROXIMATION ALGORITHMS; FACTORIZATION; FEATURE EXTRACTION;

MATRIX ALGEBRA;

EID: 80455168744     PISSN: 10179909     EISSN: 1560229X     Source Type: Journal    
DOI: 10.1117/1.3184771     Document Type: Article

References (24)

1. D. D. Lee and H. S. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature (London) 401(6755), 788-791 (1999).
2. S. E. Palmer, "Hierarchical structure in perceptual representation," Cogn. Psychol. 9(3), 441-474 (1977).
3. E. Wachsmuth, M. W. Oram, and D. I. Perrett, "Recognition of objects and their component parts: Responses of single units in the temporal cortex of the macaque," Cereb. Cortex 4(5), 509-522 (1994). (Pubitemid 24297014)
4. N. K. Logothetis and D. L. Sheinberg, "Visual object recognition," Annu. Rev. Neurosci. 19(1), 577-621 (1996). (Pubitemid 26080840)
5. D. J. Field, "What is the goal of sensory coding?" Neural Comput. 6(4), 559-601 (1994).
6. S. Wild, J. Curry, and A. Dougherty, "Improving non-negative matrix factorizations through structured initialization," Pattern Recogn. 37(11), 2217-2232 (2004).7. O. Okun and H. Priisalu, "Fast nonnegative matrix factorization and its application for protein fold recognition," EURASIP J. Appl. Signal Process. 71817 (2006).
7. W. Liu, N. Zheng, and X. Li, "Relative gradient speeding up additive updates for nonnegative matrix factorization," Neurocomputing 57, 493-499 (2004). (Pubitemid 38401037)
8. M. Heiler and C. Schnorr, "Learning sparse representations by nonnegative matrix factorization and sequential cone programming," J. Mach. Learn. Res. 7(7), 1385-1407 (2005).
9. I. Dhillon and S. Sra, "Generalized nonnegative matrix approximations with Bregman divergences," in Adv. Neural Inf. Process. Syst. 283-290, MIT Press, Cambridge, MA (2005).
10. A. Cichocki, S. Amari, R. Zdunek, R. Kompass, G. Hori, and Z. He, "Extended SMART algorithms for non-negative matrix factorization," Lecture Notes Artificial Intell. 4029, 548-562 (2006). (Pubitemid 44089843)
11. A. Cichocki, R. Zdunek, and S. Amari, "Csiszar's divergences for non-negative matrix factorization: Family of new algorithms," Lect. Notes Comput. Sci. 3889, 32-39 (2006). (Pubitemid 43998396)
12. R. Zdunek and A. Cichocki, "Non-negative matrix factorization with quasi-newton optimization," Lecture Notes Artificial Intell. 4029, 870-879 (2006). (Pubitemid 44089876)
13. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Adv. Neural Inf. Process. Syst. 2001(13), 556-562 (2001).
14. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res. 5(9), 1457-1469 (2004).
15. A. Pascual-Montano, J. M. Carzzo, K. Lochi, D. Lehmann, and R. D. Pascual-Marqui, "Nonsmooth nonnegative matrix factorization (nsNMF)," IEEE Trans. Pattern Anal. Mach. Intell. 28(3), 403-415 (2006). (Pubitemid 43159636)
16. D. Guillamet, J. Vitrià, and B. Schiele, "Introducing a weighted nonnegative matrix factorization for image classification," Pattern Recogn. Lett. 24(14), 2447-2454 (2003). (Pubitemid 36911088)
17. G. L. Wang, A. V. Kossenkov, and M. F. Ochs, "LS-NMF: A modified non-negative matrix factorization algorithm utilizing uncertainty estimates," BMC Bioinf. 7, 175 (2006).
18. ORL face database, at the AT&T (Olivetti) Research Laboratory, http://www.cl.cam.ac.uk/Research/DTG/archive/facedatabase.html (1992).
19. D. P. Bertsekas, Nonlinear Programming, 2nd ed., Athena Scientific, Belmont, MA (1999).
20. D. G. Luenberger, Introduction to Linear and Nonlinear Programming. Addison-Wesley, Reading, MA (1973).
21. MIT CBCL PEDESTRIAN database, at MIT CBCL Center for Biological and Computational Learning, http://cbcl.mit.edu/softwaredatasets/PedestrianData.html (2000).
22. A. Cichocki and A.-H. Phan, "Fast local algorithms for large scale nonnegative matrix and tensor factorizations," IEICE Trans. Fundamentals E92-A(3), 708-721 (2009).
23. A. Cichocki, R. Zdunek, and S. Amari, "Hierarchical ALS algorithms for nonnegative matrix and 3D tensor factorization," Lect. Notes Comput. Sci. 4666, 169-176 (2007).
24. A. Cichocki, A.-H. Phan, and C. Caiafa, "Flexible HALS algorithms for sparse non-negative matrix/tensor factorization," in Proc. 2008 IEEE Int. Workshop on Machine Learning and Signal Processing, pp. 73-78, IEEE, Piscataway, NJ (2008).