Symmetric nonnegative matrix factorization: Algorithms and applications to probabilistic clustering

IEEE Transactions on Neural Networks

Volumn 22, Issue 12 PART 1, 2011, Pages 2117-2131

  He, Zhaoshui ^a,b   Xie, Shengli ^a   Zdunek, Rafal ^c   Zhou, Guoxu ^a,b   Cichocki, Andrzej ^b,d  

^a GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^c WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

^d SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

Basic linear algebra subprograms; completely positive; coordinate update; multiplicative update; nonnegative matrix factorization; parallel update; probabilistic clustering; symmetric nonnegative matrix factorization

Indexed keywords

BASIC LINEAR ALGEBRA SUBPROGRAMS; COMPLETELY POSITIVE; COORDINATE UPDATE; MULTIPLICATIVE UPDATES; NONNEGATIVE MATRIX FACTORIZATION; PARALLEL UPDATE; PROBABILISTIC CLUSTERING;

ALGEBRA; CLUSTERING ALGORITHMS; FACTORIZATION; GENE EXPRESSION; IMAGE PROCESSING; SEMANTICS; UNSUPERVISED LEARNING;

MATRIX ALGEBRA;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; METHODOLOGY; STATISTICAL ANALYSIS; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATA INTERPRETATION, STATISTICAL; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 83855161608     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2172457     Document Type: Article

References (45)

1. A. Cichocki, R. Zdunek, A. H. Phan, and S. I. Amari, Nonnegative Matrix and Tensor Factorizations. New York: Wiley, Nov. 2009.
2. P. Paatero and U. Tapper, "Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, no. 2, pp. 111-126, Jun. 1994.
3. M. Craig, "Minimum-volume transforms for remotely sensed data," IEEE Trans. Geosci. Remote Sens., vol. 32, no. 3, pp. 542-552, May 1994.
4. E. Bauer, D. Koller, and Y. Singer, "Update rules for parameter estimation in Bayesian networks," in Proc. 13th Conf. Uncertainty Artif. Intell., 1997, pp. 3-13.
5. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 401, no. 6755, pp. 788-791, Oct. 1999.
6. S. Zafeiriou, A. Tefas, I. Buciu, and I. Pitas, "Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 683-95, May 2006.
7. F. Sha, L. K. Saul, and D. D. Lee, "Multiplicative updates for nonnega-tive quadratic programming in support vector machines," in Proc. Adv. Neural Inf. Process. Syst., 2002, pp. 1041-1048.
8. F. Sha, L. K. Saul, and D. D. Lee, "Multiplicative updates for large margin classifiers," in Learning Theory and Kernel Machines (Lecture Notes in Computer Science), vol. 2777. New York: Springer-Verlag, Feb. 2004, pp. 188-202.
9. F. Sha, Y. Q. Lin, L. K. Saul, and D. D. Lee, "Multiplicative updates for nonnegative quadratic programming," Neural Comput., vol. 19, no. 8, pp. 2004-2031, Aug. 2007.
10. R. Zass and A. Shashua, "A unifying approach to hard and probabilistic clustering," in Proc. 10th IEEE Int. Conf. Comput. Vis., vol. 1. Oct. 2005, pp. 294-301. (Pubitemid 44054972)
11. Y. Chen, M. Rege, M. Dong, and J. Hua, "Non-negative matrix factorization for semi-supervised data clustering," Knowl. Inf. Syst., vol. 17, no. 3, pp. 355-379, Nov. 2008.
12. Y. Chen, L. Wang, and M. Dong, "Non-negative matrix factorization for semisupervised heterogeneous data coclustering," IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1459-1474, Oct. 2010.
13. C. Ding, T. Li, and M. Jordan, "Convex and semi-nonnegative matrix factorizations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 45-55, Nov. 2010.
14. Z. Yang and E. Oja, "Linear and nonlinear projective nonnegative matrix factorization," IEEE Trans. Neural Netw., vol. 21, no. 5, pp. 734-749, May 2010.
15. H. Lee, J. Yoo, and S. Choi, "Semi-supervised nonnegative matrix factorization," IEEE Signal Process. Lett., vol. 17, no. 1, pp. 4-7, Jan. 2010.
16. Y. Li and A. Cichocki, "Non-negative matrix factorization and its application in blind sparse source separation with less sensors than sources," COMPEL: Int. J. Comput. Math. Electr. Electron. Eng., vol. 24, no. 2, pp. 695-706, 2005. (Pubitemid 40821953)
17. D. Liu, S. Hu, and H. Zhang, "Simultaneous blind separation of instantaneous mixtures with arbitrary rank," IEEE Trans. Circuits Syst. I, vol. 53, no. 10, pp. 2287-2298, Oct. 2006. (Pubitemid 44637795)
18. D. Donoho and V. Stodden, "When does non-negative matrix factorization give a correct decomposition into parts?" in Proc. Adv. Neural Inf. Process. Syst., vol. 17. 2004, pp. 1141-1148.
19. A. Pascual-Montano, J. Carazo, K. Kochi, D. Lehmann, and R. D. Pascual-Marqui, "Nonsmooth nonnegative matrix factorization (nsNMF)," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 3, pp. 403-415, Mar. 2006. (Pubitemid 43159636)
20. C. Lin, "Projected gradient methods for nonnegative matrix factorization," Neural Comput., vol. 19, no. 10, pp. 2756-2779, Oct. 2007.
21. C. Lin, "On the convergence of multiplicative update algorithms for nonnegative matrix factorization," IEEE Trans. Neural Netw., vol. 18, no. 6, pp. 1589-1596, Nov. 2007. (Pubitemid 350148414)
22. I. Buciu, N. Nikolaidis, and I. Pitas, "Nonnegative matrix factorization in polynomial feature space," IEEE Trans. Neural Netw., vol. 19, no. 6, pp. 1090-1100, Jun. 2008.
23. S. Zafeiriou, "Discriminant nonnegative tensor factorization algorithms," IEEE Trans. Neural Netw., vol. 20, no. 2, pp. 217-235, Feb. 2009.
24. R. Badeau, N. Bertin, and E. Vincent, "Stability analysis of multiplicative update algorithms and application to nonnegative matrix factorization," IEEE Trans. Neural Netw., vol. 21, no. 12, pp. 1869-1881, Dec. 2010.
25. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Advances in Neural Information Processing Systems, vol. 13, T. K. Leen, T. G. Dietterich, and V. Tresp, Eds. Cambridge, MA: MIT Press, 2001, pp. 556-562.
26. A. Berman, "Complete positivity," Linear Algebra Appl., vol. 107, pp. 57-63, Aug. 1988.
27. A. Berman and N. Shaked-Monderer, Completely Positive Matrices. Singapore: World Scientific, Apr. 2003.
28. J. Plato-, P. Krömer, V. Snáel, and A. Abraham, "Scaling IDS construction based on non-negative matrix factorization using GPU computing," in Proc. 6th Int. Conf. Inf. Assurance Security, Atlanta, GA, Aug. 2010, pp. 86-91.
29. J. Dongarra, "Basic linear algebra subprograms technical (blast) forum standard," Int. J. High Perform. Appl. Supercomput., vol. 16, no. 1, pp. 1-111, Feb. 2002.
30. L. S. Blackford, J. Demmel, J. Dongarra, I. Duff, S. Hammarling, G. Henry, M. Heroux, L. Kaufman, A. Lumsdaine, A. Petitet, R. Pozo, K. Remington, and R. C. Whaley, "An updated set of basic linear algebra subprograms (BLAS)," ACM Trans. Math. Softw., vol. 28, no. 2, pp. 135-151, Jun. 2002. (Pubitemid 135701673)
31. J. J. Dongarra, J. Du Croz, S. Hammarling, and I. S. Duff, "A set of level 3 basic linear algebra subprograms," ACM Trans. Math. Softw., vol. 16, no. 1, pp. 1-17, Mar. 1990. (Pubitemid 20684794)
32. J. J. Dongarra, J. Du Croz, S. Hammerling, and I. S. Duff, "Algorithm 679: A set of level 3 basic linear algebra subprograms: Model implementation and test programs," ACM Trans. Math. Softw., vol. 16, no. 1, pp. 18-28, Mar. 1990. (Pubitemid 20684795)
33. V. Franc, V. Hlavác, and M. Navara, "Sequential coordinate-wise algorithm for the non-negative least squares problem," in Computer Analysis of Images and Patterns (Lecture Notes in Computer Science), vol. 3691. New York: Springer-Verlag, 2005, pp. 407-414.
34. C. Ding, X. He, and H. Simon, "On the equivalence of nonnegative matrix factorization and spectral clustering," in Proc. SIAM Int. Conf. Data Min., 2005, pp. 606-610.
35. B. Long, Z. M. Zhang, X. Wu, and P. S. Yu, "Relational clustering by symmetric convex coding," in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 569-576.
36. B. Long, Z. M. Zhang, and P. S. Yu, "Co-clustering by block value decomposition," in Proc. 11th ACM SIGKDD Int. Conf. Knowl. Disc. Data Min., 2005, pp. 635-640. (Pubitemid 43218332)
37. H. A. Kiers, "Toward a standardized notation and terminology in multiway analysis," J. Chem., vol. 14, no. 3, pp. 105-122, May-Jun. 2000.
38. H. Zhang, Y. Luo, and D. Liu, "Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1490-1503, Sep. 2009.
39. H. Zhang, Q. Wei, and D. Liu, "An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games," Automatica, vol. 47, no. 1, pp. 207-214, Jan. 2011.
40. R. Zass and A. Shashua, "Doubly stochastic normalization for spectral clustering," in Advances in Neural Information Processing Systems 19, B. Schölkopf, J. Platt, and T. Hoffman, Eds. Cambridge, MA: MIT Press, 2007, pp. 1569-1576.
41. A. Georghiades, P. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001. (Pubitemid 32585276)
42. J. Ho, M.-H. Yang, J. Lim, K.-C. Lee, and D. Kriegman, "Clustering appearances of objects under varying illumination conditions," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2003, pp. 11-18.
43. D. Cai, X. He, and J. Han, "Document clustering using locality preserving indexing," IEEE Trans. Knowl. Data Eng., vol. 17, no. 12, pp. 1624-1637, Dec. 2005. (Pubitemid 43060413)
44. J. DeRisi, V. Iyer, and P. Brown, "Exploring the metabolic and genetic control of gene expression on a genomic scale," Science, vol. 278, no. 5338, pp. 680-686, Oct. 1997. (Pubitemid 27464965)
45. K. B. Petersen and M. S. Pedersen. (2008, Oct.). The Matrix Cookbook [Online]. Available: http://www2.imm.dtu.dk/pubdb/p.php?3274