Global convergence of modified multiplicative updates for nonnegative matrix factorization

Computational Optimization and Applications

Volumn 57, Issue 2, 2014, Pages 417-440

  Takahashi, Norikazu ^a,b,c   Hibi, Ryota ^a,d  

^a KYUSHU UNIVERSITY   (Japan)

^b Fukuoka Industry Academia Symphonicity   (Japan)

^c OKAYAMA UNIVERSITY   (Japan)

^d Toyama Chemical Co Ltd   (Japan)

Author keywords

Finite termination; Global convergence; Multiplicative update; Nonnegative matrix factorization

Indexed keywords

EID: 84894416864     PISSN: 09266003     EISSN: 15732894     Source Type: Journal    
DOI: 10.1007/s10589-013-9593-0     Document Type: Article

References (28)

1. Badeau, R.; Bertin, N.; Vincent, E.: Stability analysis of multiplicative update algorithms and application to nonnegative matrix factorization. IEEE Trans. Neural Netw. 21(12), 1869-1881 (2010)
2. Berry, M.W.; Browne, M.: Email surveillance using non-negative matrix factorization. Comput. Math. Organ. Theory 11, 249-264 (2005)
3. Berry, M.W.; Browne, M.; Langville, A.N.; Pauca, V.P.; Plemmons, R.J.: Algorithms and applications for approximate nonnegative matrix factorization. Comput. Stat. Data Anal. 52, 155-173 (2007)
4. Boyd, S.; Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)
5. Brunet, J.P.; Tamayo, P.; Golub, T.R.; Mesirov, J.P.: Metagenes and molecular pattern discovery using matrix factorization. Proc. Natl. Acad. Sci. USA 101(12), 4164-4169 (2004)
6. Cai, D.; He, X.; Han, J.; Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548-1560 (2011)
7. Cichocki, A.; Zdunek, R.; Phan, A.H.; Amari, S.I.: Nonnegative Matrix and Tensor Factorizations. Wiley, West Sussex (2009)
8. Csiszár, I.; Tusnády, G.: Information geometry and alternating minimization procedures. Statistics and Decisions, Supplemental Issue, 205-237 (1984)
9. Févotte, C.; Bertin, N.; Durrieu, J.L.: Nonnegative matrix factorization with the Itakura-Saito divergence: with application to music analysis. Neural Comput. 21(3), 793-830 (2009)
10. Finesso, L.; Spreij, P.: Nonnegative matrix factorization and I-divergence alternating minimization. Linear Algebra Appl. 416, 270-287 (2006)
11. Gillis, N.: Nonnegative matrix factorization: Complexity, algorithms and applications. Ph.D. thesis, Université Catholique de Louvain, Louvain-la-Neuve (2011)
12. Gillis, N.; Glineur, F.: Nonnegative factorization and the maximum edge biclique problem (2008). ArXiv e-prints
13. Gillis, N.; Glineur, F.: Accelerated multiplicative updates and hierarchical ALS algorithms for nonnegative matrix factorization. Neural Comput. 24(4), 1085-1105 (2012)
14. Hibi, R.; Takahashi, N.: A modified multiplicative update algorithm for Euclidean distance-based nonnegative matrix factorization and its global convergence. In: Proceedings of 18th International Conference on Neural Information Processing, Part-II, pp. 655-662 (2011)
15. Holzapfel, A.; Stylianou, Y.: Musical genre classification using nonnegative matrix factorization-based features. IEEE Trans. Audio Speech Lang. Process. 16(2), 424-434 (2008)
16. Lee, D.D.; Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788-792 (1999)
17. Lee, D.D.; Seung, H.S.: Algorithms for non-negative matrix factorization. In: Leen, T.K.; Dietterich, T.G.; Tresp, V. (eds.) Advances in Neural Information Processing Systems, vol. 13, pp. 556-562 (2001)
18. Lin, C.J.: On the convergence of multiplicative update algorithms for nonnegative matrix factorization. IEEE Trans. Neural Netw. 18(6), 1589-1596 (2007)
19. Lin, C.J.: Projected gradient methods for non-negative matrix factorization. Neural Comput. 19(10), 2756-2779 (2007)
20. Lu, W.; Sun, W.; Lu, H.: Robust watermarking based on DWT and nonnegative matrix factorization. Comput. Electr. Eng. 35, 183-188 (2009)
21. Sha, F.; Min, Y.; Saul, L.K.; Lee, D.D.: Multiplicative updates for nonnegative quadratic programming. Neural Comput. 19, 2004-2031 (2007)
22. Shahnaz, F.; Berry, M.W.; Pauca, V.P.; Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Inf. Process. Manag. 42, 373-386 (2006)
23. Takahashi, N.; Nishi, T.: Global convergence of decomposition learning methods for support vector machines. IEEE Trans. Neural Netw. 17(6), 1362-1369 (2006)
24. Vavasis, S.A.: On the complexity of nonnegative matrix factorization. SIAM J. Optim. 20(3), 1364-1377 (2009)
25. Wang, R.S.; Zhang, S.; Wang, Y.; Zhang, X.S.; Chen, L.: Clustering complex networks and biological networks by nonnegative matrix factorization with various similarity measures. Neurocomputing 72, 134-141 (2008)
26. Wu, C.F.J.: On the convergence properties of the EM algorithm. Ann. Stat. 11(1), 95-103 (1983)
27. Yang, Z.; Oja, E.: Unified development of multiplicative algorithm for linear and quadratic nonnegative matrix factorization. IEEE Trans. Neural Netw. 22(12), 1878-1891 (2011)
28. Zangwill, W.I.: Nonlinear Programming: a Unified Approach. Prentice Hall, Englewood Cliffs (1969)