Nonnegative matrix factorization and I-divergence alternating minimization

Linear Algebra and Its Applications

Volumn 416, Issue 2-3, 2006, Pages 270-287

  Finesso, Lorenzo ^a   Spreij, Peter ^b  

^a CNR   (Italy)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Alternating minimization; Approximate factorization; Auxiliary function; Convergence; I divergence; Lifting; Nonnegative matrix factorization

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; FUNCTION EVALUATION; ITERATIVE METHODS; OPTIMIZATION; PROBLEM SOLVING;

ALTERNATING MINIMIZATION; APPROXIMATE FACTORIZATION; AUXILIARY FUNCTION; CONVERGENCE; I-DIVERGENCE; LIFTING; NONNEGATIVE MATRIX FACTORIZATION;

MATRIX ALGEBRA;

EID: 33646910575     PISSN: 00243795     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.laa.2005.11.012     Document Type: Article

References (16)

1. Csiszár I. I-divergence geometry of probability distributions and minimization problems. Ann. Prob. 3 (1975) 146-158
2. Csiszár I., and Tusnády G. Information geometry and alternating minimization procedures. Statist. Decisions 1 supplement issue (1984) 205-237
3. Catral M., Han L., Neumann M., and Plemmons R.J. On reduced rank nonnegative matrix factorization for symmetric nonnegative matrices. Linear Algebra Appl. 393 (2004) 107-126
4. Cutler A., and Breiman L. Archetypal analysis. Technometrics 36 (1994) 338-347
5. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. With discussion. J. Roy. Statist. Soc. Ser. B 39 1 (1977) 1-38
6. L. Finesso, P.J.C. Spreij, Approximate realization of finite Hidden Markov Chains, in: Proceedings of the 2002 IEEE Information Theory Workshop, 90-93, Bangalore, India, 2002.
7. L. Finesso, P.J.C. Spreij, Approximate nonnegative matrix factorization via alternating minimization, in: Proceedings of the 16th International Symposium on Mathematical Theory of Networks and Systems (MTNS2004), Leuven, July 5-9, 2004. Available from: .
8. M. Hazewinkel, On positive vectors, positive matrices and the specialization order, CWI report PM-R8407 (1984).
9. Lee D.D., and Sebastian Seung H.S. Learning the parts of objects by non-negative matrix factorization. Nature 401 (1999) 788-791
10. Lee D.D., and Sebastian Seung H.S. Algorithms for non-negative matrix factorization. In: Leen T.K., Dietterich T.G., and Tresp V. (Eds). Advances in Neural and Information Processing Systems vol. 13 (2001), MIT Press 556-562
11. G. Picci, J.H. van Schuppen, On the weak finite stochastic realization problem, Springer LNCIS, vol. 58, 1984, pp. 237-242.
12. Picci G., van den Hof J.M., and van Schuppen J.H. Primes in several classes of the positive matrices. Linear Algebra Appl. 277 (1998) 149-185
13. Shiryaev A.N. Probability. second ed. (1996), Springer
14. J.A. O'Sullivan, Properties of the information value decomposition, in: Proceedings ISIT 2000, Sorrento, Italy, 2000, p. 491.
15. Wu C.J. On the convergence properties of the EM algorithm. Ann. Stat. 11 1 (1983) 95-103
16. Zangwill W.I. Nonlinear Programming, A Unified Approach (1969), Prentice Hall