Fast newton-type methods for the least squares nonnegative matrix approximation problem

Proceedings of the 7th SIAM International Conference on Data Mining

Volumn , Issue , 2007, Pages 343-354

  Kim, Dongmin ^a   Sra, Suvrit ^a   Dhillon, Inderjit S ^a  

^a University of Texas at Austin   (United States)

Author keywords

Active sets; Factorization; Least squares; Nonnegative matrix approximation; Projected Newton methods

Indexed keywords

APPROXIMATION ALGORITHMS; DATA MINING; FACTORIZATION; GRADIENT METHODS; HEURISTIC METHODS; IMAGE PROCESSING; MATRIX ALGEBRA; NEWTON-RAPHSON METHOD; NUMERICAL METHODS;

ACTIVE SETS; ALTERNATING LEAST SQUARES; LEAST SQUARE; MULTIPLICATIVE UPDATES; NON-NEGATIVE MATRIX APPROXIMATIONS; NUMERICAL INSTABILITY; PROJECTED NEWTON METHODS; THEORETICAL GUARANTEES;

LEAST SQUARES APPROXIMATIONS;

EID: 56449106635     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972771.31     Document Type: Conference Paper

References (25)

1. M. Berry, M. Browne, A. Langville, P. Pauca, and R. J. Piemmons. Algorithms and Applications for Approximation Nonnegative Matrix Factorization. Computational Statistics and Data Analysis, 2006. Preprint.
2. D. P. Bertsekas. Projected Newton Methods for Optimization Problems with Simple Constraints. SIAM Journal on Control and Optimization, 20(2):221-246, 1982.
3. M. Bierlaire, Philipe L. Toint, and D. Tuyttens. On Iterative Algorithms for Linear Least Squares Problems with Bound constraints. Linear Algebra and its Applications, 143:111-143, 1991.
4. Åke Björck. Numerical Methods for Least Squares Problems. SIAM, 1996.
5. R. Bro and S. D. Jong. A Fast Non-negativity-constrained Least Squares Algorithm. Journal of Chemometrics, 11 (5):393-40 1, 1997.
6. C. G. Broyden. The Convergence of A Class of Double-rank Minimization Algorithms, Part I. Journal of the Institute of Mathematics and Its Applications, 6:76-90, 1970.
7. A. Cichocki and R. Zdunek. NMFLAB - MATLAB Toolbox for Non-Negative Matrix Factorization. Online, 2006.
8. R. Fletcher. A New Approach to Variable Metric Algorithms. Computer Journal, pages 317-322, 1970.
9. D. Goldfarb. A Family of Variable-metric Methods Derived by Variational Means. Mathematics of Computation, 24(109):23-26, 1970.
10. E. F Gonzalez and Y. Zhang. Accelerating The LeeSeung Algorithm for Nonnegative Matrix Factorization. Technical Report TR-05-02, Rice University, 2005.
11. L. Grippo and M. Sciandrone. On The Convergence of The Block Nonlinear Gauss-Seidel Method under Convex Constraints. Operations Research Letters, 26: 127-136, 2000.
12. D. Kim, S. Sra, and I. S. Dhillon. A New Projected Quasi-Newton Approach for the Non-negative Least Squares Problem. Technical Report TR-06-54, Computer Sciences, The Univ. of Texas at Austin, 2006.
13. C. L. Lawson and R. J. Hanson. Solving Least Squares Problems. Prentice-Hall, 1974.
14. D. D. Lee and H. S. Seung. Algorithms for Nonnegative Matrix FactorizatIon. In Neural information Processing Systems, pages 556-562, 2000.
15. D. D. Lee and H. S. Seung. Learning The Parts of Objects by Nonnegative Matrix Factorization. Nature, 401:788-791, 1999.
16. C. Lin. Projected Gradient Methods for Non-negative Matrix Factorization. Technical Report ISSTECH-95-013, National Taiwan University, 2005.
17. M. Merritt and Y. Zhang. Interior-Point Gradient Method for Large-Scale Totally Nonnegative Least Squares Problems. Journal of Optimization Theory and Applications, 126(1): 191-202, 2005.
18. P. Paatero. Least-squares Formulation of Robust Non-negative Factor Analysis. Chemometrics and Intelligent Laboratory Systems, 37:23-35, 1997.
19. P. Paatero. The Multilmear Engine-A Table-driven Least Squares Program for Solving Multilinear Problems, Including The N-way Parallel Factor Analysis Model. Journal of Computational and Graphical Statistics, 8(4):854-888, 1999.
20. P. Paatero and U. Tapper. Positive Matrix Factorization: A Nonnegative Factor Model with Optimal Utilization of Error Estimates of Data Values. Environmetrics, 5 (111-126), 1994.
21. F. Shahnaz, M. Berry, P. Pauca, and R. Plemnions. Document Clustering using Nonnegative Matrix Factorization. Journal on Information Processing and Management, 42:373-386, 2006.
22. D. F Shanno. Conditioning of Quasi-Newton Methods for Function Minimization. Mathematics of Computation, 24(111):647-656, 1970.
23. S. Sra and I. S. Dhillon. Nonnegative Matrix Approximation: Algorithms and Applications. Technical Report Tr-06-27, Computer Sciences, University of Texas at Austin, 2006.
24. W. Xu, X. Liu, and Y. Gong. Document Clustering Based on Nonnegative Matrix Factorization. In SIGIR'03, pages 267-273, 2003.
25. R. Zdunek and A. Cichocki. Non-Negative Matrix Factorization with Quasi-Newton Optimization. In Eighth International Conference on Artificial Intelligence and Soft Computing, ICAISC, pages 870-879, 2006.