A multilevel approach for nonnegative matrix factorization

Journal of Computational and Applied Mathematics

Volumn 236, Issue 7, 2012, Pages 1708-1723

  Gillis, Nicolas ^a,b   Glineur, François ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^b UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Image processing; Multigrid multilevel methods; Nonnegative matrix factorization

Indexed keywords

ALTERNATING LEAST SQUARES; COMPUTATIONAL BIOLOGY; DIMENSIONAL SPACES; MULTI-GRID; MULTILEVEL APPROACH; MULTILEVEL METHOD; MULTIPLICATIVE UPDATES; NON-NEGATIVE MATRIX; NON-NEGATIVITY; NONNEGATIVE LEAST SQUARES; NONNEGATIVE MATRIX FACTORIZATION; STANDARD IMAGES; TEXT MINING;

ALGORITHMS; BIOINFORMATICS; FACTORIZATION; IMAGE PROCESSING; LINEAR TRANSFORMATIONS;

MATRIX ALGEBRA;

EID: 83655167175     PISSN: 03770427     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cam.2011.10.002     Document Type: Article

References (38)

1. P. Paatero, and U. Tapper Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values Environmetrics 5 1994 111 126
2. D. Lee, and H. Seung Learning the parts of objects by nonnegative matrix factorization Nature 401 1999 788 791
3. S. Vavasis On the complexity of nonnegative matrix factorization SIAM Journal on Optimization 20 2009 1364 1377
4. S. Sakellaridi, H.-R. Fang, Y. Saad, Graph-based multilevel dimensionality reduction with applications to eigenfaces and latent semantic indexing, in: Proc. of the 7th Int. Conf. on Machine Learning and Appl., 2008.
5. H. Kim, and H. Park Non-negative matrix factorization based on alternating non-negativity constrained least squares and active set method SIAM Journal on Matrix Analysis and Applications 30 2 2008 713 730
6. C. Lawson, and R. Hanson Solving Least Squares Problems 1974 Prentice-Hall
7. J. Kim, H. Park, Toward faster nonnegative matrix factorization: a new algorithm and comparisons, in: Proc. of IEEE Int. Conf. on Data Mining, 2008, pp. 353362.
8. J. Kim, H. Park, Fast nonnegative matrix factorization: an active-set-like method and comparisons, SIAM Journal on Scientific Computing (2011) (in press).
9. M. Van Benthem, and M. Keenan Fast algorithm for the solution of large-scale non-negativity constrained least squares problems Journal of Chemometrics 18 2004 441 450 (Pubitemid 41327531)
10. D. Chen, and R. Plemmons Nonnegativity constraints in numerical analysis A. Bultheel, R. Cools, Symposium on the Birth of Numerical Analysis 2009 World Scientific Press
11. D. Lee, and H. Seung Algorithms for non-negative matrix factorization Advances in Neural Information Processing vol. 13 2001
12. M.E. Daube-Witherspoon, and G. Muehllehner An iterative image space reconstruction algorithm suitable for volume ect. IEEE Transactions on Medical Imaging 5 1986 61 66 (Pubitemid 16613321)
13. C.-J. Lin On the convergence of multiplicative update algorithms for nonnegative matrix factorization IEEE Transactions on Neural Networks 2007
14. N. Gillis, F. Glineur, Nonnegative factorization and the maximum edge biclique problem, CORE Discussion Paper 2008/64, 2008.
15. J. Han, L. Han, M. Neumann, and U. Prasad On the rate of convergence of the image space reconstruction algorithm Operators and Matrices 3 1 2009 41 58
16. A. Cichocki, R. Zdunek, and S. Amari Hierarchical ALS algorithms for nonnegative matrix and 3D tensor factorization Lecture Notes in Computer Science vol. 4666 2007 Springer 169 176
17. A. Cichocki, and A.-H. Phan Fast local algorithms for large scale nonnegative matrix and tensor factorizations IEICE Transactions on Fundamentals of Electronics E92-A 3 2009 708 721
18. N.-D. Ho, Nonnegative matrix factorizationalgorithms and applications, Ph.D. Thesis, Université Catholique de Louvain, 2008.
19. N. Gillis, F. Glineur, Nonnegative matrix factorization and underapproximation, in: Communication at 9th International Symposium on Iterative Methods in Scientific Computing, Lille, France, 2008.
20. L. Li, and Y.-J. Zhang FastNMF: highly efficient monotonic fixed-point nonnegative matrix factorization algorithm with good applicability Journal of Electronic Imaging 18 2009 033004
21. N. Gillis, Nonnegative matrix factorization: complexity, algorithms and applications, Ph.D. Thesis, Université Catholique de Louvain, 2011.
22. J.H. Bramble Multigrid Methods Pitman Research Notes in Mathematic Series vol. 294 1995 Longman Scientific & Technical UK
23. A. Brandt Guide to multigrid development W. Hackbusch, U. Trottenberg, Multigrid Methods Lecture Notes in Mathematics vol. 960 1982 Springer 220 312
24. W.L. Briggs A Multigrid Tutorial 1987 SIAM Philadelphia
25. U. Trottenberg, C. Oosterlee, and A. Schller Multigrid 2001 Elsevier, Academic Press London
26. S. Gratton, A. Sartenaer, P. Toint, On recursive multiscale trust-region algorithms for unconstrained minimization, Oberwolfach Reports: Optimization and Applications.
27. D. Terzopoulos Image analysis using multigrid relaxation methods Journal of Mathematical Physics, PAMI 8 2 1986 129 139 (Pubitemid 16595416)
28. C.-J. Lin Projected gradient methods for nonnegative matrix factorization Neural Computation 19 2007 2756 2779 MIT Press
29. A. Cichocki, R. Zdunek, and S. Amari Non-negative matrix factorization with quasi-Newton optimization Lecture Notes in Artificial Intelligence vol. 4029 2006 Springer 870 879 (Pubitemid 44089876)
30. I. Dhillon, D. Kim, S. Sra, Fast Newton-type methods for the least squares nonnegative matrix approximation problem, in: Proc. of SIAM Conf. on Data Mining, 2007.
31. M. Berry, M. Browne, A. Langville, P. Pauca, and R. Plemmons Algorithms and applications for approximate nonnegative matrix factorization Computational Statistics and Data Analysis 52 2007 155 173 (Pubitemid 47331703)
32. A. Cichocki, S. Amari, R. Zdunek, and A. Phan Non-Negative Matrix and Tensor Factorizations: Applications to Exploratory Multi-Way Data Analysis and Blind Source Separation 2009 Wiley-Blackwell
33. A. Cichocki, R. Zdunek, and S. Amari Nonnegative matrix and tensor factorization IEEE Signal Processing Magazine 2008 142 145
34. Q. Zhang, H. Wang, R. Plemmons, and P. Pauca Tensor methods for hyperspectral data analysis: a space object material identification study Journal of the Optical Society of America A 25 12 2008 3001 3012
35. P. Pauca, J. Piper, and R. Plemmons Nonnegative matrix factorization for spectral data analysis Linear Algebra and its Applications 406 1 2006 29 47 (Pubitemid 43737212)
36. N. Gillis, and R. Plemmons Dimensionality reduction, classification, and spectral mixture analysis using nonnegative underapproximation Optical Engineering 50 2011 027001
37. J. Curry, A. Dougherty, and S. Wild Improving non-negative matrix factorizations through structured initialization The Journal of Pattern Recognition 37 11 2004 2217 2232 (Pubitemid 40134553)
38. C. Boutsidis, and E. Gallopoulos SVD based initialization: a head start for nonnegative matrix factorization The Journal of Pattern Recognition 41 2008 1350 1362 (Pubitemid 350212975)