A convex model for nonnegative matrix factorization and dimensionality reduction on physical space

IEEE Transactions on Image Processing

Volumn 21, Issue 7, 2012, Pages 3239-3252

  Esser, Ernie ^a   Möller, Michael ^b   Osher, Stanley ^c   Sapiro, Guillermo ^d   Xin, Jack ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF MÜNSTER   (Germany)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d University of Minnesota   (United States)

Author keywords

Blind source separation (BSS); dictionary learning; dimensionality reduction; hyperspectral endmember detection; nonnegative matrix factorization (NMF); subset selection

Indexed keywords

DICTIONARY LEARNING; DIMENSIONALITY REDUCTION; ENDMEMBERS; NONNEGATIVE MATRIX FACTORIZATION; SUBSET SELECTION;

BLIND SOURCE SEPARATION; RELAXATION PROCESSES;

MATRIX ALGEBRA;

EID: 84862519707     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2190081     Document Type: Article

References (35)

1. W. Naanaa and J.-M. Nuzillard, "Blind source separation of positive and partially correlated data," Signal Process., vol. 85, no. 9, pp. 1711-1722, Sep. 2005.
2. M. E. Winter, "N-FINDR: An algorithm for fast autonomous spectral end-member determination in hyperspectral data," in Proc. SPIE-Imaging Spectrometry V,1999, vol. 3753, pp. 266-275.
3. R. Jenatton, J.-Y. Audibert, and F. Bach, "Structured variable selection with sparsity-inducing norms," INRIA, Le Chesnay, France, Tech. Rep. arXiv:0904.3523v2, 2009.
4. J. A. Tropp, "Algorithms for simultaneous sparse approximation: Part II: Convex relaxation," Signal Process., vol. 86, no. 3, pp. 589-602, Mar. 2006.
5. G. Liu, Z. Lin, andY.Yu, "Robust subspace segmentation by low-rank representation," in Proc. ICML, 2010, pp. 663-670.
6. W. Xu, X. Liu, and Y. Gong, "Document clustering based on nonnegative matrix factorization," in Proc. 26th Annu. Int. ACM SIGIR Conf. Res. Dev. Inf. Retrieval, 2003, pp. 267-273.
7. A. Holzapfel and Y. Stylianou, "Musical genre classification using nonnegative matrix factorization-based features," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 2, pp. 424-434, Feb. 2008.
8. L. Miao and H. Qi, "Endmember extraction from highly mixed data usingminimumvolume constrained nonnegativematrix factorization," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 3, pp. 765-777, Mar. 2007.
9. M. Berry,M. Browne,A. Langville, P. Pauca, and R. J. Plemmons, "Algorithms and applications for approximate nonnegative matrix factorization," Comput. Stat. Data Anal., vol. 52, no. 1, pp. 155-173, 2007.
10. V. P. Pauca, J. Piper, and R. J. Plemmons, "Nonnegative matrix factorization for spectral data analysis," Linear Algebra Appl., vol. 416, no. 1, pp. 29-47, Jul. 2006.
11. A. Zare, "Hyperspectral endmember detection and band selection using Bayesian methods" Ph.D. dissertation, Univ. Florida, Gainesville, FL, 2008.
12. S. Moussaoui, D. Brie, A. Mohammad-Djafari, and C. Carteret, "Separation of non-negative mixture of non-negative sources using a Bayesian approach and MCMC sampling," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4133-4145, Nov. 2006.
13. N. Dobigeon, S. Moussaoui, M. Coulon, J.-Y. Tourneret, and A. O. Hero, "Joint Bayesian endmember extraction and linear unmixing for hyperspectral imagery," IEEE Trans. Signal Process., vol. 57, no. 11, pp. 4355-4368, Nov. 2009.
14. J. M. P. Nascimento and J. M. Bioucas-Dias, "Blind hyperspectral unmixing," in Proc. SPIE Conf. Image Signal Process. Remote Sens. XIII, 2007, vol. 6748, p. 67 480J.
15. C. Boutsidis, M. W. Mahoney, and P. Drineas, "An improved approximation algorithm for the column subset selection problem," in Proc. 20th Annu. ACM-SIAM SODA, 2009, pp. 968-977.
16. T. F. Chan and P. C. Hansen, "Some applications of the rank revealing QR factorization," SIAM J. Sci. Stat. Comput., vol. 13, no. 3, pp. 727-741, May 1992.
17. A. Krause and V. Cevher, "Submodular dictionary selection for sparse representation," in Proc. ICML, 2010, pp. 567-574.
18. A. Das and D. Kempe, "Submodularmeets spectral: Greedy algorithms for subset selection, sparse approximation and dictionary selection," in Proc. ICML, 2011, pp. 1057-1064.
19. L. Balzano, R. Nowak, and W. U. Bajwa, "Column subset selection with missing data," in Proc. NIPS Workshop Low-Rank Methods Large-Scale Mach. Learn., Whistler, BC, Canada, 2010.
20. A. Szlam, Z. Guo, and S. Osher, A split Bregman method for nonnegative sparsity penalized least squares with applications to hyperspectral demixing UCLA CAM, Los Angeles, CA, Tech. Rep. 10-06, 2010.
21. Z. Guo, T. Wittman, and S. Osher, "L1 unmixing and its application to hyperspectral image enhancement," in Proc. SPIE Conf. Algorithms Technol. Multispectral, Hyperspectral, Ultraspectral Imag. XV, 2008, vol. 7334, pp. 73 341M-1-73 341M-9.
22. J. Greer, "Sparse demixing," in Proc. SPIE Algorithms Technol. Multispectral, Hyperspectral, Ultraspectral Imag. XVI, 2010, vol. 7695, pp. 76 951O-1-76 951O-12.
23. A. Castrodad, Z. Xing, J. Greer, E. Bosch, L. Carin, and G. Sapiro, "Learning discriminative sparse representations for modeling, source separation, and mapping of hyperspectral imagery," IEEE Trans. Geosci. Remote Sensing, vol. 49, no. 11, pp. 4263-4281, Nov. 2011.
24. P. Sprechmann, I. Ramrez, G. Sapiro, and Y. Eldar, "C-HiLasso: A collaborative hierarchical sparse modeling framework," IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4183-4198, Sep. 2011.
25. J. Mairal, R. Jenatton, G. Obozinski, and F. Bach, "Network flow algorithms for structured sparsity," in Proc. NIPS, 2010, pp. 1558-1566.
26. D. Gabay and B. Mercier, "A dual algorithm for the solution of nonlinear variational problems via finite-element approximations," Comput. Math. Appl., vol. 2, no. 1, pp. 17-40, 1976.
27. R. Glowinski and A. Marrocco, "Sur lapproximation par elements finis dordre un, et la resolution par penalisation-dualite dune classe de problemes de Dirichlet nonlineaires," Rev. Francaise dAut Inf. Rech. Oper., vol. R-2, pp. 41-76, 1975.
28. X. Zhang, M. Burger, and S. Osher, "A unified primal-dual algorithm framework based on Bregman iteration," UCLA CAM, Los Angeles, CA, Tech. Rep. 09-99, 2009.
29. J. J. Moreau, "Proximité et dualité dans un espace hilbertien," Bull. Soc. Math. France, vol. 93, pp. 273-299, 1965.
30. E. Esser, "Applications of Lagrangian-based alternating direction methods and connections to split Bregman," UCLA CAM, Los Angeles, CA, Tech. Rep. 09-31, 2009.
31. J. M. P. Nascimento and J. M. Bioucas-Dias, "Vertex component analysis: A fast algorithm to unmix hyperspectral data," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 4, pp. 898-910, Apr. 2005.
32. Open Source MATLAB Hyperspectral Toolbox. ver. 0.04, 2010 [Online]. Available: http://matlabhyperspec.sourceforge.net/
33. E. Candes, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis," 2009 [Online]. Available: http://arxiv.org/PS cache/arxiv/pdf/0912/0912.3599v1.pdf
34. B. He, M. Tao, and X. Yuan, "A splitting method for separate convex programming with linking linear constraints," Tech. Rep., 2011 [Online]. Available: http://www.optimization-online.org/DB-FILE/2010/06/2665.pdf
35. Y. Sun, C. Ridge, F. del Rio, A. J. Shaka, and J. Xin, "Postprocessing and sparse blind source separation of positive and partially overlapped data," Signal Process., vol. 91, no. 8, pp. 1838-1851, Aug. 2011.