Large-scale distributed non-negative sparse coding and sparse dictionary learning

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 489-497

  Sindhwani, Vikas ^a   Ghoting, Amol ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

dictionary learning; mapreduce; nmf; sparse coding

Indexed keywords

COMMODITY CLUSTERS; DICTIONARY LEARNING; HIGH-DIMENSIONAL; MAP-REDUCE; NMF; NON-NEGATIVE FACTORIZATION; NON-NEGATIVE SPARSE CODING; OPTIMIZATION PROBLEMS; PARALLEL OPTIMIZATION; RISK MINIMIZATION; SPARSE CODING; SPARSE MATRICES; SPARSITY CONSTRAINTS; STATISTICAL PERFORMANCE; TEXT ANALYSIS;

ALGORITHMS; DATA MINING;

OPTIMIZATION;

EID: 84866006615     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2339530.2339610     Document Type: Conference Paper

References (19)

1. S. Arora, R. Ge, R. Kannan, and A. Moitra. Computing a nonnegative matrix factorization - provably. In STOC, 2012.
2. A. Beck and M. Teboulle. Gradient-based algorithms with applications to signal recovery problems. Convex Opt. in Sig. Proc. Comm., Camb. Univ. Press, 2010.
3. D. Bertsekas. Non-linear Programming. Athena Scientific, 1999.
4. David M. Blei, Andrew Y. Ng, and Michael I. Jordan. Latent dirichlet allocation. JMLR, 3:993-1022, 2003.
5. Peter Buhlmann and Sara Van De Geer. Statistics for High-Dimensional Data. Springer, 2011.
6. A. Cichocki, R. Zdunek, A. H. Phan, and S. Amari. Nonneg. Matrix and Tensor Fact. Wiley, 2009.
7. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI, 2004.
8. J. Duchi, S. S. Schwartz, Y. Singer, and T. Chandra. Efficient projections onto the l1-ball for learning in high dimensions. In ICML, 2008.
9. M. Elad. Sparse and Redundant Representations. Springer, 2010.
10. A. Ghoting, P. Kambadur, E. Pednault, and R. Kannan. Nimble: a toolkit for the implementation of parallel data mining and machine learning algorithms on mapreduce. In KDD, 2011.
11. A. Ghoting, R. Krishnamurthy, E. Pednault, B. Reinwald, V. Sindhwani, S. Tatikonda, Y. Tian, and S. Vaithyanathan. Declarative machine learning on mapreduce. In ICDE, 2011.
12. P. Hoyer. Non-negative matrix factorization with sparseness constraints. JMLR, 5:1457-1469, 2004.
13. R. Jenatton, J. Mairal, G. Obozinski, and F. Bach. Proximal methods for sparse hierarchical dictionary learning. In ICML, 2010.
14. D. D. Lee and H. S. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 1999.
15. C. Liu, H. Yang, J. Fan, L. He, and Y. Wang. Distributed nonnegative matrix factorization for web-scale dyadic data analysis on mapreduce. In WWW, 2010.
16. J. Mairal, F. Bach, J. Ponce, and G. Sapiro. Online learning for matrix factorization and sparse coding. JMLR, 11:19-60, 2010.
17. D. Newman, A. Ascuncion, P. Smyth, and M. Welling. Distributed algorithms for topic models. In JMLR, 2010.
18. A. Smola and S. Narayanamurthy. An architecture for parallel topic models. In VLDB, 2010.
19. Z. J. Xiang, H. Xu, and P. J. Ramadge. Learning sparse representations of high-dimensional data on large-scale dictionaries. In NIPS, 2011.