Efficient document clustering via online nonnegative matrix factorizations

Proceedings of the 11th SIAM International Conference on Data Mining, SDM 2011

Volumn , Issue , 2011, Pages 908-919

  Wang, Fei ^a   Tan, Chenhao ^b   König, Arnd Christian ^c   Li, Ping ^a  

^a Department of Molecular Biology and Genetics   (United States)

^b Microsoft Research Microsoft Coopration ^*  (United States)

^c MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER ANALYSIS; DATA MINING; FACTORIZATION; INFORMATION RETRIEVAL; LARGE DATASET;

DATA MATRICES; DATA POINTS; DOCUMENT CLUSTERING; IMAGE REPRESENTATIONS; MULTI-PASS; NONNEGATIVE MATRIX FACTORIZATION; ONE-PASS; REAL DATA SETS;

MATRIX ALGEBRA;

EID: 84857336717     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972818.78     Document Type: Conference Paper

References (43)

1. N. Andrei. Accelerated conjugate gradient algorithm with finite difference hessian/vector product approximation for unconstrained optimization. Journal of Computational and Applied Mathematics, 230(2):570-582, 2009.
2. D. P. Bertsekas. Projected newton methods for optimization problems with simple constraints. SIAM J. Control and Optimization, 20:221-246, 1982.
3. D. P. Bertsekas. Nonlinear Programming. Belmont, MA, 1999.
4. C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, 1995.
5. L. Bottou. Stochastic learning. In O. Bousquet and U. von Luxburg, editors, Advanced Lectures on Machine Learning, Lecture Notes in Artificial Intelligence, LNAI 3176, pages 146-168. Springer Verlag, Berlin, 2004.
6. A. Z. Broder, S. C. Glassman, M. S. Manasse, and G. Zweig. Syntactic clustering of the web. Computer Networks, 29(8-13):1157-1166, 1997.
7. B. Cao, D. Shen, J. Sun, X. Wang, Q. Yang, and Z. Chen. Detect and track latent factors with online nonnegative matrix factorization. In Proc. International Joint Conference on Artificial Intelligence, pages 2689-2694, 2007.
8. C. Carpineto, S. Osiński, G. Romano, and D. Weiss. A survey of web clustering engines. ACM Comput. Surv., 41(3):1-38, 2009.
9. C. T. Chu, S. K. Kim, Y. A. Lin, Y. Yu, G. Bradski, A. Y. Ng, and K. Olukotun. Map-reduce for machine learning on multicore. In Advances in Neural Information Processing Systems (NIPS), pages 281-288, 2007.
10. D. R. Cutting, D. R. Karger, J. O. Pederson, and J. W. Tukey. Scatter/gather: A cluster-based approach to browsing large document collections. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pages 318-329, 1992.
11. A. Das, M. Datar, A. Garg, and S. Rajaram. Google news personalization: Scalable online collaborative filtering. In Proceedings of the 16th International Conference on World Wide Web (WWW), pages 271-280, 2007.
12. I. S. Dhillon and D. S. Modha. Concept decompositions for large sparse text data using clustering. Machine Learning, 42(1):143-175, 2001.
13. C. Ding, X. He, and H. D. Simon. On the equivalence of nonnegative matrix factorization and spectral clustering. In Proceedings of the 5th SIAM Int'l Conf. Data Mining (SDM), pages 606-610, 2005.
14. C. Ding, T. Li, and M. I. Jordan. Convex and semi-nonnegative matrix factorizations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010.
15. D. Fetterly, M. Manasse, and M. Najork. On the evolution of clusters of near-duplicate web pages. In Proc. of the 12th International Conference on World Wide Web (WWW), pages 37-45, 2003.
16. B. C. M. Fung, K. Wang, C. M. Benjamin, F. Ke, and M. Ester. Hierarchical document clustering using frequent itemsets. In Proceedings of the 3rd SIAM International Conference on Data Mining (SDM), 2003.
17. E. Gaussier and C. Goutte. Relation between plsa and nmf and implications. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pages 601-602, 2005.
18. T. Hu., H. Xiong, W. Zhou, S. Y. Sung, and H. Luo. Hypergraph partitioning for document clustering: A unified clique perspective. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pages 871-872, 2008.
19. D. Kim, S. Sra, and I. Dhillon. Fast newton-type methods for the least squares nonnegative matrix approximation problem. In Proceedings of the SIAM International Conference on Data Mining (SDM), pages 343-354, 2007.
20. J. Kim and H. Park. Toward faster nonnegative matrix factorization: A new algorithm and comparisons. In Proceedings of the 8th International Conference on Data Mining (ICDM), pages 353-362, 2008.
21. H. J. Kushner and G. G. Yin. Stochastic Approximation Algorithms and Applications. New York: Springer-Verlag, 1997.
22. C. L. Lawson and R. J. Hanson. Solving Least Squares Problems. Society for Industrial Mathematics, 1995.
23. D. D. Lee and H. S. Seung. Learning the parts of objects with nonnegative matrix factorization. Nature, 401:788-791, 1999.
24. D. D. Lee and H. S. Seung. Algorithms for non-negative matrix factorization. In Advances in Neural Information Processing System (NIPS), pages 556-562, 2000.
25. α (0 α ≤ 2) norm. In Proocddings of the ACM SIGKDD Conference (SIGKDD), pages 440-449, 2007.
26. P. Li. Computationally efficient estimators for dimension reductions using stable random projections. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM), pages 403-412, 2008.
27. P. Li, K. W. Church, and T. Hastie. One sketch for all: Theory and application of conditional random sampling. In Advances in Neural Information Processing System (NIPS), pages 953-960, 2008.
28. P. Li, A. C. König, and W. Gui. b-bit minwise hashing for estimating three-way similarities. In Advances in Neural Information Processing System (NIPS), 2010.
29. C. J. Lin. Projected gradient methods for non-negative matrix factorization. Neural Computation, 19(10):2756-2779.
30. C. Liu, H. Yang, J. Fan, L. He, and Y. Wang. Distributed nonnegative matrix factorization for web-scale dyadic data analysis on mapreduce. In Proceedings of the 19th ACM International World Wide Web Conference (WWW), pages 681-690, 2010.
31. X. Liu and W. B. Croft. Cluster-based retrieval using language models. In Proceedings of the 27th annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pages 186-193, 2004.
32. J. Mairal, F. Bach, J. Ponce, and G. Sapiro. Online dictionary learning for sparse coding. In Proceedings of The 26th International Conference on Machine Learning (ICML), pages 689-696, 2009.
33. F. Shahnaz, M. W. Berry, V. P. Pauca, and R. J. Plemmons. Document clustering using nonnegative matrix factorization. Information Processing and Management, 42(2):373-386, 2006.
34. J. Silva, J. Mexia, A. Coelho, and G. Lopes. Document clustering and cluster topic extraction in multilingual corpora. In Proceedings of the 1st IEEE International Conference on Data Mining (ICDM), pages 513-520, 2001.
35. X. Wan and J. Yang. Multi-document summarization using cluster-based link analysis. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pages 299-306, 2007.
36. F. Wang and P. Li. Compressed nonnegative sparse coding. In Proceedings of the 10th IEEE International Conference on Data Mining (ICDM), 2010.
37. F. Wang and P. Li. Efficient non-negative matrix factorization with random projections. In Proceedings of the 10th SIAM International Conference on Data Mining (SDM), pages 281-292, 2010.
38. F. Wang, P. Li, and A. C. König. Learning a bi-stochastic data similarity matrix. In Proceedings of the 10th IEEE International Conference on Data Mining (ICDM), 2010.
39. S. Xu and J. Zhang. A hybrid parallel web document clustering algorithm performance study. Journal of Supercomputing, 30(2):117-131, 2004.
40. W. Xu and Y. Gong. Document clustering by concept factorization. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval (SIGIR), pages 202-209, 2004.
41. W. Xu, X. Liu, and Y. Gong. Document clustering based on non-negative matrix factorization. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval (SIGIR), pages 267-273, 2003.
42. S. Zhong. Efficient streaming text clustering. Neural Networks, 18(5-6):790-798, 2005.
43. S. Zhu, K. Yu, Y. Chi, and Y. Gong. Combining content and link for classification using matrix factorization. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pages 487-494, 2007.