SAIL: Summation-bAsed Incremental Learning for information-theoretic text clustering

IEEE Transactions on Cybernetics

Volumn 43, Issue 2, 2013, Pages 570-584

  Cao, Jie ^a   Wu, Zhiang ^a   Wu, Junjie ^b   Xiong, Hui ^c  

^a NANJING UNIVERSITY OF FINANCE AND ECONOMICS   (China)

^b BEIHANG UNIVERSITY   (China)

^c State University   (United States)

Author keywords

Information theoretic clustering; K means distance; KL divergence; Multithreaded parallel computing; Variable neighborhood search (VNS)

Indexed keywords

INFORMATION-THEORETIC CLUSTERING; K-MEANS; KL-DIVERGENCE; MULTITHREADED; VARIABLE NEIGHBORHOOD SEARCH;

ALGORITHMS; ITERATIVE METHODS; PARALLEL ARCHITECTURES;

INFORMATION THEORY;

EID: 84877693856     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2212430     Document Type: Article

References (35)

1. J. Wu, H. Xiong, and J. Chen, "SAIL: Summation-based incremental learning for information-theoretic clustering," in Proc. 14th ACM SIGKDD Int. Conf. Knowl. Discov. Data Mining, 2008, pp. 740-748.
2. P.-N. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining. Reading, MA: Addison-Wesley, 2005.
3. E.-H. Han, D. Boley, M. Gini, R. Gross, K. Hastings, G. Karypis, V. Kumar, B. Mobasher, and J. Moore, "Webace: A web agent for document categorization and exploration," in Proc. 2nd Int. Conf. Auton. Agents, 1998, pp. 408-415.
4. H. Zhou, D. Tao, Y. Yuan, and X. Li, "Object trajectory clustering via tensor analysis," in Proc. 16th IEEE Int. Conf. Image Process., 2009, pp. 1945-1948.
5. X. Gao, B. Wang, D. Tao, and X. Li, "A relay level set method for automatic image segmentation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 2, pp. 518-525, Apr. 2011.
6. X. Tian, D. Tao, and Y. Rui, "Complex object correspondence construction in two-dimensional animation," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3257-3269, Nov. 2011.
7. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Non-negative patch alignment framework," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1218-1230, Aug. 2011.
8. I. Dhillon, S. Mallela, and R. Kumar, "A divisive information-theoretic feature clustering algorithm for text classification, " J. Mach. Learn. Res., vol. 3, pp. 1265-1287, Mar. 2003.
9. I. Dhillon, S. Mallela, and D. Modha, "Information-theoretic co-clustering," in Proc. 9th ACM SIGKDD Int. Conf. Knowl. Discov. Data Mining, 2003, pp. 89-98.
10. S. Zhong and J. Ghosh, "Generative model-based document clustering: A comparative study," Knowl. Inf. Syst., vol. 8, no. 3, pp. 374-384, Sep. 2005.
11. C. Elkan, "Clustering documents with an exponential-family approximation of the dirichlet compound multinomial distribution," in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 289-296.
12. T. Cover and J. Thomas, Elements of Information Theory, 2nd ed. New York: Wiley, 2006.
13. S. Kullback and R. Leibler, "On information and sufficiency," Ann. Math. Stat., vol. 22, no. 1, pp. 79-86, Mar. 1951.
14. N. Slonim and N. Tishby, "The power of word clusters for text classification," in Proc. 23rd Eur. Colloq. Inf. Retrieval Res., 2001.
15. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Mining Knowl. Discov., vol. 22, no. 3, pp. 340-371, 2010.
16. X. Tian, D. Tao, and Y. Rui, "Sparse transfer learning for interactive video search reranking," ACM Trans. Multimedia Comput., Commun. Appl., vol. 8, no. 3, p. 26, Jul. 2012.
17. N. Mladenovic and P. Hansen, "Variable neighborhood search," Comput. Oper. Res., vol. 24, no. 11, pp. 1097-1100, Nov. 1997.
18. P. Hansen and N. Mladenovic, "Variable neighborhood search: Principles and applications," Eur. J. Oper. Res., vol. 130, no. 3, pp. 449-467, May 2001.
19. G. Karypis, Cluto-Version 2.1.1. [Online]. Available: http://glaros.dtc.umn.edu/gkhome/views/cluto
20. J. MacQueen, "Some methods for classification and analysis of multivariate observations," in Proc. 5th Berkeley Symp. Math. Stat. Probab., 1967, pp. 281-297.
21. Y. Zhao and G. Karypis, "Criterion functions for document clustering: Experiments and analysis," Mach. Learn., vol. 55, no. 3, pp. 311-331, 2004.
22. L. Brand, Advanced Calculus: An Introduction to Classical Analysis. New York: Dover, 2006.
23. J. Wu, H. Xiong, J. Chen, and W. Zhou, "A generalization of proximity functions for k-means," in Proc. 7th IEEE Int. Conf. Data Mining, 2007, pp. 361-370.
24. J. Wu, H. Xiong, C. Liu, and J. Chen, "A generalization of distance functions for fuzzy c-means clustering with cetroids of arithmetic means," IEEE Trans. Fuzzy Syst., vol. 20, no. 3, pp. 557-571, Jun. 2012.
25. A. Banerjee, S. Merugu, I. Dhillon, and J. Ghosh, "Clustering with Bregman divergences," J. Mach. Learn. Res., vol. 6, no. 10, pp. 1705-1749, Oct. 2005.
26. W. Hendricks and K. Robey, "The sampling distribution of the coefficient of variation," Ann. Math. Stat., vol. 7, no. 3, pp. 129-132, Sep. 1936.
27. K-means Clustering in Statistics Toolbox, MathWorks, Natick, MA. [Online]. Available: http://www.mathworks.com,
28. I. Dhillon, Co-Clustering Software, Version 1.1, Department of Computer Science, University of Texas Austin, Austin, TX. [Online]. Available: http://www.cs.utexas.edu/~inderjit/software.shtml
29. A. Jain and R. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice-Hall, 1988.
30. J. Wu, H. Xiong, and J. Chen, "Adapting the right measures for k-means clustering," in Proc. 15th ACM SIGKDD Int. Conf. Knowl. Discov. Data Mining, 2009, pp. 877-886.
31. H. Wu, R. Luk, K. Wong, and K. Kwok, "Interpreting TF-IDF term weights as making relevance decisions," ACM Trans. Inf. Syst., vol. 26, no. 3, pp. 1-37, Jun. 2008.
32. J. Wu, Advances in K-means Clustering: A Data Mining Thinking. New York: Springer-Verlag, 2012.
33. M. Meila and D. Heckerman, "An experimental comparison of model-based clustering methods," Mach. Learn., vol. 42, no. 1/2, pp. 9-29, Jan./Feb. 2001.
34. M. Steinbach, G. Karypis, and V. Kumar, "A comparison of document clustering techniques," in Proc. 6th ACM SIGKDD Int. Conf. Knowl. Discov. Data Mining, 2000.
35. A. Banerjee, I. Dhillon, J. Ghosh, and S. Sra, "Clustering on the unit hypersphere using von mises-fisher distributions," J. Mach. Learn. Res., vol. 6, pp. 1345-1382, Dec. 2005.