A scaleable document clustering approach for large document corpora

Information Processing and Management

Volumn 42, Issue 5, 2006, Pages 1163-1175

  Rooney, Niall ^a   Patterson, David ^a   Galushka, Mykola ^a   Dobrynin, Vladimir ^b  

^a UNIVERSITY OF ULSTER   (United Kingdom)

^b ST PETERSBURG STATE UNIVERSITY   (Russian Federation)

Author keywords

Document clustering; Information retrieval

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA ACQUISITION; INFORMATION ANALYSIS; INFORMATION RETRIEVAL; QUALITY CONTROL; SEMANTICS;

DOCUMENT CLUSTERING; DOCUMENT CORPUS; REUTERS CORPUS VOLUME 1 (RCV1) COLLECTION; SCALABILITY;

INFORMATION MANAGEMENT;

EID: 33646474444     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2005.10.003     Document Type: Article

References (26)

1. Baeza-Yates R., and Ribeiro-Neto B. Modern information retrieval (1999), ACM Press
2. Baker, L. D., & McCallum, A. K. (1998). Distributional clustering of words for text classification. In Proceedings of the 21st ACM international conference on research and development in information retrieval (SIGIR-98) (pp. 96-103).
3. Bekkerman, R., El-Yaniv, R., Tishby, N., & Winter, Y. (2001). On feature distributional clustering for text categorization. In Proceedings of the 24th ACM international conference on research and development in information retrieval (SIGIR-01) (pp. 146-153).
4. Bekkerman R., El-Yaniv R., Tishby N., and Winter Y. Distributional word clusters vs. words for text categorization. Journal of Machine Learning Research 1 1-48 (2002)
5. Belew R. Finding out about: a cognitive perspective on search engine technology and the WWW (2000), Cambridge Press
6. Cutting, D., Karger, D., Pedersen, J., & Tukey, J. (1992). Scatter/Gather: a cluster-based approach to browsing large document collections. In Proceedings of the 15th ACM international conference on research and development in information retrieval (SIGIR'92) (pp. 318-329).
7. Dhillon I.S., Fan J., and Guan Y. Efficient clustering of very large document collections. Data mining for scientific and engineering applications (2001), Kluwer Academic Publishers 357-381
8. Dhillon I.S., Manella S., and Kumar R. Divisive information-theoretic feature clustering algorithm for text classification. Journal of Machine Learning Research 3 (2003) 1265-1287
9. Dobrynin V., Patterson D., Galushka M., and Rooney N. SOPHIA: an interactive cluster based retrieval system for the OHSUMED collection. IEEE Transaction on Information Technology for Biomedicine 9 2 (2005)
10. Dobrynin V., Patterson D., and Rooney N. Contextual document clustering. Proceedings of the 26th European conference on information retrieval research. LNCS Vol. 2997 (2004), Springer 167-180
11. El-Yaniv R., and Souroujon O. Iterative double clustering for unsupervised and semi-supervised learning. Proceedings of 12th European conference on machine learning (2001), Springer 121-132
12. Gondek T., and Hoffman T. Non redundant data clustering. Proceedings of the 4th IEEE international conference on data mining (2004), IEEE CS Press 75-82
13. Guha, S., Rastogi, R., & Shim, K. (1998). CURE: An efficient clustering algorithm for large databases. In Proceedings of the ACM SIGMOD international conference on management of data (pp. 73-84).
14. Hearst, M. A., & Pedersen, J. O. (1996). Reexamining the cluster hypothesis: scatter/gather on retrieval results. In Proceedings of the 19th international ACM SIGIR conference on research and development in information retrieval (SIGIR'96) (pp. 76-84).
15. Jain A.K., Murty M.N., and Flynn P.J. Data clustering: a review. ACM Computing Surveys 31 3 (1999) 264-323
16. Lewis D., Yang Y., Rose T., and Lin F. RCV1: a new benchmark collection for text categorization research. Journal of Machine Learning Research 5 (2004) 362-397
17. Lin J. Divergence measures based on the Shannon entropy. IEEE Transactions on Information Theory 37 1 (1991) 145-151
18. Liu, X., & Croft, W. B. (2004). Cluster-based retrieval using language models. In Proceedings of the 27th annual international conference on research and development in information retrieval (SIGIR-04) (pp. 186-193).
19. McCallum, A., Nigam, K., & Ungar, L. H. (2000). Efficient clustering of high-dimensional data sets with application to reference matching. In Proceedings of the sixth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 169-178).
20. Mechkour, M., Harper, D. J., & Muresan, G. (1998). The webcluster project: using clustering for mediating access to the WWW. In Proceedings of the 21st ACM international conference on research and development in information retrieval (SIGIR-98) (pp. 357-358).
21. Pereira, F., Tishby, N., & Lee, L. (1993). Distributional clustering of English words. In 30th annual meeting of the association for computational linguistics (pp. 183-190), Columbus, Ohio.
22. Rose, T., Stevenson, M., & Whitehead, M. (2002). The Reuters corpus Vol. 1-from yesterday's news to tomorrow's language resources. In Proceedings of the 3rd international conference on language resources and evaluation.
23. Sebastiani F. Machine learning in automated text categorization. ACM Computer Surveys 34 1 (2002) 1-47 March
24. Slonim, N., & Tishby, N. (2000). Document clustering using word clusters via the information bottleneck method. In Proceedings of the 23rd annual international ACM SIGIR conference on research and development in information retrieval (SIGIR'00) (pp. 208-215).
25. Slonim, N., Friedman, N., & Tishby, N. (2002). Unsupervised document classification using sequential information maximization. In Proceedings of the 25th annual international conference on research and development in information retrieval (SIGIR'02) (pp. 129-136).
26. Tishby, N., Pereira, F., & Bialek, W. (1999). The Information bottleneck method. In Proceedings of the 37th annual allerton conference on communication, control, and computing (pp. 368-377).