Techniques of document clustering: A review

Library and Information Science

Volumn , Issue 49, 2003, Pages 33-75

  Kishida, Kazuaki ^a  

^a SURUGADAI UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 13444259727     PISSN: 03734447     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (100)

1. Anderberg, Michael R. Cluster Analysis for Applications. Academic Press, 1973.
2. Ando, Rie Kubota "Latent semantic space: iterative scaling improves precision of interdocument similarity measurement". Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2000, p. 216-223.
3. Ando, Rie Kubota; Lee, Lillian. "Iterative residual rescaling: an analysis and generalization of LSI". Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2001, p. 154-162.
4. Azcarraga, Arnulfo P.; Yap, Teddy N., Jr. "Extracting meaningful labels for WEBSOM text archives". Proceedings of the 2001 ACM CIKM, 2001, p. 41-48.
5. Beil, Florian; Ester, Martin; Xu, Xiaowei. "Frequent term-based text clustering". Proceeding of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2002, p. 436-442.
6. Boley, Daniel; Gini, Maria; Gross, Robert; Han, Eui-Hong; Hastings, Kyle; Karypis, George; Kumar, Vipin; Mobasher, Bamshad; Moore, Jerome. Document categorization and query generation on the World Wide Web using WebACE. Artificial Intelligence Review, vol. 13, no. 5/6, 1999, p. 365-391.
7. Bote, Vicente P. Guerrero; Anegón, Felix de Moya; Solana, Victor Herrero. Document organization using Kohonen's algorithm. Information Processing and Management, vol. 38, 2002, p. 79-89.
8. Buckley, C.; Allan, J.; Salton, G. "Automatic routing and ad-hoc retrieval using SMART; TREC2". Proceedings of the Second Text Retrieval Conference (TREC2). D. Harman ed. National Institute of Standards and Technology, 1994, p. 45-55.
9. Can, Fazli. Incremental clustering for dynamic information processing. ACM Transactions on Information Systems, vol. 10, no. 2, 1993, p. 143-164.
10. Can, Fazli; Fox, Edward A.; Snavely, Cory D.; France, Robert K. Incremental clustering for very large document databases: initial MARIAN experience. Information Sciences. vol.84, 1995, p. 101-114.
11. Can, Fazli; Ozkarahan, Esen A. Two partitioning type clustering algorithms. Journal of the American Society for Information Science. vol. 35, no. 5, 1984, p. 268-276.
12. Can, Fazli; Ozkarahan, Esen A. Similarity and stability analysis of the two partitioning type clustering algorithms. Journal of the American Society for Information Science, vol. 36, no. 1, 1985, p. 3-14.
13. Can, Fazli; Ozkarahan, Esen A. Computation of term/document discrimination values by use of the cover coefficient concept. Journal of the American Society for Information Science, vol. 38, no. 3, 1987, p. 171-183.
14. Can, Fazli; Ozkarahan, Esen A. Concepts and effectiveness of the cover-coefficient-based clustering methodology for text databases. ACM Transactions on Database Systems, vol. 15, no. 4, 1990, p. 483-517.
15. Chen, H.; Hsu, P.; Orwig, R.; Hoopes, L; Nunamaker, F., Jr. Automatic concept classification of text from electronic meetings. Communications of the ACM. vol. 37, no. 10, 1994, p. 56-73.
16. Croft, W. Bruce. Clustering large flies of documents using the single-link method. Journal of the American Society for Information Science, vol. 28, no. 6, 1977, p. 341-344.
17. Crouch, Donald B. A file organization and maintenance procedure for dynamic document collections. Information Processing and Management, vol. 11, no. 1/2, 1975, p. 11-21.
18. Cugini, John; Laskowski, Sharon; Piatko, Christine. "Document clustering in concept space; The NIST Information Retrieval Visualization Engine (NIRVE)". CODATA Euro-American Workshop, 1997.
19. Cutting, Douglass R.; Karger, David R.; Pedersen, Jan O.; Tukey, Joh W. "Scatter/Gather: A cluster-based approach to browsing large document collections". Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1992, p. 318-329.
20. Deerwester, S.; Dumais, S.; Furnas, G.; Landauer, T.; Harshman, R. Indexing by latent semantic analysis. Journal of the American Society for Information Science, vol. 41, no. 6, 1990, p. 391-407.
21. Dhillon, Inderjit; Kogan, Jacob; Nicholas, Charles. "Feature selection and document clustering". Survey of Text Mining. M. W. Berry, ed., Springer, 2004, p. 73-100.
22. Duda, R.O.; Hart, P.E.; Stork, D.G. Pattern Classification. 2nd ed. Wiley, 2001.
23. El-Hamdouchi, Abdelmoula; Willett, Peter. Techniques for the measurement of clustering tendency in document retrieval systems. Journal of Information Science, vol. 13, 1987, p. 361-365.
24. Franz, Martin; McCarley, J. Scott; Ward, Todd; Zhu, Wei-Jing. "Unsupervised and supervised clustering for topic tracking". Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2001, p. 310-317.
25. Frigui, Hichem; Nasraoui, Olfa. "Simultaneous clustering and dynamic keyword weighting for text documents". Survey of Text Mining. M. W. Berry, ed. Springer, 2004, p. 45-72.
26. Fung, Benjamin C. M.; Wang, Ke; Ester, Martin. "Hierarchical document clustering using frequent itemsets". SIAM International Conference on Data Mining, 2003.
27. Golub, G. H.; van Loan, C. F. Matrix Computations, 3rd ed. Johns Hopkins Univ. Press, 1996.
28. Griffith, Alan; Robinson, Lesley A.; Willett, Peter. Hierarchic agglomerative clustering methods for automatic classification. Journal of Documentation, vol. 40, no. 3, 1984, p. 175-205.
29. Han, Jiawei; Kamber, Micheline. Data Mining: Concepts and Techniques. Morgan Kaufmann, 2001.
30. Harding, Alan F.; Willett, Peter. Indexing exhaustivity and the computation of similarity matrices. Journal of the American Society for Information Science, vol. 31, no. 4, 1980, p. 298-300.
31. Hatzivassiloglou, Vasileios; Gravano, Luis; Maganti, Ankineedu. "An investigation of linguistic features and clustering algorithms for topic document clustering". Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2000, p. 224-231.
32. Havre, Susan; Hetzler, Elizabeth; Whitney, Paul; Nowell, Lucy. ThemeRiver: visualizing thematic changes in large document collection. IEEE Transactions on Visualization and Computer Graphics, vol. 8, no. 1, 2002, p. 9-20.
33. Hearst, Marti A.; Pedersen, Jan O. "Reexamining the cluster hypothesis: Scatter/Gather on retrieval results". Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1996, p. 76-84.
34. Hofmann, Thomas. "The cluster-abstraction model: unsupervised learning of topic hierarchies from text data". Proceedings of IJCAI-99, 1999.
35. Honkela, Timo; Kaski, Samuel; Lagus, Krista; Kohonen, Teuvo. "Exploration of full-text databases with self-organizing maps". Proceedings of ICNN'96, IEEE International Conference on Neural Networks, 1996, p. 56-61.
36. Ishikawa, Yoshiharu; Chen, Yibing.; Kitagawa, Hiroyuki. "An on-line document clustering method based on forgetting factors". Research and Advanced Technology for Digital Libraries: 5th European Conference, ECDL 2001. Panos Constantopoulos and Ingeborg T. Solvberg eds. Springer, LNCS 2163, 2001, p. 325-339.
37. Jain, A.K.; Murty, M.N.; Flynn, P.J. Data clustering: a review. ACM Computing Surveys, vol. 31, no. 3, 1999, p. 264-323.
38. Jardin, N.; van Rijsbergen, C. J. The use of hierarchic clustering in information retrieval. Information Storage and Retrieval, vol. 7, no. 5, 1971, p. 217-240.
39. Jones, Gareth; Robertson, Alexander M.; Santimetvivul, Chawchat; Willett, Peter. Nonhierarchic document clustering using a genetic algorithm. Information Research, vol. 1, no. 1, 1995. http://informationr.net/ir/1-1/paper1.html
40. Kaski, Samuel. "Dimensionality reduction by random mapping: fast similarity computation for clustering". Proceedings of IJCNN'98, IEEE International Joint Conference on Neural Networks, vol. 1, 1998, p. 413-418.
41. Kaski, Samuel. "Fast winner search for SOM-based monitoring and retrieval of high-dimensional data". Proceedings of ICANN 99, the 9th International Conference on Neural Networks, vol. 2, 1999, p. 940-945.
42. Library and Information Science, no. 47, 2003. p. 27-38.
43. Kobayashi, Mei; Aono, Masaki. "Vector space models for search and cluster mining". Survey of Text Mining. M.W. Berry ed. Springer, 2004. p. 103-122.
44. Kogan, Jacob. "Means clustering for text data". Proceedings of the Workshop on Text Mining at the First SIAM International Conference on Data Mining. 2001. p. 47-57.
45. Kohonen, T. Self-Organizing Maps. Springer-Verlag, 1995.
46. Kohonen, Teuvo; Kaski, Samuel; Lagus, Krista; Salojarvi, Jarkko; Honkela, Jukka; Paatero, Vesa; Saarela, Antti. Self organization of a massive document collection. IEEE Transactions on Neural Networks, vol. 11, no. 3, 2000, p. 574-585.
47. Kolatch, Erica. "Clustering algorithms for spatial databases: a survey". 2001. http://citeseer.nj.nec.com/436843.html
48. Korfhage, Robert R. Information Storage and Retrieval. John Wiley and Sons, 1997.
49. Lagus, Krista. Text Retrieval Using Self-organized Document Maps. Technical Report A61. Helsinki University of Technology, Laboratory of Computer and Information Science, 2000.
50. Lagus, Krista; Kaski, Samuel. "Keyword selection method for characterizing text document maps". Proceedings of ICANN 99, the 9th International Conference on Neural Networks, 1999, p. 371-376.
51. Larsen, Bjornar; Aone, Chinatsu. "Fast and effective text mining using linear-time document clustering". Proceedings, of the 5th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1999, p. 16-22.
52. Lin, Xia. Map displays for information retrieval. Journal of the American Society for Information Science, vol. 48, no. 1, 1997, p. 40-54.
53. Lin, X.; Soergel, D.; Marchionini, G. "A self-organizing sematic map for information retrieval". Proceedings of the 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 1991, p. 262-269.
54. Liu, Xin; Gong, Yihong; Xu, Wei; Zhu, Shenghuo. "Document clustering with cluster refinement and model selection capabilities". Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2002, p. 191-198.
55. Miller, Nancy; Wong, Pak Chung; Brewster, Mary; Foote, Harlan. "TOPIC ISLANDS: a wavelet-based text visualization system". IEEE Visualization'98, 1998, p. 189-196.
56. Muresan, Gheorghe; Harper, David J. "Document clustering and language models for system-mediated information access". Research and Advanced Technology for Digital Libraries: 5th European Conference, ECDL 2001. Panos Constantopoulos and Ingeborg T. Solvberg eds. Springer, LNCS 2163, 2001, p. 438-449.
57. Murtagh, F. Structure of hierarchic clustering: implications for information retrieval and for multivariate data analysis. Information Processing and Management, vol. 20, no. 5/6, 1984, p. 611-617.
58. Nilsson, Martin. Hierarchical clustering using non-greedy principal direction divisive partitioning. Information Retrieval, vol. 5, 2002, p. 311-321.
59. NIST. Topic Detection and Tracking (TDT). http: //www.nist.gov/speech/tests/tdt/ (2004-06-07)
60. NTCIR. NTCIR (NII-NACSIS Test Collection for IR Systems) Project, http: //research.nii.ac.jp/ntcir/ (2004-06-07)
61. Olsen, Kai A.; Korfhage, Robert R.; Sochats, Kenneth M.; Spring, Michael B.; Williams James G. Visualization of a document collection: the VIBE system. Information Processing and Management.vol. 29, no. 1, 1993, p. 66-81.
62. Orwig, Richard E.; Chen, Hsinchun; Nunamaker, Jay F., Jr. A graphical, self-organizing approach to classifying electronic meeting output. Journal of the American Society for Information Science, vol. 48, no. 2, 1997, p. 157-170.
63. Pantel, Patrick; Lin, Dekang. "Document clustering with committees". Proceedings. of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2002, p. 199-206.
64. Papka, Ron; Allan, James. "Topic detection and tracking: event clustering as a basis for first story detection". Advances in Information Retrieval. W. Bruce Croft ed. Kluwer Academic Publishers, 2000. p. 97-126.
65. Rasmussen, Edie. "Clustering algorithms". Information Retrieval: Data Structure and Algorithms. William B. Frakes and Ricardo Baeza-Yates eds. PTR Prentice Hall, 1992. p. 419-442.
66. Roussinov, Dmitri G.; Chen, Hsinchun. Information navigation on the web by clustering and summarizing query results. Information Processing and Management, vol. 37, 2001, p. 789-816.
67. Sahami, Mehran; Yusufali, Salim; Baldonado, Michelle Q. W. "SONIA: A service for organizing networked information autonomously". Proceeding of the third ACM International Conference on Digital Libraries. 1998, p. 200-209.
68. Salton, G.; McGill, M. J. Introduction to Modern Information Retrieval. McGraw-Hill. 1983.
69. Schutze, Hinrich; Silverstein, Craig. "Projections for efficient document clustering". Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 1997, p. 74-81.
70. Sibson, R. SLINK: an optimally efficient algorithm for the single-link cluster method. The Computer Journal, vol. 16, no. 1, 1973, p. 30-34.
71. Silverstein, Craig; Pedersen, Jan O. "Almost-constant-time clustering of arbitrary corpus subsets". Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 1997, p. 60-66.
72. Slonim, Noam; Tishby, Naftali. "Document clustering using word clusters via the information bottleneck method". Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2000, p. 267-273.
73. Small, Henry. Update on science mapping: creating large documentation space. Scientometrics. vol. 38, no. 2, 1997, p. 275-293.
74. Small, Henry. Visualizing science by citation mapping. Journal of the American Society for Information Science, vol. 59, no. 9, 1999, p. 799-813.
75. Smeaton, Alan F.; Burnett, Mark; Crimmins, Francis; Quinn, Gerard. "An architecture for efficient document clustering and retrieval on a dynamic collection of newspaper texts". 20th BCS-IRGS Colloquium on Information Retrieval. 1998.
76. Steinbach, Michael; Karypis, George; Kumar, Vipin. "A comparison of document clustering techniques". KDD Workshop on Text Mining. 2000.
77. TREC. Text REtrieval Conference (TREC) http: //trec.nistgov/ (2004-06-07)
78. van Huile, Marc M. Faithful Representations and Topographic Maps. John Wiley and Sons, 2000.
79. van Rijsbergen, C. J. Further experiments with hierarchic document clustering in document retrieval. Information Storage and Retrieval, vol. 10, no. 1, 1974, p. 1-14.
80. van Rijsbergen, C. J. Information Retrieval. 2nd ed. Butterworths, 1979.
81. van Rijsbergen, C. J; Croft, W. B. Document clustering: an evaluation of some experiments with the Cranfield 1400 collection. Information Processing and Management, vol. 11, no. 5/7, 1975, p. 171-182.
82. van Rijsbergen, C. J.; Sparck Jones, K. A test for the separation of relevant and non-relevant documents in experimental retrieval collections. Journal of Documentation, vol. 29, no. 3, 1973, p. 251-257.
83. Voorhees, Ellen M. Implementing agglomerative hierarchic clustering algorithms for use in document retrieval. Information Processing and Management, vol. 22, no. 6, 1986, p. 465-476.
84. Wang, Yitong; Kitsuregawa, Masaru. "Evaluating contents-link coupled web page clustering for web search results". Proceedings of the 2002 ACM CIKM. 2002, p. 499-506.
85. Weiss, Sholom; White, Brian F.; Apte, Chidanand V. "Lightweight document clustering". IBM Research Report. No. RC-21684, 2000. http://www.research.ibm.com/dar/papers/pdf/weiss_ldc_with-cover.pdf
86. Willett, Peter. Document clustering using an inverted file approach. Journal of Information Science, vol. 2, no. 5, 1980, p. 223-231.
87. Willett, Peter. A fast procedure for the calculation of similarity coefficients in automatic classification. Information Processing and Management, vol. 17, 1981, p. 53-60.
88. Willett, Peter. Recent trends in hierarchic document clustering: a critical review. Information Processing and Management, vol. 24, no. 5, 1988, p. 577-597.
89. Wise, James A. The ecological approach to text visualization. Journal of the American Society for Information Science, vol. 50, no. 13, 1999, p. 1224-1233.
90. Xu, J.; Croft, W. B. "Topic-based language models for distributed retrieval". Advances in Information Retrieval: Recent Research from the Center for Intelligence Information Retrieval. W. B. Croft ed. Kluwer, 2000, p. 151-172.
91. Xu, Wei; Liu, Xin; Gong.Yihong. "Document clustering based on non-negative matrix factorization". Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2003, p. 267-273.
92. Yu, Clement T. A clustering algorithm based on user queries. Journal of the American Society for Information Science, vol. 25, no. 4, 1974, p. 218-226.
93. Zamir, Oren; Etzioni, Oren. "Web document clustering: a feasibility demonstration". Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 1998, p. 45-54.
94. Zamir, Oren; Etzioni, Oren. "Grouper: a dynamic clustering interface to Web search results". The Eighth International World Wide Web Conference. 1999. http://www8.org/w8-papers/
95. Zhao, Ying; Karypis, George. "Evaluation of hierarchical clustering algorithms for document databases". Proceeding of the 2002 ACM CIKM. 2002, p. 515-524.