Efficient phrase-based document indexing for web document clustering

IEEE Transactions on Knowledge and Data Engineering

Volumn 16, Issue 10, 2004, Pages 1279-1296

  Hammouda, Khaled M ^a   Kamel, Mohamed S ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Document clustering; Document index graph; Document similarity; Document structure; Phrase matching; Phrase based indexing; Web mining

Indexed keywords

ALGORITHMS; CHARACTER RECOGNITION; DATA MINING; DATABASE SYSTEMS; HTML; INFORMATION RETRIEVAL SYSTEMS; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; SEARCH ENGINES; TREES (MATHEMATICS); WORLD WIDE WEB;

DOCUMENT CLUSTERING; DOCUMENT INDEX GRAPHS; DOCUMENT SIMILARITY; DOCUMENT STRUCTURE; PHRASE MATCHING; PHRASE-BASED INDEXING; WEB MINING;

INDEXING (OF INFORMATION);

EID: 13844267502     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2004.58     Document Type: Article

References (45)

1. K. Cios, W. Pedrycs, and R. Swiniarski, Data Mining Methods for Knowledge Discovery. Boston: Kluwer Academic Publishers, 1998.
2. W.B. Frakes and R. Baeza-Yates, Information Retrieval: Data Structures and Algorithms. Englewood Cliffs, N.J.: Prentice Hall, 1992.
3. R. Kosala and H. Blockeel, "Web Mining Research: A Survey," ACM SIGKDD Explorations Newsletter, vol. 2, no. 1, pp. 1-15, 2000.
4. O. Zamir and O. Etzioni, "Grouper: A Dynamic Clustering Interface to Web Search Results," Computer Networks, vol. 31, nos. 11-16, pp. 1361-1374, 1999.
5. S. Dumais, J. Platt, D. Heckerman, and M. Sahami, "Inductive Learning Algorithms and Representations for Text Categorization," Proc. Seventh Int'l Conf. Information and Knowledge Management, pp. 148-15, Nov. 1998.
6. H. Kargupta, I. Hamzaoglu, and B. Stafford, "Distributed Data Mining Using an Agent Based Architecture," Proc. Knowledge Discovery and Data Mining, pp. 211-214, 1997.
7. U.Y. Nahm and R.J. Mooney, "A Mutually Beneficial Integration of Data Mining and Information Extraction," Proc. 17th Nat'l Conf. Artificial Intelligence (AAAI-00), pp. 627-632, 2000.
8. Y. Yang, J. Carbonell, R. Brown, T. Pierce, B. Archibald, and X. Liu, "Learning Approaches for Detecting and Tracking News Events," IEEE Intelligent Systems, vol. 14, no. 4, pp. 32-43, 1999.
9. D. Freitag and A. McCallum, "Information Extraction with HMMs and Shrinkage," Proc. AAAI-99 Workshop Machine Learning for Information Extraction, pp. 31-36, 1999.
10. T. Hofmann, "The Cluster-Abstraction Model: Unsupervised Learning of Topic Hierarchies from Text Data," Proc. 16th Int'l Joint Conf. Artificial Intelligence (IJCAI-99), pp. 682-687, 1999.
11. T. Honkela, S. Kaski, K. Lagus, and T. Kohonen, "WEBSOM - Self-Organizing Maps of Document Collections," Proc. WSOM'97, Workshop Self-Organizing Maps, pp. 310-315, June 1997.
12. W.W. Cohen, "Learning to Classify English Text with ILP Methods," Proc. Fifth Int'l Workshop Inductive Logic Programming, pp. 3-24, 1995.
13. M. Junker, M. Sintek, and M. Rinck, "Learning for Text Categorization and Information Extraction with ILP," Proc. First Workshop Learning Language in Logic, J. Cussens, ed., pp. 84-93, 1999.
14. S. Scott and S. Matwin, "Feature Engineering for Text Classification," Proc. 16th Int'l Conf. Machine Learning (ICML-99), pp. 379-388, 1999.
15. S. Soderland, "Learning Information Extraction Rules for Semi-Structured and Free Text," Machine Learning, vol. 34, nos. 1-3, pp. 233-272, 1999.
16. K. Aas and L. Eikvil, "Text Categorisation: A Survey," Technical Report 941, Norwegian Computing Center, June 1999.
17. G. Salton, A. Wong, and C. Yang, "A Vector Space Model for Automatic Indexing," Comm. ACM, vol. 18, no. 11, pp. 613-620, Nov. 1975.
18. G. Salton and M.J. McGill, Introduction to Modern Information Retrieval. McGraw-Hill Computer Science Series, New York: McGraw-Hill, 1983.
19. G. Salton, Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Reading, Mass.: Addison Wesley, 1989.
20. O. Zamir, O. Etzioni, O. Madanim, and R.M. Karp, "Fast and Intuitive Clustering of Web Documents," Proc. Third Int'l Conf. Knowledge Discovery and Data Mining, pp. 287-290, Aug. 1997.
21. O. Zamir and O. Etzioni, "Web Document Clustering: A Feasibility Demonstration," Proc. 21st Ann. Int'l ACM SIGIR Conf., pp. 46-54, 1998.
22. M.F. Porter, "An Algorithm for Suffix Stripping," Program, vol. 14, no. 3, pp. 130-137, July 1980.
23. S. Kurtz, "Reducing the Space Requirement of Suffix Trees," Software - Practice and Experience, vol. 29, no. 13, pp. 1149-1171, 1999.
24. A. Apostolico, "The Myriad Virtues of Subword Trees," Combinatorial Algorithms on Words, A. Apostolico and Z. Galil, eds., pp. 85-96, (NATO ISI Series), 1985.
25. U. Manber and G. Myers, "Suffix Arrays: A New Method for On-Line String Searches," SIAM J. Computing, vol. 22, no. 5, pp. 935-948, 1993.
26. J.L. Pagan, "Experiments in Automatic Phrase Indexing for Document Retrieval: A Comparison of Syntactic and Non-Syntactic Methods," PhD thesis, Dept. of Computer Science, Cornell Univ., Sept. 1987.
27. M.F. Caropreso, S. Matwin, and F. Sebastiani, "Statistical Phrases in Automated Text Categorization," Technical Report IEI-B4-07-2000, Pisa, Italy, 2000.
28. J.D. Isaacs and J.A. Aslam, "Investigating Measures for Pairwise Document Similarity," Technical Report PCS-TR99-357, Dartmouth College, Computer Science, Hanover, N.H., June 1999.
29. D. Lin, "An Information-Theoretic Definition of Similarity," Proc. 15th Int'l Conf. Machine Learning, pp. 296-304, 1998.
30. A. Strehl, J. Ghosh, and R. Mooney, "Impact of Similarity Measures on Web-Page Clustering," Proc. 17th Nat'l Conf. Artificial Intelligence: Workshop Artificial Intelligence for Web Search (AAAI 2000), pp. 58-64, July 2000.
31. Y. Yang and J.P. Pedersen, "A Comparative Study on Feature Selection in Text Categorization," Proc. 14th Int'l Conf. Machine Learning (ICML'97), pp. 412-420, 1997.
32. M. Steinbach, G. Karypis, and V. Kumar, "A Comparison of Document Clustering Techniques," Proc. KDD-2000 Workshop TextMining, Aug. 2000.
33. A.K. Jain and R.C. Dubes, Algorithms for Clustering Data. Englewood Cliffs, N.J.: Prentice Hall, 1988.
34. A.K. Jain, M.N. Murty, and P.J. Flynn, "Data Clustering: A Review," ACM Computing Surveys, vol. 31, no. 3, pp. 264-323, 1999.
35. M. Charikar, C. Chekuri, T. Feder, and R. Motwani, "Incremental Clustering and Dynamic Information Retrieval," Proc. 29th Ann. ACM Symp. Theory of Computing, pp. 626-635, 1997.
36. F. Beil, M. Ester, and X. Xu, "Frequent Term-Based Text Clustering," Proc. Eighth Int'l Conf. Knowledge Discovery and Data Mining (KDD 2002), pp. 436-442, 2002.
37. P. Pantel and D. Lin, "Document Clustering with Committees," Proc. ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 199-206, 2002.
38. D.R. Hill, "A Vector Clustering Technique," Mechanized Information Storage, Retrieval and Dissemination. K. Samuelson, ed., Amsterdam: North-Holland Publishing, 1968.
39. B.V. Dasarathy, Nearest Neighbor NN Norms: NN Pattern Classification Techniques. McGraw-Hill Computer Science Series. IEEE CS Press, 1991.
40. S.Y. Lu and K.S. Fu, "A Sentence-to-Sentence Clustering Procedure for Pattern Analysis," IEEE Trans. Systems, Man, and Cybernetics, vol. 8, pp. 381-389, 1978.
41. W. Wong and A. Fu, "Incremental Document Clustering for Web Page Classification," Proc. 2000 Int'l Conf. Information Soc. in the 21st Century: Emerging Technologies and New Challenges (IS2000), 2000.
42. K. Hamrnouda and M. Kamel, "Phrase-Based Document Similarity Based on an Index Graph Model," Proc. 2002 IEEE Int'l Conf. Data Mining (ICDM'02), pp. 203-210, Dec. 2002.
43. D. Boley, "Principal Direction Divisive Partitioning," Data Mining and Knowledge Discovery, vol. 2, no. 4, pp. 325-344, 1998.
44. D. Boley, M. Gini, R. Gross, S. Han, K. Hastings, G. Karypis, V. Kumar, B. Mobasher, and J. Moore, "Partitioning-Based Clustering for Web Document Categorization," Decision Support Systems, vol. 27, pp. 329-341, 1999.
45. D. Boley, M. Gini, R. Gross, S. Han, K. Hastings, G. Karypis, V. Kumar, B. Mobasher, and J. Moore, "Document Categorization and Query Generation on the World Wide Web Using WebACE," AI Rev., vol. 13, nos. 5-6, pp. 365-391, 1999.