Improving Web site understanding with keyword-based clustering

Journal of Software Maintenance and Evolution

Volumn 20, Issue 1, 2008, Pages 1-29

  Ricca, Filippo ^a   Pianta, Emanuele ^b   Tonella, Paolo ^b   Girardi, Christian ^b  

^a DISI   (Italy)

^b ITC IRST   (Italy)

Author keywords

Keyword based clustering; Keywords extraction; Web site understanding

Indexed keywords

CLUSTERING ALGORITHMS; CONTENT BASED RETRIEVAL; HTML; SOCIETIES AND INSTITUTIONS; VIRTUAL STORAGE; WEBSITES;

KEYWORD-BASED CLUSTERING; KEYWORDS EXTRACTION; WEB SITE UNDERSTANDING;

COMPUTER SOFTWARE MAINTENANCE;

EID: 40049095506     PISSN: 1532060X     EISSN: 15320618     Source Type: Journal    
DOI: 10.1002/smr.360     Document Type: Article

References (39)

1. Corbi TA. Program understanding: challenge for the 1990's. IBM Systems Journal 1989; 28(2):294-306.
2. Warren P, Boldyreff C, Munro M. The evolution of websites. Proceedings of the International Workshop on Program Comprehension (IWPC), 1999; 178-185.
3. Ricca F, Tonella P. Analysis and testing of web applications. Proceedings of the International Conference on Software Engineering (ICSE), 12-19 May 2001; 25-34.
4. Di Lucca GA, Fasolino AR, De Carlini U, Pace F, Tramontana P. Comprehending web applications by a clustering based approach. Proceedings of the 10th International Workshop on Program Comprehension (IWPC), 2002; 261-270.
5. Ricca F, Tonella P, Girardi C, Pianta E. An empirical study on keyword-based website clustering. Proceedings of the 12th International Workshop on Program Comprehension (IWPC), June 2004; 204-213.
6. Tonella P, Ricca F, Pianta E, Girardi C. Using keyword extraction for website clustering. Proceedings of the International Workshop on Website Evolution (WSE), September 2003; 41-48.
7. Anquetil N, Lethbridge TC. Experiments with clustering as a software remodularization method. Proceedings of the 6th Working Conference on Reverse Engineering (WCRE), 1999; 235-255.
8. Mancoridis S, Mitchell BS, Chen Y, Gansner ER. Using automatic clustering to produce high-level system organizations of source code. Proceedings of the International Workshop on Program Comprehension (IWPC), 1998; 45-52.
9. Manning CD, Schtze H. Foundations of Statistical Natural Language Processing. The MIT Press: Cambridge MA, 1999.
10. Wiggerts TA. Using clustering algorithms in legacy systems remodularization. Proceedings of the 4th Working Conference on Reverse Engineering (WCRE), 1997; 33-43.
11. Salton G. Automatic Text processing: The Transformation Analysis and Retrieval of Information by Computer. Addison-Wesley Publishing Company: Reading, MA, 1989.
12. Willet P. Recent trends in hierarchic document clustering: A critical review. Information Processing and Management 1988; 24(5):577-597.
13. Salton G, McGill MJ. Introduction to Modern Information Retrieval. McGraw-Hill: New York NY, 1983.
14. Bentivogli L, Pianta E. Beyond lexical units: Enriching WordNets with phrasets. Proceedings of the Research Note Sessions of the 10th Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2003; 67-70.
15. Tonella P, Ricca F, Pianta E, Girardi C. Restructuring multilingual websites. Proceedings of the International Conference on Software Maintenance (ICSM), 2002; 290-299.
16. Wohlin C, Runeson P, Host M, Ohlsson MC, Regnell B, Wesslen A. Experimentation in Software Engineering: An Introduction. Kluwer Academic Publishers: Dortrecht, 2000.
17. van Rijsbergen CJ. Information Retrieval (2nd edn). http://www.dcs.gla.ac.uk/Keith/Preface.html [5 August 2007].
18. Wikipedia, the free on-line encyclopaedia. http://en.wikipedia.org/wiki/ Macromedia_Flash [5 August 2007].
19. Wikipedia, the free on-line encyclopaedia. http://en.wikipedia.org/wiki/ AJAX [5 August 2007].
20. Girardi C, Ricca F, Tonella P. Web crawlers compared. International Journal of Web Information Systems 2006; 2(2):85-94.
21. Miller RC, Bharat K. SPHINX: A framework for creating personal, site-specific web crawlers. Proceedings of the International World Wide Web Conference (WWW), 1998; 119-130.
22. Boldi P, Codenotti B, Santini M, Vigna S. Ubicrawler: A scalable fully distributed web crawler. Software-Practice and Experience 2004; 34(8):711-726.
23. Cho J, Garcia-Molina H. Parallel crawlers. Proceedings of the 11th International World-Wide Web Conference, 7-11 May 2002; 124-135.
24. Heydon A, Najork M. Mercator: A scalable, extensible web crawler. World Wide Web 1999; 2(4):219-229.
25. Raghavan S, Garcia-Molina H. Crawling the hidden web. Proceedings of the Twenty-seventh International Conference on Very Large Databases, 2001; 129-138.
26. Di Lucca GA, Di Penta M, Fasolino AR. An approach to identify duplicated web pages. Proceedings of the 26th Annual International Computer Software and Applications Conference (COMPSAC), 2002; 481 -486.
27. Ricca F, Tonella P. Using clustering to support the migration from static to dynamic web pages. Proceedings of the International Workshop on Program Comprehension (IWPC), 2003; 207-216.
28. Antoniol G, Canfora G, Casazza G, De Lucia A. Information retrieval models for recovering traceability links between code and documentation. Proceedings of the International Conference on Software Maintenance (ICSM), 2000; 40-51.
29. Marcus A, Maletic JI. Recovering documentation-to-source-code traceability links using latent semantic indexing. Proceedings of the 25th International Conference on Software Engineering (ICSE), 2003; 124-135.
30. Anquetil N, Lethbridge T. Assessing the relevance of identifier names in a legacy software system. Proceedings of CASCON, 1998; 213-222.
31. Maletic JI, Marcus A. Supporting program comprehension using semantic and structural information. Proceedings of the 23rd International Conference on Software Engineering (ICSE) 2001; 103-112.
32. Maarek YS, Berry DM, Kaiser GE. An information retrieval approach for automatically constructing software libraries. IEEE Transactions on Software Engineering 1991; 17(8):800-813.
33. Baeza-Yates R, Poblete B. A website mining model centered on user queries. Proceedings of the European Web Mining Forum, Berendt B et al. (eds.). 2005; 3-15.
34. Silva JF, Mexia J, Coelho A, Lopes GP. Multilingual Document Clustering, Cluster Topic Extraction and Data Transformation. Lecture Notes in Artificial Intelligence (Progress in Artificial Intelligence), vol. 2258. Springer: Berlin, 2001; 74-87.
35. Steinbach M, Karypis G, Kumar V. A comparison of document clustering techniques. Proceedings of the KDD Workshop on Text Mining, 2000.
36. Zamir O, Etzioni O. Web document clustering: A feasibility demonstration. Proceedings of ACM SIGIR'98. Research and Development in Information Retrieval, 1998; 46-54.
37. Poblete B, Baeza-Yates R. A content and structure Website mining model. Proceedings of 15th International Conference on World Wide Web (WWW '06). ACM Press: New York NY, 2006; 957-958.
38. Forster R. Document clustering in large German corpora using natural language processing. Thesis, Faculty of Arts of the University of Zurich for the degree of doctor of Philosophy, http://www.dissertationen.unizh.ch/2006/ forster/abstract.htm [5 August 2007],
39. Dave K. Using cluster analysis to automatically thread discussion board messages. Senior Thesis, Yale University. http://citeseer.ist.psu.edu/ dave02using.html [5 August 2007].