Effectiveness of template detection on noise reduction and websites summarization

Information Sciences

Volumn 219, Issue , 2013, Pages 41-72

  Alassi, Derar ^a   Alhajj, Reda ^a  

^a UNIVERSITY OF CALGARY   (Canada)

Author keywords

Noise detection; Template detection; Web mining; Website summarization

Indexed keywords

COHERENT BLOCKS; CONTENT AND STRUCTURE; HAND HELD DEVICE; NOISE DETECTION; ON THE GO; PROCESSING TIME; SPACE COMPLEXITY; TEMPLATE DETECTION; TIME COMPLEXITY; WEB MINING;

DETECTORS; INTERNET; NOISE ABATEMENT;

WEBSITES;

EID: 84867575506     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.07.022     Document Type: Article

References (28)

1. F. Ahmadi-Abkenari, and A. Selamat An architecture for a focused trend parallel Web crawler with the application of clickstream analysis Information Sciences 184 1 2012 266 281
2. S. Akbar, L. Slaughter, O. Nytro, Extracting main content-blocks from blog posts, in: Proceedings of the International Conference on Knowledge Discovery and Information Retrieval, 2010, pp. 438-443.
3. Z. Bar-Yossef, and S. Rajagopalan Template detection via data mining and its applications Proceedings of the 11th International Conference on World Wide Web 2002 ACM Honolulu, Hawaii, USA 580 591
4. D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma Block-based Web search SIGIR'04 2004 acm Sheffield, South Yorkshire, UK
5. D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma VIPS: A Vision-based Page Segmentation Algorithm 2003 Microsoft Corporation Redmond
6. J. Chen, B. Zhou, J. Shi, H. Zhang, Q. Fenqwu, Function-based object model towards website adaptation, in: Proceedings of the 10th International Conference on World Wide Web, Hong Kong, 2001.
7. S. Debnath, P. Mitra, and C.L. Giles Automatic extraction of informative blocks from webpages Proceedings of the 2005 ACM Symposium on Applied Computing 2005 ACM Santa Fe, New Mexico 1722 1726
8. D. Fernandes, E. Moura, B. Ribiero-Neto, A. Silva, M. Goncalves, Computing block importance for searching on Web sites, in: CIKM 2007, 2007, pp. 165-174.
9. D. Gibson, K. Punera, and A. Tomkins The volume and evolution of Web page template International World Wide Web Conference 2005 ACM Chiba, Japan 830 839
10. S. Gupta, G. Kaiser, D. Neistadt, and P. Grimm DOM-based Content Extraction of HTML Documents 2003 ACM Budapest, Hungary
11. M. Kovacevic, M. Diligenti, M. Gori, and V. Milutinovic Recognition of common areas in a Web page using visual information: a possible application in a page classification Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM'02) 2002 Maebashi TERRSA/EEE Computer Society Maebashi City, Japan/Washington, DC, USA
12. C. Li, J. Dong, and J. Chen Extraction of informative blocks from Web pages based on VIPS Journal of Computational Information Systems 6 1 2010 271 277
13. J. Li, C. Ezeife, Cleaning Web pages for effective Web content mining, in: 17th International Conference Database and Expert Systems Applications, Krakow, Poland, 2006, pp. 560-571. (Pubitemid 44502995)
14. S.-H. Lin, and J.-M. Ho Discovering informative content blocks from Web documents The 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2002 ACM New York, NY, USA 588 593
15. B. Liu Web Data Mining: Exploring Hyperlinks* Contents and Usage Data 2006 Springer New York
16. B. Liu, and K. Chen-Chuan-Chang Editorial: special issue on Web content mining ACM SIGKDD Explorations Newsletter 2004 1 4
17. B. Liu, W. Hsu, and Y. Ma Integrating classification and association rule mining ACM SIGKDD 1998 AAAI Press 80 86
18. L. Lo, V. To-Yee Ng, P. Ng, S.C. Chan, Automatic template detection for structured Web pages, in: Proceedings of the 10th International Conference on Computer Supported Cooperative Work in Design, Nanjing, China, 2006, pp. 1-6.
19. M. Murata, H. Toda, Y. Matsuura, and R. Kataoka Access concentration detection in click logs to improve mobile Web-IR Information Sciences 179 12 2009 1859 1869
20. C. van Rijsbergen, S. Robertson, M. Porter, New models in probabilistic information retrieval. British Library Research and Development Report, No. 5587, London, UK, 1980.
21. R. Song, H. Liu, J.-R. Wen, and W.-Y. Ma Learning block importance models for Web pages Proceedings of the 13th International Conference on World Wide Web 2004 ACM New York, NY, USA 203 211 (Pubitemid 40752755)
22. K.-C. Tai The Tree-to-Tree Correction Problem 26 3 1979
23. B. van Gils, H.A.E. Proper, P. van Bommel, and Th.P. van der Weide On the quality of resources on the Web: an information retrieval perspective Information Sciences 177 21 2007 4566 4597
24. K. Vieira, A.S. Silva, N. Pinto, E.S. Moura, J.M. Cavalcanti, and J. Freire A fast and robust method for Web page template detection and removal The 15th ACM International Conference on Information and Knowledge Management 2006 ACM Arlington, Virginia, USA 258 267 (Pubitemid 47203573)
25. World Internet Usage Statistics News and World Population Stats, from Internet Usage World Stats. (retrieved 16.01.09).
26. W. Yang, Identifying Syntactic Differences Between Two Programs 21, 1991.
27. L. Yi, B. Liu, and X. Li Eliminating noisy information in Web pages for data mining Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2003 ACM Washington 296 305
28. K. Zhang, The Editing Distance Between Trees: Algorithms and Applications, PhD thesis, Courant Institute, Departement of Computer Science, 1989.