A densitometric approach to web page segmentation

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2008, Pages 1173-1182

  Kohlschütter, Christian ^a   Nejdl, Wolfgang ^a  

^a L3S RESEARCH CENTER   (Germany)

Author keywords

Full text extraction; Noise removal; Template detection; Web page Segmentation

Indexed keywords

FULL-TEXT EXTRACTION; FULL-TEXT SEARCH; HTML PAGES; NEW APPROACHES; NOISE REMOVAL; QUANTITATIVE LINGUISTICS; TEMPLATE DETECTION; TEXT CLASSIFICATION; TEXT SEGMENTS; WEB PAGE; WEB PAGE SEGMENTATION;

COMPUTER VISION; INFORMATION SERVICES; KNOWLEDGE MANAGEMENT; MARKUP LANGUAGES; NATURAL LANGUAGE PROCESSING SYSTEMS; WORLD WIDE WEB;

TEXT PROCESSING;

EID: 70349243805     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1458082.1458237     Document Type: Conference Paper

References (26)

1. Gabriel Altmann. Verteilungen der Satzlängen (Distribution of Sentence Lengths). In K.-P. Schulz, editor, Glottometrika 9. Brockmeyer, 1988.
2. A. Antonacopoulos, B. Gatos, and D. Bridson. Page segmentation competition. Document Analysis and Recognition, 2007. ICDAR 2007. Ninth International Conference on, 2:1279-1283, 23-26 Sept. 2007.
3. Shumeet Baluja. Browsing on small screens: recasting web-page segmentation into an efficient machine learning framework. In WWW '06: Proceedings of the 15th international conference on World Wide Web, pages 33-42, New York, NY, USA, 2006. ACM.
4. Ziv Bar-Yossef and Sridhar Rajagopalan. Template detection via data mining and its applications. In WWW, pages 580-591, 2002.
5. Karl-Heinz Best. Quantitative Linguistics - An International Handbook, chapter Satzlänge (Sentence length), pages 298-304. de Gruyter, 2005.
6. Karl-Heinz Best. Sprachliche Einheiten in Textblöcken. In Glottometrics 9, pages 1-12. RAM Verlag, L̈udenscheid, 2005.
7. Deng Cai, Shipeng Yu, Ji-Rong Wen, and Wei-Ying Ma. Extracting content structure for web pages based on visual representation. In X. Zhou, Y. Zhang, and M. E. Orlowska, editors, APWeb, volume 2642 of LNCS, pages 406-417. Springer, 2003.
8. Deng Cai, Shipeng Yu, Ji-Rong Wen, and Wei-Ying Ma. Block-based web search. In SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, pages 456-463, New York, NY, USA, 2004. ACM.
9. Deepayan Chakrabarti, Ravi Kumar, and Kunal Punera. Page-level template detection via isotonic smoothing. In WWW '07: Proceedings of the 16th international conference on World Wide Web, pages 61-70, New York, NY, USA, 2007. ACM.
10. Deepayan Chakrabarti, Ravi Kumar, and Kunal Punera. A graph-theoretic approach to webpage segmentation. In WWW '08: Proceeding of the 17th international conference on World Wide Web, pages 377-386, New York, NY, USA, 2008. ACM.
11. Ming Chen, Xiaoqing Ding, and Jian Liang. Analysis, understanding and representation of chinese newspaper with complex layout. Image Processing, 2000. Proceedings. 2000 International Conference on, 2:590-593 vol.2, 2000.
12. Yu Chen, Wei-Ying Ma, and Hong-Jiang Zhang. Detecting web page structure for adaptive viewing on small form factor devices. In WWW '03: Proceedings of the 12th international conference on World Wide Web, pages 225-233, New York, NY, USA, 2003. ACM.
13. Sandip Debnath, Prasenjit Mitra, Nirmal Pal, and C. Lee Giles. Automatic identification of informative sections of web pages. IEEE Trans. on Knowledge and Data Engineering, 17(9):1233-1246, 2005.
14. Lukasz Debowski. Zipf's law against the text size: a half-rational model. In Glottometrics 4, pages 49-60. RAM Verlag, Lüdenscheid, 2002.
15. David Fernandes, Edleno S. de Moura, Berthie Ribeiro-Neto, Altigran S. da Silva, and Marcos André Gonçalves. Computing block importance for searching on web sites. In CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, pages 165-174, New York, NY, USA, 2007. ACM.
16. David Gibson, Kunal Punera, and Andrew Tomkins. The volume and evolution of web page templates. In Allan Ellis and Tatsuya Hagino, editors, WWW (Special interest track), pages 830-839. ACM, 2005.
17. Peter Grzybek. On the systematic and system-based study of grapheme frequencies - a re-analysis of german letter frequencies. In G. Altmann, K.-H. Best, and P. Grzybek et al., editors, Glottometrics 15, pages 82-91. RAM Verlag, Lüdenscheid, 2007.
18. Marti A. Hearst. Multi-paragraph segmentation of expository text. In Proceedings of the 32nd annual meeting on Association for Computational Linguistics, pages 9-16, Morristown, NJ, USA, 1994. Association for Computational Linguistics.
19. Lawrence Hubert and Phipps Arabie. Comparing partitions. Journal of Classification, 2(1):193-218, December 1985.
20. Hung-Yu Kao, Jan-Ming Ho, and Ming-Syan Chen. Wisdom: Web intrapage informative structure mining based on document object model. Knowledge and Data Engineering, IEEE Transactions on, 17(5):614-627, May 2005.
21. Jared M. Spool, Tara Scanlon, Carolyn Snyder, Will Schroeder, and Terri DeAngelo. Web site usability: a designer's guide. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1999.
22. George Stockman and Linda G. Shapiro. Computer Vision. Prentice Hall PTR, Upper Saddle River, NJ, USA, 2001.
23. Alexander Strehl and Joydeep Ghosh. Cluster ensembles - a knowledge reuse framework for combining multiple partitions. J. Mach. Learn. Res., 3:583-617, 2003.
24. Karane Vieira, Altigran S. da Silva, Nick Pinto, Edleno S. de Moura, ao M. B. Cavalcanti Jo and Juliana Freire. A fast and robust method for web page template detection and removal. In CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management, pages 258-267, New York, NY, USA, 2006. ACM.
25. Relja Vulanovic and Reinhard Köhler. Quantitative Linguistics - An international Handbook, chapter Syntactic units and structures, pages 274-291. de Gruyter, 2005.
26. Lan Yi, Bing Liu, and Xiaoli Li. Eliminating noisy information in web pages for data mining. In KDD '03: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 296-305, New York, NY, USA, 2003. ACM.