CETR - Content extraction via tag ratios

Proceedings of the 19th International Conference on World Wide Web, WWW '10

Volumn , Issue , 2010, Pages 971-980

  Weninger, Tim ^a   Hsu, William H ^b   Han, Jiawei ^a  

^a University of Illinois at Urbana Champaign   (United States)

^b Kansas State University   (United States)

Author keywords

content extraction; tag ratio; world wide web

Indexed keywords

ALTERNATIVE METHODS; CLUSTERING TECHNIQUES; CONTENT EXTRACTION; EXISTING METHOD; HTML DOCUMENTS; PRECISION AND RECALL; TWO DIMENSIONAL MODEL; TWO-DIMENSION; WEB CORPORA; WEB DOMAINS; WEB PAGE;

GRAPHIC METHODS;

WORLD WIDE WEB;

EID: 77954569037     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1772690.1772789     Document Type: Conference Paper

References (33)

1. 19th International Workshop on Database and Expert Systems Applications (DEXA 2008), 1-5 September 2008, Turin, Italy. IEEE Computer Society, 2008.
2. B. Adelberg. Nodose - a tool for semi-automatically extracting semi-structured data from text documents. In SIGMOD Conference, pages 283-294. ACM Press, 1998.
3. Z. Bar-Yossef and S. Rajagopalan. Template detection via data mining and its applications. In WWW, pages 580-591, 2002.
4. O. Buyukkokten, H. Garcia-Molina, and A. Paepcke. Accordion summarization for end-game browsing on pdas and cellular phones. In CHI, pages 213-220, 2001.
5. D. Cai, X. He, J.-R.Wen, andW.-Y. Ma. Block-level link analysis. In SIGIR, pages 440-447. ACM, 2004.
6. D. Cai, S. Yu, J.-R.Wen, andW.-Y. Ma. Extracting content structure for web pages based on visual representation. In APWeb, volume 2642 of Lecture Notes in Computer Science, pages 406-417. Springer, 2003.
7. R. Cathey, L. Ma, N. Goharian, and D. A. Grossman. Misuse detection for information retrieval systems. In CIKM, pages 183-190. ACM, 2003.
8. J. Chen, B. Zhou, and H. Zhang. Function-based object model towards website adaptation. In In Proceedings of the 10th International World Wide Web Conference, pages 587-596. ACM Press, 2001.
9. L. Chen, S. Ye, and X. Li. Template detection for large scale search engines. In SAC, pages 1094-1098. ACM, 2006.
10. D. de Castro Reis, P. B. Golgher, A. S. da Silva, and A. H. F. Laender. Automatic web news extraction using tree edit distance. In WWW, pages 502-511. ACM, 2004.
11. S. Debnath, P. Mitra, and C. L. Giles. Automatic extraction of informative blocks from webpages. In SAC, pages 1722-1726. ACM, 2005.
12. S. Debnath, P. Mitra, and C. L. Giles. Identifying content blocks from web documents. In ISMIS, volume 3488 of Lecture Notes in Computer Science, pages 285-293. Springer, 2005.
13. A. Finn, N. Kushmerick, and B. Smyth. Fact or fiction: Content classification for digital libraries. In DELOS Workshop: Personalization and Recommender Systems in Digital Libraries, 2001.
14. T. Gottron. Evaluating content extraction on html documents. In ITA, pages 123-132, 2007.
15. T. Gottron. Combining content extraction heuristics: the ombine system. In iiWAS, pages 591-595. ACM, 2008.
16. T. Gottron. Content code blurring: A new approach to content extraction. In DEXA Workshops [1], pages 29-33.
17. S. Gupta, G. E. Kaiser, P. Grimm, M. F. Chiang, and J. Starren. Automating content extraction of html documents. World Wide Web, 8(2):179-224, 2005.
18. S. Gupta, G. E. Kaiser, D. Neistadt, and P. Grimm. Dom-based content extraction of html documents. In WWW, pages 207-214, 2003.
19. S. Gupta, G. E. Kaiser, and S. J. Stolfo. Extracting context to improve accuracy for html content extraction. In WWW (Special interest tracks and posters), pages 1114-1115. ACM, 2005.
20. W. Han, D. Buttler, and C. Pu. Wrapping web data into xml. SIGMOD Rec., 30(3):33-38, 2001.
21. H.-Y. Kao, S.-H. Lin, J.-M. Ho, and M.-S. Chen. Mining web informative structures and contents based on entropy analysis. IEEE Trans. Knowl. Data Eng., 16(1):41-55, 2004.
22. N. Kushmerick. Wrapper induction: efficiency and expressiveness. Artificial Intelligence, 118(1-2):15-68, 2000.
23. S.-H. Lin and J.-M. Ho. Discovering informative content blocks from web documents. In KDD, pages 588-593. ACM, 2002.
24. J. MacQueen. Some methods for classification and analysis of multivariate observations. In Berkeley Symposium on Mathematics Statistics and Probability, pages 281-297, 1967.
25. C. Mantratzis, M. A. Orgun, and S. Cassidy. Separating xhtml content from navigation clutter using dom-structure block analysis. In S. Reich and M. Tzagarakis, editors, Hypertext, pages 145-147. ACM, 2005.
26. M. Marek, P. Pecina, and M. Spousta. Template detection through conditional random fields. In WAC3, 2007.
27. I. Muslea, S. Minton, and C. A. Knoblock. Hierarchical wrapper induction for semistructured information sources. Autonomous Agents and Multi-Agent Systems, 4(1-2):93-114, 2001.
28. J. Pasternack and D. Roth. Extracting article text from the web with maximum subsequence segmentation. In WWW, pages 971-980. ACM, 2009.
29. D. Pinto, M. Branstein, R. Coleman, W. B. Croft, M. King, W. Li, and X. Wei. Quasm: a system for question answering using semi-structured data. In JCDL, pages 46-55. ACM, 2002.
30. A. F. R. Rahman, H. Alam, and R. Hartono. Content extraction from html documents. In WDA, pages 7-10, 2001.
31. T. V. Raman. Toward 2w, beyond web 2.0. Commun. ACM, 52(2):52-59, 2009.
32. T. Weninger and W. H. Hsu. Text extraction from the web via text-to-tag ratio. In DEXA Workshops [1], pages 23-28.
33. L. Yi, B. Liu, and X. Li. Eliminating noisy information in web pages for data mining. In KDD, pages 296-305. ACM, 2003.