URL tree: Efficient unsupervised content extraction from streams of web documents

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2013, Pages 2267-2272

  Sluban, Borut ^a   Grčar, Miha ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

Author keywords

Boilerplate removal; Content extraction; Stream data; Unsupervised learning; Web content

Indexed keywords

CONTENT EXTRACTION; EVALUATION RESULTS; HTML DOCUMENTS; OPEN SOURCES; STREAM DATA; STREAM-BASED; WEB CONTENT; WEB DOCUMENT;

ALGORITHMS; FORESTRY; HTML; KNOWLEDGE MANAGEMENT; TREES (MATHEMATICS); UNSUPERVISED LEARNING; WEBSITES;

INFORMATION RETRIEVAL SYSTEMS;

ALGORITHMS; FORESTRY; INFORMATION RETRIEVAL; INFORMATION SYSTEMS; MATHEMATICS; TREES;

EID: 84889610613     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2505515.2505654     Document Type: Conference Paper

References (8)

1. Z. Bar-Yossef and S. Rajagopalan. Template detection via data mining and its applications. In Proc. of the Int. Conf. on World Wide Web, pages 580-591, 2002.
2. L. Chen, S. Ye, and X. Li. Template detection for large scale search engines. In Proc. of the A CM Symposium on Applied Computing, pages 1094-1098, 2006.
3. S. Evert. A lightweight and efficient tool for cleaning web pages. In Proc. of the Int. Conf. on Language Resources and Evaluation (LREC), 2008.
4. C. Kohlschütter, P. Fankhauser, and W. Nejdl. Boilerplate detection using shallow text features. In Proc. of the ACM Int. Conf. on Web Search and Data Mining, pages 441-450, 2010.
5. T. Kovacic. Evaluating Web Content Extraction Algorithms. Bachelor's Thesis, Faculty of Computer and Information Science, University of Ljubljana, Slovenia, 2012.
6. S.-H. Lin and J.-M. Ho. Discovering informative content blocks from web documents. In Proc. of the A CM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, pages 588-593, 2002.
7. J. Pomikalek. Removing Boilerplate and Duplicate Content from Web Corpora. PhD thesis, Faculty of Informatics, Masaryk University, Brno, Czech Republic, 2011.
8. K. Vieira, A. S. da Silva, N. Pinto, E. S. de Moura, J. a. M. B. Cavalcanti, and J. Freire. A fast and robust method for web page template detection and removal. In Proc. of the ACM Int. Conf. on Information and Knowledge Management, pages 258-267, 2006.