An efficient language-independent method to extract content from news webpages

DocEng 2011 - Proceedings of the 2011 ACM Symposium on Document Engineering

Volumn , Issue , 2011, Pages 121-127

  Cardoso, Eduardo ^a   Jabour, Iam ^a   Laber, Eduardo ^a   Rodrigues, Rogério ^b   Cardoso, Pedro ^a  

^a PONTIFICAL CATHOLIC UNIVERSITY OF RIO DE JANEIRO   (Brazil)

^b MICROSOFT   (United States)

Author keywords

news segmentation; webpage rendering

Indexed keywords

NEWS SEGMENTATION; PROCESSING TIME; VISUAL PRESENTATION; WEB-PAGE;

LEARNING ALGORITHMS;

EID: 80054777520     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2034691.2034720     Document Type: Conference Paper

References (28)

1. Çelik, T., Bos, B., Hickson, I., and Lie, H. W. Cascading style sheets level 2 revision 1 (CSS 2.1) specification. Candidate recommendation, W3C, Sept. 2009. http://www.w3.org/TR/2009/CR-CSS2-20090908.
2. Cleaneval home page. http://cleaneval.sigwac.org.uk. [Online; accessed 18-January-2011].
3. DOM CSS Properties - MDC Doc Center. https://developer.mozilla.org/en/ DOM/CSS. [Online; accessed 13-April-2011].
4. Gecko. https://developer.mozilla.org/en/Gecko. [Online; accessed 01-September-2010].
5. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. The weka data mining software: an update. ACM SIGKDD Explorations Newsletter 11, 1 (2009), 10-18.
6. Hu, Y., Xin, G., Song, R., Hu, G., Shi, S., Cao, Y., and Li, H. Title extraction from bodies of html documents and its application to web page retrieval. In SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval (New York, NY, USA, 2005), ACM, pp. 250-257.
7. Jacobs, I., Raggett, D., and Hors, A. L. HTML 4.01 specification. W3C recommendation, W3C, Dec. 1999. http://www.w3.org/TR/1999/REC-html401- 19991224.
8. Laber, E. S., de Souza, C. P., Jabour, I. V., de Amorim, E. C. F., Cardoso, E. T., Rentería, R. P., Tinoco, L. C., and Valentim, C. D. A fast and simple method for extracting relevant content from news webpages. In CIKM (2009), D. W.-L. Cheung, I.-Y. Song, W. W. Chu, X. Hu, and J. J. Lin, Eds., ACM, pp. 1685-1688.
9. Levenshtein, V. I. Binary codes with correction of deletions, insertions and substitution of symbols. Doklady Akademii Nauk SSSR 163, 4 (1965), 845-848.
10. Luo, P., Fan, J., Liu, S., Lin, F., Xiong, Y., and Liu, J. Web article extraction for web printing: a dom+visual based approach. In Proceedings of the 9th ACM symposium on Document engineering (2009), ACM, pp. 66-69.
11. Marek, M., Pecina, P., and Spousta, M. Web page cleaning with conditional random fields. Cahiers du Cental 5 (2007), 1.
12. MSHTML. http://msdn.microsoft.com/en- us/library/bb508516(v=VS.85).aspx. [Online; accessed 01-September-2010].
13. Nicol, G., Champion, M., Hégaret, P. L., Robie, J., Wood, L., Hors, A. L., and Byrne, S. Document object model (DOM) level 3 core specification. W3C recommendation, W3C, Apr. 2004. http://www.w3.org/TR/2004/ REC-DOM-Level-3- Core-20040407.
14. Opera Presto 2.1 - Web standards supported by Opera's core - Dev.Opera. http://dev.opera.com/articles/view/presto-2-1-web- standards-supported-by/. [Online; accessed 13-April-2011].
15. Pasternack, J., and Roth, D. Extracting article text from the web with maximum subsequence segmentation. In Proceedings of the 18th international conference on World wide web (2009), ACM, pp. 971-980.
16. Spengler, A., Bordes, A., and Gallinari, P. A comparison of discriminative classifiers for web news content extraction. In Proceedings of RIAO 2010, 9th Int. Conf. on Adaptivity, Personalization and Fusion of Heterogeneous Information (2010).
17. Spengler, A., and Gallinari, P. Learning to Extract Content from News Webpages. In Proceedings of the 2009 International Conference on Advanced Information Networking and Applications Workshops (2009), IEEE Computer Society, pp. 709-714.
18. Spengler, A., and Gallinari, P. Document structure meets page layout: loopy random fields for web news content extraction. In Proceedings of the 10th ACM symposium on Document engineering (2010), ACM, pp. 151-160.
19. Tan, P.-N., Steinbach, M., and Kumar, V. Introduction to Data Mining. Addison-Wesley, 2005.
20. The WebKit Open Source Project - CSS (Cascading Style Sheets). http://www.webkit.org/projects/css/index.html. [Online; accessed 13-April-2011].
21. van Kesteren, A. HTML 5 differences from HTML 4. W3C working draft, W3C, Aug. 2009. http://www.w3.org/TR/2009/WD-html5-diff- 20090825/.
22. Vieira, K., da Silva, A. S., Pinto, N., de Moura, E. S., Cavalcanti, J. M. B., and Freire, J. A fast and robust method for web page template detection and removal. In CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management (New York, NY, USA, 2006), ACM, pp. 258-267.
23. Wang, J., Chen, C., Wang, C., Pei, J., Bu, J., Guan, Z., and Zhang, W. V. Can we learn a template-independent wrapper for news article extraction from a single training site? In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (2009), ACM, pp. 1345-1354.
24. Wang, J., He, X., Wang, C., Pei, J., Bu, J., Chen, C., Guan, Z., and Lu, G. News article extraction with template-independent wrapper. In Proceedings of the 18th international conference on World wide web (2009), ACM, pp. 1085-1086.
25. WebKit. http://webkit.org/. [Online; accessed 01-September-2010].
26. Wikipedia. Comparison of layout engines (cascading style sheets) - Wikipedia, the free encyclopedia, 2010. [Online; accessed 22-September-2010].
27. World Wide Web Consortium (W3C). http://www.w3c.org/. [Online; accessed 14-September-2010].
28. Xue, Y., Hu, Y., Xin, G., Song, R., Shi, S., Cao, Y., Lin, C.-Y., and Li, H. Web page title extraction and its application. Information Processing and Management 43, 5 (2007), 1332-1347. (Pubitemid 46636023)