Content extraction from news pages using particle swarm optimization on linguistic and structural features

Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence, WI 2007

Volumn , Issue , 2007, Pages 242-249

  Ziegler, Cai Nicolas ^a   Skubacz, Michal ^a  

^a SIEMENS AG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CONTENT EXTRACTION; DOCUMENT RETRIEVAL; EMPIRICAL EVALUATIONS; FINANCIAL TIMES; HTML PAGES; INTERNATIONAL CONFERENCES; MEDIA CHANNELS; OPTIMAL CLASSIFICATION; PARTICLE SWARM OPTIMIZATIONS; PARTICLE SWARM OPTIMIZER; STRUCTURAL FEATURES; TEXTUAL CONTENT; WASHINGTON POST; WEB INTELLIGENCE; WEB PAGES;

BENCHMARKING; INFORMATION RETRIEVAL SYSTEMS; LINGUISTICS; MARKUP LANGUAGES; PARTICLE SWARM OPTIMIZATION (PSO); STRUCTURAL OPTIMIZATION; TEXT PROCESSING; WORLD WIDE WEB;

FEATURE EXTRACTION;

EID: 48349100720     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WI.2007.38     Document Type: Conference Paper

References (21)

1. R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison-Wesley, Reading, MA, USA, May 1999.
2. R. Baumgartner, S. Flesca, and G. Gottlob. Visual Web information extraction with Lixto. In Proceedings of the 27th International Conference on Very Large Databases, pages 119-128, Roma, Italy, 2001.
3. D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma. Block-based Web search. In Proceedings of the 27th Annual International ACM SIGiR Conference on Research and Development in Information Retrieval, pages 456-463, Sheffield, UK, 2004. ACM Press.
4. H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. GATE: An architecture for development of robust HLT applications. In ACL '02: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pages 168-175, Philadelphia, PA, USA, 2001. Association for Computational Linguistics.
5. D. de Castro Reis, P. Golgher, A. Silva, and A. Laender. Automatic Web news extraction using tree edit distance. In Proceedings of the 13th International Conference on World Wide Web, pages 502-511, New York, NY, USA, 2004. ACM Press.
6. N. Glance, M. Hurst, and T. Tomokiyo. Blogpulse: Automated trend discovery for weblogs. In Proceedings of the WWW 2004 Workshop on the Weblogging Ecosystem, New York, NY, USA, 2004.
7. J. Goller. STAN: Structural analysis for Web documents. In Proceedings of the Second Internation Workshop on Web Document Analysis, pages 15-18, Ediburg, UK, 2003.
8. S. Gupta, G. Kaiser, P. Grimm, M. Chiang, and J. Starren. Automating content extraction of HTML documents. World Wide Web, 8(2):179-224, 2005.
9. S. Gupta, G. Kaiser, D. Neistadt, and P. Grimm. DOM-based content extraction of HTML documents. In Proceedings of the 12th International Conference on World Wide Web, pages 207-214, Budapest, Hungary, 2003. ACM Press.
10. J. Kennedy and R. Eberhart. Particle swarm optimization. In Proceedings of IEEE International Conference on Neural Networks, pages 1942-1948, Piscataway, NJ, USA, 1995. IEEE Computer Society.
11. N. Kushmerick, D. Weld, and R. Doorenbos. Wrapper induction for information extraction. In International Joint Conference on Artificial Intelligence, pages 729-737, Nagoya, Japan, 1997. Morgan Kaufmann.
12. S.-H. Lin and J.-M. Ho. Discovering informative content blocks from Web documents. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 588-593, Edmonton, Alberta, Canada, 2002. ACM Press.
13. A. Ntoulas, M. Najork, M. Manasse, and D. Fetterly. Detecting spam Web pages through content analysis. In Proceedings of the 15th International Conference on World Wide Web, pages 83-92, Edinburgh, Scotland, 2006. ACM Press.
14. R. Quinlan. Improved use of continuous attributes in C4.5. Journal of Artificial Intelligence Research, 4:77-90, 1996.
15. K. Simon and G. Lausen. VIPER: Augmenting automatic information extraction with visual perceptions. In Proceedings of the 2005 ACM CIKM Conference on Information and Knowledge Management, pages 381-388, Bremen, Germany, November 2005. ACM Press.
16. R. Song, H. Liu, J.-R. Wen, and W.-Y. Ma. Learning block importance models for Web pages. In Proceedings of the 13th International Conference on World Wide Web, pages 203-211, New York, NY, USA, 2004. ACM Press.
17. A. Sun and E.-P. Lim. Web unit mining: Finding and classifying subgraphs of Web pages. In Proceedings of the 12th International Conference on Information and Knowledge Management, pages 108-115, New Orleans, LA, USA, 2003. ACM Press.
18. Y.-F. Tseng and H.-Y Kao. The mining and extraction of primary informative blocks and data objects from systematic Web pages. In Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, pages 370-373, Hong Kong, China, 2006. IEEE Computer Society.
19. Y. Yang and H.-J. Zhang. HTML page analysis based on visual cues. In Proceedings of the Sixth International Conference on Document Analysis and Recognition, pages 859-864, Washington, DC, USA, 2001. IEEE Computer Society.
20. Y. Zhai and B. Liu. Web data extraction based on partial tree alignment. In Proceedings of the 14th International Conference on World Wide Web, pages 76-85, Chiba, Japan, 2005. ACM Press.
21. C.-N. Ziegler and M. Skubacz. Towards automated reputation and brand monitoring on the web. In Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, pages 1066-1070, Hong Kong, China, December 2006. IEEE Computer Society Press.