Extraction of informative blocks from web pages

Proceedings - ALPIT 2008, 7th International Conference on Advanced Language Processing and Web Information Technology

Volumn , Issue , 2008, Pages 544-549

  Cao, YuJuan ^a   Niu, ZhenDong ^a   Dai, LiuLing ^a   Zhao, YuMing ^a  

^a BEIJING INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Data mining; Information extraction; LSI; SVM; VIPS; Web; Web page segmentation

Indexed keywords

CLASSIFICATION (OF INFORMATION); INFORMATION TECHNOLOGY; INFORMATION THEORY; LINGUISTICS; SEMANTICS; TECHNOLOGY; WEBSITES; WORLD WIDE WEB;

CLASSIFICATION MODELS; CLASSIFICATION TASKS; DATA MINING; FEATURE VECTORS; INFORMATION EXTRACTION; INTERNATIONAL CONFERENCES; LANGUAGE PROCESSING; LATENT SEMANTIC INDEXING; LSI; NEAR-DUPLICATE DETECTION; SEMANTIC BLOCKS; SEMANTIC INFORMATION; SVM; TRAINING DATA SETS; VIPS; VISION-BASED PAGE SEGMENTATION; VISUAL FEATURES; WEB; WEB INFORMATION; WEB PAGE SEGMENTATION; WEB PAGES; WEB-MINING;

FEATURE EXTRACTION;

EID: 51949096948     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ALPIT.2008.106     Document Type: Conference Paper

References (19)

1. Michael F. Chiang, Roy G. Cole, Suhit Gupta, Gail E.Kaiser, Justin B. Starren, "Computer and World Wide Web Accessibility by Visually Disabled Patients: Problems and Solutions", to appear in Survey of Ophthalmology, 2005.
2. D. Cai, S. Yu, J. Wen, and W. Ma. Vips: a visionbased page segmentation algorithm. Technical Report MSR-TR-2003-79, Microsoft Technical Report, 2003.
3. Bar-Yossef, Z. and Rajagopalan, S. Template Detection via Data Mining and its Applications, WWW 2002,580-591
4. Yi, L. and Liu, B., Web Page Cleaning for Web Mining through Feature Weighting, in the proceedings of Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-03), Acapulco, Mexico, August, 2003, 249-264
5. Z. Bar-Yossef and S. Rajagopalan. Template detection via data mining and its applications. In WWW '02: Proceedings of the 11th international conference on World Wide Web, pages 1, New York, NY,USA, 2002, ACM Press, 580-59
6. Suhit Gupta Gail E. Kaiser, Automating Content Extraction of HTML Documents, World Wide Web, Volume 8, Number 2, June (2005) 179-224
7. David Fernandes, Computing Block Importance for Searching on Web Sites in the processing of CIKM'07,(2007) 165-174
8. K.R. McKeown, R. Barzilay, D. Evans, V. Hatzivassiloglou, M.Y. Kan, B. Schiffman and S. Teufel. "Columbia Multi-document Summarization: Approach and Evaluation", In Document Understanding Conf., 2001.
9. N. Wacholder, D. Evans and J. Klavans. "Automatic Identification and Organization of Index Terms for Interactive Browsing". In Joint Conf. on Digital Libraries '01, 2001.
10. Kovacevic, M., Diligenti, M., Gori, M. and Milutinovic, V., Recognition of Common Areas in a Web Page Using Visual Information: a possible application in a page classification, in the proceedings of 2002 IEEE International Conference on Data,2002
11. Yi, L. and Liu, B., Web Page Cleaning for Web Mining through Feature Weighting, in the proceedings of Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-03), Acapulco, Mexico, August, 2003.
12. Yi, L. and Liu, B., Eliminating Noisy Information in Web Pages for Data Mining, in the proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD-2003), Washington, DC, USA, August, 2003.
13. K. Vieira, A. S. da Silva, N. Pinto, E. S. de Moura, J. M. B. Cavalcanti, and J. Freire. A fast and robust method for web page template detection and removal. In: Proceedings of the 15th ACM international conference on Information and knowledge management CIKM '06, pages 258-267, New York, NY, USA, 2006. ACM Press.
14. X. Yin and W. S. Lee. Using link analysis to improve layout on mobile devices. In WWW '04: Proceedings of the 13th international conference on World Wide Web, pages 338-344, New York, NY, USA, 2004. ACM Press. 173
15. R. Song, H. Liu, J.-R. Wen, and W.-Y. Ma. Learning block importance models for web pages. In WWW '04:Proceedings of the 13th international conference on World Wide Web, pages 203-211, New York, NY, USA, 2004. ACM Press.
16. S. Chakrabarti, M. Joshi, and V. Tawde. Enhanced topic distillation using text, markup tags, and hyperlinks. In SIGIR '01: Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, pages 208-216, New York, NY, USA, 2001. ACM Press.
17. S.-H. Lin and J.-M. Ho. Discovering informative content blocks from web documents. In KDD '02: Proceedings of the 8th ACM SIGKDD international conference on Knowledge discovery and data mining,pages 588-593, New York, NY, USA, 2002. ACM Press.
18. Scott C. Deerwester, Susan T. Dumais, Thomas K. Landauer, George W. Fmnas, and Richard A. Harshman. Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41(6):391-407, 1990
19. Shian-Hua Lin, Jan-Ming Ho, Discovering Informative Content Blocks from Web Documents, IEEE Transactions on Knowledge and Data Engineering, page 41-45, Jan 2004 ,