Extracting article text from the Web with maximum subsequence segmentation

WWW'09 - Proceedings of the 18th International World Wide Web Conference

Volumn , Issue , 2009, Pages 971-980

  Pasternack, Jeff ^a   Roth, Dan ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Maximum subsequence; Page segmentation; Text extraction

Indexed keywords

EXPERT KNOWLEDGE; HTML DOCUMENTS; LEVENSHTEIN DISTANCE; LINEAR TIME; LOCAL CLASSIFIER; MAXIMUM SUBSEQUENCE; ONLINE NEWS; PAGE SEGMENTATION; PAGE STRUCTURES; SEMI-SUPERVISED ALGORITHM; TEMPLATE DETECTION; TEXT EXTRACTION; TRAINING EXAMPLE; WRAPPER INDUCTION;

GLOBAL OPTIMIZATION;

WEBSITES;

EID: 84865651487     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1526709.1526840     Document Type: Conference Paper

References (24)

1. Adelberg, B. NoDoSE-a tool for semi-automatically extracting structured and semistructured data from text documents. SIGMOD 1998.
2. Buyukkokten, O., Garcia-Molina, H. and Paepcke, A. Accordion summarization for end-game browsing on PDAs and cellular phones. SIGCHI 2001.
3. Cai, D., Yu, S., Wen, J.R. and Ma, W.Y. Extracting content structure for web pages based on visual representation. APWeb 2003.
4. Cai, D., Yu, S., Wen, J.R. and Ma, W.Y. VIPS: a Visionbased Page Segmentation Algorithm. Microsoft Technical Report (MSR-TR-2003-79),2003
5. Cai, D., He, X., Wen, J.R. and Ma, W.Y. "Block-level Link Analysis", SIGIR 2004.
6. Cai, D., Yu, S., Wen, J.R. and Ma, W.Y. "Block-based Web Search", SIGIR 2004.
7. Chen, J., Zhou, B., Shi, J., Zhang, H. and Fengwu, Q. Function-based object model towards website adaptation. WWW2001.
8. Chen, L., Ye, S. and Li, X. Template detection for large scale search engines. SAC 2006.
9. Crescenzi, V., Mecca, G. and Merialdo, P. Roadrunner: Towards automatic data extraction from large web sites. VLDB 2001.
10. Fox, A., Goldberg, I., Gribble, S.D., Lee, D.C., Polito, A. and Brewer, E.A. Experience With Top Gun Wingman: A Proxy-Based Graphical Web Browser for the 3Com PalmPilot. Middleware 1998.
11. Kushmerick, N. Wrapper induction: Efficiency and expressiveness. Artificial Intelligence, 118, 2000.
12. Laender, A., Ribeiro-Neto, B., Silva, A. and Teixeira, J. A Brief Survey of Web Data Extraction Tools, SIGMOD Record, Volume 31, Number 2, 2002.
13. Lin, S.H. and Ho, J.M. Discovering informative content blocks from Web documents. KDD 2002.
14. Liu, L., Pu, C. and Han, W. XWRAP: an XML-enabled wrapper construction system for Web information sources. ICDE 2000.
15. Ma, L., Goharian, N., Chowdhury, A. and Chung, M. Extracting unstructured data from template generated web documents. CIKM 2003.
16. Marek, M., Pecina, P., Spousta, M. Web Page cleaning with Conditional Random Fields. WAC3 2007.
17. McKeown, K.R., Barzilay, R., Evans, D., Hatzivassiloglou, V., Klavans, J.L., Nenkova, A., Sable, C., Schiffman, B. and Sigelman, S. Tracking and summarizing news on a daily basis with Columbia's Newsblaster. HLT 2002.
18. Muslea, I., Minton, S. and Knoblock, C.A. Hierarchical Wrapper Induction for Semistructured Information Sources. Autonomous Agents and Multi-Agent Systems, 2001.
19. Porter, M.F. An algorithm for suffix stripping. Program, vol. 14, no. 3, pp. 130-137, 1980.
20. Punyakanok, V., Roth, D., Yih, W. and Zimak, D. Learning and inference over constrained output. IJCAI 2005.
21. Ruzzo, W.L. and Tompa, M. A linear time algorithm for finding all maximal scoring subsequences. ISMB 1999.
22. Yi, L. and Liu, B. Web Page Cleaning for Web Mining through Feature Weighting. IJCAI-03.
23. Yi, L., Liu, B. and Li, X. Eliminating noisy information in Web pages for data mining. KDD 2003.
24. Yu, S., Cai, D., Wen, J.R. and Ma, W.Y. "Improving Pseudo-Relevance Feedback in Web Information Retrieval Using Web Page Segmentation", WWW2003