A high-precision forum crawler based on vertical crawling

Proceedings of 2009 IEEE International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC2009

Volumn , Issue , 2009, Pages 362-367

  Gao, Qing ^a   Xiao, Bo ^a   Lin, Zhiqing ^a   Chen, Xiyao ^a   Zhou, Bing ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

Forum; High precision; Structured information; Template; Vertical crawler

Indexed keywords

FOCUSED CRAWLER; HIGH-PRECISION; PROCESSING METHOD; REGULAR EXPRESSIONS; STRUCTURED INFORMATION; SYSTEM RESOURCES; TEMPLATE-BASED; TIME SPAN; WEB INFORMATION; WEB PAGE; WEB RESOURCES;

WORLD WIDE WEB;

INTERNET;

EID: 77649295678     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICNIDC.2009.5360990     Document Type: Conference Paper

References (9)

1. J. Talim, Z. Liu, Ph. Nain, E. G. Coffman, Jr.. Controlling the robots of Web search engines. Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems.
2. Hua Jiang, Bing Han, Ying Lin, Dan Zuo, Yong Xing Ge. Design and Implementation of University Focused Crawler Based on BP Network Classifier. Knowledge Discovery and Data Mining, 2009. WKDD 2009. Second International Workshop on 23-25 Jan. 2009 Page(s):44-47.
3. Thanh Tin Tang, David Hawking, Nick Craswell, Kathy Griffiths. Focused crawling for both topical relevance and quality of medical information. Proceedings of the 14th ACM international conference on Information and knowledge management.
4. Chau M., Hsinchun Chen. Comparison of Three Vertical Search Spiders. IEEE Computer Society, May 2003, Volume: 36, Issue: 5.
5. Yan Guo, Kui Li, Kai Zhang, Gang Zhang. Board Forum Crawling: A Web Crawling Method for Web Forum. Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence.
6. Lizhu Zhou, Ling Lin. Survey on the research of focused crawling technique. JOURNAL OF COMPUTER APPLICATIONS VOL 25, NO 9, 2005.
7. Zhirong Zhao. Vertical Website and Vertical Search Engine. CHINA INFORMATION REVIEW No.11,2000.
8. Ḿarcio L.A. Vidal, Altigran S.da Silva, Edleno S.de Moura, Joao M.B. Cavalcanti. Structure-Driven Crawler Generation by Example. Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval.
9. Black John, Cochran Martin, Highland Trevor. A study of the MD5 attacks: Insights and improvements. Lecture Notes in Computer Science, 2006, Volume: 4047 LNCS.