Evaluating topic-driven web crawlers

SIGIR Forum (ACM Special Interest Group on Information Retrieval)

Volumn , Issue , 2001, Pages 241-249

  Menczer, Filippo ^a   Pant, Gautam ^a   Srinivasan, Padmini ^a   Ruiz, Miguel E ^b  

^a UNIVERSITY OF IOWA   (United States)

^b Textwise   (United States)

Author keywords

Best first search; Focused crawlers; InfoSpiders; PageRank; Performance metrics; Topic driven crawling; Web information retrieval

Indexed keywords

ADAPTIVE SYSTEMS; ALGORITHMS; COMPUTATIONAL METHODS; DECISION SUPPORT SYSTEMS; INDEXING (OF INFORMATION);

WEB CRAWLERS;

WORLD WIDE WEB;

EID: 0034794539     PISSN: 01635840     EISSN: None     Source Type: Journal    
DOI: 10.1145/383952.383995     Document Type: Conference Paper

References (25)

1. Does "Authority" mean quality? predicting expert quality ratings of web documents
2. Adding support for dynamic and focused search with fetuccino
3. Improved algorithms for topic distillation in hyperlinked environments
4. The anatomy of a large-scale hypertextual web search engine
5. Automatic resource compilation by analyzing hyperlink structure and associated text
6. Focused crawling: A new approach to topic-specific web resource discovery
7. Efficient crawling through url ordering
8. Information retrieval in the world wide web: Making client-based searching feasible
9. Measuring search engine quality using random walks on the web
10. Improving text retrieval for the routing problem using latent semantic indexing
11. Authoritative sources in a hyperlinked environment
12. Training algorithms for linear text classifiers
13. Adaptive retrieval agents: Internalizing local context and scaling up to the web
14. Feature selection, perceptron learning, and a usability case study for text categorization
15. Finding what people want: Experiences with the webcrawler
16. An algorithm for suffix stripping
17. Learning internal representations by error propagation
18. Link-based and content-based evidential information in a belief network model
19. An evaluation of statistical approaches to text categorization