A web crawler design for data mining

Journal of Information Science

Volumn 27, Issue 5, 2001, Pages 319-325

  Thelwall, M ^a  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER AIDED SOFTWARE ENGINEERING; COMPUTER SIMULATION; DATA MINING; ENGINEERING RESEARCH; INFORMATION ANALYSIS; SYSTEMS ANALYSIS; WORLD WIDE WEB;

LARGE SCALE PROCESSING; WEB CRAWLER DESIGN;

COMPUTER SOFTWARE;

EID: 0035204851     PISSN: 01655515     EISSN: None     Source Type: Journal    
DOI: 10.1177/016555150102700503     Document Type: Article

References (31)

1. The anatomy of a large scale hypertextual web search engine
2. Authoritative sources in a hyperlinked environment
3. The evolution of the web and implications for an incremental crawler
4. Structuring and visualising the world-wide web with generalised similarity analysis
5. How did university departments interweave the web: A study of connectivity and underlying factors
6. Inferring web communities from link topology
7. Socio-economic impact of the internet in the academic research environment
8. The presentation of self in WWW home pages
9. Presenting a model for the structure and content of a university world wideweb site
10. The web as an information source on informetrics? A content analysis
11. Graph structure in the web
12. Readers, authors and page structure: A discussion of four questions arising from a content analysis of web pages
13. WebWatch: A aurvey of links to UK university web sites
14. Commercial web site links
15. Web impact factors
16. Can search engines be used for web-link analysis? A critical review
17. A tale of two web spaces: Comparing sites using web impact factors
18. Web impact factors and search engine coverage
19. Results from a web impact factor crawler
20. Data collection on the web for informetric purposes - A review and analysis
21. Mining the web for relations
22. World wide web robots: An overview
23. Mercator: A scalable, extensible web crawler
24. WWLib-TNG - New directions in search engine technology
25. Finding idle machines in a workstation-based distributed system
26. Distributed execution with remote audit
27. NEOS and condor: Solving optimization problems over the internet
28. My personal search engine
29. SPHINX: A framework for creating personal, site-specific web crawlers
30. Extracting macroscopic information from web links