Design and implementation of a distributed crawler and filtering processor

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2382, Issue , 2002, Pages 58-74

  Zeinalipour Yazti, Demetrios ^a   Dikaiakos, Marios ^b  

^a University of California Riverside   (United States)

^b UNIVERSITY OF CYPRUS   (Cyprus)

Author keywords

[No Author keywords available]

Indexed keywords

INTEGRATED CIRCUIT DESIGN; JAVA PROGRAMMING LANGUAGE; MIDDLEWARE; SEARCH ENGINES;

CORPORATE INTRANET; DESIGN AND IMPLEMENTATIONS; DISTRIBUTED COMPONENTS; DISTRIBUTED CRAWLER; FUTURE INTERNET; INTERNET SOURCES; PROXY SERVICES; USER PROFILE;

WEB CRAWLER;

EID: 84937389622     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-45431-4_6     Document Type: Conference Paper

References (24)

1. A. Arasu, J. Cho, H. Garcia-Molina, A. Paepcke, and S. Raghavan. Searching the Web. ACM Transactions on Internet Technology, 2001. To appear.
2. C. M. Bowman, P. B. Danzig, D. R. Hardy, U. Manber, and M. F. Schwartz. The Harvest Information Discovery and Access System. In Proceedings of the Second International WWW Conference, 1995.
3. S. Brin and L. Page. The Anatomy of a Large-Scale Hypertextual (Web) Search Engine. Computer Networks and ISDN Systems, 30(1–7):107–117, 1998.
4. S. Chakrabarti, M. van den Berg, and B. Dom. Focused Crawling: A New Approach to Topic-Specific Web Resource Discovery. In 8th World Wide WebConfer ence, Toronto, May 1999.
5. J. Cho, H. Garcia-Molina, and L. Page. Efficient crawling through URL ordering. In Proceedings of the Seventh International WWW Conference, pages 161–172, April 1998.
6. J. Gosling, B. Joy, and G. Steele. The Java Language Specification. Addison-Wesley, 1996.
7. S. Gribble, E. Brewer, J. Hellerstein, and D. Culler. Scalable, Distributed Data Structures for Internet Service Construction. In Proceedings of the Fourth Symposium on Operating Systems Design and Implementation (OSDI 2000), 2000.
8. S. Gribble, M. Welsh, R. von Behren, E. Brewer, D. Culler, N. Borisov, S. Czerwinski, R. Gummadi, J. Hill, A. Joseph, R.H. Katz, Z.M. Mao, S. Ross, and B. Zhao. The Ninja Architecture for Robust Internet-scale Systems and Services. Computer Networks, 35:473–497, 2001.
9. A. Heydon and M. Najork. Mercator: A Scalable, Extensible Web Crawler. World Wide Web, 2(4):219–229, December 1999.
10. G. Huck, I. Macherius, and P. Fankhauser. PDOM: Lightweight Persistency Support for the Document Object Model. In Proceedings of the 1999 OOPSLA Workshop Java and Databases: Persistence Options. Held on the 14th Annual ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications (OOPSLA ’99). ACM, SIGPLAN, November 1999.
11. Tympani Development Inc. NetAttache Pro. http://www.tympani.com/products/NAPro.html, 2000.
12. S. Lempinen. Jtidy. http://lempinen.net/sami/jtidy.
13. M. DIkaiakos and D. Zeinalipour. eRACE Project. http://www.cs.ucy.ac.cy/Projects/eRACE/, 2001.
14. Steve Meloan. The Java HotSpotTM Performance Engine: An In-Depth Look. Technical report, Sun Microsystems, June 1999. http://developer.java.sun.com/developer/technicalArticles/Networking/HotSpot/.
15. Sun Microsystems. The Java HotSpot TM Server VM. http://java.sun.com/products/hotspot/, 1999.
16. R. Miller and K. Bharat. SPHINX: A Framework for Creating Personal, Sitespecific Web Crawlers. In Proceedings of the Seventh International WWW Conference, pages 161–172, April 1998.
17. GMD-IPSI XQL Engine. http://xml.darmstadt.gmd.de/xql/.
18. D. Raggett. Clean up your Webp ages with HTML TIDY. http://www.w3.org/People/Raggett/tidy/.
19. S. Raghavan and H. Garcia-Molina. Crawling the Hidden Web. In VLDB 2001: 27th International Conference on Very Large Data Bases, September 2001. To appear.
20. VMGEAR. OptimizeIt!: The Java Ultimate Performance Profiler. http://www.vmgear.com/.
21. W3C. Document Object Model (DOM) Level 1 Specification. W3C Recommendation 1, October 1998. http://www.w3.org/TR/REC-DOM-Level-1/.
22. T. W. Yan and H. Garcia-Molina. SIFT - A Tool for Wide-Area Information Dissemination. In Proceedings of the 1995 USENIX Technical Conference, pages 177–186, 1995.
23. D. Zeinalipour-Yazti. eRACE: an eXtensible Retrieval, Annotation and Caching Engine, June 2000. B.Sc. Thesis. In Greek.
24. D. Zeinalipour-Yazti and M. Dikaiakos. High-Performance Crawling and Filtering in Java. Technical Report TR-01-3, Department of Computer Science, University of Cyprus, June 2001.