CoBWeb-A crawler for the Brazilian Web

String Processing and Information Retrieval Symposium and International Workshop on Groupware, SPIRE 1999 and CRIWG 1999

Volumn , Issue , 1999, Pages 184-191

  Da Silva, Altigran S ^a   Veloso, Eveline A ^a   Golgher, Paulo B ^a   Ribeiro Neto, Berthier ^a   Laender, Alberto H F ^a   Ziviani, Nivio ^a  

^a FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SOFTWARE; GROUPWARE; INFORMATION RETRIEVAL; WEB CRAWLER;

LARGE AMOUNTS; MOBILE COMPUTING ENVIRONMENT; TIME-PERIODS;

SEARCH ENGINES;

EID: 34547500958     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SPIRE.1999.796594     Document Type: Conference Paper

References (13)

1. Search engine watch. http://www.searchenginewatch.com.
2. Squid home page. http://squid.nlanr.net/Squid.
3. C. M. Bowman, P. B. Danzig, D. R. Hardy, U. Manber, and M. F. Schwartz. Harvest: A scalable, customizable discovery and access system. Technical Report CU-CS-732-94, Department of Computer Science, University of Colorado, Bouder, 1994.
4. J. Cho, H. Garcia-Molina, and L. Page. Efficient crawling through URL ordering. In Proceedings of the 7th International WWW Conference, Brisbane, Australia, 1998.
5. F. Douglis. Resource updates on the web. http://www.research.att.com/-douglis/characterizationpos. html.
6. F. Douglis, A. Feldmann, B. Krishnamurthy, and J. Mogul. Rate of change and other metrics: A live study of the world wide web. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, 1997.
7. C. P. Kollar, J. R. R. Leavitt, and M. Mauldin. Robot exclusion standard revisited. http://www.kollar.com/robots.html.
8. M. Koster. Guidelines for robot writers. http://info.webcrawler.com/mak/projects/robots/-guidelines.html.
9. D. Menascé and V. F. Almeida. Capacity Planning for Web Performance-Metrics, Models & Methods. Prentice Hall, 1998.
10. A. O. Mendelzon and T. Milo. Formal models of Web queries. Information Systems, 23(8):615-637, 1998.
11. R. Rivest. The MD5 Message-Digest Algorithm. Request for Comments 1321, MIT Laboratory for Computer Science, 1992.
12. H. Yamana, K. Tamura, H. Kawano, S. Kamei, M. Harada, H. Nishimura, I. Asai, H. Kusumoto, Y. Shinoda, and Y. Muraoka. Experiments of collecting www information using distributed www robots. In Proceedings of the 21st International ACM SIGIR Conference, Melbourne, Australia, 1998.
13. N. Ziviani. Information systems on mobile computing environments. Technical Report RT.DCC.001/99 PRONEX.SIAM.001/99, Federal University of Minas Gerais, Computer Science Departament, 1999. http://www.dcc.ufmg.br/siam.