Characterizing crawler behavior from web server access logs

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2738, Issue , 2003, Pages 369-378

  Dikaiakos, Marios ^a   Stassopoulou, Athena ^b   Papageorgiou, Loizos ^a  

^a UNIVERSITY OF CYPRUS   (Cyprus)

^b Dept of Computer Science ^*  (Cyprus)

Author keywords

[No Author keywords available]

Indexed keywords

SEARCH ENGINES; WEB SERVICES;

ACCESS LOG; AUTOMATIC DETECTION; BEHAVIOR-BASED; CHARACTERIZATION STUDIES; CITESEER; WEB SERVERS;

WEB CRAWLER;

EID: 33947181188     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: None     Document Type: Conference Paper

References (8)

1. A. Arasu, J. Cho, H. Garcia-Molina, A. Paepcke, and S. Raghavan. Searching the Web. ACM Transactions on Internet Technology, 1(1):2–43, 2001.
2. M. Arlitt and T. Jin. Workload Characterization of the 1998 World Cup Web Site. Technical Report HPL-1999-35R1, Hewlett-Packard Laboratories, September 1999
3. P. Barford, A. Bestavros, A. Bradley, and M. Crovella. Changes in Web client access patterns: Characteristics and caching implications. World Wide Web (special issue on Characterization and Performance Evaluation), 1999.
4. M. Crovella. Performance Characteristics of theWorld-WideWeb. In C. L.G. Haring and M. Reiser, editors, Performance Evaluation:Or igins and Directions, pages 219–233. Springer, 1999
5. M. Dikaiakos, A. Stassopoulou, and L. Papageorgiou. Characterizing Crawler Behavior from Web Server Access Logs. Technical Report TR-2002-4, Department of Computer Science, University of Cyprus, November 2002
6. A. Feldmann. Characteristics of TCP Connection Arrivals. In K. Park and W. Willinger, editors, Self-Similar Network Traffic and Performance Evaluation. John Wiley, 2000.
7. B. Krishnamurthy and J. Rexford. Web Protocols and Practice. Addison-Wesley, 2001
8. G. Paliouras, C. Papatheodorou, V. Karkaletsis, and C. Spyropoulos. Clustering the Users of LargeWeb Sites into Communities. In Proceedings of the International Conference on Maching Learning (ICML), pages 719–726, 2000.