Estimating the web robot population

Proceedings of the 19th International Conference on World Wide Web, WWW '10

Volumn , Issue , 2010, Pages 1189-1190

  Sun, Yang ^a   Giles, C Lee ^b  

^a AOL Research   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

web robot population

Indexed keywords

ACCESS LOG; CAPTURE-RECAPTURE; IP ADDRESSS; MAXIMUM LIKELIHOOD ESTIMATOR; OBSERVATION DATA; WEB ROBOTS; WEB SERVERS;

ESTIMATION; MAXIMUM LIKELIHOOD; WORLD WIDE WEB;

ROBOTS;

EID: 77954597480     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1772690.1772868     Document Type: Conference Paper

References (7)

1. A. Dobra and S. E. Fienberg. How large is the World Wide Web?, chapter Web Dynamics. Springer-Verlag, 2003.
2. S. Lawrence and C. L. Giles. Searching the World Wide Web. Science, 280(5360):98-100, 1998.
3. D. L. Otis, K. P. Burnham, G. C. White, and D. R. Anderson. Statistical inference from capture data on closed animal populations. Wildlife Monographs, 62:1-135, 1978.
4. S. Pledger. Unified maximum likelihood estimates for closed capture-recapture models using mixtures. Biometrics, 56:434-442, 2000.
5. K. H. Pollock. A capture-recapture design robust to unequal probability of capture. Journal of Wildlife Management, 46:757-760, 1982.
6. D. Poole. Estimating the size of the telephone universe: a bayesian mark-recapture approach. In KDD '04: Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 659-664, New York, NY, USA, 2004. ACM.
7. R.King and S. Brooks. On the bayesian analysis of population size. Biometrika, 88(2):317-336, 2001.