SearchGen: A synthetic workload generator for scientific literature digital libraries and search engines

Proceedings of the ACM International Conference on Digital Libraries

Volumn , Issue , 2007, Pages 137-146

  Li, Huajing ^a   Lee, Wang Chien ^a   Sivasubramaniam, Anand ^a   Giles, Lee ^a,b  

^a The Pennsylvania State University   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Benchmark; Modeling; Synthetic workload

Indexed keywords

ACCESS CONTROL; CLIENT SERVER COMPUTER SYSTEMS; DIGITAL LIBRARIES; MATHEMATICAL MODELS; SEMANTICS; WEB SERVICES;

GENERIC WEB WORKLOADS; SEARCH SERVICES; SYNTHETIC WORKLOADS; WEB APPLICATIONS;

SEARCH ENGINES;

EID: 36349033571     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1255175.1255203     Document Type: Conference Paper

References (25)

1. G. Abdulla. Analysis and modeling of world wide web traffic. PhD thesis, 1998. Chair-Edward A. Fox.
2. C. S. Badue, R. Barbosa, P. Golgher, B. Ribeiro-Neto, and N. Ziviani. Distributed processing of conjunctive queries. In HDIR '05, SIGIR 2005, 2005.
3. P. Barford and M. E. Crovella. Generating representative Web workloads for network and server performance evaluation. In SIGMETRICS '98, pages 151-160, July 1998.
4. L. Bent, M. Rabinovich, G. M. Voelker, and Z. Xiao. Characterization of a large web site population with implications for content delivery. In WWW '04, pages 522-533, 2004.
5. J. Beran. Statistics for Long-Memory Processes. Chapman & Hall, New York, NY, 1994.
6. B. Berendt, B. Mobasher, M. Spiliopoulou, and J. Wiltshire. Measuring the accuracy of sessionizers for web usage analysis. In Proceedings of the Web Mining Workshop at the 1st SIAM International Conference on Data Mining, Chicago, Illinois, April 2001.
7. G. Box and G. Jenkins. Time Series Analysis, Forecasting and Control. Holden-Day, Incorporated, 1990.
8. S. Chaudhuri, P. Ganesan, and V. R. Narasayya. Primitives for workload summarization and implications for SQL. In VLDB, pages 730-741, 2003.
9. M. E. Crovella and A. Bestavros. Self-similarity in World Wide Web traffic: Evidence and possible causes. IEEE/ACM Transactions on Networking, 5(6):835-846, Dec. 1997.
10. P. Dinda and D. O'Hallaron. An extensible toolkit for resource prediction in distributed systems, 1999.
11. C. L. Giles, K. Bollacker, and S. Lawrence. CiteSeer: An automatic citation indexing system. In The Third ACM Conference on Digital Libraries, pages 89-98, Pittsburgh, PA, 1998.
12. M. E. Gómez and V. Santonja. Analysis of self-similarity in I/O workload using structural modeling. In MASCOTS, page 234, 1999.
13. T. Kelly and J. Mogul. Aliasing on the World Wide Web: Prevalence and Performance Implications. In WWW'02, Honolulu, Hawaii, May 2002.
14. D. E. Knuth. The Art of Computer Programming. Four volumes. Addison-Wesley, 1969.
15. H. Li, I. G. Councill, W.-C. Lee, and C. L. Giles. CiteSeerX: an architecture and web service design for an academic document search engine. In WWW, pages 883-884, 2006.
16. Y. Lu, T. Abdelzaher, C. Lu, and G. Tao. An adaptive control framework for QoS guarantees and its application to differentiated caching services, 2002.
17. E. Manavoglu, D. Pavlov, and C. L. Giles. Probabilistic user behavior models. In ICDM 'OS, page 203, Washington, DC, USA, 2003.
18. R. Sen and M. Hansen. Predicting a web user's next access based on log data. Journal of Computational and Graphical Statistics, 12:143-155(13), 2003.
19. R. Simmonds, C. L. Williamson, R. Bradford, M. F. Arlitt, and B. Unger. Web server benchmarking using parallel WAN emulation. In SIGMETRICS'02, pages 286-287, 2002.
20. A. Streit. Self-Tuning Job Scheduling Strategies for the Resource Management of HPC Systems and Computational Grids. PhD thesis, Faculty of Computer Science, Electrical Engineering and Mathematics, University Paderborn, 2003.
21. P. Tkn and V. Kumar. Discovery of web robot sessions based on their navigational patterns. Data Mining and Knowledge Discovery, 6:9-35, 2002.
22. N. Tran and D. A. Reed. ARIMA time series modeling and forecasting for adaptive I/O prefetching. In Proceedings of the 15th international conference on Supercomputing, pages 473-485, June 2001.
23. Y. Wang, M. J. Rutherford, A. Carzaniga, and A. L. Wolf. Weevil: a tool to automate experimentation with distributed systems. Technical Report CU-CS-980-04, Department of Computer Science, University of Colorado, Oct. 2004.
24. J. Zhang, A. Sivasubramaniam, H. Franke, N. Gautam, Y. Zhang, and S. Nagar. Synthesizing representative I/O workloads for TPC-H. In HPCA, pages 142-151, 2004.
25. S. Zhang, I. Cohen, M. Goldszmidt, J. Symons, and A. Fox. Ensembles of models for automated diagnosis of system performance problems. In DSN '05: Proceedings of the 2005 International Conference on Dependable Systems and Networks (DSN'05), pages 644-653, 2005.