Characterization of real workloads of web search engines

Proceedings - 2011 IEEE International Symposium on Workload Characterization, IISWC - 2011

Volumn , Issue , 2011, Pages 15-25

  Xi, Huafeng ^a   Zhan, Jianfeng ^a   Jia, Zhen ^a   Hong, Xuehai ^a   Wang, Lei ^a   Zhang, Lixin ^a   Sun, Ninghui ^a   Lu, Gang ^a  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CPU UTILIZATION; DATA CENTERS; EVALUATION TOOL; GAIN INSIGHT; LOG-NORMAL DISTRIBUTION; MEMORY ACCESS LATENCY; PERFORMANCE DATA; PERFORMANCE METRICS; PROBABILITY MODELS; PROCESSOR PIPELINES; REAL TRACE; REAL WORLD WEB; SEARCH QUERIES; SEARCH SERVICES; SYSTEM DESIGNERS; WEB APPLICATION;

BENCHMARKING; CHARACTERIZATION; INFORMATION RETRIEVAL; MEMORY ARCHITECTURE; NORMAL DISTRIBUTION; POISSON DISTRIBUTION; SYSTEMS ANALYSIS; WORLD WIDE WEB;

SEARCH ENGINES;

EID: 84862929528     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IISWC.2011.6114193     Document Type: Conference Paper

References (28)

1. http://www.sogou.com/.
2. http://www.sogou/labs/dl/t.html.
3. http://hadoop.apache.org/mapreduce/docs/current/gridmix.html.
4. http://www.tpc.org/tpcc.
5. http://www.spec.org/cpu2006.
6. Performance counters for linux. https://perf.wiki.kernel.org/index.php/ Main-Page.
7. Search: a benchmark for datacenter and cloud computing. http://prof.ncic.ac.cn/DCBenchmarks.
8. A testbed for datacenter and cloud computing. http://prof.ncic.ac.cn/htc- testbed.
9. Zipf's law. http://en.wikipedia.org/wiki/Zipf's-law.
10. C. Almeida, A. Bestavros, M. Crovella, and A. De Oliveira. Characterizing reference locality in the WWW. In pdis, page 0092. Published by the IEEE Computer Society, 1996.
11. H. Anand and S. Giles. Searchgen: a synthetic workload generator for scientific literature digital libraries and search engines. In Proceedings of the 7th ACM/IEEE Joint Conference on Digital Libraries: Vancouver, British Columbia, Canada, June 18-23, 2007: building & sustaining the digital environment: JCDL 2007, page 137. Citeseer, 2007.
12. P. Barford and M. Crovella. Generating representative web workloads for network and server performance evaluation. ACM SIGMETRICS Performance Evaluation Review, 26(1):151-160, 1998.
13. L. Barroso and U. Hölzle. The datacenter as a computer: An introduction to the design of warehouse-scale machines. Synthesis Lectures on Computer Architecture, 4(1):1-108, 2009.
14. B. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. In Proceedings of the 1st ACM symposium on Cloud computing, pages 143-154. ACM, 2010.
15. S. P. E. Corporation. Specweb2005: Spec benchmark for evaluating the performance of world wide web servers. http://www.spec.org/web2005/, 2005.
16. J. Dongarra, P. Luszczek, and T. U. KNOXVILLE. Introduction to the HPCChallenge benchmark suite. Citeseer, 2005.
17. Ş. Gündüz and M. Özsu. A poisson model for user accesses to web pages. Computer and Information Sciences-ISCIS 2003, pages 332-339, 2003.
18. J. Hennessy, D. Patterson, and D. Goldberg. Computer architecture: a quantitative approach. Morgan Kaufmann, 2003.
19. B. Jansen. Search log analysis: What it is, what's been done, how to do it. Library & Information Science Research, 28(3):407-432, 2006.
20. B. Jansen, A. Spink, C. Blakely, and S. Koshman. Defining a session on Web search engines. Journal of the American Society for Information Science and Technology, 58(6):862-871, 2007.
21. R. Mattson, J. Gecsei, D. Slutz, and I. Traiger. Evaluation techniques in storage hierarchies. IBM Journal of Research and Development, 9(2):78-117, 1970.
22. M. Michael, J. Moreira, D. Shiloach, and R. Wisniewski. Scale-up x scale-out: A case study using nutch/lucene. In Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE International, pages 1-8. IEEE, 1930.
23. D. Mosberger and T. Jin. httperf - tool for measuring web server performance. ACM SIGMETRICS Performance Evaluation Review, 26(3):31-37, 1998.
24. A. Phansalkar, A. Joshi, and L. John. Analysis of redundancy and application balance in the spec cpu2006 benchmark suite. ACM SIGARCH Computer Architecture News, 35(2):412-423, 2007.
25. A. H. S. Project. Flood: a profile-driven http load tester. http://httpd.apache.org/test/flood/, Mar. 2011.
26. B. Sang, J. Zhan, G. Lu, H. Wang, D. Xu, L. Wang, Z. Zhang, and Z. Jia. Precise, scalable, and online request tracing for multi-tier services of black boxes. IEEE Transactions on Parallel and Distributed Systems, 2011.
27. L. Wang, J. Zhan, W. Shi, and Y. Liang. In cloud, can scientific communities benefit from the economies of scale? IEEE Transactions on Parallel and Distributed Systems, 2011.
28. P. Wang, D. Meng, J. Han, J. Zhan, B. Tu, and X. Shi. Transformer: a new paradigm for building data-parallel programming models. Micro, IEEE, 30(4):55-64, 2010.