Workload characterization and performance implications of large-scale blog servers

ACM Transactions on the Web

Volumn 6, Issue 4, 2012, Pages

  Jeon, Myeongjae ^a   Kim, Youngjae ^b   Hwang, Jeaho ^c   Lee, Joonwon ^d   Seo, Euiseong ^d  

^a Rice University   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

^c Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^d Sungkyunkwan University   (South Korea)

Author keywords

Filesystems; Measurement; Modeling; Social Network Services; Workload characterization

Indexed keywords

AUDIO FILES; DISK BLOCK; FILE ACCESS; FILESYSTEM; FILESYSTEMS; HOST SERVERS; LOG-NORMAL DISTRIBUTION; NETWORK TRAFFIC; PARETO DISTRIBUTIONS; PERFORMANCE IMPROVEMENTS; PROCESSING TIME; SMALL FILES; SOCIAL NETWORK SERVICES; SYSTEM THROUGHPUT; TEMPORAL LOCALITY; TRACE DRIVEN SIMULATION; USER ACCESS; WEB SERVER LOGS; WORKLOAD CHARACTERIZATION;

CHARACTERIZATION; MEASUREMENTS; MODELS; SOCIAL NETWORKING (ONLINE);

BLOGS;

EID: 84870696631     PISSN: 15591131     EISSN: 1559114X     Source Type: Journal    
DOI: 10.1145/2382616.2382619     Document Type: Article

References (39)

1. ABAN, I. B., MEERSCHAERT, M. M., AND PANORSKA, A. K. 2006. Parameter estimation for the truncated pareto distribution. J. Amer. Statist. Assoc. 101, 473, 270-277. (Pubitemid 43500041)
2. ARLITT, M. F. AND JIN, T. 2000. A workload characterization study of the 1998 world cup web site. IEEE Netw. 14, 3, 33-37.
3. ARLITT, M. F. AND WILLIAMSON, C. L. 1997. Internet web servers: Workload characterization and performance implications. IEEE/ACM Trans. Netw. 5, 5, 631-645. (Pubitemid 127770550)
4. BARFORD, P. AND CROVELLA, M. 1999. A performance evaluation of hyper text transfer protocols. SIGMETRICS Perform. Eval. Rev. 27, 1, 188-197.
5. BENT, L., RABINOVICH, M., VOELKER, G. M., AND XIAO, Z. 2004. Characterization of a large web site population with implications for content delivery. In Proceedings of the 13th International World Wide Web Conference.
6. BORGHOL, Y., MITRA, S., ARDON, S., CARLSSON, N., EAGER, D., AND MAHANTI, A. 2011. Characterizing and modeling popularity of user-generated videos. Perform. Eval. 68, 11, 1037-1055.
7. BUCY, J. S., SCHINDLER, J., SCHLOSSER, S. W., AND GANGER, G. R. 2008. The disksim simulation environment version 4.0 reference manual. Tech. rep. CMU-PDL-08-101, Carnegie Mellon University.
8. BURKE, M., MARLOW, C., AND LENTO, T. 2009. Feed me: Motivating newcomer contribution in social network sites. In Proceedings of the 27th ACM CHI Conference on Human Factors in Computing Systems.
9. CHA, M., MISLOVE, A., AND GUMMADI, K. P. 2009. A measurement-driven analysis of information propagation in the flickr social network. In Proceedings of the 18th International Conference on World Wide Web.
10. CHALLENGER, J. 1996. A distributed web server and its performance analysis on multiple platforms. In Proceedings of the 16th International Conference on Distributed Computing Systems.
11. CROVELLA, M. E. AND BESTAVROS, A. 1997. Self-similarity in world wide web traffic: Evidence and possible causes. IEEE/ACM Trans. Netw. 5, 6, 835-846. (Pubitemid 127768491)
12. CROVELLA, M. E. AND TAQQU, M. S. 1999. Estimating the heavy tail index from scaling properties. Meth. Comput. Appl. Probab. 1, 1, 55-79.
13. DINGLE, A., MACNAIR, E., AND NGUYEN, T. 1999. An analysis of web server performance. In Proceedings of the Global Telecommunication Conference.
14. DUARTE, F., MATTOS, B., BESTAVROS, A., ALMEIDA, V., AND ALMEIDA, J. 2007. Traffic characteristics and communication patterns in blogosphere. In Proceedings of the International Conference on Weblogs and Social Media.
15. FABER, A. M., GUPTA, M., AND VIECCO, C. H. 2006. Revisiting web server workload invariants in the context of scientific web sites. In Proceedings of the ACM/IEEE Conference on Supercomputing.
16. GILL, P., ARLITT, M., LI, Z., AND MAHANTI, A. 2007. Youtube traffic characterization: A view from the edge. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement.
17. GILL, P., ARLITT, M., CARLSSON, N., MAHANTI, A., AND WILLIAMSON, C. 2011. Characterizing organizational use of web-based services: Methodology, challenges, observations, and insights. ACM Trans. Web 5, 4, 19:1-19:23.
18. GUO, L., TAN, E., CHEN, S., ZHANG, X., AND ZHAO, Y. E. 2009. Analyzing patterns of user content generation in online social networks. In Proceedings of the 15th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.
19. HOLMEDAHL, V., SMITH, B., AND YANG, T. 1998. Cooperative caching of dynamic content on a distributed web server. In Proceedings of the 7th International Symposium on High Performance Distributed Computing.
20. IYENGAR, A. AND CHALLENGER, J. 1997. Improving web server performance by caching dynamic data. In Proceedings of the USENIX Symposium on Internet Technologies and Systems.
21. KANT, K. AND WON, Y. 1999. Performance impact of uncached file accesses in specweb99. In Proceedings of the 2nd IEEE Workshop on Workload Characterization.
22. KRISHNAMURTHY, B. 2009. A measure of online social networks. In Proceedings of the 1st International Conference on Communication Systems and Networks.
23. LESKOVEC, J., MCGLOHON, M., FALOUTSOS, C., GLANCE, N., AND HURST, M. 2007. Cascading behavior in large blog graphs. In Proceedings of the 7th SIAM International Conference on Data Mining.
24. LI, Z., CHEN, Z., SRINIVASAN, S. M., AND ZHOU, Y. 2004. C-miner: Mining block correlations in storage systems. In Proceedings of the 3rd USENIX Conference on File and Storage Technologies.
25. LIMPERT, E., STAHEL, W. A., AND ABBT, M. 2001. Log-Normal Distributions across the Sciences: Keys and Clues. BioScience.
26. NAGPURKAR, P., HORN, W., GOPALAKRISHNAN, U., DUBEY, N., JANN, J., AND PATTNAIK, P. 2008. Workload characterization of selected JEE-based web 2.0 applications. In Proceedings of the IEEE International Symposium on Workload Characterization.
27. OHARA, M., NAGPURKAR, P., UEDA, Y., AND ISHIZAKI, K. 2009. The data-centricity of web 2.0 workloads and its impact on server performance. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software.
28. OKE, A. AND BUNT, R. B. 2002. Hierarchical workload characterization for a busy web server. In Proceedings of the 12th International Conference on Modelling Tools and Techniques for Computer and Communication System Performance Evaluation.
29. PATTERSON, R. H., GIBSON, G. A., GINTING, E., STODOLSKY, D., AND ZELENKA, J. 1995. Informed prefetching and caching. In Proceedings of the 15th ACM Symposium on Operating System Principles.
30. PAXSON, V. AND FLOYD, S. 1994. Wide-area traffic: the failure of poisson modeling. In Proceedings of the Conference on Communications Architectures, Protocols and Applications.
31. RODRIGUEZ, P. 2009. Web infrastructure for the 21st century. In Proceedings of the 18th International World Wide Web Conference.
32. SHRIVER, E., GABBER, E., HUANG, L., AND STEIN, C. A. 2001. Proceedings of the USENIX Annual Technical Conference.
33. STEWART, C., LEVENTI, M., AND SHEN, K. 2008. Empirical examination of a collaborative web application. In Proceedings of the IEEE International Symposium on Workload Characterization.
34. TOMKINS, A., PATTERSON, R. H., AND GIBSON, G. 1997. Informed multi-process prefetching and caching. In Proceedings of the ACM SIGMETRICS Conference.
35. VERES, S. AND IONESCU, D. 2009. Measurement-Based traffic characterization for web 2.0 applications. In Proceedings of the International Instrumentation and Measurement Technology Conference.
36. WACHS, M., ABD-EL-MALEK, M., THERESKA, E., AND GANGER, G. R. 2007. Argon: Performance insulation for shared storage servers. In Proceedings of the 6th USENIX Conference on File and Storage Technologies.
37. WANG, J. AND LI, D. 2003. A light-weight, temporary file system for large-scale web servers. In Proceedings of the 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.
38. WILLIAMS, A., ARLITT, M., WILLIAMSON, C., AND BARKER, K. 2005. Web Workload Characterization: Ten Years Later. Springer.
39. ZIPF, G. K. 1949. Human Behavior and the Principle of Least-Effort. Addison-Wesley.