Resilient workload manager: Taming bursty workload of scaling internet applications

Proceedings of the 6th International Conference Industry Session on Autonomic Computing and Communications Industry Session, ICAC-INDST'09

Volumn , Issue , 2009, Pages 19-28

  Zhang, Hui ^a   Jiang, Guofei ^a   Yoshihira, Kenji ^a   Chen, Haifeng ^a   Saxena, Akhilesh ^a  

^a NEC LABORATORIES AMERICA   (United States)

Author keywords

Algorithms; Cloud computing; Data center management; Load balancing; Workload management

Indexed keywords

CLOUD COMPUTING; DATA ACCESS; DATA CENTER MANAGEMENT; DATA CENTERS; DYNAMIC PROVISIONING; HIGH PERFORMANCE SYSTEMS; INTERNET APPLICATION; LOAD BALANCING; OPTIMIZATION TECHNIQUES; ORDERS OF MAGNITUDE; PEAK LOAD; PROCESSING SPEED; REGULAR PERIODS; RESOURCE EFFICIENCIES; RESOURCE PLANNING; ROOT CAUSE; SERVICE QUALITY; TARGET APPLICATION; WORKLOAD MANAGEMENT;

INTERNET; LARGE SCALE SYSTEMS; MANAGERS; MATHEMATICAL OPERATORS; QUALITY CONTROL; QUALITY OF SERVICE; RESOURCE ALLOCATION; ROM; SATELLITE COMMUNICATION SYSTEMS;

COMPUTATION THEORY;

EID: 70049102944     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1555312.1555318     Document Type: Conference Paper

References (45)

1. Amazon. http://aws.amazon.com/cloudfront/.
2. Amazon web services. http://aws.amazon.com/.
3. Darwin streaming server. http://developer.apple.com/darwin/projects/ streaming/.
4. Emc invista: Network-based storage virtualization. http://www.emc.com/ products/detail/software/invista.htm.
5. Gigaspaces. http://www.gigaspaces.com.
6. Google app engine. http://code.google.com/appengine/.
7. Myspace. http://www.myspace.com.
8. openrtsp. http://www.live555.com/openRTSP/.
9. Vmware. http://www.vmware.com.
10. Vmware cloud vservices. http://www.vmware.com/technology/ virtualdatacenter- os/cloud-vservices/.
11. Xen. http://www.xen.org.
12. Yahoo! video. http://video.yahoo.com.
13. Youtube. http://www.youtube.com.
14. A capacity planning framework for multi-tier enterprise services with real workloads. In Proceedings of 10th IFIP/IEEE International Symposium on Integrated Network Management, pages 781-784, 2007.
15. ComScore Video Metrix report: U.S. Viewers Watched an Average of 3 Hours of Online Video in July. http://www.comscore.com/press/release.asp?press=1678, July 2007.
16. D. Abendroth and U. Killat. Intelligent shaping: Well shaped throughout the entire network? In Proceedings of INFOCOM 2002, 2002.
17. M. Arregoces and M. Portolani. Data Center Fundamentals. Cisco Press, 2003.
18. J. M. Blanquer, A. Batchelli, K. Schauser, and R. Wolski. Quorum: flexible quality of service for internet services. In NSDI'05: Proceedings of the 2ndconference on Symposium on Networked Systems Design & Implementation, pages 159-174, Berkeley, CA, USA, 2005. USENIX Association.
19. P. Bodik, M. P. Armbrust, K. Canini, A. Fox, M. Jordan, and D. A. Patterson. A case for adaptive datacenters to conserve energy and improve reliability. Technical Report UCB/EECS-2008-127, EECS Department, University of California, Berkeley, Sep 2008.
20. E. Casalicchio, V. Cardellini, and M. Colajanni. Content-aware dispatching algorithms for cluster-based web servers. Cluster Computing, 5(1):65-74, 2002.
21. Y. Chen, S. Iyer, X. Liu, and D. M. abd Akhil Sahai. Sla decomposition: Translating service level objectives to system level thresholds. In ICAC '07. Fourth International Conference on Autonomic Computing, June 2007.
22. L. Cherkasova and L. Staley. Measuring the capacity of a streaming media server in a utility data center environment. In MULTIMEDIA '02: Proceedings of the tenth ACM international conference on Multimedia, pages 299-302, New York, NY, USA, 2002. ACM.
23. L. Cherkasova, W. Tang, and S. Singhal. An sla-oriented capacity planning tool for streaming media services, July 2004.
24. N. G. Duffield and M. Grossglauser. Trajectory sampling for direct traffic observation. SIGCOMM Comput. Commun. Rev., 30(4):271-282, 2000.
25. L. Gao, M. Dahlin, A. Nayate, J. Zheng, and A. Iyengar. Application specific data replication for edge services. In Proceedings of the 2003 International World Wide Web, May 2003.
26. D. Gmach, J. Rolia, L. Cherkasova, G. Belrose, T. Turicchi, and A. Kemper. An integrated approach to resource pool management: Policies, efficiency and quality metrics. In DSN, pages 326-335, 2008.
27. F. Hao, M. Kodialam, T. V. Lakshman, and H. Zhang. Fast payload-based flow estimation for traffic monitoring and network security. In ANCS '05: Proceedings of the 2005 ACM symposium on Architecture for networking and communications systems, New York, NY, USA, 2005. ACM.
28. M. Harchol-Balter, M. E. Crovella, and C. D. Murta. On choosing a task assignment policy for a distributed server system. Journal of Parallel and Distributed Computing, 59(2):204-228, 1999.
29. M. Harchol-Balter, M. E.Crovella, and C. D. Murta. On choosing a task assignment policy for a distributed server system, 1998.
30. S. Jin and A. Bestavros. Greedydual* web caching algorithm: Exploiting the two sources of temporal locality in web request streams. In In Proceedings of the 5th International Web Caching and Content Delivery Workshop, pages 174-183, 2000.
31. X. Kang, H. Zhang, G. Jiang, H. Chen, X. Meng, and K. Yoshihira. Understanding internet video sharing site workload: a view from data center design. In WWW '08: Proceeding of the 17th international conference on World Wide Web, pages 1097-1098, New York, NY, USA, 2008. ACM.
32. G. Karypis and V. Kumar. Multilevel k-way hypergraph partitioning. In DAC '99: Proceedings of the 36th ACM/IEEE conference on Design automation, pages 343-348, New York, NY, USA, 1999. ACM.
33. E. W. Knightly and N. B. Shroff. Admission control for statistical qos: theory and practice. Network, IEEE, 13(2):20-29, 1999.
34. A. Kumar, M. Sung, J. Xu, and J. Wang. Data streaming algorithms for efficient and accurate estimation of flow distribution. In Proc. of ACM SIGMETRICS, June 2004. to appear.
35. Z. Liu, M. S. Squillante, and J. L. Wolf. On maximizing service-level-agreement profits. ACM SIGMETRICS Performance Evaluation Review Special section on the MAMA 2001 workshop, 29(3):43-44, 2001.
36. A. Manjhi, V. Shkapenyuk, K. Dhamdhere, and C. Olston. Finding (recently) frequent items in distributed data streams. In ICDE '05: Proceedings of the 21st International Conference on Data Engineering, pages 767-778, Washington, DC, USA, 2005. IEEE Computer Society.
37. R. Pan, B. Prabhakar, and K. Psounis. Choke - a stateless active queue management scheme for approximating fair bandwidth allocation. In INFOCOM 2000. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE, volume 2, pages 942-951 vol.2, 2000.
38. V. Paxson and S. Floyd. Wide-area traffic: the failure of poisson modeling. SIGCOMM Comput. Commun. Rev., 24(4):257-268, 1994.
39. E. Pinheiro, R. Bianchini, E. V. Carrera, and T. Heath. Dynamic cluster reconfiguration for power and performance. pages 75-93, 2003.
40. K. Shen, H. Tang, T. Yang, and L. Chu. Integrated resource management for cluster-based internet services. SIGOPS Oper. Syst. Rev., 36(SI):225-238, 2002.
41. J. S. Turner. New directions in communications (or which way to the information age). IEEE Communications, 24(10):8-15, Oct. 1986.
42. B. Urgaonkar and P. Shenoy. Cataclysm: Scalable overload policing for internet applications. Jul 2008.
43. B. Urgaonkar, P. Shenoy, A. Chandra, and P. Goyal. Dynamic provisioning of multi-tier internet applications. In ACM proceedings of the Second International Conference on Automonic Computing, pages 217-228, June 2005.
44. W. Whitt. Partitioning customers into service groups. Management Science, 45(11):1579-1592, Nov 1999.
45. A. Wolman, M. Voelker, N. Sharma, N. Cardwell, A. Karlin, and H. M. Levy. On the scale and performance of cooperative web proxy caching. SIGOPS Oper. Syst. Rev., 33(5):16-31, 1999.