Cataclysm: Scalable overload policing for internet applications

Journal of Network and Computer Applications

Volumn 31, Issue 4, 2008, Pages 891-920

  Urgaonkar, Bhuvan ^a   Shenoy, Prashant ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

Admission control; Data center; Dynamic provisioning; Internet application; Overload; Sentry

Indexed keywords

DECISION MAKING; DYNAMIC RESPONSE; INFORMATION SERVICES; PROBLEM SOLVING; STRUCTURAL LOADS;

ADMISSION CONTROL (AC); DYNAMIC CAPACITY (DC); INTEGRATED APPROACH; INTERNET APPLICATIONS; LINUX CLUSTERING; LOW OVERHEAD; MULTIPLE TIME-SCALES; PRIMARY CONTRIBUTION; RESPONSE TIME; REVENUE MAXIMIZATION; SERVER PLATFORMS;

INTERNET;

EID: 47949130398     PISSN: 10848045     EISSN: 10958592     Source Type: Journal    
DOI: 10.1016/j.jnca.2007.04.001     Document Type: Article

References (44)

1. Abdelzaher T, Bhatti N. Web content adaptation to improve server overload behavior. In: Proceedings of the World Wide Web conference (WWW8). Tornoto; 1999.
2. Anderson T., Roscoe T., and Wetherall D. Preventing Internet denial-of-service with capabilities. ACM SIGCOMM Computer Communications Review 34 1 (2004) 39-44
3. Appleby K, Fakhouri S, Fong L, Goldszmidt MKG, Krishnakumar S, Pazel D, Pershing J, Rochwerger B. Oceano-SLA-based management of a computing utility. In: Proceedings of the IFIP/IEEE symposium on integrated network management; May 2001.
4. Aron M, Druschel P, Zwaenepoel W. Cluster reserves: a mechanism for resource management in cluster-based network servers. In: Proceedings of the ACM SIGMETRICS conference. Santa Clara, CA; June 2000.
5. Aron M, Sanders D, Druschel P, Zwaenepoel W. Scalable content-aware request distribution in cluster-based network servers. In: Proceedings of the USENIX 2000 annual technical conference. San Diego, CA; June 2000.
6. Benani M, Menasce D. Resource allocation for autonomic data centers using analytic performance models. In: Proceedings of IEEE international conference on autonomic computing, Seattle (ICAC-05), WA; June 2005.
7. Cardellini V., Casalicchio E., Colajanni M., and Yu P. The State of the Art in Locally Distributed Web-server Systems. ACM Computing Surveys (CSUR) Archive 34 2 (2002) 263-311
8. Chandra A, Gong W, Shenoy P. Dynamic resource allocation for shared data centers using online measurements. In: Proceedings of the eleventh international workshop on quality of service (IWQoS 2003). Monterey, CA; June 2003.
9. Chase J, Doyle R. Balance of power: energy management for server clusters. In: Proceedings of the eighth workshop on hot topics in operating systems (HotOS-VIII). Elmau, Germany; May 2001.
10. Chase J, Grit L, Irwin D, Moore J, Sprenkle S. Dynamic virtual clusters in a grid site manager. In: Twelfth international symposium on high performance distributed computing (HPDC-12); June 2003.
11. Cheng S.-C., Stankovic J.-A., and Ramamritham K. Scheduling algorithms for hard real-time systems: a brief survey. Tutorial: hard-real systems (1989), IEEE Computer Society Press, Los Alamitos, CA, USA 150-173
12. Cherkasova L, Phaal P. Session based admission control: a mechanism for improving performance of commercial web sites. in: Proceedings of seventh international workshop on quality of service, IEEE/IFIP event. London; June 1999.
13. Cohen I, Chase J, Goldszmidt M, Kelly T, Symons J. Correlating Instrumentation data to system states: a building block for automated diagnosis and control. In: Proceedings of the sixth USENIX symposium in operating systems design and implementation (OSDI 2004). San Francisco, CA; December 2004.
14. Computer Science and Telecommunications Board Division on Engineering and Physical Sciences, National Research Council. The Internet under crisis conditions: learning from September 11. In: Report on the Internet Under Crisis Conditions; 2002.
15. Doyle R, Chase J, Asad O, Jin W, Vahdat A. Model-based resource provisioning in a Web service utility. In: Proceedings of the fourth USITS; March 2003.
16. Elnikety S, Nahum E, Tracey J, Zwaenepoel W. A method for transparent admission control and request scheduling in e-commerce Web sites. In: Proceedings of the thirteenth international conference on World Wide Web. New York, NY, USA; 2004. p. 276-86.
17. Floyd S., and Jacobson V. Raodom early detection gateways for congestion avoidance. IEEE/ACM Transactions on Networking 1 4 (1993) 397-413
18. Floyd S., and Jacobson V. Link sharing and resource management models for packet networks. IEEE/ACM Transactions on Networking 3 4 (1995) 365-386
19. Garey M., and Johnson D. Computers and intractibility: a guide to the theory of NP-completeness (January 1979), W.H. Freeman and Company, New York
20. Hellerstein J., Zhang F., and Shahabuddin P. Link sharing and resource management models for packet networks. A Statistical Approach to Predictive Detection. Computer Networks 35 1 (2001) 77-95
21. Iyer R, Tewari V, Kant K. Overload control mechanisms for Web servers. In: Workshop on Performance and QoS of Next Generation Networks; November 2000.
22. Jamjoom H, Reumann J, Shin K. QGuard: protecting Internet servers from overload. Technical Report CSE-TR-427-00, Department of Computer Science, University of Michigan; 2000.
23. Kamra A, Misra V, Nahum E. Yaksha: a controller for managing the performance of 3-tiered Websites. In: Proceedings of the twelfth IWQoS, 2004a.
24. Kamra A., Saran H., Sen S., and Shorey R. Fair adaptive bandwidth allocation: a rate control based active queue management discipline. The International Journal of Computer and Telecommunications Networking 44 2 (2004) 135-152
25. Kandula S, Katabi D, Jacob M, Burger A. Botz-4-Sale: surviving DDoS attacks that mimic flash crowds. In: Proceedings of USENIX symposium on networked systems design and implementation; 2005.
26. Kanodia V, Knightly E. Multi-class latency-bounded Web servers. In: Proceedings of international workshop on quality of service (IWQoS'00); June 2000.
27. Kleinrock L. Queueing systems, volume 2: computer applications (1976), Wiley, New York
28. Knightly E., and Shroff N. Admission control for statistical QoS: theory and practice. IEEE Network 13 2 (1999) 20-29
29. Kernel TCP Virtual Server. 〈http://www.linuxvirtualserver.org/software/ktcpvs/ktcpvs.html〉.
30. Li S, Jamin S. A measurement-based admission-controlled Web server. In: Proceedings of the nineteenth annual joint conference of the IEEE computer and communications societies (INFOCOM 2000). Tel Aviv, Israel; March 2000.
31. Mosberger D, Jin T. httperf-a tool for measuring web server performance. In: Proceedings of the SIGMETRICS Workshop on Internet Server Performance; June 1998.
32. Pai V, Aron M, Banga G, Svendsen M, Druschel P, Zwanepoel W, Nahum E. Locality-aware request distribution in cluster-based network servers. In: Proceedings of the eighth international conference on architectural support for programming languages and operating systems (ASPLOS-VIII), San Jose, CA; October 1998.
33. Ranjan S, Rolia J, Fu H, Knightly E. QoS-driven server migration for Internet data centers. In: Proceedings of the tenth international workshop on quality of service. Miami, FL; 2002.
34. Schroeder B, Harchol-Balter M. Web servers under overload: how scheduling can help. In: Proceedings of the eighteenth international teletraffic congress; 2003.
35. Stewart C, Kelly T, Zhang A. Exploiting nonstationarity for performance prediction. In: Proceedings of EuroSys2007. Lisbon, Portugal; March 2007.
36. Urgaonkar B, Pacifici G, Shenoy P, Spreitzer M, Tantawi A. An analytical model for multi-tier Internet services and its applications. In: Proceedings of the ACM international conference on measurement and modeling of computer systems (SIGMETRICS 2005). Banff, Canada; June 2005.
37. Urgaonkar B., and Shenoy P. Sharc: managing CPU and network bandwidth in shared clusters. IEEE Transactions on Parallel and Distributed Systems 15 1 (2004) 2-17
38. Urgaonkar B, Shenoy P. Cataclysm: policing extreme overloads in Internet applications. In: Proceedings of the fourteenth international World Wide Web conference (WWW 2005). Chiba, Japan; May 2005.
39. Urgaonkar B, Shenoy P, Roscoe T. Resource overbooking and application profiling in shared hosting platforms. In: Proceedings of the fifth USENIX symposium on operating systems design and implementation (OSDI 2002). Boston, MA; December 2002.
40. Verma A, Ghosal S. On admission control for profit maximization of networked service providers. In: Proceedings of the 12th international World Wide Web conference (WWW2003). Budapest, Hungary; May 2003.
41. Villela D, Pradhan P, Rubenstein D. Provisioning servers in the application tier for e-commerce systems. In: Proceedings of the twelfth IWQoS; June 2004.
42. Voigt T, Tewari R, Freimuth D, Mehra A. Kernel mechanisms for service differentiation in overloaded Web servers. In: Proceedings of USENIX annual technical conference; June 2001.
43. Welsh M, Culler D. Adaptive overload control for busy Internet servers. In: Proceedings of the fourth USENIX conference on Internet technologies and systems (USITS'03); March 2003.
44. Web service level agreements (wsla) project. 〈http://www.research.ibm.com/wsla〉.