Resource overbooking and application profiling in a shared internet hosting platform

ACM Transactions on Internet Technology

Volumn 9, Issue 1, 2009, Pages

  Urgaonkar, Bhuvan ^a   Shenoy, Prashant ^b,c   Roscoe, Timothy ^d  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

^c Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

^d ETH ZURICH   (Switzerland)

Author keywords

Capsule; Dedicated hosting platform; High percentile; Internet application; Placement; Profile; Quality of service; Resource overbooking; Shared hosting platform; Yield management

Indexed keywords

CAPSULE; DEDICATED HOSTING PLATFORM; HIGH PERCENTILE; INTERNET APPLICATION; PLACEMENT; PROFILE; QUALITY-OF-SERVICE; RESOURCE OVERBOOKING; SHARED HOSTING PLATFORM; YIELD MANAGEMENT;

ECONOMICS; INTERNET; PLANNING; RESOURCE ALLOCATION;

APPLICATIONS;

EID: 62149087382     PISSN: 15335399     EISSN: 15576051     Source Type: Journal    
DOI: 10.1145/1462159.1462160     Document Type: Article

References (101)

1. ABDELZAHER, T., SHIN, K. G., AND BHATTI, N. 2002. Performance guarantees for web server end- systems: A control-theoretical approach. IEEE Trans. Parall, Distrih. Syst. 13, 1 (Jan.).
2. ANDERSON, J., BERC, L., DEAN, J., GHEMAWAT, S., HENZINGER, M., LUENG, S., VANDERVOORDE, M., WALDSPURGER, C., AND WEIHL, W. 1997. Continuous profiling: Where have all the cycles gone? In Proceedings of the 16th ACM Symposium on Operating Systems Principles. ACM, New York, 1-14.
3. APPLEBY, K., FAKHOURI, S., FONG, L., GOLDSZMIDT, M. K. G., KRISHNAKUMAR, S., PAZEL, D., PERSHING, J., AND ROCHWERGER, B. 2001. Oceano-SLA-based management of a computing utility. In Pro- ceedings of the IFIP/IEEE Symposium on Integrated Network Management. IEEE Computer Society Press, Los Alamitos, CA.
4. ARON, M., DRUSCHEL, P., AND ZWAENEPOEL, W. 2000. Cluster reserves: A mechanism for resource management in cluster-based network servers. In Proceedings of the ACM SIGMETRICS Con- ference. ACM, New York.
5. ARPACI-DUSSEAU, A. AND ARPACI- DUSSEAU, R. 2001. Information and control in gray-box systems. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP 2001). ACM, New York, 43-56.
6. ARPACI-DUSSEAU, A. C. 2001. Implicit coscheduling: Coordinated scheduling with implicit infor- mation in distributed systems. ACM Trans. Comput. Syst. 19, 3, 283-331.
7. BANGA, G., DRUSCHEL, P., AND MOGUL, J. 1999. Resource containers: A new facility for resource management in server systems. InProceedings of the 3rd Symposium, on Operating System Design and Implementation (OSDγ99). 45-58.
8. BARHAM, P., DRAGOVIC, B., FRASER, K., HAND, S., HARRIS, T., HO, A., NEUGEBUER, R., PRATT, I., AND WARFIELD, A. 2003. Xen andtheartofvirtulization.InProceedmgso/'í/¡e 19th ACM Symposium on Operating Systems Principles (SOSP). ACM, New York.
9. BENNANI, M. AND MENASCE, D. 2005. Resource allocation for autonomic data centers using analytic performance models. In Proceedings of IEEE International Conference on Autonomic Computing (ICAC-05). IEEE Computer Society Press, Los Alamitos, CA.
10. BERGER, E., KAPLAN, S., URGAONKAR, B., SHARMA, P., CHANDRA, A., AND SHENOY, P. 2003. Scheduler- aware virtual memory management. In Poster at the 19th ACM Symposium, on Operating Systems Principles (SOSP 2003). ACM, New York.
11. BLANQUER, J., BRUNO, J., MCSHEA, M., OZDEN, B., SILBERSCHATZ, A., AND SINGH, A. 1999. Resource management for QoS in Eclipse/BSD. In Proceedings of the FreeBSD'99 Conference.
12. BOORSTYN, R., BURCHARD, A., LIEBEHERR, J., AND OOTTAMAKORN, C. 2000. Statistical service as- surances for traffic scheduling algorithms. IEEE J. Select. Areas Commun. 18, 12, 2651-2664.
13. BURNETT, N, BENT, J., ARPACI-DUSSEAU, A., AND ARPACI-DUSSEAU, R. 2002. Exploiting gray-box knowledge of buffer-cache management. In Proceedings of the USENIX Annual Technical Conference.
14. CHANDRA, A., ADLER, M., GOYAL, P., AND SHENOY, P. 2000. Surplus fair scheduling: A proportional- share CPU scheduling algorithm for symmetric multiprocessors. In Proceedings of the 4th Sym- posium on Operating System Design and Implementation (OSDI 2000).
15. CHANDRA, A., GONG, W., AND SHENOY, P. 2003a. Dynamic resource allocation for shared data centers using online measurements. In Proceedings of the 11th International Workshop on Quality of Service (γWQoS 2003).
16. CHANDRA, A., GOYAL, P., AND SHENOY, P. 2003b. Quantifying the benefits of resource multiplexing in on-demand data centers. In Proceedings of the 1st Workshop on Algorithms and Architectures for Self-Managing Systems.
17. CHASE, J. AND DOYLE, R. 2001. Balance of power: Energy management for server clusters. In Proceedings of the 8th Workshop on Hot Topics in Operating Systems (HotOS-VIII).
18. CHASE, J., GRIT, L., IRWIN, D., MOORE, J., AND SPRENKLE, S. 2003. Dynamic virtual clusters in a grid site manager. In Proceedings of the 12th International Symposium on High Performance Distributed Computing (HPDC-12).
19. CHEN, Y, DAS, A., QIN, W., SIVASUBRAMANIAM, A., WANG, Q., AND NATARAJAN, G. 2005. Managing server energy and operational costs in hosting centers. In Proceedings of the ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS 2005), ACM, New York.
20. CHEN, Y, DAS, A., WANG, Q., SIVASUBRAMANIAM, A., HARPER, R., AND BLAND, M. 2006. Consolidating clients on back-end servers with co-location and frequency control. In Poster at the ACM Inter- national Conference on Measurement and Modeling of Computer Systems (SIGMETRICS 2006). ACM, New York.
21. CHERKASOVA, L. AND PHAAL, P. 1999. Session based admission control: A mechanism for improving performance of commercial web sites. InProceedings of the 7th International Workshop on Quality of Service. IEEE Computer Society Press, Los Alamitos, CA.
22. CLARK, C, FRASER, K., HAND, S., HANSEN, J., JUL, E., LIMPACH, G, PRATT, I., AND WARFIELD, A. 2005. Live migration of virtual machines. In Proceedings of the 2nd Symposium, on Networked. Systems Design and Implementation (NSDγ05).
23. COHEN, I., CHASE, J., GOLDSZMIDT, M., KELLY, T., AND SYMONS, J. 2004. Correlating instrumen- tation data to system states: A building block for automated diagnosis and control. In Pro- ceedings of the 6th USENIX Symposium in Operating Systems Design and Implementation (OSDI2004).
24. COOK, W. AND ROHE, A. 1999. Computing minimum-weight perfect matchings. INFORMS J. Corn- put. 138-148.
25. Corba 2006. Corba documentation, http://www.omg.org/.
26. CORMEN, T., LEISERSON, C, AND RIVEST, R. 1991. Introduction to Algorithms. The MIT Press, Cambridge, MA.
27. DAVIS, P. 1994. Airline ties profitability to yield management. SIAM News.
28. DOYLE, R., CHASE, J., ASAD, O., JIN, W., AND VAHDAT, A. 2003. Model-based resource provisioning in a web service utility. In Proceedings of the 4th USITS.
29. DUDA, K. J. AND CHERγγON, D. R. 1999. Borrowed-virtual-time (BVT) scheduling: Supporting latency-sensitive threads in a general-purpose scheduler. In Proceedings of the 17th ACM Sym- posium on Operating Systems Principles. ACM, New York, 261-276.
30. EDMONDS, J. 1965. Maximum matching and a polyhedron with 0,1 - Vertices. J. Rese. NBS 69B.
31. ELNIKETY, S., NAHUM, E., TRACEY, J., AND ZWAENEPOEL, W. 2004. A method for transparent admission control and request scheduling in e-commerce web sites. In Proceedings of the 13th International Conference on World Wide Web. 276-286.
32. Fox, A., GRIBBLE, S., CHAWATHE, Y., BREWER, E., AND GAUTHIER, P. 1997. Cluster-based scalable network services. In Proceedings of the 16th Symposium on Operating Systems Principles (SOSP'97). ACM, New York.
33. FRANKS, R. 1999. Performance Analysis of Distributed Server Systems. Ph.D. dissertation, Car- leton University.
34. GOVIL, K., TEODOSIU, D., HUANG, Y, AND ROSENBLUM, M. 1999. Cellular disco: Resource management using virtual clusters on Shared-memory Multiprocessors. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP'99). ACM, New York, 154-169.
35. GOVINDAN, S., NATH, A., DAS, A., URGAONKAR, B., AND SγV3/4 SUBRAMANIAM, A. 2007. Xen and co.: Communication-aware CPU scheduling for consolidated xen-based hosting platforms. In Pro- ceedings of the 3rd International ACM SIGPLANISIGOPS Conference on Virtual Execution En- vironments (VEEj. ACM, New York.
36. GOYAL, P., GUO, X., AND VIN, H. M. 1996a. A hierarchical CPU scheduler for multimedia operating systems. In Proceedings of the USENIX Symposium on Operating System Design and Implemen- tation (OSDγ96). 107-122.
37. GOYA L, P., VIN, H. M., AND CHENG, H. 1996b. Start-time fair queuing: A scheduling algorithm for integrated services packet switching networks. In Proceedings of ACM SIGCOMM '96. ACM, New York.
38. GridForum02b 2002. Global grid forum: Scheduling and resource management working group. http://www-unix.mcs.anl.gov/ schopf/ggf-sched/.
39. GUPTA, A., STAHL, D., AND WHINSTON, A. 1999. The economics of network management. Commun. ACM 42, 5, 57-63.
40. HARCHOL-BALTER, M. 2000. Task assignment with unknown duration. In Proceedings of the In- ternational Conference on Distributed Computing Systems. 214-224.
41. HORI, A., TEZUKA, H., ISHIKAWA, Y, SODA, N, KANAKA, H., AND MAEDA, M. 1996. Implementation of gang scheduling on a workstation cluster. In Proceedings of the IPPS'96 Workshop on Job Scheduling Strategies for Parallel Processing. 27-40.
42. IYέR, R., TEWARI, V, AND KANT, K. 2000. Overload control mechanisms for web servers. In Pro- ceedings of the Workshop on Performance and QoS of Next Generation Networks.
43. JAMJOOM, H., REUMANN, J., AND SHIN, K. 2000. QGuard: Protecting internet servers from overload. Tech. Rep. CSE-TR-427-00, Department of Computer Science, University of Michigan.
44. JONES, M. B., ROSU, D., AND ROSU, M. 1997. CPU reservations and time constraints: Efficient, predictable scheduling of independent activities. In Proceedings of the 16th ACM Symposium on Operating Systems Principles (SOSP'97). ACM, New York, 198-211.
45. KAMRA, A., MISRA, V., AND NAHUM, E. 2004. Yaksha: A controller for managing the performance of 3-tiered websites. In Proceedings of the 12th International Workshop on Quality of Service (IWQoS). IEEE Computer Society Press, Los Alamitos, CA.
46. KANODIA, V. AND KNIGHTLY, E. 2000. Multi-class latency-bounded web servers. In Proceedings of International Workshop on Quality of Service (IWQoS'00). IEEE Computer Society Press, Los Alamitos, CA.
47. KELLY, T., COHEN, I., GOLDSZMIDT, M., AND KEETON, K. 2004. Inducing models of black-box storage arrays. Tech. Rep. HPL-2004, HP Labs.
48. KNIGHTLY, E. AND SHROFF, N. 1999. Admission control for statistical QoS: Theory and practice. IEEE Network 13, 2. 20-29.
49. KOURNEV, S. AND BUCHMANN, A. 2003. Performance modeling and evaluation of large-scale J2EE applications. In Proceedings of the International Conference of the Computer Measurement Group.
50. LEE, L.-W., SCHEUERMANN, P., AND VINGRALEK, R. 2000. File assignment in parallel I/O systems with minimal variance of service time. IEEE Trans, Comput, 49, 2, 127-140.
51. LESLIE, I., MCAULEY, D., BLACK, R., ROSCOE, T., BARHAM, P., EVERS, D., FAIRBAIRNS, R., AND HYDEN, E. 1996. The design and implementation of an operating system to support distributed multimedia applications. IEEE J. Selected Areas in Communication, 14, 7, 1280-1297.
52. LEVY, R., NAGARAJARAO, J., PACIFICI, G., SPREITZER, M., TANTAWI, A., AND YOUSSEF, A. 2003. Per- formance management for cluster based web services. In Proceedings of the IFIP/IEEE 8th International Symposium on Integrated Network Management. IEEE Computer Society Press, Los Alamitos, CA, Vol. 246. 247-261.
53. LI, S. AND JAMIN, S. 2000. A measurement-based admission-controlled web server. In Proceed- ings of the 9th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM2000). IEEE Computer Society Press, Los Alamitos, CA.
54. LIN, C, CHU, H., AND NAHRSTEDT, K. 1998. A soft-real-time scheduling server on the windows NT. In Proceedings of the 2nd USENIX Windows NT Symposium..
55. LITZKOW, M., LIVNY, M., AND MUTKA, M. 1988. Condor-A hunter of idle workstations. In Proceed- ings of the 8th International Conference of Distributed Computing Systems. 104-111.
56. LIU, T.-K., KUMARAN, S., AND LUO, Z. 2001. Layered queueing models for Enterprise Java Beans Applications. Tech. rep., IBM. June.
57. LTT02. The linux toolkit project page. http://www.opensys.com/LTT.
58. MENASCE, D. 2003. Web Server Software Architectures. IEEE Internet Comput. 7.
59. MENASCE, D., ALMEIDA, V., AND DOWDY', L. 2004. Performance by Design: Computer Capacity Plan- ning by Example. Prentice-Hall, Englewood Cliffs, NJ.
60. MENON, A., COX, A., AND ZWAENEPOEL, W. 2006. Optimizing network virtualization in xen. In Pro- ceedings of the USENIX Annual Technical Conference (USENIXΌ6).
61. MENON, A., SANTOS, J., TURNER, Y., JANAKIRAMAN, G., AND ZWAENEPOEL, W. 2005. Diagnosing perfor- mance overheads in the xen virtual machine environment. In Proceedings of the International Conference on Virtual Execution Environments.
62. NELSON, M., LIM, B.-H., AND HUTCHINS, G. 2005. Fast transparent migration for virtual machines. In Proceedings of the 2005 USENIX Annual Technical Conference. 391-394
63. PAPOULIS, A. AND PILLAI, S. 2002. Probability, Random. Variables and Stochastic Processes. McGraw-Hill, Englewood Cliffs, NJ.
64. pgbench 2002. The pgbench man page, postgresql software distribution.
65. PRADHAN, P., TEWARI, R., SAHU, S., CHANDRA, A., AND SHENOY, P. 2002. An observation-based ap- proach towards self-managing web servers. In Proceedings of the 10th International Workshop on Quality of Service (TWQoS 2002). IEEE Computer Society Press, Los Alamitos, CA.
66. RANJAN, S., ROLIA, J., Fu, H., AND KNIGHTLY, E. 2002. QoS-driven server migration for internet data centers. In Proceedings of the 10th International Workshop on Quality of Service (IWQoS). IEEE Computer Society Press, Los Alamitos, CA.
67. ROLIA, J. AND SEVCIK, K. 1995. The method of layers. IEEE Trans. Softw. Eng. 21, 8, 689-700.
68. ROSCOE, T. AND LYLES, B. 2000. Distributing computing without DPEs: Design considerations for public computing platforms. In Proceedings of the 9th ACM SIGOPS European Workshop. ACM, New York.
69. SAITO, Y., BERSHAD, B., AND LEVY, H. 1999. Manageability, availability and performance in por- cupine: A highly scalable, cluster-based mail service. In Proceedings of the 17th Symposium on Operating Systems Principles (SOSP'99). ACM, New York.
70. SAPUNTZAKIS, C, CHANDRA, R., PFAFF, B., CHOW, J., LAM, M. S., AND ROSENBLUM, M. 2002. Optimizing the migration of virtual computers. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation.
71. Sgi99 1999. React: Irix real-time extensions, http://www.sgi.com/ software/react.
72. SHENDE, S., MALONY, A., CUNY, J., LINDLAN, K., BECKMAN, P., AND KARMESIN, S. 1998. Portable profiling and tracing for parallel scientific applications using C++. In Proceedings of ACM SIGMETRICS Symposium on Parallel and Distributed Tools (SPDT). ACM, New York. 134-145.
73. SHENOY, P. AND VIN, H. 1998. Cello: A disk scheduling framework for next generation operating systems. In Proceedings of ACM SIGMETRICS Conference. ACM, New York. 44-55.
74. SLOTHOUBER, L. 1996. A model of web server performance. In Proceedings of the 5th International World Wide Web Conference.
75. SMITH, B. C, LEIMKUHLER, J. F., AND DARROW, R. M. 1992. Yield management at American Airlines. Interfaces, 22, 1, 8-31.
76. SPECWeb99. The Standard Performance Evaluation Corporation (SPEC), http://www.spec.org/.
77. STEWART, C. AND SHEN, K. 2005. Performance modeling and system management for multi- component online services. In Proceedings of the 2nd Symposium on Networked Systems Design and Implementation.
78. Sun98b 1998. Solaris resource manager 1.0: Controlling system resources effectively. http://www.sun.com/software/white-papers/wp-srm.
79. SUNDARAM, V., CHANDRA, A., GOYAL, P., SHENOY, P., SAHNI, J., AND VIN, H. 2000. Application perfor- mance in the QLinux multimedia operating system. In Proceedings of the 8th ACM Conference on Multimedia.. ACM, New York.
80. TANG, P. AND TAI, T. 1999. Network traffic characterization using token bucket model. In Proceed- ings of IEEE Infocom'99. IEEE Computer Society Press, Los Alamitos, CA.
81. URGAONKAR, B., PACIFICI, G., SHENOY, P., SPREITZER, M., AND TANTAWI, A. 2005a. An analytical model for multi-tier internet services and its applications. In Proceedings of the ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS 2005). ACM, New York.
82. URGAONKAR, B. AND SHENOY, P. 2004a. Cataclysm: Handling extreme overloads in internet ser- vices. In Proceedings of the 23rd Annual ACM SIGACT-S1GOPS Symposium on Principles of Distributed Computing (PODC2004). ACM, New York.
83. URGAONKAR, B. AND SHENOY, P. 2004b. Share: Managing CPU and network bandwidth in shared Clusters. IEEE Transactions on Parallel and Distributed Systems, 15, 1, 2-17.
84. URGAONKAR, B. SHENOY, P., CHANDRA, A., AND GOYAL, P. 2005b. Dynamic provisioning of multi-tier internet applications. In Proceedings of the 2nd IEEE International Conference on Autonomic Computing (ICAC-05). IEEE Computer Society Press, Los Alamitos, CA.
85. URGAONKAR, B., SHENOY, P., AND ROSCOE, T. 2002. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the 5th USENIX Symposium on Operating Systems Design and Implementation (OSDI2002).
86. VERGHESE, B., GUPTA, A., AND ROSENBLUM, M. 1998. Performance isolation: Sharing and isolation in shared-memory multiprocessors. In Proceedings of ASPLOS-VIΠ-. 181-192.
87. VERMA, A. AND ANAND, A. 2006. On store placement for response time minimization in parallel disks. In Proceedings oflCDCSΌ, 31.
88. VERMA, A. AND GHOSAL, S. 2003. On admission control for profit maximization of networked service providers. In Proceedings of the 12th International World Wide Web Conference (WWW2003).
89. VILLELA, D., PRADHAN, P., AND RUBENSTEIN, D. 2004. Provisioning servers in the application tier fore-commerce systems. In Proceedings of the 12th International Workshop on Quality of Service (IWQoS). IEEE Computer Society Press, Los Alamitos, CA.
90. VIN, H. M., GOYAL, P., GOYAL, A., AND GOYAL, A. 1994. A statistical admission control algorithm for multimedia servers. In Proceedings of the ACM Multimedia'94. ACM, New York, 33-40.
91. VOIGT, T, TEWARI, R., FREIMUTH, D., AND MEHRA, A. 2001. Kernel mechanisms for service differ- rentiation in overloaded web servers. In Proceedings of USENIX Annual Technical Conference.
92. WALDSPURGER, C. 2002. Memory resource management in VMWare ESX server. In Proceedings of the 5th Symposium on Operating System Design and Implementation (OSDγ02).
93. WALDSPURGER, C. A. AND WEIHL, W. E. 1994. Lottery scheduling: Flexible proportional-share re- source management. In Proceedings of the USENIX Symposium on Operating System Design and Implementation (OSDγ94).
94. WELSH, M. AND CULLER, D. 2003. Adaptive overload control for busy internet servers. In Proceed- ings of the 4th USENIX Conference on Internet Technologies and Systems (USITSΌ3) .
95. WHITAKER, A., SHAW, M., AND GRIBBLE, S. D. 2002. Scale and performance in the denali isolation kernel. In Proceedings of the 5th Symposium on Operating System Design and Implementation (OSDγ02).
96. WOODSIDE, C. AND RAGHUNATH, G. 1995. General bypass architecture for high-performance dis- tributed algorithms. In Proceedings of the 6th IFIP Conference on Performance of Computer Net- works.
97. WSLA. Web service level agreements (wsla) project, http://www.research. ibm.com/wsla.
98. Xu, J., OUFIMTSEV, A., WOODSIDE, M., AND MURPHY, L. 2006. Performance modeling and predic- tion of enterprise JavaBeans with layered queuing network templates. SIGSOFT Softw. Eng. Notes 31, 2.
99. Xu, W, BODIK, P., AND PATTERSON, D. 2004. A flexible architecture for statistical learning and data mining from system log streams. In Proceedings of Workshop on Temporal Data Mining: Algorithms, Theory and Applications at the 4th IEEE International Conference on Data Mining (ICDMΌ4).
100. ZHANG, J., SIVASUBRAMANIAM, A., RISKA, A., WANG, Q., AND RIEDEL, E. 2005a. An interposed 2-level I/O scheduling framework for performance virtualization. In Proceedings of the ACM Interna- tional Conference on Measurement and Modeling of Computer Systems (SIGMETRICS 2005). ACM, New York.
101. ZHANG, J., SIVASUBRAMANIAM, A., WANG, Q., RISKA, A., AND RIEDEL, E. 2005b. Storage performance virtualization via throughput and latency control. In Proceedings of MASCOTS.