QoS-aware scheduling in heterogeneous datacenters with paragon

ACM Transactions on Computer Systems

Volumn 31, Issue 4, 2013, Pages

  Delimitrou, Christina ^a   Kozyrakis, Christos ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Cloud computing; Datacenter; Heterogeneity; Interference; QoS; Resource efficiency; Scheduling

Indexed keywords

ADMISSION CONTROL PROTOCOLS; COLLABORATIVE FILTERING TECHNIQUES; DATACENTER; HETEROGENEITY; PERFORMANCE DEGRADATION; QUALITY OF SERVICE (QOS) GUARANTEES; RESOURCE EFFICIENCIES; ROBUST ANALYTICAL METHODS;

CLOUD COMPUTING; QUALITY OF SERVICE; WAVE INTERFERENCE;

SCHEDULING;

EID: 84891749429     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/2556583     Document Type: Article

References (65)

1. ALAMELDEEN, A. R. AND WOOD, D. A. 2006. IPC considered harmful for multiprocessor workloads. IEEE Micro(Special Issue on Computer Architecture Simulation and Modeling).
2. AMAZON EC2. http://aws.amazon.com/ec2/.
3. BANGA, G., DRUSCHEL, P., AND MOGUL, J. C. 1999. Resource containers: A new facility for resource management in server systems. In Proceedings of the Third Symposium on Operating Systems Design and Implementation (OSDI).
4. BARROSO, L. 2011. Warehouse-scale computing: entering the teenage decade. In Proceedings of ISCA.
5. BARROSO, L. AND HOELZLE, U. 2009. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan and Claypool.
6. BELL, R. M., KOREN, Y., AND VOLINSKY, C. 2007. The BellKor 2008 solution to the Netflix Prize. Tech. rep., AT&T Labs.
7. BERTSIMAS, D., GAMARNIK, D., AND TSITSIKLIS, J. N. 2001. Performance of multiclass Markovian queueing networks via piecewise linear Lyapunov functions. Ann. Appl. Probab. 11, 1384-1428. (Pubitemid 33571766)
8. BIENIA, C., KUMAR, S., SINGH, J. P., AND LI, K. 2008. The PARSEC benchmark suite: Characterization and architectural implications. In Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques (PACT).
9. BOTTOU, L. 2010. Large-scale machine learning with stochastic gradient descent. In Proceedings of the International Conference on Computational Statistics (COMPSTAT).
10. CALDER, B., WANG, J., OGUS, A., NILAKANTAN, N., SKJOLSVOLD, A., MCKELVIE, S., XU, Y., SRIVASTAV, S., WU, J., SIMITCI, H., HARIDAS, J., UDDARAJU, C., KHATRI, H., EDWARDS, A., BEDEKAR, V., MAINALI, S., ABBASI, R., AGARWAL, A., UL HAQ, M. F., UL HAQ, M. I., BHARDWAJ, D., DAYANAND, S., ADUSUMILLI, A., MCNETT, M., SANKARAN, S., MANIVANNAN, K., AND RIGAS, L. 2011. Windows Azure storage: A highly available cloud storage service with strong consistency. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP).
11. CHASE, J., ANDERSON, D., THAKAR, P., VAHDAT, A., AND DOYLE, R. 2001. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP).
12. CRAEYNEST, K. V., JALEEL, A., EECKHOUT, L., NARVAEZ, P., AND EMER, J. 2012. Scheduling heterogeneous multicores through performance impact estimation (PIE). In Proceedings of the International Symposium on Computer Architecture (ISCA).
13. DAI, J. G. 1995. On positive Harris recurrence of multiclass queueing networks: A unified approach via fluid limit models. Ann. Appl. Probab. 5, 49-77.
14. DAI, J. G. 1996. A fluid-limit model criterion for instability of multiclass queueing networks. Ann. Appl. Probab. 6, 751-757.
15. DELIMITROU, C. AND KOZYRAKIS, C. 2013a. iBench: Quantifying interference for datacenter applications. In Proceedings of the IEEE International Symposium on Workload Characterization (IISWC).
16. DELIMITROU, C. AND KOZYRAKIS, C. 2013b. Paragon: QoS-aware scheduling for heterogeneous datacenters. In Proceedings of the 18th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).
17. DELIMITROU, C. AND KOZYRAKIS, C. 2013c. The Netflix challenge: Datacenter edition. IEEE Comput. Archit.Lett. (June).
18. FEDOROVA, A., SELTZER, M., AND SMITH, M. D. 2007. Improving performance isolation on chip multiprocessors via an operating system scheduler. In Proceedings of the 16th International Conference on Parallel Architecture and Compilation Techniques (PACT).
19. GAMARNIK, D. 2000. On deciding stability of scheduling policies in queuing systems. In Proceedings of the 11th Annual ACM-SIAM Symposium on Discrete Algorithms. 467-476. (Pubitemid 30549290)
20. GOOGLE COMPUTE ENGINE GCE. http://cloud.google.com/products/compute- engine.html.
21. GHODSI, A., ZAHARIA, M., HINDMAN, B., KONWINSKI, A., SHENKER, S., AND STOICA, I. 2011. Dominant resource fairness: Fair allocation of multiple resource types. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI).
22. GMACH, D., ROLIA, J., CHERKASOVA, L., AND KEMPER, A. 2007.Workload analysis and demand prediction of enterprise data center applications. In Proceedings of the 10th IEEE International Symposium on Workload Characterization (IISWC).
23. GOVINDAN, S., LIU, J., KANSAL, A., AND SIVASUBRAMANIAM, A. 2011. Cuanta: Quantifying effects of shared on-chip resource interference for consolidated virtual machines. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SOCC).
24. HAMILTON, J. 2009. Internet-scale service infrastructure efficiency. In Proceedings of the 37th International Symposium on Computer Architecture (ISCA).
25. HAMILTON, J. 2010. Cost of power in large-scale data centers. http://perspectives.mvdirona.com.
26. HASENBEIN, J. J. 1998. Stability, capacity, and scheduling of multiclass queuing networks. Ph.D. dissertation, Georgia Institute of Technology.
27. HINDMAN, B., KONWINSKI, A., ZAHARIA, M., GHODSI, A., JOSEPH, A. D., KATZ, R., SHENKER, S., AND STOICA, I. 2011. Mesos: A platform for fine-grained resource sharing in the data center. In Proceedings of the 8th USENIX Symposium on Networked Systems Design and Implementation (NSDI).
28. JALEEL, A., MATTINA, M., AND JACOB, B. L. 2006. Last level cache (LLC) performance of data mining workloads on a CMP-A case study of parallel bioinformatics workloads. In Proceedings of the 12th International Symposium on High-Performance Computer Architecture (HPCA-12).
29. KATZ, J. AND LINDELL, Y. 2007. Introduction to Modern Cryptography. Chapman & Hall/CRC Press.
30. KIWIEL, K. C. 2001. Convergence and efficiency of subgradient methods for quasiconvex minimization. Math. Program. (Series A), 90, 1, 1-25. (Pubitemid 33758930)
31. KOZYRAKIS, C., KANSAL, A., SANKAR, S., AND VAID, K. 2010. Server engineering insights for large-scale online services. IEEE Micro 30, 4, 8-19. DOI:http://dx.doi.org/10.1109/MM.2010.73.
32. LEVERICH, J. AND KOZYRAKIS, C. 2010. On the energy (in)efficiency of Hadoop clusters. SIGOPS Oper. Syst. Rev. 44, 1, 61-65.
33. LIN, J. AND KOLCZ, A. 2012. Large-scale machine learning at Twitter. In Proceedings of the ACM SIGMOD Conference.
34. MARS, J. AND TANG, L. 2013. Whare-map: heterogeneity in "homogeneous" warehouse-scale computers. In Proceedings of the 40th Annual International Symposium on Computer Architecture (ISCA).
35. MARS, J., TANG, L., AND HUNDT, R. 2011. Heterogeneity in "homogeneous"; warehouse-scale computers: A performance opportunity. IEEE Comput. Archit. Lett. 10, 2, 29-32. DOI:http://dx.doi.org/10.1109/LCA. 2011.14.
36. MEISNER, D., SADLER, C. M., BARROSO, L. A., WEBER, W.-D., AND WENISCH, T. F. 2011. Power management of online data-intensive services. In Proceedings of the 38th Annual International Symposium on Computer Architecture (ISCA).
37. MILLER, B. L. 1969. A queuing reward system with several customer classes. Manage. Sci. 16, 3, 234-245.
38. NARAYANAN, R., OZISIKYILMAZ, B., ZAMBRENO, J., MEMIK, G., AND CHOUDHARY, A.N. 2006. MineBench: A benchmark suite for data mining workloads. In Proceedings of the 9th IEEE International Symposium on Workload Characterization (IISWC).
39. NATHUJI, R., ISCI, C., AND GORBATOV, E. 2007. Exploiting platform heterogeneity for power efficient data centers. In Proceedings of the International Conference on Autonomic Computing (ICAC).
40. NATHUJI, R., KANSAL, A., AND GHAFFARKHAH, A. 2010. Q-Clouds: Managing performance interference effects for QoS-aware clouds. In Proceedings of the European Conference on Computer Systems (EuroSys'10).
41. NOVAKOVI ̀C, D., VASÌC, N., NOVAKOVÌC, S., KOSTÌC, D., AND BIANCHINI, R. 2013. Deep Dive: Transparently identifying and managing performance interference in virtualized environments. In Proceedings of the USENIX Annual Technical Conference (ATC).
42. RACKSPACE. Open Cloud. http://www.rackspace.com/.
43. RAJARAMAN, A. AND ULLMAN, J. 2011. Textbook on Mining of Massive Datasets. Rightscale. https://aws.amazon.com/solution-providers/isv/rightscale.
44. SANCHEZ, D. AND KOZYRAKIS, C. 2011. Vantage: Scalable and efficient fine-grain cache partitioning. In Proceedings of the 38th Annual International Symposium in Computer Architecture (ISCA-38).
45. SCHEIN, A., POPESCUL, A., UNGAR, L., AND PENNOCK, D. 2002. Methods and metrics for cold-start recommendations. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR).
46. SCHWARZKOPF, M., KONWINSKI, A., ABD-EL-MALEK, M., AND WILKES, J. 2013. Omega: Flexible, scalable schedulers for large compute clusters. In Proceedings of the 8th ACM European Conference on Computer Systems(EuroSys'13).
47. SHELEPOV, D., ALCAIDE, J. C. S., JEFFERY, S., FEDOROVA, A., PEREZ, N., HUANG, Z. F., BLAGODUROV, S., AND KUMAR, V. 2009. HASS: A scheduler for heterogeneous multicore systems. SIGOPS Oper. Syst. Rev. 43, 2.
48. SHEN, Z., SUBBIAH, S., GU, X., AND WILKES, J. 2011. CloudScale: elastic resource scaling for multi-tenant cloud systems. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SOCC).
49. SUN, J., XIE, Y., ZHANG, H., AND FALOUTSOS, C. 2008. Less is more: Compact matrix decomposition for large sparse graphs. J. Stat. Anal. Data Mining 1, 1.
50. TANENBAUM, A. S. 2007. Modern Operating Systems. 3rd Ed. Peason Education, Inc.
51. VASÍC, N., NOVAKOVÍC, D., MIUCIN, S., KOSTÍC, D., AND BIANCHINI, R. 2012. Deja vu: accelerating resource allocation in virtualized environments. In Proceedings of the 17th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).
52. VMOTION. Migrate VMs with Zero Downtime. http//www.vmware.com/products/ vmotion.
53. VMWARE-DRS. 2012. Distributed resource scheduler: design, implementation and lessons learned. VMware Tech. J. 1, 1.
54. VMWARE VSPHERE. http://www.vmware.com/products/vsphere/.
55. WENG, L.-T., YUE, X., YUEFENG, L., AND NAYAK, R. 2008. Exploiting item taxonomy for solving cold-start problem in recommendation making. In Proceedings of the 20th IEEE International Conference on Tools with Artificial Intelligence (ICTAI).
56. WENISCH, T. F., WUNDERLICH, R. E., FERDMAN, M., AILAMAKI, A., FALSAFI, B., AND HOE, J. C. 2006. SimFlex: Statistical sampling of computer system simulation. IEEE MICRO 26, 4.
57. WINDOWS AZURE. http://www.windowsazure.com/.
58. WITTEN, I. H., FRANK, E., AND HOLMES, G. 2011. Data Mining: Practical Machine Learning Tools and Techniques.3rd Ed.
59. WOO, S. C., OHARA, M., TORRIE, E., SINGH, J. P., AND GUPTA, A. 1995. The SPLASH-2 programs: Characterization and methodological considerations. In Proceedings of the 22nd International Symposium on Computer Architecture (ISCA).
60. XENSERVER. 6.1. http://www.citrix.com/xenserver/.
61. YANG, H., BRESLOW, A., MARS, J., AND TANG, L. 2013. Bubble-flux: Precise online QoS management for increased utilization in warehouse scale computers. In Proceedings of the 40th Annual International Symposium on Computer Architecture (ISCA).
62. ZAHARIA, M., CHOWDHURY, M., DAS, T., DAVE, A., MA, J., MCCAULEY, M., FRANKLIN, M. J., SHENKER, S., AND STOICA, I. 2012. Spark: Cluster computing with working sets. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI).
63. ZHANG, X., TUNE, E., HAGMANN, R., JNAGAL, R., GOKHALE, V., AND WILKES, J. 2013. CPI2: CPU performance isolation for shared compute clusters. In Proceedings of the 8th ACM European Conference on Computer Systems (EuroSys'13).
64. ZHANG, Z.-K., LIU, C., ZHANG, Y.-C., AND ZHOU, T. 2010. Solving the cold-start problem in recommender systems with social tags. arXiv:1004.3732v2.
65. ZHU, X., YOUNG, D., WATSON, B. J., WANG, Z., ROLIA, J., SINGHAL, S., MCKEE, B., HYSER, C., GMACH, D., GARDNER, R., CHRISTIAN, T., AND CHERKASOVA, L. 2009. 1000 Islands: An integrated approach to resource management for virtualized datacenters. J. Cluster Comput. 12, 1.