Ginseng: Market-driven LLC allocation

Proceedings of the 2016 USENIX Annual Technical Conference, USENIX ATC 2016

Volumn , Issue , 2016, Pages 295-308

  Funaro, Liran ^a   Ben Yehuda, Orna Agmon ^a   Schuster, Assaf ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

CACHE ALLOCATION; CACHE POLLUTION; CLOUD PROVIDERS; DYNAMIC ALGORITHM; HARDWARE UTILIZATION; LAST-LEVEL CACHES; PHYSICAL RESOURCES; STATE OF THE ART;

EID: 85077514497     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (66)

1. AGMON BEN-YEHUDA, O., BEN-YEHUDA, M., SCHUSTER, A., AND TSAFRIR, D. The resource-as-a-service (RaaS) cloud. In Proceedings of the 4th USENIX Conference on Hot Topics in Cloud Computing (HotCloud) (2012), USENIX Association.
2. AGMON BEN YEHUDA, O., BEN YEHUDA, M., SCHUSTER, A., AND TSAFRIR, D. Deconstructing Amazon EC2 spot instance pricing. ACM Transactions on Economics and Computation (TEAC) 1, 3 (2013).
3. AGMON BEN-YEHUDA, O., BEN-YEHUDA, M., SCHUSTER, A., AND TSAFRIR, D. The rise of RaaS: The resource-as-aservice cloud. Communications of the ACM 57, 7 (2014), 76-84.
4. AGMON BEN-YEHUDA, O., POSENER, E., BEN-YEHUDA, M., SCHUSTER, A., AND MU'ALEM, A. Ginseng: Market-driven memory allocation. In Proceedings of the 10th ACM SIGPLAN/ SIGOPS International Conference on Virtual Execution Environments (VEE) (2014), ACM, pp. 41-52.
5. AGMON BEN-YEHUDA, O., SCHUSTER, A., SHAROV, A., SILBERSTEIN, M., AND IOSUP, A. ExPERT: Pareto-efficient task replication on grids and a cloud. In IEEE 26th International Parallel & Distributed Processing Symposium (IPDPS) (2012), IEEE, pp. 167-178.
6. ALBONESI, D. H. Selective cache ways: on-demand cache resource allocation. In Proceedings of the 32nd Annual International Symposium on Microarchitecture (MICRO-32) (1999), IEEE, pp. 248-259.
7. ARMBRUST, M., FOX, A., GRIFFITH, R., JOSEPH, A. D., KATZ, R., KONWINSKI, A., LEE, G., PATTERSON, D., RABKIN, A., STOICA, I., AND ZAHARIA, M. A view of cloud computing. Communications of the ACM 53, 4 (2010), 50-58.
8. BUGNION, E., ANDERSON, J. M., MOWRY, T. C., ROSENBLUM, M., AND LAM, M. S. Compiler-directed page coloring for multiprocessors. In Proceedings of the Seventh International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (1996), ACM, pp. 244-255.
9. CHIOU, D., JAIN, P., RUDOLPH, L., AND DEVADAS, S. Application-specific memory management for embedded systems using software-controlled caches. In Proceedings of the 37th Annual Design Automation Conference (DAC) (2000), ACM, pp. 416-419.
10. CLARKE, E. Multipart pricing of public goods. Public Choice 11, 1 (1971), 17-33.
11. DREXLER, K. E., AND MILLER, M. S. Incentive engineering for computational resource management. The Ecology of Computation 2 (1988), 231-266.
12. DYBDAHL, H., AND STENSTR ÖM, P. Enhancing last-level cache performance by block bypassing and early miss determination. In Advances in Computer Systems Architecture, C. Jesshope and C. Egan, Eds., vol. 4186 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2006, pp. 52-66.
13. FUNARO, L., AGMON BEN-YEHUDA, O., AND SCHUSTER, A. Ginseng: Market-driven LLC allocation. Tech. rep., Technion-Israel Institute of Technology, 2016. http://www.cs.technion.ac.il/users/wwwb/cgi-bin/trinfo. cgi/2016/CS/CS-2016-03.
14. GONZÁLEZ, A., ALIAGAS, C., AND VALERO, M. A data cache with multiple caching strategies tuned to different types of locality. In ACM International Conference on Supercomputing 25th Anniversary Volume (2014), ACM, pp. 217-226.
15. GORDON, A., HINES, M., DA SILVA, D., BEN-YEHUDA, M., SILVA, M., AND LIZARRAGA, G. Ginkgo: Automated, application-driven memory overcommitment for cloud computing. In 3rd IEEE International Conference on Cloud Computing Technology and Science (CloudCom) (2011).
16. GOVINDAN, S., LIU, J., KANSAL, A., AND SIVASUBRAMANIAM, A. Cuanta: Quantifying effects of shared on-chip resource interference for consolidated virtual machines. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SOCC) (2011), ACM.
17. GROVES, T. Incentives in teams. Econometrica: Journal of the Econometric Society (1973), 617-631.
18. GUO, F., SOLIHIN, Y., ZHAO, L., AND IYER, R. Quality of service shared cache management in chip multiprocessor architecture. ACM Transactions on Architecture and Code Optimization (TACO) 7, 3 (2010).
19. GUO, R., LIAO, X., JIN, H., YUE, J., AND TAN, G. Night- Watch: Integrating lightweight and transparent cache pollution control into dynamic memory allocation systems. In Proceedings of the USENIX Technical Annual Conference (2015), USENIX Association, pp. 307-318.
20. GUPTA, D., CHERKASOVA, L., GARDNER, R., AND VAHDAT, A. Enforcing performance isolation across virtual machines in Xen. In Middleware (2006), M. van Steen and M. Henning, Eds., vol. 4290 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, pp. 342-362.
21. HASENPLAUGH, W., AHUJA, P. S., JALEEL, A., STEELY, S., AND EMER, J. The gradient-based cache partitioning algorithm. ACM Transactions on Architecture and Code Optimization (TACO) 8, 4 (2012).
22. HEO, J., ZHU, X., PADALA, P., AND WANG, Z. Memory overbooking and dynamic control of Xen virtual machines in consolidated environments. In IFIP/IEEE International Symposium on Integrated Network Management (IM) (2009), IEEE, pp. 630-637.
23. HINES, M. R., GORDON, A., SILVA, M., DA SILVA, D., RYU, K., AND BEN-YEHUDA, M. Applications know best: Performance-driven memory overcommit with Ginkgo. In 2011 IEEE 3rd International Conference on Cloud Computing Technology and Science (CloudCom) (2011), IEEE, pp. 130-137.
24. HUND, R., WILLEMS, C., AND HOLZ, T. Practical timing side channel attacks against kernel space ASLR. In IEEE Symposium on Security and Privacy (SP) (2013), IEEE, pp. 191-205.
25. INTEL. Improving real-time performance by utilizing cache allocation technology. http://www.intel.com/content/www/us/en/communications/cacheallocation- technology-white-paper.html, 2015. Accessed May, 2016.
26. INTEL OPEN SOURCE.ORG. Cache monitoring technology, memory bandwidth monitoring, cache allocation technology & code and data prioritization. https://01.org/packetprocessing/ cache-monitoring-technology-memory-bandwidthmonitoring- cache-allocation-technology-code-and-data. Accessed January, 2016.
27. IYER, R., ZHAO, L., GUO, F., ILLIKKAL, R., MAKINENI, S., NEWELL, D., SOLIHIN, Y., HSU, L., AND REINHARDT, S. QoS policies and architecture for cache/memory in CMP platforms. In Proceedings of the ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) (2007), vol. 35, ACM, pp. 25-36.
28. JAIN, P., DEVADAS, S., AND RUDOLPH, L. Controlling cache pollution in prefetching with software-assisted cache replacement. Comptation Structures Group, Laboratory for Computer Science CSG Memo 462 (2001).
29. JEONG, M. K., EREZ, M., SUDANTHI, C., AND PAVER, N. A QoS-aware memory controller for dynamically balancing GPU and CPU bandwidth use in an MPSoC. In Proceedings of the 49th Annual Design Automation Conference (DAC) (2012), ACM, pp. 850-855.
30. JIN, X., CHEN, H., WANG, X., WANG, Z., WEN, X., LUO, Y., AND LI, X. A simple cache partitioning approach in a virtualized environment. In IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) (2009), IEEE, pp. 519-524.
31. JOHNSON, T., CONNORS, D., MERTEN, M., AND HWU, W. Run-time cache bypassing. IEEE Transactions on Computers 48, 12 (1999), 1338-1354.
32. KANG, H., AND WONG, J. L. To hardware prefetch or not to prefetch?: A virtualized environment study and core binding approach. SIGPLAN Not. 48, 4 (2013), 357-368.
33. KASERIDIS, D., STUECHELI, J., AND JOHN, L. K. Bank-aware dynamic cache partitioning for multicore architectures. In International Conference on Parallel Processing (ICPP) (2009), IEEE, pp. 18-25.
34. KASTURE, H., AND SANCHEZ, D. Ubik: Efficient cache sharing with strict QoS for latency-critical workloads. In Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (2014), ACM, pp. 729-742.
35. KIVITY, A., KAMAY, Y., LAOR, D., LUBLIN, U., AND LIGUORI, A. KVM: the Linux virtual machine monitor. In Proceedings of the Linux Symposium (2007), vol. 1, pp. 225-230.
36. KOH, Y., KNAUERHASE, R., BRETT, P., BOWMAN, M., WEN, Z., AND PU, C. An analysis of performance interference effects in virtual environments. In IEEE International Symposium on Performance Analysis of Systems & Software (2007), IEEE, pp. 200-209.
37. LARABEL, M., AND TIPPETT, M. Phoronix test suite. http://www.phoronix-test-suite.com/, 2011. Accessed May, 2015.
38. LAZAR, A. A., AND SEMRET, N. Design and analysis of the progressive second price auction for network bandwidth sharing. Telecommunication Systems-Special issue on Network Economics (1999).
39. LEE, H., CHO, S., AND CHILDERS, B. R. Cloudcache: Expanding and shrinking private caches. In IEEE 17th International Symposium on High Performance Computer Architecture (HPCA) (2011), IEEE, pp. 219-230.
40. LIN, W.-F., AND REINHARDT, S. K. Predicting last-touch references under optimal replacement. Tech. rep., University of Michigan, 2002. CSE-TR-447-02.
41. LO, D., CHENG, L., GOVINDARAJU, R., RANGANATHAN, P., AND KOZYRAKIS, C. Heracles: Improving resource efficiency at scale. In Proceedings of the 42nd Annual International Symposium on Computer Architecture (2015), ACM, pp. 450-462.
42. LU, Q., LIN, J., DING, X., ZHANG, Z., ZHANG, X., AND SADAYAPPAN, P. Soft-OLP: Improving hardware cache performance through software-controlled object-level partitioning. In 18th International Conference on Parallel Architectures and Compilation Techniques (PACT) (2009), IEEE, pp. 246-257.
43. LUCIER, B., LEME, R. P., AND TARDOS, E. On revenue in the generalized second price auction. In Proceedings of the 21st International Conference on the World Wide Web (WWW) (2012), ACM, pp. 361-370.
44. MAILLÉ, P., AND TUFFIN, B. Multi-bid auctions for bandwidth allocation in communication networks. In IEEE INFOCOM (2004).
45. MOVSOWITZ, D., AGMON BEN-YEHUDA, O., AND SCHUSTER, A. Attacks in the resource-as-a-service (RaaS) cloud context. In Distributed Computing and Internet Technology, N. Bjørner, S. Prasad, and L. Parida, Eds., vol. 9581 of Lecture Notes in Computer Science. Springer International Publishing, 2016, pp. 10-18.
46. MURALIDHARA, S. P., SUBRAMANIAN, L., MUTLU, O., KANDEMIR, M., AND MOSCIBRODA, T. Reducing memory interference in multicore systems via application-aware memory channel partitioning. In Proceedings of the 44th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO-44) (2011), ACM, pp. 374-385.
47. NATHUJI, R., KANSAL, A., AND GHAFFARKHAH, A. Qclouds: Managing performance interference effects for QoSaware clouds. In Proceedings of the 5th European Conference on Computer Systems (EuroSys) (2010), ACM, pp. 237-250.
48. NESBIT, K. J., AGGARWAL, N., LAUDON, J., AND SMITH, J. E. Fair queuing memory systems. In 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO-39) (2006), IEEE, pp. 208-222.
49. OU, Z., ZHUANG, H., NURMINEN, J. K., YLÄJÄÄSKI, A., AND HUI, P. Exploiting hardware heterogeneity within the same instance type of Amazon EC2. In 4th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud) (2012).
50. PIQUET, T., ROCHECOUSTE, O., AND SEZNEC, A. Exploiting single-usage for effective memory management. In Asia-Pacific Computer Systems Architecture Conference (2007), Springer, pp. 90-101.
51. POZO, R., AND MILLER, B. Scimark 2.0. http://math.nist.gov/scimark2, 2000. Accessed January, 2016.
52. QURESHI, M. K., JALEEL, A., PATT, Y. N., STEELY, S. C., AND EMER, J. Adaptive insertion policies for high performance caching. In Proceedings of the 34th Annual International Symposium on Computer Architecture (ISCA) (2007), ACM, pp. 381-391.
53. RAFIQUE, N., LIM, W. T., AND THOTTETHODI, M. Architectural support for operating system-driven cmp cache management. In Proceedings of the 15th International Conference on Parallel Architectures and Compilation Techniques (PACT) (2006), ACM, pp. 2-12.
54. RAJ, H., NATHUJI, R., SINGH, A., AND ENGLAND, P. Resource management for isolation enhanced cloud services. In Proceedings of the ACM Workshop on Cloud Computing Security (CCSW) (2009), ACM, pp. 77-84.
55. SANCHEZ, D., AND KOZYRAKIS, C. Vantage: Scalable and efficient fine-grain cache partitioning. ACM SIGARCH Computer Architecture News 39, 3 (2011), 57-68.
56. SCOLARI, A., SIRONI, F., SCIUTO, D., AND SANTAMBROGIO, M. D. A survey on recent hardware and software-level cache management techniques. In IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) (2014), IEEE, pp. 242-247.
57. SHARIFI, A., SRIKANTAIAH, S., MISHRA, A. K., KANDEMIR, M., AND DAS, C. R. METE: Meeting end-to-end QoS in multicores through system-wide resource management. In Proceedings of the ACM Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) (2011), ACM, pp. 13-24.
58. SOARES, L., TAM, D., AND STUMM, M. Reducing the harmful effects of last-level cache polluters with an OS-level, software-only pollute buffer. In Proceedings of the 41st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO 41) (2008), IEEE Computer Society, pp. 258-269.
59. TAYLOR, G., DAVIES, P., AND FARMWALD, M. The TLB slice a low-cost high-speed address translation mechanism. In Proceedings of the 17th Annual International Symposium on Computer Architecture (ISCA) (1990), ACM, pp. 355-363.
60. VICKREY, W. Counterspeculation, auctions, and competitive sealed tenders. The Journal of Finance 16, 1 (1961), 8-37.
61. WALDSPURGER, C. A., HOGG, T., HUBERMAN, B. A., KEPHART, J. O., AND STORN, W. S. Spawn: A distributed computational economy. IEEE Transactions on Software Engineering 18, 2 (1992), 103-117.
62. WANG, X., WEN, X., LI, Y., LUO, Y., LI, X., AND WANG, Z. A dynamic cache partitioning mechanism under virtualization environment. In IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications (Trust- Com) (2012), IEEE, pp. 1907-1911.
63. YAROM, Y., GE, Q., LIU, F., LEE, R. B., AND HEISER, G. Mapping the Intel last-level cache. Tech. rep., Cryptology ePrint Archive, Report 2015/905, 2015.
64. YE, C., BROCK, J., DING, C., AND JIN, H. Rochester elastic cache utility (RECU): Unequal cache sharing is good economics. International Journal of Parallel Programming (2015), 1-15.
65. YE, Y., WEST, R., CHENG, Z., AND LI, Y. Coloris: A dynamic cache partitioning system using page coloring. In Proceedings of the 23rd International Conference on Parallel Architectures and Compilation (PACT) (2014), ACM, pp. 381-392.
66. ZHANG, X., DWARKADAS, S., AND SHEN, K. Towards practical page coloring-based multicore cache management. In Proceedings of the 4th ACM European Conference on Computer Systems (EuroSys) (2009), ACM, pp. 89-102.