Cake: Enabling high-level SLOs on shared storage systems

Proceedings of the 3rd ACM Symposium on Cloud Computing, SoCC 2012

Volumn , Issue , 2012, Pages

  Wang, Andrew ^a   Venkataraman, Shivaram ^a   Alspaugh, Sara ^a   Katz, Randy ^a   Stoica, Ion ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Consolidation; Service level objectives; Storage systems; Two level scheduling

Indexed keywords

APPLICATION PROGRAMMERS; BOUNDED LATENCY; CHANGING WORKLOAD; COMPLETION TIME; DISTRIBUTED STORAGE; HIGH THROUGHPUT; MULTI-RESOURCE; PERFORMANCE REQUIREMENTS; PERFORMANCE SPECIFICATIONS; SCHEDULING PARAMETERS; SECOND-LEVEL; SERVICE LEVEL OBJECTIVE; SHARED STORAGE; STORAGE SYSTEMS; TWO-LEVEL SCHEDULING;

CLOUD COMPUTING; CONSOLIDATION;

SCHEDULING;

EID: 84870502467     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2391229.2391243     Document Type: Conference Paper

References (41)

1. Hadoop distributed file system. http://hadoop.apache.org/hdfs.
2. Hbase. http://hbase.apache.org.
3. The Apache Cassandra Project. http://cassandra.apache.org/.
4. J. Appavoo, A. Waterland, D. Da Silva, V. Uhlig, B. Rosenburg, E. Van Hensbergen, J. Stoess, R. Wisniewski, and U. Steinberg. Providing a cloud network infrastructure on a supercomputer. In HPDC '10, Chicago, IL.
5. M. Armbrust, A. Fox, D. A. Patterson, N. Lanham, B. Trushkowsky, J. Trutna, and H. Oh. SCADS: Scale-Independent Storage for Social Computing Applications. In CIDR, Asilomar, CA, 2009.
6. L. A. Barroso. Warehouse-Scale Computing: Entering the Teenage Decade. In ISCA '11, San Jose, USA.
7. D. Borthakur, J. Gray, J. S. Sarma, K. Muthukkaruppan, N. Spiegelberg, H. Kuang, K. Ranganathan, D. Molkov, A. Menon, S. Rash, R. Schmidt, and A. Aiyer. Apache Hadoop goes Realtime at Facebook. In SIGMOD '11, Athens, Greece.
8. L. S. Brakmo and L. L. Peterson. TCP Vegas: End to End congestion avoidance on a global Internet. IEEE Journal on Selected Areas in Communications, 13(8):1465-1480, Oct. 1995.
9. J. Bruno, J. Brustoloni, E. Gabber, B. Ozden, and A. Silberschatz. Disk Scheduling with Quality of Service Guarantees. In IEEE International Conference on Multimedia Computing an Systems (ICMCS '99), pages 400-405, 1999.
10. D. D. Chambliss, G. A. Alvarez, P. Pandey, D. Jadav, J. Xu, R. Menon, and T. P. Lee. Performance virtualization for large-scale storage systems. In 22th International Symposium on Reliable Distributed Systems (SRDS03), pages 109-118, 2003.
11. F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. Gruber. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems, 26(2):4, 2008.
12. B. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. PNUTS: Yahoo!'s hosted data serving platform. In VLDB 2008, Auckland, NZ.
13. J. Dean and L. Barroso. http://research.google.com/people/jeff/latency. html, March 26, 2012.
14. A. Ferguson, P. Bodik, S. Kandula, E. Boutin, and R. Fonseca. Jockey: Guaranteed Job Latency in Data Parallel Clusters. In EuroSys '12, Bern, Switzerland.
15. G. Ananthanarayanan, A. Ghodsi, A. Wang, S. Shenker, I. Stoica. PACMan: Coordinated Memory Caching for Parallel Jobs. In NSDI '12, San Jose, CA, 2012.
16. A. Ganapathi, Y. Chen, A. Fox, R. H. Katz, and D. A. Patterson. Statistics-driven workload modeling for the cloud. In ICDE '10, Long Beach, CA.
17. * storage: Brick-based storage with automated administration. Technical Report CMU-CS-03-178, Carnegie Mellon University, 2003.
18. A. Ghodsi, V. Sekar, M. Zaharia, and I. Stoica. Multi-resource fair queuing for packet processing. In SIGCOMM'12, Helsinki, Finland, 2012.
19. A. Ghodsi, M. Zaharia, B. Hindman, A. Konwinski, S. Shenker, and I. Stoica. Dominant resource fairness: fair allocation of multiple resource types. In NSDI'11, Boston, MA, 2011.
20. P. Goyal, H. Vin, and H. Cheng. Start-time fair queueing: A Scheduling Algorithm for Integrated services Packet Switching Networks. Networking, IEEE/ACM Transactions on, 5(5):690-704, Oct 1997.
21. A. Gulati, I. Ahmad, and C. Waldspurger. PARDA: Proportional allocation of resources for distributed storage access. In FAST'09, pages 85-98, San Jose, CA, 2009.
22. A. Gulati, C. Kumar, I. Ahmad, and K. Kumar. BASIL: Automated IO load balancing across storage devices. In FAST '10, San Jose.
23. A. Gulati, A. Merchant, and P. Varman. mClock: Handling Throughput Variability for Hypervisor IO Scheduling. In OSDI '10, Vancouver, Canada.
24. J. Hamilton. The cost of latency. http://perspectives.mvdirona.com/2009/ 10/31/TheCostOfLatency.aspx.
25. Y. Izrailevsky. NoSQL at Netflix. http://techblog.netflix.com/2011/01/ nosql-at-netflix.html.
26. V. Jacobson. Congestion avoidance and control. SIGCOMM Computer Communication Review, 25(1):157-187, Jan. 1995.
27. C. R. Lumb, A. Merchant, and G. A. Alvarez. Facade: Virtual storage devices with performance guarantees. In FAST'03, pages 131-144, San Francisco, CA, 2003.
28. H. V. Madhyastha, J. C. McCullough, G. Porter, R. Kapoor, S. Savage, A. C. Snoeren, and A. Vahdat. scc: Cluster Storage Provisining Informed by Application Characteristics and SLAs. In FAST'12, San Jose, USA.
29. A. Merchant, M. Uysal, P. Padala, X. Zhu, S. Singhal, and K. Shin. Maestro: Quality-of-Service in Large Disk Arrays. In ICAC '11, pages 245-254, Karlsruhe, Germany.
30. M. P. Mesnier and J. B. Akers. Differentiated storage services. SIGOPS Operating Systems Review, 45(1):45-53, Feb. 2011.
31. P. Padala, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem. Adaptive control of virtualized resources in utility computing environments. In EuroSys '07, pages 289-302, Lisbon, Portugal, 2007.
32. E. Schurman and J. Brutlag. The user and business impact of server delays, additional bytes, and http chunking in web search, 2009.
33. P. J. Shenoy and H. M. Vin. Cello: A disk scheduling framework for next generation operating systems. In ACM SIGMETRICS 1997, pages 44-55.
34. G. Soundararajan and C. Amza. Towards End-to-End Quality of Service: Controlling I/O Interference in Shared Storage Servers. In Middleware 2008, volume 5346, pages 287-305.
35. G. Soundararajan, D. Lupei, S. Ghanbari, A. D. Popescu, J. Chen, and C. Amza. Dynamic resource allocation for database servers running on virtual storage. In FAST '09, pages 71-84, San Francisco, California, 2009.
36. B. Trushkowsky, P. Bodik, A. Fox, M. Franklin, M. Jordan, and D. Patterson. The SCADS Director: Scaling a distributed storage system under stringent performance requirements. In FAST 2011, pages 163-176.
37. M. Wachs, M. Abd-El-Malek, E. Thereska, and G. R. Ganger. Argon: performance insulation for shared storage servers. In FAST '07, San Jose, CA, 2007.
38. C. A. Waldspurger. Lottery and Stride Scheduling: Flexible Proportional-Share Resource Management. Technical Report MIT-LCS-TR-667, MIT, Laboratory for Computer Science, 1995.
39. A. Wang, S. Venkataraman, S. Alspaugh, I. Stoica, and R. Katz. Sweet storage SLOs with Frosting. In HotCloud 2012, Boston, MA.
40. C. Wilson, H. Ballani, T. Karagiannis, and A. Rowtron. Better never than late: meeting deadlines in datacenter networks. In ACM SIGCOMM 2011, pages 50-61.
41. D. Zats, T. Das, P. Mohan, D. Borthakur, and R. Katz. DeTail: reducing the flow completion time tail in datacenter networks. In ACM SIGCOMM 2012, pages 139-150, Helsinki, Finland.