Agility and performance in elastic distributed storage

ACM Transactions on Storage

Volumn 10, Issue 4, 2014, Pages

  Xu, Lianghong ^a   Cipar, James ^c   Krevat, Elie ^c   Tumanov, Alexey ^a   Gupta, Nitin ^a   Kozuch, Michael A ^b   Ganger, Gregory R ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b INTEL CORPORATION   (United States)

^c Carnegie Mellon University   (United States)

Author keywords

Agility; Cloud storage; Distributed file systems; Elastic storage; Power; Write offloading

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; ELASTICITY; FILE ORGANIZATION; MULTIPROCESSING SYSTEMS;

AGILITY; CLOUD STORAGES; DISTRIBUTED FILE SYSTEMS; ELASTIC STORAGE; POWER; WRITE OFFLOADING;

DIGITAL STORAGE;

EID: 84908866297     PISSN: 15533077     EISSN: 15533093     Source Type: Journal    
DOI: 10.1145/2668129     Document Type: Conference Paper

References (24)

1. AMPLab. 2013. Algorithms, Machines, People Laboratory, Berkley. http://amplab.cs.berkeley.edu.
2. Hrishikesh Amur, James Cipar, Varun Gupta, Gregory R. Ganger, Michael A. Kozuch, and Karsten Schwan. 2010. Robust and flexible power-proportional storage. In Proceedings of the ACM Symposium on Cloud Computing. 217-228.
3. Peter Bodik, Michael Armbrust, Kevin Canini, Armando Fox, Michael Jordan, and David Patterson. 2008. A Case for Adaptive Datacenters to Conserve Energy and Improve reliability. University of California at Berkeley, Tech. Rep. UCB/EECS-2008-127.
4. Dhruba Borthakur. 2007. The Hadoop Distributed File System: Architecture and Design. The Apache Software Foundation.
5. Randal E. Bryant. 2007. Data-intensive supercomputing: The case for DISC. Tech. rep., Carnegie Mellon University.
6. Fay Chang, Jeffrey Dean, Sanjay Ghemawat,Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber. 2008. BigTable: A distributed storage system for structured data. ACM Trans. Comput. Syst. 26, 2, 1-26.
7. Yanpei Chen, Sara Alspaugh, and Randy Katz. 2012. Interactive analytical processing in big data systems: A cross industry study of MapReduce workloads. Proc. VLDB Endow. 5, 12, 1802-1813.
8. Yanpei Chen, Archana Ganapathi, Rean Griffith, and Randy Katz. 2011. The case for evaluating MapReduce performance using workload suites. In Proceedings of the IEEE 9th International Symposium on Modeling, Analysis & Simulation of Computer and Telecommunication Systems (MASCOTS).
9. Jeffrey Dean and Sanjay Ghemawat. 2008. MapReduce: Simplified data processing on large clusters. Commun. ACM 51, 1, 107-108.
10. Sanjay Ghemawat, Howard Gobioff, and Shun tak Leung. 2003. The Google file system. In Proceedings of the 19th ACM Symposium on Operating System Principles (SOSP). 29-43.
11. Daniel Gmach, Jerry Rolia, Ludmila Cherkasova, and Alfons Kemper. 2007. Workload analysis and demand prediction of enterprise data center applications. In Proceedings of the IEEE 10th International Symposium or Workload Characterization (IISWC).
12. Hadoop. 2012. The Apache Hadoop project. http://hadoop.apache.org.
13. Larry Hardesty. 2012. MIT, Intel unveil new initiatives addressing 'Big Data'. http://web.mit.edu/newsoffice/2012/big-data-csail-intel-center-0531.html.
14. Michael Isard, Vijayan Prabhakaran, Jon Currey, Udi Wieder, Kunal Talwar, and Andrew Goldberg. 2009. Quincy: Fair scheduling for distributed computing clusters. In Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles (SOSP'09). ACM, New York, NY, 261-276.
15. ISTC-CC. 2013. Intel science and technology center - cloud computing. www.istc-cc.cmu.edu.
16. Jacob Leverich and Christos Kozyrakis. 2009. On the energy (in)efficiency of Hadoop clusters. In Proceedings of the Workshop on Power-Aware Computing and System HotPower.
17. Minghong Lin, Adam Wierman, Lachlan L. H. Andrew, and Eno Thereska. 2011. Dynamic right-sizing for power-proportional data centers. In Proceedings of the INFOCOM.
18. Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. 2008a. Write off-loading: Practical power management for enterprise storage. In Proceedings of the USENIX Conference on File and Storage Technologies. USENIX Association, Berkeley, CA, 1-15.
19. Dushyanth Narayanan, Austin Donnelly, Eno Thereska, Sameh Elnikety, and Antony Rowstron. 2008b. Everest: Scaling down peak loads through I/O off-loading. In Proceedings of the 8th USENIX Symposium on Operating Systems and Implementation (OSD).
20. Yasushi Saito, Svend Frølund, Alistair Veitch, Arif Merchant, and Susan Spence. 2004. FAB: Building distributed enterprise disk arrays from commodity components. In Proceedings of the 11th International Conference on Architechtural Support for Programming Languages and Operating System. 48-58.
21. Eno Thereska, Austin Donnelly, and Dushyanth Narayanan. 2011. Sierra: Practical power-proportionality for data center storage. In Proceedings of the 6th Conference on Computer Systems (EuroSys). 169-182.
22. Nedeljko Vasić, Martin Barisits, Vincent Salzgeber, and Dejan Kostic. 2009. Making cluster applications energy-aware. In Proceedings of the Workshop on Automated Control for Datacenters and Clouds. 37-42.
23. Charles Weddle, Mathew Oldham, Jin Qian, An-I AndyWang, Peter L. Reiher, and Geoffrey H. Kuenning. 2007. PARAID: A gear-shifting power-aware RAID. ACM Trans. Storage 3, 3, Article 13.
24. E. R. Zayas. 1991. AFS-3 programmer's reference: Architectural overview. Tech. Rep. Transarc Corporation.