Robust and flexible power-proportional storage

Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC '10

Volumn , Issue , 2010, Pages 217-228

  Amur, Hrishikesh ^a   Cipar, James ^b   Gupta, Varun ^b   Ganger, Gregory R ^b   Kozuch, Michael A ^c   Schwan, Karsten ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c INTEL CORPORATION   (United States)

Author keywords

Cluster computing; Data layout; Power proportionality

Indexed keywords

BUILDING BLOCKES; CLOUD COMPUTING; CLUSTER-BASED STORAGE; DATA LAYOUTS; DATA SETS; DISTRIBUTED FILE SYSTEMS; INTERFERENCE AVOIDANCE; ITS DATA; LARGE-SCALE CLUSTERS; NODE FAILURE; SIMULATION EXPERIMENTS;

ROUGH SET THEORY;

CLUSTER COMPUTING;

EID: 77954916337     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1807128.1807164     Document Type: Conference Paper

References (23)

1. Hadoop. http://hadoop.apache.org.
2. Pig. http://hadoop.apache.org/pig.
3. David G. Andersen, Jason Franklin, Michael Kaminsky, Amar Phanishayee, Lawrence Tan, and Vijay Vasudevan. FAWN: A Fast Array of Wimpy Nodes. In SOSP '09: Proceedings of the 22nd ACM Symposium on Operating Systems Principles, New York, NY, USA, 2009. ACM.
4. Luiz A. Barroso and Urs Hölzle. The Case for Energy-Proportional Computing. Computer, 40(12):33-37, 2007.
5. Adrian M. Caulfield, Laura M. Grupp, and Steven Swanson. Gordon: Using Flash Memory to Build Fast, Power-efficient Clusters for Data-intensive Applications. In ASPLOS '09: Proceeding of the 14th international conference on Arc hitectural support for programming languages and operating systems, pages 217-228, New York, NY, USA, 2009. ACM.
6. Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber. BigTable: A Distributed Storage System for Structured Data. ACM Trans. Comput. Syst., 26(2):1-26, June 2008.
7. Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin M. Vahdat, and Ronald P. Doyle. Managing Energy and Server Resources in Hosting Centers. SIGOPS Oper. Syst. Rev., 35(5):103-116, December 2001.
8. Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI '04: Proceedings of USENIX Conference on Operating Systems Design and Implementation, pages 137-150, 2004.
9. Sanjay Ghemawat, Howard Gobioff, and Shun T. Leung. The Google File System. SIGOPS Oper. Syst. Rev., 37(5):29-43, 2003.
10. Jorge Guerra, Wendy Belluomini, Joseph Gilder, Karan Gupta, and Himabindu Pucha. Energy Proportionality for Storage: Impact and Feasibility. In HotStorage '09: SOSP Workshop on Hot Topics in Storage and File Systems, 2009.
11. Michael Isard, Vijayan Prabhakaran, Jon Currey, Udi Wieder, Kunal Talwar, and Andrew Goldberg. Quincy: Fair Scheduling for Distributed Computing Clusters. In SOSP '09: Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles, pages 261-276, New York, NY, USA, 2009. ACM.
12. Jacob Leverich and Christos Kozyrakis. On the Energy (In)efficiency of Hadoop Clusters. In HotPower '09, Workshop on Power Aware Computing and Systems, 2009.
13. David Meisner, Brian T. Gold, and Thomas F. Wenisch. PowerNap: Eliminating Server Idle Power. In ASPLOS '09: Proceeding of the 14th international conference on Architectural support for programming languages and operating systems, pages 205-216, New York, NY, USA, 2009. ACM.
14. Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. Write Off-Loading: Practical Power Management for Enterprise Storage. In FAST'08: Proceedings of the 6th USENIX Conference on File and Storage Technologies, pages 1-15, Berkeley, CA, USA, 2008. USENIX Association.
15. Dushyanth Narayanan, Austin Donnelly, Eno Thereska, Sameh Elnikety, and Antony Rowstron. Everest: Scaling down peak loads through I/O off-loading. In OSDI '08: Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation, 2008.
16. Colby Ranger, Ramanan Raghuraman, Arun Penmetsa, Gary Bradski, and Christos Kozyrakis. Evaluating MapReduce for Multi-core and Multiprocessor Systems. In HPCA '07: Proceedings of the 2007 IEEE 13th International Symposiu m on High Performance Computer Architecture, pages 13-24, Washington, DC, USA, 2007. IEEE Computer Society.
17. Cosmin Rusu, Alexandre Ferreira, Claudio Scordino, and Aaron Watson. Energy-Efficient Real-Time Heterogeneous Server Clusters. In RTAS '06: Proceedings of the 12th IEEE Real-Time and Embedded Technology and Applications Symposium, pages 418-428, Washington, DC, USA, 2006. IEEE Computer Society.
18. Yasushi Saito, Svend Frølund, Alistair Veitch, Arif Merchant, and Susan Spence. FAB: Building Distributed Enterprise Disk Arrays from Commodity Components. In ASPLOS-XI: Proceedings of the 11th International Conference on Architectural Support for Programming Languages and Operating Systems, pages 48-58, New York, NY, USA, 2004. ACM.
19. Sorting 1PB with MapReduce, http://googleblog.blogspot.com/2008/11/ sorting-1pbwith-mapreduce.html.
20. E. Thereska, A. Donnelly, and D. Narayanan. Sierra: A Power-Proportional, Distributed Storage System. Technical report, Microsoft Research, 2009.
21. Nedeljko Vasić, Martin Barisits, Vincent Salzgeber, and Dejan Kostic. Making Cluster Applications Energy-Aware. In ACDC '09: Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds, pages 37-42, New York, NY, USA, 2009. ACM.
22. Charles Weddle, Mathew Oldham, Jin Qian, An-I Andy Wang, Peter L. Reiher, and Geoffrey H. Kuenning. PARAID: A Gear-Shifting Power-aware RAID. TOS, 3(3), 2007.
23. E.R. Zayas. AFS-3 Programmer's Reference: Architectural Overview. Technical report, Transarc Corporation, 1991.