Exploiting spatio-temporal tradeoffs for energy-aware mapreduce in the cloud

Proceedings - 2011 IEEE 4th International Conference on Cloud Computing, CLOUD 2011

Volumn , Issue , 2011, Pages 251-258

  Cardosa, Michael ^a   Singh, Aameek ^b   Pucha, Himabindu ^b   Chandra, Abhishek ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

^b IBM RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD PROVIDERS; DATA PROCESSING APPLICATIONS; ENERGY AWARE; JOB PERFORMANCE; MACHINE RESOURCES; MAP-REDUCE; OPTIMIZATION TECHNIQUES; PLACEMENT ALGORITHM; RUNTIMES; SPATIO-TEMPORAL; VIRTUAL MACHINES;

ALGORITHMS; DATA HANDLING; ENERGY EFFICIENCY;

CLOUD COMPUTING;

EID: 80053148507     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLOUD.2011.68     Document Type: Conference Paper

References (30)

1. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in Proc. of OSDI, 2004.
2. "Hadoop," http://hadoop.apache.org.
3. "Amazon Elastic MapReduce," http://aws.amazon.com.
4. "Amazon ec2," http://aws.amazon.com/ec2.
5. IBM Smart Business Private Cloud, ibm.com/ibm/cloud.
6. J. G. Koomey, "Worldwide electricity used in data centers," Environmental Research Letters, vol. 3, no. 3, 2008.
7. C. L. Belady, "In the data center, power and cooling costs more than the it equipment it supports," Electronics Cooling Magazine, vol. 13, no. 1, pp. 24-27, 2007.
8. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the art of virtualization," in SOSP, 2003.
9. G. Ananthanarayanan, Kandula, A. Greenberg, I. Stoica, Y. Lu, B. Saha, and E. Harris, "Reining in the outliers in map-reduce clusters using mantri," in OSDI, 2010.
10. M. Cardosa, P. Narang, A. Chandra, H. Pucha, and A. Singh, "STEAMEngine: Driving MapReduce Provisioning in the Cloud," Dept. of CSE, Univ. of Minnesota, Tech. Rep. 10-023, Sep. 2010.
11. K. Kambatla, A. Pathak, and H. Pucha, "Towards optimizing hadoop provisioning in the cloud," in HotCloud, 2009.
12. S. Babu, "Towards automatic optimization of mapreduce programs," in SOCC, 2010.
13. E. M. Elnozahy, M. Kistler, and R. Rajamony, "Energy-efficient server clusters," in Proceedings of the 2nd Workshop on Power-Aware Computing Systems, 2002.
14. T. Burd, T. Pering, A. Stratakos, and R. Brodersen, "A Dynamic Voltage-Scaled Microprocessor System," in IEEE ISSCC, 2000.
15. M. Cardosa, A. Singh, H. Pucha, and A. Chandra, "Exploiting Spatio-Temporal Tradeoffs for Energy Efficient MapReduce in the Cloud," Dept. of CSE, Univ. of Minnesota, Tech. Rep. 10-008, Apr. 2010.
16. X. Fan, W.-D. Weber, and L. A. Barroso, "Power provisioning for a warehouse-sized computer," in ISCA, 2007.
17. K. Lim, P. Ranganathan, J. Chang, C. Patel, T. Mudge, and S. Reinhardt, "Understanding and designing new server architectures for emerging warehouse-computing environments," in ISCA, 2008.
18. Y. Chen, L. Keys, and R. H. Katz, "Towards Energy Efficient MapReduce," EECS Department, University of California, Berkeley, Tech. Rep. UCB/EECS-2009-109, Aug 2009.
19. J. Leverich and C. Kozyrakis, "On the energy (in) efficiency of hadoop clusters," in HotPower, 2009.
20. W. Lang, J. M. Patel, and S. Shankar, "Energy management for mapreduce clusters," in VLDB, 2010.
21. "Scheduling in hadoop," http://www.cloudera.com/blog/tag/ scheduling/.
22. T. Sandholm and K. Lai, "Mapreduce optimization using dynamic regulated prioritization," in ACM SIGMET-RICS/Performance, 2009.
23. M. Isard, V. Prabhakaran, J. Currey, U. Wieder, K. Talwar, and A. Goldberg, "Quincy: fair scheduling for distributed computing clusters," in SOSP, 2009.
24. A. Verma, P. Ahuja, and A. Neogi, "pMapper: Power and Migration Cost Aware Placement of Applications in Virtualized Systems," in ACM Middleware, 2008.
25. A. Singh, M. Korupolu, and D. Mohapatra, "Server-storage virtualization: Integration and load balancing in data centers," in Proceedings of IEEE/ACM Supercomputing, 2008.
26. T. Wood, P. Shenoy, A. Venkataramani, and M. Yousif, "Black-box and Gray-box Strategies for Virtual Machine Migration," in NSDI, 2007.
27. G. Khanna, K. Beaty, G. Kar, and A. Kochut, "Application performance management in virtualized server environments," in NOMS, 2006.
28. M. Steinder, I. Whalley, D. Carrera, I. Gaweda, and D. M. Chess, "Server virtualization in autonomic management of heterogeneous workloads," in IM, 2007, pp. 139-148. (Pubitemid 47485167)
29. R. Nathuji and K. Schwan, "Virtualpower: coordinated power management in virtualized enterprise systems," in SOSP, 2007, pp. 265-278. (Pubitemid 351429381)
30. A. Kansal, J. Liu, A. Singh, R. Nathuji, and T. Abdelzaher, "Semantic-less coordination of power management and application performance," in HotPower, 2009.