GreenHadoop: Leveraging green energy in data-processing frameworks

EuroSys'12 - Proceedings of the EuroSys 2012 Conference

Volumn , Issue , 2012, Pages 57-70

  Goiri, Íñigo ^a   Le, Kien ^a   Nguyen, Thu D ^a   Guitart, Jordi ^b   Torres, Jordi ^b   Bianchini, Ricardo ^a  

^a RUTGERS UNIVERSITY   (United States)

^b BARCELONA SUPERCOMPUTING CENTER   (Spain)

Author keywords

Cost aware scheduling; Energy aware scheduling; Green energy; MapReduce; Renewable energy

Indexed keywords

COMPUTATIONAL WORKLOAD; DATA CENTERS; ELECTRICAL GRIDS; ELECTRICITY COSTS; ENERGY DEMANDS; ENERGY-AWARE SCHEDULING; GREEN ENERGY; MAP-REDUCE; PHOTOVOLTAIC; RENEWABLE ENERGIES; SOLAR ARRAYS; SOURCES OF ENERGY; TIME BOUND;

ALTERNATIVE FUELS; COSTS; DATA HANDLING; ELECTRIC LOAD FORECASTING; ENERGY UTILIZATION; MULTIPROCESSING SYSTEMS; SOLAR ENERGY;

ENERGY POLICY;

EID: 84860594967     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2168836.2168843     Document Type: Conference Paper

References (33)

1. S. Akoush et al. Free Lunch: Exploiting Renewable Energy for Computing. In HotOS, 2011.
2. B. Aksanli et al. Utilizing Green Energy Prediction to Schedule Mixed Batch and Service Jobs in Data Centers. In HotPower, 2011.
3. H. Amur et al. Robust and Flexible Power-Proportional Storage. In SOCC, June 2010.
4. Apache. Apache Hadoop. http://hadoop.apache.org/.
5. Apache. Apache Nutch, http://nutch.apache.org/.
6. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI, December 2004.
7. DSIRE. Database of State Incentives for Renewables and Efficiency. http://www.dsireusa.org/.
8. D. Feitelson et al. Parallel Job Scheduling - A Status Report. In JSSPP, June 2004.
9. I. Goiri et al. GreenSlot: Scheduling Energy Consumption in Green Datacenters. In Supercomputing, November 2011.
10. S. Govindan et al. Benefits and Limitations of Tapping into Stored Energy for Datacenters. In ISCA, June 2011.
11. A. Jossen et al. Operation conditions of batteries in PV applications. Solar Energy, 76(6), 2004.
12. K. Kant et al. Willow: A Control System for Energy and Thermal Adaptive Computing. In IPDPS, May 2011.
13. R. T. Kaushik et al. Evaluation and Analysis of GreenHDFS: A Self-Adaptive, Energy-Conserving Variant of the Hadoop Distributed File System. In CloudCom, December 2010.
14. A. Krioukov et al. Integrating Renewable Energy Using Data Analytics Systems: Challenges and Opportunities. Bulletin of the IEEE Computer Society Technical Committee, March 2011.
15. A. Krioukov et al. Design and Evaluation of an Energy Agile Computing Cluster. Technical Report EECS-2012-13, University of California at Berkeley, January 2012.
16. W. Lang and J. Patel. Energy Management for MapReduce Clusters. In VLDB, September 2010.
17. K. Le et al. Cost- And Energy-Aware Load Distribution Across Data Centers. In HotPower, October 2009.
18. K. Le et al. Reducing Electricity Cost Through Virtual Machine Placement in High Performance Computing Clouds. In Supercomputing, November 2011.
19. K. Le et al. Capping the Brown Energy Consumption of Internet Services at Low Cost. In IGCC, August 2010.
20. J. Leverich and C. Kozyrakis. On the Energy (In)efficiency of Hadoop Clusters. In HotPower, October 2009.
21. C. Li et al. SolarCore: Solar Energy Driven Multi-core Architecture Power Management. In HPCA, February 2011.
22. Z. Liu et al. Greening Geographical Load Balancing. In SIGMETRICS, June 2011.
23. S. Oikawa and R. Rajkumar. Linux/RK: A Portable Resource Kernel in Linux. In RTAS, May 1998.
24. A. Qureshi et al. Cutting the Electric Bill for Internet-Scale Systems. In SIGCOMM, August 2009.
25. P. Ranganathan et al. Ensemble-level Power Management for Dense Blade Servers. In ISCA, June 2006.
26. N. Sharma et al. Cloudy Computing: Leveraging Weather Forecasts in Energy Harvesting Sensor Systems. In SECON, June 2010.
27. N. Sharma et al. Blink: Managing Server Clusters on Intermittent Power. In ASPLOS, March 2011.
28. SMA. Sunny Central 800CP, 2012.
29. SolarBuzz. Marketbuzz, 2011.
30. C. Stewart and K. Shen. Some Joules Are More Precious Than Others: Managing Renewable Energy in the Datacenter. In HotPower, October 2009.
31. US Environmental Protection Agency. Report to Congress on Server and Data Center Energy Efficiency, August 2007.
32. A. Yoo et al. SLURM: Simple Linux Utility for Resource Management. In JSPP, June 2003.
33. M. Zaharia et al. Job Scheduling for Multi-User MapReduce Clusters. In TR UCB/EECS-2009-55, Berkeley, August 2009.