A survey of the research on power management techniques for high-performance systems

Software - Practice and Experience

Volumn 40, Issue 11, 2010, Pages 943-964

  Liu, Yongpeng ^a   Zhu, Hong ^b  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b OXFORD BROOKES UNIVERSITY   (United Kingdom)

Author keywords

commercial clusters; energy consumption profiling; high performance computing; high performance systems; metrics of power consumption efficiency; power management; virtual machine

Indexed keywords

COMMERCIAL CLUSTERS; ENERGY CONSUMPTION; HIGH PERFORMANCE SYSTEMS; HIGH-PERFORMANCE COMPUTING; POWER CONSUMPTION; POWER MANAGEMENTS; VIRTUAL MACHINES;

COMPUTER SIMULATION; ENERGY UTILIZATION; INDUSTRIAL MANAGEMENT; OPERATING COSTS; SPEED CONTROL; SUPERCOMPUTERS; SURVEYS;

RESEARCH;

EID: 78249280637     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.952     Document Type: Article

References (97)

1. Feng W,. Making a case for efficient supercomputing. ACM Queue 2003; 1 (7): 54-64.
2. Meuer H, Strohmair E, Simon H, Dongarra J,. Thirty-third edition of TOP500 list. Available at: http://www.top500.org/lists/2009/06 [23 June 2009].
3. U.S. Environmental Protection Agency ENERGY STAR Program. Report to Congress on Server and Data Center Energy Efficiency. Available at: http://www.energystar.gov/ia/partners/prod development/downloads/EPA Datacenter Report Congress Final1.pdf [2 August 2007].
4. Seager M,. What are the future trends in high-performance interconnects for parallel computers? Proceedings of the 12th IEEE Symposium on High-Performance Interconnects (Panel 1), Stanford, California, U.S.A., 25-27 August 2004; 3-3.
5. American Power Conversion (APC). Determining total cost of ownership for data center and network room Infrastructure. Available at: ftp://www.apcmedia. com/salestools/CMRP-5T9PQG R2 EN.pdf [15 December 2003].
6. US Enviroment Protection Agency. Available at: http://www.epa.gov/ cleanenergy/energy-resouces/calculator.html [17 February 2009].
7. Venkatachalam V, Franz M,. Power reduction techniques for microprocessor systems. ACM Computing Surveys 2005; 37 (3): 195-237.
8. Ge R, Feng X, Cameron K,. Improvement of power-performance efficiency for high-end computing. Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05), Workshop 11: The 1st IEEE Workshop on High-Performance, Power-Aware Computing (HPPAC'05), vol. 12, Denver, CO, U.S.A., 4 April 2005; 233.2.
9. Intel. Intel 64 and IA-32 architectures software developer's manual. Volume 3A: System programming guide, Part 1. Order Number: 253668-031US. Available at: http://download.micron.com/pdf/technotes/ddr3/TN41 01DDR3 [20 June 2009].
10. Micron Techology Inc. Calculating memory system power for DDR3. Available at: Power.pdf [30 August 2007].
11. Pinheiro E, Bianchini R,. Energy conservation techniques for disk array-based servers. Proceedings of the 18th ACM/IEEE Conference on Supercomputing (SC'04), Malo, France, June 2004; 68-78.
12. Gurumurthi S, Sivasubramaniam A, Kandemir M, Franks H,. DRPM dynamic speed control for power management in server class disks. Proceedings of the 30th Annual International Symposium on Computer Architecture (ISCA'03), San Deigo, CA, U.S.A., 9-11 June 2003; 169-181.
13. Carrera E, Pinheiro E, Bianchini R,. Conserving disk energy in network servers. Proceedings of the 17th International Conference on Supercomputing (ICS'03), San Francisco, CA, U.S.A., 23-26 June 2003; 86-97.
14. Hewlett-Packard, Intel, Microsoft, Phoenix and Toshiba. Advanced Configuration and Power Interface Specification Revision 4.0. Available at: http://www.acpi.info/DOWNLOADS/ACPIspec40.pdf [16 June 2009].
15. Intel. What is difference between deep and deeper sleep states? Available at: http://www.intel.com/support/processors/sb/CS-028739.htm [24 February 2009].
16. Pandey V, Jiang W, Zhou Y, Binachini R,. DMA-aware memory energy management. Proceedings of the 12th International Symposium on High-Performance Computer Architecture (HPCA-12), Austin, TX, U.S.A., 11-15 February 2006; 133-144.
17. Colarelli D, Grunwald D,. Massive arrays of idle disks for storage archives. Proceedings of the 16th ACM/IEEE Conference on Supercomputing (SC'02), Baltimore, MD, U.S.A., 16-22 November 2002; 1-11.
18. Pinheiro E, Bianchini R, Dubnicki C,. Exploiting redundancy to conserve energy in storage systems. Proceedings of the ACM International Conference on Measurement and Modeling of Computer Systems 2006 (SIGMETRICS/Performace'06), Saint Malo, France, 26-30 June 2006; 15-26.
19. PCI-SIG. PCI Bus Power Management Interface Specification, Revision 1.2. Available at: http://www.pcisig.com/specifications/conventional/pcipm1.2.pdf [3 March 2004].
20. Chase J, Aderson D, Thakar P, Vahdat A, Doyle R,. Managing energy and server resources in hosting centers. Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP'01), Banff, Alberta, Canada, October 2001; 103-116.
21. Pinheiro E, Bianchini R, Carrera E, Health T,. Load balancing and unbalancing for power and performance in cluster-based systems. Technical Report DCS-TR-440, Department of Computer Science, Rutgers University, May 2001.
22. P'enzes P, Martin A,. Energy-delay efficiency of VLSI computations. Proceedings of the 12th ACM Great Lakes Symposium on VLSI (GLSVLSI'02), New York, NY, U.S.A., 18-19 April 2002; 104-111.
23. Martonosi M, Brooks D, Bose P,. Modeling and analyzing cpu power and performance: metrics, methods, and abstractions (Tutorial). Proceedings of Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS/Performance'01), Cambridge, MA, U.S.A., 2001.
24. Hsu C, Feng W, Archuleta J,. Towards efficient supercomputing: A quest for the right metric. Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05), Workshop 11: The 1st IEEE Workshop on High-Performance, Power-Aware Computing (HPPAC'05), vol. 12, Denver, CO, U.S.A., 4 April 2005; 230.1.
25. Green500 List. 5th Edition of the Green500 List. [June 2009].
26. Sharma S, Hsu C, Feng WC,. Making a case for a Green500 list. Proceedings of the 2nd IEEE Workshop on High-Performance, Power-Aware Computing (HPPAC'06), Rhodes, Greece, 25-29 April 2006; 343.
27. Choi K, Soma R, Pedram M,. Dynamic voltage and frequency scaling based on workload decomposition. Proceedings of International Symposium on Low Power Electronics and Design 2004 (ISLPED'04), Newport Beach, CA, U.S.A., 9-11 August 2004; 174-179.
28. Hsu C, Feng W,. A power-aware run-time system for high-performance computing. Proceedings of the 19th ACM/IEEE Conference on Supercomputing (SC'05), WA, U.S.A., 12-18 November 2005; 1-9.
29. Ge R, Feng X, Feng W, Camron K,. CPU MISER: A performance-directed, run-time system for power-aware clusters. Proceedings of the 2007 International Conference on Parallel Processing (ICPP'07), Xian, China, 10-14 September 2007; 18-25.
30. Lim K, Ranganathan P, Chang J, Patel C, Mudge T, Reinhardt S,. Understanding and designing new server architectures for emerging warehouse-computing environments. Proceedings of the 35th International Symposium on Computer Architecture (ISCA'08), Beijing, China, 21-25 June 2008; 315-326.
31. Standard Performance Evaluation Corporation. SPECpower-ssj2008. Available at: http://www.spec.org/specpower/ [15 April 2009].
32. Belady C, Rawson A, Pfleuger J, Cader T,. Green grid data center power efficiency metrics: PUE and DCiE, White Paper #6. Available at: http://www.thegreengrid.org/gg content/TGG-Data-Center-Power-Efficiency-Metrics- PUE-and-DCiE.pdf [30 November 2007].
33. Brill K,. Data center energy efficiency and productivity. The Uptime Institute white paper TUI3004D, 2007. Available at: http://www.uptimeinstitute. org/symp pdf/(TUI3004D)DataCenterEnergyEfficiency.pdf.
34. Snowdon D, Petters S, Heiser G,. Power measurement as the basis for power management. Proceedings of the 1st Workshop on Operating System Platforms for Embedded Real-Time Applications (OSPERT'05), Palma, Mallorca, Spain, July 2005.
35. Bellosa F,. The case for event-driven energy accounting. Technical Report TR-14-01-07, Department of Computer Science, University of Erlangen, Erlangen, Germany, June 2001.
36. Najm F,. A survey of power estimation techniques in VLSI circutes. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 1994; 2 (4): 446-455.
37. Brooks D, Tiwari V, Martonosi M,. Wattch a framework for architectural-level power analysis and optimizations. Proceedings of the 27th International Symposium on Computer Architecture (ISCA'00), Vancouver, British Columbia, Canada, 2000; 83-94.
38. Brockmeyer E, Miranda M, Corporaal H, Catthoor F,. Layer assignment techniques for low energy in multi-layered memory organisations. Proceedings of the 6th ACM/IEEE Design and Test in Europe, Leuven, Belgium, 3-7 March 2003; 1070-1075.
39. Gurumurthi S, Sivasubramaniam A, Irwin M, Vijakrishnan N, Kandemir M,. Using complete machine simulation for software power estimation: The softwatt approach. Proceedings of the 8th International Symposium on High Performance Computer Architecture (HPCA'02), Cambridge, U.K., 2-6 February 2002; 141-150.
40. Heath T, Diniz B, Carrera E, Meira W, Bianchini R,. Energy conservation in heterogeneous server clusters. Proceedings of 10th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'05), Chicago, U.S.A., 15-17 June 2005; 186-195.
41. Heath T, Centeno A, George P, Ramos L, Jaluria Y, Bianchini R,. Mercury and Freon temperature emulation and management for server systems. Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'06), San Jose, CA, U.S.A., 21-25 October 2006; 106-116.
42. Skadron K, Stan M, Sankaranarayanan K, Huang W, Velusamy S, Tarjan D,. Temperature-aware microarchitecture: Modeling and implementation. ACM Transactions on Architecture and Code Optimization (TACO) 2004; 1 (1): 94-125.
43. Flinn J, Satyanarayanan M,. Powerscope a tool for profiling the energy usage of mobile applications. Proceedings of the 2nd IEEE Workshop on Mobile Computing Systems and Applications (WMCSA'99), New Orleans, LA, U.S.A., February 1999; 2-10.
44. Joseph R, Brooks D, Martonosi M,. Live, runtime power measurements as a foundation for evaluating power/performance tradeoffs. Workshop on Complexity Effective Design in Conjunction with the 28th International Symposium on Computer Architecture (ISCA'01), Göteborg, Sweden, 30 June-4 July 2001.
45. Bellosa F,. The benefits of event-driven energy accounting in power-sensitive systems. Proceedings of the 9th ACM SIGOPS European Workshop, New York, U.S.A., 17-20 September 2000; 37-42.
46. Weissel A, Bellosa F,. Process cruise control: Event-driven clock scaling for dynamic power management. Proceedings of the 2002 International Conference on Compilers, Architecture, and Synthesis for Embedded Systems (CASES'02), Grenoble, France, 8-11 October 2002; 238-246.
47. Bellosa F, Weissel A, Waitz M, Wessil A,. Event-driven energy accounting for dynamic thermal management. Proceedings of the 4th Workshop on Compilers and Operating Systems for Low Power (COLP'03), New Orleans, LA, U.S.A., 27 September 2003.
48. Isci C, Martonosi M,. Runtime power monitoring in high-end processors: Methodology and empirical data. Proceedings of the 36th Annual ACM/IEEE International Symposium on Microarchitecture (MICRO-36), San Diego, CA, U.S.A., 3-5 December 2003; 93-104.
49. Bircher W, Law J, Valluri M, John L,. Effective use of performance monitoring counters for run-time prediction of power. Technical Report TR-041104-01, University of Texas at Austin, TX, U.S.A., November 2004.
50. Chang F, Farkas K, Ranganathan P,. Energy-driven statistical profiling: Detecting software hotspots. Proceedings of the 2nd International Workshop on Power-Aware Computer Systems (PACS'02), Cambridge, MA, U.S.A., 2 February 2002; 110-129.
51. Hu C, Jimenez D, Kremer U,. Efficient program power behavior characterization. High Performance Embedded Architectures and Compilers (HiPEAC), vol. 4367. Springer: Berlin, 2007; 183-197. ISSN: 1611-3349.
52. Isci C, Martonosi M,. Phase characterization for power: Evaluating control-flow-based and event-counter-based techniques. Proceedings of the 12th International Symposium on High-Performance Computer Architecture (HPCA-12), Austin, TX, U.S.A., 11-15 February 2006; 121-132.
53. Lefurgy C, Rajamani K, Rawson F, Felter W, Kistler M, Keller T,. Energy management for commercial servers. Computer 2003; 36 (12): 39-48.
54. Bianchini R, Rajamony R,. Power and energy management for server systems. Technical Report DCS-TR-528, Department of Computer Science, Rutgers University, NJ, U.S.A., June 2003.
55. Rajamony R, Bianchini R,. Energy management for server clusters (Tutorial). Proceedings of 16th Annual ACM International Conference on Supercomputing (SC'02), New York, U.S.A., 22-26 June 2002; 165.
56. Chen Y, Das A, Qin W, Sivasubramaniam A, Wang Q, Gautam N,. Managing server energy and operational costs in hosting centers. Proceedings of the 2005 ACM International Conference on Measurement and Modeling of Computer Systems (SIGMetrics'05), Banff, Alberta, Canada, 6-10 June 2005; 303-314.
57. Horvath T, Skadron K,. Multi-mode energy management for multi-tier server clusters. Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques (PACT'08), Toronto, Ontario, Canada, 25-29 October 2008; 270-279.
58. Horvath T, Abdelzaher T, Skadron K, Liu X,. Dynamic voltage scaling in multi-tier web servers with end-to-end delay control. IEEE Transactions on Computers 2007; 56 (4): 444-458.
59. Ranganathan P, Leech P, Irwin D, Chase J,. Ensemble-level power management for dense blade servers. Proceedings of the 33rd International Symposium on Computer Architecture (ISCA'06), Boston, MA, U.S.A., 17-21 June 2006; 66-77.
60. Fan X, Weber W, Barroso L,. Power provisioning for a warehouse-sized computer. Proceedings of the 34th International Symposium on Computer Architecture (ISCA'07), San Diego, CA, U.S.A., June 2007; 13-23.
61. Femal M, Freech V,. Boosting data center performance through non-uniform power allocation. Proceedings of the 2nd International Conference on Autonomic Computing (ICAC'05), Seattle, WA, U.S.A., 13-16 June 2005; 250-261.
62. Wang X, Chen M,. Cluster-level feedback power control for performance optimization. Proceedings of the 14th IEEE International Symposium on High-Performance Computer Architecture (HPCA'08), Salt Lake City, Utah, 16-20 February 2008; 101-110.
63. Skadron K, Abdelzaher T, Stan M,. Control-theoretic techniques and thermal-rc modeling for accurate and localized dynamic thermal management. Proceedings of the 8th International Symposium on High-Performance Computer Architecture (HPCA'02), Washington, DC, U.S.A., 2-6 February 2002; 17-33.
64. Moore J, Chase J, Rangantahan P, Sharma R,. Making scheduling 'cool': Temperature-aware workload placement in data centers. Proceedings of the 2005 Annual Conference on USENIX Annual Technical Conference (USENIX'05), Marriott Anaheim, Anehim, CA, 10-15 April 2005; 5-18.
65. Ge R, Feng X, Cameron K,. Performance-constrained distributed dvs scheduling for scientific applications on power-aware clusters. Proceedings of the 19th ACM/IEEE Conference on Supercomputing (SC'05), Seattle, WA, U.S.A., 12-18 November 2005; 34-44.
66. Linux. Available at: ftp://ftp.kernel.org/pub/linux/kernel/v2.6/linux-2. 6.28.tar.bz2 [24 December 2008].
67. Malkowski K, Raghavan P, Kandemir M, Irwin M,. Phase-aware adaptive hardware selection for power-efficient scientific computations. Proceedings of the International Symposium on Low Power Electronics and Design 2007 (ISLPED'07), Portland, OR, U.S.A., 27-29 August 2007; 403-406.
68. Freeh V, Lowenthal D, Pan F, Kappiah N,. Using multiple energy gears in mpi programs on a power-scalable cluster. Proceedings of the 2005 ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPOPP'05), Chicago, U.S.A., 15-17 June 2005; 164-173.
69. Messgae Passing Interface Forum. MPI: A Message-Passing Interface Standard (Version 2.1). Available at: http://www.mpi-forum.org/ [23 June 2008].
70. Lim M, Freeh V, Lowenthal D,. Adaptive transparent frequency and voltage scaling of communication phases in mpi programs. Proceedings of the 20th ACM/IEEE Conference on Supercomputing (SC'06), Tampa, FL, U.S.A., 11-17 November 2006; 14-27.
71. Kappiah N, Freeh V, Lowenthal D,. Just in time dynamic voltage scaling: Exploiting inter-node slack to save energy in mpi programs. Proceedings of the 19th ACM/IEEE Conference on Supercomputing (SC'05), Washington, U.S.A., 12-18 November 2005; 33-41.
72. Rountree B, Lowenthal D, Supinski B, Schulz M, Freeh V, Bletsch T,. Adagio making DVS practical for complex HPC applications. Proceedings of the 23th International Conference on Supercomputing (ICS'09), Yorktown Heights, New York, U.S.A., 8-12 June 2009; 460-469.
73. LLNL, HP and Bull. The Simple Linux Utility for Resource Management (SLRUM). Available at: http://www.llnl.gov/linux/slurm/.revision 2.0.3 [30 June 2009].
74. Koch K, Henning P,. Beyond a single cell. Cell Workshop, University of Tennessee, 25 October 2006.
75. Zong Z, Qin X, Ruan X, Bellam K, Nijim M, Alghamdi M,. Energy-Efficient Scheduling for Parallel Applications Running on Heterogeneous Clusters. Proceedings of the 36th International Conference on Parallel Processing (ICPP'07), 10-14 September 2007; 19-26.
76. Smith J, Nair R,. The architecture of virtual machines. Computer 2005; 38 (5): 32-38.
77. Rosenblum M, Garfinkel T,. Virtual machine monitors: Current technology and future trends. Computer 2005; 38 (5): 39-47.
78. VMware. Understanding full virtualization, paravirtualization, and hardware assist. Whitepaper WP-028-PRD-01-01. Available at: http://www.vmware. com/solutions/whitepapers/virtualization.html [11 September 2007].
79. Pratt I, Fraser K, Hand S, Limpach C, Warfield A,. Xen 3.0 and the art of virtualization. Proceedings of the 2005 Ottawa Linux Symposium, Ottawa, Canada, 30 July 2005; 65-85.
80. Sun. Solaris Containers: Server Virtualization and Manageability. Sun White Paper. Available at: http://www.sun.com/software/whitepapers/solaris10/ grid containers.pdf [30 September 2004].
81. Soltesz S, Potzl H,. Container-based operating system virtualization: A scalable, high-performance alternative to hypervisors. Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems (EuroSys'07), Lisboa, Portugal, 21-23 March 2007; 275-287.
82. Parallels. OpenVZ. Available at: http://www.openvz.org/ [1 July 2009].
83. Lu K, Chi W, Liu Y, Tang H,. HPVZ: A high performance virtual computing environment for super computer. Proceedings of the 8th Advanced Parallel Processing Technology (APPT'09), Rapperswil, Switzerland, 24-25 August 2009; 205-219.
84. Huang W, Liu J,. A case for high performance computing with virtual machines. Proceedings of 20th Annual International Conference on Supercomputing (SC'06), Cairns, Queensland, Australia, 28-30 June 2006; 125-134.
85. Figueiredo R, Dinda P, Fortes J,. A case for grid computing on virtual machines. Proceedings of the 23rd International Conference on Distributed Computing Systems (ICDCS'03), Providence, Rhode Island, U.S.A., 19-22 May 2003; 550-559.
86. Engelmann C, Scott S, Ong H,. Configurable virtualized system environments for high performance computing. Proceedings of the 1st Workshop on System-level Virtualization for High Performance Computing (HPCVirt'07), Lisbon, Portugal, 20 March 2007.
87. Mergen M, Uhlig V, Krieger O, Xenidis J,. Virtualization for high-performance computing. ACM SIGOPS Operating Systems Review 2006; 40 (2): 8-11.
88. Padala P, Zhu X, Wang Z, Singhal S, Shin K,. Performance evaluation of virtualization technologies for server consolidation. Technical Report HPL-2007-59, HP Laboratories, Palo Alto, 11 April 2007.
89. Milo D, Douglis F,. Process migration. ACM Computing Surveys 2000; 32 (3): 241-299.
90. Clark C, Fraser K, Hand S,. Live migration of virtual machines. Proceedings of the 2nd Conference on Symposium on Networked Systems Design and Implementation (NSDI'05), vol. 2, Boston, MA, U.S.A., July 2005; 273-286.
91. Stoess J, Klee C, Domthera S, Bellosa F,. Transparent, power-aware migration in virtualized systems. Proceedings of GI/ITG Fachgruppentreffen Betriebssysteme, Karlsruhe, Germany, 12 October 2007; 3-8.
92. Verma A, Ahuja P, Neogi A,. pMapper: Power and migration cost aware application placement in virtualized systems. Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware (Middleware'08), Leuven, Belgium, 1-5 December 2008; 243-264.
93. Verma A, Ahuja P, Neogi A,. Power-aware dynamic placement of HPC applications. Proceedings of the 22nd International Conference on Supercomputing (ICS'08), Island of Kos, Aegean Sea, Greece, 7-12 June, 2008; 175-184.
94. Stoess J, Lang C, Bellosa F,. Energy management for hypervisor-based virtual machines. Proceedings of the 2007 USENIX Annual Technical Conference (USENIX'07), Santa Clara, CA, 17-22 June 2007; 1-14.
95. Nathuji R, Schwan K,. VirtualPower: Coordinated power management in virtualized enterprise systems. Proceedings of the 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP'07), Stevenson, WA, U.S.A., 14-17 October 2007; 265-278.
96. Lefurgy C, Wang X, Ware M,. Server-level power control. Proceedings of the 4th IEEE International Conference on Autonomic Computing (ICAC'07). Jacksonville, FL, 11-15 June 2007; 4-13.
97. Dash R, Kephart J, Lefurgy C, Tesauro G, Levine D, Chan H,. Autonomic multi-agent management of power and performance in data centers. Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS'08), Industrial Track, Estoril, Portugal, 12-16 May 2008; 107-114.