Analyzing the energy-time trade-off in high-performance computing applications

IEEE Transactions on Parallel and Distributed Systems

Volumn 18, Issue 6, 2007, Pages 835-848

  Freeh, Vincent W ^a   Lowenthal, David K ^b   Pan, Feng ^a   Kappiah, Nandini ^a   Springer, Rob ^b   Rountree, Barry L ^b   Femal, Mark E ^a  

^a North Carolina State University   (United States)

^b The University of Georgia ^*  (United States)

Author keywords

High performance computing; Power aware computing

Indexed keywords

CLUSTER ANALYSIS; DELAY CONTROL SYSTEMS; ENERGY UTILIZATION; PERSONAL COMMUNICATION SYSTEMS;

COMMUNICATION BOTTLENECKS; ENERGY-TIME TRADE-OFF; HIGH-PERFORMANCE COMPUTING; POWER-AWARE COMPUTING;

PERSONAL COMPUTING;

EID: 34248638757     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2007.1026     Document Type: Article

References (79)

1. N.D. Adiga et al., "An Overview of the BlueGene/L Supercomputer," Proc. Supercomputing '02, Nov. 2002.
2. ASCI Purple Benchmark Suite, http://www.llnl.gov/asci/platforms/purple/ rfp/benchmarks/, 2007.
3. M. Baker, S. Asami, E. Deprit, J. Ousterhout, and M. Seltzer, "Non-Volatile Memory for Fast, Reliable File Systems," Proc. Fifth Architectural Support for Programming Languages and Operating Systems Conf., 1992.
4. F. Bellosa, "The Benefits of Event-Driven Energy Accounting in Power-Sensitive Systems," Proc. Ninth ACM SIGOPS European Workshop Sept. 2000.
5. P. Bohrer, E. Elnozahy, T. Keller, M. Kistler, C. Lefurgy, C. McDowell, and R. Rajamony, "The Case of Power Management in Web Servers," Power Aware Computing, R. Graybill and R. Melham, eds., Kluwer/ Plenum, 2002.
6. E.V. Carrera, E. Pinheiro, and R. Bianchini, "Conserving Disk Energy in Network Servers," Proc. Int'l Conf. Supercomputing, pp. 86-97, 2003.
7. J.S. Chase, D.C. Anderson, P.N. Thakar, A. Vahdat, and R.P. Doyle, "Managing Energy and Server Resources in Hosting Centers," Proc. Symp. Operating Systems Principles, pp. 103-116, 2001.
8. G. Chen, K. Malkowski, M. Kandemir, and P. Raghavan, "Reducing Power with Performance Constraints for Parallel Sparse Applications," Proc. First Workshop on High-Performance, Power-Aware Computing, Apr. 2005.
9. W. Chen, M. Dubios, and P. Stenstrom, "Integrating Complete-System and User-Level Performance/Power Simulators: The Simwattch Approach," Proc. Int'l Symp. Performance Analysis of Systems and Software, 2003.
10. Compaq Computer Corporation, Intel Corporation, Microsoft Corporation, Phoenix Technologies Ltd., and Toshiba Corporation, Advanced Configuration and Power Interface Specification, Revision 2.0, July 2000.
11. V. Delaluz, A. Sivasubramanian, M. Kandemir, N. Vijaykrishnan, and M.J. Irwin, "Scheduler-Based DRAM Energy Management," Proc. Design Automation Conf. (DAC '02), June 2002.
12. C. Ding and K. Kennedy, "Memory Bandwidth Bottleneck and Its Amelioration by a Compiler," Proc. Int'l Parallel and Distributed Processing Symp., May 2000.
13. F. Douglis, P. Krishnan, and B. Bershad, "Adaptive Disk Spin-Down Policies for Mobile Computers," Proc. Second USENIX Symp. Mobile and Location-Independent Computing, 1995.
14. E. Elnozahy, M. Kistler, and R. Rajamony, "Energy Conservation Policies for Web Servers," Proc. Fourth USENIX Symp. Internet Technologies and Systems (USITS '03), 2003.
15. E.N. (Mootaz) Elnozahy, M. Kistler, and R. Rajamony, "Energy-Efficient Server Clusters," Proc. Workshop Mobile Computing Systems and Applications, Feb. 2002.
16. M.E. Femal, "Non-Uniform Power Distribution in Data Centers for Safely Overprovisioning Circuit Capacity and Boosting Throughput," master's thesis, North Carolina State Univ., Raleigh, N.C., May 2005.
17. M.E. Femal and V.W. Freeh, "Safe Overprovisioning: Using Power Limits to Increase Aggregate Throughput," Proc. Workshop Power-Aware Computer Systems, Dec. 2004.
18. M.E. Femal and V.W. Freeh, "Boosting Data Center Performance through Non-Uniform Power Allocation," Proc. Second Int'l Conf. Autonomic Computing (ICAC), June 2005.
19. W.-C. Feng, "Making a Case for Efficient Supercomputing," ACM Queue vol. 1, no. 7, Oct. 2003.
20. X. Feng, R. Ge, and K.W. Cameron, "Power and Energy of Scientific Applications on Distributed Systems," Proc. Int'l Parallel and Distributed Processing Symp., Apr. 2005.
21. K. Flautner, S. Reinhardt, and T. Mudge, "Automatic Performance-Setting for Dynamic Voltage Scaling," Proc. MobiCom '01, July 2001.
22. V.W. Freeh, D.K. Lowenthal, R. Springer, F. Pan, and N. Kappiah, "Exploring the Energy-Time Tradeoff in MPI Programs on a Power-Scalable Cluster," Proc. 19th Int'l Parallel and Distributed Processing Symp. (IPDPS '05), Apr. 2005.
23. V.W. Freeh, D.K. Lowenthal, R. Springer, F. Pan, and N. Kappiah, "Using Multiple Energy Gears in MPI Programs on a Power-Scalable Cluster," Principles and Practices of Parallel Processing, June 2005.
24. C. Gniady, Y.C. Hu, and Y.-H. Lu, "Program Counter Based Techniques for Dynamic Power Management," Proc. 10th Int'l Symp. High-Performance Computer Architecture, Feb. 2004.
25. R. Gonzalez and M. Horowitz, "Energy Dissipation in General Purpose Microprocessors," Proc. IEEE Int'l Symp. Low Power Electronics, Oct. 1995.
26. F. Gruian, "Hard Real-Time Scheduling for Low-Energy Using Stochastic Data and DVS Processors," Proc. Int'l Symp. Low-Power Electronics and Design (ISPLED '01), Aug. 2001.
27. S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke, "Dynamic Speed Control for Power Management in Server Class Disks," Proc. Int'l Symp. Computer Architecture, pp. 169-179, June 2003.
28. S. Gurumurthi, J. Zhang, A. Sivasubramaniam, M. Kandemir, H. Franke, N. Vijaykrishnan, and M.J. Irwin, "Interplay of Energy and Performance for Disk Arrays Running Transaction Processing Workloads," Proc. Int'l Symp. Performance Analysis of Systems and Software, pp. 123-132, Mar. 2003.
29. S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke, "Reducing Disk Power Consumption in Servers with DRPM," Computer pp. 41-48, Dec. 2003.
30. T. Heath, B. Diniz, E.V. Carrera, W. Meira Jr., and R. Bianchini, "Energy Conservation in Heterogeneous Server Clusters," Principles and Practice of Parallel Programming, pp. 186-195, June 2005.
31. T. Heath, E. Pinheiro, J. Hom, U. Kremer, and R. Bianchini, "Application Transformations for Energy and Performance-Aware Device Management," Proc. 11th Int'l Conf. Parallel Architectures and Compilation Techniques, Sept. 2002.
32. D.P. Helmbold, D.D.E. Long, and B. Sherrod, "A Dynamic Disk Spin-Down Technique for Mobile Computing," Mobile Computing and Networking, pp. 130-142, 1996.
33. M. Horowitz, T. Indermaur, and R. Gonzalez, "Low-Power Digital Design," Proc. Symp. Low Power Electronics, pp. 8-11, Oct. 1994.
34. C.-H. Hsu and U. Kremer, "The Design, Implementation, and Evaluation of a Compiler Algorithm for CPU Energy Reduction," Proc. ACM SIGPLAN Conf. Programming Languages, Design, and Implementation, June 2003.
35. C.-H. Hsu and W. Feng, "Effective Dynamic-Voltage Scaling through CPU-Boundedness Detection," Proc. Fourth IEEE/ACM Workshop Power-Aware Computing Systems, Dec. 2004.
36. C.-H. Hsu and W. Feng, "Towards Efficient Supercomputing: Choosing the Right Efficiency Metric," Proc. First Workshop High-Performance, Power-Aware Computing, Apr. 2005.
37. C. Hu, D. Jimenez, and U. Kremer, "Toward an Evaluation Infrastructure for Power and Energy Optimizations," Proc. First Workshop High-Performance, Power-Aware Computing, Apr. 2005.
38. M. Huang, J. Renau, and J. Torellas, "Positional Adaptation of Processors: Application to Energy Reduction," Proc. Int'l Symp. Computer Architecture, pp. 157-168, June 2003.
39. M. Huang, J. Renau, and J. Torrellas, "Profile-Based Energy Reduction in High-Performance Processors," Proc. Fourth Workshop Feedback-Directed and Dynamic Optimizations, Dec. 2001.
40. R. Joseph and M. Martonosi, "Run-Time Power Estimation in High Performance Microprocessors," Proc. Int'l Symp. Low-Power Electronics and Design (ISPLED '01), Aug. 2001.
41. N. Kappiah, V.W. Freeh, and D.K. Lowenthal, "Just in Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs," Proc. Supercomputing, Nov. 2005.
42. K. Kennedy and U. Kremer, "Automatic Data Layout for Distributed-Memory Machines," ACM Trans. Programming Languages and Systems, vol. 20, no. 4, pp. 869-916, 1998.
43. R. Kotla, S. Ghiasi, T. Keller, and F. Rawson, "Scheduling Processor Voltage and Frequency in Server and Cluster Systems," Proc. Workshop High-Performance, Power-Aware Computing, 2005.
44. R. Krashinsky and H. Balakrishnan, "Minimizing Energy for Wireless Web Access with Bounded Slowdown," Proc. MobiCom '02, Sept. 2002.
45. R. Kravets, K. Schwan, and K. Calvert, "Power-Aware Communication for Mobile Computers," Proc. Sixth Int'l Workshop Mobile Multimedia Comm., Nov. 1999.
46. A.R. Lebeck, X. Fan, H. Zeng, and C.S. Ellis, "Power Aware Page Allocation," Architectural Support for Programming Languages and Operating Systems, pp. 105-116, 2000.
47. C. Lefurgy, K. Rajamani, F. Rawson, W. Felter, M. Kistler, and T.W. Keller, "Energy Management for Commercial Servers," Computer, pp. 39-48, Dec. 2003.
48. D. Li and J. Wang, "Eeraid: Energy Efficient Redundant and Inexpensive Disk Array," Proc. SIGOPS European Workshop, Sept. 2004.
49. K. Li, R. Kumpf, P. Horton, and T.E. Anderson, "A Quantitative Analysis of Disk Drive Power Management in Portable Computers," Proc. USENIX Winter, pp. 279-291, 1994.
50. A.J. Martin, M. Nystroem, and P. Penzes, "ET2: A Metric for Time and Energy Efficiency of Computation," Technical Report CSTR:2001.007, California Inst. Technology, Pasadena, Calif., 2001.
51. M. Martonosi, D. Brooks, and P. Bose, "Modeling and Analyzing CPU Power and Performance: Metrics, Methods, and Abstractions," Proc. SIGMETRICS, 2001.
52. WattsUp Meters, http://www.doubleed.com, 2007.
53. A. Miyoshi, C. Lefurgy, E. Van Hensbergen, R. Rajamony, and R. Rajkumar, "Critical Power Slope: Understanding the Runtime Effects of Frequency Scaling," Proc. 16th Int'l Conf. Supercomputing, pp. 35-44, 2002.
54. Orion Multisystems, http://www.orionmulti.com/, 2006.
55. S. Palacharla, N.P. Jouppi, and J.E. Smith, "Complexity-Effective Superscalar Processors," Proc. 24th Ann. Int'l Symp. Computer Architecture (ISCA '97), pp. 206-218, 1997.
56. F. Pan, "Exploring the Energy-Time Tradeoff in High Performance Computing," master's thesis, North Carolina State Univ., Raleigh, N.C., May 2005.
57. F. Pan, V.W. Freeh, and D.M. Smith, "Exploring the Energy-Time Tradeoff in High Performance Computing," Proc. Workshop High-Performance, Power-Aware Computing, Apr. 2005, in conjunction with the Proc. Int'l Parallel and Distributed Processing Symp.
58. A.E. Papathanasiou and M.L. Scott, "Energy Efficiency through Burstiness," Proc. IEEE Workshop Mobile Computing Systems and Applications, Oct. 2003.
59. T. Pering, T. Burd, and R. Brodersen, "The Simulation and Evaluation of Dynamic Voltage Scaling Algorithms," Proc. Int'l Symp. Low-Power Electronics and Design (ISPLED '98), pp. 76-81, Aug. 1998.
60. E. Pinheiro, R. Bianchini, E.V. Carrera, and T. Heath, "Dynamic Cluster Reconfiguration for Power and Performance," Compilers and Operating Systems for Low Power, Sept. 2001.
61. E. Pinheiro and R. Bianchini, "Energy Conservation Techniques for Disk Array-Based Servers," Proc. 18th Ann. Int'l Conf. Supercomputing, pp. 68-78, June 2004.
62. E. Pinheiro, R. Bianchini, E.V. Carrera, and T. Heath, "Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems," Proc. Workshop Compilers and Operating Systems for Low Power, Sept. 2001.
63. E. Pinheiro, R. Bianchini, E.V. Carrera, and T. Heath, "Dynamic Cluster Reconfiguration for Power and Performance," Compilers and Operating Systems for Low Power, pp. 75-93, Kluwer Academic Publishers, 2003.
64. J. Pouwelse, K. Langendoen, and H. Sips, "Energy Priority Scheduling for Variable Voltage Processors," Proc. Int'l Symp. Low-Power Electronics and Design (ISPLED '01), Aug. 2001.
65. M. Schulz, B. White, S. McKee, H. Lee, and J. Jeitner, "Owl: Next-Generation System Monitoring," ACM Computing Frontiers, pp. 116-124, May 2005.
66. V. Sharma, A. Thomas, T. Abdelzaher, and K. Skadron, "Power-Aware QoS Management in Web Servers," Proc. 24th Ann. IEEE Real-Time Systems Symp., Dec. 2003.
67. T. Sherwood, E. Perelman, G. Hamerly, and B. Calder, "Automatically Characterizing Large Scale Program Behavior," Proc. Int'l Conf. Architectural Support for Programming Languages and Operating Systems Oct. 2002.
68. R.C. Springer IV, D.K. Lowenthal, B. Rountree, and V.W. Freeh, "Minimizing Execution Time in MPI Programs on an Energy-Constrained, Power-Scalable Cluster," Proc. ACM SIGPLAN Symp. Principles and Practice of Parallel Programming, Mar. 2006.
69. A. Vahdat, A. Lebeck, and C. Ellis, "Every Joule is Precious: The Case for Revisiting Operating System Design for Energy Efficiency," Proc. SIGOPS European Workshop, 2000.
70. M. Valluri and L.K. John, "Is Compiling for Performance = Compiling for Power?" Proc. Fifth Ann. Workshop Interaction between Compilers and Computer Architectures, 2001.
71. J.S. Vetter, "Performance Analysis of Distributed Applications Using Automatic Classification of Communication Inefficiencies," Proc. Int'l Conf. Supercomputing, pp. 245-254, May 2000.
72. M. Warren, E. Weigle, and W. Feng, "High-Density Computing: A 240-Node Beowulf in One Cubic Meter," Proc. Supercomputing '02, Nov. 2002.
73. A. Weissel, B. Beutel, and F. Bellosa, "Cooperative IO - A Novel IO Semantics for Energy-Aware Applications," Proc. Fifth Symp. Operating Systems Design and Implementation (OSDI '02), Dec. 2002.
74. J. Wilkes, "Predictive Power Consumption," Technical Report HPL-CSP-92-5, Hewlett-Packard Labs, Feb. 1992.
75. F.C. Wong et al., "Architectural Requirements and Scalability of the NAS Parallel Benchmarks," Proc. Supercomputing '99, Nov. 1999.
76. H. Yan, R. Krishnan, S.A. Watterson, D.K. Lowenthal, K. Li, and L.L. Peterson, "Client-Centered Energy and Delay Analysis for TCP Downloads," Proc. 14th IEEE Int'l Workshop Quality of Service, June 2004.
77. H. Zeng, C.S. Ellis, A.R. Lebeck, and A. Vahdat, "Currentcy: Unifying Policies for Resource Management," Proc. USENIX 2003 Ann. Technical Conf., June 2003.
78. Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wikes, "Hibernator: Helping Disk Arrays Sleep through the Winter," Proc. Symp. Operating Systems Principles, pp. 177-190, Oct. 2005.
79. Q. Zhu, F.M. David, C. Devaraj, Z. Li, Y. Zhou, and P. Cao, "Reducing Energy Consumption of Disk Storage Using Power-Aware Cache Management," Proc. 10th Int'l Symp. High-Performance Computer Architecture (HPCA-10), Feb. 2004.