Strategies for energy-efficient resource management of hybrid programming models

IEEE Transactions on Parallel and Distributed Systems

Volumn 24, Issue 1, 2013, Pages 144-157

  Li, Dong ^a   De Supinski, Bronis R ^b   Schulz, Martin ^b   Nikolopoulos, Dimitrios S ^c,d   Cameron, Kirk W ^e  

^a OAK RIDGE NATIONAL LABORATORY   (United States)

^b LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^c QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

^d INSTITUTE OF COMPUTER SCIENCE   (Greece)

^e State University   (United States)

Author keywords

dynamic concurrency throttling; dynamic voltage and frequency scaling; hybrid parallel programming models; Power management

Indexed keywords

DYNAMIC VOLTAGE AND FREQUENCY SCALING; ENERGY EFFICIENT; FREQUENCY CONFIGURATION; HYBRID MODEL; HYBRID PARALLEL PROGRAMMING MODEL; HYBRID PROGRAMMING MODEL; MULTI CORE; NOVEL ALGORITHM; PARALLEL APPLICATION; PERFORMANCE GAIN; PERFORMANCE LOSS; POTENTIAL SOLUTIONS; POWER MANAGEMENTS; POWER-AWARE; PREDICTIVE MODELS; PROGRAMMING MODELS; RESOURCE CONFIGURATIONS; RESOURCE MANAGEMENT; RESOURCE UTILIZATIONS; SCIENTIFIC APPLICATIONS; SHARED MEMORIES; SUBSTANTIAL ENERGY; TIME REQUIREMENTS;

ALGORITHMS; BENCHMARKING; ENERGY EFFICIENCY; ENERGY MANAGEMENT; LARGE SCALE SYSTEMS; OPTIMIZATION;

MULTICORE PROGRAMMING;

EID: 84870895827     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2012.95     Document Type: Article

References (28)

1. OpenMP Architecture Rev. Board, "OpenMP Fortran/C/C++ Application Programming Interface, " version 3. 0, May 2008.
2. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. Dongarra, MPI: The Complete Reference, second ed ., vol. 1. MIT Press, 1998.
3. R. Rabenseifner and G. Wellein, "Communication and Optimization Aspects of Parallel Programming Models on Hybrid Architectures, " Int'l J. High Performance Computing Applications, vol. 17, no. 1, pp. 49-62, 2003.
4. M. Curtis-Maury, J. Dzierwa, C. D. Antonopoulos, and D. S. Nikolopoulos, "Online Power-Performance Adaptation of Multithreaded Programs Using Hardware Event-Based Prediction, " Proc. 20th ACM Int'l Conf. Supercomputing, pp. 157-166, 2006. (Pubitemid 47168502)
5. M. A. Suleman, M. K. Qureshi, and Y. N. Patt, "Feedback-Driven Threading: Power-Efficient and High-Performance Execution of Multithreaded Workloads on CMPs, " Proc. 13th ACM Symp. Architectural Support for Programming Languages and Operating Systems, pp. 277-286, 2008. (Pubitemid 351585413)
6. M. Curtis-Maury, F. Blagojevic, C. D. Antonopoulos, and D. S. Nikolopoulos, "Prediction-Based Power-Performance Adaptation of Multithreaded Scientific Codes, " IEEE Trans. Parallel and Distributed Systems, vol. 19, no. 10, pp. 1396-1410, Oct. 2008.
7. A. Miyoshi, C. Lefurgy, E. V. Hensbergen, R. Rajamony, and R. Rajkumar, "Critical Power Slope: Understanding the Runtime Effects of Frequency Scaling, " Proc. 16th Ann. ACM Int'l Conf. Supercomputing, pp. 35-44, 2002. (Pubitemid 35039982)
8. H. Chung-Hsing and F. Wu-Chun, "A Power-Aware Run-Time System for High-Performance Computing, " Proc. ACM/IEEE Conf. Supercomputing (SC '05), 2005.
9. C. Isci and M. Martonosi, "Runtime Power Monitoring in High-End Processors: Methodology and Empirical Data, " Proc. 36th Int'l Symp. Microarchitecture, pp. 93-104, 2003.
10. V. Freeh, N. Kappiah, D. Lowenthal, and T. Bletsch, "Just-In-Time Dynamic Voltage Scaling: Exploiting Inter-node Slack to Save Energy in MPI Programs, " Proc. Ann. ACM/IEEE Int'l Conf. Supercomputing (SC '05), 2005.
11. Y. Dong, J. Chen, X. Yang, L. Deng, and X. Zhang, "Energy-Oriented OpenMP Parallel Loop Scheduling, " Proc. Int'l Symp. Parallel and Distributed Processing with Applications, 2008.
12. N. Kappiah, V. Freeh, and D. Lowenthal, "Just in Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs, " Proc. ACM/IEEE Conf. Supercomputing (SC '05), 2005.
13. M. Curtis-Maury, A. Shah, F. Blagojevic, D. S. Nikolopoulos, B. R. de Supinski, and M. Schulz, "Prediction Models for Multi-Dimensional Power-Performance Optimization on Many Cores, " Proc. 17th Int'l Conf. Parallel Architectures and Compilation Techniques (PACT), pp. 250-259, 2008.
14. R. Springer, D. Lowenthal, B. Rountree, and V. Freeh, "Minimizing Execution Time in MPI Programs on an Energy-Constrained, Power-Scalable Cluster, " Proc. 11th ACM SIGPLAN Symp. Principles and Practice of Parallel Programming (PPoPP), pp. 230-238, 2006. (Pubitemid 44758693)
15. B. Rountree, D. Lowenthal, S. Funk, V. Freeh, B. R. de Supinski, and M. Schulz, "Bounding Energy Consumption in Large-Scale MPI Programs, " Proc. ACM/IEEE Conf. Supercomputing (SC '07), 2007.
16. V. Freeh and D. Lowenthal, "Using Multiple Energy Gears in MPI Programs on a Power-Scalable Cluster, " Proc. 11th ACM SIGPLAN Symp. Principles and Practice of Parallel Programming (PPoPP), pp. 164-173, 2007. (Pubitemid 43182843)
17. B. Rountree, D. K. Lownenthal, B. R. de Supinski, M. Schulz, V. W. Freeh, and T. Bletsch, "Adagio: Making DVS Practical for Complex HPC Applications, " Proc. 23rd Int'l Conf. Supercomputing, pp. 460-469, 2009.
18. Lawrence Livermore Nat'l Laboratory, "ASC Sequoia Benchmarks, " https://asc. llnl. gov/sequoia/benchmarks, 2012.
19. M. Silvano and P. Toth, Knapsack Problems: Algorithms and Computer Implementations. John Wiley and Sons, 1990.
20. T. Horvath and K. Skadron, "Multi-Mode Energy Management for Multi-Tier Server Clusters, " Proc. 17th Int'l Conf. Parallel Architectures and Compilation Techniques (PACT), pp. 270-279, 2008.
21. T. Li and L. K. John, "Run-Time Modeling and Estimation of Operating System Power Consumption, " Proc. ACM SIGMETRICS Int'l Conf. Measurements and Modeling of Computer Systems, pp. 160-171, 2003.
22. B. Mohr, A. D. Malony, S. Shende, and F. Wolf, "Design and Prototype of a Performance Tool Interface for OpenMP, " Proc. Ann. Los Alamos Computer Science Inst. Symp. (LACSI), 2001.
23. NASA, "NAS Parallel Benchmarks, " http://www. nas. nasa. gov/Resources/Software/npb. html, 2012.
24. H. Jin and R. Van der Wijingaart, "Performance Characteristics of the Multi-Zone NAS Parallel Benchmarks, " Proc. 18th Int'l Parallel and Distributed Processing Symp. (IPDPS), 2004.
25. V. E. Henson and U. M. Yang, "BoomerAMG: A Parallel Algebraic Multigrid Solver and Preconditioner, " Applied Numerical Math ., vol. 41, pp. 155-177, 2000.
26. C. Liao and B. Chapman, "A Compile-Time Cost Model for OpenMP, " Proc. 21st Int'l Parallel and Distributed Proceeding Symp ., 2007.
27. G. Tournavitis, Z. Wang, B. Franke, and M. F. O0Boyle, "Towards a Holistic Approach to Auto-Parallelization Integrating Profile-Driven Parallelism Detection and Machine-Learning Based Mapping, " Proc. ACM SIGPLAN Conf. Programming Language Design and Implementation, pp. 177-187, 2009.
28. S. W. Son, K. Malkowski, G. Chen, M. Kandemir, and P. Raghavan, "Reducing Energy Consumption of Parallel Sparse Matrix Applications through Integrated Link/CPU Voltage Scaling, " J. Supercomputing, vol. 41, no. 3, pp. 179-213, 2007. (Pubitemid 47115199)