Practical resource management in power-constrained, high performance computing

HPDC 2015 - Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing

Volumn , Issue , 2015, Pages 121-132

  Patki, Tapasya ^a   Lowenthal, David K ^a   Sasidharan, Anjana ^b   Maiterth, Matthias ^c   Rountree, Barry L ^d   Schulz, Martin ^d   De Supinski, Bronis R ^d  

^a UNIVERSITY OF ARIZONA   (United States)

^b AMAZON   (United States)

^c UNIVERSITY OF MUNICH   (Germany)

^d LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

Author keywords

Power constrained HPC; Resource Management

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS; ELECTRIC POWER UTILIZATION; NATURAL RESOURCES MANAGEMENT; POWER MANAGEMENT; SUPERCOMPUTERS; TURNAROUND TIME;

ADAPTIVE POLICY; APPLICATION PERFORMANCE; HIGH PERFORMANCE COMPUTING; OVER PROVISIONING; POWER-CONSTRAINED HPC; RESEARCH CHALLENGES; RESOURCE MANAGEMENT; RESOURCE MANAGERS;

RESOURCE ALLOCATION;

EID: 84987740923     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2749246.2749262     Document Type: Conference Paper

References (47)

1. NASA Advanced Supercomputing Division, NAS Parallel Benchmark Suite v3.3. 2006. http://www.nas.nasa.gov/Resources/Software/npb.html.
2. Top500 Supercomputer Sites. November 2014. http://www.top500.org/lists/2014/11.
3. NPFA 70. National Electric Code 2014. http://www.nfpa.org/codes-and-standards/document-information-pages?mode=code&code=70.
4. Anat Batat and Dror Feitelson. Gang Scheduling with Memory Considerations. In International Symposium on Parallel and Distributed Processing Symposium, pages 109-114, 2000.
5. Deva Bodas, Justin Song, Murali Rajappa, and Andy Hoffman. Simple Power-aware Scheduler to Limit Power Consumption by HPC System Within a Budget. In Proceedings of the 2nd International Workshop on Energy Efficient Supercomputing, pages 21-30. IEEE Press, 2014.
6. Robert Davis and Alan Burns. A Survey of Hard Real-Time Scheduling Algorithms and Schedulability Analysis Techniques for Multiprocessor Systems. In Technical Report YCS-2009-443, Department of Computer Science, University of York, 2009.
7. Elmootazbellah Elnozahy, Michael Kistler, and Ramakrishnan Rajamony. Energy-Efficient Server Clusters. In Power-Aware Computer Systems, volume 2325 of Lecture Notes in Computer Science, pages 179-197. Springer Berlin Heidelberg, 2003.
8. Maja Etinski, Julita Corbalan, Jesus Labarta, and Mateo Valero. Optimizing Job Performance Under a Given Power Constraint in HPC Centers. In Green Computing Conference, pages 257-267, 2010.
9. Maja Etinski, Julita Corbalan, Jesus Labarta, and Mateo Valero. Utilization Driven Power-aware Parallel Job Scheduling. Computer Science-R&D, 25(3-4):207-216, 2010.
10. Maja Etinski, Julita Corbalan, Jesus Labarta, and Mateo Valero. Linear Programming Based Parallel Job Scheduling for Power Constrained Systems. In International Conference on High Performance Computing and Simulation, pages 72-80, 2011.
11. Maja Etinski, Julita Corbalan, Jesus Labarta, and Mateo Valero. Parallel Job Scheduling for Power Constrained HPC Systems. Parallel Computing, 38(12):615-630, December 2012.
12. Xiaobo Fan, Wolf-Dietrich Weber, and Luiz Andral' Barroso. Power Provisioning for a Warehouse-sized Computer. In The 34th ACM International Symposium on Computer Architecture, 2007.
13. Dror Feitelson. Job Scheduling in Multiprogrammed Parallel Systems, 1997.
14. Dror Feitelson. Workload Modeling for Performance Evaluation. In Performance Evaluation of Complex Systems: Techniques and Tools, Performance 2002, Tutorial Lectures, pages 114-141, London, UK, UK, 2002. Springer-Verlag.
15. Dror Feitelson and Morris Jette. Improved Utilization and Responsiveness with Gang Scheduling. In Job Scheduling Strategies for Parallel Processing, pages 238-261. Springer-Verlag LNCS, 1997.
16. Dror Feitelson and Larry Rudolph. Parallel Job Scheduling: Issues and Approaches. Job Scheduling Strategies for Parallel Processing, pages 1-18, 1995.
17. Dror Feitelson and Larry Rudolph. Towards Convergence in Job Schedulers for Parallel Supercomputers. In Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing, IPPS '96, pages 1-26, London, UK, UK, 1996. Springer-Verlag.
18. Dror Feitelson, Larry Rudolph, and Uwe Schwiegelshohn. Parallel Job Scheduling: A Status Report. In Job Scheduling Strategies for Parallel Processing, volume 3277 of Lecture Notes in Computer Science, pages 1-16. Springer Berlin Heidelberg, 2005.
19. Dror Feitelson, Larry Rudolph, Uwe Schwiegelshohn, Kenneth Sevcik, and Parkson Wong. Theory and Practice in Parallel Job Scheduling. Job Scheduling Strategies for Parallel Processing, pages 1-34, 1997.
20. Dror Feitelson, Uwe Schwiegelshohn, and Larry Rudolph. Parallel Job Scheduling-A Status Report. In In Lecture Notes in Computer Science, pages 1-16. Springer-Verlag, 2004.
21. Eitan Frachtenberg and Dror Feitelson. Pitfalls in Parallel Job Scheduling Evaluation. In Proceedings of the 11th International Conference on Job Scheduling Strategies for Parallel Processing, JSSPP'05, pages 257-282, Berlin, Heidelberg, 2005. Springer-Verlag.
22. Yiannis Georgiou, Thomas Cadeau, David Glesser, Danny Auble, Morris Jette, and Matthieu Hautreux. Energy Accounting and Control with SLURM Resource and Job Management System. In Distributed Computing and Networking, volume 8314 of Lecture Notes in Computer Science, pages 96-118. Springer Berlin Heidelberg, 2014.
23. Intel. Intel-64 and IA-32 Architectures Software Developer's Manual, Volumes 3A and 3B: System Programming Guide. 2011.
24. David Jackson, Quinn Snell, and Mark Clement. Core Algorithms of the Maui Scheduler. In Job Scheduling Strategies for Parallel Processing, volume 2221 of Lecture Notes in Computer Science, pages 87-102. Springer Berlin Heidelberg, 2001.
25. Ignacio Laguna, David F. Richards, Todd Gamblin, Martin Schulz, and Bronis R. de Supinski. Evaluating User-Level Fault Tolerance for MPI Applications. In Proceedings of the 21st European MPI Users' Group Meeting, EuroMPI/ASIA '14, pages 57:57-57:62, New York, NY, USA, 2014. ACM.
26. Lawrence Livermore National Laboratory. The ASCI Purple benchmark codes. http://www.llnl.gov/asci/purple/benchmarks/limited/code-list.html.
27. Lawrence Livermore National Laboratory. SPhot-Monte Carlo Transport Code. https://asc.llnl.gov/computing-resources/purple/archive/benchmarks/sphot/.
28. Barry Lawson and Evgenia Smirni. Power-aware Resource Allocation in High-end Systems via Online Simulation. In International onference on Supercomputing, pages 229-238, June 2005.
29. David Lifka. The ANL/IBM SP Scheduling System. In Job Scheduling Strategies for Parallel Processing, volume 949 of Lecture Notes in Computer Science, pages 295-303. Springer Berlin Heidelberg, 1995.
30. Ahuva W. Mu'alem and Dror Feitelson. Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling. Parallel and Distributed Systems, IEEE Transactions on, 12(6):529-543, 2001.
31. Trevor Mudge. Power: A First-class Architectural Design Constraint. IEEE Computer, 34(4):52-58, 2001.
32. Tapasya Patki, David K. Lowenthal, Barry Rountree, Martin Schulz, and Bronis R. de Supinski. Exploring Hardware Overprovisioning in Power-constrained, High Performance Computing. In International Conference on Supercomputing, pages 173-182, 2013.
33. Tapasya Patki, Anjana Sasidharan, Matthias Maiterth, David Lowenthal, Barry Rountree, Martin Schulz, and Bronis de Supinski. Practical Resource Management in Power-Constrained, High Performance Computing. TR 01-15, University of Arizona, January 2015. http://www.cs.arizona.edu/people/tpatki/tr01-15.pdf.
34. Antoine Petitet, Clint Whaley, Jack Dongarra, and Andy Cleary. High Performance Linpack. http://www.netlib.org/benchmark/hpl/.
35. Eduardo Pinheiro, Ricardo Bianchini, Enrique V. Carrera, and Taliver Heath. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. In Workshop on Compilers and Operating Systems for Low Power, 2001.
36. Barry Rountree, Dong H. Ahn, Bronis R. de Supinski, David K. Lowenthal, and Martin Schulz. Beyond DVFS: A First Look at Performance under a Hardware-Enforced Power Bound. In IPDPS Workshops (HPPAC), pages 947-953. IEEE Computer Society, 2012.
37. Osman Sarood. Optimizing Performance Under Thermal and Power Constraints for HPC Data Centers. PhD thesis, University of Illinois, Urbana-Champaign, December 2013.
38. Osman Sarood, Akhil Langer, Abhishek Gupta, and Laxmikant V. Kale. Maximizing Throughput of Overprovisioned HPC Data Centers Under a Strict Power Budget. In Supercomputing, November 2014.
39. Osman Sarood, Akhil Langer, Laxmikant V. Kale, Barry Rountree, and Bronis R. de Supinski. Optimizing Power Allocation to CPU and Memory Subsystems in Overprovisioned HPC Systems. In IEEE International Conference on Cluster Computing, pages 1-8, Sept 2013.
40. Sanjeev Setia, Mark S. Squillante, and Vijay K. Naik. The Impact of Job Memory Requirements on Gang-scheduling Performance. SIGMETRICS Perform. Eval. Rev., 26(4):30-39, March 1999.
41. Edi Shmueli and Dror Feitelson. Backfilling with Lookahead to Optimize the Performance of Parallel Job Scheduling. In Job Scheduling Strategies for Parallel Processing, volume 2862 of Lecture Notes in Computer Science, pages 228-251. Springer Berlin Heidelberg, 2003.
42. Joseph Skovira, Waiman Chan, Honbo Zhou, and David Lifka. The EASY LoadLeveler API Project. In Job Scheduling Strategies for Parallel Processing, volume 1162 of Lecture Notes in Computer Science, pages 41-47. Springer Berlin Heidelberg, 1996.
43. Srividya Srinivasan, Rajkumar Kettimuthu, Vijay Subramani, and P. Sadayappan. Selective Reservation Strategies for Backfill Job Scheduling. In Scheduling Strategies for Parallel Processing, LNCS 2357, pages 55-71. Springer-Verlag, 2002.
44. Dan Tsafrir, Yoav Etsion, and Dror Feitelson. Backfilling using System-generated Predictions Rather than User Runtime Estimates. Parallel and Distributed Systems, IEEE Transactions on, 18(6):789-803, 2007.
45. Andy Yoo, Morris Jette, and Mark Grondona. SLURM: Simple Linux Utility for Resource Management. In Job Scheduling Strategies for Parallel Processing, volume 2862 of Lecture Notes in Computer Science, pages 44-60. 2003.
46. Ziming Zhang, Michael Lang, Scott Pakin, and Song Fu. Trapped Capacity: Scheduling under a Power Cap to Maximize Machine-room Throughput. In Proceedings of the 2nd International Workshop on Energy Efficient Supercomputing, pages 41-50. IEEE Press, 2014.
47. Zhou Zhou, Zhiling Lan, Wei Tang, and Narayan Desai. Reducing Energy Costs for IBM Blue Gene/P via Power-Aware Job Scheduling. In Job Scheduling Strategies for Parallel Processing, Lecture Notes in Computer Science, pages 96-115. Springer Berlin Heidelberg, 2014.