Comprehensive, open-source resource usage measurement and analysis for HPC systems

Concurrency and Computation: Practice and Experience

Volumn 26, Issue 13, 2014, Pages 2191-2209

  Browne, James C ^a   Deleon, Robert L ^b   Patra, Abani K ^b   Barth, William L ^c   Hammond, John ^c   Jones, Matthew D ^b   Furlani, Thomas R ^b   Schneider, Barry I ^d   Gallo, Steven M ^b   Ghadersohi, Amin ^b   Gentner, Ryan J ^b   Palmer, Jeffrey T ^b   Simakov, Nikolay ^b   Innus, Martins ^b   Bruno, Andrew E ^b   White, Joseph P ^b   Cornelius, Cynthia D ^b   Yearke, Thomas ^b   Marcus, Kyle ^b   Von Laszewski, Gregor ^e   Wang, Fugang ^e   more..

^a University of Texas at Austin   (United States)

^b UNIVERSITY AT BUFFALO   (United States)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^d NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^e INDIANA UNIVERSITY   (United States)

Author keywords

HPC resource management; performance analysis; SUPReMM; system management; TACC Stats; usage analysis; XDMoD; XSEDE

Indexed keywords

CLUSTER COMPUTING; COST ENGINEERING; DIGITAL STORAGE; MAPPING; METADATA; NATURAL RESOURCES MANAGEMENT; OPEN SYSTEMS; RHENIUM COMPOUNDS; SCHEDULING; SUPERCOMPUTERS;

PERFORMANCE ANALYSIS; RESOURCE MANAGEMENT; SUPREMM; SYSTEM MANAGEMENT; TACC-STATS; USAGE ANALYSIS; XDMOD; XSEDE;

INFORMATION MANAGEMENT;

EID: 84905102995     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.3245     Document Type: Conference Paper

References (28)

1. Hammond J,. TACC-stats: I/O performance monitoring for the intransigent. 2011 Workshop for Interfaces and Architectures for Scientific Data Storage (IASDS), 2011.
2. Available from: http://github.com/TACCProjects/tacc/stats [accessed on 21 Febuary 2014].
3. Furlani TR, Jones MD, Gallo SM, Bruno AE, Lu C-D, Ghadersohi A, Gentner RJ, Patra A, DeLeon RL, von Laszewski G, Wang F, Zimmerman A,. Performance metrics and auditing framework using application kernels for high performance computer systems. Concurrency and Computation: Practice and Experience 2013; 25 (7): 918. [Online]. Available from: http://dx.doi.org/10.1002/cpe.2871 XDMoD: http://xdmod.ccr.buffalo.edu; Open XDMoD: http://xdmod.sourceforge.net/ [accessed on 21 Febuary 2014].
4. Furlani TR, Schneider BI, Jones MD, Towns T, Hart DL, Gallo SM, DeLeon RL, Lu C-D, Ghadersohi A, Gentner RJ, Patra AK, von Laszewski G, Wang F, Palmer JT, Simakov N,. Using XDMoD to facilitate XSEDE operations, planning and analysis. Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery (XSEDE '13), ACM, New York, NY, USA, 2013; Article 46, 8. DOI: 10.1145/2484762.2484763
5. Available from: http://sebastien.godard.pagesperso-orange.fr [accessed on 21 Febuary 2014].
6. Del Vento D, Engel T, Ghosh S, Hart D, Kelly R, Liu S, Valent R,. System-level monitoring of floating-point performance to improve effective system utilization. International Conference for High Performance Computing, Networking, Storage and Analysis, 2011.
7. Brandt J, Gentile A, Thompson D,. Develop feedback system for intelligent dynamic resource allocation to improve application performance. SAND2011-6301, 2011.
8. Brandt J, Debusschere B, Gentile A, Mayo J, Pebay P, Thompson D, Wong M,. OVIS-2: a robust distributed architecture for scalable RAS. 22nd IEEE International Parallel and Distributed Processing Symposium, 4th Workshop of System Management Techniques, Processes, and Services, 2008.
9. Huck KA, Malony AD, Shende S, Morris A,. Knowledge support and automation for performance analysis with PerfExplorer 2.0. Large-Scale Programming Tools and Environments, Special Issue of Scientific Programming 2008; 16 (2-3): 123-134.
10. Shende S, Malony A,. The Tau parallel performance system. International Journal of High Performance Computing Applications 2006; 20 (2): 287-311.
11. Tau. Available from: http://www.cs.uoregon.edu/research/tau/home.php [accessed on 21 Febuary 2014].
12. Tallent NR, Mellor-Crummey JM, Adhianto L, Fagan MW, Krentel M,. HPCToolkit: performance tools for scientific computing. Journal of Physics: Conference Series 2008; 125: 012088.
13. HPCToolkit. Available from: http://www.hpctoolkit.org/ [accessed on 21 Febuary 2014].
14. Djoudi L, Barthou D, Carribault P, Lemuet C, Acquaviva JT, Jalby J,. Exploring application performance: a new tool for a static/dynamic approach. The Sixth Los Alamos Comp. Science Institute Symp., 2005.
15. Open|SpeedShop. Available from: http://www.openspeedshop.org/wp/ [accessed on 21 Febuary 2014].
16. Geimer M, Saviankou P, Strube A, Szebenyi Z, Wolf F, Wylie BJN,. Further improving the scalability of the Scalasca toolset. Proc. of PARA 2010: State of the Art in Scientific and Parallel Computing, Part II: Minisymposium Scalable tools for High Performance Computing, Reykjavik, Iceland, June 6-9 2010, volume 7134 of Lecture Notes in Computer Science, Springer, 2012; 463-474.
17. VTune. Available from: http://software.intel.com/intel-vtune-amplifier-xe [accessed on 21 Febuary 2014].
18. Miller BP, Callaghan MD, Cargille JM, Hollingsworth JK, Irvin RB, Karavanic KL, Kunchithapadam K, Newhall T,. The Paradyn parallel performance measurement tool. IEEE Computer 1995; 28: 37-46.
19. Burtscher M, Kim BD, Diamond J, McCalpin J, Koesterke L, Browne J,. PerfExpert: an easy-to-use performance diagnosis tool for HPC applications. SC2010 Int. Conference for High-Performance Computing, Networking, Storage and Analysis, November 2010.
20. PerfExpert. Available from: http://www.tacc.utexas.edu/perfexpert/ [accessed on 21 Febuary 2014].
21. HOPSA-Holistic Performance System Analysis. Available from: http://www.vi-hps.org/projects/hopsa/overview [accessed on 21 Febuary 2014].
22. Threadspotter. Available from: http://www.roguewave.com/products/ threadspotter.aspx [accessed on 21 Febuary 2014].
23. Scalasca. Available from: http://www.scalasca.org/ [accessed on 21 Febuary 2014].
24. Paraver. Available from: http://www.bsc.es/computer-sciences/performance- tools/paraver [accessed on 21 Febuary 2014].
25. Vampir. Available from: http://www.vampir.eu/ [accessed on 21 Febuary 2014].
26. Bennett PM,. Sustained systems performance monitoring at the U.S. Department of Defense High Performance Computing Modernization Program. State of the Practice Reports, ser. SC '11, New York, NY, USA, ACM, 2011; 3:1-3:11. [Online]. Available from: http://doi.acm.org/10.1145/2063348.2063352
27. Chuah E, Jhumka A, Narasimhamurthy S, Browne JC, Hammond J, Barth W,. Linking resource usage anomalies with system failures from Cluster Log Data. Proc. Symposium on Reliable Distributed Systems, September 2013.
28. Scott DW,. Multivariate Density Estimation. Wiley: New York, 1992.