Performance metrics and auditing framework using application kernels for high-performance computer systems

Concurrency and Computation: Practice and Experience

Volumn 25, Issue 7, 2013, Pages 918-931

  Furlani, Thomas R ^a   Jones, Matthew D ^a   Gallo, Steven M ^a   Bruno, Andrew E ^a   Lu, Charng Da ^a   Ghadersohi, Amin ^a   Gentner, Ryan J ^a   Patra, Abani ^a   Deleon, Robert L ^a   Von Laszewski, Gregor ^b   Wang, Fugang ^b   Zimmerman, Ann ^c  

^a UNIVERSITY AT BUFFALO   (United States)

^b INDIANA UNIVERSITY   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

application kernels; HPC Metrics; HPCMoD; UBMoD; XDMoD; XSEDE

Indexed keywords

HPC METRICS; HPCMOD; UBMOD; XDMOD; XSEDE;

HUMAN RESOURCE MANAGEMENT;

EID: 84876458208     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.2871     Document Type: Article

References (58)

1. Nagios: The Industry Standard. IT Infrastructure Monitoring: (Available from: http://www.nagios.org/ [August 19, 2011]).
2. Matthew L, Massie B, Chun N, Culler DE,. The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing 2004; 30 (8): 817-840.
3. Cacti: The Complete RRDTool-based Graphing Solution. (Available from: http://www.cacti.net/ [August 19, 2011]).
4. Smallen S, Olschanowsky C, Ericson K, Beckman P, Schopf J,. The Inca test harness and reporting framework, Proceedings of Supercomputing, Pittsburg PA, 2004; 55-64. See also: Inca. http://inca.sdsc.edu [September 1, 2011].
5. Hawkeye: A Monitoring and Management Tool for Distributed Systems. (Available from: http://www.cs.wisc.edu/condor/hawkeye/ [August 19, 2011]).
6. Laszewski V,. Grid Usage Sensor Service. (Available from: http://128.150.4.107/awardsearch/showAward.do?AwardNumber=0414407 [August 19, 2011]).
7. Martin S, Lane P, Foster I, Christie M,. TeraGrid's GRAM Auditing & Accounting, & Its Integration with the LEAD Science Gateway, TeraGrid Workshop, 2007. (Available from: http://www.globus.org/alliance/publications/ papers/TG\-GRAM\-auditing\-and\-LEAD\-Gateway\-final\-2.pdf [August 19, 2011]).
8. GPIR. (Available from: http://www.tacc.utexas.edu/projects/gpir.php [September 8, 2011]).
9. TeraGrid Knowledge Base: How can I check my TeraGrid account balance? Available from: [October 28, 2008]).
10. TeraGrid Knowledge Base: How can I tell if a TeraGrid resource is available? (Available from: [May 16, 2008]).
11. TeraGrid Traffic Map. (Available from: https://network.teragrid.org/ trafmap/ [August 19, 2011]).
12. TeraGrid Information Services. (Available from: [September 8, 2011]).
13. TeraGrid Knowledge Base: On the TeraGrid, how do I convert service units on one platform to the equivalent amount on another platform? (Available from: [October 28, 2008]).
14. TeraGrid Knowledge Base: What is Inca? (Available from: [May 22, 2008]).
15. TeraGrid Knowledge Base: How does Inca work? (Available from: [July 21, 2008]).
16. Reporters and Reporter Repositories. (Available from: [August 19, 2011]).
17. (Available from: http://inca.sdsc.edu/repository/latest/cgi-bin/list\- reporters.cgi [September 8, 2011]).
18. TeraGrid Knowledge Base: What is pfmon, and can I run it on the TeraGrid? (Available from: [September 18, 2008]).
19. Katz DS, Hart D, Jordon C, Majumdar A, Navarro JP, Smith W, Towns J, Welch V, Wilkins-Diehr N,. Cyberinfrastructure usage modalities on the TeraGrid. IEEE International Parallell & Distributed Processing Symposium, Anchorage AK, 2011; 932, DOI: 10.1109/1PDPS.2011.239.
20. Hart DL,. Measuring TeraGrid: workload characterization for an HPC federation. IJHPCA 2011; 25 (4): 451-465. DOI: 10.1177/1094342010394382. Advance online publication, Feb. 10, 2011.
21. Hart DL,. Deep and wide metrics for HPC resource capability and project usage, SC11 state of the practice reports (Seattle, WA), 2011. DOI: 10.1145/2063348.2063350.
22. TeraGrid Knowledge Base: What is PAPI, and where is it installed on the TeraGrid? (Available from: [October 17, 2008]).
23. Canal P, Green C,. GRATIA, a resource accounting system for OSG. CHEP, Victoria, B.C., 2007.
24. DOD HPC modernization program metrics. (Available from: http://www.hpcmo.hpc.mil/Htdocs/HPCMETRIC/index.html [December 16, 2011]).
25. Bennett PM,. Sustained systems performance monitoring at the U. S. Department of Defense high performance computing modernization program. In State of the Practice Reports (SC '11), Article 3, ACM: New York, NY, USA, 2011; 11 pages, DOI: 10.1145/2063348.2063352. http://doi.acm.org/10.1145/2063348.2063352.
26. NERSC performance monitoring tools. (Available from: https://www.nersc. gov/research-and-development/performance-and-monitoring-tools/ [December 16, 2011]).
27. DOE "operational assessment" metrics for various HPC sites, for example ORNL. (Available from: http://info.ornl.gov/sites/publications/files/ Pub32006.pdf [December 16, 2011]).
28. University at Buffalo Metrics on Demand (UBMoD): Open source data warehouse and web portal for mining statistical data from resource managers in high-performance computing environments. Developed at the Center for Computational Research at the University at Buffalo, SUNY. Freely available under an open source license at SourceForge at http://ubmod.sourceforge.net/ [May 1, 2012].
29. TORQUE Resource Manager. (Available from http://en.wikipedia.org/wiki/ TORQUE-Resource-Manager, a fork of OpenPBS that is maintained by Adaptive Computing Enterprises, Inc. (http://www.adaptivecomputing.com/)).
30. OpenPBS. (Available from http://www.mcs.anl.gov/research/projects/ openpbs/, http://en.wikipedia.org/wiki/Portable-Batch-System,andhttp://www. pbsworks.com/).
31. SGE (Sun Grid Engine), now known as Oracle Grid Engine. (Available from http://en.wikipedia.org/wiki/Oracle-Grid-Engine, http://gridscheduler. sourceforge.net/).
32. Apon A, Ahalt S, Dantuluri V, Gurdgiew C, Limayem M, Ngo L, Stealey M,. High performance computing instrumentation and research productivity in U.S. universities. Journal of Information Technology Impact 2010; 10 (2): 87-98.
33. Elmasri R, Navathe SB,. Fundamentals of Database Systems. Pearson Education: New York, 2004. Print.
34. Levene M, Loizou G,. Why is the snowflake schema a good data warehouse design? Information Systems 2003; 28 (3): 225-240. DOI: 10.1016/S0306-4379(02) 00021-2. http://dx.doi.org/10.1016/S0306-4379(02)00021-2.
35. Moody DL, Kortink MAR,. From: ER models to dimensional models: bridging the gap between OLTP and OLAP design. Journal of Business Intelligence Summer(2003); 8: 3.
36. Lin B (Betsy), Hong Y, Lee Z-H,. Data warehouse performance. In Encyclopedia of Data Warehousing and Mining, Wang John, (ed.), 2nd edn. IGI Global: Hershey, PA, 2009; 318-322.
37. Fielding R,.Architectural styles and the design of network-based software architectures retrieved from http://www.ics.uci.edu/~fielding/pubs/ dissertation/top.htm, 2000.
38. ExtJS Website. (Available from: http://www.sencha.com/products/extjs/ [May 25, 2012]).
39. Krasner GE, Pope ST,. A cookbook for using the model-view controller user interface paradigm in smalltalk-80. J. Object Oriented Programming 1988; 1 (3): 26-49.
40. Buschmann F, Meunier R, Rohnert H, Sommerlad P, Stal M,. Pattern-Oriented Software Architecture, A System of Patterns. John Wiley & Sons: New York, 1996.
41. Valiev M, Bylaska EJ, Govind N, Kowalski K, Straatsma TP, van Dam HJJ, Wang D, Nieplocha J, Apra E, Windus TL, de Jong WA,. NWChem: a comprehensive and scalable open-source solution for large scale molecular simulations. Computer Physics Communications 2010; 181: 1477.
42. (Available from: http://www.nwchem-sw.org [December 16, 2011]).
43. Schmidt MW, Baldridge KK, Boatz JA, Elbert TS, Gordon MS, Jensen JH, Koseki S, Matsunaga N, Nguyen KA, Su S, Windus TL, Dupuis M, Montgomery JA,. General atomic and molecular electronic structure system. Journal of Computational Chemistry 1993; 14: 1347-1363.
44. Gordon MS, Schmidt MW,. Advances in electronic structure theory: GAMESS a decade later. In Theory and Applications of Computational Chemistry: the First Forty Years, Dykstra CE, Frenking G, Kim KS, G. E. Scuseria GE, (eds). Elsevier: Amsterdam; 2005; 1167-1189.
45. (Available from: http://www.msg.ameslab.gov/gamess [December 16, 2011]).
46. Phillips JC, Braun R, Wang W, Gumbart J, Tajkhorshid E, Villa E, Chipot C, Skeel RD, Kale L, Schulten K,. Scalable molecular dynamics with NAMD. Journal of Computational Chemistry 2005; 26: 1781-1802. DOI: 10.1002/jcc.20289.
47. (Available from: http://www.ks.uiuc.edu/Research/namd [December 16, 2011]).
48. Skamarock WC, Klemp JB, Dudhia J, Gill DO, Barker M, Duda KG, Huang XY, Wang W, Powers JG,. A description of the advanced research WRF version 3. Technical Report, National Center for Atmospheric Research, NCAR/TN-475+STR, 2008. (Available from: http://www.wrf-model.org).
49. (Available from: http://www.cesm.ucar.edu [May 25, 2012]).
50. McCalpin JD,. Memory bandwidth and machine balance in current high performance computers. IEEE Computer Society Technical Committee on Computer Architecture (TCCA) Newsletter, December 1995.
51. (Available from: http://www.cs.virginia.edu/stream/ref.html [May 25,2012]).
52. OSU Micro Benchmarks 3.3. (Available from: http://mvapich.cse.ohio-state. edu/benchmarks/ [September 1, 2011]). See also: Intel MPI Benchmarks 3.2.2. (Available from: http://software.intel.com/en-us/articles/intel-mpi-benchmarks [September 1, 2011]).
53. Petitet A, Whaley RC, Dongarra J, Cleary A,.HPL-a portable implementation of the high-performance linpack Benchmark for distributed-memory computers. (Available from: http://netlib.org/benchmark/hpl [September 1, 2011]).
54. Murphy RC, Wheeler KB, Barrett BW, Ang JA,. Introducing the Graph 500. Cray User's Group (CUG), May 5, 2010. (Available from: http://www.graph500.org/ [May 25, 2012]).
55. Asanovic K, Bodik R, Catanzaro B, Gebis J, Husbands P, Keutzer K, Patterson D, Plishker W, Shalf J, Williams S, Yelik K,. The landscape of parallel computing research: a view from Berkeley. Technical Report UCB/EECS-2006-183, EECS Department, University of California at Berkeley, December 2006.
56. Ahern SD, Alam SR, Fahey MR, Hartman-Baker RJ, Barrett RF, Kendall RA, Kothe DB, Messer OEB, Mills RT, Sankaran R, Tharrington AN, White JB, III,. Scientific application requirements for leadership computing at the exascale. Proceedings of the 2008 Cray User Group Meeting, Helsinki, Finland, May 5-8, 2008. Also available as ORNL/TM-2007/238.
57. Dwarf Mine. (Available from: http://view.eecs.berkeley.edu/wiki/Dwarf\- Mine [September 1, 2011]).
58. Furlani TR, Schneider BI, Jones MD, Towns J, Hart DL, Patra AK, DeLeon RL, Gallo SM, Lu C, Ghadersohi A, Gentner RJ, Bruno AE, Boisseau JR, Wang F, von Laszewski G,. Data analytics driven cyberinfrastructure operations, planning and analysis using XDMoD. submitted SC12 Conference, Salt Lake City, Utah, November 2012.