Using XDMoD to facilitate XSEDE operations, planning and analysis

ACM International Conference Proceeding Series

Volumn , Issue , 2013, Pages

  Furlani, Thomas R ^a   Schneider, Barry L ^b   Jones, Matthew D ^a   Towns, John ^c   Hart, David L ^d   Gallo, Steven M ^a   Deleon, Robert L ^a   Lu, Charng Da ^a   Ghadersohi, Amin ^a   Gentner, Ryan J ^a   Patra, Abani K ^e   Laszewski, Gregor Von ^f   Wang, Fugang ^f   Palmer, Jeffrey T ^a   Simakov, Nikolay ^a  

^a UNIVERSITY AT BUFFALO   (United States)

^b NATIONAL SCIENCE FOUNDATION   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^d NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^e the State University of New York   (United States)

^f Pervasive Technology Institute   (United States)

Author keywords

Application kernels; CI performance metrics; HPC metrics; Technology audit service; XDMoD; XSEDE

Indexed keywords

HPC METRICS; PERFORMANCE METRICS; TECHNOLOGY AUDIT; XDMOD; XSEDE;

FILE ORGANIZATION; MANAGEMENT; QUALITY OF SERVICE; QUANTUM CHEMISTRY; TOOLS;

APPLICATION PROGRAMS;

EID: 84882386120     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2484762.2484763     Document Type: Conference Paper

References (24)

1. Nagios: The Industry Standard. IT Infrastructure Monitoring: (Available from: http://www.nagios.org/[August 19, 2011]).
2. Matthew, L., Massie, B., Chun, N., Culler, D. E., The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing 2004; 30(8): 817-840.
3. Cacti: The Complete RRDTool-based Graphing Solution. (Available from: http://www.cacti.net/[August 19, 2011]).
4. Smallen, S., Olschanowsky, C., Ericson, K., Beckman, P., Schopf, J., The Inca test harness and reporting framework. Proceedings of Supercomputing, Pittsburg PA, 2004; 55-64. See also: Inca. http://inca.sdsc.edu [September 1, 2011].
5. Hawkeye: A Monitoring and Management Tool for Distributed Systems. (Available from: http://www.cs.wisc.edu/condor/hawkeye/[August 19, 2011]).
6. von Laszewski, G., J. DiCarlo, and B. Allcock, "A Portal for Visualizing Grid Usage, " Concurrency and Computation: Practice and Experience, vol. 19, iss. 12, pp. 1683-1692, [2007].
7. Martin, S., Lane, P., Foster, I., Christie, M.. TeraGrid's GRAM Auditing & Accounting, & Its Integration with the LEAD Science Gateway, TeraGrid Workshop, 2007. (Available from: http://www.globus.org/alliance/publications/ papers/TG-GRAM-auditing-and-LEAD-Gateway-final-2.pdf [August 19, 2011]).
8. Canal, P., Green, C., GRATIA, a resource accounting system for OSG. CHEP, Victoria, B.C., 2007.
9. DOD HPC modernization program metrics. (Available from: http://www.hpcmo.hpc.mil/Htdocs/HPCMETRIC/index.html [Dec16, 2011]).
10. Bennett, P.M., Sustained systems performance monitoring at the U. S. Department of Defense high performance computing modernization program. In State of the Practice Reports (SC '11), Article 3. ACM: New York, NY, USA, 2011; 11 pages, DOI: 10.1145/2063348.2063352. http://doi.acm.org/10.1145/2063348.2063352.
11. NERSC performance monitoring tools. (Available fromhttps://www.nersc.gov/ research-and-development/performance-andmonitoring-tools/[December 16, 2011]).
12. DOE "operational assessment" metrics for various HPC sites, for example ORNL. http://info.ornl.gov/sites/publications/files/Pub32006.pdf [December 16, 2011]).
13. University at Buffalo Metrics on Demand (UBMoD): Open source web portal for mining data from resource managers in HPC environments. Developed at the Center for Computational Research at the University at Buffalo, SUNY. Freely available at SourceForge at http://ubmod.sourceforge.net/[May 1, 2012].
14. Furlani, T.R., Jones, M.D., Gallo, S.M., Bruno, A.E., Lu, C.-D., Ghadersohi, A., Gentner, R.J., Patra, A., DeLeon, R.L., von Laszewski, G., Wang, F., and Zimmerman, A., "Performance metrics and auditing framework using application kernels for high performance computer systems, " Concurrency and Computation: Practice and Experience, vol. 25, pp.918-931, 2013. [Online]. Available: http://dx.doi.org/10.1002/cpe.2871.
15. University at Buffalo, "XDMoD portal." [Online]. Available: https://xdmod.ccr.buffalo.edu.
16. Katz, D.S., Hart, D., Jordan, C., Majumdar, A., Navarro, J.P., Smith, W., Towns, J., Welch, V., and Wilkins-Diehr, N., "Cyberinfrastructure usage modalities on the TeraGrid, " in Proceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum, ser. IPDPSW '11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 932-939. [Online]. Available: http://dx.doi.org/10.1109/IPDPS.2011.239.
17. "XSEDE Overview." [Online]. Available: https://www.xsede.org/ overview.
18. Hart, D. L., "Measuring TeraGrid: workload characterization for a high-performance computing federation, " International Journal of High Performance Computing Applications, vol. 25, no. 4, pp. 451-465, 2011. [Online]. Available: http://hpc.sagepub.com/content/25/4/451.abstract.
19. Hart, D., "Deep and wide metrics for hpc resource capability and project usage, " in State of the Practice Reports, ser. SC '11. New York, NY, USA: ACM, 2011, pp. 1:1-1:7. [Online]. Available: http://doi.acm.org/10. 1145/2063348.2063350.
20. Bennett, P.M., "Sustained systems performance monitoring at the U.S. Department of Defense High Performance Computing Modernization Program, " in State of the Practice Reports, ser. SC '11. New York, NY, USA: ACM, 2011, pp. 3:1-3:11. [Online]. Available: http://doi.acm.org/10.1145/2063348.2063352.
21. Valiev, M., Bylaska, E., Govind, N., Kowalski, K., Straatsma, T., Dam, H.V., Wang, D., Nieplocha, J., Apra, E., Windus, T., and de Jong, W., "NWchem: A comprehensive and scalable open-source solution for large scale molecular simulations, " Computer Physics Communications, vol. 181, no. 9, pp. 1477-1489, 2010. [Online]. Available: http://www.sciencedirect.com/science/ article/pii/S0010465510001438.
22. Hammond, J., "TACC Stats I/O performance monitoring for the intransigent, " 2011, in 2011 Workshop for Interfaces and Architectures for Scientific Data Storage, IASDS 2011. Available: http://www.mcs.anl.gov/events/ workshops/iasds11/presentations/jhammond-iasds.pdf.
23. Hadri, B., You, H., Moore, S., "Achieve better performance with PEAK on XSEDE resources", XSEDE '12 Proceedings of the 1st Conference of the XSEDE: Bridging from the eXtreme to the campus and beyond, Article 10 (2012): DOI =10.1145/2335755.2335801.
24. von Laszewski, G., Lee, H., Diaz, J., Wang, F., Tanaka, K., Karavinkoppa, S., Fox, G. C., and Furlani, T., "Design of an Accounting and Metric-based Cloud-shifting and Cloud-seeding framework for Federated Clouds and Bare-metal Environments, ", San Jose, CA., [September, 2012].