Visual analysis of I/O system behavior for high-end computing

LSAP'11 - Proceedings of the 3rd International Workshop on Large-Scale System and Application Performance

Volumn , Issue , 2011, Pages 19-26

  Muelder, Christopher ^a   Sigovan, Carmen ^a   Ma, Kwan Liu ^a   Cope, Jason ^b   Lang, Sam ^b   Iskra, Kamil ^b   Beckman, Pete ^b   Ross, Robert ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

information visualization; parallel I O; performance analysis tools

Indexed keywords

DATA REQUIREMENTS; DIRECT ANALYSIS; DIRECT VISUALIZATION; DOMAIN SPECIFIC; GANTT CHART; HIGH-END COMPUTING; I/O SYSTEMS; INFORMATION VISUALIZATION; OPERATIONAL PATTERNS; PARALLEL FILE SYSTEM; PARALLEL I/O; PARALLEL I/O SYSTEMS; PARALLEL STORAGE SYSTEMS; PARALLEL SYSTEM; PERFORMANCE ANALYSIS; SCALE-UP; VISUAL ANALYSIS; VISUALIZATION METHOD;

FILE ORGANIZATION; INFORMATION SYSTEMS; LARGE SCALE SYSTEMS; SUPERCOMPUTERS; TRACE ANALYSIS; VISUALIZATION;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 79961037998     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1996029.1996036     Document Type: Conference Paper

References (41)

1. N. Ali, P. Carns, K. Iskra, D. Kempe, S. Lang, R. Latham, R. Ross, L. Ward, and P. Sadayappan. Scalable I/O forwarding framework for high-performance computing systems. In IEEE International Conference on Cluster Computing (Cluster 2009), 2009.
2. P. Beckman, K. Iskra, K. Yoshii, and S. Coghlan. Operating system issues for petascale systems. SIGOPS Oper. Syst. Rev., 40(2):29-33, 2006.
3. P. Braam. The Lustre storage architecture. http://www.lustre.org/docs/ lustre.pdf, 2004.
4. P. Carns, R. Latham, R. Ross, K. Iskra, S. Lang, and K. Riley. 24/7 characterization of petascale I/O workloads. In 2009 Workshop on Interfaces and Architectures for Scientific Data Storage, 2009.
5. A. Chan, W. Gropp, and E. Lusk. An efficient format for nearly constant-time access to arbitrary time intervals in large trace files. Scientific Programming, 16(2-3):155-165, 2008.
6. Chombo - Infrastructure for adaptive mesh refinement. https://seesar.lbl.gov/ANAG/chombo/.
7. B. Cornelissen, A. Zaidman, D. Holten, L. Moonen, A. van Deursen, and J. J. van Wijk. Execution trace analysis through massive sequence and circular bundle views. J. Syst. Softw., 81(12):2252-2268, 2008.
8. B. Fryxell, K. Olson, P. Ricker, F. X. Timmes, M. Zingale, D. Q. Lamb, P. MacNeice, R. Rosner, J. W. Truran, and H. Tufo. FLASH: An adaptive mesh hydrodynamics code for modeling astrophysical thermonuclear flashes. The Astrophysical Journal Supplement Series, 131(1):273, 2000.
9. HDF5. http://hdf.ncsa.uiuc.edu/HDF5/.
10. M. T. Heath. ParaGraph: A tool for visualizing performance of parallel programs. In Second Workshop on Environments and Tools for Parallel Sci. Comput, pages 221-230, 1994.
11. V. Herrarte and E. Lusk. Studying parallel program behavior with upshot. Technical Report ANL-91/15, Argonne National Laboratory, 1991.
12. IBM's HPCT-I/O, http://domino.research.ibm.com/comm/research-projects. nsf/pages/hpct.mio.html.
13. The IOR benchmark, http://sourceforge.net/projects/ior-sio/.
14. D. F. Jerding, J. T. Stasko, and T. Ball. Visualizing interactions in program executions. In ICSE '97: Proc. of the 19th Intl. Conf. on Software Engineering, pages 360-370. ACM, 1997.
15. J. Johansson, P. Ljung, M. Jern, and M. Cooper. Revealing structure within clustered parallel coordinates displays. In InfoVis '05: Proc. of the 2005 IEEE Symposium on Information Visualization, pages 125-132. IEEE Computer Society, 2005.
16. E. Karrels and E. Lusk. Performance analysis of MPI programs. In J. Dongarra and B. Tourancheau, editors, Proc. of the Workshop on Environments and Tools for Parallel Scientific Computing, pages 195-200. SIAM Publications, 1994.
17. A. Knüpfer, H. Brunst, J. Doleschal, M. Jurenz, M. Lieber, H. Mickler, M. S. Müller, and W. E. Nagel. The Vampir performance analysis tool-set. In M. Resch, R. Keller, V. Himmler, B. Krammer, and A. Schulz, editors, Tools for High Performance Computing, pages 139-155. Springer, Berlin, 2008.
18. D. Kranzlmüller, S. Grabner, and J. Volkert. Debugging massively parallel programs with ATEMPT. In HPCN Europe 1996: Proc. of the Intl. Conf. and Exhibition on High-Performance Computing and Networking, pages 806-811, London, UK, 1996. Springer-Verlag.
19. D. Kranzlmüller and J. Volkert. Debugging point-to-point communication in MPI and PVM. Lecture Notes in Computer Science, 1497:265-272, 1998. (Pubitemid 128135118)
20. LANL-Trace, http://institute.lanl.gov/data/software/#lanl-trace.
21. J. Li, W.-k. Liao, A. Choudhary, R. Ross, R. Thakur, W. Gropp, R. Latham, A. Siegel, B. Gallagher, and M. Zingale. Parallel netCDF: A high-performance scientific I/O interface. In SC '03: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, page 39, Washington, DC, USA, 2003. IEEE Computer Society.
22. T. Ludwig, S. Krempel, M. Kuhn, J. Kunkel, and C. Lohse. Analysis of the MPI-IO optimization levels with the PIOViz Jumpshot enhancement. In F. Cappello, T. Herault, and J. Dongarra, editors, Recent Advances in Parallel Virtual Machine and Message Passing Interface, volume 4757 of Lecture Notes in Computer Science, pages 213-222. Springer, Berlin, 2007.
23. S. Moreta and A. Telea. Multiscale visualization of dynamic software logs. In EuroVis, pages 11-18, 2007.
24. mpi-tile-io. http://www.mcs.anl.gov/research/projects/pio-benchmark/.
25. C. Muelder, F. Gygi, and K.-L. Ma. Visual analysis of inter-process communication for large-scale parallel computing. IEEE Transactions on Visualization and Computer Graphics, 15(6):1129-1136, October 2009.
26. N. Nakka, A. Choudhary, R. Klundt, M. Weston, and L. Ward. Detailed analysis of I/O traces of large scale applications. In HiPC, International Conference on High Performance Computing, December 2009.
27. K. Ohta, D. Kempe, J. Cope, K. Iskra, R. Ross, and Y. Ishikawa. Optimization techniques at the I/O forwarding layer. In IEEE International Conference on Cluster Computing (Cluster 2010), 2010.
28. PVFS2: Parallel Virual File System, version 2, www.pvfs.org.
29. R. Ross, T. Peterka, H.-W. Shen, Y. Hong, K.-L. Ma, H. Yu, and K. Moreland. Visualization and parallel I/O at extreme scale. Journal of Physics, July 2008. Proc. of DOE SciDAC Conf., 2008.
30. P. C. Roth. Characterizing the I/O behavior of scientific applications on the Cray XT. In PDSW '07: Proc. of the 2nd International Workshop on Petascale Data Storage, pages 50-55, New York, NY, 2007. ACM.
31. Sandia National Laboratories' Red Storm I/O traces, http://www.cs.sandia. gov/Scalable-IO/SNL-Trace-Data/index.html.
32. F. Schmuck and R. Haskin. Gpfs: A shared-disk file system for large computing clusters. In First Conference on File and Storage Technologies (FAST), 2002.
33. E. Shaffer, D. Reed, S. Whitmore, and B. Schaeffer. Virtue: Performance visualization of parallel and distributed applications. IEEE Computer, 32(12):44-51, Dec 1999. (Pubitemid 30556935)
34. S. S. Shende and A. D. Malony. The TAU parallel performance system. Int. J. High Perform. Comput. Appl., 20(2):287-311, 2006.
35. The SYSIO library, http://sourceforge.net/projects/libsysio.
36. B. Topol, J. T. Stasko, and V. Sunderam. PVaniM: A tool for visualization in network computing environments. j-CPE, 10(14):1197-1222, Dec. 1998.
37. A. Uselton, M. Howison, N. Wright, D. Skinner, N. Keen, J. Shalf, K. Karavanic, and L. Oliker. Parallel I/O performance: From events to ensembles. In IEEE International Parallel and Distributed Processing Symposium 2010, April 2010.
38. C. E. Wu, A. Bolmarcich, M. Snir, D. Wootton, F. Parpia, A. Chan, E. Lusk, and W. Gropp. From trace generation to visualization: A performance framework for distributed parallel systems. In Proc. of ACM/IEEE Supercomputing (SC00), November 2000.
39. H. Yu and K.-L. Ma. A study of I/O techniques for parallel visualization. Journal of Parallel Computing, 31(2):167-183, Feb 2005. (Pubitemid 40612563)
40. H. Yu, K.-L. Ma, and J. Welling. A parallel visualization pipeline for terascale earthquake simulations. In Proc. of ACM/IEEE Supercomputing (SC04), Nov 2004.
41. D. Zeckzer, R. Kalcklösch, L. Schröder, H. Hagen, and T. Klein. Analyzing the reliability of communication between software entities using a 3D visualization of clustered graphs. In SoftVis '08: Proc. of the 4th ACM Symposium on Software Visualization, pages 37-46. ACM, 2008.