ScalaTrace: Scalable compression and replay of communication traces for high-performance computing

Journal of Parallel and Distributed Computing

Volumn 69, Issue 8, 2009, Pages 696-710

  Noeth, Michael ^a   Ratn, Prasun ^a   Mueller, Frank ^a   Schulz, Martin ^b   de Supinski, Bronis R ^b  

^a North Carolina State University   (United States)

^b LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

Author keywords

Communication tracing; High performance computing; Scalability

Indexed keywords

COMMUNICATION BEHAVIOR; COMMUNICATION STRUCTURES; COMPRESSION TECHNIQUES; CONCISE REPRESENTATIONS; EXECUTION TIME; HIGH-PERFORMANCE COMPUTING; LARGE-SCALE APPLICATIONS; LEVEL STATISTICS; ORDERS OF MAGNITUDE; SCALABLE COMPRESSION; STRUCTURAL INFORMATION;

KNOWLEDGE REPRESENTATION; SCALABILITY;

COMMUNICATION;

EID: 67349187344     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2008.09.001     Document Type: Article

References (30)

1. N. Adiga, et al. An overview of the BlueGene/L supercomputer, in: Supercomputing, November 2002
2. Dorian C. Arnold, Dong H. Ahn, Bronis R. de Supinski, Gregory L. Lee, Barton P. Miller, Martin Schulz, Stack trace analysis for large scale debugging, in: International Parallel and Distributed Processing Symposium, 2007
3. Daniel Becker, Felix Wolf, Wolfgang Frings, Markus Geimer, Brian J.N. Wylie, Bernd Mohr, Automatic trace-based performance analysis of metacomputing applications, in: International Parallel and Distributed Processing Symposium, 2007
4. Holger Brunst, Hans-Christian Hoppe, Wolfgang E. Nagel, Manuela Winkler, Performance optimization for large scale computing: The scalable VAMPIR approach, in: International Conference on Computational Science (2) 2001, pp. 751-760
5. Marc Casas, Rosa Badia, Jesus Labarta, Automatic structure extraction from mpi applications tracefiles, in: Euro-Par Conference, August 2007
6. JaeWoong Chung, Chi Cao Minh, Austen McDonald, Travis Skare, Hassan Chafi, Brian D. Carlstrom, Christos Kozyrakis, Kunle Olukotun, Tradeoffs in transactional memory virtualization, in: Architectural Support for Programming Languages and Operating Systems, 2006
7. L. DeRose, K. Ekanadham, J.K. Hollingsworth, S. Sbaraglia, SIGMA: A simulator infrastructure to guide memory analysis, in: Supercomputing, November 2002
8. F. Freitag, J. Caubet, J. Labarta, On the scalability of tracing mechanisms, in: Euro-Par Conference, August 2002, pp. 97-104
9. M. Geimer, F. Wolf, B.J.N. Wylie, E. Abraham, D. Becker, B. Mohr, The scalasca performance toolset architecture, in: International Workshop on Scalable Tools for High-End Computing, June 2008
10. M. Geimer, F. Wolf, B. Wylie, B. Mohr, Scalable parallel trace-based performance analysis, in: European PVM/MPI Users' Group Meeting, 2007
11. Jeff Greenough, Allen Kuhl, Louis Howell, Alek Shestakov, Ulrike Creach, Al Miller, Ellen Tarwater, Andrew Cook, Bill Cabot, Raptor-Software and applications on bluegene/l. BG/L workshop paper 22, Lawrence Livermore National Lab, October 2003. http://www.llnl.gov/asci/platforms/bluegene/papers/22greenough.pdf
12. Havlak P., and Kennedy K. An implementation of interprocedural bounded regular section analysis. IEEE Transactions on Parallel and Distributed Systems 2 3 (1991) 350-360
13. Andreas Knupfer, Construction and compression of complete call graphs for post-mortem program trace analysis, in: International Conference on Parallel Processing, 2005, pp. 165-172
14. A. Knüpfer, R. Brendel, H. Brunst, H. Mix, W.E. Nagel, Introducing the open trace format (OTF), in: International Conference on Computational Science, May 2006, pp. 526-533
15. J. Marathe, F. Mueller, T. Mohan, B.R. de Supinski, S.A. McKee, A. Yoo, METRIC: Tracking down inefficiencies in the memory hierarchy via binary rewriting, in: International Symposium on Code Generation and Optimization, March 2003, pp. 289-300
16. M. Mesnier, M. Wachs, R. Sambasivan, J. Lopez, J. Hendricks, G.R. Ganger, //trace: Parallel trace replay with approximate causal events, in: USENIX Conference on File and Storage Technologies, February 2007
17. Marcin Neyman, Michal Bukowski, Piotr Kuzora, Efficient replay of pvm programs, in: European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, 1999, pp. 83-90
18. M. Noeth, F. Mueller, M. Schulz, B.R. de Supinski, Scalable compression and replay of communication traces in massively parallel environments, in: International Parallel and Distributed Processing Symposium, April 2007
19. OpenSpeedshop for linux
20. Pillet V., Labarta J., Cortes T., and Girona S. PARAVER: A tool to visualise and analyze parallel code. Proceedings of WoTUG-18: Transputer and Occam Developments. Transputer and Occam Engineering vol. 44 (1995) 17-31
21. P. Ratn, F. Mueller, Bronis R. de Supinski, M. Schulz, Preserving time in large-scale communication traces, in: International Conference on Supercomputing, June 2008, pp. 46-55
22. Roth P.C., Arnold D.C., and Miller B.P. MRNet: A software-based multicast/reduction network for scalable tools. Supercomputing (2003), IEEE Computer Society, Washington, DC, USA 21-36
23. n MPI tools: A whole lot greater than the sum of their parts, in: Supercomputing, 2007
24. Shuyi Shao, Alex Jones, Rami Melhem, A compiler-based communication analysis approach for multiprocessor systems, in: International Parallel and Distributed Processing Symposium, 2006
25. S. Shende, A. Malony, Portable profiling and tracing for parallel, scientific applications using C++, in: SIGMETRICS Symposium on Parallel and Distributed Tools, SPDT, 1998, pp. 134-145
26. The ASCI purple benchmarks. http://www.llnl.gov/asci/purple/benchmarks. 2002
27. J. Vetter, M. McCracken, Statistical scalability analysis of communication operations in distributed applications, in: ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2001
28. Wolf F., and Mohr B. Kojak - A tool set for automatic performance analysis of parallel applications. Proc. of the European Conference on Parallel Computing (Euro-Par). Lecture Notes in Computer Science vol. 2790 (2003), Springer, Klagenfurt, Austria 1301-1304 Demonstrations of parallel and distributed computing
29. F. Wong, R. Martin, R. Arpaci-Dusseau, D. Culler, Architectural requirements and scalability of the NAS parallel benchmarks, in: Supercomputing, 1999
30. Ziv J., and Lempel A. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory 23 3 (1977) 337-343