A scalable tool architecture for diagnosing wait states in massively parallel applications

Parallel Computing

Volumn 35, Issue 7, 2009, Pages 375-388

  Geimer, Markus ^a   Wolf, Felix ^a,b   Wylie, Brian J N ^a   Mohr, Bernd ^a  

^a FORSCHUNGSZENTRUM JÜLICH   (Germany)

^b RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

Event tracing; Pattern search; Performance analysis; Scalability

Indexed keywords

COMMUNICATION BEHAVIOR; EVENT TRACING; EXECUTION TIME; NEW APPROACHES; PARALLEL APPLICATION; PATTERN SEARCH; PERFORMANCE ANALYSIS; PERFORMANCE IMPACT; SCALABLE APPROACH; SEQUENTIAL SEARCH; SYNCHRONIZATION POINTS; TARGET APPLICATION;

MESSAGE PASSING;

SCALABILITY;

EID: 67649372904     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2009.02.003     Document Type: Article

References (34)

1. Accelerated Strategic Computing Initiative, The ASCI SWEEP3D benchmark code, 1995. .
2. Advanced Simulation and Computing Program, The ASC SMG2000 benchmark code, 2001. .
3. Argonne National Laboratory, The FPMPI-2 MPI profiling library. .
4. Becker D., Rabenseifner R., and Wolf F. Timestamp synchronization for event traces of large-scale message-passing applications. Proceedings of the 14th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 4757 (2007), Springer, Paris, France
5. Behr M., Arora D., Coronado O., and Pasquali M. Models and finite element techniques for blood flow simulation. International Journal of Computational Fluid Dynamics 20 (2006) 175-181
6. H. Brunst, W.E. Nagel, Scalable performance analysis of parallel systems: concepts and experiences, in: Proceedings of the International Conference on Parallel Computing (ParCo), Dresden, Germany, 2003.
7. Freitag F., Caubet J., and Labarta J. On the scalability of tracing mechanisms. Proceedings of the Eighth Euro-Par Conference. Lecture Notes in Computer Science vol. 2400 (2002), Springer, Paderborn, Germany
8. Geimer M., Wolf F., Knüpfer A., Mohr B., and Wylie B.J.N. A parallel trace-data interface for scalable performance analysis. Proceedings of the Workshop on State-of-the-Art in Scientific and Parallel Computing (PARA). Lecture Notes in Computer Science vol. 4699 (2006), Springer, Umeå, Sweden
9. Geimer M., Wolf F., Wylie B.J.N., and Mohr B. Scalable parallel trace-based performance analysis. Proceedings 13th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 4192 (2006), Springer, Bonn, Germany
10. Gropp W., Lusk E., and Skjellum A. Using MPI - Portable Parallel Programming with the Message-Passing Interface. second ed. (1999), MIT Press (Chapter 4, pp. 81-93)
11. M.-A. Hermanns, M. Geimer, F. Wolf, B.J.N. Wylie, Verifying causality between distant performance phenomena in large-scale MPI applications, in: Proceedings of the 17th Euromicro International Conference on Parallel, Distributed, and Network-based Processing (PDP), IEEE Computer Society, Weimar, Germany, 2009.
12. IBM Blue Gene/P Team, Overview of the IBM Blue Gene/P project, IBM J. Res. Dev. 52(1/2) (2008) 199-220.
13. Jülich Supercomputing Centre, Scalasca parallel performance analysis toolset documentation. .
14. Knüpfer A., and Nagel W.E. Construction and compression of complete call graphs for post-mortem program trace analysis. Proceedings of the International Conference on Parallel Processing (ICPP) (2005), IEEE Computer Society, Oslo, Norway
15. J. Labarta, J. Gimenez, E. Martinez, P. Gonzalez, H. Servat, G. Llort, X. Aguilar, Scalability of visualization and tracing tools, in: Proceedings of the International Conference on Parallel Computing (ParCo), Málaga, Spain, 2005.
16. Labarta J., Girona S., Pillet V., Cortes T., and Gregoris L. DiP: a parallel program development environment. Proceedings of the 2nd International Euro-Par Conference (1996), Springer, Lyon, France
17. W. Meira Jr., T.L. LeBlanc, A. Poulos, Waiting time analysis and performance visualization in Carnival, in: Proceedings of the SIGMETRICS Symposium on Parallel and Distributed Tools, Philadelphia, PA, 1996.
18. Miller B.P., Clark M., Hollingsworth J.K., Kierstead S., Lim S.-S., and Torzewski T. IPS-2: the second generation of a parallel program measurement system. IEEE Transactions on Parallel and Distributed Systems 1 2 (1990) 206-217
19. Morajko O., Morajko A., Margalef T., and Luque E. On-line performance modeling for MPI applications. Proceedings of the 14th Euro-Par Conference. Las Palmas de Gran Canaria, Lecture Notes in Computer Science vol. 5168 (2008), Springer, Spain
20. MPI PERUSE. .
21. Nagel W., Weber M., Hoppe H.-C., and Solchenbach K. VAMPIR: visualization and analysis of MPI resources. Supercomputer 63, XII 1 (1996) 69-80
22. M. Noeth, F. Müller, M. Schulz, B.R. de Supinski, Scalable compression and replay of communication traces in massively parallel environments, in: Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS), Long Beach, CA, 2007.
23. P. Ratn, F. Müller, B.R. de Supinski, M. Schulz, Preserving time in large-scale communication traces, in: Proceedings of the 22nd International Conference on Supercomputing (ICS), Kos, Greece, 2008.
24. P.C. Roth, D.C. Arnold, B.P. Miller, MRNet: a software-based multicast/reduction network for scalable tools, in: Proceedings of the ACM International Conference on Supercomputing (ICS), Phoenix, AZ, 2003.
25. J. Vetter, Performance analysis of distributed applications using automatic classification of communication inefficencies, in: Proceedings of the ACM International Conference on Supercomputing (ICS), Santa Fe, NM, 2000.
26. F. Wolf, EARL - API Documentation, Technical Report ICL-UT-04-03, University of Tennessee, Innovative Computing Laboratory, October 2004.
27. F. Wolf, F. Freitag, B. Mohr, S. Moore, B.J.N. Wylie, Large event traces in parallel performance analysis, in: Proceedings of the 8th Workshop on Parallel Systems and Algorithms (PASA), Germany, Lecture Notes in Informatics, Gesellschaft für Informatik, Frankfurt am Main, 2006.
28. Wolf F., and Mohr B. Automatic performance analysis of hybrid MPI/OpenMP applications. Journal of Systems Architecture 49 10-11 (2003) 421-439
29. F. Wolf, B. Mohr, EPILOG Binary Trace-Data Format, Technical Report FZJ-ZAM-IB-2004-06, Forschungszentrum Jülich, May 2004.
30. Wolf F., Mohr B., Dongarra J., and Moore S. Efficient pattern search in large traces through successive refinement. Proceedings of the 10th Euro-Par Conference. Lecture Notes in Computer Science vol. 3149 (2004), Springer, Pisa, Italy
31. F. Wolf, B.J.N. Wylie, E. Ábrahám, D. Becker, W. Frings, K. Fürlinger, M. Geimer, M.-A. Hermanns, B. Mohr, S. Moore, M. Pfeifer, Z. Szebenyi, Usage of the Scalasca toolset for scalable performance analysis of large-scale parallel applications, in: Tools for High Performance Computing: Proceedings of the Second HLRS Parallel Tools Workshop, Springer, Stuttgart, Germany, 2008.
32. C.E. Wu, A. Bolmarcich, M. Snir, D. Wootton, F. Parpia, A. Chan, E. Lusk, W. Gropp, From trace generation to visualization: a performance framework for distributed parallel systems, in: Proceedings of the Supercomputing Conference (SC), Dallas, TX, 2000.
33. Wylie B.J.N., Geimer M., Nicolai M., and Probst M. Performance analysis and tuning of the XNS CFD solver on BlueGene/L. Proceedings of 14th European PVM/MPI Users' Group Meeting. Lecture Notes in Computer Science vol. 4757 (2007), Springer, Paris, France
34. Zaki O., Lusk E., Gropp W., and Swider D. Toward scalable performance visualization with Jumpshot. High Performance Computing Applications 13 2 (1999) 277-288