Scalable identification of load imbalance in parallel executions using call path profiles

2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010

Volumn , Issue , 2010, Pages

  Tallent, Nathan R ^a   Adhianto, Laksono ^a   Mellor Crummey, John M ^a  

^a RICE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CALL PATH; LOAD IMBALANCE; PARALLEL ANALYSIS; PARALLEL EXECUTIONS; PARALLEL PROGRAM; PETASCALE; PROCESSOR CORES; ROOT CAUSE; SCALING PROBLEM; STATIC AND DYNAMIC;

PARALLEL ARCHITECTURES;

EID: 78650837195     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2010.47     Document Type: Conference Paper

References (31)

1. L. Adhianto, S. Banerjee, M. Fagan, M. Krentel, G. Marin, J. Mellor-Crummey, and N. R. Tallent, "HPCToolkit: Tools for performance analysis of optimized parallel programs, "Concurrency and Computation: Practice and Experience, vol. 22, no. 6, pp. 685-701, 2010.
2. G. Ammons, T. Ball, and J. R. Larus, "Exploiting hardware performance counters with flow and context sensitive profiling, "in Proc. of the 1997 ACM SIGPLAN Conference on Programming Language Design and Implementation. New York, NY, USA: ACM, 1997, pp. 85-96.
3. S. Balay, K. Buschelman, V. Eijkhout, W. D. Gropp, D. Kaushik, M. G. Knepley, L. C. McInnes, B. F. Smith, and H. Zhang, "PETSc users manual, "Argonne National Laboratory, Tech. Rep. ANL-95/11 - Revision 3.0.0, 2008.
4. I.-H. Chung, R. E. Walkup, H.-F. Wen, and H. Yu, "MPI performance analysis tools on Blue Gene/L, "in Proc. of the 2006 ACM/IEEE Conference on Supercomputing. New York, NY, USA: ACM, 2006, p. 123.
5. L. DeRose, B. Homer, and D. Johnson, "Detecting application load imbalance on high end massively parallel systems, "Lecture Notes in Computer Science, vol. 4641/2007, pp. 150-159, 2007.
6. L. DeRose, B. Homer, D. Johnson, S. Kaufmann, and H. Poxon, "Cray performance analysis tools, "in Tools for High Performance Computing. Springer Berlin Heidelberg, 2008, pp. 191-199.
7. T. Gamblin, B. R. de Supinski, M. Schulz, R. Fowler, and D. A. Reed, "Scalable load-balance measurement for SPMD codes, "in Proc. of the 2008 ACM/IEEE Conference on Supercomputing. Piscataway, NJ, USA: IEEE Press, 2008, pp. 1-12.
8. T. Gamblin, B. R. de Supinski, M. Schulz, R. Fowler, and D. A. Reed"Clustering performance data efficiently at massive scales, "in Proc. of the 24th ACM International Conference on Supercomputing. New York, NY, USA: ACM, 2010, pp. 243-252.
9. T. Gamblin, R. Fowler, and D. A. Reed, "Scalable methods for monitoring and detecting behavioral equivalence classes in scientific codes, "in Proc. of the 2008 IEEE International Symposium on Parallel and Distributed Processing, April 2008, pp. 1-12.
10. M. Geimer, F. Wolf, B. J. N. Wylie, E. Á brahám, D. Becker, and B. Mohr, "The Scalasca performance toolset architecture, "Concurrency and Computation: Practice and Experience, vol. 22, no. 6, pp. 702-719, 2010.
11. C. W. Lee and L. V. Kalé, "Scalable Techniques for Performance Analysis, "Parallel Programming Laboratory, Department of Computer Science, University of Illinois, Urbana-Champaign, Tech. Rep. 07-06, May 2007.
12. C. W. Lee, C. Mendes, and L. V. Kalé, "Towards Scalable Performance Analysis and Visualization through Data Reduction, "in Proc. of the 13th International Workshop on High-Level Parallel Programming Models and Supportive Environments, Miami, Florida, USA, April 2008.
13. P. Lichtner et al, "PFLOTRAN project web site, "https:// software.lanl.gov/pflotran, 2009.
14. J. C. Linford, M.-A. Hermanns, M. Geimer, D. Boehme, and F. Wolf, "Detecting load imbalance in massively parallel applications, "Forschungszentrum Jülich, Tech. Rep. FZJ-JSC-IB-2008-09, December 2008.
15. A. D. Malony, S. Shende, A. Morris, and F. Wolf, "Compensation of measurement overhead in parallel performance profiling, "Int. J. High Perform. Comput. Appl., vol. 21, no. 2, pp. 174-194, 2007.
16. MPI: A Message Passing Interface Standard, Message Passing Interface Forum, June 1999, http://www.mpi-forum.org/docs/mpi-11.ps.
17. B. P. Miller, M. D. Callaghan, J. M. Cargille, J. K. Hollingsworth, R. B. Irvin, K. L. Karavanic, K. Kunchithapadam, and T. Newhall, "The Paradyn parallel performance measurement tool, "Computer, vol. 28, no. 11, pp. 37-46, 1995.
18. R. T. Mills, C. Lu, P. C. Lichtner, and G. E. Hammond, "Simulating subsurface flow and transport on ultrascale computers using PFLOTRAN, "Journal of Physics Conference Series, vol. 78, no. 012051, 2007.
19. M. Noeth, P. Ratn, F. Mueller, M. Schulz, and B. R. de Supinski, "Scalatrace: Scalable compression and replay of communication traces for high-performance computing, "J. Parallel Distrib. Comput., vol. 69, no. 8, pp. 696-710, 2009.
20. H. Poxon and L. DeRose, "Addressing scalability with the Cray performance analysis toolset, "Workshop on Performance Tools for Petascale Computing, Center for Scalable Application Development Software, July 2009. [Online]. Available: http://cscads.rice.edu/workshops/summer09/slides/ performance-tools/CScADS09-PoxonDeRose.pdf.
21. Rice University, "HPCToolkit performance tools, "http:// hpctoolkit.org.
22. P. C. Roth, D. C. Arnold, and B. P. Miller, "MRNet: A software-based multicast/reduction network for scalable tools, "in Proc. of the 2003 ACM/IEEE Conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2003, p. 21.
23. N. R. Tallent, "Performance analysis for parallel programs: From multicore to petascale, "Ph.D. dissertation, Department of Computer Science, Rice University, March 2010.
24. N. R. Tallent and J. Mellor-Crummey, "Effective performance measurement and analysis of multithreaded applications, "in Proc. of the 14th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. New York, NY, USA: ACM, 2009, pp. 229-240.
25. N. R. Tallent, J. Mellor-Crummey, and M. W. Fagan, "Binary analysis for measurement and attribution of program performance, "in Proc. of the 2009 ACM SIGPLAN Conference on Programming Language Design and Implementation. New York, NY, USA: ACM, 2009, pp. 441-452.
26. N. R. Tallent, J. M. Mellor-Crummey, L. Adhianto, M. W. Fagan, and M. Krentel, "Diagnosing performance bottlenecks in emerging petascale applications, "in Proc. of the 2009 ACM/IEEE Conference on Supercomputing. New York, NY, USA: ACM, 2009, pp. 1-11.
27. N. R. Tallent, J. M. Mellor-Crummey, and A. Porterfield, "Analyzing lock contention in multithreaded applications, "in Proc. of the 15th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. New York, NY, USA: ACM, 2010, pp. 269-280.
28. J. Vetter, "Performance analysis of distributed applications using automatic classification of communication infficiencies, "in Proc. of the 14th International Conference on Supercomputing. New York, NY, USA: ACM, 2000, pp. 245-254.
29. J. Wagner Meira, T. J. LeBlanc, and A. Poulos, "Waiting time analysis and performance visualization in carnival, "in Proc. of the 1996 SIGMETRICS Symposium on Parallel and Distributed Tools. New York, NY, USA: ACM, 1996, pp. 1-10.
30. F. Wolf, B. Mohr, J. Dongarra, and S. Moore, "Automatic analysis of inefficiency patterns in parallel applications, "Concurrency and Computation: Practice and Experience, vol. 19, pp. 1481-1496, Feb. 2007, special Issue Automatic Performance Analysis. (Pubitemid 47204258)
31. B. J. N. Wylie, M. Geimer, and F. Wolf, "Performance measurement and analysis of large-scale parallel applications on leadership computing systems, "Sci. Program., vol. 16, no. 2-3, pp. 167-181, 2008.