MPIWIZ: Subgroup reproducible replay of MPI applications

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn , Issue , 2009, Pages 251-260

  Xue, Ruini ^a   Liu, Xuezheng ^b   Wu, Ming ^b   Guo, Zhenyu ^b   Chen, Wenguang ^a   Zheng, Weimin ^a   Zhang, Zheng ^b   Voelker, Geoffrey M ^c  

^a TSINGHUA UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Design; Performance; Reliability

Indexed keywords

COARSE-GRAINED; COMMUNICATION LOCALITY; COMMUNICATION MESSAGES; CONCURRENT EXECUTION; CYCLIC DEBUGGING; DETERMINISTIC BEHAVIOR; EXECUTION TIME; GROUP BOUNDARY; HYBRID DETERMINISTIC; INTRA-GROUP; MESSAGE ORDERING; MESSAGE PASSING INTERFACE; MPI APPLICATIONS; NON-DETERMINISM; PERFORMANCE; SOURCE CODE MODIFICATION; SYSTEM CALLS; TRAFFIC PATTERN;

COMMUNICATION; MESSAGE PASSING; RADIO RECEIVERS; RING GAGES;

PARALLEL PROGRAMMING;

EID: 67650178061     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1504176.1504213     Document Type: Conference Paper

References (39)

1. D. Bailey, T. Harris, W. Saphir, R. van der Wijngaart, A. Woo, and M. Yarrow. The NAS Parallel Benchmarks 2.0. Technical Report Report NAS-95-020, Numerical Aerodynamic Simulation Facility, NASA Ames Research Center, Mail Stop T 27 A-1, Moffett Field, CA 94035-101000, USA, Dec. 05 1995.
2. A. Bouteiller, G. Bosilca, and J. Dongarra. Retrospect: Deterministic Replay of MPI Applications for Interactive Distributed Debugging. In 14th European PVM/MPI User's Group Meeting, pages 297-306, 2007.
3. C.-K. Cheng and Y.-C. A. Wei. An Improved Two-way Partitioning Algorithm with Stable Performance. IEEE Transactions on Computer Aided Design, 10(12):1502-1511, 1991.
4. C. Cĺemençon, J. Fritscher, M. J. Meehan, and R. Rühl. An Implementation of Race Detection and Deterministic Replay with MPI. In EuroPar'95, pages 155-166, Aug. 1995.
5. J. C. de Kergommeaux, M. Ronsse, and K. D. Bosschere. MPL*: Efficient Record/Play of Nondeterministic Features of Message Passing Libraries. In 6th European PVM/MPI Users' Group Meeting, pages 141-148, 1999.
6. J. DeSouza, B. Kuhn, B. R. de Supinski, V. Samofalov, S. Zheltov, and S. Bratanov. Automated, Scalable Debugging of MPI programs with Intel Message Checker. In SE-HPCS'05, pages 78-82, 2005.
7. C. Falzone, A. Chan, E. L. Lusk, and W. Gropp. Collective Error Detection for MPI Collective Operations. In PVM/MPI'05, pages 138-147, 2005.
8. A. Faraj and X. Yuan. Communication Characteristics in the NAS Parallel Benchmarks. In PDCS'02, pages 724-729, 2002.
9. J. Garbers, H. J. Prömel, and A. Steger. Finding Clusters in VLSI Circuits. In IEEE International Conference on Computer Aided Design, pages 520-523, Nov. 1990. (Pubitemid 21675396)
10. W. Gropp, E. Lusk, N. Doss, and A. Skjellum. A High-performance, Portable Implementation of the MPI Message Passing Interface Standard. Parallel Computing, 22(6):789-828, Sept. 1996. (Pubitemid 126364517)
11. Z. Guo, X.Wang, J. Tang, X. Liu, Z. Xu, M.Wu, M. F. Kaashoek, and Z. Zhang. R2: An Application-Level Kernel for Record and Replay. In OSDI'08, To appear, 2008.
12. W. Haque. Concurrent Deadlock Detection in Parallel Programs. Int. J. Comput. Appl., 28(1):19-25, 2006. (Pubitemid 43171279)
13. HPCC. Hpcc 1998 blue book (computing, information, and communications: Technologies for the 21st century). Computing, Information, and Communications (CIC) R&D Subcommittee of the National Science and Technology Council's Committee on Computing, Information, and Communications (CCIC), 1998.
14. Z. Huang, M. K. Purvis, and P. Werstein. Performance Evaluation of View-Oriented Parallel Programming. In ICPP'05, pages 251-258, 2005. (Pubitemid 43898233)
15. NAS Parallel Benchmarks: ProActive implementations. http: //proactive.inria.fr/index.php?page=nas-benchmarks.
16. G. Karypis and V. Kumar. Multilevel k-way Partitioning Scheme for Irregular Graphs. Journal of Parallel and Distributed Computing, 48(1):96-129, 1998. (Pubitemid 128347296)
17. T. Kielmann, R. F. H. Hofman, H. E. Bal, A. Plaat, and R. A. F. Bhoedjang. MagPIe: MPI's Collective Communication Operations for Clustered Wide Area Systems. ACM SIGPLAN Notices, 34(8):131-140, 1999. (Pubitemid 129694057)
18. J. Kim and D. J. Lilja. Characterization of Communication Patterns in Message-Passing Parallel Scientific Application Programs. In CANPC'98, pages 202-216, 1998. (Pubitemid 128027868)
19. B. Krammer and M. S. Müller. MPI Application Development with MARMOT. In ParCo'05, pages 893-900, 2005.
20. D. KranzlMüller, C. Schaubschläger, and J. Volkert. An Integrated Record&Replay Mechanism for Nondeterministic Message Passing Programs. In 8th European PVM/MPI Users' Group Meeting, pages 192-200, 2001. (Pubitemid 33348545)
21. D. KranzlMüller and J. Volkert. NOPE: A Nondeterministic Program Evaluator. In ACPC'99, pages 490-499, 1999.
22. T. J. LeBlanc and J. M. Mellor-Crummey. Debugging Parallel Programs with Instant Replay. IEEE Trans. Computers, 36(4):471-482, 1987. (Pubitemid 17565734)
23. R. Lovas and P. Kacsuk. Correctness Debugging of Message Passing Programs Using Model Verification Techniques. In 14th European PVM/MPI User's Group Meeting, pages 335-343, 2007.
24. G. R. Luecke, H. Chen, J. Coyle, J. Hoekstra, M. Kraeva, and Y. Zou. MPI-CHECK: A Tool for Checking Fortran 90 MPI Programs. Concurrency and Computation: Practice and Experience, 15(2):93-100, 2003.
25. M. Maruyama, T. Tsumura, and H. Nakashima. Parallel Program Debugging based on Data-Replay. In PDCS'05, pages 151-156, 2005.
26. G. L. Miller, S.-H. Teng, and S. A. Vavasis. A Unified Geometric Approach to Graph Separators. In 32th Annual Symposium on Foundations of Computer Science, pages 538-547, Oct. 1991.
27. SIM-MPI Library. http://www.hpctest.org.cn/resources/ sim-mpi.tgz.
28. N. Neophytou and P. Evripidou. Net-dbx: A Web-Based Debugger of MPI Programs Over Low-Bandwidth Lines. IEEE Trans. Parallel Distrib. Syst., 12(9):986-995, 2001. (Pubitemid 32992569)
29. S. Pervez, G. Gopalakrishnan, R. M. Kirby, R. Palmer, R. Thakur, and W. Gropp. Practical Model-Checking Method for Verifying Correctness of MPI Programs. In 14th European PVM/MPI User's Group Meeting, pages 344-353, 2007.
30. PGDBG Graphical Symbolic Debugger. http://www.pgroup. com/products/pgdbg.htm.
31. M. Rudgyard. Novel Techniques for Debugging and Optimizing Parallel Applications. In SC'06, page 281, 2006.
32. B. Schroeder and G. A. Gibson. A Large-scale Study of Failures in High-performance Computing Systems. In International Conference on Dependable Systems and Networks (DSN 2006), pages 249-258, 2006. (Pubitemid 44930426)
33. S. F. Siegel. Model Checking Nonblocking MPI Programs. In 8th International Conference on Verification, Model Checking, and Abstract Interpretation (VMCAI 2007), pages 44-58, 2007. (Pubitemid 350143483)
34. S. F. Siegel and G. S. Avrunin. Modeling Wildcard-free MPI Programs for Verification. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPOPP 2005), pages 95-106, 2005. (Pubitemid 43182836)
35. S. F. Siegel, A. Mironova, G. S. Avrunin, and L. A. Clarke. Using Model Checking with Symbolic Execution to Verify Parallel Numerical Programs. In Proceedings of the ACM/SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2006), pages 157-168, 2006. (Pubitemid 46645527)
36. Totalview. http://www.totalviewtech.com/.
37. J. L. Träff and J. Worringen. Verifying Collective MPI Calls. In 11th European PVM/MPI Users' Group Meeting, pages 18-27, 2004. (Pubitemid 39289452)
38. J. S. Vetter and B. R. de Supinski. Dynamic Software Testing of MPI Applications with Umpire. In SC'00, pages 70-170, November, 4-10 2000.
39. J. S. Vetter and F. Mueller. Communication Characteristics of Largescale Scientific Applications for Contemporary Cluster Architectures. J. Parallel Distrib. Comput., 63(9):853-865, 2003. (Pubitemid 37364491)