GRace: A low-overhead mechanism for detecting data races in gpu programs

ACM SIGPLAN Notices

Volumn 46, Issue 8, 2011, Pages 135-145

  Zheng, Mai ^a   Ravi, Vignesh T ^a   Qin, Feng ^a   Agrawal, Gagan ^a  

^a Ohio State University   (United States)

Author keywords

Concurrency; CUDA; Data Race; GPU; Multithreading

Indexed keywords

CONCURRENCY; CUDA; DATA RACES; GPU; MULTI-THREADING;

CONCURRENCY CONTROL; MODEL CHECKING; MULTITASKING; PARALLEL PROGRAMMING; PROGRAM PROCESSORS; RATING; WELL LOGGING;

STATIC ANALYSIS;

EID: 80053998590     PISSN: 15232867     EISSN: None     Source Type: Journal    
DOI: 10.1145/2038037.1941574     Document Type: Conference Paper

References (46)

1. CUDA Community Showcase. http://www.nvidia.com/object/cuda-apps-flash- new.html.
2. ATI Stream Technology. http://www.amd.com/stream.
3. D. H. Ahn, B. R. de Supinski, I. Laguna, G. L. Lee, B. Liblit, B. P. Miller, and M. Schulz. Scalable temporal order analysis for large scale debugging. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC), 2009.
4. D. C. Arnold, D. H. Ahn, B. R. de Supinski, G. Lee, B. P. Miller, and M. Schulz. Stack trace analysis for large scale debugging. In Proceedings of the 21st IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2007.
5. S. M. Balle, B. R. Brett, C.-P. Chen, and D. LaFrance-Linden. Extending a traditional debugger to debug massively parallel applications. J. Parallel Distrib. Comput., 64(5), 2004.
6. C. Boyapati, R. Lee, and M. Rinard. Ownership types for safe programming: Preventing data races and deadlocks. In Proceedings of the International Conference on Object Oriented Programming, Systems, Languages and Applications (OOPSLA), 2002.
7. M. Boyer, K. Skadron, and W. Weimer. Automated dynamic analysis of CUDA programs. In Proceedings of the Third Workshop on Software Tools for MultiCore Systems (STMCS), 2008.
8. H. Cho, I. S. Dhillon, Y. Guan, and S. Sra. Minimum sum-squared residue co-clustering of gene expression data. In Proceedings of the 4th SIAM International Conference on Data Mining (SDM), 2004.
9. J.-D. Choi, K. Lee, A. Loginov, R. O'Callahan, V. Sarkar, and M. Sridharan. Efficient and precise datarace detection for multithreaded object-oriented programs. In Proceedings of the ACM SIGPLAN Conference on Programming language design and implementation (PLDI), 2002.
10. A. Dempster, N. Laird, and D. Rubin. Maximum Likelihood Estimation from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society, 39(1):1-38, 1977.
11. J. DeSouza, B. Kuhn, B. R. de Supinski, V. Samofalov, S. Zheltov, and S. Bratanov. Automated, scalable debugging of MPI programs with Intel Message Checker. In Proceedings of the 2nd International workshop on Software engineering for high performance computing system applications (SE-HPCS), 2005.
12. A. Dinning and E. Schonberg. An empirical comparison of monitoring algorithms for access anomaly detection. In Proceedings of the ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP), 1990.
13. D. Engler and K. Ashcraft. Racerx: Effective, static detection of race conditions and deadlocks. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2003.
14. Etnus, LLC. TotalView. http://www.etnus.com/TotalView.
15. C. Falzone, A. Chan, E. Lusk, and W. Gropp. A portable method for finding user errors in the usage of MPI collective operations. International Journal of High Performance Computing Applications, 21(2):155-165, 2007. (Pubitemid 46672523)
16. P. Feautrier. Parametric integer programming. RAIRO Recherche Opérationnelle, 22(3):243-268, 1988.
17. A. Fedorova, S. Blagodurov, and S. Zhuravlev. Managing contention for shared resources on multicore processors. Commun. ACM, 53(2): 49-57, 2010.
18. C. Flanagan and S. N. Freund. Type-based race detection for java. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI), 2000.
19. Q. Gao, F. Qin, and D. K. Panda. DMTracker: Finding bugs in largescale parallel programs by detecting anomaly in data movements. In Proceedings of the ACM/IEEE Annual Conference on Supercomputing (SC), 2007.
20. T. A. Henzinger, R. Jhala, and R. Majumdar. Race checking by context inference. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI), 2004.
21. T. Hilbrich, B. R. de Supinski, M. Schulz, and M. S. Müller. A graph based approach for MPI deadlock detection. In Proceedings of the 23rd International Conference on Supercomputing(ICS), 2009.
22. M.-H. Kang, O.-K. Ha, S.-W. Jun, and Y.-K. Jun. A tool for detecting first races in openmp programs. In Proceedings of the International Conference on Parallel Architectures and Compilation Techniques (PACT), 2009.
23. Khronos Group. OpenCL: The Open Standdard for Heterogeneous Parallel Programming. http://www.khronos.org/opencl, 2008.
24. B. Krammera, K. Bidmona, M. S. Muller, and M. M. Rescha. MARMOT: An MPI analysis and checking tool. In Parallel Computing (PARCO), 2003.
25. L. Lamport. Time, clocks, and the ordering of events in a distributed system. Commun. ACM, 21(7):558-565, 1978. (Pubitemid 8615486)
26. S. Lee, S.-J. Min, and R. Eigenmann. OpenMP to GPGPU: A Compiler Framework for Automatic Translation and Optimization. In Proceedings of the ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP), 2009.
27. G. Li and G. Gopalakrishnan. Scalable SMT-based verification of GPU kernel functions. In Proceedings of the ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE), 2010.
28. S. Lu, S. Park, E. Seo, and Y. Zhou. Learning from mistakes: A comprehensive study on real world concurrency bug characteristics. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2008.
29. G. Luecke, H. Chen, J. Coyle, J. Hoekstra, M. Kraeva, and Y. Zou. MPI-CHECK: A tool for checking Fortran 90 MPI programs. Concurr. Comput. Pract. Exp., 15(2), 2003.
30. S. S. Lumetta and D. E. Culler. The mantis parallel debugger. In SIGMETRICS Symposium on Parallel and Distributed Tools (SPDT), 1996.
31. W. Ma and G. Agrawal. A translation system for enabling data mining applications on GPUs. In Proceedings of the International Conference on Supercomputing(ICS), 2009.
32. W. Ma and G. Agrawal. An Integer Programming Framework for Optimizing Shared Memory Use on GPUs. In Proceedings of International Conference on High Performance Computing(HiPC), 2010.
33. A. D. Malony, S. Biersdorff, W. Spear, and S. Mayanglambam. An experimental approach to performance measurement of heterogeneous parallel applications using cuda. In Proceedings of the International Conference on Supercomputing (ICS), 2010.
34. R. H. B. Netzer and B. P. Miller. Improving the accuracy of data race detection. In Proceedings of the ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP), 1991.
35. R. O'Callahan and J.-D. Choi. Hybrid dynamic data race detection. In Proceedings of the ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP), 2003.
36. J. Odom, J. K. Hollingsworth, L. DeRose, K. Ekanadham, and S. Sbaraglia. Using dynamic tracing sampling to measure long running programs. In Proceedings of the ACM/IEEE Annual Conference on Supercomputing (SC), 2005.
37. D. Perkovic and P. J. Keleher. Online data-race detection via coherency guarantees. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), 1996.
38. E. Pozniansky and A. Schuster. Efficient on-the-fly data race detection in multithreaded C++ programs. In Proceedings of the ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP), 2003.
39. S. Savage, M. Burrows, G. Nelson, P. Sobalvarro, and T. Anderson. Eraser: A dynamic data race detector for multithreaded programs. ACM Trans. Comput. Syst., 15(4):391-411, 1997. (Pubitemid 127449840)
40. N. Sundaram, A. Raghunathan, and S. Chakradhar. A framework for efficient and scalable execution of domain-specific templates on GPUs. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2009.
41. J. S. Vetter and B. R. de Supinski. Dynamic software testing of MPI applications with Umpire. In Proceedings of the ACM/IEEE Conference on Supercomputing (SC), 2000.
42. S. Yang, A. R. Butt, Y. C. Hu, and S. P. Midkiff. Trust but verify: Monitoring remotely executing programs for progress and correctness. In Proceedings of the ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming (PPoPP), 2005.
43. Y. Yu, T. Rodeheffer, and W. Chen. Racetrack: Efficient detection of data race conditions via adaptive tracking. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2005.
44. S. zee Ueng, M. Lathara, S. S. Baghsorkhi, and W. mei W. Hwu. CUDA-lite: Reducing GPU Programming Complexity. In Proceedings of the International Workshop on Languages and Compilers for Parallel Computing (LCPC), 2008.
45. A. Zhai, G. He, and M. Heimdahl. Hardware and compiler support for dynamic software monitoring. In Proceedings of the International Workshop on Runtime Verification (RV), 2009.
46. E. Z. Zhang, Y. Jiang, Z. Guo, and X. Shen. Streamlining gpu applications on the fly: Thread divergence elimination through runtime threaddata remapping. In Proceedings of the International Conference on Supercomputing (ICS), 2010.