Experience with a concurrency bugs benchmark

2008 IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW'08

Volumn , Issue , 2008, Pages 379-384

  Eytani, Yaniv ^a   Tzoref, Rachel ^b   Ur, Shmuel ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b IBM HAIFA RESEARCH LAB   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; COMPUTER SOFTWARE SELECTION AND EVALUATION; CONCURRENCY CONTROL; IMPACT TESTING; PROGRAM DEBUGGING; PROJECT MANAGEMENT; SOFTWARE TESTING;

CONCURRENT PROGRAMS; CONCURRENT TESTING; INTERNATIONAL CONFERENCES; MULTI-THREADED PROGRAMS; RE SEARCH GROUP; TESTING AND DEBUGGING; VERIFICATION AND VALIDATION;

VERIFICATION;

EID: 52249111659     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSTW.2008.17     Document Type: Conference Paper

References (28)

1. K. Sen and G. Agha, "A Race-Detection and Flipping Algorithm for Automated Testing of Multi-Threaded Programs", Haifa Verification conference, Haifa, Israel, 2006, Revised Selected Papers. Lecture Notes in Computer Science 4383, Springer, 2007.
2. M. Wojcicki and P. Strooper. "Maximising the Information Gained from a Study of Static Analysis Technologies for Concurrent Software", Journal of Empirical Software Engineering. 2007.
3. F. Chen and T. F. Serbanuta and G. Rosu. "jPredictor: A Predictive Runtime Analysis Tool for Java", ICSE. 2008.
4. F. Chen, M. d'Amorim and G. Rosu, "Checking and Correcting Behaviors of Java Programs at Runtime with Java-MOP" , RV'05, ENTCS 144, issue 4, pp 3-20. 2005.
5. N. Kidd, T Reps, J. Dolby, and M. Vaziri, "Static Detection of Atomic-Set Serializability Violations", TR-1623, Computer Sciences Department, University of Wisconsin, Madison, WI, October 2007.
6. M. B. Dwyer, S. Person, and S Elbaum, "Controlling Factors in Evaluating Path-Sensitive Error Detection Techniques", FSE. 2006.
7. N. Rungta and E. G. Mercer, "Generating Counterexamples through Randomized Guided Search", SPIN Workshop on Model Checking of Software, Berlin, Germany, 2007.
8. N. Rungta and E. G. Mercer, "Hardness for Explicit State Software Model Checking Benchmarks", 5th IEEE International Conference on Software Engineering and Formal Methods, London, U.K, 2007.
9. Y Nir-Buchbinder and S. Ur "ConTest Listeners: a Concurrency-Oriented Infrastructure for Java Test and Heal Tools", International Workshop on Software Quality Assurance, 2007.
10. J. S. Bradbury, J. R. Cordy, and J. Dingel, "Comparative Assessment of Testing and Model Checking Using Program Mutation", Workshop on Mutation Analysis (Mutation 2007), UK, 2007.
11. J. S. Bradbury, J. R. C. and J. Dingel. "Mutation Operators for Concurrent Java (J2SE 5.0)", In Proc. of the Workshop on Mutation Analysis (Mutation 2006), pages 83-92, Raleigh, North Carolina, USA, 2006.
12. Y. Eytani and T. Latvala. "Explaining Intermittent Concurrent Bugs by Minimizing Scheduling Noise". Haifa Verification conference, Haifa, Israel, 2006, Revised Selected Papers. Lecture Notes in Computer Science 4383, Springer, 2007.
13. Y. Ben-Asher, Y. Eytani, E. Farchi, and S. Ur. "Noise Makers Need to Know Where to be Silent - Producing Schedules that Find Bugs". International Symposium on Leveraging Applications of Formal Methods, Verification and Validation (ISOLA), 2006.
14. C. von Praun and T. R. Gross, "Static Detection of Atomicity Violations in Object-Oriented Programs", Journal of Object Technology 3(6): 103-122 (2004)
15. K. Havelund, S. D. Stoller, and S. Ur, "Benchmark and framework for encouraging research on multi-threaded testing tools", Workshop on Parallel and Distributed Testing and Debugging, 2003.
16. Y. Eytani, K. Havelund, S. D. Stoller, and S. Ur, "Toward a Framework and Benchmark for Testing Tools for Multi-Threaded Programs", Concurrency and Computation: Practice & Experience, 19(3): 267-279 (2007).
17. Y. Eytani and S. Ur, "Compiling a Benchmark of Documented Multi-threaded Bugs", Workshop on Parallel and Distributed Testing and Debugging, 2004.
18. M. Naik, A. Aiken and J. Whaley, "Effective Static Race Detection for Java", Conference on Programming Language Design and Implementation (PLDI), 2006.
19. M. E. Keremoglu, S. Tasiran, T. Elmas, "Classification of Concurrency Bugs in Java Benchmarks by Developer Intent", Workshop on Parallel and Distributed Testing and Debugging, 2006.
20. L. Wang and S.D. Stoller, "Runtime Analysis of Atomicity for Multi-threaded Programs", IEEE Transactions on Software Engineering, 32(2):93-110, 2006.
21. V. Mutilin, "Concurrent Testing of Java Components Using Java PathFinder", ISOLA. 2006.
22. C. Artho, Z. Chen, S. Honiden, "AOP-Based Automated Unit Test Classification of Large Benchmarks", AoAsia. 2007.
23. Rachel Tzoref, Shmuel Ur, Elad Yom-Tov: "Instrumenting Where It Hurts: An Automatic Concurrent Debugging Technique". ISSTA 2007:
24. Shmuel Ur, "Special Issue: Parallel and Distributed Systems: Testing and Debugging (PADTAD)". Concurrency and Computation: Practice and Experience 19(3): 265-266 (2007)
25. http://www.haifa.ibm.com/projects/verification/padtad/ index.html
26. Eitan Farchi, Yarden Nir, Shmuel Ur, "Concurrent Bug Patterns and How to Test Them", Workshop on Parallel and Distributed Testing and Debugging, 2003.
27. Robert O'Callahan, Jong-Deok Choi, "Hybrid Dynamic Data Race Detection", PPOPP 2003.
28. C. Hammer, J. Dolby, M. Vaziri, F. Tip, "Dynamic Detection of Atomic-Set-Serializability Violations", Accepted for publication at the 30th International Conference on Software Engineering (ICSE'08), Germany, May 2008