Parallel test generation and execution with Korat

6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering, ESEC/FSE 2007

Volumn , Issue , 2007, Pages 135-144

  Misailovic, Sasa ^a   Milicevic, Aleksandar ^a   Petrovic, Nemanja ^b   Khurshid, Sarfraz ^c   Marinov, Darko ^d  

^a UNIVERSITY OF BELGRADE   (Serbia)

^b GOOGLE INC   (United States)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Bounded exhaustive testing; Korat; Parallel testing; Test data generation

Indexed keywords

BOUNDED-EXHAUSTIVE TESTING; PARALLEL TESTING; TEST DATA GENERATION; COMPLEX TESTS; INFRA STRUCTURES; INPUT SIZES; KORAT; NOVEL ALGORITHMS; NOVEL METHODOLOGIES; PARALLEL SEARCHES; PARALLEL TESTS; SPEED-UP; STRUCTURAL CONSTRAINTS; SYSTEMATIC SEARCHES; TEST INPUTS;

ALGORITHMS; CONSTRAINT THEORY; PARALLEL PROCESSING SYSTEMS; CODES (SYMBOLS); INTERNET; SOFTWARE ENGINEERING; SOFTWARE TESTING; TESTING;

SOFTWARE TESTING; PARALLEL ALGORITHMS;

EID: 37849029299     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1287624.1287645     Document Type: Conference Paper

References (46)

1. F. A. Aloul, A. Ramani, I. L. Markov, and K. A. Sakallah. Solving difficult SAT instances in the presence of symmetry. In Proc. of the 39th Conference on Design Automation, 2002.
2. J. Barnat, L. Brim, and J. Chaloupka. Parallel breadth-first search ltl model-checking. In Proc. of the 18th IEEE International Conference on Automated Software Engineering, 2003.
3. B. Beizer. Software Testing Techniques. International Thomson Computer Press, 1990.
4. C. Boyapati, S. Khurshid, and D. Marinov. Korat: Automated testing based on Java predicates. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA), July 2002.
5. L. A. Clarke. A system to generate test data and symbolically execute programs. IEEE Transactions on Software Engineering, Sept. 1976.
6. J. Crawford, M. Ginsberg, E. Luks, and A. Roy. Symmetry-breaking predicates for search problems. In Proc. Fifth International Conference on Principles of Knowledge Representation and Reasoning, 1996.
7. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Sixth Symposium on Operating System Design and Implementation, San Francisco, CA, Dec. 2004.
8. M. B. Dwyer, S. Elbaum, S. Person, and R. Purandare. Parallel randomized state-space search. In Proc. of the 29th International Conference on Software Engineering (ICSE), Minneapolis, MN, May 2007.
9. S. Ghemawat, H. Gobioff, and S. Leung. The Google file system. In 19th Symposium on Operating Systems Principles, Lake George, NY, 2003.
10. A. Gotlieb, B. Botella, and M. Rueher. Automatic test data generation using constraint solving techniques. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA), Clearwater Beach, FL, 1998.
11. A. Grama and V. Kumar. State of the art in parallel search techniques for discrete optimization problems. IEEE Trans. Knowl. Data Eng., 11(1):28-35, 1999.
12. G. Holzmann. The model checker SPIN. IEEE Transactions on Software Engineering, 23(5), May 1997.
13. J. C. Huang. An approach to program testing. ACM Computing Surveys, 7(3), 1975.
14. R. Iosif. Exploiting heap symmetries in explicit-state model checking of software. In Proc. of the 16th Conference on Automated Software Engineering (ASE), Nov. 2001.
15. D. Jackson. Software Abstractions: Logic, Language and Analysis. The MIT Press, Cambridge, MA, 2006.
16. V. K. Janakiram, D. P. Agrawal, and R. Mehrotra. A randomized parallel backtracking algorithm. IEEE Trans. Comput., 37(12): 1665-1676, 1988.
17. M. D. Jones and J. Sorber. Parallel search for ltl violations. Int. J. Softw. Tools Technol. Transf, 7(1):31-42, 2005.
18. R. M. Karp and Y. Zhang. Randomized parallel algorithms for backtrack search and branch-and-bound computation. J. ACM, 40(3):765-789, 1993.
19. S. Khurshid. Generating Structurally Complex Tests from Declarative Constraints. PhD thesis, Dept. of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, 2003.
20. S. Khurshid and D. Marinov. Checking Java implementation of a naming architecture using TestEra. In S. D. Stoller and W. Visser, editors, Electronic Notes in Theoretical Computer Science (ENTCS), volume 55. Elsevier Science Publishers, 2001.
21. S. Khurshid and D. Marinov. TestEra: Specification-based testing of Java programs using SAT. Automated Software Engineering Journal, 11(4):403-434, Oct. 2004.
22. S. Khurshid, D. Marinov, I. Shlyakhter, and D. Jackson. A case for efficient solution enumeration. In Proc. of the Sixth International Conference on Theory and Applications of Satisfiability Testing (SAT 2003), Santa Margherita Ligure, Italy, May 2003.
23. J. C. King. Symbolic execution and program testing. Communications of the ACM, 19(7), 1976.
24. B. Korel. Automated test data generation for programs with procedures. In Proc. of the International Symposium on Software Testing and Analysis, San Diego, CA, 1996.
25. R. Kumar and E. G. Mercer. Load balancing parallel explicit state model checking. Electr. Notes Theor. Comput. Sci., 128(3):19-34, 2005.
26. F. Lerda and R. Sisto. Distributed-memory model checking with spin. In Proc. of the 5th and 6th International SPIN Workshops on Theoretical and Practical Aspects of SPIN Model Checking, pages 22-39, 1999.
27. F. Lerda and W. Visser. Addressing dynamic issues of program model checking. Lecture Notes in Computer Science, 2057:80-102, 2001.
28. B. Liskov and J. Guttag. Program Development in Java: Abstraction, Specification, and Object-Oriented Design. Addison-Wesley, 2000.
29. D. Marinov. Automatic Testing of Software with Structurally Complex Inputs. PhD thesis, Dept. of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, 2004.
30. D. Marinov, A. Andoni, D. Daniliuc, S. Khurshid, and M. Rinard. An evaluation of exhaustive testing for data structures. Technical Report MIT-LCS-TR-921, MIT Computer Science and Artificial Intelligence Lab, Cambridge, MA, Sept. 2003.
31. B. D. McKay. Practical graph isomorphism. Congressus Numerantium, 1(30):45-87, 1981. http://cs.anu.edu.au/"bdm/nauty/.
32. W. M. McKeeman. Differential testing for software. Digital Technical Journal, 10(1), 1998.
33. A. Milicevic, S. Misailovic, D. Marinov, and S. Khurshid. Korat: A tool for generating structurally complex test inputs. In Proc. of the International Conference on Software Engineering, Demo Papers (ICSE Demo 2007), pages 771-774, Minneapolis, MN, May 2007.
34. S. Misailovic, A. Milicevic, S. Khurshid, and D. Marinov. Generating test inputs for fault-tree analyzers using imperative predicates. In the Workshop on Advances and Innovations in Systems Testing (STEP 2007), Memphis, TN, May 2007.
35. R. Palmer and G. Gopalakrishnan. A distributed partial order reduction algorithm. In FORTE '02: Proceedings of the 22nd IFIP WG 6.1 International Conference on Formal Techniques for Networked and Distributed Systems, pages 370-379, 2002.
36. C. V. Ramamoorthy, S.-B. F. Ho, and W. T. Chen. On the automated generation of program test data. IEEE Transactions on Software Engineering, 2(4), 1976.
37. N. J. A. Sloane, S. Plouffe, J. M. Borwein, and R. M. Corless. The encyclopedia of integer sequences. SIAM Review, 38(2), 1996. http://www.research.att.com/~njas/sequences/Seis.html.
38. U. Stern and D. L. Dill. Parallelizing the murphi verifier. In CAV '97: Proceedings of the 9th International Conference on Computer Aided Verification, pages 256-278, London, UK, 1997. Springer-Verlag.
39. U. Stern and D. L. Dill. Parallelizing the Muriφ verifier. Formal Methods in System Design, 2001.
40. K. Stobie. Advanced modeling, model based test generation, and Abstract state machine Language (AsmL). Seattle Area Software Quality Assurance Group, http://www.sasqag.org/pastmeetings/asml.ppt, Jan. 2003.
41. K. Sullivan, J. Yang, D. Coppit, S. Khurshid, and D. Jackson. Software assurance by bounded exhaustive testing. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA), 2004.
42. R. Tarjan. Depth-first search and linear graph algorithms. SIAM Journal on Computing, 1(2):146-160, 1972.
43. M. Veanes, C. Campbell, W. Schulte, and N. Tillmann. Online testing with model programs. In Proceedings of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE), pages 273-282, New York, NY, 2005. ACM Press.
44. W. Visser, K. Havelund, G. Brat, and S. Park. Model checking programs. In Proc. of the 15th Conference on Automated Software Engineering (ASE), Grenoble, France, 2000.
45. E. J. Weyuker and T. J. Ostrand. Theories of program testing and the application of revealing subdomains. IEEE Transactions on Software Engineering, 6(3), May 1980.
46. T. Xie, D. Marinov, and D. Notkin. Rostra: A framework for detecting redundant object-oriented unit tests. In Proc. of the 19th IEEE International Conference on Automated Software Engineering, Sept. 2004.