Combining unit-level symbolic execution and system-level concrete execution for testing NASA software

ISSTA'08: Proceedings of the 2008 International Symposium on Software Testing and Analysis 2008

Volumn , Issue , 2008, Pages 15-25

  Pǎsǎreanu, Corina S ^a   Mehlitz, Peter C ^a   Bushnell, David H ^a   Gundy Burlet, Karen ^a   Lowry, Michael ^a   Person, Suzette ^b   Pape, Mark ^c  

^a NASA AMES RESEARCH CENTER   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^c NASA JOHNSON SPACE CENTER   (United States)

Author keywords

Software model checking; Symbolic execution; System testing; Unit testing

Indexed keywords

CRITICAL SOFTWARES; CRITICAL SYSTEMS; DESIGN CHANGES; FLIGHT SOFTWARES; JAVA PATHFINDERS; NASA PROJECTS; PROGRAM DATUMS; PROGRAM EXECUTIONS; SOFTWARE MODEL CHECKING; SYMBOLIC EXECUTION; SYMBOLIC EXECUTIONS; SYSTEM TESTING; TEST CASE GENERATIONS; TEST CASES; UNIT TESTING;

COMPUTER PROGRAMMING LANGUAGES; COMPUTER SOFTWARE; COMPUTER SOFTWARE SELECTION AND EVALUATION; CONCRETE CONSTRUCTION; CONCRETE TESTING; MODEL CHECKING; NASA; PROGRAM INTERPRETERS; SAFETY TESTING; SOFTWARE PROTOTYPING;

SOFTWARE TESTING;

EID: 57449120657     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1390630.1390635     Document Type: Conference Paper

References (35)

1. A. Acevedo, J. Arnold, and W. Othon. ANTARES: Spacecraft simulation for multiple user communities and facilities. In AIAA Modeling and Simulation Technologies Conference and Exhibit, 2007.
2. P. Ammann, P. E. Black, and W. Majurski. Using model checking to generate tests from specifications. In Proc. of the 2nd IEEE International Conference on Formal Engineering Methods, 1998.
3. M. d'Amorim, C. Pacheco, T. Xie, D. Marinov, and M. D. Ernst. An Empirical Comparison of Automated Generation and Classification. In Proc. of the 21st ASE, 2006.
4. S. Anand, A. Orso, and M. J. Harrold. Type-dependence analysis and program transformation for Symbolic execution. In Proc. of the 13th TACAS Conference, 2007.
5. S. Anand, C. S. Pǎsǎreanu, and W. Visser. JPF-SE: A symbolic execution extension to Java PathFinder. In Proc. of the 13th TACAS Conference, 2007.
6. T. Ball. A theory of predicate-complete test coverage and generation, 2004. Microsoft Research Technical Report MSR-TR-2004-28.
7. T. Ball and S. K. Rajamani. The SLAM project: Debugging system software via static analysis. In Proc. 29th Annual ACM Symposium on the Principles of Programming Languages (POPL), pages 1-3, 2002.
8. D. Beyer, A. J. Chlipala, T. A. Henzinger, R. Jhala, and R. Majumdar. Generating tests from counterexamples. In Proc. of the 26th International Conference on Software Engineering (ICSE), 2004.
9. C. Cadar, V. Ganesh, P. M. Pawlowski, D. L. Dill, and D. R. Engler. EXE: automatically generating inputs of death. In Proc. ACM Conference on Computer and Communications Security, 2006.
10. The Choco Constraint Solver. http://choco.sourceforge.net/.
11. L. A. Clarke. A system to generate test data and symbolically execute programs. IEEE Trans. Software Eng, 2(3):215-222, 1976.
12. The Daikon invariant detector. http://groups.csail.mit.edu/pag/daikon//.
13. X. Deng, J. Lee, and Robby. Bogor/Kiasan: A k-bounded Symbolic Execution for Checking Strong-Heap Properties of Open Systems. In Proc. of the. 21st ASE, 2006.
14. D. L. Detlefs, K. R. M. Leino, G. Nelson, and J. B. Saxe. Extended static checking. Research Report 159, Compaq Systems Research Center, 1998.
15. S. G. Elbaum, H. N. Chin, M. B. Dwyer, and J. Dokulil. Carving differential unit test cases from system test cases. In Proc. of SIGSOFT FSE, 2006.
16. E. Gamma, R. Helm, R. Johnson, and J. M. Vlissides. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, 1994.
17. A. Gargantini and C. Heitmeyer. Using model checking to generate tests from requirements specifications. In Proc. of the 7th European Software Engineering Conference, Held Jointly with the 7th ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE), 1999.
18. P. Godefroid. Model checking for programming languages using VeriSoft. In Proceedings of the 24th Annual ACM Symposium, on the Principles of Programming Languages (POPL), pages 174-186, Paris, France, Jan. 1997.
19. P. Godefroid, N. Klarlund, and K. Sen. DART: directed automated random testing. In Proc. PLDI, 2005.
20. B. S. Gulavani, T. A. Henzinger, Y. Kannan, A. V. Nori, and S. K. Rajamani. SYNERGY: a new algorithm for property checking. In Proc. of SIGSOFT FSE, 2006.
21. M. P. E. Heimdahl, S. Rayadurgam, W. Visser, D. George, and J. Gao. Auto-generating test sequences using model checkers: A case study. In Proc. 3rd International Workshop on Formal Approaches to Testing of Software (FATES), Montreal, Canada, Oct. 2003.
22. T. A. Henzinger, R. Jhala, R. Majumdar, and G. Sutre. Software verification with blast. In Proceedings of the Tenth International Workshop on Model Checking of Software, volume 2648 of Lecture Notes in Computer Science, 2003.
23. G. Holzmann. The Spin Model Checker: Primer and Reference Manual. Addison-Wesley, 2003.
24. H. S. Hong, I. Lee, O. Sokolsky, and H. Ural. A temporal logic based theory of test coverage and generation. In Proc. 8th International Conference on Tools and Algorithms for Construction and Analysis of Systems (TACAS), Grenoble, France, April 2002.
25. IASolver. http://www.cs.brandeis.edu/̃tim/Applets/IAsolver.html.
26. Java PathFinder. http://javapathfinder.sourceforge.net.
27. S. Khurshid, C. S. Pǎsǎreanu, and W. Visser. Generalized symbolic execution for model checking and testing. In Proc. of the 9th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS), 2003.
28. J. C. King. Symbolic execution and program testing. Communications of the ACM, 19(7):385-394, 1976.
29. T. Lev-Ami and M. Sagiv. TVLA: A system for implementing static analyses. In Proc. Static Analysis Symposium, Santa Barbara, CA, June 2000.
30. T. Lindholm and F. Yellin. Java(TM) Virtual Machine Specification. Prentice Hall, 1999.
31. T. Menzies and Y. Hu. Data mining for very busy people. Computer, 36(ll):22-29, 2003.
32. K. Sen, D. Marinov, and G. Agha. CUTE: a concolic unit testing engine for C. In Proc. ESEC/SIGSOFT FSE, 2005.
33. W. Visser, C. S. Pasareanu, and R. Pelanek. Test input generation for Java containers using state matching. In Proc. ISSTA, 2006.
34. T. Xie, D. Marinov, W. Schulte, and D. Notkin. Symstra: A framework for generating object-oriented unit tests using symbolic execution. In Proc. of the 11th International Conference on Tools and Algorithms for Construction and Analysis of Systems (TACAS), 2005.
35. G. Yorsh, T. Ball, and M. Sagiv. Testing, abstraction, theorem proving: better together! In Proc. ISSTA, 2006.