An empirical comparison of automated generation and classification techniques for object-oriented unit testing

Proceedings - 21st IEEE/ACM International Conference on Automated Software Engineering, ASE 2006

Volumn , Issue , 2006, Pages 59-68

  D'Amorim, Marcelo ^a   Pacheco, Carlos ^b   Xie, Tao ^c   Marinov, Darko ^a   Ernst, Michael D ^b  

^a University of Illinois at Urbana Champaign   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c North Carolina State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

OBJECT ORIENTED PROGRAMMING; RANDOM VARIABLES; SOFTWARE RELIABILITY; SOFTWARE TESTING;

CLASSIFICATION TECHNIQUES; EXCEPTION-BASED SYMBOLIC TESTING; OBJECT-ORIENTED PROGRAMS;

CLASSIFICATION (OF INFORMATION);

EID: 34547417999     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASE.2006.13     Document Type: Conference Paper

References (35)

1. Agitar Agitator3.0, 2005. http://www.agitar.com/.
2. C. W. Barrett and S. Berezin. CVC Lite: A new implementation of the cooperating validity checker. In Proc. 16th CAV, pages 515-518, July 2004.
3. C. Cadar and D. R. Engler. Execution generated test cases: How to make systems code crash itself. In Proc. 12th International SPIN Workshop on Model Checking Software, pages 2-23, August 2005.
4. Y. Cheon and G. T. Leavens. A simple and practical approach to unit testing: The JML and JUnit way. In Proc. 16th ECOOP, pages 231-255, June 2002.
5. K. Claessen and J. Hughes. QuickCheck: a lightweight tool for random testing of Haskell programs. In Proc. 5th ACM SIGPLAN ICFP, pages 268-279, 2000.
6. C. Csallner and Y. Smaragdakis. JCrasher: an automatic robustness tester for Java. Software: Practice and Experience, 34:1025-1050, 2004.
7. J. Duran and S. Ntafos. An evaluation of random testing. IEEE Trans. Software Eng., 10(4):438-444, 1984.
8. M. D. Ernst, J. Cockrell, W. G. Griswold, and D. Notkin. Dynamically discovering likely program invariants to support program evolution. IEEE Trans. Softw. Eng., 27(2):99-123, 2001.
9. R. Ferguson and B. Korel. The chaining approach for software test data generation. ACM Trans. Softw. Eng. Methodol, 5(1):63-86, 1996.
10. P. G. Frankl and S. N. Weiss. An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Trans. Softw. Eng., 19(8):774-787, August 1993.
11. P. Godefroid, N. Klarlund, and K. Sen. DART: Directed automated random testing. In Proc. ACM SIGPLAN 2005 PLDI, pages 213-223, 2005.
12. N. Gupta, A. P. Mathur, and M. L. Soffa. Automated test data generation using an iterative relaxation method. In Proc. 6th ACM SIGSOFT FSE, pages 231-244, 1998.
13. R. G. Hamlet and R. Taylor. Partition testing does not inspire confidence. IEEE Trans. Software Eng., 16(12):1402-1411, 1990.
14. S. Hangal and M. S. Lam. Tracking down software bugs using automatic anomaly detection. In Proc. 24th ICSE, pages 291-301, 2002.
15. M. Harder, J. Mellen, and M. D. Ernst. Improving test suites via operational abstraction. In Proc. 25th ICSE, pages 60-71, 2003.
16. JML website, 2006. http://www.jmlspeos.org/.
17. S. Khurshid, C. S. Pasareanu, and W. Visser. Generalized symbolic execution for model checking and testing. In Proc. 9th TACAS, pages 553-568, April 2003.
18. C. Pacheco and M. D. Ernst. Eclat: Automatic generation and classification of test inputs. In Proc. 19th ECOOP, pages 504-527, July 2005.
19. N. Rutar, C. B. Almazan, and J. S. Foster. A comparison of bug finding tools for Java. In Proc. 15th IEEE ISSRE, pages 245-256, November 2004.
20. H. Schlenker and G. Ringwelski. POOC: A platform for object-oriented constraint programming. In Proc. 2002 International Workshop on Constraint Solving and Constraint Logic Programming, pages 159-170, June 2002.
21. K. Sen, D. Marinov, and G. Agha. CUTE: A concolic unit testing engine for C. In Proc. 5th ESEC/FSE, pages 263-272, September 2005.
22. D. Stotts, M. Lindsey, and A. Antley. An informal formal method for systematic JUnit test case generation. In Proc. 2002 XP/Agile Universe, pages 131-143, 2002.
23. N. Tillmann and W. Schulte. Unit tests reloaded: Parameterized unit testing with symbolic execution. Technical Report MSR-TR-2005-153, Microsoft Research, Redmond, Washington, November 2005.
24. G. Venolia, R. DeLine, and T. LaToza. Software development at Microsoft observed. Technical Report MSR-TR-2005-140, Microsoft Research, Redmond, WA, Oct. 2005.
25. W. Visser, K. Havelund, G. Brat, and S. Park. Model checking programs. In Proc. 15th IEEE ASE, pages 3-12, 2000.
26. W. Visser, C. S. Pasareanu, and S. Khurshid. Test input generation with Java PathFinder. In Proc. 2004 ACM SIGSOFT ISSTA, pages 97-107, 2004.
27. W. Visser, C. S. Pasareanu, and R. Pelánek. Test input generation for red-black trees using abstraction. In Proc. 20th IEEE/ACMASE, pages 414-417, November 2005.
28. S. Visvanathan and N. Gupta. Generating test data for functions with pointer inputs. In Proc. 17th IEEE ASE, pages 149-160, September 2002.
29. S. Wagner, J. Jurjens, C. Koller, and P. Trischberger. Comparing bug finding tools with reviews and tests. In Proc. 17th IFIP TC6/WG 6.1 International Conference on Testing of Communicating Systems, pages 40-55, May 2005.
30. M. A. Weiss. Data Structures and Algorithm Analysis in Java. Addison Wesley, 1999.
31. E. J. Weyuker and B. Jeng. Analyzing partition testing strategies. IEEE Trans. Software Eng., 17(7):703-711, 1991.
32. T. Xie, D. Marinov, and D. Notkin. Rostra: A framework for detecting redundant object-oriented unit tests. In Proc. 19th IEEE ASE, pages 196-205, Sept. 2004.
33. T. Xie, D. Marinov, W. Schulte, and D. Notkin. Symstra: A framework for generating object-oriented unit tests using symbolic execution. In Proc. 11th TACAS, pages 365-381, April 2005.
34. T. Xie and D. Notkin. Tool-assisted unit test selection based on operational violations. In Proc. 18th IEEE ASE, pages 40-48, 2003.
35. M. Zitser, R. Lippmann, and T. Leek. Testing static analysis tools using exploitable buffer overflows from open source code. In Proc. 12th ACM SIGSOFT FSE, pages 97-106, 2004.