Tool support for randomized unit testing

Proceedings of the 1st International Workshop on Random Testing, RT'06

Volumn 2006, Issue , 2006, Pages 36-45

  Andrews, James H ^a   Haldar, Susmita ^a   Lei, Yong ^a   Li, Felix Chun Hang ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Randomized testing; Unit testing

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SOFTWARE; CONFORMAL MAPPING; JAVA PROGRAMMING LANGUAGE; TREES (MATHEMATICS);

RANDOMIZED TESTING; UNIT TESTING;

INSTRUMENT TESTING;

EID: 34247380772     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1145735.1145741     Document Type: Conference Paper

References (36)

1. J. H. Andrews, L. C. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering (ICSE 2005), St. Louis, Missouri, May 2005. To appear.
2. J. H. Andrews, S. Haldar, Y. Lei, and C. H. F. Li. Randomized unit testing: Tool support and best practices. Technical Report 663, Department of Computer Science, University of Western Ontario, London, Ontario, Canada, January 2006.
3. J. H. Andrews and Y. Zhang. General test result checking with log file analysis. IEEE Transactions on Software Engineering, 29(7):634-648, July 2003.
4. S. Antoy and R. G. Hamlet. Automatically checking an implementation against its formal specification. IEEE Transactions on Software Engineering, 26(1):55-69, January 2000.
5. K. Beck. Test-Driven Development By Example. Addison-Wesley, Boston, 2003.
6. K. Beck. RE: [junit] "Bug in JUnit MoneyBag.java example?" found by Jamie Andrews, "junit" Yahoo Group, 14125, July 2005. http://groups.yahoo.com/group/junit/message/14125.
7. C. Boyapati, S. Khurshid, and D. Marinov. Korat: automated testing based on Java predicates. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA 2002), pages 123-133, Rome, Italy, July 2002.
8. L. Burdy, Y. Cheon, D. R. Cok, M. D. Ernst, J. R. Kiniry, and G. T. Leavens. An overview of JML tools and applications. International Journal on Software Tools for Technology Transfer, 7(3):212-232, June 2005.
9. K. Claessen and J. Hughes. QuickCheck: A lightweight tool for random testing of Haskell programs. In Proceedings of the Fifth ACM SIGPLAN International Conference on Functional Programming (ICFP '00), pages 268-279, Montreal, Canada, September 2000.
10. C. Csallner and Y. Smaragdakis. JCrasher: an automatic robustness tester for Java. Software Practice and Experience, 34(11):1025-1050, 2004.
11. H. Do and G. Rothermel. A controlled experiment assessing test case prioritization techniques via mutation faults. In 21st IEEE International Conference on Software Maintenance (ICSM 2005), pages 411-420, Budapest, Hungary, September 2005.
12. R.-K. Doong and P. G. Frankl. The ASTOOT approach to testing object-oriented programs. ACM Transactions on Software Engineering and Methodology, 3(2):101-130, April 1994.
13. P. G. Frankl, R. G. Hamlet, B. Littlewood, and L. Strigini. Evaluating testing methods by delivered reliability. IEEE Transactions on Software Engineering, 24(8):586-601, August 1998.
14. P. G. Frankl and S. N. Weiss. An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Transactions on Software Engineering, 19(8):774-787, August 1993.
15. W. J. Gutjahr. Partition testing vs. random testing: The influence of uncertainty. IEEE Transactions on Software Engineering, 25(5):661-674, September/October 1999.
16. D. Hamlet and R. Taylor. Partition testing does not inspire confidence. IEEE Transactions on Software Engineering, 16(12):1402-11, December 1990.
17. K. Havelund and T. Pressburger. Model checking Java programs using Java PathFinder. International Journal on Software Tools for Technology Transfer, 2(4):366-381, 2000.
18. M. Hennessy and J. F. Power. An analysis of rule coverage as a criterion in generating minimal test suites for grammar-based software. In Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE 2005), pages 104-113, Long Beach, CA, USA, November 2005.
19. D. Hoffman and P. Strooper. Classbench: A framework for automated class testing. Software Practice and Experience, 27(5):573-597, May 1997.
20. S. Khurshid and D. Marinov. TestEra: Specification-based testing of Java programs using SAT. Automated Software Engineering, 11(4):403-434, 2004.
21. Y. Ledru, L. du Bousquet, O. Maury, and P. Bontron. Filtering TOBIAS combinatorial test suites. In Proceedings of ETAPS/FASE'04 - Fundamental Approaches to Software Engineering, volume 2984 of LNCS, pages 281-294, Barcelona, Spain, 2004. Springer-Verlag.
22. D. Lee and M. Yannakakis. Principles and methods of testing finite state machines: A survey. Proceedings of the IEEE, 84:1090-1126, 1996.
23. Y. Lei and J. H. Andrews. Minimization of randomized unit test cases. In Proceedings of the 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05), pages 267-276, Chicago, November 2005.
24. D. Leon, W. Masri, and A. Podgurski. An empirical evaluation of test case filtering techniques based on exercising complex information flows. In Proceedings of the 27th International Conference on Software Engineering (ICSE2005), pages 412-421, St. Louis, MO, May 2005.
25. W. K. Leow, S. C. Khoo, and Y. Sun. Automated generation of test programs from closed specifications of classes and test cases. In Proceedings of the 26th International Conference on Software Engineering (ICSE 2004), pages 96-105, Edinburgh, UK, May 2004.
26. W. M. McKeeman. Differential testing for software. Digital Technical Journal, 10(1):100-107, December 1998.
27. B. P. Miller, L. Fredriksen, and B. So. An empirical study of the reliability of UNIX utilities. Communications of the ACM, 33(12):32-44, December 1990.
28. A. J. Offutt and R. Untch. Mutation 2000: Uniting the orthogonal. In Mutation 2000: Mutation Testing in the Twentieth and the Twenty First Centuries, pages 45-55, San Jose, CA, October 2000.
29. C. Oriat. Jartege: A tool for random generation of unit tests for Java classes. Technical Report RR 1069, Institut d'Informatique et de Mathématiques Appliquées de Grenoble (IMAG), Grenoble, France, June 2004.
30. G. Rothermel, M. J. Harrold, J. Ostrin, and C. Hong. An empirical study of the effects of minimization on the fault detection capabilities of test suites. In Proceedings of the International Conference on Software Maintenance (ICSM '98), pages 34-43, Washington, DC, USA, November 1998.
31. K. Sen, D. Marinov, and G. Agha. CUTE: a concolic unit testing engine for C. In Proceedings of the 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC/FSE), pages 263-272, Lisbon, September 2005.
32. N. Tillmann and W. Schulte. Parameterized unit tests with Unit Meister. In Proceedings of the 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC/FSE), pages 241-244, Lisbon, September 2005.
33. N. Tillmann, W. Schulte, and W. Grieskamp. Parameterized unit tests. Technical Report MSR-TR-2005-64, Microsoft Research, May 2005.
34. G. D. Venolia, R. DeLine, and T. LaToza. Software development at Microsoft observed. Technical Report MSR-TR-2005-140, Microsoft Research, October 2005.
35. W. Visser, C. S. Pasareanu, and S. Khurshid. Test input generation with Java PathFinder. In Proceedings of the ACM/SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2004), pages 97-107, Boston, MA, July 2004.
36. A. Zeller and R. Hildebrandt. Simplifying and isolating failure-inducing input. IEEE Transactions on Software Engineering, 28(2):183-200, February 2002.