Regression mutation testing

2012 International Symposium on Software Testing and Analysis, ISSTA 2012 - Proceedings

Volumn , Issue , 2012, Pages 331-341

  Zhang, Lingming ^a   Marinov, Darko ^b   Zhang, Lu ^c   Khurshid, Sarfraz ^a  

^a The University of Texas at Austin   (United States)

^b University of Illinois at Urbana Champaign   (United States)

^c BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

Mutation Testing; Regression Mutation Testing; Regression Testing; Software Evolution; Static Analysis

Indexed keywords

EMPIRICAL STUDIES; EVOLVING SYSTEMS; EXPENSIVE TESTING; MUTATION TESTING; PRIORITIZATION; REGRESSION TESTING; SOFTWARE EVOLUTION; SOFTWARE SYSTEMS;

REGRESSION ANALYSIS; STATIC ANALYSIS;

SOFTWARE TESTING;

EID: 84865279311     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/04000800.2336793     Document Type: Conference Paper

References (46)

1. PIT. http://pitest.org/.
2. A. T. Acree, T. A. Budd, R. A. DeMillo, R. J. Lipton, and F. G. Sayward. Mutation analysis. Technical report, Georgia Institute of Technology, 1979.
3. P. Ammann and J. Offutt. Introduction to Software Testing. Cambridge University Press.
4. J. H. Andrews, L. C. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Proc. ICSE, pages 402-411, 2005.
5. E. F. Barbosa, J. C. Maldonado, and A. M. R. Vincenzi. Toward the determination of sufficient mutant operators for C. STVR, 11(2):113-136, 2001.
6. P. K. Chittimalli and M. J. Harrold. Recomputing coverage information to assist regression testing. IEEE TSE, 35(4):452-469, 2009.
7. M. E. Delamaro and J. C. Maldonado. Proteum-A tool for the assessment of test adequacy for C programs. In Proc. the Conference on Performability in Computing Sys PCS 96, pages 79-95, 1996.
8. R. A. DeMillo, E.W. Krauser, and A. P. Mathur. Compiler-integrated program mutation. In Proc. COMPSAC, pages 351-356, 1991.
9. R. A. DeMillo, R. J. Lipton, and F. G. Sayward. Hints on test data selection: Help for the practicing programmer. Computer, 11(4):34-41, 1978.
10. R. A. DeMillo and R. J. Martin. The Mothra software testing environment user's manual. Technical report, Software Engineering Research Center, 1987.
11. R. A. DeMillo and A. J. Offutt. Constraint-based automatic test data generation. IEEE TSE, 17(9):900-910, 1991.
12. H. Do and G. Rothermel. On the use of mutation faults in empirical assessments of test case prioritization techniques. IEEE TSE, pages 733-752, 2006.
13. P. G. Frankl, S. N. Weiss, and C. Hu. All-uses vs mutation testing: An experimental comparison of effectiveness. JSS, 38(3):235-253, 1997.
14. G. Fraser and A. Zeller. Mutation-driven generation of unit tests and oracles. In ISSTA, pages 147-158, 2010.
15. R. G. Hamlet. Testing programs with the aid of a compiler. IEEE TSE, pages 279-290, 1977.
16. M. Harman, Y. Jia, and W. B. Langdon. Strong higher order mutation-based test data generation. In Proc. FSE, pages 212-222, 2011.
17. M. J. Harrold, J. A. Jones, T. Li, D. Liang, A. Orso, M. Pennings, S. Sinha, S. A. Spoon, and A. Gujarathi. Regression test selection for java software. In Proc. OOPSLA, pages 312-326, 2001.
18. R. Hierons and M. Harman. Using program slicing to assist in the detection of equivalent mutants. STVR, 9(4):233-262, 1999.
19. W. E. Howden. Weak mutation testing and completeness of test sets. IEEE TSE, pages 371-379, 1982.
20. Y. Jia and M. Harman. An analysis and survey of the development of mutation testing. IEEE TSE, 37(5):649-678, 2011.
21. K. N. King and A. J. Offutt. A Fortran language system for mutation-based software testing. Software: Practice and Experience, 21(7):685-718, 1991.
22. A. Kinneer, M. Dwyer, and G. Rothermel. Sofya: A flexible framework for development of dynamic program analyses for java software. Technical report, CSE, UNL, 2006.
23. E. W. Krauser, A. P. Mathur, and V. Rego. High performance software testing on SIMD machines. IEEE TSE, 17(5):403-423, 1991.
24. Y. S. Ma, J. Offutt, and Y. R. Kwon. MuJava: An automated class mutation system. STVR, 15(2):97-133, 2005.
25. A. P. Mathur. Performance, effectiveness, and reliability issues in software testing. In Proc. COMPSAC, pages 604-605, 1991.
26. A. P. Mathur and E.W. Krauser. Mutant unification for improved vectorization. Technical report, Purdue University, 1988.
27. D. Melski and T. Reps. Interconvertibility of a class of set constraints and context-free-language reachability. Theoretical Computer Science, 248(1-2):29-98, 2000.
28. A. S. Namin, J. H. Andrews, and D. J. Murdoch. Sufficient mutation operators for measuring test effectiveness. In Proc. ICSE, pages 351-360, 2008.
29. A. J. Offutt and W. M. Craft. Using compiler optimization techniques to detect equivalent mutants. STVR, 4(3):131-154, 1994.
30. A. J. Offutt, Z. Jin, and J. Pan. The dynamic domain reduction approach to test data generation. Software Practice and Experience, 29(2):167-193, 1999.
31. A. J. Offutt, A. Lee, G. Rothermel, R. H. Untch, and C. Zapf. An experimental determination of sufficient mutation operators. ACM TOSEM, 5(2):99-118, 1996.
32. A. J. Offutt, J. Pan, and J. M. Voas. Procedures for reducing the size of coverage-based test sets. In Proc. International Conference on Testing Computer Software, 1995.
33. A. J. Offutt, R. P. Pargas, S. V. Fichter, and P. K. Khambekar. Mutation testing of software using MIMD computer. In Proc. International Conference on Parallel Processing, pages 257-266, 1992.
34. A. Orso, N. Shi, and M. J. Harrold. Scaling regression testing to large software systems. In Proc. FSE, pages 241-252, 2004.
35. S. Person, G. Yang, N. Rungta, and S. Khurshid. Directed incremental symbolic execution. In Proc. PLDI, pages 504-515, 2011.
36. T. Reps. Program analysis via graph reachability. Information and software technology, 40(11):701-726, 1998.
37. G. Rothermel and M. J. Harrold. A safe, efficient regression test selection technique. ACM TOSEM, 6(2):173-210, 1997.
38. D. Schuler, V. Dallmeier, and A. Zeller. Efficient mutation testing by checking invariant violations. In Proc. ISSTA, pages 69-80, 2009.
39. D. Schuler and A. Zeller. Javalanche: Efficient mutation testing for Java. In Proc. FSE, pages 297-298, 2009.
40. R. Untch, A. J. Offutt, and M. J. Harrold. Mutation analysis using program schemata. In Proc. ISSTA, pages 139-148, 1993.
41. W. E.Wong and A. P. Mathur. Reducing the cost of mutation testing: An empirical study. JSS, 31(3):185-196, 1995.
42. M. Woodward and K. Halewood. From weak to strong, dead or alive? an analysis of some mutation testing issues. In Proc. of the Second Workshop on Software Testing, Verification, and Analysis, pages 152-158, 1988.
43. Z. Xu, Y. Kim, M. Kim, G. Rothermel, and M. B. Cohen. Directed test suite augmentation: techniques and tradeoffs. In Proc. FSE, pages 257-266, 2010.
44. G. Yang, M. B. Dwyer, and G. Rothermel. Regression model checking. In Proc. ICSM, pages 115-124, 2009.
45. L. Zhang, S. S. Hou, J. J. Hu, T. Xie, and H. Mei. Is operator-based mutant selection superior to random mutant selection? In Proc. ICSE, pages 435-444, 2010.
46. L. Zhang, T. Xie, L. Zhang, N. Tillmann, J. de Halleux, and H. Mei. Test generation via dynamic symbolic execution for mutation testing. In Proc. ICSM, pages 1-10, 2010.