Is mutation an appropriate tool for testing experiments?

Proceedings - International Conference on Software Engineering

Volumn 2005, Issue , 2005, Pages 402-411

  Andrews, J H ^a   Briand, L C ^b   Labiche, Y ^b  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b CARLETON UNIVERSITY   (Canada)

Author keywords

Hand seeded faults; Mutants; Real faults

Indexed keywords

HAND SEEDED FAULTS; MUTATION OPERATORS; SOFTWARE TESTING RESEARCH;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA REDUCTION; ENGINEERING RESEARCH; FAULT TOLERANT COMPUTER SYSTEMS; MANUAL CONTROL;

SOFTWARE ENGINEERING;

EID: 26044454396     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2005.1553583     Document Type: Conference Paper

References (26)

1. J. H. Andrews and Y. Zhang, "General Test Result Checking with Log File Analysis," IEEE Transactions on Software Engineering, vol. 29 (7), pp. 634-648, 2003.
2. L. Briand, Y. Labiche and Y. Wang, "Using Simulation to Empirically Investigate Test Coverage Criteria," Proc. IEEE/ACM International Conference on Software Engineering, Edinburgh, pp. 86-95, May, 2004.
3. T. A. Budd and D. Angluin, "Two Notions of Correctness and their Relation to Testing," Acta Informatica, vol. 18 (1), pp. 31-45, 1982.
4. D. T. Campbell and J. C. Stanley, Experimental and Quasi-Experimental Designs for Research, Houghton Mifflin Company, 1990.
5. W. Chen, R. H. Untch, G. Rothermel, S. Elbaum and J. von Ronne, "Can fault-exposure-potential estimates improve the fault detection abilities of test suites?," Software Testing, Verification and Reliability, vol. 12 (4), pp. 197-218, 2002.
6. R. A. DeMillo, R. J. Lipton and F. G. Sayward, "Hints on Test Data Selection: Help for the Practicing Programmer," IEEE Computer, vol. 11 (4), pp. 34-41, 1978.
7. th Edition, 1999.
8. H. Do, G. Rothermel and S. Elbaum, "Infrastructure support for controlled experimentation with software testing and regression testing techniques," Oregon State University, Corvallis, OR, USA, Technical report 04-06-01, January, 2004.
9. th ACM SIGSOFT International Symposium on Foundations of Software Engineering, Orlando (FL, USA), pp. 153-162, November 1-5, 1998.
10. th Symposium on Testing, Analysis, and Verification, New York, pp. 154-164, 1991.
11. T. L. Graves, M. J. Harrold, J.-M. Kim, A. Porter and G. Rothermel, "An Empirical Study of Regression Test Selection Techniques," ACM Transactions on Software Engineering and Methodology, vol. 10 (2), pp. 184-208, 2001.
12. R. G. Hamlet, "Testing programs with the aid of a compiler," IEEE Transactions on Software Engineering, vol. 3 (4), pp. 279-290, 1977.
13. th International Conference on Software Engineering, Portland, OR, USA, pp. 60-71, May, 2003.
14. th IEEE International Conference on Software Engineering, Sorrento (Italy), pp. 191-200, May 16-21, 1994.
15. S. Kim, J. A. Clark and J. A. McDermid, "Investigating the Effectiveness of Object-Oriented Testing Strategies with the Mutation Method," Software Testing, Verification and Reliability, vol. 11 (3), pp. 207-225, 2001.
16. A. M. Memon, I. Banerjee and A. Nagarajan, "What Test Oracle Should I use for Effective GUI Testing?," Proc. IEEE International Conference on Automated Software Engineering (ASE'03), Montreal, Quebec, Canada, pp. 164-173, October, 2003.
17. A. J. Offutt, "Investigations of the Software Testing Coupling Effect," ACM Transactions on Software Engineering and Methodology, vol. 1 (1), pp. 3-18, 1992.
18. A. J. Offutt, A. Lee, G. Rothermel, R. H. Untch and C. Zapf, "An Experimental Determination of Sufficient Mutation Operators," ACM Transactions on Software Engineering and Methodology, vol. 5 (2), pp. 99-118, 1996.
19. A. J. Offutt and J. Pan, "Detecting Equivalent Mutants and the Feasible Path Problem," Software Testing, Verification, and Reliability, vol. 7 (3), pp. 165-192, 1997.
20. A. J. Offutt and R. H. Untch, "Mutation 2000: Uniting the Orthogonal," Proc. Mutation, San Jose, CA, USA, pp. 45-55, October, 2000.
21. T. J. Ostrand and M. J. Balcer, "The Category-Partition Method for Specifying and Generating Functional Test," Communications of the ACM, vol. 31 (6), pp. 676-686, 1988.
22. nd Edition, 1995.
23. G. Rothermel and M. J. Harrold, "Empirical Studies of a Safe Regression Test Selection Technique," IEEE Trans. on Software Engineering, vol. 24 (6), pp. 401-419, 1998.
24. st International Symposium on Fault-Tolerant Computing, Montreal, Canada, pp. 410-417, June, 1991.
25. F. I. Vokolos and P. G. Frankl, "Empirical evaluation of the textual differencing regression testing technique," Proc. IEEE International Conference on Software Maintenance, Bethesda, MD, USA, pp. 44-53, March, 1998.
26. C. Wohlin, P. Runeson, M. Host, M. C. Ohlsson, B. Regnell and A. Wesslen, Experimentation in Software Engineering - An Introduction, Kluwer, 2000.