Sufficient mutation operators for measuring test effectiveness

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2008, Pages 351-360

  Namin, Akbar Siami ^a   Andrews, James H ^a   Murdoch, Duncan J ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Mutation analysis; Testing effectiveness

Indexed keywords

SOFTWARE ENGINEERING; TESTING; COMPUTER SOFTWARE;

CROSS VALIDATIONS; LINEAR MODELS; MUTATION ANALYSIS; MUTATION OPERATORS; STATISTICAL ANALYSIS; TEST EFFECTIVENESS; TESTING EFFECTIVENESS;

MATHEMATICAL OPERATORS; TESTING;

CROSS VALIDATION; LINEAR MODEL; MUTATION ANALYSIS; MUTATION OPERATORS; STATISTICAL ANALYSIS; TEST EFFECTIVENESS;

EID: 57349122337     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1368088.1368136     Document Type: Conference Paper

References (26)

1. H. Agrawal, R. A. DeMillo, B. Hathaway, W. Hsu, W. Hsu, E. W. Krauser, R. J. Martin, A. P. Mathur, and E. Spafford. Design of mutant operators for the C programming language. Technical Report SERC-TR-41-P, Department of Computer Science, Purdue University, Lafayette, Indiana, April 2006.
2. J. H. Andrews, L. C. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering (ICSE 2005), St. Louis, Missouri, May 2005, 402-411.
3. J. H. Andrews, L. C. Briand, Y. Labiche, and A. Siami Namin. Using mutation analysis for assessing and comparing testing coverage criteria. IEEE Transactions on Software Engineering, 32(8):608-624, August 2006.
4. E. F. Barbosa, J. C. Maldonado, and A. M. R. Vincenzi. Toward the determination of sufficient mutant operators for C. Software Testing, Verification and Reliability, 11:113-136, 2001.
5. L. C. Briand, Y. Labiche, and M. M. Sówka. Automated, contract-based user testing of commercial-off-the-shelf components. In Proceedings of the 28th International Conference on Software Engineering (ICSE 2006), pages 92-101, Shanghai, China, 2006.
6. L. C. Briand, Y. Labiche, and Y. Wang. Using simulation to empirically investigate test coverage criteria based on statechart. In Proceedings of the 26th International Conference on Software Engineering (ICSE 2004), pages 86-95, Edinburgh, UK, May 2004.
7. M. E. Delamaro and J. C. Maldonado. Proteum - a tool for the assessment of test adequacy for C programs. In Proceedings of the Conference on Performability in Computing Systems (PCS 96), pages 79-95, New Brunswick, NJ, July 1996.
8. R. A. DeMillo, R. J. Lipton, and F. G. Sayward. Hints on test data selection: Help for the practicing programmer. Computer, 11:34-41, April 1978.
9. H. Do and G. Rothermel. On the use of mutation faults in empirical assessments of test case prioritization techniques. IEEE Transactions on Software Engineering, 32(9):733-752, 2006.
10. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani. Least angle regression. Annals of Statistics, 32(2):407-499, 2004.
11. P. G. Frankl and O. Iakounenko. Further empirical studies of test effectiveness. In Proceedings of the 6th ACM SIGSOET International Symposium on Foundations of Software Engineering, pages 153-162, Lake Buena Vista, FL, USA, 1998.
12. P. G. Frankl and S. N. Weiss. An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Transactions on Software Engineering, 19(8):774-787, August 1993.
13. J. P. Guilford. Fundamental Statistics in Psychology and Education. McGraw-Hill, New York, 1956.
14. R. G. Hamlet. Testing programs with the aid of a compiler. IEEE Transactions on Software Engineering, 3(4):279-290, July 1977.
15. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments of the effectiveness of dataflow- and control flow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering (ICSE 1994), pages 191-200, Sorrento, Italy, May 1994.
16. I. Jolliffe. Disgarding variables in a principal component analysis. I: Artificial data. Applied Statistics, 21(2):160-173, 1972.
17. I. Jolliffe. Disgarding variables in a principal component analysis. II: Real data. Applied Statistics, 22(1):21-31, 1973.
18. Y.-S. Ma, J. Offutt, and Y. R. Kwon. MuJava: An automated class mutation system. Software Testing, Verification and Reliability, 15(2):97-133, June 2005.
19. J. Mayer and C. Schneckenburger. An empirical analysis and comparison of random testing techniques. In Proceedings of the International Symposium on Empirical Software Engineering, pages 105-114, Rio de Janeiro, Brazil, 2006.
20. A. J. Offutt, A. Lee, G. Rothermel, R. H. Untch, and C. Zapf. An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering and Methodology, 5(2):99-118, April 1996.
21. A. J. Offutt and R. Untch. Mutation 2000: Uniting the orthogonal. In Mutation 2000: Mutation Testing in the Twentieth and the Twenty First Centuries, pages 45-55, San Jose, CA, October 2000.
22. G. Rothermel, M. J. Harrold, J. Ostrin, and C. Hong. An empirical study of the effects of minimization on the fault detection capabilities of test suites. In Proceedings of the International Conference on Software Maintenance (ICSM '98), pages 34-43, Washington, DC, USA, November 1998.
23. A. Siami Namin and J. H. Andrews. Finding sufficient mutation operators via variable reduction. In Mutation 2006, Raleigh, NC, USA, November 2006.
24. J. Tuya, M. J. Suárez-Cabal, and C. de la Riva. Mutating database queries. Information and Software Technology, 49(4):398-417, 2007.
25. W. N. Venables, D. M. Smith, and The R Development Core Team. An introduction to R. Technical report, R Development Core Team, June 2006.
26. W. E. Wong. On Mutation and Data Flow. PhD thesis, Purdue University, December 1993.