An Experimental Determination of Sufficient Mutant Operators

ACM Transactions on Software Engineering and Methodology

Volumn 5, Issue 2, 1996, Pages 99-118

  Offutt, A Jefferson ^a   Lee, Ammei ^a   Rothermel, Gregg ^b,e   Untch, Roland H ^c   Zapf, Christian ^d  

^a GEORGE MASON UNIVERSITY   (United States)

^b CLEMSON UNIVERSITY   (United States)

^c MIDDLE TENNESSEE STATE UNIVERSITY   (United States)

^d SIEMENS AG   (Germany)

^e AMRL   (United States)

Author keywords

D.2.5 Software Engineering : Testing and debugging test data generators; Experimentation; Measurement; Reliability

Indexed keywords

EVALUATION; MEASUREMENTS; PROGRAM DEBUGGING; RELIABILITY; TESTING;

SELECTIVE MUTATION TESTING; SUFFICIENT MUTANT OPERATORS; TEST DATA GENERATORS; UNIT TESTING;

SOFTWARE ENGINEERING;

EID: 0030121550     PISSN: 1049331X     EISSN: None     Source Type: Journal    
DOI: 10.1145/227607.227610     Document Type: Article

References (27)

1. ACREE, A. T., BUDD, T. A., DEMILLO, R. A., LIPTON, R. J., AND SAYWARD, F. G. 1979. Mutation analysis. Tech. Rep. GIT-ICS-79/08, School of Information and Computer Science, Georgia Inst. of Technology, Atlanta, Ga. Sept.
2. BUDD, T. A. 1980. Mutation analysis of program test data. Ph.D. thesis, Yale Univ., New Haven, Conn.
3. BUDD, T. A. AND ANGLUIN, D. 1982. Two notions of correctness and their relation to testing. Acta Informatica 18, 1 (Nov.), 31-45.
4. BUDD, T., DEMILLO, R. A., LIPTON, R. J., AND SAYWARD, F. G. 1980. Theoretical and empirical studies on using program mutation to test the functional correctness of programs. In Proceedings of the 1980 ACM Principles of Programming Languages Symposium. ACM, New York, 220-233.
5. CHOI, B. AND MATHUR, A. P. 1993. High performance mutation testing. J. Syst. Softw. 20, 2 (Feb.), 135-152.
6. DEMILLO, R. A. AND OFFUTT, A. J. 1991. Constraint-based automatic test data generation. IEEE Trans. Softw. Eng. 17, 9 (Sept.), 900-910.
7. DEMILLO, R. A. AND OFFUTT, A. J. 1993. Experimental results from an automatic test case generator. ACM Trans. Softw. Eng. Meth. 2, 2 (Apr.), 109-127.
8. DEMILLO, R. A., GUINDI, D. S., KING, K. N., MCCRACKEN, W. M., AND OFFUTT, A. J. 1988. An extended overview of the Mothra software testing environment. In Proceedings of the 2nd Workshop on Software Testing, Verification, and Analysis (Banff, Alberta, Canada, July). IEEE Computer Society Press, Los Alamitos, Calif., 142-151.
9. DEMILLO, R. A., LIPTON, R. J., AND SAYWARD, F. G. 1978. Hints on test data selection: Help for the practicing programmer. IEEE Comput. 11, 4 (Apr.), 34-41.
10. FREUND, R. J. AND LITTELL, R. C. 1981. SAS for Linear Models: A Guide to the ANOVA and GLM Procedures. SAS Institute, Inc., Cary, N. Carol.
11. FRANKL, P. G., WEISS, S. N., AND HU, C. 1994. All-uses versus mutation testing: An experimental comparison of effectiveness. Tech. Rep. PUCS-100-94, Dept. of Computer Science, Polytechnic Univ., Brooklyn, N.Y. Feb.
12. HAMLET, R. G. 1977. Testing programs with the aid of a compiler. IEEE Trans. Softw. Eng. 3, 4 (July).
13. HOW TAI WAH, K. S. 1995. Fault coupling in finite bijective functions. J. Softw. Testing Verif. Reliab. 5, 1 (Mar.), 3-47.
14. KING, K. N. AND OFFUTT, A. J. 1991. A Fortran language system for mutation-based software testing. Softw. Pract. Exper. 21, 7 (July), 685-718.
15. MATHUR, A. P. 1991. Performance, effectiveness, and reliability issues in software testing. In Proceedings of the 15th Annual International Computer Software and Applications Conference (Tokyo, Japan, Sept.). 604-605.
16. MATHUR, A. P. AND WONG, W. E. 1994. An empirical comparison of data flow and mutation-based test adequacy criteria. J. Softw. Testing Verif. Reliab. 4, 1 (Mar.), 9-31.
17. MORELL, L. J. 1984. A theory of error-based testing. Ph.D. thesis, Tech. Rep. TR-1395, Univ. of Maryland, College Park, Md.
18. OFFUTT, A. J. 1991. An integrated automatic test data generation system. J. Syst. Integration 1, 3 (Nov.), 391-409.
19. OFFUTT, A. J. 1992. Investigations of the software testing coupling effect. ACM Trans. Softw. Eng. Methodol. 1, 1 (Jan.), 3-18.
20. OFFUTT, A. J. AND HAYES, J. H. 1996. A semantic model of program faults. In Proceedings of the 1996 International Symposium on Software Testing, Verification, and Analysis (San Diego, Calif, Jan.). ACM Press, New York, 195-200.
21. OFFUTT, A. J. AND LEE, S. D. 1994. An empirical evaluation of weak mutation. IEEE Trans. Softw. Eng. 20, 5 (May), 337-344.
22. OFFUTT, A. J. AND VOAS, J. M. 1996. Subsumption of condition coverage techniques by mutation testing. Tech. Rep. ISSE-TR-96-100, Dept. of Information and Software Systems Engineering, George Mason Univ., Fairfax, Va.
23. OFFUTT, A. J., ROTHERMEL, G. AND ZAPF, C. 1993. An experimental evaluation of selective mutation. In Proceedings of the 15th International Conference on Software Engineering (Baltimore, Md., May). IEEE Computer Society Press, Los Alamitos, Calif., 100-107.
24. OTT, L. 1988. An Introduction to Statistical Methods and Data Analysis, 3rd ed. PWS-Kent, Boston, Mass.
25. UNTCH, R., OFFUTT, A. J., AND HARROLD, M. J. 1993. Mutation analysis using program schemata. In Proceedings of the 1993 International Symposium on Software Testing, Analysis, and Verification (Cambridge, Mass., June). ACM, New York, 139-148.
26. WONG, W. E. 1993. On mutation and data flow. Ph.D. thesis, Tech. Rep. SERC-TR-149-P, Software Engineering Research Center, Purdue Univ., W. Lafayette, Ind.
27. WEYUKER, E. J., WEISS, S. N., AND HAMLET, R. G. 1991. Comparison of program testing strategies. In Proceedings of the 4th Symposium on Software Testing, Analysis, and Verification (Victoria, British Columbia, Canada, Oct.). ACM, New York, 1-10.