An upper bound on software testing effectiveness

ACM Transactions on Software Engineering and Methodology

Volumn 17, Issue 3, 2008, Pages

  Chen, Tsong Yueh ^a   Merkel, Robert ^a  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Adaptive random testing; Failure patterns; Failure causing inputs; Random testing; Software testing; Testing effectiveness metrics

Indexed keywords

COMPUTER SOFTWARE SELECTION AND EVALUATION;

(1 1 1) ORIENTATION; DEBUG TESTING; F MEASURE; FAILURE PATTERNS; TESTING STRATEGIES; UPPER BOUNDS;

SOFTWARE TESTING;

EID: 46449086982     PISSN: 1049331X     EISSN: 15577392     Source Type: Journal    
DOI: 10.1145/1363102.1363107     Document Type: Article

References (18)

1. AMMANN, P. E. AND KNIGHT, J. C. 1988. Data diversity: An approach to software fault tolerance. IEEE Trans. Comput. 37, 4, 418-425.
2. BISHOP, P. G. 1993. The variation of software survival times for different operational input profiles. In FTSC-23. Digest of Papers, the Twenty-Third International Symposium on Fault-Tolerant Computing. IEEE Computer Society Press, 98-107.
3. CHAN, F. T., CHEN, T. Y., MAK, I. K., AND YU, Y. T. 1996. Proportional sampling strategy: Guidelines for software testing practitioners. Inform. Softw. Tech. 38, 12, 775-782.
4. CHEN, T. Y., KUO, F.-C., AND MERKEL, R. 2006. On the statistical properties of testing effectiveness measures. J Syst. Softw. 79, 591-601.
5. CHEN, T. Y., KUO, F.-C., MERKEL, R., AND NG, S. 2004a. Mirror adaptive random testing. Inform. Softw. Tech. 46, 15, 1001-1010.
6. CHEN, T. Y., LEUNG, H., AND MAK, I. K. 2004b. Adaptive random testing. In Proceedings of the 9th Asian Computing Science Conference. Lecture Notes in Computer Science, vol. 3321. 320-329.
7. CHEN, T. Y. AND YU, Y. T. 1996. On the expected number of failures detected by sub domain testing and random testing. IEEE Trans. Softw. Eng. 22, 2, 109-119.
8. CIUPA, I., LEITNER, A., ORIOL, M., AND MEYER, B. 2006. Object distance and its application to adaptive random testing of object-oriented programs. In Proceedings of the 1st International Workshop on Random Testing. ACM Press, Portland, Maine, 55-63.
9. DICKINSON, W., LEON, D., AND PODGURSKI, A. 2001. Pursuing failure: the distribution of program failures in a profile space. In ESEC/FSE-9: Proceedings of the 8th European Software Engineering Conference Held Jointly with 9th ACM SIGSOFT International Symposium on Foundations of Software Engineering. ACM Press, 246-255.
10. DURAN, J. W. AND NTAFOS, S. C. 1984. Evaluation of random testing. IEEE Trans. Softw. Eng. 10, 4, 438-444.
11. FRANKL, P. G., HAMLET, R. G., LITTLEWOOD, B., AND STRIGINI, L. 1998. Evaluating testing methods by delivered reliability. IEEE Trans. Softw. Eng. 21, 8, 586-601.
12. FRANKL, P. G. AND WEYUKER, E. J. 1993. A formal analysis of the fault-detecting ability of testing methods. IEEE Trans. Softw. Eng. 19, 3, 202-213.
13. HAMLET, R. AND TAYLOR, R. 1990. Partition testing does not inspire confidence. IEEE Trans. Softw. Eng. 16, 12, 1402-1411.
14. KUO, F.-C. 2006. On adaptive random testing. Ph.D. thesis, Swinburne University of Technology, Hawthorn, Australia.
15. MERKEL, R. 2005. Analysis and enhancements of adaptive random testing. Ph.D. thesis, Swinburne University of Technology, Hawthorn, Australia.
16. MORASCA, S. AND SERRA-CAPIZZANO, S. 2004. On the analytical comparison of testing techniques. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA2004). ACM, 154-164.
17. WEISSTEIN, E. W. 2004. Tessellation. From Mathworld-a Wolfram Web Resource, http://mathworld.wolfram.com/Tessellation.html.
18. WHITE, L. AND COHEN, E. 1980. A domain strategy for computer program testing. IEEE Trans. Softw. Eng. 6, 247-257.