Adaptive Random Testing: The ART of test case diversity

Journal of Systems and Software

Volumn 83, Issue 1, 2010, Pages 60-66

  Chen, Tsong Yueh ^a   Kuo, Fei Ching ^a   Merkel, Robert G ^a   Tse, T H ^b  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Adaptive random sequence; Adaptive random testing; Failure pattern; Failure based testing; Random testing; Software testing

Indexed keywords

ADAPTIVE RANDOM TESTING; FAILURE PATTERN; FAILURE PATTERNS; RANDOM SEQUENCE; RANDOM TESTING;

COLUMNS (STRUCTURAL); COMPUTER SOFTWARE SELECTION AND EVALUATION; TESTING;

SOFTWARE TESTING;

EID: 71649102481     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2009.02.022     Document Type: Article

References (29)

1. Ammann P.E., and Knight J.C. Data diversity: an approach to software fault tolerance. IEEE Transactions on Computers 37 4 (1988) 418-425
2. Barus, A.C., Chen, T.Y., Kuo, F.-C., Merkel, R.G., Rothermel, G., in preparation. Adaptive random testing of programs with arbitrary input types: a methodology and an empirical study.
3. Bati, H., Giakoumakis, L., Herbert, S., Surna, A., 2007. A genetic approach for random testing of database systems. In: Proceedings of the 33rd International Conference on Very Large Data Bases (VLDB 2007). VLDB Endowment, pp. 1243-1251.
4. Bishop P.G. The variation of software survival time for different operational input profiles (or why you can wait a long time for a big bug to fail). Digest of Papers, the 23rd International Symposium on Fault-Tolerant Computing (FTCS-23) (1993), IEEE Computer Society Press, Los Alamitos, CA 98-107
5. Bratley P., Fox B.L., and Niederreiter H. Implementation and tests of low-discrepancy sequences. ACM Transactions on Modeling and Computer Simulation 2 3 (1992) 195-213
6. Chan F.T., Chen T.Y., Mak I.K., and Yu Y.T. Proportional sampling strategy: guidelines for software testing practitioners. Information and Software Technology 38 12 (1996) 775-782
7. Chan K.P., Chen T.Y., and Towey D.P. Restricted random testing: adaptive random testing by exclusion. International Journal of Software Engineering and Knowledge Engineering 16 4 (2006) 553-584
8. Chen T.Y., and Merkel R.G. Quasi-random testing. IEEE Transactions on Reliability 56 3 (2007) 562-568
9. Chen T.Y., and Merkel R.G. An upper bound on software testing effectiveness. ACM Transactions on Software Engineering and Methodology 17 3 (2008) Article No. 16
10. Chen T.Y., and Yu Y.T. On the expected number of failures detected by subdomain testing and random testing. IEEE Transactions on Software Engineering 22 2 (1996) 109-119
11. Chen, T.Y., Cheung, S.C., Yiu, S.M., 1998. Metamorphic testing: a new approach for generating next test cases. Technical Report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology, Hong Kong.
12. Chen T.Y., Tse T.H., and Yu Y.T. Proportional sampling strategy: a compendium and some insights. Journal of Systems and Software 58 1 (2001) 65-81
13. Chen T.Y., Eddy G., Merkel R.G., and Wong P.K. Adaptive random testing through dynamic partitioning. Proceedings of the 4th International Conference on Quality Software (QSIC 2004) (2004), IEEE Computer Society Press, Los Alamitos, CA 79-86
14. Chen, T.Y., Leung, H., Mak, I.K., 2004b. Adaptive random testing. In: Proceedings of the Ninth Asian Computing Science Conference (ASIAN'04), Lecture Notes in Computer Science, vol. 3321, pp. 320-329.
15. Ciupa I., Leitner A., Oriol M., and Meyer B. ARTOO: adaptive random testing for object-oriented software. Proceedings of the 30th International Conference on Software Engineering (ICSE 2008) (2008), ACM Press, New York, NY 71-80
16. Kapoor K., and Bowen J.P. Test conditions for fault classes in Boolean specifications. ACM Transactions on Software Engineering and Methodology 16 3 (2007) 1-12
17. Keynes J.M. A Treatise on Probability (2006), Cosimo, New York, NY
18. Kuo, F.-C., 2006. On adaptive random testing. PhD Thesis, Swinburne University of Technology, Melbourne, Australia.
19. Malaiya, Y.K., 1995. Antirandom testing: getting the most out of black-box testing. In: Proceedings of the 6th International Symposium on Software Reliability Engineering (ISSRE '95). IEEE Computer Society Press, Los Alamitos, CA, pp. 86-95.
20. Mayer J. Lattice-based adaptive random testing. Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE 2005) (2005), ACM Press, New York, NY 333-336
21. Merkel, R.G., 2005. Analysis and enhancements of adaptive random testing. PhD Thesis, Swinburne University of Technology, Melbourne, Australia.
22. Morasca, S., Serra-Capizzano, S., 2004. On the analytical comparison of testing techniques. In: Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2004). ACM SIGSOFT Software Engineering Notes 29 (4), 154-164.
23. Ostrand T.J., and Balcer M.J. The category-partition method for specifying and generating functional tests. Communications of the ACM 31 6 (1988) 676-686
24. Pacheco C., Lahiri S.K., Ernst M.D., and Ball T. Feedback-directed random test generation. Proceedings of the 29th International Conference on Software Engineering (ICSE 2007) (2007), IEEE Computer Society Press, Los Alamitos, CA 75-84
25. Renfer G.F. Automatic program testing. Proceedings of Third Conference of the Computing and Data Processing Society of Canada (1962), University of Toronto Press, Toronto, Canada
26. Rothermel, G., Elbaum, S., Kinneer, A., Do, H., 2009. Software-artifact Infrastructure Repository. .
27. Slutz D.R. Massive stochastic testing of SQL. Proceedings of the 24th International Conference on Very Large Data Bases (VLDB '98) (1998), Morgan Kaufmann, San Francisco, CA 618-622
28. White L.J., and Cohen E.I. A domain strategy for computer program testing. IEEE Transactions on Software Engineering SE-6 3 (1980) 247-257
29. Yoshikawa T., Shimura K., and Ozawa T. Random program generator for Java JIT compiler test system. Proceedings of the Third International Conference on Quality Software (QSIC 2003) (2003), IEEE Computer Society Press, Los Alamitos, CA 20-24