Adaptive random testing based on distribution metrics

Journal of Systems and Software

Volumn 82, Issue 9, 2009, Pages 1419-1433

  Chen, Tsong Yueh ^a   Kuo, Fei Ching ^a   Liu, Huai ^a  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Adaptive random testing; Discrepancy; Dispersion; Random testing; Software testing; Test case distribution

Indexed keywords

ADAPTIVE RANDOM TESTING; DISCREPANCY; EMPIRICAL RESULTS; FAILURE DETECTION; RANDOM TESTING; SOFTWARE TESTING TECHNIQUES; TEST CASE; TEST CASE DISTRIBUTION; TEST CASE SELECTION;

ALGORITHMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; DISPERSIONS; TESTING;

SOFTWARE TESTING;

EID: 68949130178     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2009.05.017     Document Type: Article

References (44)

1. ACM, 1980. Collected Algorithms from ACM. Association for Computing Machinery.
2. Ammann P.E., and Knight J.C. Data diversity: an approach to software fault tolerance. IEEE Transactions on Computers 37 4 (1988) 418-425
3. Beizer B. Software Testing Techniques (1990), Van Nostrand Reinhold
4. Bird D.L., and Munoz C.U. Automatic generation of random self-checking test cases. IBM Systems Journal 22 3 (1983) 229-245
5. Bishop, P.G., 1993. The variation of software survival times for different operational input profiles. In: Proceedings of the 23rd International Symposium on Fault-Tolerant Computing, pp. 98-107.
6. Branicky M.S., LaValle S.M., Olson K., and Yang L. Quasi-randomized path planning. Proceedings of the 2001 IEEE International Conference on Robotics and Automation (2001), IEEE Computer Society 1481-1487
7. Budd T.A. Mutation analysis: ideas, examples, problems and prospects. In: Chandrasekaran B., and Radicci S. (Eds). Computer Program Testing (1981), Amsterdam, North-Holland 129-148
8. Chan K.P., Chen T.Y., and Towey D. Restricted random testing: adaptive random testing by exclusion. International Journal of Software Engineering and Knowledge Engineering 16 4 (2006) 553-584
9. Chen, T.Y., Kuo, F.-C., Liu, H., 2007a. Distribution metric driven adaptive random testing. In: Proceedings of the 7th International Conference on Quality Software (QSIC 2007), pp. 274-279.
10. Chen, T.Y., Kuo, F.-C., Liu, H., 2007b. On test case distributions of adaptive random testing. In: Proceedings of the 19th International Conference on Software Engineering and Knowledge Engineering (SEKE 2007), pp. 141-144.
11. Chen T.Y., Kuo F.-C., and Zhou Z.Q. On favorable conditions for adaptive random testing. International Journal of Software Engineering and Knowledge Engineering 17 6 (2007) 805-825
12. Chen, T.Y., Leung, H., Mak, I.K., 2004. Adaptive random testing. In: Proceedings of the 9th Asian Computing Science Conference, pp. 320-329.
13. Chen T.Y., and Merkel R. Quasi-random testing. IEEE Transactions on Reliability 56 3 (2007) 562-568
14. Chen T.Y., and Merkel R. An upper bound on software testing effectiveness. ACM Transactions on Software Engineering and Methodology 17 3 (2008) 16:1-16:27
15. Ciupa, I., Leitner, A., Oriol, M., Meyer, B., 2006. Object distance and its application to adaptive random testing of object-oriented programs. In: Proceedings of the First International Workshop on Random Testing (RT2006), Portland, ME, USA, pp. 55-63.
16. Ciupa I., Leitner A., Oriol M., and Meyer B. ARTOO: adaptive random testing for object-oriented software. Proceedings of the 30th International Conference on Software Engineering (ICSE'08) (2008), ACM Press 71-80
17. Dabóczi, T., Kollár, I., Simon, G., Megyeri, T., 2003. Automatic testing of graphical user interfaces. In: Proceedings of the 20th IEEE Instrumentation and Measurement Technology Conference 2003 (IMTC'03), Vail, CO, USA, pp. 441-445.
18. Finelli G.B. NASA software failure characterization experiments. Reliability Engineering and System Safety 32 1-2 (1991) 155-169
19. Forrester, J.E., Miller, B.P., 2000. An empirical study of the robustness of Windows NT applications using random testing. In: Proceedings of the 4th USENIX Windows Systems Symposium, Seattle, pp. 59-68.
20. GCC, 2004. GNU compiler collection, .
21. Girard, E., Rault, J., 1973. A programming technique for software reliability. In: Proceedings of 1973 IEEE Symposium on Computer Software Reliability, IEEE, pp. 44-50.
22. Godefroid P., Klarlund N., and Sen K. DART: directed automated random testing. Proceedings of ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2005) (2005), ACM Press 213-223
23. Hailpern B., and Santhanam P. Software debugging, testing, and verification. IBM Systems Journal 41 1 (2002) 4-12
24. Hamlet R. Random testing. In: Marciniak J. (Ed). Encyclopedia of Software Engineering. 2nd ed. (2002), John Wiley & Sons
25. Hua L.K., and Wang Y. Applications of Number Theory to Numerical Analysis (1981), Springer, Berlin
26. Kuo, F.-C., 2006. On adaptive random testing. Ph.D. thesis, Faculty of Information and Communications Technologies, Swinburne University of Technology.
27. Mayer J. Lattice-based adaptive random testing. Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE 2005) (2005), ACM, New York, USA 333-336
28. Mayer J., and Guderlie R. On random testing of image processing applications. Proceedings of the 6th International Conference on Quality Software (QSIC 2006) (2006), IEEE Computer Society 85-92
29. Mayer J., and Schneckenburger C. An empirical analysis and comparison of random testing techniques. Proceedings of the 2006 ACM/IEEE International Symposium on Empirical Software Engineering (ISESE 2006) (2006), ACM Press 105-114
30. Merkel, R., 2005. Analysis and enhancements of adaptive random testing. Ph.D. thesis, School of Information Technology, Swinburne University of Technology.
31. Miller B.P., Fredriksen L., and So B. An empirical study of the reliability of UNIX utilities. Communications of the ACM 33 12 (1990) 32-44
32. Miller, B.P., Koski, D., Lee, C.P., Maganty, V., Murthy, R., Natarajan, A., Steidl, J., 1995. Fuzz revisited: a re-examination of the reliability of UNIX utilities and services. Tech. Rep. CS-TR-1995-1268, University of Wisconsin.
33. Myers G.J. The Art of Software Testing. second ed. (2004), John Wiley and Sons Revised and updated by T. Badgett and T.M. Thomas with C. Sandler
34. Niederreiter, H., 1986. Quasi-Monte Carlo methods for global optimization. In: Proceedings of the 4th Pannonian Symposium on Mathematical Statistics, pp. 251-267.
35. Niederreiter H. Random Number Generation and Quasi-Monte-Carlo Methods (1992), SIAM
36. NIST, 2002. The economic impacts of inadequate infrastructure for software testing, , National Institute of Standards and Technology, Gaithersburg, MA, USA.
37. Press W.H., Flannery B.P., Teukolsky S.A., and Vetterling W.T. Numerical Recipes (1986), Cambridge University Press
38. Regehr J. Random testing of interrupt-driven software. Proceedings of the 5th ACM International Conference on Embedded Software (EMSOFT'05) (2005), ACM Press 290-298
39. Slutz, D., 1998. Massive stochastic testing of SQL. In: Proceedings of the 24th International Conference on Very Large Databases (VLDB 1998), pp. 618-622.
40. Thayer R.A., Lipow M., and Nelson E.C. Software Reliability (1978), North-Holland
41. Tukey J.W. Exploratory Data Analysis (1977), Addison-Wesley
42. West C.H., and Tosi A. Experiences with a random test driver. Computer Networks and ISDN Systems 27 (1995) 1163-1174
43. White L.J., and Cohen E.I. A domain strategy for computer program testing. IEEE Transactions on Software Engineering 6 3 (1980) 247-257
44. Yoshikawa, T., Shimura, K., Ozawa, T., 2003. Random program generator for Java JIT compiler test system. In: Proceedings of the 3rd International Conference on Quality Software (QSIC 2003), pp. 20-24.