Distributing test cases more evenly in adaptive random testing

Journal of Systems and Software

Volumn 81, Issue 12, 2008, Pages 2146-2162

  Chen, Tsong Yueh ^a   Kuo, Fei Ching ^a   Liu, Huai ^a  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Adaptive random testing; Random testing; Software quality; Software testing; Test case distribution

Indexed keywords

ALGORITHMS; RANDOM PROCESSES;

ADAPTIVE RANDOM TESTING; RANDOM TESTING; SOFTWARE QUALITY; SOFTWARE TESTING; TEST CASE DISTRIBUTION;

TESTING;

EID: 53949087158     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2008.03.062     Document Type: Article

References (35)

1. ACM. Collected Algorithms from ACM (1980), Association for Computing Machinery
2. Ammann P.E., and Knight J.C. Data diversity: an approach to software fault tolerance. IEEE Transactions on Computers 37 4 (1988) 418-425
3. Bishop P.G. The variation of software survival times for different operational input profiles. Proceedings of the 23rd International Symposium on Fault-Tolerant Computing (FTCS-23) (1993), IEEE Computer Society Press 98-107
4. Branicky M.S., LaValle S.M., Olson K., and Yang L. Quasi-randomized path planning. Proceedings of the 2001 IEEE International Conference on Robotics and Automation (2001), IEEE Computer Society 1481-1487
5. Budd T.A. Mutation analysis: ideas, examples, problems and prospects. In: Chandrasekaran B., and Radicci S. (Eds). Computer Program Testing (1981), North-Holland, Amsterdam 129-148
6. Chan K.P., Chen T.Y., and Towey D. Restricted random testing: adaptive random testing by exclusion. International Journal of Software Engineering and Knowledge Engineering 16 4 (2006) 553-584
7. Chen T.Y., Eddy G., Merkel R., and Wong P.K. Adaptive random testing through dynamic partitioning. Proceedings of the 4th International Conference on Quality Software (QSIC 04) (2004), IEEE Computer Society Press, Braunschweig, Germany 79-86
8. Chen T.Y., and Huang D.H. Adaptive random testing by localization. Proceedings of the 11th Asia-Pacific Software Engineering Conference (APSEC'04) (2004), IEEE Computer Society 292-298
9. Chen T.Y., Huang D.H., and Zhou Z.Q. Adaptive random testing through iterative partitioning. Proceedings of the 11th Ada-Europe International Conference on Reliable Software Technologies (Ada-Europe 2006). Lecture Notes in Computer Science vol. 4006 (2006), Springer-Verlag 155-166
10. Chen T.Y., Kuo F.-C., and Liu H. Enhancing adaptive random testing in high dimensional input domains. Proceedings of the 22nd Annual ACM Symposium on Applied Computing (SAC 2007) (2007), ACM Press 1467-1472
11. Chen T.Y., Kuo F.-C., and Liu H. Enhancing adaptive random testing through partitioning by edge and centre. Proceedings of the 18th Australian Software Engineering Conference (ASWEC 2007) (2007), IEEE Computer Society Press 265-273
12. Chen, T.Y., Kuo, F.-C., Liu, H., 2007c. On test case distributions of adaptive random testing. In: Proceedings of the 19th International Conference on Software Engineering and Knowledge Engineering (SEKE 2007), pp. 141-144.
13. Chen T.Y., Kuo F.-C., Merkel R., and Ng S.P. Mirror adaptive random testing. Information and Software Technology 46 15 (2004) 1001-1010
14. Chen T.Y., Kuo F.-C., and Zhou Z.Q. On favorable conditions for adaptive random testing. International Journal of Software Engineering and Knowledge Engineering 17 6 (2007) 805-825
15. Chen, T.Y., Leung, H., Mak, I.K., 2004c. Adaptive random testing. In: Proceedings of the 9th Asian Computing Science Conference. Lecture Notes in Computer Science, vol. 3321. pp. 320-329.
16. Chen, T.Y., Merkel, R., in press. An upper bound on software testing effectiveness. ACM Transactions on Software Engineering and Methodology.
17. Ciupa, I., Leitner, A., Oriol, M., Meyer, B., 2006. Object distance and its application to adaptive random testing of object-oriented programs. In: Proceedings of the First International Workshop on random testing (RT06), Portland, ME, USA, pp. 55-63.
18. Ciupa, I., Leitner, A., Oriol, M., Meyer, B., 2008. ARTOO: adaptive random testing for object-oriented software. In: Proceedings of the 30th International Conference on Software Engineering (ICSE2008), pp. 71-80.
19. Finelli G.B. NASA software failure characterization experiments. Reliability Engineering and System Safety 32 1-2 (1991) 155-169
20. Forrester, J.E., Miller, B.P., 2000. An empirical study of the robustness of Windows NT applications using random testing. In: Proceedings of the 4th USENIX Windows Systems Symposium, Seattle, pp. 59-68.
21. GCC, 2004. GNU compiler collection. .
22. Hamlet R. Random testing. In: Marciniak J. (Ed). Encyclopedia of Software Engineering. second ed. (2002), John Wiley & Sons
23. Kuo, F.-C., 2006. On adaptive random testing. Ph.D. thesis, Faculty of Information and Communications Technologies, Swinburne University of Technology.
24. Laski J.W., and Korel B. A data flow oriented program testing strategy. IEEE Transactions on Software Engineering 9 3 (1983) 347-354
25. Mayer J. Lattice-based adaptive random testing. Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE 2005) (2005), ACM, New York, USA 333-336
26. Mayer J., and Schneckenburger C. An empirical analysis and comparison of random testing techniques. Proceedings of the 2006 ACM/IEEE International Symposium on Empirical Software Engineering (ISESE 2006) (2006), ACM Press 105-114
27. Merkel, R., 2005. Analysis and enhancements of adaptive random testing. Ph.D. thesis, School of Information Technology, Swinburne University of Technology.
28. Miller B.P., Fredriksen L., and So B. An empirical study of the reliability of UNIX utilities. Communications of the ACM 33 12 (1990) 32-44
29. Miller, B.P., Koski, D., Lee, C.P., Maganty, V., Murthy, R., Natarajan, A., Steidl, J., 1995. Fuzz revisited: a re-examination of the reliability of UNIX utilities and services. Technical Report CS-TR-1995-1268, University of Wisconsin.
30. Myers G.J. The Art of Software Testing. second ed. (2004), Wiley, New York
31. Press W.H., Flannery B.P., Teukolsky S.A., and Vetterling W.T. Numerical Recipes (1986), Cambridge University Press
32. Regehr, J., 2005. Random testing of interrupt-driven software. In: Proceedings of the 5th ACM International Conference on Embedded Software (EMSOFT'05), New York, NY, USA, pp. 290-298.
33. Slutz, D., 1998. Massive stochastic testing of SQL. In: Proceedings of the 24th International Conference on Very Large Databases (VLDB 98), pp. 618-622.
34. White L.J., and Cohen E.I. A domain strategy for computer program testing. IEEE Transactions on Software Engineering 6 3 (1980) 247-257
35. Yoshikawa T., Shimura K., and Ozawa T. Random program generator for Java JIT compiler test system. Proceedings of the 3rd International Conference on Quality Software (QSIC 2003) (2003), IEEE Computer Society Press 20-24