Is adaptive random testing really better than random testing

Proceedings of the 1st International Workshop on Random Testing, RT'06

Volumn 2006, Issue , 2006, Pages 64-69

  Chen, T Y ^a   Kuo, F C ^b  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b UNIVERSITY OF WOLLONGONG   (Australia)

Author keywords

Adaptive random testing; Fix sized candidate set ART; Random testing; Software testing

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SYSTEM RECOVERY;

ADAPTIVE RANDOM TESTING (ART); RANDOM TESTING (RT);

SOFTWARE TESTING;

EID: 34247344546     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1145735.1145745     Document Type: Conference Paper

References (23)

1. P. E. Ammann and J. C. Knight. Data diversity: an approach to software fault tolerance. IEEE Transactions on Computers, 37(4):418-425, 1988.
2. P. G. Bishop. The variation of software survival times for different operational input profiles. In Proceedings of the 23rd International Symposium on Fault-Tolerant Computing (FTCS-23), pages 98-107. IEEE Computer Society Press, 1993.
3. K. P. Chan, T. Y. Chen, and D. Towey. Restricted random testing: Adaptive random testing by exclusion. Accepted to appear in International Journal of Software Engineering and Knowledge Engineering, 2006.
4. T. Y. Chen, G. Eddy, R. G. Merkel, and P. K. Wong. Adaptive random testing through dynamic partitioning. In Proceedings of the 4th International Conference on Quality Software (QSIC 04), pages 79-86, Braunschweig, Germany, 2004. IEEE Computer Society Press.
5. T. Y. Chen and D. H. Huang. Adaptive random testing by localization. In Proceedings of the 11th Asia-Pacific Software Engineering Conference (APSEC'04), pages 292-298. IEEE Computer Society, 2004.
6. T. Y. Chen, F. C. Kuo, R. G. Merkel, and S. P. Ng. Mirror adaptive random testing. Information and Software Technology, 46(15):1001-1010, 2004.
7. T. Y. Chen, F. C. Kuo, and Z. Q. Zhou. On the relationships between the distribution of failure-causing inputs and effectiveness of adaptive random testing. In Proceedings of the 17th International Conference on Software Engineering and Knowledge Engineering (SEKE 2005)), pages 306-311, Taipei, Taiwan, 2005.
8. T. Y. Chen, H. Leung, and I. K. Mak. Adaptive random testing. In Proceedings of the 9th Asian Computing Science Conference, volume 3321 of Lecture Notes in Computer Science, pages 320-329, 2004.
9. T. Y. Chen and R. Merkel. An upper bound on software testing effectiveness, submitted for publication.
10. R. Cobb and H. D. Mills. Engineering software under statistical quality control. IEEE Software, 7(6):45-54, 1990.
11. T. Dabóczi, I. Kollár, G. Simon, and T. Megyeri. Automatic testing of graphical user interfaces. In Proceedings of the 30th IEEE Instrumentation and Measurement Technology Conference 2003 (IMTC '03), pages 441-445, Vail, CO, USA, 2003.
12. G. B. Finelli. Nasa software failure characterization experiments. Reliability Engineering and System Safety, 32(1-2):155-169, 1991.
13. J. E. Forrester and B. P. Miller. An empirical study of the robustness of Windows NT applications using random testing. In Proceedings of the 4th USENIX Windows Systems Symposium, pages 59-68, Seattle, 2000.
14. R. Hamlet. Random testing. In J. Marciniak, editor, Encyclopedia of Software Engineering. John Wiley & Sons, second edition, 2002.
15. I. K. Mak. On the effectiveness of random testing. Master's thesis, Department of Computer Science, University of Melbourne, 1997.
16. B. P. Miller, L. Fredriksen, and B. So. An empirical study of the reliability of UNIX utilities. Communications of the ACM, 33(12):32-44, 1990.
17. B. P. Miller, D. Koski, C. P. Lee, V. Maganty, R. Murthy, A. Natarajan, and J. Steidl. Fuzz revisited: A re-examination of the reliability of UNIX utilities and services. Technical Report CS-TR-1995-1268, University of Wisconsin, 1995.
18. E. Miller. Website testing. http://www.soft.com/eValid/Technology/White. Papers/website.testing.html, Software Research, Inc., 2005.
19. G. J. Myers. The Art of Software Testing. Wiley, New York, second edition, 1979.
20. N. Nyman. In defense of monkey testing: Random testing can find bugs, even in well engineered software, http://www.softtest.org/sigs/material/nnyman2. htm, Microsoft Corporation.
21. K. Sen, D. Marinov, and G. Agha. Cute: a concolic unit testing engine for c. In ESEC/FSE-13: Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering, pages 263-272, New York, NY, USA, 2005. ACM Press.
22. D. Slutz. Massive stochastic testing of SQL. In Proceedings of the 24th International Conference on Very Large Databases (VLDB 98), pages 618-622, 1998.
23. T. Yoshikawa, K. Shimura, and T. Ozawa. Random program generator for Java JIT compiler test system. In Proceedings of the 3rd International Conference on Quality Software (QSIC 2003), pages 20-24. IEEE Computer Society Press, 2003.