On the fault-detection capabilities of adaptive random test case prioritization: Case studies with large test suites

Proceedings of the Annual Hawaii International Conference on System Sciences

Volumn , Issue , 2012, Pages 5584-5593

  Zhou, Zhi Quan ^a   Sinaga, Arnaldo ^a,b   Susilo, Willy ^a  

^a UNIVERSITY OF WOLLONGONG   (Australia)

^b Del Polytechnic of Informatics   (Indonesia)

Author keywords

[No Author keywords available]

Indexed keywords

SOFTWARE TESTING; TESTING;

DETECTION CAPABILITY; FREQUENCY INFORMATION; JACCARD DISTANCE; MANHATTAN DISTANCE; RANDOM TESTING; REGRESSION TESTS; TEST CASE PRIORITIZATION; TESTING STRATEGIES;

FAULT DETECTION;

EID: 84863263726     PISSN: 15301605     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HICSS.2012.454     Document Type: Conference Paper

References (29)

1. B. Hailpern and P. Santhanam, "Software debugging, testing, and verification," IBM Systems Journal, vol. 41, no. 1, pp. 4-12, 2002.
2. Z. Q. Zhou, B. Scholz, and G. Denaro, "Automated software testing and analysis: Techniques, practices and tools," in Proceedings of the 40th Annual Hawaii International Conference on System Sciences (HICSS'07). IEEE Computer Society Press, 2007.
3. J. Burnim and K. Sen, "Heuristics for scalable dynamic test generation," in Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering. IEEE Computer Society Press, 2008, pp. 443-446.
4. R. Hamlet, "Random testing," in Encyclopedia of Software Engineering, J. Marciniak, Ed. John Wiley & Sons, 2002, pp. 970-978.
5. T. Y. Chen, F.-C. Kuo, and Z. Q. Zhou, "On favourable conditions for adaptive random testing," International Journal of Software Engineering and Knowledge Engineering, vol. 17, no. 6, pp. 805-825, 2007.
6. G. F. Renfer, "Automatic program testing," in Proceedings of the 3rd Conference of the Computing and Data Processing Society of Canada. University of Toronto Press, 1962.
7. D. L. Bird and C. U. Munoz, "Automatic generation of random self-checking test cases," IBM Systems Journal, vol. 22, no. 3, pp. 229-245, 1983.
8. B. P. Miller, L. Fredriksen, and B. So, "An empirical study of the reliability of Unix utilities," Communications of the ACM, vol. 33, no. 12, pp. 32-44, 1990.
9. D. Slutz, "Massive stochastic testing of SQL," in Proceedings of the 24th International Conference on Very Large Data Bases (VLDB'98), 1998, pp. 618-622.
10. J. E. Forrester and B. P. Miller, "An empirical study of the robustness of Windows NT applications using random testing," in Proceedings of the 4th USENIX Windows Systems Symposium, 2000, pp. 59-68.
11. T. Dabóczi, I. Kollár, G. Simon, and T. Megyeri, "Automatic testing of graphical user interfaces," in Proceedings of the 20th IEEE Instrumentation and Measurement Technology Conference (IMTC'03), 2003, pp. 441-445.
12. T. Yoshikawa, K. Shimura, and T. Ozawa, "Random program generator for Java JIT compiler test system," in Proceedings of the 3rd International Conference on Quality Software (QSIC'03). IEEE Computer Society Press, 2003, pp. 20- 24.
13. G. J. Myers, The Art of Software Testing. New York: Wiley, 1979.
14. T. Y. Chen, F.-C. Kuo, R. G. Merkel, and T. H. Tse, "Adaptive random testing: The ART of test case diversity," Journal of Systems and Software, vol. 83, no. 1, pp. 60-66, 2010.
15. T. Y. Chen, T. H. Tse, and Z. Q. Zhou, "Fault-based testing without the need of oracles," Information and Software Technology, vol. 45, no. 1, pp. 1-9, 2003.
16. -, "Semi-proving: An integrated method for program proving, testing, and debugging," IEEE Transactions on Software Engineering, vol. 37, no. 1, pp. 109-125, 2011.
17. T. Y. Chen, D. H. Huang, T. H. Tse, and Z. Yang, "An innovative approach to tackling the boundary effect in adaptive random testing," in Proceedings of the 40th Annual Hawaii International Conference on System Sciences (HICSS'07). IEEE Computer Society Press, 2007.
18. I. K. Mak, "On the effectiveness of random testing," Master's thesis, The University of Melbourne, Melbourne, Australia, 1997.
19. I. Ciupa, A. Leitner, M. Oriol, and B. Meyer, "ARTOO: Adaptive random testing for object-oriented software," in Proceedings of the 30th International Conference on Software Engineering (ICSE'08), 2008.
20. H. Jaygarl, C. K. Chang, and S. Kim, "Practical extensions of a randomized testing tool," in Proceedings of the 33rd Annual International Computer Software and Applications Conference (COMPSAC'09). IEEE Computer Society Press, 2009, pp. 148-153.
21. B. Jiang, Z. Zhang, W. K. Chan, and T. H. Tse, "Adaptive random test case prioritization," in Proceedings of the 24th IEEE/ACM International Conference on Automated Software Engineering (ASE'09). IEEE Computer Society Press, November 2009, pp. 233-244.
22. Z. Q. Zhou, "Using coverage information to guide test case selection in adaptive random testing," in Proceedings of the 34th Annual International Computer Software and Applications Conference (COMPSAC'10), 7th International Workshop on Software Cybernetics. IEEE Computer Society Press, 2010, pp. 208-213.
23. T. Y. Chen, H. Leung, and I. K. Mak, "Adaptive random testing," in Proceedings of the 9th Asian Computing Science Conference (ASIAN'04), Lecture Notes in Computer Science 3321. Springer-Verlag, 2004, pp. 320-329.
24. G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold, "Prioritizing test cases for regression testing," IEEE Transactions on Software Engineering, vol. 27, no. 10, pp. 929-948, 2001.
25. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments on the effectiveness of dataflow- and controlflowbased test adequacy criteria," in Proceedings of the 16th International Conference on Software Engineering (ICSE'94). IEEE Computer Society Press, 1994, pp. 191-200.
26. C. Liu, X. Yan, and J. Han, "Mining control flow abnormality for logic error isolation," in Proceedings of the 6th SIAM International Conference on Data Mining (SDM'06), 2006.
27. H. Do, S. G. Elbaum, and G. Rothermel, "Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact," Empirical Software Engineering: An International Journal, vol. 10, no. 4, pp. 405-435, 2005.
28. Microsoft Corporation, "Jacek Czerwonka tester spotlight," http://msdn.microsoft.com/en-us/testing/cc136640.aspx (accessed in June 2011).
29. SQLite homepage, http://www.sqlite.org (accessed in June 2011).