Adaptive random testing through test profiles

Software - Practice and Experience

Volumn 41, Issue 10, 2011, Pages 1131-1154

  Liu, Huai ^a   Xie, Xiaodong ^b   Yang, Jing ^b   Lu, Yansheng ^b   Chen, Tsong Yueh ^a  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

adaptive random testing; random testing; software quality; software testing; test profile

Indexed keywords

ADAPTIVE RANDOM TESTING; COMPUTATIONAL OVERHEADS; GENERIC APPROACH; RANDOM TESTING; RANDOM TESTS; SOFTWARE FAILURE; SOFTWARE QUALITY; TEST CASE; TEST PROFILE;

ALGORITHMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; SOFTWARE RELIABILITY; TESTING;

SOFTWARE TESTING;

EID: 80052040990     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.1067     Document Type: Conference Paper

References (40)

1. Liu H, Xie X, Yang J, Lu Y, Chen TY,. Adaptive random testing by exclusion through test profile. Proceedings of the 10th International Conference on Quality Software (QSIC 2010), Zhangjiajie, China, 2010; 92-101.
2. Myers GJ,. The Art of Software Testing (2nd edn). Wiley: New York, 2004. Revised and updated by T. Badgett and T. M. Thomas with C. Sandler.
3. Godefroid P, Klarlund N, Sen K,. DART: Directed automated random testing. Proceedings of ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2005), Chicago, IL, U.S.A., 2005; 213-223.
4. Regehr J,. Random testing of interrupt-driven software. Proceedings of the Fifth ACM International Conference on Embedded Software (EMSOFT 2005), Jersey City, NJ, U.S.A., 2005; 290-298. (Pubitemid 41833031)
5. Sen K, Marinov D, Agha G,. CUTE: A concolic unit testing engine for C. Proceedings of the 10th European Software Engineering Conference held jointly with 13th ACM SIGSOFT International Symposium on Foundations of Software Engineering (ESEC/FSE 2005), Lisbon, Portugal, 2005; 263-272. (Pubitemid 43218836)
6. Menzies T, Cukic B,. When to test less. IEEE Software 2000; 17 (5): 107-112.
7. Duran JW, Ntafos SC,. An evaluation of random testing. IEEE Transactions on Software Engineering 1984; 10 (4): 438-444.
8. Taylor R, Hamlet R,. Partition testing does not inspire confidnece. IEEE Transactions on Software Engineering 1990; 16 (12): 1402-1411.
9. Gutjahr WJ,. Partition testing vs. random testing: The influence of uncertainty. IEEE Transactions on Software Engineering 1999; 25 (5): 661-674. (Pubitemid 30541839)
10. Morasca S, Serra-Capizzano S,. On the analytical comparison of testing techniques. Proceedings of the 2004 International Symposium on Software Testing and Analysis (ISSTA 2004), Boston, MA, U.S.A., 2004; 154-164. (Pubitemid 41121387)
11. White LJ, Cohen EI,. A domain strategy for computer program testing. IEEE Transactions on Software Engineering 1980; 6 (3): 247-257.
12. Ammann PE, Knight JC,. Data diversity: An approach to software fault tolerance. IEEE Transactions on Computers 1988; 37 (4): 418-425.
13. Finelli GB,. NASA software failure characterization experiments. Reliability Engineering and System Safety 1991; 32 (1-2): 155-169.
14. Bishop PG,. The variation of software survival times for different operational input profiles. Proceedings of the 23rd International Symposium on Fault-tolerant Computing, Toulouse, France, 1993; 98-107.
15. van der Meulen M, Bishop P, Revilla M,. An exploration of software faults and failure behaviour in a large population of programs. Proceedings of the 15th International Symposium on Software Reliability Engineering (ISSRE 2004), Saint Malo, Bretagne, France, 2004; 101-112.
16. Chen TY, Tse TH, Yu YT,. Proportional sampling strategy: A compendium and some insights. The Journal of Systems and Software 2001; 58 (1): 65-81. (Pubitemid 32746268)
17. Chen TY, Eddy G, Merkel RG, Wong PK,. Adaptive random testing through dynamic partitioning. Proceedings of the Fourth International Conference on Quality Software (QSIC 2004), Braunschweig, Germany, 2004; 79-86. (Pubitemid 40276400)
18. Chan KP, Chen TY, Towey D,. Restricted random testing: Adaptive random testing by exclusion. International Journal of Software Engineering and Knowledge Engineering 2006; 16 (4): 553-584. (Pubitemid 44313707)
19. Tappenden AF, Miller J,. A novel evolutionary approach for adaptive random testing. IEEE Transactions on Reliability 2009; 58 (4): 619-633.
20. Jaygarl H, Chang CK, Kim S,. Practical extensions of a randomized testing tool. Proceedings of the 33rd Annual International Computer Software and Applications Conference (COMPSAC 2009), Seattle, WA, U.S.A., vol. I, 2009; 148-153.
21. Jiang B, Zhang Z, Chan W, Tse T,. Adaptive random test case prioritization. Proceedings of the 24th IEEE/ACM International Conference on Automated Software Engineering (ASE 2009), Auckland, New Zealand, 2009; 233-244.
22. Lin Y, Tang X, Chen Y, Zhao J,. A divergence-oriented approach to adaptive random testing of Java programs. Proceedings of the 24th IEEE/ACM International Conference on Automated Software Engineering (ASE 2009), Auckland, New Zealand, 2009; 221-232.
23. Chan KP, Chen TY, Kuo FC, Towey D,. A revisit of adaptive random testing by restriction. Proceedings of the 28th Annual International Computer Software and Applications Conference (COMPSAC 2004), Hong Kong, 2004; 78-85. (Pubitemid 40673833)
24. Chan KP, Chen TY, Towey D,. Forgetting test cases. Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC 2006), Chicago, IL, U.S.A., 2006; 485-492. (Pubitemid 46661682)
25. Chen TY, Huang DH,. Adaptive random testing by localization. Proceedings of the 11th Asia-Pacific Software Engineering Conference (APSEC'04), Busan, Korea, 2004; 292-298. (Pubitemid 40700519)
26. Mayer J,. Adaptive random testing by bisection and localization. Proceedings of the Fifth International Workshop on Formal Approaches to Testing of Software (FATES 2005) (Lecture Notes in Computer Science, vol. 3997), Edinburgh, U.K. Springer: Berlin, 2006; 72-86. (Pubitemid 44165378)
27. Merkel R,. Analysis and enhancement of adaptive random testing. PhD Thesis, School of Information Technology, Swinburne University of Technology, 2004; 81-93.
28. Kuo FC,. On adaptive random testing. PhD Thesis, Faculty of Information and Communications Technologies, Swinburne University of Technology, 2006; 56-74.
29. Ciupa I, Leitner A, Oriol M, Meyer B,. ARTOO: Adaptive random testing for object-oriented software. Proceedings of the 30th International Conference on Software Engineering (ICSE 2008), Leipzig, Germany, 2008; 71-80.
30. Chen TY, Merkel R,. An upper bound on software testing effectiveness. ACM Transactions on Software Engineering and Methodology 2008; 17 (3): 16:1-16:27.
31. Tijms H,. Understanding Probability: Chance Rules in Everyday Life. Cambridge University Press: Cambridge, 2004.
32. Chen TY, Kuo FC, Zhou ZQ,. On favorable conditions for adaptive random testing. International Journal of Software Engineering and Knowledge Engineering 2007; 17 (6): 805-825. (Pubitemid 351206402)
33. Chen TY, Kuo FC, Liu H,. On test case distributions of adaptive random testing. Proceedings of the 19th International Conference on Software Engineering and Knowledge Engineering (SEKE 2007), Boston, MA, U.S.A., 2007; 141-144.
34. Lawder J,. Calculation of mappings between one and n-dimensional values using the Hilbert space-filling curves. Technical Report JL1/00, School of Computer Science and Information Systems, Birkbeck College, University of London, 2000; 1-13.
35. Press WH, Flannery BP, Teukolsky SA, Vetterling WT,. Numerical Recipes. Cambridge University Press: Cambridge, 1986.
36. ACM. Collected Algorithms from ACM. Association for Computing Machinery: New York, 1980.
37. DeMillo RA, Lipton RJ, Sayward FG,. Hints on test data selection: Help for the practicing programmer. IEEE Computer 1978; 11 (4): 31-41.
38. Chen TY, Kuo FC, Liu H,. Application of a failure driven test profile in random testing. IEEE Transactions on Reliability 2009; 58 (1): 179-192.
39. Cai KY, Hu H, Jiang CH, Ye F,. Random testing with dynamically updated test profile. Proceedings of the 20th International Symposium on Software Reliability Engineering (ISSRE 2009), Mysuru, India, 2009; Fast abstract 198:1-2.
40. Mayer J,. Lattice-based adaptive random testilng. Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE 2005), Long Beach, CA, U.S.A., 2005; 333-336.