Diversity oriented test data generation using metaheuristic search techniques

Information Sciences

Volumn 259, Issue , 2014, Pages 490-509

  Bueno, Paulo M S ^a   Jino, Mario ^b   Wong, W Eric ^c  

^a Renato Archer Information Technology Center   (Brazil)

^b UNIVERSITY OF CAMPINAS   (Brazil)

^c The University of Texas at Dallas   (United States)

Author keywords

Genetic algorithms; Random testing; Simulated annealing; Simulated repulsion; Software testing; Test data generation

Indexed keywords

AUTOMATIC TEST DATA GENERATION; META HEURISTICS; META-HEURISTIC SEARCH TECHNIQUES; RANDOM TESTING; SIMULATED REPULSION; TEST DATA GENERATION; TESTING EFFECTIVENESS; TESTING TECHNIQUE;

DATA COMMUNICATION SYSTEMS; GENETIC ALGORITHMS; MONTE CARLO METHODS; SIMULATED ANNEALING;

SOFTWARE TESTING;

EID: 84889670641     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2011.01.025     Document Type: Article

References (78)

1. Andrea Arcuri, and Xin Yao Search based software testing of object-oriented containers Information Sciences 178 15 2008 3075 3095 1
2. M. Alshraideh, L. Bottaci, and B.A. Mahafzah Using program data-state scarcity to guide automatic test data generation Software Quality Control 18 1 2010 109 144
3. P.E. Ammann, and J.C. Knight Data diversity: an approach to software fault tolerance IEEE Transactions on Computers 37 4 1988 418 425
4. J. Andrews, L. Briand, Y. Labiche, Is mutation an appropriate tool for testing experiments? in: Proceedings of the 27th International Conference on Software Engineering, St. Louis, Missouri, May 2005, pp. 402-411.
5. K. Ayari, S. Bouktif, G. Antoniol, Automatic mutation test input data generation via ant colony, in: Proceedings of the Ninth Annual Conference on Genetic and Evolutionary Computation, London, UK, July 2007, pp. 1074-1081.
6. R. Bache The effect of fault size on testing Software Testing, Verification and Reliability 7 3 1997 139 152
7. B. Beizer Black-box Testing, Techniques for Functional Testing of Software Systems 1995 Wiley
8. P.G. Bishop, The variation of software survival time for different operational input profiles (or why you can wait a long time for a big bug to fail), in: Proceedings of the IEEE International Symposium on Fault-Tolerant Computing, Toulouse, France, June, 1993, pp. 98-107.
9. P.M.S. Bueno, and M. Jino Automatic test data generation for program paths using genetic algorithms International Journal of Software Engineering and Knowledge Engineering 12 6 2002 691 709
10. P.M.S. Bueno, W.E. Wong, M. Jino, Improving random test sets using the diversity oriented test data generation, in: Proceedings of the Second International Workshop on Random Testing, Atlanta, Georgia, November 2007, pp. 10-17.
11. P.M.S. Bueno, W.E. Wong, M. Jino, Automatic test data generation using particle systems, in: Proceedings of the ACM Symposium of Applied Computing, Fortaleza, Brazil, March 2008, pp. 809-814.
12. M.L. Chaim, POKE-TOOL - Uma ferramenta para suporte ao teste estrutural de programas baseadoem análise de fluxo de dados, Master Thesis, Campinas, SP, Brazil, April, 1991 (tool available at: (in Portuguese).
13. K.P. Chan, T.Y. Chen, D. Towey, Restricted random testing, in: Proceedings of the Seventh European Conference on Software Quality, Helsinki, Finland, 2002, pp. 321-330.
14. T.Y. Chen, G. Eddy, R. Merkel, P.K. Wong, Adaptive random testing through dynamic partitioning, in: Proceedings of the Fourth International Conference on Quality Software, Braunschweig, Germany, September 2004, pp. 79-86.
15. T.Y. Chen, and R. Merkel Quasi-random testing IEEE Transactions on Software Engineering SE-56 3 2007 562 568
16. T.Y. Chen, H. Leung, I.K. Mak, Adaptive random testing, in: Proceedings of the Ninth Asian Computing Science Conference, Chiang Mai, Thailand, December 2004, pp. 320-329.
17. T.Y. Chen, F.C. Kuo, R.G. Merkel, and S.P. Ng Mirror adaptive random testing Information and Software Technology 46 15 2004 1001 1010
18. J. Clarke, J.J. Dolado, M. Harman, R. Hierons, B. Jones, M. Lumkin, B. Mitchell, S. Mancoridis, K. Rees, M. Roper, and M. Shepperd Reformulating software engineering as a search problem Software 150 3 2003 161 175
19. L. Clarke A system to generate test data and symbolically execute programs IEEE Transactions on Software Engineering SE-2 3 1976 215 222
20. S.R. Dalal, A. Jain, N. Karunanithi, J.M. Leaton, C.M. Lott, G.C. Patton, B.M. Horowitz, Model-based testing in practice, in: Proceedings of the 21st International Conference on Software Engineering, Los Angeles, California, May 1999, pp. 285-294.
21. L. DeCastro, and J. Timmis Artificial Immune Systems: A New Computational Intelligence Approach 2002 Springer-Verlag
22. L. DeCastro, F.J. Von Zuben, An immunological approach to initialize feedforward neural network weights, in: Proceedings of International Conference on Artificial Neural Networks and Genetic Algorithms, Prague, Czech Republic, 2001, pp. 126-129.
23. M.E. Delamaro, J.C. Maldonado, A tool for the assessment of test adequacy for C programs, in: Proceedings of the Conference on Performability in Computing System, New Jersey, July, 1996, pp. 79-95.
24. R.A. De Millo, R.J. Lipton, and F.G. Sayward Hints on test data selection: help for the practicing programmer Computer 11 4 1978 34 41
25. J.W. Duran, and S.C. Ntafos An evaluation of random testing IEEE Transactions on Software Engineering SE-10 4 1984 438 444
26. R.W. Eglese Simulated annealing: a tool for operational research European Journal of Operational Research 46 3 1990 271 281
27. R. Feldt, R. Torkar, T. Gorschek, and W. Afzal Searching for cognitively diverse tests: towards universal test diversity metrics Proceedings of the IEEE International Conference on Software Testing Verification and Validation Workshop (ICSTW '08) 2008 IEEE Computer Society Washington, DC, USA 178 186
28. K. Fujisawa, Y. Takefuji, A balloon net discovering improved solutions in one of unsolved problems in geometry: a problem of spreading points in a unit square, in: Proceedings of IEEE International Conference on Neural Networks, Perth, WA, Australia, December 1995, pp. 2208-2210.
29. M.J. Gallagher, and V.L. Narasimhan Adtest: a test data generation suite for Ada software systems IEEE Transactions on Software Engineering 23 8 1997 473 484
30. D.E. Goldberg Genetic Algorithms in Search, Optimization, and Machine Learning 1989 Addison-Wesley
31. D. Hamlet, and R. Taylor Partition testing does not inspire confidence IEEE Transactions on Software Engineering 16 12 1990 1402 1411
32. D. Hamlet, Continuity in software systems, in: Proceedings of the International Symposium on Software Testing and Analysis, Rome, Italy, July 2002, pp. 196-200.
33. R. Hamlet Random Testing, Encyclopedia of Software Engineering 1994 Wiley pp. 970-978
34. M. Harman, The current state and future of search based software engineering, Future of software engineering 2007, Washington, DC, May 2007.
35. M. Harman, S.A. Mansouri, Y. Zhang, Search based software engineering: a comprehensive analysis and review of trends techniques and applications, Technical report TR-09-03, Department of Computer Science, King's College London, UK, April, 2009.
36. T. Hendtlass, M. Randall, A survey of ant colony and particle swarm meta-heuristics and their application to discrete optimization problems, in: Proceedings of The Inaugural Workshop on Artificial Life, Adelaide, Australia, December 2001, pp. 15-25.
37. J.H. Holland Adaptation in Natural and Artificial Systems 1975 MIT Press
38. W.E. Howden Symbolic testing and dissect symbolic evaluation system IEEE Transactions on Software Engineering SE-3 4 1977 266 278
39. B.F. Jones, H.H. Sthamer, and D.E. Eyres Automatic structural testing using genetic algorithms Software Engineering Journal 11 5 1996 299 306
40. J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proceedings of IEEE International Conference on Neural Networks, Perth, Australia, June 1995, pp. 1942-1948.
41. S. Kirpatrick, C.D. Gelatt Jr., and M.P. Vecchi Optimization by simulated annealing Science 220 4598 1983 671 680
42. B. Korel Automated software test data generation IEEE Transactions on Software Engineering 16 8 1990 870 879
43. R. Larson, and B. Farber Elementary Statistics: Picturing the World fourth ed. 2009 Prentice Hall
44. Jin-Cherng Lin, and Pu-Lin Yeh Automatic test data generation for path testing using GAs Information Sciences 131 1-4 2001 47 64
45. S.M. LaValle Planning Algorithms 2006 Cambridge University Press
46. J.W. Laski, and B. Korel A data flow oriented program testing strategy IEEE Transactions on Software Engineering SE-9 3 1983 347 354
47. A.N. Magurran Measuring Biological Diversity 2003 Wiley
48. Y.K. Malaiya, Antirandom testing: getting the most out of black-box testing, in: Proceedings of the Sixth International Symposium on Software Reliability Engineering, Toulouse, France, October 1995, pp. 86-95.
49. J. Mayer, Lattice-based adaptive random testing, in: Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering, Long Beach, California, November 2005, pp. 333-336.
50. P. McMinn Search-based software test data generation: a survey Software Testing, Verification and Reliability 14 2 2004 105 156
51. C.C. Michael, G. McGraw, and M.A. Schatz Generating software test data by evolution IEEE Transactions on Software Engineering 27 12 2001 1085 1110
52. Z. Michalewicz, and D.B. Fogel How to Solve It: Modern Heuristics third ed. 2002 Springer
53. Z. Michalewicz Genetic Algorithms + Data Structures = Evolution Programs third ed. 1996 Springer-Verlag
54. W. Miller, and D.L. Spooner Automatic generation of floating-point test data IEEE Transactions on Software Engineering SE-2 3 1976 223 226
55. W.J. Morokoff, and R.E. Caflisch Quasi-Monte Carlo integration Journal of Computational Physics 122 2 1995 218 230
56. G.J. Myers The Art of Software Testing 1979 Wiley
57. S.C. Ntafos On required element testing IEEE Transactions on Software Engineering SE-10 6 1984 795 803
58. S.C. Ntafos On comparisons of random, partition, and proportional partition testing IEEE Transactions on Software Engineering SE-27 10 2001 949 960
59. A.J. Offutt, J.H. Hayws, A semantic model of program faults, in: International Symposium on Software Testing and Analysis, San Diego, California, January 1996, pp. 195-200.
60. M. Oprea, S. Forrest, How the immune system generates diversity: pathogen space coverage with random and evolved antibody libraries, in: Proceedings of the Genetic and Evolutionary Computation Conference, vol. 2, Orlando, Florida, July 1999, pp. 13-17.
61. R.P. Pargas, M.J. Harrold, and R.R. Peck Test-data generation using genetic algorithms Journal of Software Testing, Verification and Reliability 9 4 1999 263 282
62. W. Pedrycz, Computational intelligence as an emerging paradigm of software engineering, in: Proceedings of International Conference on Software Engineering and Knowledge Engineering, Ischia, Italy, July 2002, pp. 7-14.
63. W. Press, B. Flannery, S. Teukolsky, and W. Vetterling Numerical Recipes in C: The Art of Scientific Computing 1993 Cambridge University Press
64. C.V. Ramamoorthy, F.H. Siu-Bun, and W.T. Chen On automated generation of program test data IEEE Transactions on Software Engineering SE-2 4 1976 293 300
65. S. Rapps, and E.J. Weyuker Selecting software test data using data flow information IEEE Transactions on Software Engineering SE-11 4 1985 367 375
66. D.J. Richardson, M.C. Thompson, The relay model for error detection and its application, in: Proceedings of the Second Workshop on Software, Testing, Verification and Analysis, Alberta, Canada, July 1988, pp. 223-230.
67. J. Rosernberg, Statistical methods and measurement, in: F. Shull, J. Singer, I.K. Dag Sjøberg (Eds.), Guide to Advanced Empirical Software Engineering, Springer-Verlag, London, 2008.
68. N.J.A. Sloane, The sphere packing problem, in: Proceedings of the International Congress on Mathematics, Berlin, vol. 3, 1998, pp. 387-396.
69. M. Srinivas, and L.M. Patnaik Genetic algorithms: a survey IEEE Computer 27 6 1994 17 26
70. N. Tracey, J. Clark, K. Mander, Automated program flaw finding using simulated annealing, in: Proceedings of the International Symposium on Software Testing and Analysis, Clearwater Beach, Florida, March 1998, pp. 73-81.
71. K. Trojanowski, Z. Michalewicz, Evolutionary algorithms and the problem-specific knowledge, in: Proceedings of the Second National Conference on Evolutionary Computation and Global Optimization, Rytro, Poland, September 1997, pp. 281-292.
72. J. Voas PIE: a dynamic failure-based technique IEEE Transactions on Software Engineering 18 8 1992 717 727
73. von Mayrhause, A., T. Hajjar, A. Bai, A. Anderson, C, Fast antirandom (FAR) test generation, in: Proceedings of Third IEEE International High-Assurance Systems Engineering Symposium, November, Washington, DC, USA, 1998, pp. 262-269.
74. E.J. Weyuker On testing non-testable programs The Computer Journal 25 4 1982 465 470
75. E.J. Weyuker, and B. Jeng Analyzing partition testing strategies IEEE Transactions on Software Engineering 17 7 1991 703 711
76. J.A. Whittaker, and J. Voas Towards a more reliable theory of software reliability IEEE Computer 33 12 2000 36 42
77. A. Windisch, S. Wappler, J. Wegener, Applying particle swarm optimization to software testing, in: Proceedings of the Ninth Annual Conference on Genetic and Evolutionary Computation, London, UK, July 2007, pp. 1121-1128.
78. A. Witkin, An introduction to physically based modeling: particle system dynamics, Technical Report, Robotics Institute, Carnegie Mellon University, August, 1997.