Optimizing for the number of tests generated in search based test data generation with an application to the oracle cost problem

ICSTW 2010 - 3rd International Conference on Software Testing, Verification, and Validation Workshops

Volumn , Issue , 2010, Pages 182-191

  Harman, Mark ^a   Kim, Sung Gon ^a   Lakhotia, Kiran ^a   McMinn, Phil ^b   Yoo, Shin ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED TEST DATA GENERATION; BENCHMARK PROGRAMS; BRANCH COVERAGE; COST PROBLEMS; EMPIRICAL STUDIES; NON-TRIVIAL; SEARCH SPACES; TEST CASE; TEST DATA GENERATION;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA COMMUNICATION SYSTEMS; MATHEMATICAL MODELS; SOFTWARE TESTING; TEST FACILITIES; TESTING; VERIFICATION;

COST REDUCTION;

EID: 77953750964     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSTW.2010.31     Document Type: Conference Paper

References (40)

1. M. Harman and P. McMinn, "A theoretical and empirical study of search based testing: Local, global and hybrid search," IEEE Transactions on Software Engineering, vol. 36, no. 2, 2010, To Appear.
2. P. Tonella, "Evolutionary testing of classes," in ISSTA, 2004, pp. 119- 128.
3. A. Arcuri and X. Yao, "Search based software testing of object-oriented containers," Inf. Sci, vol. 178, no. 15, pp. 3075-3095, 2008.
4. M. Harman, F. Islam, T. Xie, and S. Wappler, "Automated test data generation for aspect-oriented programs," in AOSD, 2009, pp. 185-196.
5. K. Derderian, R. M. Hierons, M. Harman, and Q. Guo, "Input sequence generation for testing of communicating finite state machines (CFSMs)," in GECCO, 2004, pp. 1429-1430.
6. Y. Zhan and J. A. Clark, "Search-based mutation testing for simulink models," in GECCO, 2005, pp. 1061-1068.
7. V. Garousi, L. C. Briand, and Y. Labiche, "Traffic-aware stress testing of distributed real-time systems based on UML models using genetic algorithms," Journal of Systems and Software, vol. 81, no. 2, pp. 161-185, 2008.
8. N. Tracey, J. Clark, and K. Mander, "The way forward for unifying dynamic test-case generation: The optimisation-based approach," in International Workshop on Dependable Computing and Its Applications (DCIA), 1998, pp. 169-180.
9. Y. Jia and M. Harman, "Constructing subtle faults using higher order mutation testing," in SCAM, 2008, pp. 249-258.
10. Y. Zhan and J. A. Clark, "The state problem for test generation in simulink," in GECCO, 2006, pp. 1941-1948.
11. J. Wegener and O. Biihler, "Evaluation of different fitness functions for the evolutionary testing of an autonomous parking system," in GECCO, 2004, pp. 1400-1412.
12. W. Afzal, R. Torkar, and R. Feldt, "A systematic review of search-based testing for non-functional system properties," Information and Software Technology, vol. 51, no. 6, pp. 957-976, Jun. 2009.
13. M. Harman, A. Mansouri, and Y. Zhang, "Search based software engineering: A comprehensive analysis and review of trends techniques and applications," Department of Computer Science, King's College London, Tech. Rep. TR-09-03, April 2009.
14. P. Godefroid, N. Klarlund, and K. Sen, "DART: directed automated random testing," ACM SIGPLAN Notices, vol. 40, no. 6, pp. 213-223, Jun. 2005.
15. R. A. Demillo and A. J. Offutt, "Experimental results from an automatic test case generator," ACM Transactions on Software Engineering and Methodology, vol. 2, no. 2, pp. 109-127, Apr. 1993.
16. B. Meyer, "Eiffel: A language and environment for software engineering," The Journal of Systems and Software, vol. 8, no. 3, pp. 199-246, Jun. 1988.
17. J. Ferrante, K. J. Ottenstein, and J. D. Warren, "The program dependence graph and its use in optimization," ACM Transactions on Programming Languages and Systems, vol. 9, no. 3, pp. 319-349, Jul. 1987.
18. P. McMinn, "Search-based software test data generation: a survey," Softw. Test, Verif. Reliab, vol. 14, no. 2, pp. 105-156, 2004.
19. M. Harman and B. F. Jones, "Search-based software engineering," Information & Software Technology, vol. 43, no. 14, pp. 833-839, 2001.
20. M. Harman, "The current state and future of search based software engineering," in FOSE, 2007, pp. 342-357. (Pubitemid 47484936)
21. J. Wegener, A. Baresel, and H. Sthamer, "Evolutionary test environment for automatic structural testing," Information & Software Technology, vol. 43, no. 14, pp. 841-854, 2001.
22. A. M. Smith and G. M. Kapfhammer, "An empirical study of incorporating cost into test suite reduction and prioritization," in SAC, 2009, pp. 461-467.
23. D. S. Johnson, "Approximation algorithms for combinatorial problems," in Proceedings of the 5th annual ACM Symposium on Theory of Computing (STOC 1973), 1973, pp. 38-49.
24. C. C. Michael, G. McGraw, and M. Schatz, "Generating software test data by evolution," IEEE Trans. Software Eng, vol. 27, no. 12, pp. 1085-1110, 2001.
25. M. J. Harrold, R. Gupta, and M. L. Soffa, "A methodology for controlling the size of a test suite," ACM Transactions on Software Engineering and Methodology, vol. 2, no. 3, pp. 270-285, Jul. 1993.
26. J. Offutt, J. Pan, and J. Voas, "Procedures for reducing the size of coverage-based test sets," in Proceedings of the 12th International Conference on Testing Computer Software, 1995, pp. 111-123.
27. W. E. Wong, J. R. Horgan, S. London, and A. P. Mathur, "Effect of test set minimization on fault detection effectiveness," Softw, Pract. Exper, vol. 28, no. 4, pp. 347-369, 1998.
28. P. McMinn, "IGUANA: Input generation using automated novel algorithms. A plug and play research tool," Department of Computer Science, University of Sheffield, Tech. Rep. CS-07-14, 2007.
29. J. E. Baker, "Reducing bias and inefficienry in the selection algorithm," in Proceedings of the 2nd International Conference on Genetic Algorithms and their Applications, 1987, pp. 14-21.
30. D. Whitley, "The GENITOR algorithm and selection pressure: Why rank-based allocation," in Proc. of the Third Int. Conf. on Genetic Algorithms, 1989, pp. 116-121.
31. H. Mühlenbein and D. Schlierkamp-Voosen, "Predictive models for the breeder genetic algorithm: I. continuous parameter optimization," Evolutionary Computation, vol. 1, no. 1, pp. 25-49, 1993.
32. E. J. Weyuker, "Program schemas with semantic restrictions," Ph.D. dissertation, Rutgers University, June 1977.
33. M. Harder, J. Mellen, and M. D. Ernst, "Improving test suites via operational abstraction," in Proceedings of the 25th International Conference on Software Engineering, 2003, pp. 60-71.
34. J. Black, E. Melachrinoudis, and D. R. Kaeli, "Bi-criteria models for all-uses test suite reduction," in ICSE, 2004, pp. 106-115.
35. S. Yoo and M. Harman, "Pareto efficient multi-objective test case selection," in ISSTA, 2007, pp. 140-150.
36. A. Leitner, M. Oriol, A. Zeller, I. Ciupa, and B. Meyer, "Efficient unit test case minimization," in ASE, 2007, pp. 417-420.
37. B. Jones, H.-H. Sthamer, and D. Eyres, "Automatic structural testing using genetic algorithms," The Software Engineering Journal, vol. 11, pp. 299-306, 1996.
38. M. Roper, "Computer aided software testing using genetic algorithms," in 10th International Software Quality Week, San Francisco, USA, 1997.
39. A. Watkins, "A tool for the automatic generation of test data using genetic algorithms," in Proceedings of the Software Quality Conference '95, 1995, pp. 300-309.
40. K. Deb, S. Agrawal, A. Pratap, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. Evolutionary Computation, vol. 6, no. 2, pp. 182-197, 2002.