Test Case Evaluation and Input Domain Reduction strategies for the Evolutionary Testing of Object-Oriented software

Information and Software Technology

Volumn 51, Issue 11, 2009, Pages 1534-1548

  Ribeiro, José Carlos Bregieiro ^a   Zenha Rela, Mário Alberto ^b   Fernández de Vega, Francisco ^c  

^a POLYTECHNIC INSTITUTE OF LEIRIA   (Portugal)

^b UNIVERSITY OF COIMBRA   (Portugal)

^c UNIVERSITY OF EXTREMADURA   (Spain)

Author keywords

Evolutionary Testing; Input Domain Reduction; Search Based Software Engineering; Test Case Evaluation

Indexed keywords

COVERAGE METRICS; EVOLUTIONARY TESTING; INPUT DOMAIN REDUCTION; META-HEURISTIC SEARCH; NOVEL METHODOLOGY; OBJECT ORIENTED SOFTWARE; OBJECT-ORIENTED PROGRAM; PURITY ANALYSIS; SEARCH PROCESS; SEARCH SPACES; SEARCH-BASED SOFTWARE ENGINEERING; STRONGLY-TYPED GENETIC PROGRAMMING; STRUCTURAL UNIT; TEST CASE; TEST CASE EVALUATION; TEST DATA; TEST OBJECT;

COMPUTER SOFTWARE SELECTION AND EVALUATION; EVOLUTIONARY ALGORITHMS; GENETIC PROGRAMMING; HEURISTIC METHODS; OBJECT ORIENTED PROGRAMMING; SOFTWARE ENGINEERING; TEST FACILITIES; TESTING;

QUALITY CONTROL;

EID: 69749103111     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2009.06.009     Document Type: Article

References (49)

1. Andrea Arcuri, Xin Yao, A memetic algorithm for test data generation of object-oriented software, in: Proceedings of the 2007 IEEE Congress on Evolutionary Computation (CEC), IEEE, 2007, pp. 2048-2055.
2. Arcuri A., and Yao X. On test data generation of object-oriented software. TAICPART-MUTATION'07: Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (2007), IEEE Computer Society, Washington, DC, USA 72-76
3. Andrea Arcuri, Xin Yao, Search Based Testing of Containers for Object-Oriented Software, Technical Report CSR-07-3, University of Birmingham, School of Computer Science, April 2007.
4. In: Back T., Fogel D.B., and Michalewicz Z. (Eds). Handbook of Evolutionary Computation (1997), IOP Publishing Ltd., Bristol, UK
5. Stéphane Barbey, Alfred Strohmeier, The problematics of testing object-oriented software, in: M. Ross, C.A. Brebbia, G. Staples, J. Stapleton (Eds.), SQM'94 Second Conference on Software Quality Management, Edinburgh, Scotland, UK, July 26-28, vol. 2, 1994, pp. 411-426.
6. Beizer B. Software Testing Techniques (1990), John Wiley & Sons, Inc., New York, NY, USA
7. Bertolino A. Software testing research: achievements, challenges, dreams. FOSE'07: 2007 Future of Software Engineering (2007), IEEE Computer Society, Washington, DC, USA 85-103
8. De Jong K.A. Evolutionary Computation (2002), The MIT Press
9. Bruce Eckel, Thinking in Java, Prentice Hall Professional Technical Reference, 2002.
10. Harman M. Automated test data generation using search based software engineering. AST'07: Proceedings of the Second International Workshop on Automation of Software Test (2007), IEEE Computer Society, Washington, DC, USA 2
11. Harman M. The current state and future of search based software engineering. FOSE'07: 2007 Future of Software Engineering (2007), IEEE Computer Society, Washington, DC, USA 342-357
12. Harman M., Hassoun Y., Lakhotia K., McMinn P., and Wegener J. The impact of input domain reduction on search-based test data generation. ESEC-FSE'07: Proceedings of the 6th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering (2007), ACM Press, New York, NY, USA 155-164
13. Haynes T.D., Schoenefeld D.A., and Wainwright R.L. Type inheritance in strongly typed genetic programming. In: Angeline P.J., and Kinnear Jr. K.E. (Eds). Advances in Genetic Programming vol. 2 (1996), MIT Press, Cambridge, MA, USA 359-376
14. Hinterding R., Michalewicz Z., and Eiben A.E. Adaptation in evolutionary computation: a survey. Proceedings of the Fourth International Conference on Evolutionary Computation (ICEC 97) (1997), IEEE Press 65-69
15. Holland J.H. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence (1992), The MIT Press
16. Kobi Inkumsah, Tao Xie, Evacon: a framework for integrating evolutionary and concolic testing for object-oriented programs, in: Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007), November 2007, pp. 425-428.
17. Kobi Inkumsah, Tao Xie, Improving structural testing of object-oriented programs via integrating evolutionary testing and symbolic execution, in: Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE 2008), September 2008.
18. Kinneer A., Dwyer M.B., and Rothermel G. Sofya: supporting rapid development of dynamic program analyses for Java. ICSE COMPANION'07: Companion to the Proceedings of the 29th International Conference on Software Engineering (2007), IEEE Computer Society, Washington, DC, USA 51-52
19. Koza J.R. Genetic Programming: On the Programming of Computers by Means of Natural Selection (Complex Adaptive Systems) (1992), The MIT Press
20. Leavens G.T., Baker A.L., and Ruby C. Preliminary design of jml: a behavioral interface specification language for java. SIGSOFT Software. Eng. Notes 31 3 (2006) 1-38
21. Li K., and Wu M. Effective Software Test Automation: Developing an Automated Software Testing Tool (2004), SYBEX Inc., Alameda, CA, USA
22. Xiyang Liu, Bin Wang, Hehui Liu, Evolutionary search in the context of object-oriented programs, in: MIC'05: Proceedings of the Sixth Metaheuristics International Conference, 2005.
23. Sean Luke, ECJ 16: A Java Evolutionary Computation Library, 2007. .
24. Mantere T., and Alander J.T. Evolutionary software engineering, a review. Appl. Software Comput. 5 3 (2005) 315-331
25. McMinn P. Search-based software test data generation: a survey. Software Testing Verif. Reliab. 14 2 (2004) 105-156
26. P. McMinn, M. Holcombe, The State Problem for Evolutionary Testing, 2003.
27. Zbigniew Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, second extended ed., Springer-Verlag, Inc., New York, NY, USA, 1994.
28. Montana D.J. Strongly typed genetic programming. Evolut. Comput. 3 2 (1995) 199-230
29. Myers G.J., and Sandler C. The Art of Software Testing (2004), John Wiley & Sons
30. Ribeiro J.C.B. Search-based test case generation for object-oriented java software using strongly-typed genetic programming. GECCO'08: Proceedings of the 2008 GECCO Conference Companion on Genetic and Evolutionary Computation vol. 7 (2008), ACM, New York, NY, USA 1819-1822
31. Ribeiro J.C.B., Fernández de Vega F., and Rela M.Z. Using dynamic analysis of java bytecode for evolutionary object-oriented unit testing. SBRC WTF 2007: Proceedings of the 8th Workshop on Testing and Fault Tolerance at the 25th Brazilian Symposium on Computer Networks and Distributed Systems (2007), Brazilian Computer Society (SBC) 143-156
32. Ribeiro J.C.B., Rela M.Z., and Fernández de Vega F. A strategy for evaluating feasible and unfeasible test cases for the evolutionary testing of object-oriented software. AST'08: Proceedings of the 3rd International Workshop on Automation of Software Test (2008), ACM, New York, NY, USA 85-92
33. José Carlos Bregieiro Ribeiro, Mário Zenha-Rela, Francisco Fernández de Vega, An evolutionary approach for performing structural unit-testing on third-party object-oriented java software, in: Nature Inspired Cooperative Strategies for Optimization (NICSO 2007), Studies in Computational Intelligence, vols. 129, Springer, Berlin/Heidelberg, 2008/2007, pp. 379-388.
34. Ribeiro J.C.B., Zenha-Rela M.A., and Fernández de Vega F. Strongly-typed genetic programming and purity analysis: input domain reduction for evolutionary testing problems. GECCO'08: Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation vol. 7 (2008), ACM, New York, NY, USA 1783-1784
35. Ramon Sagarna, Andrea Arcuri, Xin Yao, Estimation of distribution algorithms for testing object oriented software, in: Dipti Srinivasan, Lipo Wang (Eds.), IEEE Congress on Evolutionary Computation, 25-28 September 2007, IEEE Computational Intelligence Society, IEEE Press, Singapore pp. 438-444.
36. A. Salcianu, M. Rinard, A Combined Pointer and Purity Analysis for Java Programs, Technical Report MIT-CSAILTR-949, MIT, May 2004.
37. Alexandru Salcianu, Martin C. Rinard, Purity and side effect analysis for java programs, in: VMCAI'05: Proceedings of the 6th International Conference on Verification, Model Checking, and Abstract Interpretation, Lecture Notes in Computer Science, vol. 3385. Springer, 2005, pp. 199-215.
38. Seesing A., and Gro H.-G. A genetic programming approach to automated test generation for object-oriented software. ITSSA 1 2 (2006) 127-134
39. Tonella P. Evolutionary testing of classes. ISSTA'04: Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (2004), ACM Press, New York, NY, USA 119-128
40. Nigel Tracey, John Clark, John McDermid, Keith Mander, A search-based automated test-data generation framework for safety-critical systems, in: Systems Engineering for Business Process Change: New Directions, 2002, pp. 174-213.
41. Vallée-Rai R., Co P., Gagnon E., Hendren L., Lam P., and Sundaresan V. Soot - a java bytecode optimization framework. CASCON'99: Proceedings of the 1999 Conference of the Centre for Advanced Studies on Collaborative Research (1999), IBM Press 13
42. Vincenzi A.M.R., Delamaro M.E., Maldonado J.C., and Wong W.E. Establishing structural testing criteria for java bytecode. Software Pract. Exp. 36 14 (2006) 1513-1541
43. Wappler S., and Wegener J. Evolutionary unit testing of object-oriented software using a hybrid evolutionary algorithm. CEC'06: Proceedings of the 2006 IEEE Congress on Evolutionary Computation (2006), IEEE 851-858
44. Wappler S., and Lammermann F. Using evolutionary algorithms for the unit testing of object-oriented software. GECCO'05: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation (2005), ACM Press, New York, NY, USA 1053-1060
45. Stefan Wappler, Joachim Wegener, Evolutionary unit testing of object-oriented software using strongly-typed genetic programming, in: GECCO'06: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, ACM Press, New York, NY, USA, 2006, pp. 1925-1932.
46. Whaley J., and Rinard M. Compositional pointer and escape analysis for java programs. OOPSLA'99: Proceedings of the 14th ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (1999), ACM, New York, NY, USA 187-206
47. S. Xanthakis, C. Ellis, C. Skourlas, A. Le Gall, S. Katsikas, K. Karapoulios, Application of genetic algorithms to software testing [application des algorithmes génétiques au test des logiciels], in: Proceedings of the 5th International Conference on Software Engineering, 1992, pp. 625-636.
48. Tao Xie, Nikolai Tillmann, Jonathan de Halleux, Wolfram Schulte, Method-sequence exploration for automated unit testing of object-oriented programs, in: Proceedings of the Workshop on State-Space Exploration for Automated Testing (SSEAT 2008), July 2008.
49. Yoo S., and Harman M. Pareto efficient multi-objective test case selection. ISSTA'07: Proceedings of the 2007 International Symposium on Software Testing and Analysis (2007), ACM, New York, NY, USA 140-150