A principled evaluation of the effect of directed mutation on search-based statistical testing

Proceedings - 4th IEEE International Conference on Software Testing, Verification, and Validation Workshops, ICSTW 2011

Volumn , Issue , 2011, Pages 184-193

  Poulding, Simon ^a   Clark, John A ^a   Waeselynck, Hélène ^b  

^a UNIVERSITY OF YORK   (United Kingdom)

^b LAAS CNRS   (France)

Author keywords

Experimental design; Optimization; Software program verification; Test coverage of code; Testing strategies

Indexed keywords

ALGORITHM PERFORMANCE; DIRECTED MUTATION; EMPIRICAL APPROACH; EMPIRICAL EVALUATIONS; FITNESS EVALUATIONS; LABOUR-INTENSIVE; META-HEURISTIC SEARCH ALGORITHMS; MUTATION OPERATORS; OBJECTIVE METHODS; RESPONSE SURFACE METHODOLOGY; SEARCH ALGORITHMS; SEARCH-BASED; SOFTWARE/PROGRAM VERIFICATION; STATISTICAL TESTING; STRUCTURAL TESTING; TEST COVERAGE; TEST INPUTS; TEST SETS; TESTING STRATEGIES; TUNING ALGORITHM;

COMPUTER SOFTWARE SELECTION AND EVALUATION; LEARNING ALGORITHMS; MATHEMATICAL OPERATORS; PROBABILITY DISTRIBUTIONS; SAMPLING; STATISTICAL TESTS;

SOFTWARE TESTING;

EID: 80051656117     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSTW.2011.36     Document Type: Conference Paper

References (25)

1. P. Th́evenod-Fosse, "Software validation by means of statistical testing: Retrospect and future direction, " in Dependable Computing for Critical Applications, A. Avizienis and J. C. Laprie, Eds. Springer, 1991, pp. 23-50.
2. P. Th́evenod-Fosse and H. Waeselynck, "An investigation of statistical software testing, " J. Software Testing, Verification and Reliability, vol. 1, no. 2, pp. 5-26, 1991.
3. P. Th́evenod-Fosse and H. Waeselynck, "Statemate applied to statistical testing, " in Proc. Int'l Symp. Software Testing and Analysis (ISSTA'93), 1993, pp. 99-109.
4. P. Th́evenod-Fosse, H. Waeselynck, and Y. Crouzet, "Software statistical testing, " Laboratoire d'Analyse et d'Architecture des Syst̀emes du CNRS (LAAS), Tech. Rep. 95178, 1995.
5. P. Th́evenod-Fosse and H. Waeselynck, "Towards a statistical approach to testing object-oriented programs, " in Proc. IEEE Ann. Int'l Symp. Fault Tolerant Computing (FTCS-27), 1997, pp. 99-108.
6. S. Poulding and J. A. Clark, "Efficient software verification: Statistical testing using automated search, " IEEE Trans. Software Eng., vol. 36, no. 6, pp. 763-777, 2010, to appear.
7. P. Thevenod-Fosse, H. Waeselynck, and Y. Crouzet, "An experimental study on software structural testing: deterministic versus random input generation, " in Fault-Tolerant Computing, 1991. FTCS-21. Digest of Papers., Twenty-First International Symposium, Jun. 1991, pp. 410 - 417. (Pubitemid 21704479)
8. J. Grefenstette, "Optimization of control parameters for genetic algorithms, " Systems, Man and Cybernetics, IEEE Transactions on, vol. 16, no. 1, pp. 122 -128, 1986.
9. E. Ridge and D. Kudenko, "Analyzing heuristic performance with response surface models: prediction, optimization and robustness, " in Proc. Genetic and Evolutionary Computation Conf. (GECCO 2007), 2007, pp. 150-157. (Pubitemid 47291494)
10. D. R. White and S. Poulding, "A rigorous evaluation of crossover and mutation in genetic programming, " in Proceedings of the 12th European Conference on Genetic Programming, ser. EuroGP '09. Springer-Verlag, 2009, pp. 220-231.
11. J.-T. Tsai, J.-H. Chou, and T.-K. Liu, "Tuning the structure and parameters of a neural network by using hybrid Taguchi-genetic algorithm, " Neural Networks, IEEE Transactions on, vol. 17, no. 1, pp. 69 -80, Jan. 2006. (Pubitemid 43263941)
12. R. H. Myers and D. C. Montgomery, Response surface methodology: process and product optimization using designed experiments, ser. Wiley Series in Probability and Statistics. John Wiley & Sons, Inc., 2005.
13. K. K. Vadde, V. R. Syrotiuk, and D. C. Montgomery, "Optimizing protocol interaction using response surface methodology, " IEEE Trans. Mob. Comput., vol. 5, no. 6, pp. 627-639, June 2006.
14. D. C. Montgomery, Design and Analysis of Experiments, 6th ed. John Wiley & Sons, Inc., 2005.
15. P. Ross, D. Corne, and H.-L. Fang, "Improving evolutionary timetabling with delta evaluation and directed mutation, " in Parallel Problem Solving from Nature - PPSN III, ser. Lecture Notes in Computer Science, Y. Davidor, H.-P. Schwefel, and R. M̈anner, Eds. Springer Berlin/Heidelberg, 1994, vol. 866, pp. 556-565.
16. B. Paechter, A. Cumming, M. Norman, and H. Luchian, "Extensions to a memetic timetabling system, " in Practice and Theory of Automated Timetabling, ser. Lecture Notes in Computer Science, E. Burke and P. Ross, Eds. Springer Berlin/Heidelberg, 1996, vol. 1153, pp. 251- 265. (Pubitemid 126141972)
17. R. Tavares, A. Téofilo, P. Silva, and A. C. Rosa, "Infected genes evolutionary algorithm, " in Proceedings of the 1999 ACM Symposium on Applied computing (SAC '99), 1999, pp. 333-338.
18. D. Thierens, "Adaptive mutation rate control schemes in genetic algorithms, " in Evolutionary Computation, 2002. CEC '02. Proceedings of the 2002 Congress on, vol. 1, May 2002, pp. 980 -985.
19. "JDK 1.4 Demo Applets." [Online]. Available: http://java.sun.com/applets/jdk/1.4/index.html.
20. "WCET Analysis Project." [Online]. Available: http://www.mrtc.mdh.se/projects/wcet/benchmarks.html.
21. M. Galassi et al., GNU Scientific Library Reference Manual, 3rd ed. Network Theory, 2009.
22. F. Wilcoxon, "Individual comparisons by ranking methods, " Biometrics Bulletin, vol. 1, no. 6, pp. 80-83, 1945.
23. A. Vargha and H. Delaney, "A critique and improvement of the CL common language effect size statistics of McGraw and Wong, " J. Educational and Behavioral Statistics, vol. 25, no. 2, pp. 101-132, 2000.
24. "random.org." [Online]. Available: http://www.random.org/.
25. A. Arcuri and X. Yao, "Search based software testing of object-oriented containers, " Information Sciences, vol. 178, no. 15, pp. 3075-3095, August 2008.