A general framework for statistical performance comparison of evolutionary computation algorithms

Information Sciences

Volumn 178, Issue 14, 2008, Pages 2870-2879

  Shilane, David ^a   Martikainen, Jarno ^b   Dudoit, Sandrine ^a   Ovaska, Seppo J ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b AALTO UNIVERSITY   (Finland)

Author keywords

Bootstrap; Evolutionary computation; Genetic algorithms; Multiple hypothesis testing; Performance comparison; Statistics; Twofold sampling

Indexed keywords

DATA REDUCTION; DISTRIBUTION FUNCTIONS; PROBLEM SOLVING; RANDOM PROCESSES; SAMPLING;

BOOTSTRAP; MULTIPLE HYPOTHESIS TESTING; PERFORMANCE COMPARISON; TWO FOLD SAMPLING;

GENETIC ALGORITHMS;

EID: 44149083276     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2008.03.007     Document Type: Article

References (19)

1. Bäck T. Evolutionary Algorithms in Theory and Practice (1996), Oxford University Press
2. Castillo-Valdivieso P.A., Merelo J.J., Prieto A., Rojas I., and Romero G. Statistical analysis of the parameters of a neuro-genetic algorithm. IEEE Transactions on Neural Networks 13 6 (2002) 1374-1394
3. S. Christensen, M. Wineberg, Using appropriate statistics - statistics for artificial intelligence, in: Tutorial Program of the Genetic and Evolutionary Computation Conference, Seattle, WA, 2004, pp. 544-564.
4. Czarn A., MacNish C., Vijayan K., Turlach B., and Gupta R. Statistical exploratory analysis of genetic algorithms. IEEE Transactions on Evolutionary Computation 8 4 (2004) 405-421
5. Dudoit S., van der Laan M.J., and Pollard K.S. Multiple testing. Part I. Single-step procedures for control of general type I error rates. Statistical Applications in Genetics and Molecular Biology 3 1 (2004) Article 13
6. Dudoit S., and van der Laan M.J. Multiple Testing Procedures and Applications to Genomics (2008), Springer, New York, NY
7. Efron B., and Tibshirani R. An Introduction to the Bootstrap (1994), Chapman and Hall, Boca Raton, FL
8. A. Flexer, Statistical evaluation of neural network experiments: minimum requirements and current practice, in: R. Trappel (Ed.), Proceedings of the 13th European Meeting on Cybernetics and Systems Research, Cybernetics and Systems '96, Vienna, Austria, vol. 2, 1996, pp. 1005-1008.
9. Fogel D.B. Evolutionary Computation: Toward a New Philosophy of Machine Intelligence (2000), Wiley-IEEE Press, Hoboken, NJ
10. François O., and Lavergne C. Design of evolutionary algorithms - a statistical perspective. IEEE Transactions on Evolutionary Computation 5 2 (2001) 129-148
11. Milton J.S., and Arnold J.C. Introduction to Probability and Statistics: Principles and Applications for Engineering and the Computing Sciences (1990), McGraw-Hill, New York, NY
12. Penev K., and Littlefair G. Free search - a comparative analysis. Information Sciences 172 (2005) 173-193
13. Pollard K.S., Birkner M.D., van der Laan M.J., and Dudoit S. Test statistics null distributions in multiple testing: simulation studies and applications to genomics. Journal de la Société Française de Statistique 146 1-2 (2005) 77-115
14. Pollard K.S., Dudoit S., and van der Laan M.J. Multiple testing procedures: the multtest package and applications to genomics. Bioinformatics and Computational Biology Solutions using R and Bioconductor. Statistics for Biology and Health (2005), Springer-Verlag, New York pp. 249-271 (Chapter 15)
15. Pollard K.S., and van der Laan M.J. Choice of a null distribution in resampling-based multiple testing. Journal of Statistical Planning and Inference 125 1-2 (2004) 85-100
16. Rice J.A. Mathematical Statistics and Data Analysis (2006), Duxbury Press, Pacific Grove, CA
17. Rojas I., González J., Pomares H., Merelo J.J., Castillo P.A., and Romero G. Statistical analysis of the main parameters involved in the design of a genetic algorithm. IEEE Transactions on Systems, Man, and Cybernetics-Part C 32 1 (2002) 31-37
18. van der Laan M.J., Dudoit S., and Pollard K.S. Augmentation procedures for control of the generalized family-wise error rate and tail probabilities for the proportion of false positives. Statistical Applications in Genetics and Molecular Biology 3 1 (2004) Article 15
19. Wolpert D.H., and MacReady W.G. No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation 1 1 (1997) 67-82