A general framework for statistical performance comparison of evolutionary computation algorithms

Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2006

Volumn , Issue , 2006, Pages 7-12

  Shilane, David ^a   Martikainen, Jarno ^b   Dudoit, Sandrine ^a   Ovaska, Seppo J ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b AALTO UNIVERSITY   (Finland)

Author keywords

Bootstrap; Evolutionary computation; Multiple hypothesis testing; Performance comparison; Statistics; Two fold sampling

Indexed keywords

COMPUTER APPLICATIONS; DATA MINING; STATISTICAL METHODS;

BOOTSTRAP; MULTIPLE HYPOTHESIS TESTING; PERFORMANCE COMPARISON; TWO-FOLD SAMPLING;

EVOLUTIONARY ALGORITHMS;

EID: 34250782545     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. D. B. Fogel, Evolutionary computation: Toward a new philosophy of machine intelligence (Piscataway, NJ: IEEE Press, 2000).
2. T. Back, Evolutionary algorithms in theory and practice (New York, NY: Oxford University Press, 1996).
3. D. H. Wolpert and W. G. Macready, No free lunch theorems for optimization, IEEE Transactions on Evolutionary Computation, 1(1), 1997, 67-82.
4. S. Christensen and M. Wineberg, Using appropriate statistics - Statistics for artificial intelligence, Tutorial Program of the 2004 Genetic and Evolutionary Computation Conference, Seattle, WA, 2004, 544-564.
5. th European Meeting on Cybernetics and Systems Research. Austrian Society for Cybernetic Studies, Vienna, Austria, 1996, vol. 2, 1005-1008.
6. A. Czarn, C. MacNish, K. Vijayan, B. Turlach, and R. Gupta, Statistical exploratory analysis of genetic algorithms, IEEE Transactions on Evolutionary Computation, 8(4), 2004, 405-421.
7. J. S. Milton and J. C. Arnold, Introduction to probability and statistics: Principles and applications for engineering and the computing science (New York, NY: McGraw-Hill, 1990).
8. B. Efron and R. Tibshirani, An introduction to the bootstrap (Boca Raton, FL: Chapman and Hall, 1994).
9. K. S. Pollard et. al, Test statistics null distributions in multiple testing: Simulation studies and applications to genomics, Technical Report #184, U.C. Berkeley Division of Biostatistics Working Paper Series. (Submitted, Journal de la Société Francaise de Statistique.)
10. WWW-pages of the R project for statistical computing. [Cited 1.9.2005]. Available at 〈http:// r-project.org〉.
11. K. S. Pollard, S. Dudoit, and M. J. van der Laan, Multiple testing procedures: The Mulltest package and applications to genomics, R. C. Gentleman, V. J. Carey, W. Huber, R. Irizarry, and S. Dudoit (eds), Bioinformatics and Computational Biology Solutions Using R and Bioconductor (New York:, NY: Springer-Verlag, 2005), Chapter 15, 249-271.
12. K. S. Pollard and M. J. van der Laan, Resampling-based multiple testing: Asymptotic control of type I error and applications to gene expression data, U.C. Berkeley Division of Biostatistics Working Paper Series. Working Paper 121, 2003.
13. S. Dudoit, M. J. van der Laan, and K. S. Pollard, Multiple testing. Part I. Single-step procedures for control of general type I error rates, Statistical Applications in Genetics and Molecular Biology, 3(1), Article 13, 2004.
14. S. Dudoit and M. J. van der Laan (In preparation), Multiple testing procedures and applications to genomics, Springer Series in Statistics.
15. M. J. van der Laan, S. Dudoit, and K. S. Pollard, Augmentation procedures for control of the generalized family-wise error rate and tail probabilities for the proportion of false positives, Statistical Applications in Genetics and Molecular Biology, 3(1), Article 15, 2004.