Unified eigen analysis on multivariate Gaussian based estimation of distribution algorithms

Information Sciences

Volumn 178, Issue 15, 2008, Pages 3000-3023

  Dong, Weishan ^a   Yao, Xin ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Covariance matrix scaling; Eigen analysis; Eigenvalue tuning; Estimation of distribution algorithm; Multivariate Gaussian distribution

Indexed keywords

ALGORITHMS; COVARIANCE MATRIX; MAXIMUM LIKELIHOOD; PARAMETER ESTIMATION;

COVARIANCE MATRIX SCALING; DISTRIBUTION ALGORITHM; EIGEN ANALYSIS; EIGENVALUE TUNING; MULTIVARIATE GAUSSIAN DISTRIBUTION;

EIGENVALUES AND EIGENFUNCTIONS;

EID: 44949177605     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2008.01.021     Document Type: Article

References (25)

1. P.A.N. Bosman, J. Grahl, Matching Inductive Search Bias and Problem Structure in Continuous Estimation-of-Distribution Algorithms, Technical Report 03/2005, Dept. of Logistics, Mannheim Business School, 2005.
2. Bosman P.A.N., Grahl J., and Rothlauf F. SDR: A better trigger for adaptive variance scaling in normal EDAs. Proceedings of the Genetic and Evolutionary Computation Conference, GECCO-2007 (2007), ACM Press, New York, NY, USA 492-499
3. P.A.N. Bosman, D. Thierens, An Algorithmic Framework for Density Estimation based Evolutionary Algorithms, Utrecht University Technical Report UU-CS-1999-46, 1999.
4. Bosman P.A.N., and Thierens D. Expanding from discrete to continuous estimation of distribution algorithms: the IDEA. Proceedings of the Sixth International Conference on Parallel Problem Solving From Nature - PPSN VI (2000), Springer-Verlag, Berlin 767-776
5. P.A.N. Bosman, D. Thierens, Continuous iterated density estimation evolutionary algorithms within the IDEA framework, in: Proceedings of the Optimization by Building and Using Probabilistic Models OBUPM Workshop at the Genetic and Evolutionary Computation Conference, GECCO-2000, Morgan Kauffmann, San Francisco, California, 2000, pp. 197-200.
6. Chatfield C., and Collin A.J. Introduction to Multivariate Analysis (1980), Science Paperbacks
7. Devroye L. Non-Uniform Random Variate Generation (1986), Springer-Verlag, New York
8. W. Dong, X. Yao, Covariance matrix repairing in Gaussian based EDAs, in: 2007 IEEE Congress on Evolutionary Computation (CEC2007), Singapore, 2007, pp. 415-422.
9. Gallagher M.R., and Frean M. Population-based continuous optimization, probabilistic modelling and mean shift. Evol. Comput. 13 (2005) 29-42
10. Goldberg D.E. Genetic Algorithms in Search, Optimization, and Machine Learning (1989), Addison-Wesley, Reading, Massachusetts, USA
11. Gonzlez C., Lozano J.A., and Larrañaga P. Mathematical modelling of UMDAc algorithm with tournament selection. Behaviour on linear and quadratic functions. Int. J. Approxim. Reason. 31 (2002) 313-340
12. Grahl J., Bosman P.A.N., and Rothlauf F. The correlation-triggered adaptive variance scaling IDEA. Proceedings of the Genetic and Evolutionary Computation Conference, GECCO-2006 (2006), ACM Press, New York, New York 397-404
13. Grahl J., Minner S., and Rothlauf F. Behaviour of UMDAc with truncation selection on monotonous functions. Proceedings of the Congress on Evolutionary Computation (CEC2005) (2005), IEEE Press, Piscataway, New Jersey 2553-2559
14. Jolliffe I.T. Principle Component Analysis (1986), Springer-Verlag
15. Larrañaga P., Etxeberria R., Lozano J.A., and Peña J.M. Optimization in continuous domains by learning and simulation of Gaussian networks. Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, GECCO-2000 (2000), ACM Press, New York, NY, USA 201-204
16. Larrañaga P., and Lozano J.A. Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation (2001), Kluwer, Norwel, MA
17. Ledoit O., and Wolf M. A well-conditioned estimator for large-dimensional covariance matrices. J. Multivar. Anal. 88 (2004) 365-411
18. H. Mühlenbein, G. Paaß, From recombination of genes to the estimation of distributions I. Binary parameters, Lecture Notes in Computer Science 1411, in: Parallel Problem Solving from Nature - PPSN IV, Springer-Verlag, London, UK, 1996, pp. 178-187.
19. T. Paul, H. Iba, Real-coded estimation of distribution algorithm, in: Proceedings of the 5th Metaheuristics International Conference, 2003, pp. 61-66.
20. Pelikan M., Goldberg D., and Lobo F. A survey to optimization by building and using probabilistic models. Comput. Optim. Appl. 21 (2002) 5-20
21. Vapnik V. Statistical Learning Theory (1998), John Wiley & Sons, New York
22. M.R. Wagner, A. Auger, M. Schoenauer, EEDA: A New Robust Estimation of Distribution Algorithm, Rapport de Recherche (Research Report) RR-5190, INRIA, 2004.
23. Wolpert D.H., and Macready W.G. No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1 (1997) 67-82
24. Yao X., Liu Y., and Lin G. Evolutionary programming made faster. IEEE Trans. Evol. Comput. 3 (1999) 82-102
25. Ye J. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. J. Mach. Learning Res. 6 (2005) 483-502