Matching inductive search bias and problem structure in continuous Estimation-of-Distribution Algorithms

European Journal of Operational Research

Volumn 185, Issue 3, 2008, Pages 1246-1264

  Bosman, Peter A N ^a   Grahl, Jörn ^b  

^a CWI   (Netherlands)

^b UNIVERSITY OF MANNHEIM   (Germany)

Author keywords

Adaptive variance; Convergence dynamics; Estimation of Distribution Algorithms; Normal distribution; Numerical optimization

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; FINITE DIFFERENCE METHOD; NORMAL DISTRIBUTION; OPTIMIZATION; PARAMETER ESTIMATION; PROBLEM SOLVING;

ADAPTIVE VARIANCE; CONVERGENCE DYNAMICS; ESTIMATION-OF-DISTRIBUTION ALGORITHMS; NUMERICAL OPTIMIZATION;

GENETIC ALGORITHMS;

EID: 34848839239     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2006.06.051     Document Type: Article

References (53)

1. Ahn C.W., Ramakrishna R.S., and Goldberg D.E. Real-coded Bayesian optimization algorithm: Bringing the strength of BOA into the continuous world. In: Deb K., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2004 (2004), Springer-Verlag, Berlin 840-851
2. Anderson T.W. An Introduction to Multivariate Statistical Analysis (1958), John Wiley & Sons Inc., New York
3. Bengoetxea E., Larrañaga P., Bloch I., Perchant A., and Boeres C. Learning and simulation of Bayesian networks applied to inexact graph matching. Pattern Recognition 35 12 (2002) 2867-2880
4. Blanco, R., Larrañaga, P., Inza, I., Sierra, B., 2001. Selection of highly accurate genes for cancer classification by estimation of distribution algorithms. In: Lucas, P. et al. (Eds.), Proceedings of the Bayesian Models in Medicine Workshop at the 8th Artificial Intelligence in Medicine in Europe AIME-2001, pp. 29-34.
5. Blanco R., Inza I., and Larrañaga P. Learning Bayesian networks in the space of structures by estimation of distribution algorithms. International Journal of Intelligent Systems 18 (2003) 205-220
6. Bosman, P.A.N., 2003. Design and application of iterated density-estimation evolutionary algorithms. Ph.D. thesis, University of Utrecht, Institute of Information and Computer Science.
7. Bosman P.A.N., and Thierens D. Linkage information processing in distribution estimation algorithms. In: Banzhaf W., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-1999 (1999), Morgan Kaufmann, San Francisco, California 60-67
8. Bosman P.A.N., and Thierens D. Expanding from discrete to continuous estimation of distribution algorithms: The ID E A. In: Schoenauer M., et al. (Ed). Parallel Problem Solving from Nature - PPSN VI (2000), Springer-Verlag, Berlin 767-776
9. Bosman P.A.N., and Thierens D. Advancing continuous ID E As with mixture distributions and factorization selection metrics. In: Pelikan M., and Sastry K. (Eds). Proceedings of the Optimization by Building and Using Probabilistic Models OBUPM Workshop at the Genetic and Evolutionary Computation Conference - GECCO-2001 (2001), Morgan Kaufmann, San Francisco, California 208-212
10. Bosman, P.A.N., Thierens, D., 2001b. Exploiting gradient information in continuous iterated density estimation evolutionary algorithms. In: Kröse, B. et al. (Eds.), Proceedings of the Thirteenth Belgium-Netherlands Artificial Intelligence Conference BNAIC-2001, pp. 69-76.
11. Bosman P.A.N., and Thierens D. Learning probabilistic models for enhanced evolutionary computation. In: Jin Y. (Ed). Knowledge Incorporation in Evolutionary Computation (2004), Springer-Verlag, Berlin 147-176
12. Cho D.-Y., and Zhang B.-T. Continuous estimation of distribution algorithms with probabilistic principal component analysis. Proceedings of the 2001 Congress on Evolutionary Computation - CEC2001 (2001), IEEE Press, Piscataway, New Jersey 521-526
13. Cho D.-Y., and Zhang B.-T. Evolutionary optimization by distribution estimation with mixtures of factor analyzers. Proceedings of the 2002 Congress on Evolutionary Computation - CEC2002 (2002), IEEE Press, Piscataway, New Jersey 1396-1401
14. Cho D.-Y., and Zhang B.-T. Evolutionary continuous optimization by distribution estimation with variational Bayesian independent component analyzers mixture model. In: Yao X., et al. (Ed). Parallel Problem Solving from Nature - PPSN VIII (2004), Springer-Verlag, Berlin 212-221
15. Ducheyne, E.I., De Wulf, R.R., De Baets, B., 2002. Using linkage learning for forest management planning. In: Late-Breaking Papers of the Genetic and Evolutionary Computation Conference - GECCO-2002, pp. 109-114.
16. Etxeberria R., and Larrañaga P. Global optimization using Bayesian networks. In: Rodriguez A.A.O., et al. (Ed). Proceedings of the Second Symposium on Artificial Intelligence CIMAF-1999 (1999), Institute of Cybernetics, Mathematics and Physics 332-339
17. Friedman N., and Goldszmidt M. Learning Bayesian networks with local structure. In: Horvits E., and Jensen F. (Eds). Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence UAI-1996 (1996), Morgan Kaufmann, San Francisco, California 252-262
18. Gallagher M., Fream M., and Downs T. Real-valued evolutionary optimization using a flexible probability density estimator. In: Banzhaf W., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-1999 (1999), Morgan Kaufmann, San Francisco, California 840-846
19. Goldberg D.E. The Design of Innovation: Lessons from and for Competent Genetic Algorithms. Series on Genetic Algorithms and Evolutionary Computation vol. 7 (2002), Kluwer Academic Publishers
20. Grahl J., Minner S., and Rothlauf F. Behaviour of UMDAc with truncation selection on monotonous functions. Proceedings of the 2005 Congress on Evolutionary Computation - CEC2005 (2005), IEEE Press, Piscataway, New Jersey 2553-2559
21. Greene W.H. Econometric Analysis vol. 5 (2003), Prentice Hall, Upper Saddle River
22. Hansen N. The CMA evolution strategy: A comparing review. In: Lozano J.A., Larrañaga P., Inza I., and Bengoetxea E. (Eds). Towards a New Evolutionary Computation. Advances in Estimation of Distribution Algorithms (2006), Springer-Verlag, Berlin
23. Hansen N., Muller S.D., and Koumoutsakos P. Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evolutionary Computation 11 1 (2003) 1-18
24. Harik, G., 1999. Linkage learning via probabilistic modeling in the ECGA. Technical Report 99010, IlliGAL, University of Illinois, Urbana, Illinois.
25. Harik G., and Goldberg D.E. Learning linkage. Foundations of Genetic Algorithms 4 (1996) 247-262
26. Harik G., and Goldberg D.E. Linkage learning through probabilistic expression. Computer Methods in Applied Mechanics and Engineering 186 (2000) 295-310
27. Kern S., Müller S.D., Hansen N., Büche D., Ocenasek J., and Koumoutsakos P. Learning probability distributions in continuous evolutionary algorithms - a comparative review. Natural Computing 3 1 (2004) 77-112
28. In: Larrañaga P., and Lozano J. (Eds). Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation. Genetic Algorithms and Evolutionary Computation vol. 2 (2001), Kluwer Academic Publishers
29. Larrañaga P., Etxeberria R., Lozano J.A., and Peña J.M. Optimization in continuous domains by learning and simulation of Gaussian networks. In: Pelikan M., et al. (Ed). Proceedings of the Optimization by Building and Using Probabilistic Models OBUPM Workshop at the Genetic and Evolutionary Computation Conference - GECCO-2000 (2000), Morgan Kaufmann, San Francisco, California 201-204
30. Lauritzen S.L. Graphical Models (1996), Clarendon Press, Oxford
31. Mühlenbein H., and Mahnig T. FDA - a scalable evolutionary algorithm for the optimization of additively decomposed functions. Evolutionary Computation 7 4 (1999) 353-376
32. Mühlenbein, H., Paaß, G., 1996. From recombination of genes to the estimation of distributions I. In: Binary Parameters, Lecture Notes in Computer Science, vol. 1411, Parallel Problem Solving from Nature - PPSN IV, pp. 178-187.
33. Ocenasek, J., Schwarz, J., 2002. Estimation of distribution algorithm for mixed continuous-discrete optimization problems. In: 2nd Euro-International Symposium on Computational Intelligence, pp. 227-232.
34. Ocenasek J., Kern S., Hansen N., and Koumoutsakos P. A mixed Bayesian optimization algorithm with variance adaptation. In: Yao X., et al. (Ed). Parallel Problem Solving from Nature - PPSN VIII (2004), Springer-Verlag, Berlin 352-361
35. Paul, T., Iba, H., 2003a. Real-coded estimation of distribution algorithm. In: Proceedings of the 5th Metaheuristics International Conference 2003 - MIC-2003, pp. 60-1-60-6.
36. Paul T., and Iba H. Reinforcement learning estimation of distribution algorithm. In: Cantú-Paz E., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2003 (2003), Springer-Verlag, Berlin 1259-1270
37. Pelikan M., and Goldberg D.E. Escaping hierarchical traps with competent genetic algorithms. In: Spector L., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2001 (2001), Morgan Kaufmann, San Francisco, California 511-518
38. Pelikan M., and Goldberg D.E. Hierarchical BOA solves rising spin glasses and maxsat. In: Cantú-Paz E., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2003 (2003), Springer-Verlag, Berlin 1271-1282
39. Pelikan, M., Mühlenbein, H., 1998. Marginal distribution in evolutionary algorithms. In: Proceedings of the International Conference on Genetic Algorithms Mendel '98, Brno, Czech Republic, pp. 90-95.
40. Pelikan M., Goldberg D.E., and Cantú-Paz E. BOA: The Bayesian optimization algorithm. In: Banzhaf W., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-1999 (1999), Morgan Kauffman, San Francisco, California 525-532
41. Pelikan M., Goldberg D.E., and Lobo F. A survey of optimization by building and using probabilistic models. Computational Optimization and Applications 21 1 (2002) 5-20 Also IlliGAL Report No. 99018
42. Rastegar R., and Meybodi M.R. A study on the global convergence time complexity of estimation of distribution algorithms. In: Slezak D., et al. (Ed). Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing: 10th International Conference RSFDGrC-2005 (2005), Springer-Verlag, Berlin 441-450
43. Rothlauf F. Representations for Genetic and Evolutionary Algorithms. Studies on Fuzziness and Soft Computing 104 (2002), Springer, Berlin
44. Rudlof, S., Köppen, M., 1996. Stochastic hill climbing by vectors of normal distributions. In: Proceedings of the First Online Workshop on Soft Computing (WSC1), Nagoya, Japan.
45. Schwefel H.P. Evolution and Optimum Seeking (1995), Wiley and Sons, New York
46. Sebag M., and Ducoulombier A. Extending population-based incremental learning to continuous search spaces. In: Eiben A.E., et al. (Ed). Parallel Problem Solving from Nature - PPSN V (1998), Springer-Verlag, Berlin 418-427
47. Servet I., Trave-Massuyes L., and Stern D. Telephone network traffic overloading diagnosis and evolutionary computation technique. In: Hao J.K., et al. (Ed). Proceedings of Artificial Evolution '97 (1997), Springer-Verlag, Berlin 137-144
48. Shin S.-Y., and Zhang B.-T. Bayesian evolutionary algorithms for continuous function optimization. Proceedings of the 2001 Congress on Evolutionary Computation - CEC2001 (2001), IEEE Press, Piscataway, New Jersey 508-515
49. Shin S.-Y., Cho D.-Y., and Zhang B.-T. Function optimization with latent variable models. In: Ochoa A., et al. (Ed). Proceedings of the Third International Symposium on Adaptive Systems ISAS-2001 - Evolutionary Computation and Probabilistic Graphical Models (2001), Institute of Cybernetics, Mathematics and Physics 145-152
50. Sierra B., Lazkano E., Inza I., Merino M., Larrañaga P., and Quiroga J. Prototype selection and feature subset selection by estimation of distribution algorithms. a case study in the survival of cirrhotic patients treated with tips. In: Rector A.L., et al. (Ed). Proceedings of the 8th Artificial Intelligence in Medicine in Europe AIME-2001 (2001), Springer-Verlag, Berlin 20-29
51. Tatsuoka M.M. Multivariate Analysis: Techniques for Educational and Psychological Research (1971), John Wiley & Sons Inc., New York
52. Thierens D. Scalability problems of simple genetic algorithms. Evolutionary Computation 7 4 (1999) 331-352
53. Yuan B., and Gallagher M. On the importance of diversity maintenance in estimation of distribution algorithms. In: Beyer H.-G., et al. (Ed). Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-2005 vol. 1 (2005), ACM Press, Washington DC, USA 719-726