Survey on estimation of distribution algorithms

Zidonghua Xuebao/Acta Automatica Sinica

Volumn 33, Issue 2, 2007, Pages 113-124

  Zhou, Shu De ^a   Sun, Zeng Qi ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Estimation of distribution algorithms (EDAs); Genetic algorithm; Probabilistic model; Statistical learning

Indexed keywords

EVOLUTIONARY ALGORITHMS; GENETIC ALGORITHMS; OPTIMIZATION; PROBABILITY DISTRIBUTIONS; SAMPLING;

ESTIMATION OF DISTRIBUTION ALGORITHMS (EDAS); EVOLUTIONARY COMPUTATION; PROBABILISTIC MODEL; STATISTICAL LEARNING; STOCHASTIC OPTIMIZATION ALGORITHMS;

ESTIMATION;

EID: 34247218016     PISSN: 02544156     EISSN: None     Source Type: Journal    
DOI: 10.1360/aas-007-0113     Document Type: Review

References (90)

1. Larrañaga P, Lozano J A. Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation. Boston: Kluwer Academic Publishers, 2002
2. Pelikan M, Goldberg D E, Lobo F. A Survey of Optimization by Building and Using Probabilistic Models. IlliGAL Report No. 99018, University of Illinois at Urbana-Champaign, Illinois Genetic Algorithms Laboratory, Urbana, Illinois, 1999
3. Pelikan M, Goldberg D E, Cantú-Paz E. Linkage Problem, Distribution Estimation, and Bayesian Networks. Illi-GAL Report No. 98013, University of Illinois at Urbana-Champaign, Illinois Genetic Algorithms Laboratory, Urbana, Illinois, 1998
4. Baluja S. Population-Based Incremental Learning: A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning. Technical Report CMU-CS-94-163, Pittsburgh, PA: Carnegie Mellon University, 1994
5. Baluja S. An Empirical Comparison of Seven Iterative and Evolutionary Function Optimizaion Heuristics. Technical Report CMU-CS-95-193, Computer Science Department, Carnegie Mellon University, 1995
6. Baluja S, Caruana R. Removing the genetics from standard genetic algorithm. In: Proceedings of the International Conference on Machine Learning. San Mateo, USA: Morgan Kaufmann, 1995. 38-46
7. Mühlenbein H, Paass G. From recombination of genes to the estimation of distributions I. Binary parameters. Parallel Problem Solving from Nature-PPSN IV, Berlin, 1996. 178-187
8. Mühlenbein H. The equation for response to selection and its use for prediction. Evolutionary Computation, 1997, 5(3): 303-346
9. Harik G R, Lobo F G, Goldberg D E. The compact genetic algorithm. In: Proceedings of the IEEE Conference on Evolutionary Computation. IEEE, Indianapolis, USA, 1998. 523-528
10. De Bonet, J S, Isbell C L, Viola P. MIMIC: Finding optima by estimating probability densities. Advances in Neural Information Processing Systems, Cambridge: MIT Press, 1997. 9: 424-430
11. Baluja S, Davies S. Using optimal dependency-trees for combinatorial optimization: Learning the structure of thesearch space. In: Proceedings of the 14th International Conference on Machine Learning. San Francisco, CA: Morgan Kaufmann, 1997. 30-38
12. Pelikan M, Mühlenbein H. The bivariate marginal distribution algorithm. Advances in Soft Computing-Engineering Design and Manufacturing, London, Springer-Verlag, 1999, 521-535
13. Pelikan M, Mühlenbein H. Marginal distributions in evolutionary algorithms. In: Proceedings of the International Conference on Genetic Algorithms. Brno, Czech Republic: Technical University of Brno, Publisher, 1998. 90-95
14. Harik G. Linkage Learning via Probabilistic Modeling in the ECGA. Illigal Report No. 99010, Illinois Genetic Algorithms Laboratory, University of Illinois, Urbana-Champaign, Illinois, 1999
15. Mühlenbein H, Mahnig T. Convergence theory and applications of the factorized distribution algorithm. Journal of Computing and Information Technology, 1999, 7(1): 19-32
16. Mühlenbein H, Mahnig T. The Factorized distributon algorithm for additively decomposable functions. In: Second Symposium on Artificial Intelligence. Adaptive Systems. CIMAF 99, La Habana, 1999. 301-313
17. Mühlenbein H, Mahnig T. FDA-a scalable evolutionary algorithm for the optimization of additively decomposed functions. Evolutionary Computation, 1999, 7(4): 353-376
18. Kallel L, Naudts B, Rogers A. Theoretical Aspects of Evolutionary Computating. London, UK: Springer-Verlag, 2001. 137-176
19. Mühlenbein H, Mahnig T, Ochoa A R. Schemata, distributions and graphical models in evolutionary optimization. Journal of Heuristics, 1999, 5: 215-247
20. Pelikan M, Goldberg D E, Cantú-Paz E. BOA: The Bayesian optimization algorithm. In: Proceedings of the Genetic and Evolutionary Computation Conference GECCO-99, Orlando, FL: 1999. 525-532
21. Pelikan M. A Simple Implementation of Bayesian Optimization Algorithm in C++(Version1.0). Illigal Report No. 99011, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, Urbana, Illinois, 1999
22. Pelikan M, Goldberg D E, Cantú-Paz E. Bayesian Optimization Algorithm, Population Sizing, and Time to Convergence. IlliGAL Report No. 2000001, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, Urbana, Illinois, 2000
23. Pelikan M. Hierarchical Bayesian Optimization Algorithm: Toward a New Generation of Evolutionary Algorithms. New York: Springer-Verlag, 2005
24. Chickering D M, Geiger D, Heckerman D. Learning Bayesian Networks Is NP-hard. Technical Report MSR-TR-94-17, Microsoft Research, Redmond, Wirginia, 1994
25. Larrañaga P, Etxeberria R, Lozano J A, Peňa J M. Combinatorial optimization by learning and simulation of Bayesian networks. In: Proceedings of the Sixteenth Conference on Uncertainty in Artificial Intelligence. Stanford: 2000. 343-352
26. Jiři O. Parallel Estimation of Distribution Algorithms. [Ph.D. dissertation], Brno University of Technology, 2002
27. Larrañaga P, Etxeberria R, Lozano J A, Peňa J M. Optimization in continuous domains by learning and simulation of Gaussian networks. In: Proceedings of the 2000 Genetic and Evolutionary Computation Conference Workshop Program. Las Vegas, Nevada, 2000. 201-204
28. Sebag M, Ducoulombier A. Extending population-based incremental learning to continuous search spaces. In: Back Th, Eiben G, Schoenauer M, Schwefel H P, editors, Proceedings of the 5th Conference on Parallel Problem Solving from Nature-PPSN V, Springer-Verlag, 1998. 418-427
29. Rudlof S, Köppen M. Stochastic Hill Climbing by Vectors of Normal Distributions. In: Proceedings of the First Online Workshop on Soft Computing (WSC1), Nagoya, Japan, 1996
30. Tsutsui S, Pelikan M, Goldberg D E. Evolutionary Algorithm Using Marginal Histogram Models in Continuous Domain. IlliGAL Report No. 2001019, University of Illinois at Urbana-Champaign, Urbana, Illinois, 2001
31. Larrañaga P, Etxeberria R, Lozano J A, Peňa J M. Optimization by Learning and Simulation of Bayesian and Gaussian Networks. Technical Report EHU-KZAA-IK-4/99, University of the Basque Country, Spain, 1999
32. Larrañaga P, Lozano J A, Bengoetxea E. Estimation of Distribution Algorithms Based on Multivariate Normal and Gaussian Networks. Technical Report KZZA-IK-1-01, Department of Computer Science and Artificial Intelligence, University of the Basque Country, 2001
33. Bosman P A N, Thierens D. Expanding from discrete to continuous estimation of distribution algorithms: The IDEA. In: Proceedings of the 6th International Conference on Parallel Problem Solving from Nature-PPSN VI, Springer-Verlag: 2000. 767-776
34. Hohfeld M, Rudolph G. Towards a theory of population based incremental learning. In: Proceedings of the 4th International Conference on Evolutionary Computation. IEEE, 1997. 1-5
35. Cristina G, Lozano J A, Larrañaga P. Analyzing the PBIL algorithm by means of discrete dynamical systems. Complex Systems, 2001, 12(4), 465-479
36. Shapiro J L. Drift and scaling in estimation of distribution algorithms. Evolutionary Computation, 2005, 13(1): 99-123
37. Zhang Q, Mühlenbein H. On the convergence of a class of estimation of distribution algorithms. IEEE Transactions on Evolutionary Computation, 2004, 8(2): 127-136
38. Zhang Q. On the convergence of a factorized distribution algorithm with truncation selection[Online], available: http://cswww.essex.ac.uk/staff/zhang/EDAWEB/, May 10, 2006
39. Zhang Q. On stability of fixed points of limit models of univariate marginal distribution algorithm and factorized distribution algorithm. IEEE Transactions on Evolutionary Computation, 2004, 8(1): 80-93
40. Rastegar R, Meybodi M R. A study on the global convergence time complexity of estimation of distribution algorithms. Lecture Notes in Computer Science, 2005, 3641: 441-450
41. Gao Y, Culberson J. Space complexity of estimation of distribution algorithms. Evolutionary Computation, 2005, 13(1): 125-143
42. Pelikan M, Sastry K, Goldberg D E. Scalability of the Bayesian optimization algorithm. International Journal of Approximate Reasoning, 2002, 31(3): 221-258
43. Mühlenbein H, Höns R. The estimation of distributions and the minimum relative entropy principle. Evolutionary Computation, 2005, 13(1): 1-27
44. Roberto S. Estimation of distribution algorithms with Kikuchi approximations. Evolutionary Computation, 2005, 13(1): 67-97
45. Jiři O. Entropy-based convergence measurement in discrete estimation of distribution algorithms. In: Lozano et al. (Eds): Towards a New Evolutionary Computation: Advances in the Estimation of Distribution Algorithms. Springs-Verlag, 2002. 125-142
46. Corno F, Reorda M S, Squillero G. The selfish gene algorithm: a new evolutionary optimization strategy. In: Proceedings of the 13th Annual ACM Symposium on Applied Computing (SAC'98). Atlanta, Georgia, USA: 1998. 349-355
47. Tu Z, Lu Y. A robust stochastic genetic algorithm (StGA) for global numerical optimization. IEEE Transaction on Evolutionary Computation, 2004, 8(5): 456-470
48. Han K H, Kim J H. Quantum-Inspired Evolutionary Algorithm for a class of combinatorial optimization. IEEE Transactions on Evolutionary Computation, 2002, 6(6): 580-593
49. Han K H, Kim J H. Quantum-inspired evolutionary algorithms with a new termination criterion, Hε gate, and two-phase scheme. IEEE Transactions on Evolutionary Computation, 2004, 8(2): 156-169
50. Zhou S, Sun Z. A new approach belonging to EDAs: quantum-inspired genetic algorithm with only one chromosome. In: Proceedings of First International Conference on Natural Computation (ICNC'05), Changsha, China, 2005. 141-150
51. Michalski R S. Learnable evolution model: Evolutionary processes guided by machine learning. Machine Learning 2000, 38: 9-40
52. Wojtusiak J, Michalski R S. The LEM3 System for Non-darwinian Evolutionary Computation and Its Application to Complex Function Optimization. Reports of the Machine Learning and Inference Laboratory, MLI 05-2, George Mason University, Fairfax, VA, Oct. 2005
53. Sun J, Zhang Q, Tsang E. DE/EDA: A new evolutionary algorithm for global optimization. Information Sciences, 2005, 169: 249-262
54. Cho D Y, Zhang B T. Evolutionary continuous optimization by distribution estimation with variational Bayesian independent component analyzers mixture model. Lecture Notes in Computer Science, 2004, 3242: 212-221
55. Peňa J M, Robles V, Larrañaga P, Herves V, Rosales F, Pérez M S. GA-EDA: Hybrid evolutionary algorithm using genetic and estimation of distribution algorithms. Lecture Notes in Computer Science, 2004, 3029: 361-371
56. Topon K P, Hitoshi I. Reinforcement learning estimation of distribution algorithm. In: Proceedings of Genetic and Evolutionary Computation Conference 2003. Lecture Notes in Computer Science, 2003, 2724: 1259-1270
57. Laurent G, Rodolphe L R, Raphael T H. A study of the effects of dimensionality on stochastic hill climbers and estimation of distribution algorithms. Lecture Notes in Computer Science, 2004, 2936: 27-38
58. Wright A, Poli R, Stephens C, Langdon W B, Pulavarty S. An estimation of distribution algorithm based on maximum entropy. In: Proceedings of the Genetic and Evolutionary Computation Conference. Lecture Notes in Computer Science, 2004, 3103: 343-354
59. Zhou S, Sun Z. Can ensemble method convert a 'weak' evolutionary algorithm to a 'strong' one? In: Proceedings of International Conference on Computational Intelligence for Modeling, Control and Automation, Vienna, Austria, 2005. 2: 68-74
60. Nazan K, Goldberg D E, Pelikan M. Multi-Objective Bayesian Optimization Algorithm. IlliGAL Report No. 2002009, University of Illinois at Urbana-Champaign, Urbana, Illinois, 2002
61. Pelikan M, Sastry K, Goldberg D E. Multiobjective hBOA, clustering, and scalability. In: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation. New York, USA: ACM Press, 2005. 663-670
62. Li H, Zhang Q, Tsang E P K, Ford J. Hybrid estimation of distribution algorithm for multiobjective Knapsack problem. In: Proceedings of 4th European Conference on Evolutionary Computation in Combinatorial Optimization. Coimbra, Portugal: 2004, 145-154
63. Laumanns M, Ocenasek J. Bayesian optimization algorithms for multi-objective optimization. In: Proceedings of the 7th International Conference on Parallel Problem Solving from Nature. London, UK: Springer-Verlag, 2002. 298-307
64. Thierens D, Bosman P A N. Multi-objective mixture-based iterated density estimation evolutionary algorithms. In: Proceedings of Genetic and Evolutionary Computation Conference. San Francisco, USA: Morgan Kaufmann, 2001. 663-670
65. Bosman P A N, Thierens D. Multi-objective optimization with the naive MIDEA. In: Towards a New Evolutionary Computation. Advances in Estimation of Distribution Algorithms. Springer-Verlag, Berlin: 2006. 123-157
66. Peňa J M, Lozano J A, Larran̈aga P. Globally multimodal problem optimization via an estimation of distribution algorithm based on unsupervised learning of Bayesian networks. Evolutionary Computation, 2005, 13(1): 43-66
67. Lozano J A, Sagarna R, Larrañaga P. Parallel estimation of distribution algorithms. In: Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation. Boston: Kluwer Academic Publishers, 2002. 125-142
68. Mendiburu A, Miguel-Alonso J, Lozano J A. Implementation and performance evaluation of a parallelization of estimation of Bayesian networks algorithms. Parallel Processing Letters, 16(1), 133-148
69. Jiři O, Josef S. The parallel Bayesian optimization algorithm. In: Proceedings of the European Symposium on Computational Inteligence. Košice, SK, Springer, 2000. 61-67
70. Pelikan M, Mühlenbein H. The bivariate marginal distribution algorithm. In: Advances in Soft Computing-Engineering Design and Manufacturing. London: Springer-Verlag, 1998. 521-535
71. Alba E, Troya J M. A survey of parallel distributed genetic algorithms. Complexity, John Willey and Sons, Inc, 1999, 4(4): 31-52
72. Julio M, Enrique A, Alberto O. A parallel island model for estimation of distribution algorothms. Studies in Fuzziness and Soft Computing, 2006, 192: 159-186
73. Pelikan M, Sastry K, Goldberg D E. Sporadic model building for efficiency enhancement of hBOA. In: Proceedings of Genetic and Evolutionary Computation Conference, ACM Press, 2006. 405-412
74. Baluja S. Using a priori knowledge to create probabilistic models for optimization. International Journal of Approximate Reasoning, 2002, 31(3): 193-220
75. Wright A, Pulavarty S. On the convergence of an estimation of distribution algorithm based on linkage discovery and factorization. In: Proceedings of Genetic and Evolutionary Computation Conference. ACM Press, 2005. 695-702
76. Leonardo R E, Traleski R, Pozo A. Using prior knowledge to improve the performance of an estimation of distribution algorithm applied to feature selection. In: Proceedings of the Fifth International Conference on Hybrid Intelligent Systems. IEEE, 2005. 393-398
77. Tsutsui S, Pelikan M, Ghosh A. Edge histogram based sampling with local search for solving permutation problems. The International Journal of Hybrid Intelligent Systems, 2006, 3(1): 11-22
78. Bosman P A N, Thierens D. Permutation optimization by iterated estimation of random keys marginal product factorizations. In: Proceedings of the 7th International Conerence on Parallel Problem Solving from Nature-PPSN VII. Granada, Spain: Springer Berlin Heidelberg, 2002. 331-340
79. Aickelin U, Li Jing-Peng. An estimation of distribution algorithm for nurse scheduling. Annals of OR, to be published
80. Simionescu P A, Beale D G, Dozier G V. Teeth-number synthesis of a multispeed planetary transmission using an estimation of distribution algorithm. Journal of Mechanical Design, 2006, 128(1): 108-115
81. I.Inza P, Larrañaga P, Etxeberria B S. Feature subset selection by Bayesian network-based optimization. Artificial Intelligence, 2000, 123(1-2): 157-184
82. Cesar R M, Bengoetxea E, Bloch I, Larrañaga P. Inexact graph matching for model-based recognition: Evaluation and comparison of optimization algorithms. Pattern Recognition, 2005, 38(11): 2099-2113
83. Sagarna R, Lozano J. On the performance of estimation of distribution algorithms applied to software testing. Applied Artificial Intelligence, 2005, 19(5): 457-489
84. Blanco R, Larrañaga P, Inza I. Gene selection for cancer classification using wrapper approaches. International Journal of Pattern Recognition and Artificial Intelligence, 2004, 18(8): 1373-1390
85. Saeys Y, Degroeve S, Aeyels D, van de Peer Y, Rouzé P. Fast feature selection using a simple estimation of distribution algorithm: a case study on splice site prediction. Bioinformatics, 2003, 19(s2): 179-188
86. Santarelli S, Yu T, Goldberg D E, Altshuler E, O'Donnell T, Southall H. Military antenna design using simple and competent genetic algorithms. Mathematical and Computer Modelling, 2006, 43(9-10): 990-1022
87. Yang X, Birkfellner W, Niederer P. Optimized 2D/3D medical image registration using the estimation of multivariate normal algorithm (EMNA). In: Proceedings of Biomedical Engineering, Innsbruck, Austria, 2005, 163-168
88. Joaquin R, Roberto S. Improving the discovery component of classifier systems by the application of estimation of distribution algorithms. In: Proceedings of the Students Sessions, ACAI'99. Chania, Greece, 1999. 43-44
89. Zhang Q, Sun J, Tsang E P K, Ford J. Combination of guided local search and estimation of distribution algorithm for solving quadratic assignment problem. In: Proceedings of the Brid of a Feather Workshops, Genetic and Evolutionary Computation Conference. Berlin: Springer-Verlag, 2004. 42-48
90. Cantú-Paz E. Pruning neural networks with distribution estimation algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference GECCO 2003. Berlin: Springer-Verlag, 2003. 790-800