Probabilistic modeling for continuous EDA with Boltzmann selection and Kullback-Leibeler divergence

GECCO 2006 - Genetic and Evolutionary Computation Conference

Volumn 1, Issue , 2006, Pages 389-396

  Yunpeng, Cai ^a   Xiaomin, Sun ^a   Peifa, Jia ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Boltzmann Selection; Continuous Optimization; Estimation of Distribution Algorithms; Evolutionary Computation

Indexed keywords

BENCHMARKING; MATHEMATICAL MODELS; MATRIX ALGEBRA;

ADAPTIVE PARAMETERS; BOLTZMANN DISTRIBUTIONS; BOLTZMANN SELECTION; CONTINUOUS OPTIMIZATION; DISTRIBUTION ALGORITHMS; GAUSSIAN MODELS;

EVOLUTIONARY ALGORITHMS;

EID: 33750253981     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1143997.1144070     Document Type: Conference Paper

References (30)

1. S. Baluja. Population Based Incremental Learning - A Method for Integrating Genetic Search Based Function Optimisation and Competitive Learning. Technical Report CMU-CS-94-163, CMU, Jun. 1994.
2. A. Berny. An Adaptive Scheme for Real Function Optimization Acting As a Selection Operator. In First IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks, pages 140-149. IEEE, 2000.
3. A. Berny. Selection and Reinforcement Learning for Combinatorial Optimization. In Parallel Problem Solving from Nature - PPSN VI, pages 601-610. Springer Verlag, 2000.
4. A. Berny. Statistical Machine Learning and Combinatorial Optimization. In Theoretical Aspects of Evolutionary Computation, pages 287-306. Springer Verlag, 2001.
5. P. Bosman and J. Grahl. Matching Inductive Search Bias and Problem Structure in Continuous Estimation of Distribution Algorithms. Technical Report 03/2005, Dept. of Logistics, Mannheim Business School, 2005.
6. P. Bosman and D. Thierens. Mixed IDEAs. Technical Report UU-CS-2000-45, Utrech University, 1999.
7. P. Bosman and D. Thierens. Expanding from Discrete to Continuous Estimation of Distribution Algorithms: The IDEA. In Parallel Problem Solving from Nature -PPSN VI, pages 767-776, Paris, France, Sep. 2000. Springer-Verlag.
8. T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley, 1991.
9. M. Gallagher. Multi-layer Perceptron Error Surfaces: Visualization, Structure and Modelling. PhD thesis, University of Queensland, 2002.
10. M. Gallagher and M. Frean. Population-Based Continuous Optimization, Probabilistic Modelling and Mean Shift. Evolutionary Computation, 13(1):29-42, 2005.
11. C. Gonzalez, J. Lozano, and P. Larrañaga. Mathematical Modelling of UMDAc Algorithm with Tournament Selection: Behaviour on Linear and Quadratic' Functions. International Journal of Approximate Reasoning, 31(2):313-340, 2002.
12. J. Grahl, S. Minner, and F. Rothlauf. Behaviour of UMDAc with Truncation Selection on Monotonous Functions. In The 2005 IEEE Congress on Evolutionary Computation, pages 2553-2559, Edinburgh, Scotland, 2005. IEEE.
13. P. Larrañaga, R. Etxeberria, J. A. Lozano, and J. M. Peña. Optimization in Continuous Domains by Learning and 'Simulation of Gaussian Networks. In Proceedings of the GECCO-2000 Workshop in Optimization by Building and Using Probabilistic Models, pages 201-204, San Francisco, CA, USA, 2001. Morgan Kaufmann.
14. P. Larrañaga and J. Lozano. Estimation of Distribution Algorithms, A New Tool for Evolutionary Computation. Kluwer Academic Publishers, 2002.
15. P. Larrañaga, J. A. Lozano, and E. Bengoetxea. Estimation of Distribution Algorithms based on Multivariate Normal and Gaussian Networks. Technical Report EHU-KZAA-IK-1-01, University of the Basque Country, 2001.
16. H. Mühlenbein and T. Mahnig. A New Adaptive Boltzmann Selection Schedule SDS. In Proceedings of the 2001 Congress on Evolutionary Computation, 2001., pages 183-190. IEEE, 2001.
17. H. Mühlenbein and T. Mahnig. Evolutionary algorithms and the Boltzmann Distribution. In Foundations of genetic algorithms (FOGA-7), pages 133-150. Morgan Kaufmann, 2003.
18. H. Mühlenbein, T. Mahnig, and A. O. Rodriguez. Schemata, Distributions and Graphical Models in Evolutionary Optimization. Journal of Heuristics, 5:215-247, 1999.
19. H. Mühlenbein. The Equation for Response to Selection and Its Use for Prediction. Evolutionary Computation, 5(3):303-346, 1997.
20. J. Oceanasek and J. Schwarz. Estimation of Distribution Algorithm for Mixed Continuous-discrete Optimization Problems. In 2nd Euro-International Symposium on Computational Intelligence, pages 227-232, Kosice, Slowakia, 2002. IOS Press.
21. J. Ocenasek, S. Kern, N. Hansen, S. Müller, and P. Koumoutsakos. A Mixed Bayesian Optimization Algorithm with Variance Adaptation. In Parallel Problem Solving from Nature - PPSN VIII, pages 352-361. Springer Verlag, 2004.
22. T. Paul and H. Iba. Real-Coded Estimation of Distribution Algorithm. In Proceedings of The Fifth Metaheuristics International Conference, 2003.
23. M. Pelikan. Bayesian Optimization Algorithm: From Single Level to Hierarchy. PhD thesis, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, Urbana, IL. USA, 2002. IlliGAL Report No. 2002023.
24. M. Pelikan, D. Goldberg, and F. Lobo. A Survey to Optimization by Building and Using Probabilistic Models. Computational Optimization and Applications, 21(1):5-20, 2002.
25. M. Pelikan, D. Goldberg, and S. Tsutsui. Getting the Best of Both Worlds: Discrete and Continuous Genetic and Evolutionary Algorithms in Concert. Information Sciences, 156(3-4): 147-171, 2003.
26. S. Rudolf and M. Köppen. Stochastic Hill Climbing by Vectors of Normal Distributions. In Proceedings of the First Online Workshop on Soft Computing, Nagoya, Japan, 1996.
27. M. Sebag and A. Ducoulombier. Extending Population-Based Incremental Learning to Continuous Search Spaces. In Parallel Problem Solving from Nature - PPSN V., pages 418-427, Amsterdam, Netherlands, Sep. 1998. Springer-Verlag.
28. I. Servet, L. Trave-Massuyes, and D. Stern. Telephone Network Traffic Overloading Diagnosis and Evolutionary Techniques. In Proceedings of the Third European Conference on Artificial Evolution, (AE'97), pages 137-144. Springer Verlag, 1997.
29. S. Shin and B.-T. Zhang. Bayesian Evolutionary-Algorithms for Continuous Function Optimization. In Proc. 2001 Congress on Evolutionary Computation, pages 508-515. IEEE, 2001.
30. B. Yuan and M. Gallagher. On the Importance of Diversity Maintenance in Estimation of Distribution Algorithms. In Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, pages 719-726. ACM Press, 2005.