Mateda-2.0: Estimation of distribution algorithms in MATLAB

Journal of Statistical Software

Volumn 35, Issue 7, 2010, Pages 1-30

  Santana, Roberto ^a   Bielza, Concha ^a   Larrañaga, Pedro ^a   Lozano, Jose A ^b   Echegoyen, Carlos ^b   Mendiburu, Alexander ^b   Armañanzas, Rubén ^a   Shakya, Siddartha ^c  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^c BT Innovate ^*

Author keywords

Estimation of distribution algorithms; MATLAB; Optimization; Probabilistic models; Statistical learning

Indexed keywords

EID: 77955170179     PISSN: 15487660     EISSN: 15487660     Source Type: Journal    
DOI: None     Document Type: Article

References (87)

1. Akaike H (1974). "A New Look at the Statistical Identification Model." IEEE Transactions on Automatic Control, pp. 716-723.
2. Armañanzas R (2009). Consensus Policies to Solve Bioinformatic Problems through Bayesian Network Classifiers and Estimation of Distribution Algorithms. Ph.D. thesis, Department of Computer Science and Artificial Intelligence, University of the Basque Country. URL http://www.sc.ehu.es/ccwbayes/members/ruben/RubenPhD.pdf.
3. Armañanzas R, Inza I, Santana R, Saeys Y, Flores JL, Lozano JA, Van de Peer Y, Blanco R, Robles V, Bielza C, Larrañaga P (2008). "A Review of Estimation of Distribution Algorithms in Bioinformatics." BioData Mining, 1(6).
4. Asuncion A, Newman DJ (2007). "UCI Machine Learning Repository." URL http://www.ics.uci.edu/~mlearn/MLRepository.html.
5. Baluja S, Davies S (1997)."Using Optimal Dependency-Trees for Combinatorial Optimization: Learning the Structure of the Search Space." In Proceedings of the 14th International Conference on Machine Learning, pp. 30-38. Morgan Kaufmann, San Francisco, CA.
6. Bengoetxea E (2003). Inexact Graph Matching Using Estimation of Distribution Algorithms. Ph.D. thesis, Ecole Nationale Supérieure des Télécommunications. Paris, France. URL http://www.sc.ehu.es/acwbecae/ikerkuntza/these/.
7. Besag J (2000). "Markov Chain Monte Carlo for Statistical Inference." Working Paper 9, Center for Statistical and Social Science, University of Washington.
8. Bosman PA, Thierens D (2000a). "Expanding from Discrete to Continuous Estimation of Distribution Algorithms: The IDEA." In Parallel Problem Solving from Nature - PPSN VI 6th International Conference. Springer-Verlag, Paris, France. Lecture Notes in Computer Science 1917.
9. Bosman PA, Thierens D (2000b). "IDEAs Based on the Normal Kernels Probability Density Function." Technical Report UU-CS-2000-11, Utrecht University. URL http://www.cs.uu.nl/research/techreps/repo/CS-2000/2000-11.pdf.
10. Bosman PA, Thierens D (2002). "Multi-Objective Optimization with Diversity Preserving Mixture-Based Iterated Density Estimation Evolutionary algorithms." International Journal of Approximate Reasoning, 31(3), 259-289.
11. Brownlee S, McCall J, Zhang Q, Brown D (2008). "Approaches to Selection and Their Effect on Fitness Modelling in an Estimation of Distribution Algorithm." In Proceedings of the 2008 Congress on Evolutionary Computation CEC-2008, pp. 2621-2628. IEEE Press, Hong Kong.
12. Cotta C (2003). "Protein Structure Prediction Using Evolutionary Algorithms Hybridized with Backtracking." In J Mira, JR Alvarez (eds.), Artificial Neural Nets Problem Solving Methods, volume 2687 of Lecture Notes in Computer Science, pp. 321-328. Springer-Verlag.
13. Crescenzi P, Goldman D, Papadimitriou CH, Piccolboni A, Yannakakis M (1998). "On the Complexity of Protein Folding." Journal of Computational Biology, 5(3), 423-466.
14. de la Ossa L, Sastry K, Lobo FG (2006). "χ-ary Extended Compact Genetic Algorithm in C++." IlliGAL Report 2006013, University of Illinois at Urbana-Champaign, Illinois Genetic Algorithms Laboratory, Urbana, IL. URL http://www.illigal.uiuc.edu/pub/papers/IlliGALs/2006013.pdf.
15. Dill KA (1985). "Theory for the Folding and Stability of Globular Proteins." Biochemistry, 24(6),1501-1509.
16. Echegoyen C, Santana R, Lozano JA, Larrañaga P (2008). "The Impact of Probabilistic Learning Algorithms in EDAs Based on Bayesian Networks." In Linkage in Evolutionary Computation, Studies in Computational Intelligence, pp. 109-139. Springer-Verlag.
17. Etxeberria R, Larrañaga P (1999). "Global Optimization Using Bayesian Networks." In A Ochoa, MR Soto, R Santana (eds.), Proceedings of the Second Symposium on Artificial Intelligence (CIMAF-99), pp. 151-173. Havana, Cuba.
18. Everitt B, Hand D (1981). Finite Mixture Distributions. Chapman and Hall, London.
19. Frey BJ, Dueck D (2007). "Clustering by Passing Messages between Data Points." Science, 315,972-976.
20. Geiger D, Heckerman D (1996). "Knowledge Representation and Inference in Similarity Networks and Bayesian Multinets." Artificial Intelligence, 82(1-2), 45-74.
21. Greenwood GW, Shin JM (2002). In GB Fogel, DW Corne (eds.), Evolutionary Computation in Bioinformatics, chapter On the Evolutionary Search for Solutions to the Protein Folding Problem, pp. 115-136. Morgan Kaufmann, San Francisco, CA.
22. Grosset L, Riche R, Haftka RT (2006). "A Double-Distribution Statistical Algorithm for Composite Laminate Optimization." Structural and Multidisciplinary Optimization, 31(1), 49-59.
23. Hart WE, Istrail SC (1996). "Fast Protein Folding in the Hydrophobic-Hydrophilic Model within Three-Eights of Optimal." Journal of Computational Biology, 3(1), 53-96.
24. Hauschild M, Pelikan M, Lima C, Sastry K (2007). "Analyzing Probabilistic Models in Hierarchical BOA on Traps and Spin Glasses." In D Thierens et al (ed.), Proceedings of the Genetic and Evolutionary Computation Conference GECCO-2007, volume I, pp. 523-530. ACM Press, London, UK.
25. Hauschild M, Pelikan M, Sastry K, Goldberg DE (2008). "Using Previous Models to Bias Structural Learning in the Hierarchical BOA." MEDAL Report No. 2008003, Missouri Estimation of Distribution Algorithms Laboratory (MEDAL). URL http://medal.cs.umsl.edu/files/2008003.pdf.
26. Henrion M (1988). "Propagating Uncertainty in Bayesian Networks by Probabilistic Logic Sampling." In JF Lemmer, LN Kanal (eds.), Proceedings of the Second Annual Conference on Uncertainty in Artificial Intelligence, pp. 149-164. Elsevier.
27. Holland JH (1975). Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. University of Michigan Press, Ann Arbor, MI.
28. Hong ZQ, Yang JY (1991). "Optimal Discriminant Plane for a Small Number of Samples and Design Method of Classifier on the Plane." Pattern Recognition, 24(4), 317-324.
29. Hu L, Zhou C, Sun Z (2006). "Biped Gait Optimization Using Spline Function Based Probability Model." In Proceedings of the 2006 IEEE International Conference on Robotics and Automation, pp. 830-835. Orlando, Florida.
30. Inselberg A (2009). Parallel Coordinates: Visual Multidimensional Geometry and Its Applications. Springer-Verlag, New York.
31. Inza I, Larrañaga P, Sierra B (2002). Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation, chapter Feature Subset Selection by Estimation of Distribution Algorithms, pp. 265-290. Kluwer Academic Publishers, London.
32. Johnson SC (1967). "Hierarchical Clustering Schemes." Psychometrika, 2, 241-254.
33. Kindermann R, Snell JL (1980). Markov Random Fields and Their Applications. American Mathematical Society, Providence, Rhode Island.
34. Kirkpatrick S, Gelatt CDJ, Vecchi MP (1983). "Optimization by Simulated Annealing." Science, 220, 671-680.
35. Krasnogor N, Hart WE, Smith J, Pelta DA (1999). "Protein Structure Prediction with Evolutionary Algorithms." In W Banzhaf, J Daida, AE Eiben, MH Garzon, V Honavar, M Jakiela, RE Smith (eds.), Proceedings of the Genetic and Evolutionary Computation Conference, volume 2, pp. 1596-1601. Morgan Kaufmann, San Francisco, CA.
36. Larrañaga P (2002). Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation, chapter A Review on Estimation of Distribution Algorithms, pp. 55-98. Kluwer Academic Publishers, Boston/Dordrecht/London.
37. Larrañaga P, Calvo B, Santana R, Bielza C, Galdiano J, Inza I, Lozano JA, Armañanzas R, Santafé G, Pérez A, Robles V (2006). "Machine Learning in Bioinformatics." Briefings in Bioinformatics, 7, 86-112.
38. Larrañaga P, Etxeberria R, Lozano JA, Peña JM (1999). "Optimization by Learning and Simulation of Bayesian and Gaussian Networks." Technical Report EHU-KZAA-IK-4/99, Department of Computer Science and Artificial Intelligence, University of the Basque Country.
39. Larrañaga P, Lozano JA (eds.) (2002). Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation. Kluwer Academic Publishers, Boston/Dordrecht/London.
40. Lauritzen SL (1996). Graphical Models. Clarendon Press, Oxford.
41. Leray P, Francois O (2004). "BNT Structure Learning Package: Documentation and Experiments." Technical report, Laboratoire PSI, INSA Rouen, FRE CNRS 2645. URL http://bnt.insa-rouen.fr/programmes/BNT_StructureLearning_v1.3.pdf.
42. Lima CF, Pelikan M, Goldberg DE, Lobo FG, Sastry K, Hauschild M (2007). "Influence of Selection and Replacement Strategies on Linkage Learning in BOA." In Proceedings of the 2007 Congress on Evolutionary Computation CEC-2007, pp. 1083-1090. IEEE Press.
43. Mateo JL, de la Ossa L (2007). "LiO an Easy and Flexible Library of Metaheuristics." Technical Report DIAB-06-04-1, Department of Computing Systems, Escuela Politecnica Superior de Castilla La Mancha, Albacete, Spain.
44. Meila M, Jordan MI (2000). "Learning with Mixtures of Trees." Journal of Machine Learning Research, 1, 1-48.
45. Mendiburu A, Miguel-Alonso J, Lozano JA, Ostra M, Ubide C (2006). "Parallel EDAs to Create Multivariate Calibration Models for Quantitative Chemical Applications." Journal of Parallel Distributed Computation, 66(8), 1002-1013.
46. Metropolis N, Rosenbluth A, Teller A, Teller E (1953). "Equations of State Calculations by Fast Computing Machines." Journal of Chemical Physics, 21(6), 1087-1091.
47. Mühlenbein H (1997). "The Equation for Response to Selection and Its Use for Prediction." Evolutionary Computation, 5(3), 303-346.
48. Mühlenbein H, Höns R (2005). "The Estimation of Distributions and the Minimum Relative Entropy Principle." Evolutionary Computation, 13(1), 1-27.
49. Mühlenbein H, Mahnig T (2001). "Evolutionary Synthesis of Bayesian Networks for Optimization." In M Patel, V Honavar, K Balakrishnan (eds.), Advances in Evolutionary Synthesis of Intelligent Agents, pp. 429-455. MIT Press, Cambridge, Mass.
50. Mühlenbein H, Mahnig T, Ochoa A (1999). "Schemata, Distributions and Graphical Models in Evolutionary Optimization." Journal of Heuristics, 5(2), 213-247.
51. Mühlenbein H, Paaß G (1996). "From Recombination of Genes to the Estimation of Distributions I. Binary Parameters." In HM Voigt, W Ebeling, I Rechenberg, HP Schwefel (eds.), Parallel Problem Solving from Nature - PPSN IV, volume 1141 of Lectures Notes in Computer Science, pp. 178-187. Springer-Verlag, Berlin.
52. Murphy K (2001). "The Bayes Net Toolbox for MATLAB." Computer Science and Statistics: Proceedings of Interface, 33, 331-350. URL http://code.google.com/p/bnt/.
53. Nilsson D (1998). "An Efficient Algorithm for Finding the M Most Probable Configurations in Probabilistic Expert Systems." Statistics and Computing, 2, 159-173.
54. Pearl J (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Mateo, California.
55. Pelikan M (2000). "The Bayesian Optimization Algorithm (BOA) with Decision Graphs." IlliGAL Report No. 2000025, University of Illinois at Urbana-Champaign, Illinois Genetic Algorithms Laboratory, Urbana, IL. URL http://www.illigal.uiuc.edu/pub/papers/IlliGALs/2000025.ps.Z.
56. Pelikan M (2005). Hierarchical Bayesian Optimization Algorithm. Toward a New Generation of Evolutionary Algorithms, volume 170 of Studies in Fuzziness and Soft Computing. Springer-Verlag, New York.
57. Pelikan M, Goldberg DE (2000). "Genetic Algorithms, Clustering, and the Breaking of Symmetry." In M Schoenauer, K Deb, G Rudolph, X Yao, E Lutton, JJ Merelo, HP Schwefel (eds.), Parallel Problem Solving from Nature - PPSN VI 6th International Conference, pp. 385-394. Springer-Verlag, Paris, France. Lecture Notes in Computer Science 1917.
58. Pelikan M, Goldberg DE, Cantú-Paz E (1999)."BOA: The Bayesian Optimization Algorithm." In W Banzhaf, J Daida, AE Eiben, MH Garzon, V Honavar, M Jakiela, RE Smith (eds.), Proceedings of the Genetic and Evolutionary Computation Conference GECCO-1999, volume I, pp. 525-532. Morgan Kaufmann Publishers, San Francisco, CA.
59. Pelikan M, Mühlenbein H (1999). "The Bivariate Marginal Distribution Algorithm." In R Roy, T Furuhashi, PK Chawdhry (eds.), Advances in Soft Computing - Engineering Design and Manufacturing, pp. 521-535. Springer-Verlag, London.
60. Pelikan M, Sastry K, Goldberg DE (2006). "Implementation of the Dependency-Tree Estimation of Distribution Algorithm in C++." MEDAL Report No. 2006010, Missouri Estimation of Distribution Algorithms Laboratory (MEDAL). URL http://medal.cs.umsl.edu/files/2006010.pdf.
61. Pereira FB, Machado P, Costa E, Cardoso A, Ochoa A, Santana R, Soto MR (2000). "Too Busy to Learn." In Proceedings of the 2000 Congress on Evolutionary Computation CEC2000, pp. 720-727. IEEE Press, La Jolla Marriott Hotel La Jolla, California, USA.
62. Polat K, Günes S (2008). "Computer Aided Medical Diagnosis System Based on Principal Component Analysis and Artificial Immune Recognition System Classifier Algorithm." Expert Systems with Applications, 34(1), 773-779.
63. Santana R (2005). "Estimation of Distribution Algorithms with Kikuchi Approximations." Evolutionary Computation, 13(1), 67-97.
64. Santana R, Echegoyen C (2009)."MATLAB Toolbox for Estimation of Distribution Algorithms (Mateda-2.0)." URL http://www.sc.ehu.es/ccwbayes/members/rsantana/software/matlab/MATEDA.html.
65. Santana R, Echegoyen C, Mendiburu A, Bielza C, Lozano JA, Larrañaga P, Armañanzas R, Shakya S (2009a). "MATEDA: A Suite of EDA Programs in MATLAB." Technical Report EHU-KZAA-IK-2/09, Department of Computer Science and Artificial Intelligence, University of the Basque Country. URL http://www.sc.ehu.es/ccwbayes/technical.htm.
66. Santana R, Larrañaga P, Lozano JA (2006). "Mixtures of Kikuchi Approximations." In J Fürnkranz, T Scheffer, M Spiliopoulou (eds.), Proceedings of the 17th European Conference on Machine Learning: ECML 2006, volume 4212 of Lecture Notes in Artificial Intelligence, pp. 365-376. Springer-Verlag.
67. Santana R, Larrañaga P, Lozano JA (2008a). "Adaptive Estimation of Distribution Algorithms." In C Cotta, M Sevaux, K Sörensen (eds.), Adaptive and Multilevel Metaheuristics, volume 136 of Studies in Computational Intelligence, pp. 177-197. Springer-Verlag.
68. Santana R, Larrañaga P, Lozano JA (2008b). "Protein Folding in Simplified Models with Estimation of Distribution Algorithms." IEEE Transactions on Evolutionary Computation, 12(4),418-438.
69. Santana R, Larrañaga P, Lozano JA (2009b). "Learning Factorizations in Estimation of Distribution Algorithms Using Affinity Propagation." Evolutionary Computation. Accepted for publication.
70. Santana R, Larrañaga P, Lozano JA (2009c). "Research Topics on Discrete Estimation of Distribution Algorithms." Memetic Computing, 1(1), 35-54.
71. Santana R, Ochoa A, Soto MR (2001). "The mixture of Trees Factorized Distribution Algorithm." In L Spector, E Goodman, A Wu, W Langdon, H Voigt, M Gen, S Sen, M Dorigo, S Pezeshk, M Garzon, E Burke (eds.), Proceedings of the Genetic and Evolutionary Computation Conference GECCO-2001, pp. 543-550. Morgan Kaufmann Publishers, San Fran- cisco, CA.
72. Sastry K, Pelikan M, Goldberg DE (2006). "Efficiency Enhancement of Estimation of Distribution Algorithms." In M Pelikan, K Sastry, E Cantú-Paz (eds.), Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications, Studies in Computational Intelligence, pp. 161-186. Springer-Verlag.
73. Schwarz G (1978). "Estimating the Dimension of a Model." The Annals of Statistics, 7(2), 461-464.
74. Shachter R, Kenley C (1989). "Gaussian Influence Diagrams." Management Science, 35, 527-550.
75. Shakya S, McCall J (2007). "Optimization by Estimation of Distribution with DEUM Framework Based on Markov Random Fields." International Journal of Automation and Computing, 4(3), 262-272.
76. Shakya S, McCall J, Brown D (2005). "Using a Markov Network Model in a Univariate EDA: An Empirical Cost-Benefit Analysis." In HG Beyer, UM O'Reilly (eds.), Proceedings of Genetic and Evolutionary Computation Conference GECCO-2005, pp. 727-734. ACM Press, Washington, D.C.
77. Shakya S, Santana R (2008). "An EDA Based on Local Markov Property and Gibbs Sampling." In M Keijzer (ed.), Proceedings of the 2008 Genetic and Evolutionary Computation Conference (GECCO), pp. 475-476. ACM, New York.
78. Silander T, Myllymaki P (2006). "A Simple Approach for Finding the Globally Optimal Bayesian Network Structure." In Proceedings of the 22th Annual Conference on Uncertainty in Artificial Intelligence (UAI-2006), pp. 445-452. Morgan Kaufmann Publishers, San Francisco, CA.
79. Simionescu PA, Beale D, Dozier GV (2007). "Teeth-Number Synthesis of a Multispeed Planetary Transmission Using an Estimation of Distribution Algorithm." Journal of Mechanical Design, 128(1), 108-115.
80. Spirtes P, Glymour C, Scheines R (1993). Causation, Prediction and Search, volume 81 of Lecture Notes in Statistics. Springer-Verlag, New York.
81. The MathWorks, Inc (2007). MATLAB - The Language of Technical Computing, Version 7.5. The MathWorks, Inc., Natick, Massachusetts. URL http://www.mathworks.com/products/matlab/.
82. Tierney L (1994). "Markov Chains for Exploring Posterior Distributions." The Annals of Statistics, 22, 1701-1762.
83. Troyanskaya O, Cantor M, Sherlock G, Brown P, Hastie T, Tibshirani R, Botstein D, Altman RB (2001). "Missing Value Estimation Methods for DNA Microarrays." Bioinformatics, 17(6),520-525.
84. Ward MO (2002). "A Taxonomy of Glyph Placement Strategies for Multidimensional Data Visualization." Information Visualization, 1(3/4), 194-210.
85. Yuan B, Orlowska ME, Sadiq SW (2007)."Finding the Optimal Path in 3D Spaces Using EDAs - The Wireless Sensor Networks Scenario." In B Beliczynski, A Dzielinski, M Iwanowski, B Ribeiro (eds.), Adaptive and Natural Computing Algorithms, 8th International Conference, ICANNGA 2007, Warsaw, Poland, April 11-14, 2007, Proceedings, Part I, volume 4431 of Lecture Notes in Computer Science, pp. 536-545. Springer-Verlag.
86. Zhang Q, Li H (2007). "MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition." IEEE Transactions on Evolutionary Computation, 11(6), 712-731.
87. Zhang Q, Zhou A, Jin Y (2008). "RM-MEDA: A Regularity Model Based Multiobjective Estimation of Distribution Algorithm." IEEE Transactions on Evolutionary Computation, 12(1),41-63.