To explore or to exploit: An entropy-driven approach for evolutionary algorithms

International Journal of Knowledge-Based and Intelligent Engineering Systems

Volumn 13, Issue 3-4, 2009, Pages 185-206

  Liu, Shih Hsi ^a   Mernik, Marjan ^b   Bryant, Barrett R ^c  

^a UNIVERSITY OF ALABAMA AT BIRMINGHAM   (United States)

^b UNIVERSITY OF MARIBOR   (Slovenia)

^c CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

Entropy; Evolutionary algorithms; Exploitation; Exploration; Genetic algorithms; Parameter control

Indexed keywords

EID: 85013568026     PISSN: 13272314     EISSN: 18758827     Source Type: Journal    
DOI: 10.3233/KES-2009-0184     Document Type: Article

References (49)

1. L. Altenberg, N.K. Fitness Landscapes, Handbook of Evolutionary Computation, Institute of Physics Press, 1996.
2. H.B. Amor and A. Rettinger, Intelligent Exploration for Genetic Algorithms: Using Self-Organizing Maps in Evolutionary Computation, Genetic and Evolutionary Computation Conf., pp. 1531-1538, 2005.
3. T. Bäck, Selective Pressure in Evolutionary Algorithms: A Characterization of Selection Mechanisms, 1st Conf. on Evolutionary Computing, pp. 57-62, 1994.
4. T. Bäck, D.B. Fogel and Z. Michalewicz, Handbook of Evolutionary Computation, University of Oxford Press, 1996.
5. T. Bäck and H.-P. Schwefel, Evolution Strategies I: Variants and Their Computational Implementation, Genetic Algorithms in Engineering and Computer Science, John Wiley & Sons, 1995.
6. J. Brest, S. Greiner, B. Boskovic, M. Mernik and V. Zumer, Self-Adapting Control Parameters in Differential Evolution:A Comparative Study on Numerical Benchmark Problems, IEEE Trans on Evolutionary Computations 10(6) (2006), 646-657.
7. E. Burke, S. Gustafson, G. Kendall and N. Krasnogor, Advanced Population Diversity Measures in Genetic Programming, Parallel Problem Solving from Nature - PPSN VII, Springer Verlag LNCS 2439: 341-350, 2002.
8. N. Chaiyaratana, T. Piroonratana and N. Sangkawelert, Effects of Diversity Control in Single-Objective and Multi-Objective Genetic Algorithms, Journal of Heuristics 13 (2007), 1-34.
9. K. De Jong, The Analysis of the Behavior of a Class of Genetic Adaptive Systems, Ph.D. thesis, Dept. of Computer Science, University of Michigan, Ann Arbor, 1975.
10. D. Dumitrescu, B. Lazzerini, L.C. Jain and A. Dumitrescu, Evolutionary Computation, CRC Press, 2007.
11. A. Eiben, R. Hinterding and Z. Michalewicz, Parameter Control in Evolutionary Algorithms, IEEE Trans on Evolutionary Computation 3(2) (1999), 124-141.
12. A. Eiben, E. Marchiori and V.A. Valko, Evolutionary Algorithms with on-the-fly Population Size Adjustment, Parallel Problem Solving from Nature - PPSN VIII, Springer Verlag LNCS 3242: 41-50, 2004.
13. A. Eiben and C. Schippers, On Evolutionary Exploration and Exploitation, Fundamenta Informaticae 35 (1998), 35-50.
14. L. Eschelman and J. Schaffer, Preventing Premature Convergence in Genetic Algorithms by Preventing Incest, 4th Intl. Conf. on Genetic Algorithms, pp. 115-122, 1991.
15. T.C. Fogarty, Varying the Probability of Mutation in the Genetic Algorithm, 3rd Intl. Conf. on Genetic Algorithms, pp. 104-109, 1989.
16. M. Gallagher and B. Yuan, A General-Purpose Tunable Landscape Generator, IEEE Trans on Evolutionary Computation 10(5) (2006), 590-602.
17. K.S. Goh, A. Lim and B. Rodrigues, Sexual Selection for Genetic Algorithms, Artificial Intelligence Review 19 (2003), 123-152.
18. D.A. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison-Wesley, 1989.
19. J.J. Grefenstette, Optimization of Control Parameters for Genetic Algorithms, IEEE Trans on Systems, Man&Cybernetics, SMC-16(1) (1986), 122-128.
20. T. Grüninger, Multimodal Optimization using Genetic Algorithms, Master Thesis, Stuttgart University, 1996.
21. J. Han and M. Kamber, Data Mining: Concepts and Techniques, Morgan Kaufmann, 2001.
22. G. Harik, Finding Multimodal Solutions Using Restricted Tournament Selection, 6th Intl. Conf. on Genetic Algorithms, pp. 24-31, 1995.
23. G. Harik and F. Lobo, A Parameter-less Genetic Algorithm. Technical Report IlliGAL 9900, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, 1999.
24. T.-Y. Huang and Y.-Y, Chen, Diversity-based Selection Pooling Scheme in Evolution Strategies, 16th ACM Symposium on Applied Computing, pp. 351-355, 2001.
25. T. Kohonen, M. Kohonen, R. Schroeder and T.S. Huang, Self-Organizing Maps, Springer-Verlag, 2001.
26. C.-Y. Lee, Entropy-Boltzmann Selection in the Genetic Algorithms, IEEE Trans on Systems Man and Cybernetics 33(1) (2003), 138-142.
27. S.-H. Liu, QoSPL: A Quality of Service-Driven Software Product Line Engineering Framework for Design and Analysis of Component-Based Distributed Real-Time and Embedded Systems, Ph.D. thesis, Dept. of Computer and Information Sciences, University of Alabama at Birmingham, 2007.
28. S.-H. Liu, M. Mernik and B.R. Bryant, Parameter Control in Evolutionary Algorithms by Domain-Specific Scripting Language PPCEA, 1st Intl. Conf. on Bioinspired Optimization Methods and their Applications, pp. 41-50, 2004.
29. S.-H. Liu, M. Mernik and B.R. Bryant, Entropy-driven Parameter Control for Evolutionary Algorithms. Informatica:An Intl. Journal of Computing and Informatics 31(1) (2007), 41-50.
30. S.-H. Liu, M. Mernik and B.R. Bryant, A Clustering Entropy-driven Approach for Exploring and Exploiting Noisy Functions, 22nd ACM Symposium on Applied Computing, pp. 738-742, 2007.
31. M. Lozano, F. Herrera and J.R. Cano, Replacement Strategies to Maintain Useful Diversity in Steady-State Genetic Algorithms, Soft Computing: Methodologies and Applications (2005), 85-96.
32. W. Lu and I. Traoré, A New Evolutionary Algorithm for Determining the Optimal Number of Clusters, 17th Intl. Conf. on Tools with Artificial Intelligence, pp. 712-713, 2005.
33. W.N. Martin, J. Lienig and J.P. Cohoon, Island (Migration) Models: Evolutionary Algorithms based on Punctuated Equilibria, in: Evolutionary Computation 2, Chapter 15, T. Bäck et al., eds, Institute of Physics Publishing, Bristol, UK, 2000.
34. M. Mernik, J. Heering and A. Sloane, When and How to Develop Domain-Specific Languages, ACM Computing Surveys 37(4) (2005), 316-344.
35. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, 1996.
36. N. Mori, J. Yoshida, H. Tamaki and H.K. Nishikawa, A Thermodynamical Selection Rule for the Genetic Algorithm, 2nd Intl. Conf. on Evolutionary Computation, pp. 188-192, 1995.
37. PPCEA: A Domain-Specific Language for Evolutionary Algorithms http://www.cis.uab.edu/liush/PPCea.htm.
38. W.H. Press, S.A. Teukolsky, W.T. Vetterling and B.P. Flannery, Numerical Recipes: The Art of Scientific Computing, Cambridge University Press, 2007.
39. C.R. Reeves, Experiments with Tunable Fitness Landscapes, Parallel Problem Solving from Nature - PPSN VII, Springer Verlag LNCS 1917, 139-148, 2000.
40. E. Ronald, When Selection Meets Seduction, 6th Intl. Conf. on Genetic Algorithms, pp. 167-173, 1995.
41. J. Rosca, Entropy-Driven Adaptive Representation, Workshop on Genetic Programming: From Theory to Real-World Applications, pp. 23-32, 1995.
42. J.D. Schaffer, R.A. Caruana, L.J. Eshelman and R. Das, A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization, 3rd Intl. Conf. on Genetic Algorithms, pp. 51-60, 1989.
43. C. Shannon, A Mathematical Theory of Communication, Bell Systems Technical Journal 27 (1958), 379-423, 623-656.
44. H. Shimodaira, A Diversity Control Oriented Genetic Algorithm, 2nd Intl. Conf. on Genetic Algorithms in Engineering Systems: Innovations and Applications, pp. 444-449, 1997.
45. R.E. Smith, Adaptively Resizing Population: Algorithm and Analysis. Technical Report TCGA Report #93001, University of Alabama, 1993.
46. J.E. Smith and T.C. Fogarty, Operator and Parameter Adaptation in Genetic Algorithms, Soft Computing 1(2) (1997), 81-87.
47. R. Ursem, Diversity-Guided Evolutionary Algorithms. Parallel Problem Solving from Nature - PPSN VII, Springer Verlag LNCS 2439 (2002), 462-471.
48. Wikipedia, http://en.wikipedia.org/wiki/Bijection%2C injection and surjection, 2008.
49. X. Yao, Y. Liu and G. Lin, Evolutionary Programming Made Faster, IEEE Trans on Evolutionary Computation 3(2) (1999), 82-102.