Transforming evolutionary search into higher-level evolutionary search by capturing problem structure

IEEE Transactions on Evolutionary Computation

Volumn 18, Issue 5, 2014, Pages 628-642

  Mills, Rob ^a   Jansen, Thomas ^b   Watson, Richard A ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b ABERYSTWYTH UNIVERSITY   (United Kingdom)

Author keywords

Automatic problem decomposition; evolutionary computation; linkage learning; modularity; scalability

Indexed keywords

SCALABILITY;

AUTOMATIC PROBLEM DECOMPOSITION; EVOLUTIONARY SEARCH; LINKAGE LEARNING; MODULARITY; PROBLEM STRUCTURE;

EVOLUTIONARY ALGORITHMS;

EID: 84907851946     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2014.2347702     Document Type: Article

References (71)

1. W. T. McCormick, Jr., P. J. Schweitzer, and T. W. White, "Problem decomposition and data reorganization by a clustering technique," Oper. Res., vol. 20, no. 5, pp. 993-1009, 1982.
2. D. Smith, "Top-down synthesis of divide-and-conquer algorithms," Artif. Intell., vol. 27, no. 1, pp. 43-96, 1985.
3. H. A. Simon, The Sciences of the Artificial. Cambridge, MA, USA: MIT Press, 1969.
4. D. Michie, "Memo functions and machine learning," Nature, vol. 218, pp. 19-22, Apr. 1968.
5. J. E. Laird, P. S. Rosenbloom, and A. Newell, "Chunking in soar: The anatomy of a general learning mechanism," Mach. Learn., vol. 1, no. 1, pp. 11-46, 1986.
6. R. Bellman, Dynamic Programming. Princeton, NJ, USA: Princeton Univ. Press, 1957.
7. J. A. Walker and J. F. Miller, "The automatic acquisition, evolution and reuse of modules in Cartesian genetic programming," IEEE Trans. Evol. Comput., vol. 12, no. 4, pp. 397-417, Aug. 2008.
8. M. A. Potter and K. A. De Jong, "Cooperative coevolution: An architecture for evolving coadapted subcomponents," Evol. Comput., vol. 8, no. 1, pp. 1-29, 2000.
9. Q. Zhang and H. Li, "MOEA/D: A multiobjective evolutionary algorithm based on decomposition," IEEE Trans. Evol. Comput., vol. 11, no. 6, pp. 712-731, Dec. 2007.
10. J. H. Holland, Adaptation in Natural and Artificial Systems. Ann Arbor, MI, USA: Univ. Michigan Press, 1975.
11. D. Goldberg, Genetic Algorithm in Search, Optimization and Machine Learning. Reading, MA, USA: Addison-Wesley, 1989.
12. M. Mitchell, S. Forrest, and J. H. Holland, "The royal road for genetic algorithms: Fitness landscapes and GA performance," in Proc. 1st Eur. Conf. Artif. Life (ECAL), 1992, pp. 245-254.
13. R. A. Watson, G. S. Hornby, and J. B. Pollack, "Modelling buildingblock interdependency," in Parallel Problem Solving from Nature-V. Berlin, Germany: Springer, 1998, pp. 97-106.
14. R. A. Watson and T. Jansen, "A building-block royal road where crossover is provably essential," in Proc. 9th Annu. Conf. Genet. Evol. Comput., 2007, pp. 1452-1459.
15. R. Mills, "How micro-evolution can guide macro-evolution: Multi-scale search via evolved modular variation," Ph.D. dissertation, Dept. Electron. Comput. Sci., Univ. Southampton, Southampton, U.K., 2010.
16. R. A. Watson, R. Mills, and C. Buckley, "Transformations in the scale of behaviour and the global optimisation of constraints in adaptive networks," Adapt. Behav., vol. 19, no. 4, pp. 227-249, 2011.
17. D. Iclanzan and D. Dumitrescu, "Overcoming hierarchical difficulty by hill-climbing the building block structure," in Proc. 9th Annu. Conf. Genet. Evol. Comput., 2007, pp. 1256-1263.
18. J. Houdayer and O. C. Martin, "A hierarchical approach for computing spin glass ground states," Phys. Rev. E, vol. 64, no. 5, p. 056704, 2001.
19. K. Mahdavi, M. Harman, and R. M. Hierons, "A multiple hill climbing approach to software module clustering," in Proc. IEEE Conf. Softw. Maint., 2003, pp. 315-324.
20. D. Thierens, "The linkage tree genetic algorithm," in Proc. 11th Int. Conf. Parallel Probl. Solving Nat. (PPSN XI), 2010, pp. 264-273.
21. T. Gross and B. Blasius, "Adaptive coevolutionary networks: A review," J. Roy. Soc. Interface, vol. 5, no. 20, pp. 259-271, 2008.
22. D. Iclanzan and D. Dumitrescu, "Towards memoryless model building," in Proc. 10th Annu. Conf. Companion Genet. Evol. Comput., 2008, pp. 2147-2152.
23. R. Mills, R. A. Watson, and C. Buckley, "Emergent associative memory as a local organising principle for global adaptation in adaptive networks," in Proc. 8th Int. Conf. Complex Syst. (ICCS), Boston, MA, USA, 2011, pp. 417-430.
24. R. A. Watson, C. Buckley, and R. Mills, "Optimisation in 'selfmodelling' complex adaptive systems," Complexity, vol. 16, no. 5, pp. 17-26, 2010.
25. R. A. Watson, R. Mills, and C. Buckley, "Global adaptation in networks of selfish components: Emergent associative memory at the system scale," Artif. Life, vol. 17, no. 3, pp. 147-166, 2011.
26. R. A. Watson, "Compositional evolution: Interdisciplinary investigations in evolvability, modularity, and symbiosis," Ph.D. dissertation, Dept. Comput. Sci., Brandeis Univ., Waltham, MA, USA, 2002.
27. K. Deb and D. E. Goldberg, "Analyzing deception in trap functions," in Foundations of Genetic Algorithms 2, L. D. Whitley, Ed. San Mateo, CA, USA: Morgan Kaufmann, 1993, pp. 93-108.
28. D. Goldberg, K. Sastry, and T. Latoza, "On the supply of building blocks," in Proc. Genet. Evol. Comput. Conf. (GECCO), San Francisco, CA, USA, 2001, pp. 336-342.
29. M. Pelikan, "Bayesian optimisation algorithm: From single level to hierarchy," Ph.D. dissertation, Dept. Comput. Sci., Univ. Illinois, Champaign, IL, USA, 2002.
30. D. Whitley, K. Mathias, S. Rana, and J. Dzubera, "Building better test functions," in Proc. Int. Conf. Genet. Algorithms, 1995, pp. 239-246.
31. T. Jones, "Crossover, macromutation, and population-based search," in Proc. 6th Int. Conf. Genet. Algorithms, 1995, pp. 73-80.
32. P. Larrañaga and J. Lozano, Eds., Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation. Boston, MA, USA: Kluwer, 2002.
33. M. Pelikan and D. E. Goldberg, "Hierarchical problem solving and the Bayesian optimization algorithm," in Proc. Genet. Evol. Comput. Conf. (GECCO), 2000, pp. 267-274.
34. U. Aickelin, E. K. Burke, and J. Li, "An estimation of distribution algorithm with intelligent local search for rule-based nurse rostering," J. Oper. Res. Soc., vol. 58, pp. 1574-1585, Oct. 2006.
35. M. Pelikan and D. E. Goldberg, "Hierarchical BOA solves Ising spin glasses and MAXSAT," in Proc. Genet. Evol. Comput. Conf. (GECCO), Chicago, IL, USA, 2003, pp. 1271-1282.
36. R. Santana, P. Larrañaga, and J. Lozano, "Protein folding in simplified models with estimation of distribution algorithms," IEEE Trans. Evol. Comput., vol. 12, no. 4, pp. 418-438, Aug. 2008.
37. R. A. Watson, D. Weinrich, and J. Wakerley, "Genome structure and the benefit of sex," Evolution, vol. 65, pp. 523-536, Feb. 2011.
38. R. Impagliazzo, R. Paturi, and F. Zane, "Which problems have strongly exponential complexity?" J. Comput. Syst. Sci., vol. 63, no. 4, pp. 512-530, Dec. 2001.
39. T.-L. Yu and D. E. Goldberg, "Conquering hierarchical difficulty by explicit chunking: Substructural chromosome compression," in Proc. 8th Annu. Conf. Genet. Evol. Comput. (GECCO), 2006, pp. 1385-1392.
40. J. P. Rosca, "Hierarchical learning with procedural abstraction mechanisms," Ph.D. dissertation, Dept. Comput. Sci., Univ. Rochester, Rochester, NY, USA, 1997.
41. P. Angeline and J. B. Pollack, "Coevolving high-level representations," in Artificial Life III, C. G. Langton, Ed. Boston, MA, USA: Addison- Wesley, 1994, pp. 55-71.
42. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA, USA: MIT Press, 1992.
43. R. A. Watson and J. B. Pollack, "A computational model of symbiotic composition in evolutionary transitions," Biosystems, vol. 69, nos. 2-3, pp. 187-209, 2003.
44. E. D. de Jong, R. A. Watson, and D. Thierens, "On the complexity of hierarchical problem solving," in Proc. 7th Annu. Conf. Genet. Evol. Comput. (GECCO), 2005, pp. 1201-1208.
45. A. Defaweux, "Evolutionary transitions as a metaphor for compositional search," Ph.D. dissertation, Dept. Comput. Sci., Vrije Univ. Brussel, Brussels, Belgium, 2006.
46. R. Mills and R. A. Watson, "Symbiosis, synergy and modularity: Introducing the reciprocal synergy symbiosis algorithm," in Proc. 9th Eur. Conf. Adv. Artif. Life (ECAL), Lisbon, Portugal, 2007, pp. 1192-1201.
47. R. Mills and R. A. Watson, "Variable discrimination of crossover versus mutation using parameterized modular structure," in Proc. 9th Annu. Conf. Genet. Evol. Comput. (GECCO), 2007, pp. 1312-1319.
48. R. A. Watson, N. Palmius, R. Mills, S. Powers, and A. Penn, "Can selfish symbioses effect higher-level selection?" in Proc. 10th Eur. Conf. Adv. Artif. Life (ECAL), Budapest, Hungary, 2009, pp. 27-36.
49. T. Jansen and R. P. Wiegand, "The cooperative coevolutionary (1+1) EA," Evol. Comput., vol. 12, no. 4, pp. 405-434, 2004.
50. S. Nijssen and T. Back, "An analysis of the behavior of simplified evolutionary algorithms on trap functions," IEEE Trans. Evol. Comput., vol. 7, no. 1, pp. 11-22, Feb. 2003.
51. M. Pelikan and D. E. Goldberg, "Genetic algorithms, clustering, and the breaking of symmetry," in Proc. 6th Int. Conf. Parallel Probl. Solving Nat. (PPSN VI), Paris, France, 2000, pp. 385-394.
52. T. Friedrich, P. S. Oliveto, D. Sudholt, and C. Witt, "Analysis of diversity-perserving mechanisms for global optimisation," Evol. Comput., vol. 17, no. 4, pp. 455-476, 2009.
53. D. E. Goldberg, C. Van Hoyweghen, and B. Naudts, "From TwoMax to the Ising model: Easy and hard symmetrical problems," in Proc. Genet. Evol. Comput. Conf. (GECCO), 2002, pp. 626-633.
54. S. Droste, T. Jansen, and I. Wegener, "Upper and lower bounds for randomized search heuristics in black-box optimization," Theor. Comput. Syst., vol. 39, no. 4, pp. 525-544, 2006.
55. S. Droste, T. Jansen, K. Tinnefeld, and I. Wegener, "A new framework for the valuation of algorithms for black-box optimization," in Foundations of Genetic Algorithms 7. San Mateo, CA, USA: Morgan Kaufmann, 2003, pp. 253-270.
56. P. K. Lehre and C. Witt, "Black-box search by unbiased variation," Algorithmica, vol. 64, no. 4, pp. 623-642, 2012.
57. I. Wegener, "Simulated annealing beats metropolis in combinatorial optimization," in Proc. 32nd Int. Colloq. Autom. Lang. Program. (ICALP), Lisbon, Portugal, 2005, pp. 589-601.
58. G. R. Harik, E. Cantú-Paz, D. E. Goldberg, and B. L. Miller, "The gambler's ruin problem, genetic algorithms, and the sizing of populations," Evol. Comput., vol. 7, no. 3, pp. 231-253, 1999.
59. T.-L. Yu, K. Sastry, D. E. Goldberg, and M. Pelikan, "Population sizing for entropy-based model building in estimation of distribution algorithms," in Proc. 9th Annu. Conf. Genet. Evol. Comput. (GECCO), 2007, pp. 601-608.
60. M. Pelikan, K. Sastry, and D. E. Goldberg, "Sporadic model building for efficiency enhancement of the hierarchical BOA," Genet. Program. Evol. Mach., vol. 9, no. 1, pp. 53-84, 2008.
61. M. Pelikan, D. E. Goldberg, and E. Cantú-Paz, "BOA: The Bayesian optimization algorithm," in Proc. Genet. Evol. Comput. Conf. (GECCO), 1999, pp. 525-532.
62. S. Shakya, R. Santana, and J. A. Lozano, "A Markovianity based optimisation algorithm," Genet. Program. Evol. Mach., vol. 13, no. 2, pp. 159-195, Jun. 2012.
63. A. Prügel-Bennett, "Benefits of a population: Five mechanisms that advantage population-based algorithms," IEEE Trans. Evol. Comput., vol. 14, no. 4, pp. 500-517, Aug. 2010.
64. C. González, "Contributions on theoretical aspects of estimation of distribution algorithms," Ph.D. dissertation, Dept. Comput. Sci., Univ. Basque Country, San Sebastián, Spain, 2005.
65. T. Chen, P. K. Lehre, T. Ke, and X. Yao, "When is an estimation of distribution algorithm better than an evolutionary algorithm?" in Proc. IEEE Congr. Evol. Comput., Trondheim, Norway, 2009, pp. 1470-1477.
66. R. Etxeberria and P. Larrañaga, "Global optimization using Bayesian networks," in Proc. 2nd Symp. Artif. Intell., 1999, pp. 332-339.
67. R. Heckendorn and A. H. Wright, "Efficient linkage discovery by limited probing," Evol. Comput., vol. 12, no. 4, pp. 517-545, 2004.
68. R. A. Watson, G. P. Wagner, M. Pavlicev, D. M. Weinreich, and R. Mills, "The evolution of phenotypic correlations and 'developmental memory'," Evolution, vol. 68, no. 4, pp. 1124-1138, 2014.
69. R. A. Watson, A. Jackson, N. Palmius, R. Mills, and S. T. Powers, "The evolution of symbiotic partnerships and their adaptive consequences," to be published.
70. S. T. Powers, A. S. Penn, and R. A. Watson, "The concurrent evolution of cooperation and the population structures that support it," Evolution, vol. 65, no. 6, pp. 1527-1543, Jun. 2011.
71. J. Maynard Smith and E. Szathmáry, The Major Transitions in Evolution. Oxford, U.K.: Oxford Univ. Press, 1995.