Reusing building blocks of extracted knowledge to solve complex, large-scale boolean problems

IEEE Transactions on Evolutionary Computation

Volumn 18, Issue 4, 2014, Pages 465-480

  Iqbal, Muhammad ^a   Browne, Will N ^a   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

Author keywords

Building Blocks; Code Fragments; Genetic Programming; Layered Learning; Learning classifier Systems; Scalability

Indexed keywords

GENETIC ALGORITHMS; GENETIC PROGRAMMING; MULTIPLEXING; MULTIPLEXING EQUIPMENT; SCALABILITY;

BUILDING BLOCKES; CODE FRAGMENTS; EVEN-PARITY PROBLEMS; EVOLUTIONARY COMPUTATION TECHNIQUES; LARGE-SCALE PROBLEM; LAYERED LEARNING; LEARNING CLASSIFIER SYSTEM; REUSING BUILDINGS;

LEARNING SYSTEMS;

EID: 84905591330     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2013.2281537     Document Type: Article

References (71)

1. S. Thrun, "Is learning the nth thing any easier than learning the first?" in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 1996, pp. 640-646.
2. M. V. Butz, T. Kovacs, P. L. Lanzi, and S. W. Wilson, "Toward a theory of generalization and learning in XCS, " IEEE Trans. Evol. Comput., vol. 8, no. 1, pp. 28-46, Feb. 2004.
3. C. Ioannides and W. N. Browne, "Investigating scaling of an abstracted LCS utilising ternary and S-expression alphabets, " in Proc. Genet. Evol. Comput. Conf., 2007, pp. 2759-2764. (Pubitemid 47291070)
4. S. W. Wilson, "Classifier fitness based on accuracy, " Evol. Comput., vol. 3, no. 2, pp. 149-175, 1995.
5. S. W. Wilson, "Generalization in the XCS classifier system, " in Proc. Genet. Programming Conf., 1998, pp. 665-674.
6. L. Torrey and J. Shavlik, "Transfer learning, " in Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques. Hershey, PA, USA: IGI Global, 2010, ch. 11, pp. 242-264.
7. S. J. Pan and Q. Yang, "A survey on transfer learning, " IEEE Trans. Knowledge Data Eng., vol. 22, no. 10, pp. 1345-1359, Oct. 2010.
8. P. Stone and M. Veloso, "Layered learning, " in Proc. Eur. Conf. Mach. Learning, 2000, pp. 369-381.
9. H. de Garis, "Genetic programming-Building nanobrains with genetically programmed neural network modules, " in Proc. Int. Joint Conf. Neural Netw., 1990, pp. 511-516.
10. M. Asada, S. Noda, S. Tawaratsumida, and K. Hosoda, "Purposive behavior acquisition for a real robot by vision-based reinforcement learning, " Mach. Learning, vol. 23, no. 2-3, pp. 279-303, 1996. (Pubitemid 126724375)
11. K. A. De Jong, Evolutionary Computation: A Unified Approach. Cambridge, MA, USA: MIT Press, 2006.
12. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Reading, MA, USA: Addison-Wesley, 1989.
13. J. H. Holland, Adaptation in Natural and Artificial Systems. Ann Arbor, MI, USA: Univ. Michigan Press, 1975.
14. H. Mühlenbein and G. Paab, "From recombination of genes to the estimation of distributions I. Binary parameters, " in Proc. Parallel Problem Solving Nature, 1996, pp. 178-187. (Pubitemid 126128306)
15. M. Pelikan, D. E. Goldberg, and F. G. Lobo, "A survey of optimization by building and using probabilistic models, " Comput. Optimization Appl., vol. 21, no. 1, pp. 5-20, 2002. (Pubitemid 34172679)
16. R. Santana, A. Mendiburu, and J. A. Lozano, "Structural transfer using EDAs: An application to multimarker tagging SNP selection, " in Proc. IEEE CEC, 2012, pp. 3221-3228.
17. M. Pelikan and M. W. Hauschild, "Learn from the past: Improving model-directed optimization by transfer learning based on distancebased bias, " Missouri Estimation Distribution Algorithms Lab., Univ. Missouri, St. Louis, MO, USA, Tech. Rep. 2012007, 2012.
18. L. Altenberg, "The schema theorem and Prices theorem, " in Proc. Found. Genet. Algorithms, 1995, pp. 23-49.
19. H. G. Beyer, "An alternative explanation for the manner in which genetic algorithms operate, " BioSystems, vol. 41, no. 1, pp. 1-15, 1997.
20. K. M. Burjorjee. (2008). The fundamental problem with the building block hypothesis, " CoRR, vol. abs/0810.3356 [Online]. Available: Http://arxiv.org/abs/0810.3356
21. R. Poli and W. B. Langdon, "Schema theory for genetic programming with one-point crossover and point mutation, " Evol. Comput., vol. 6, no. 3, pp. 231-252, 1998. (Pubitemid 128692904)
22. R. Poli, "Why the schema theorem is correct also in the presence of stochastic effects, " in Proc. IEEE CEC, 2000, pp. 487-492.
23. J. Drugowitsch, Design and Analysis of Learning Classifier Systems: A Probabilistic Approach. Berlin, Germany: Springer, 2008.
24. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA, USA: MIT Press, 1992.
25. S. Luke and L. Panait, "A comparison of bloat control methods for genetic programming, " Evol. Comput., vol. 14, no. 3, pp. 309-344, 2006. (Pubitemid 44699556)
26. M. Zhang and P. Wong, "Genetic programming for medical classification: A program simplification approach, " Genet. Program. Evolvable Mach., vol. 9, no. 3, pp. 229-255, 2008.
27. D. Kinzett, M. Johnston, and M. Zhang, "Numerical simplification for bloat control and analysis of building blocks in genetic programming, " Evol. Intell., vol. 2, no. 4, pp. 151-168, 2009.
28. E. Alfaro-Cid, J. J. Merelo, F. F. de Vega, A. I. Esparcia-Alcazar, and K. Sharman, "Bloat control operators and diversity in genetic programming: A comparative study, " Evol. Comput., vol. 18, no. 2, pp. 305-332, 2010.
29. M. Brameier and W. Banzhaf, Linear Genetic Programming. Berlin, Germany: Springer, 2007.
30. J. F. Miller and P. Thomson, "Cartesian genetic programming, " in Proc. Eur. Conf. Genet. Programming, 2000, pp. 121-132.
31. S. M. Gustafson and W. H. Hsu, "Layered learning in genetic programming for a cooperative robot soccer problem, " in Proc. Eur. Conf. Genet. Programming, 2001, pp. 291-301. (Pubitemid 33255079)
32. D. Jackson and A. P. Gibbons, "Layered learning in Boolean GP problems, " in Proc. Eur. Conf. Genet. Program., 2007, pp. 148-159. (Pubitemid 47290307)
33. T.-H. Hoang, R. I. B. McKay, D. Essam, and N. X. Hoai, "On synergistic interactions between evolution, development and layered learning, " IEEE Trans. Evol. Comput., vol. 15, no. 3, pp. 287-312, Jun. 2011.
34. J. F. Miller and S. L. Smith, "Redundancy and computational efficiency in Cartesian genetic programming, " IEEE Trans. Evol. Comput., vol. 10, no. 2, pp. 167-174, Apr. 2006.
35. S. Harding, J. F. Miller, and W. Banzhaf, "Self-modifying Cartesian genetic programming, " in Proc. Genet. Evol. Comput. Conf., 2007, pp. 1021-1028. (Pubitemid 47291656)
36. S. Harding, J. F. Miller, and W. Banzhaf, "Developments in Cartesian genetic programming: Self-modifying CGP, " Genet. Programming Evolvable Mach., vol. 11, nos. 3-4, pp. 397-439, 2010.
37. M. Iqbal, W. N. Browne, and M. Zhang, "Extending learning classifier system with cyclic graphs for scalability on complex, largescale Boolean problems, " in Proc. Genet. Evol. Comput. Conf., 2013, pp. 1045-1052.
38. J. R. Koza, Genetic Programming II: Automatic Discovery of Reusable Programs. Cambridge, MA, USA: MIT Press, 1994.
39. N. T. Hien, N. X. Hoai, and B. McKay, "A study on genetic programming with layered learning and incremental sampling, " in Proc. IEEE CEC, 2011, pp. 1179-1185.
40. N. T. Hien and N. X. Hoai. (2012). Learning in stages: A layered learning approach for genetic programming, " in Proc. Int. Conf. Comput. Commun. Technol. Res. Innovation Vision Future [Online]. Available: Http://dx.doi.org/ 10.1109/rivf.2012.6169838
41. N. X. Hoai, R. I. B. McKay, and D. Essam, "Representation and structural difficulty in genetic programming, " IEEE Trans. Evol. Comput., vol. 10, no. 2, pp. 157-166, Apr. 2006.
42. C. M. Bishop, Pattern Recognition and Machine Learning. Berlin, Germany: Springer, 2011.
43. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
44. R. J. Urbanowicz and J. H. Moore, "Learning classifier systems: A complete introduction, review, and roadmap, " J. Artif. Evol. Appl., vol. 2009, no. 1, pp. 1-25, 2009.
45. M. V. Butz and S. W. Wilson, "An algorithmic description of XCS, " Soft Comput., vol. 6, nos. 3-4, pp. 144-153, 2002.
46. T. Kovacs, "Evolving optimal populations with XCS classifier systems, " Univ. Birmingham, Birmingham, U.K., Tech. Rep. CSR-96-17 and CSRP-9617, 1996.
47. P. L. Lanzi, "Extending the representation of classifier conditions Part I: From binary to messy coding, " in Proc. Genet. Evol. Comput. Conf., 1999, pp. 337-344.
48. D. E. Goldberg, B. Korb, and K. Deb, "Messy genetic algorithms: Motivation, analysis, and first results, " Complex Syst., vol. 3, no. 5, pp. 493-530, 1989.
49. P. L. Lanzi and A. Perrucci, "Extending the representation of classifier conditions part II: From messy coding to S-expressions, " in Proc. Genet. Evol. Comput. Conf., 1999, pp. 345-352.
50. L. Bull and T. O'Hara, "Accuracy-based neuro and neuro-fuzzy classifier systems, " in Proc. Genet. Evol. Comput. Conf., 2002, pp. 905-911.
51. H. H. Dam, H. A. Abbass, C. Lokan, and X. Yao, "Neural-based learning classifier systems, " IEEE Trans. Knowledge Data Eng., vol. 20, no. 1, pp. 26-39, Jan. 2008.
52. M. Iqbal, W. N. Browne, and M. Zhang, "Evolving optimum populations with XCS classifier systems, " Soft Comput., vol. 17, no. 3, pp. 503-518, 2013.
53. P. L. Lanzi, "XCS with stack-based genetic programming, " in Proc. IEEE CEC, 2003, pp. 1186-1191.
54. D. Loiacono, A. Marelli, and P. Lanzi, "Support vector machines for computing action mappings in learning classifier systems, " in Proc. IEEE CEC, 2007, pp. 2141-2148.
55. S. W. Wilson, "Classifiers that approximate functions, " Natural Comput., vol. 1, nos. 2-3, pp. 211-234, 2002.
56. M. V. Butz, P. L. Lanzi, and S. W. Wilson, "Function approximation with XCS: Hyperellipsoidal conditions, recursive least squares, and compaction, " IEEE Trans. Evol. Comput., vol. 12, no. 3, pp. 355-376, Jun. 2008.
57. P. L. Lanzi and D. Loiacono, "Classifier systems that compute action mappings, " in Proc. Genet. Evol. Comput. Conf., 2007, pp. 1822-1829. (Pubitemid 47291808)
58. M. Ahluwalia and L. Bull, "A genetic programming based classifier system, " in Proc. Genet. Evol. Comput. Conf., 1999, pp. 11-18.
59. M. V. Butz, M. Pelikan, X. Llora, and D. E. Goldberg, "Automated global structure extraction for effective local building block processing in XCS, " Evol. Comput., vol. 14, no. 3, pp. 345-380, 2006. (Pubitemid 44699557)
60. M. Iqbal, W. N. Browne, and M. Zhang, "Extracting and using building blocks of knowledge in learning classifier systems, " in Proc. Genet. Evol. Comput. Conf., 2012, pp. 863-870.
61. M. Iqbal, W. N. Browne, and M. Zhang, "Learning overlapping natured and niche imbalance Boolean problems using XCS classifier systems, " in Proc. IEEE CEC, 2013, pp. 1818-1825.
62. M. Iqbal, W. N. Browne, and M. Zhang, "Comparison of two methods for computing action values in XCS with code-fragment actions, " in Proc. Genet. Evol. Comput. Conf. (Companion), 2013, pp. 1235-1242.
63. M. Iqbal, W. N. Browne, and M. Zhang, "XCSR with computed continuous action, " in Proc. Australasian Joint Conf. Artif. Intell., 2012, pp. 350-361.
64. M. Iqbal, M. Zhang, and W. N. Browne, "Automatically defined functions for learning classifier systems, " in Proc. Genet. Evol. Comput. Conf. (Companion), 2011, pp. 375-382.
65. M. V. Butz, "XCSJava 1.0: An implementation of the XCS classifier system in Java, " Illinois Genet. Algorithms Lab., Urbana, IL, USA, Tech. Rep. 2000027, 2000.
66. J. A. Walker, J. F. Miller, P. Kaufmann, and M. Platzner, "Problem decomposition in Cartesian genetic programming, " in Cartesian Genetic Programming. Berlin, Germany: Springer, 2011, ch. 3, pp. 35-99.
67. W. Banzhaf, P. Nordin, R. E. Keller, and F. D. Francone, Genetic Programming-An Introduction; On the Automatic Evolution of Computer Programs and Its Applications. San Mateo, CA, USA: Morgan Kaufmann, 1998.
68. W. B. Langdon, "Generalisation in genetic programming, " in Proc. Genet. Evol. Comput. Conf., 2011, p. 205.
69. M. V. Butz, Rule-Based Evolutionary Online Learning Systems: A Principal Approach to LCS Analysis and Design. Berlin, Germany: Springer, 2006.
70. R. Poli and J. Page, "Solving high-order Boolean parity problems with smooth uniform crossover, submachine code GP and demes, " Genet. Program. Evolable Mach., vol. 1, nos. 1-2, pp. 37-56, 2000.
71. N. Nisan and S. Schocken, The Elements of Computing Systems: Building a Modern Computer From First Principles. Cambridge, MA, USA: MIT Press, 2008. .