A neural learning classifier system with self-adaptive constructivism for mobile robot control

Artificial Life

Volumn 12, Issue 3, 2006, Pages 353-380

  Hurst, Jacob ^a   Bull, Larry ^a  

^a UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

Author keywords

Adaptation; Generic algorithm; Neural network; Reinforcement learning; Robotics

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; GENETIC ALGORITHMS; LEARNING ALGORITHMS; NEURAL NETWORKS; ROBOT LEARNING; ROBOTICS;

MOBILE ROBOT CONTROL; NEURAL LEARNING CLASSIFIER SYSTEM; REINFORCEMENT LEARNING; SELF-ADAPTIVE CONSTRUCTIVISM;

MOBILE ROBOTS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AVOIDANCE BEHAVIOR; ENVIRONMENT; MAZE TEST; ROBOTICS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; AVOIDANCE LEARNING; ENVIRONMENT; MAZE LEARNING; NEURAL NETWORKS (COMPUTER); ROBOTICS;

EID: 33746844882     PISSN: 10645462     EISSN: 15309185     Source Type: Journal    
DOI: 10.1162/artl.2006.12.3.353     Document Type: Article

References (46)

1. Abbass, H. A. (2003). Speeding up backpropagation using multiobjective evolutionary algorithms. Neural Computation, 15, 2705-2726.
2. Ahluwalia, M., & Bull, L. (1999). A genetic programming classifier system. In W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, & R. E. Smith (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-99 (pp. 11-18). San Mateo, CA: Morgan Kaufmann.
3. Asada, M., Noda, S., Tawaratsumida, S., & Hosoda, A. (1996). Purposive behaviour acquisition for a real robot by vision based reinforcement learning. Machine Learning, 23, 2-3.
4. Baeck, T. (1995). Evolutionary computation: Theory and practice. Oxford, UK: Oxford University Press.
5. Bull, L. (2002). On using constructivism in neural learning classifier systems. In J. Merelo, P. Adamidis, H.-G. Beyer, J.-L. Fernandez-Villacanas, & H.-P. Schwefel (Eds.), Parallel problem solving from nature - PPSN VII (pp. 558-567). Berlin: Springer-Verlag.
6. Bull, L., & Fogarty, T. C. (1996). Artificial symbiogenesis. Artificial Life, 2(3), 269-292.
7. Bull, L., & Hurst, J. (2002). ZCS redux. Evolutionary Computation, 10(2), 185-205.
8. Bull, L., Hurst, J., & Tomlinson, A. (2000). Self-adaptive mutation in classifier system controllers. In J.-A. Meyer, A. Berthoz, D. Floreano, H. Roitblatt, & S. W. Wilson (Eds.), From Animals to Animats 6 - The Sixth International Conference on the Simulation of Adaptive Behavior (pp. 460-471). Cambridge, MA: MIT Press.
9. Bull, L., & O'Hara, T. (2002). Accuracy-based neuro and neuro-fuzzy classifier systems. In W. B. Langdon, E. Cantu-Paz, K. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J. Wegener, L. Bull, M. A. Potter, A. C. Schultz, J. F. Miller, E. Burke, & N. Jonoska (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-02 (pp. 905-911). San Mateo, CA: Morgan Kaufmann.
10. Davis, L. (1989). Mapping neural networks into classifier systems. In J. D. Schaffer (Ed.), Proceedings of the Third International Conference on Genetic Algorithms (pp. 375-378). San Mateo, CA: Morgan Kaufmann.
11. Dorigo, M., & Colombetti, M. (1997). Robot shaping. Cambridge, MA: MIT Press.
12. Edelman, G. (1987). Neural Darwinism: The theory of neuronal group selection. New York: Basic Books.
13. Farmer, D. (1989). A Rosetta stone for connectionism. Physica D, 42, 153-187.
14. Fritzke, B. (1994). Fast learning with incremental RBF networks. Neural Processing Letters, 1(1), 2-5.
15. Harvey, I., Husbands, P., & Cliff, D. (1994). Seeing the light: Artificial evolution, real vision. In D. Cliff, P. Husbands, J.-A. Meyer, & S. W. Wilson (Eds.), From Animals to Animats 3: Proceedings of the Third International Conference on Simulation of Adaptive Behavior (pp. 392-401). Cambridge, MA: MIT Press.
16. Holland, J. H. (1975). Adaptation in natural and artificial systems. Ann Arbor: University of Michigan Press.
17. Holland, J. H. (1976). Adaptation. In R. Rosen & F. M. Snell (Eds.), Progress in Theoretical Biology 4 (pp. 263-293). New York: Academic Press.
18. Hurst, J., & Bull, L. (2001). A self-adaptive classifier system. In P.-L. Lanzi, W. Stolzmann, & S. W. Wilson (Eds.), Advances in learning classifier systems: Proceedings of the Third International Workshop on Learning Classifier Systems (pp. 70-79). Berlin: Springer-Verlag.
19. Hurst, J., Bull, L., & Melhuish, C. (2002). TCS learning classifier system controller on a real robot. In J. Merelo, P. Adamidis, H.-G. Beyer, J.-L. Fernandez-Villacanas, & H.-P. Schwefel (Eds.), Parallel problem solving from nature - PPSN VII (pp. 588-600). Berlin: Springer-Verlag.
20. Lanzi, P.-L. (1999). Extending the representation of classifier conditions Part I: From binary to messy coding. In W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, & R. E. Smith (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-99 (pp. 11-18). San Mateo, CA: Morgan Kaufmann.
21. Lanzi, P.-L. (1999). Extending the representation of classifier conditions Part II: From messy coding to S-expressions. In W. Banzhaf, J. Daida, A. E. Eiben, M. H. Garzon, V. Honavar, M. Jakiela, & R. E. Smith (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference - GECCO-99 (pp. 11-18). San Mateo, CA: Morgan Kaufmann.
22. Lin, L.-J. (1992). Self-improving reactive agents based on reinforcement learning, planning and teachings. Machine Learning, 8, 625-632.
23. Lindgren, K., & Nordhal, M. G. (1995). Cooperation and community structure in artificial ecosystems. Artificial Life, 1(1), 15-38.
24. Millan, J., Posenato, D., & Dedieu, E. (2002). Continuous action Q-learning. Machine Learning, 49, 291-323.
25. Montana, D. J., & Davis, L. (1989). Training feedforward neural networks using genetic algorithms. In S. Sridharan (Ed.), Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (pp. 762-767). San Mateo, CA: Morgan Kaufmann.
26. Moriarty, D. E., & Miikkulainen, R. (1997). Forming neural networks through efficient and adaptive coevolution. Evolutionary Computation, 5(2), 373-399.
27. Nolfi, S., & Floreano, D. (2000). Evolutionary robotics: Biology, intelligence, and technology of self-organizing machines. Cambridge, MA: MIT Press.
28. Nolfi, S., & Parisi, D. (1997). Learning to adapt to changing environments in evolving neural networks. Adaptive Behaviour, 5, 99-105.
29. O'Hara, T., & Bull, L. (2005). A memetic accuracy-based neural learning classifier system. In Proceedings of the IEEE Congress on Evolutionary Computation (pp. 2040-2045).
30. Parr, R. (1998). Hierarchical control and learning for Markov decision processes. Ph.D. thesis. University of California, Berkeley.
31. Peng, J., & Williams, R. J. (1996). Incremental multi-step Q-learning. Machine Learning, 22, 283-290.
32. Poggio, T., & Girosi, F. (1990). Networks for approximation and learning. Proceedings of the IEEE, 78, 1481-1497.
33. Quartz, S. R., & Sejnowski, T. J. (1997). The neural basis of cognitive development: A constructionist manifesto. Behavioral and Brain Sciences, 20(4), 537-596.
34. Redding, N. J., Kowalcyzk, A., & Downs, T. (1993). Constructive higher-order network algorithm that is polynomial time. Neural Networks, 6, 997-1010.
35. Rumelhart, D. E., & McClelland, J. L. (1986). Parallel distributed processing. Cambridge, MA: MIT Press.
36. Santamaria, J. C., Sutton, R., & Ram, A. (1998). Experiments in reinforcement learning in problems with continuous state and action spaces. Adaptive Behaviour, 6(2), 163-217.
37. Schuurmans, D., & Schaeffer, J. (1989). Representational difficulties with classifier systems. In J. D. Schaffer (Ed.), Proceedings of the Third International Conference on Genetic Algorithms (pp. 328-333). San Mateo, CA: Morgan Kaufmann.
38. Stanley, K., & Miikkulainen, R. (2002). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10(2), 99-128.
39. Smith, R. E., & Cribbs, H. B. (1994). Is a learning classifier system a type of neural network? Evolutionary Computation, 2(1), 19-36.
40. Sutton, R. S. (1988). Learning to predict by the method of temporal differences. Machine Learning, 3, 9-44.
41. Sutton, R. S., & Barto, R. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
42. Tham, C. L. (1995). Reinforcement learning of multiple tasks using a hierarchical CMAC architecture. Robotics and Autonomous Systems, 15, 247-274.
43. Valenzuela-Rendon, M. (1991). The fuzzy classifier system: A classifier system for continuously varying variables. In L. Booker & R. Belew (Eds.), Proceedings of the Fourth International Conference on Genetic Algorithms (pp. 346-353). San Mateo, CA: Morgan Kaufmann.
44. Wilson, S. W. (1994). ZCS: A zeroth-level classifier system. Evolutionary Computation, 2(1), 1-18.
45. Wilson, S. W. (2000). Get Real! XCS with continuous-valued inputs. In P.-L. Lanzi, W. Stolzmann, & S. W. Wilson (Eds.), Learning classifier systems: From foundations to applications (pp. 209-222). Berlin: Springer-Verlag.
46. Yao, X. (1999). Evolving artificial neural networks. Proceedings of the IEEE, 87(9), 1423-1447.