TCS learning classifier system controller on a real robot

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2439, Issue , 2002, Pages 588-597

  Hurst, Jacob ^a   Bull, Larry ^a   Melhuish, Chris ^a  

^a UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTERING ALGORITHMS; DECISION THEORY; ROBOTS;

ADAPTIVE CHARACTERISTIC; CLASSIFIER SYSTEMS; DECISION PROCESS; EVOLUTIONARY TECHNIQUES; GENERALISATION; LEARNING CLASSIFIER SYSTEM; LIGHT SEEKING; REWARD FUNCTION;

REINFORCEMENT LEARNING;

EID: 84944329221     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-45712-7_57     Document Type: Conference Paper

References (30)

1. Ahluwalia, M & Bull, L (1999) A Genetic Programming Based Classifier System. In W. Banzhaf, J. Daida, A. E. Eihen, M. H. Garzon, V. Honavar, M. Jakiela & R. E. Smith (eds) Proceedings of the Genetic and Evolution Computation Conference –GECCO-99. Morgan Kaufmann, pp 11-18.
2. Asada, M, Noda, S, Tawaratsumida, S, Hosoda, K (1996) Purposive Behavior Acquisition for a Real Robot by a Vision Based Reinforcement Learning. Machine Learning Vol 23 pp 279-303.
3. Barry, A (2000) Specifying Action Persistence within XCS. In D. Whitley, D. Goldberg, E. Cantu-Paz, L. Spector, I. Parmee & H-G Beyer (eds) Proceedings of the Genetic and Evolutionary Computation Conference. Morgan Kaufmann, pp 50-57
4. Booker, L (1990) Instinct as an inductive bias for learning behavioral Sequences In Meyer, J, A and Wilson (eds) From animals to animats-The first International Conference on Simulation of Adaptive Behavior, MIT Press
5. Bull, L., Hurst, J. & Tomlinson, A. (2000) Self-Adaptive Mutation in Classifier System
6. Controllers. In J-A. Meyer, A. Berthoz, D. Floreano, H. Roitblatt & S. W. Wilson (eds) From Animals to Animats 6 -The Sixth International Conference on the Simulation of Adaptive Behaviour, MIT Press.
7. Bull L & Hurst J (2002) ZCS Redux EvolutionaryComputation In Press
8. Bradtke, S. J & Duff, M. O (1995) Reinforcement Learning Models for continuous-time Markov decision problems, Advances in Neural information Processing Systems 7 MIT Press pp 393-400
9. Cobb, H & Grefenstette, J (1991)Learning the Persistance of Actions in Reactive Control Rules Proceedings of the 8th International Machine Learning Workshop. Morgan Kaufmann pp 293-297
10. Cliff, D & Ross, S (1995) Adding Temporary Memory to ZCS Adaptive Behavior 3(2) 101-150
11. Dorigo, M, Colombetti, M (1997) Robot Shaping, MIT Press
12. Donnart, J. Y, Meyer, J. A. (1996b). Learning Reactive and Planning Rules in a Motivationally Autonomous Animat. IEEE Transactions on Systems, Man, and Cybernetics -Part B: Cybernetics. 26(3), 381-395.
13. Donnart, J. Y et Meyer, J. A. (1996a)Spatial exploration, map learning, and self-positioning with MonaLysa. In Maes, P., Mataric, M., Meyer, J. A., Pollack, J. et Wilson, S. (Eds.). From animals to animats 4. Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior. The MIT Press.
14. Doya, K (2000) Reinforcement learning in continuous time and space Neural Computation 12(1) 219-245
15. Holland, J. H. (1975) Adaptation in Natural and Artificial Systems. University of Michigan Press.
16. Hurst, J, Bull, L (2001) A Self-Adaptive Classifier System. In P-L Lanzi, W. Stolzmann & S. Wilson (eds) Proceedings of the Third International Workshop on Learning Classifier Systems.
17. Katagami, D, Yamada, S, (2002) Interactive Evolutionary Computation for Real Robot from a view point of observation. In Proceedings of the The 7th International Conference on Intelligent Autonomous Systems (IAS7)
18. Lanzi, P. L (1999) Extending the representation of Classifier Conditions from Messy Coding to S-Expressions. In W. Banzhaf, J. Daida, A. E. Eihen, M. H. Garzon, V. Honavar, M. Jakiela & R. E. Smith (eds) Proceedings of the Genetic and Evolution Computation Conference – GECCO-99. Morgan Kaufmann, pp 345-352.
19. Nolfi, S, Floreano, D (2000) Evolutionary robotics, MIT Press
20. Parr R (1998) Hierarchical Control and Learning for Markov Decision Processes, Ph. D. Thesis, University of California, Berkeley.
21. Santamaria J, Suton, R and Ram, A (1998) Experiments with reinforcement learning in problems with continuous state and action spaces. Adaptive Behavior Vol 6 No 2 pp 163-217
22. Stolzmann, Butz. M (2000) Latent learning and action planning in robots with anticipatory classifier systems In P-L. Lanzi, W. Stolzmann & “. W. Wilson (eds) Learning Classifier Systems: From Foundations to App lications. Springer.
23. Sutton, R & Barto, A (1998) Reinforcement Learning An Introduction, MIT Press
24. Sutton, R, Precup, D and Singh, S (1999) Between MDPs and semi-MDPs: A Framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112 pp 181-211
25. Uchibi, Eiji, Asada, M and Hosoda, K (1997) Vision Based State Space Construction for Learning Mobile Robots in Multi-Agent Environments. Proceedings of Sixth European Workshop on Learning Robots (EWLR-6) pp 33-41
26. Valenzuela-Rendon, M (1991) The Fuzzy Classifier System: a Classifier System for Continuously Varying Variables. Im L. Booker & R. Belew (eds) Proceedings of the Fourth International Conference on genetic Algorithms. Morgan Kaufmann pp 346-353
27. Watkins, C (1989). Learning From Delayed Rewards. Phd. Cambridge University
28. Wilson, S. W (1994) ZCS: A Zeroth-level Classifier System. Evolutionary Computation 2(1):1-18
29. Wilson, S. W (2000) Get Real! XCS with Continuous Valued Inputs. In P-L. Lanzi, W. Stolzmann & “. W. Wilson (eds) Learning Classifier Systems: From Foundations to App lications. Springer, pp 209-222.
30. Wilson, S. W (2001) Function App roximation with a Classifier System. In L. Spector, M. Gen, S. Sen, M. Dorigo, S, Pezeshk, M. Garzon & E. Burke (eds) Proceedings of the Genetic and Evolutionary Computation Conference-GECCO 2001. Morgan Kaufmann, pp 974-984.