Combining latent learning with dynamic programming in the modular anticipatory classifier system

European Journal of Operational Research

Volumn 160, Issue 3 SPEC. ISS., 2005, Pages 614-637

  Gérard, Pierre ^a,b   Meyer, Jean Arcady ^a   Sigaud, Olivier ^a  

^a DASSAULT AVIATION   (France)

^b UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

Artificial intelligence; Dynamic programming; Latent learning; Learning classifier systems; Reinforcement learning

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; OPERATIONS RESEARCH; OPTIMIZATION; PROBLEM SOLVING; SENSORS;

ANTICIPATORY CLASSIFIER SYSTEM (ACS); LATENT LEARNING; LEARNING CLASSIFIER SYSTEMS; REINFORCEMENT LEARNING;

DYNAMIC PROGRAMMING;

EID: 4444312064     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2003.10.004     Document Type: Conference Paper

References (34)

1. Bellman R.E. Dynamic Programming. 1957;Princeton University Press, Princeton NJ.
2. E. Bernardó, X. Llorà, J.M. Garrel, XCS and GALE: a comparative study of two Learning Classifer Systems with six other learning algorithms on classification tasks, in: P.L. Lanzi, W. Stolzmann, S.W. Wilson (Eds.), Proceedings of the fourth international workshop on Learning Classifer Systems, 2001.
3. M.V. Butz, D.E. Goldberg, W. Stolzmann, Introducing a genetic generalization pressure to the Anticipatory Classifier System part I: Theoretical approach, in: Proceedings of the 2000 Genetic and Evolutionary Computation Conference (GECCO 2000), 2000.
4. Butz M.V., Goldberg D.E., Stolzmann W. Probability-enhanced predictions in the anticipatory classifier system. LNAI1996: Advances in learning classifier systems. 2001;Springer-Verlag.
5. Dorigo M. Genetic and non-genetic operators in ALECSYS. Evolutionary Computation. 1(2):1994;151-164.
6. Drescher G.L. Made-Up Minds: A constructivist approach to Artificial Intelligence. 1991;MIT Press, Cambridge, MA.
7. Gal T., Stewart T.J., Hanne T. Multicriteria Decision Making: Advances in MCDM Models, Algorithms, Theory, and Applications. 1999;Kluwer Academic Publishers.
8. Gérard P., Sigaud O. Adding a generalization mechanism to YACS. Spector L., Goodman E., Wu A., Langdon W.B., Voigt H.M., Gen M., Sen S., Dorigo M., Pezeshk S., Garzon M., Burke E. Proceedings of the Genetic and Evolutionary Computation Conference 2001 (GECCO01). 2001;951-957 Morgan Kaufmann, San Francisco, CA.
9. Gérard P., Sigaud O. YACS: Combining anticipation and dynamic programming in classifier systems. Stolzmann W., Lanzi P.L., Wilson S.W. LNAI 1996: Advances in Classifier Systems. 2001;Springer Verlag.
10. P. Gérard, W. Stolzmann, O. Sigaud, YACS: A new learning classifier system using anticipation, Journal of Soft Computing, A Fusion of Foundations, Methodologies and Applications: Special Issue on Learning Classifier Systems, 6(3-4) 2002, 216-228.
11. J. Hoffmann, Vorhersage und Erkenntnis [Anticipation and Cognition], Hogrefe, 1993.
12. Holland J.H. Adaptation. Progress in theoretical biology. 1976.
13. Holland J.H. Properties of the bucket brigade algorithm. Grefenstette J.J. Proceedings of the 1st international Conference on Genetic Algorithms and their applications (ICGA85). 1985;1-7 L.E. Associates.
14. Holland J.H. Concerning the emergence of tag mediated lookahead in classifier systems. Special Issue of Physica D. 42:1990;188-201.
15. Holland J.H., Reitman J.S. Cognitive systems based on adaptive algorithms. Pattern Directed Inference Systems. 7(2):1978;125-149.
16. Kaelbing L.P., Littman M.L., Moore A.W. Reinforcement learning: A survey. Journal of Artificial Intelligence Research. 4:1996;237-285.
17. Lanzi P.L. A study of the generalization capabilities of XSC. Baeck T. Proceedings of the Seventh International Conference on Genetic Algorithms. 1997;418-425 Morgan Kaufmann, San Franciso, CA.
18. Lanzi P.L. Adding memory to XCS. Proceedings of the IEEE Conference on Evolutionary Computation (ICEC98). 1998;IEEE Press.
19. P.L. Lanzi, Learning Classifier Systems from a reinforcement learning perspective, Technical report, Dip. di Elettronica e Informazione, Politecnico di Milano, 2000.
20. Riolo R.L. Lookahead planning and latent learning in a Classifier System. Meyer J.-A., Wilson S.W. From animals to animats: Proceedings of the First International Conference on Simulation of Adaptative Behavior. 1991;316-326 MIT Press.
21. Roy B., Vincke P. Multicriteria analysis: Survey and new directions. European Journal of Operational Research. 8(3):1981;207-218.
22. Seward J.P. An experimental analysis of latent learning. Journal of Experimental Psychology. 11:1949.
23. Sigaud O., Gérard P. Using classifier systems as adaptive expert systems for control. Stolzmann W., Lanzi P.-L., Wilson S.W. LNAI 1996: Advances in Classifier Systems. 2001;Springer-Verlag.
24. Stolzmann W. Anticipatory classifier systems. Koza J.R., Banzhaf W., Chellapilla K., Deb K., Dorigo M., Fogel D.B., Garzon M.H., Goldberg D.E., Iba H., Riolo R. Genetic Programming. 1998;Morgan Kaufmann Publishers, Inc, San Francisco, CA.
25. R. Sun, T. Peterson, Automatic partitioning for multi-agent reinforcement learning, in: J.A. Meyer, A. Berthoz, D. Floreano, H.L. Roitblat, S.W. Wilson (Eds.), From Animals to Animats 6: Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior (SAB2000), 2000.
26. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction. 1998;MIT Press.
27. Sutton R.S. Reinforcement learning architectures for animats. Meyer J.A., Wilson S.W. From animals to animats: Proceedings of the First International Conference on Simulation of Adaptative Behavior. 1991;MIT Press, Cambridge, MA.
28. Tolman E.C. Purposive behavior in animals and men. 1932;Appletown, New York.
29. Tomlinson A., Bull L. CXCS. Lanzi P.L., Stolzmann W., Wilson S.W. Learning Classifier Systems, From Foundations to Applications. Lecture Notes in Artificial Intelligence. vol. 1813:2000;194-208 Springer-Verlag, Berlin.
30. C.J. Watkins, Learning with delayed rewards, PhD thesis, Psychology Department, University of Cambridge, England, 1989.
31. Wiering M., Schmidhuber J. Hq-learning. Adaptive Behavior. 6(2):1997;219-246.
32. Wilson S.W. A critical review of Classifier Systems. Proceedings of the Third International Conference on Genetic Algorithms. 1989;244-255 Morgan Kaufmann, Los Altos, CA.
33. Wilson S.W. Classifier fitness based on accuracy. Evolutionary Computation. 3(2):1995;149-175.
34. Wilson S.W. Function approximation with a classifier system. Spector L., Goodman E.D., Wu A., Langdon W.B., Voigt H.M., Gen M. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO01). 2001;974-981 Morgan Kaufmann.