Internal models and anticipations in adaptive learning systems

Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science)

Volumn 2684, Issue , 2003, Pages 86-109

  Butz, Martin V ^b,c   Sigaud, Olivier ^a   Gérard, Pierre ^a  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

^b UNIVERSITY OF WÜRZBURG   (Germany)

^c Illinois Genetic Algorithms Laboratory (IlliGAL)   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTERS; ADAPTIVE SYSTEMS; COGNITIVE SYSTEMS; DECISION THEORY; INFORMATION ANALYSIS; MATHEMATICAL MODELS; PROBLEM SOLVING; RESEARCH AND DEVELOPMENT MANAGEMENT; WAVE FILTERS;

ADAPTIVE BEHAVIOR; ADAPTIVE LEARNING SYSTEMS; ANTICIPATORY MECHANISMS; FUTURE RESEARCH DIRECTIONS; INTERNAL MODELS;

LEARNING SYSTEMS;

ADAPTIVE LEARNING SYSTEMS; ANTICIPATORY MECHANISMS; GENERALIZATION; PARTIALLY OBSERVABLE MARKOV DESIGN PROCESSES (POMDP);

EID: 23144446332     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/978-3-540-45002-3_6     Document Type: Conference Paper

References (71)

1. Arbib, M.: The mirror system, imitation, and the evolution of language. In Dautenhahn, K., Nehaniv, C.L., eds.: Imitation in animals and artifacts. MIT Press, Cambridge, MA (2002).
2. Baluja, S., Pomerleau, D.A.: Using the representation in a neural network's hidden layer for task-specific focus on attention. Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (1995) 133-141.
3. Baluja, S., Pomerleau, D.A.: Expectation-based selective attention for visual monitoring and control of a robot vehicle. Robotics and Autonomous Systems 22 (1997) 329-344.
4. Barto, A.G., Mahadevan, S.: Recent advances in hierarchical reinforcement learning. Discrete event systems (2003, to appear).
5. Bellman, R.E.: Dynamic programming. Princeton University Press, Princeton, NJ (1957).
6. Booker, L., Goldberg, D.E., Holland, J.H.: Classifier systems and genetic algorithms. Artificial Intelligence 40 (1989) 235-282.
7. Brooks, R.A.: Intelligence without reason. Proceedings of the 12th International Joint Conference on Artificial Intelligence (1991) 569-595.
8. Butz, M.V.: Anticipatory learning classifier systems. Kluwer Academic Publishers, Boston, MA (2002).
9. Cassandra, A.R., Kaelbling, L.P., Littman, M.L.: Acting optimally in partially observable stochastic domains. Proceedings of the Twelfth National Conference on AI (1994) 1023-1028.
10. Davidsson, P.: Learning by linear anticipation in multi-agent systems. InWeiss, G., ed.: Distributed artificial intelligence meets machine learning, Berlin Heidelberg, Springer-Verlag (1997) 62-72.
11. Drescher, G.L.: Made-up minds, a constructivist approach to artificial intelligence. MIT Press, Cambridge, MA (1991).
12. Elman, J.L.: Finding structure in time. Cognitive Science 14 (1990) 179-211.
13. Fikes, R.E., Nilsson, N.J.: STRIPS: A new approach to the application of theorem proving to problem solving. Artificial Intelligence 2 (1971) 189-208.
14. Gallese, V.: The 'shared manifold' hypothesis: From mirror neurons to empathy. Journal of Consciousness Studies: Between Ourselves - Second-Person Issues in the Study of Consciousness 8 (2001) 33-50.
15. Gallese, V., Goldman, A.: Mirror neurons and the simulation theory of mindreading. Trends in Cognitive Sciences 2 (1998) 493-501.
16. Gérard, P., Meyer, J.A., Sigaud, O.: Combining latent learning and dynamic programming in MACS. European Journal of Operational Research (submitted, 2003).
17. Gérard, P., Stolzmann, W., Sigaud, O.: YACS: A new learning classifier system with anticipation. Soft Computing 6 (2002) 216-228.
18. Gérard, P., Sigaud, O.: Adding a generalization mechanism to YACS. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001) (2001) 951-957.
19. Gérard, P., Sigaud, O.: YACS: Combining dynamic programming with generalization in classifier systems. In Lanzi, P.L., Stolzmann, W., Wilson, S.W., eds.: Advances in learning classifier systems: Third international workshop, IWLCS 2000. Springer-Verlag, Berlin Heidelberg (2001) 52-69.
20. Goldberg, D.E.: Genetic algorithms in search, optimization and machine learning. Addison-Wesley, Reading, MA (1989).
21. Herbart, J.: Psychologie als Wissenschaft neu gegründet auf Erfahrung, Metaphysik und Mathematik. Zweiter, analytischer Teil. August Wilhem Unzer, Königsberg, Germany (1825).
22. Hoffmann, J., Sebald, A., Stöcker, C.: Irrelevant response effects improve serial learning in serial reaction time tasks. Journal of Experimental Psychology: Learning, Memory, and Cognition 27 (2001) 470-482.
23. Holland, J.H.: Adaptation in natural and artificial systems. The University of Michigan Press (1975).
24. Holland, J.H., Holyoak, K.J., Nisbett, R.E., Thagard, P.R.: Induction. MIT Press (1986).
25. Holland, J.H., Reitman, J.S.: Cognitive systems based on adaptive algorithms. Pattern Directed Inference Systems 7 (1978) 125-149.
26. Holland, J.H.: Properties of the bucket brigade algorithm. Proceedings of an International Conference on Genetic Algorithms and their Applications (1985) 1-7.
27. Kaelbing, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4 (1996) 237-285.
28. Koch, C., Ullmann, S.: Shifts in selective attention: Towards the underlying neural circuitry. Human Neurobiology 4 (1985) 219-227.
29. Kunde, W.: Response-effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance 27 (2001) 387- 394.
30. Kuvayev, L., Sutton, R.S.: Model-based reinforcement learning with an approximate, learned model. In: Proceedings of the ninth yale workshop on adaptive and learning systems, New Haven, CT (1996) 101-105.
31. LaBerge, D.: Attentional processing, the brain's art of mindfulness. Harvard University Press, Cambridge, MA (1995).
32. Lanzi, P.L.: An analysis of generalization in the XCS classifier system. Evolutionary Computation 7 (1999) 125-149.
33. Lanzi, P.L.: Learning classifier systems from a reinforcement learning perspective. Soft Computing 6 (2002) 162-170.
34. Mack, A., Rock, I.: Inattentinal blindness. MIT Press (Cambridge, MA).
35. Moore, A.W., Atkeson, C.: Prioritized sweeping: Reinforcement learning with less data and less real time. Machine Learning 13 (1993) 103-130.
36. Newell, A., Simon, H.A., Shaw, J.C.: Elements of a theory of human problem solving. Psychological Review 65 (1958) 151-166.
37. Pashler, H., Johnston, J.C., Ruthruff, E.: Attention and performance. Annual Review of Psychology 52 (2001) 629-651.
38. Pashler, H.E.: The psychology of attention. MIT Press, Cambridge, MA (1998).
39. Pavlov, I.P.: Conditioned reflexes. London: Oxford (1927).
40. Peng, J., Williams, R.J.: Efficient learning and planning within the dyna framework. Adaptive Behavior 1 (1993) 437-454.
41. Rizzolatti, G., Fadiga, L., Gallese, V., Fogassi, L.: Premotor cortex and the recognition of motor actions. Cognitive Brain Research 3 (1996) 131-141.
42. Rummery, G.A., Niranjan, M.: On-line Q-learning using connectionist systems. Technical Report CUED/F-INFENG/TR 166, Engineering Department, Cambridge University (1994).
43. Schubotz, R.I., von Cramon, D.Y.: Functional organization of the lateral premotor cortex. fMRI reveals different regions activated by anticipation of object properties, location and speed. Cognitive Brain Research 11 (2001) 97-112.
44. Simons, D.J., Chabris, C.F.: Gorillas in our midst: Sustained inattentional blindness for dynamic events. Perception 28 (1999) 1059-1074.
45. Sjölander, S.: Some cognitive break-throughs in the evolution of cognition and consciousness, and their impact on the biology language. Evolution and Cognition 1 (1995) 3-11.
46. Skinner, B.F.: The behavior of organisms. Appleton-Century Crofts, Inc., New- York (1938).
47. Skinner, B.F.: Beyond freedom and dignity. Bantam/Vintage, New York (1971).
48. Stock, A., Hoffmann, J.: Intentional fixation of behavioral learning or how R-E learning blocks S-R learning. European Journal of Cognitive Psychology (2002) in press.
49. Stolzmann, W.: Antizipative Classifier Systems [Anticipatory classifier systems]. Shaker Verlag, Aachen, Germany (1997).
50. Stolzmann, W.: Anticipatory classifier systems. Genetic Programming 1998: Proceedings of the Third Annual Conference (1998) 658-664.
51. Stolzmann, W., Butz, M.V., Hoffmann, J., Goldberg, D.E.: First cognitive capabilities in the anticipatory classifier system. From Animals to Animats 6: Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior (2000) 287-296.
52. Sutton, R.S., Barto, A.G.: Reinforcement learning: An introduction. MIT Press (1998).
53. Sutton, R.: Reinforcement learning architectures for animats. From animals to animats: Proceedings of the First International Conference on Simulation of Adaptative Behavior (1991).
54. Sutton, R., Precup, D., Singh, S.: Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112 (1999) 181-211.
55. Tani, J.: Model-based learning for mobile robot navigation from the dynamical system perspective. IEEE Transactions on System, Man and Cybernetics 26 (1996) 421-436.
56. Tani, J.: An interpretation of the "self" from the dynamical systems perspective: A constructivist approach. Journal of Consciousness Studies 5 (1998) 516-542.
57. Tani, J.: Learning to perceive the world as articulated: An approach for hierarchical learning in sensory-motor systems. Neural Networks 12 (1999) 1131-1141.
58. Thistlethwaite, D.: A critical review of latent learning and related experiments. Psychological Bulletin 48 (1951) 97-129.
59. Thompson, E.: Empathy and consciousness. Journal of Consciousness Studies: Between Ourselves - Second-Person Issues in the Study of Consciousness 8 (2001) 1-32.
60. Thorndike, E.L.: Animal intelligence: Experimental studies. Macmillan, New York (1911).
61. Tolman, E.C.: Purposive behavior in animals and men. Appletown, New York (1932).
62. Tolman, E.C.: The determiners of behavior at a choice point. Psychological Review 45 (1938) 1-41.
63. Tolman, E.C.: Cognitive maps in rats and men. Psychological Review 55 (1948) 189-208.
64. Tolman, E.C.: Principles of purposive behavior. In Koch, S., ed.: Psychology: A study of science, New York, McGraw-Hill (1959) 92-157.
65. Watkins, C.J.: Learning with delayed rewards. PhD thesis, Psychology Department, University of Cambridge, England (1989).
66. Wilson, S.W.: ZCS, a zeroth level classifier system. Evolutionary Computation 2 (1994) 1-18.
67. Wilson, S.W.: Classifier fitness based on accuracy. Evolutionary Computation 3 (1995) 149-175.
68. Wilson, S.W.: Mining oblique data with XCS. In Lanzi, P.L., Stolzmann, W., Wilson, S.W., eds.: Advances in learning classifier systems: Third international workshop, IWLCS 2000, Berlin Heidelberg, Springer-Verlag (2001).
69. Wilson, S.W.: Knowledge growth in an artificial animal. In Grefenstette, J.J., ed.: Proceedings of an international conference on genetic algorithms and their applications, Carnegie-Mellon University, Pittsburgh, PA (1985) 16-23.
70. Witkowski, C.M.: Schemes for learning and behaviour: A new expectancy model. PhD thesis, Department of Computer Science, University of London, England (1997).
71. Wolpert, D.H.: The lack of a priori distinctions between learning algorithms. Neural Computation 8 (1995) 1341-1390.