Acquisition of hierarchical reactive skills in a unified cognitive architecture

Cognitive Systems Research

Volumn 10, Issue 4, 2009, Pages 316-332

  Langley, Pat ^a   Choi, Dongkyu ^a   Rogers, Seth ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Cognitive architecture; Hierarchical skills; Incremental learning; Problem solving; Reactive control

Indexed keywords

COGNITIVE ARCHITECTURES; EXPERIMENTAL STUDIES; INCREMENTAL LEARNING; PHYSICAL ENVIRONMENTS; REACTIVE CONTROL; REACTIVE SKILLS;

LEARNING SYSTEMS;

PROBLEM SOLVING;

ARTICLE; COGNITION; CONCEPT FORMATION; DRIVING ABILITY; HUMAN; LEARNING; LONG TERM MEMORY; MEDICAL RESEARCH; MENTAL TASK; PRIORITY JOURNAL; PROBLEM SOLVING; SKILL RETENTION; URBAN AREA;

EID: 71749084105     PISSN: None     EISSN: 13890417     Source Type: Journal    
DOI: 10.1016/j.cogsys.2008.07.003     Document Type: Article

References (39)

1. Anderson J.R. Rules of the mind (1993), Lawrence Erlbaum, Hillsdale, NJ
2. Asgharbeygi N., Nejati N., Langley P., and Arai S. Guiding inference through relational reinforcement learning. Proceedings of the fifteenth international conference on inductive logic programming (2005), Springer, Bonn, Germany
3. Benson S. Inductive learning of reactive action models. Proceedings of the twelfth international conference on machine learning (1995), Morgan Kaufman, San Francisco 47-54
4. Choi D., Kaufman M., Langley P., Nejati N., and Shapiro D. An architecture for persistent reactive behavior. Proceedings of the third international joint conference on autonomous agents and multi agent systems (2004), ACM Press, New York 988-995
5. Choi D., and Langley P. Learning teleoreactive logic programs from problem solving. Proceedings of the fifteenth international conference on inductive logic programming (2005), Springer, Bonn, Germany
6. Doyle J. A truth maintenance system. Artificial Intelligence 12 (1979) 231-272
7. Fern A., Yoon S.W., and Givan R. Learning domain-specific control knowledge from random walks. Proceedings of the fourteenth international conference on automated planning and scheduling (2004), AAAI Press, Whistler, BC 191-199
8. Forgy C.L. Rete: A fast algorithm for the many pattern/many object pattern match problem. Artificial Intelligence 19 (1982) 17-37
9. Iba G.A. A heuristic approach to the discovery of macro-operators. Machine Learning 3 (1989) 285-317
10. Ilghami, O., Nau, D. S., Muñoz-Avila, H., & Aha, D. W. (2002). CaMeL: Learning method preconditions for HTN planning. In Proceedings of the sixth international conference on AI planning and scheduling (pp. 131-142). Toulouse, France.
11. Jones R.M., and VanLehn K. Acquisition of children's addition strategies: A model of Impasse-free, knowledge-level learning. Machine Learning 16 (1994) 11-36
12. Jones R.M., and Langley P. A constrained architecture for learning and problem solving. Computational Intelligence 21 (2005) 480-502
13. Khardon R. Learning to take actions. Machine Learning 35 (1999) 57-90
14. Laird J.E., Rosenbloom P.S., and Newell A. Chunking in Soar: The anatomy of a general learning mechanism. Machine Learning 1 (1986) 11-46
15. Langley P., and Choi D. Learning recursive control programs from problem solving. Journal of Machine Learning Research 7 (2006) 493-518
16. Langley, P., Cummings, K., & Shapiro, D. (2004). Hierarchical skills and cognitive architectures. In Proceedings of the 26th annual conference of the cognitive science society (pp. 779-784). Chicago, IL.
17. Langley P., McKusick K.B., Allen J.A., Iba W.F., and Thompson K. A design for the Icarus architecture. SIGART Bulletin 2 (1991) 104-109
18. Langley, P., & Rogers, S. (2005). An extended theory of human problem solving. Proceedings of the twenty-seventh annual meeting of the cognitive science society. Stresa, Italy.
19. Langley P., and Stromsten S. Learning context-free grammars with a simplicity bias. Proceedings of the eleventh European conference on machine learning (2000), Springer, Barcelona 220-228
20. Marsella S., and Schmidt C.F. A method for biasing the learning of nonterminal reduction rules. In: Minton S. (Ed). Machine learning methods for planning (1993), Morgan Kaufmann, San Mateo, CA
21. Minton S.N. Quantitative results concerning the utility of explanation-based learning. Artificial Intelligence 42 (1990) 363-391
22. Mooney R.J. The effect of rule use on the utility of explanation-based learning. Proceedings of the eleventh international joint conference on artificial intelligence (1989), Morgan Kaufmann, Detroit 725-730
23. Nardi D., and Brachman R.J. An introduction to description logics. In: Baader F., et al. (Ed). Description logic handbook (2002), Cambridge University Press, Cambridge
24. Nejati, N., Langley, P., & Konik, T. (2006). Learning hierarchical task networks by observation. In Proceedings of the 23rd international conference on machine learning. Pittsburgh, PA.
25. Neves D.M., and Anderson J.R. Knowledge compilation: Mechanisms for the automatization of cognitive skills. In: Anderson J.R. (Ed). Cognitive skills and their acquisition (1981), Erlbaum, Hillsdale, NJ
26. Newell A. Unified theories of cognition (1990), Harvard University Press, Cambridge, MA
27. Newell, A., Shaw, J. C., & Simon, H. A. (1960). Report on a general problem-solving program for a computer. In Information processing: Proceedings of the international conference on information processing (pp. 256-264). Paris: UNESCO House.
28. Nilsson N. Teleoreactive programs for agent control. Journal of Artificial Intelligence Research 1 (1994) 139-158
29. Pfleger K. On-line cumulative learning of hierarchical sparse n-grams. Proceedings of the third international conference on development and learning (2004), IEEE Press, San Diego, CA
30. Reddy C., and Tadepalli P. Learning goal-decomposition rules using exercises. Proceedings of the fourteenth international conference on machine learning (1997), Morgan Kaufmann, San Francisco
31. Richman H.B., Staszewski J.J., and Simon H.A. Simulation of expert memory using EPAM IV. Psychological Review 102 (1995) 305-330
32. Ruby D., and Kibler D. SteppingStone: An empirical and analytical evaluation. Proceedings of the tenth national conference on artificial intelligence (1991), AAAI Press, Menlo Park, CA 527-532
33. Sage S., and Langley P. Modeling development on the balance scale task. Proceedings of the eighth international joint conference on artificial intelligence (1983), Morgan Kaufmann, Karlsruhe, West Germany
34. Sammut C., and Banerji R.B. Learning concepts by asking questions. In: Michalski R.S., Carbonell J.G., and Mitchell T.M. (Eds). Machine learning: An artificial intelligence approach Vol. 2 (1986), Morgan Kaufmann, Los Altos, CA
35. Shapiro D., Langley P., and Shachter R. Using background knowledge to speed reinforcement learning in physical agents. Proceedings of the fifth international conference on autonomous agents (2001), ACM Press, Montreal 254-261
36. Shavlik J.W. Acquiring recursive concepts with explanation-based learning. Proceedings of the eleventh international joint conference on artificial intelligence (1989), Morgan Kaufmann, Detroit, MI 688-693
37. Stone P., and Veloso M.M. Layered learning. Proceedings of the eleventh european conference on machine learning (2000), Springer-Verlag, Barcelona
38. Utgoff, P., & Stracuzzi, D. (2002). Many-layered learning. In Proceedings of the second international conference on development and learning (pp. 141-146).
39. Veloso M.M., and Carbonell J.G. Derivational analogy in Prodigy: Automating case acquisition, storage, and utilization. Machine Learning 10 (1993) 249-278