A hybrid agent architecture integrating desire, intention and reinforcement learning

Expert Systems with Applications

Volumn 38, Issue 7, 2011, Pages 8477-8487

  Tan, Ah Hwee ^a   Ong, Yew Soon ^a   Tapanuj, Akejariyawong ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

BDI architecture; Minefield navigation; Plan learning; Reinforcement learning; Self organizing neural networks

Indexed keywords

ACTION EXECUTION; BDI AGENT; BDI ARCHITECTURE; DELIBERATIVE PLANNING; EMPIRICAL RESULTS; FUSION ARCHITECTURE; HYBRID AGENT ARCHITECTURE; HYBRID ARCHITECTURES; LEARNING MODULES; MINEFIELD NAVIGATION; PLAN LEARNING; REAL-TIME ENVIRONMENT; REINFORCEMENT SIGNAL; ROBUST PERFORMANCE; SELF-ORGANIZING NEURAL NETWORKS; TEMPORAL DIFFERENCES;

DECISION MAKING; NAVIGATION; NETWORK ARCHITECTURE; NEURAL NETWORKS; REINFORCEMENT;

REINFORCEMENT LEARNING;

EID: 79952438883     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.01.045     Document Type: Article

References (31)

1. M. Anderson Embodied cognition: A field guide Artificial Intelligence 149 2003 91 130
2. J. Anderson, D. Bothell, and M. Byrne An integrated theory of the mind Psychological Review 111 4 2004 1036 1060 (Pubitemid 39375086)
3. M. Bratman, D. Israel, and M. Pollack Plans and resource-bounded practical reasoning Computational Intelligence 4 4 1988 349 355
4. R. Brooks Cambrian intelligence: The early history of the new AI 1999 MIT Press [A Bradford Book]
5. G.A. Carpenter, and S. Grossberg A massively parallel architecture for a self-organizing neural pattern recognition machine Computer Vision, Graphics, and Image Processing 37 1987 54 115
6. G.A. Carpenter, S. Grossberg, and D.B. Rosen Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system Neural Networks 4 1991 759 771
7. Gordan, D., Subramanian, D. (1997). A cognitive model of learning to navigate. In Proceedings of nineteenth annual conference of the Cognitive Science Society (pp. 271-276).
8. Guerra-Hernandez, A., Fallah-Seghrouchni, A. E., Soldano, H. (2004). Learning in BDI multi-agent systems. In Proceedings, fourth international workshop on computational logic in multi-agent systems, Fort Lauderdale, FL.
9. L. Kaelbling, M. Littman, and A. Moore Reinforcement learning: A survey Journal of Artificial Intelligence Research 4 1996 237 285 (Pubitemid 126646155)
10. Karim, S., Sonenberg, L., Tan, A.-H. (2006). A hybrid architecture combining reactive plan execution and reactive learning. In Proceedings of the 9th Biennial Pacific Rim international conference on artificial intelligence (PRICAI'06), LNAI 4099, Guilin, China (pp. 200-211). (Pubitemid 44531800)
11. Karim, S., Subagdja, B., Sonenberg, L. (2006). Plans as products of learning. In IAT'06: Proceedings of the IEEE/WIC/ACM international conference on Intelligent Agent Technology (pp. 139-145). (Pubitemid 351210115)
12. Kinny, D., Georgeff, M. P. (1991). Commitment and effectiveness of situated agents. In Proceedings of twelfth international joint conference on artificial intelligence (pp. 82-88).
13. C. Lebiere, and D. Wallach Sequence learning in the act-r cognitive architecture: Empirical analysis of a hybrid model R. Sun, C. Giles, Sequence Learning LNAI Vol. 1828 2000 Springer-Verlag 188 212 (Pubitemid 33221930)
14. Norling, E. (2004). Folk psychology for human modelling: Extending the BDI paradigm. In Proceedings, AAMAS'04, New York, USA (pp. 202-209).
15. M.E. Pollack The uses of plans Artificial Intelligence 57 1992 43 68
16. J. Si, A.G. Barto, W.B. Powell, D. Wunsch, Handbook of learning and approximate dynamic programming 2004 Wiley-IEEE Press
17. Subagdja, B., Sonenberg, L. (2005). Learning plans with patterns of actions in bounded-rational agents. In Proceedings of the 9th international conference, KES 2005 (Vol.3, pp. 30-36). (Pubitemid 43936061)
18. R. Sun Beyond simple rule extraction: The extraction of planning knowledge from reinforcement learners Proceedings of the international joint conference on neural networks, Como, Italy 2000 IEEE Press Piscataway, NJ 24 27
19. R. Sun, C. Giles, Sequence learning: Paradigms, algorithms, and applications LNAI Vol. 1828 2000 Springer-Verlag
20. R. Sun, and C. Sessions Learning plans without a priori knowledge Adaptive Behavior 8 3/4 2000 225 254 (Pubitemid 34334586)
21. R. Sutton, and A. Barto Reinforcement learning: An introduction 1998 MIT Press Cambridge, MA
22. A.-H. Tan Adaptive resonance associative map Neural Networks 8 3 1995 437 446
23. Tan, A.-H. (2004). FALCON: A fusion architecture for learning, cognition, and navigation. In Proceedings of the international joint conference on neural networks (pp. 3297-3302). (Pubitemid 40011563)
24. Tan, A.-H. (2007). Direct code access in self-organizing neural architectures for reinforcement learning. In Proceedings of the international joint conference on artificial intelligence (IJCAI07), Hyderabad, India (pp. 1071-1076).
25. Tan, A.-H., Xiao, D. (2005). Self-organizing cognitive agents and reinforcement learning in a multi-agent environment. In Proceedings of the IEEE/WIC/ACM international conference on intelligent agent technology (IAT'05), France (pp. 351-357). (Pubitemid 46116575)
26. Tan, A.-H., Carpenter, G. A., Grossberg, S. (2007). Intelligence through interaction: Towards a unified theory for learning. In Proceedings of ISNN, LNCS (Vol. 4491, pp. 1098-1107).
27. A.-H. Tan, N. Lu, and D. Xiao Integrating temporal difference methods and self-organizing neural networks for reinforcement learning with delayed evaluative feedback IEEE Transactions on Neural Networks 9 2 2008 230 244 (Pubitemid 351359289)
28. A.-H. Tan, and H. Pan Predictive neural networks for gene expression data analysis Neural Networks 18 3 2005 297 306 (Pubitemid 40719531)
29. P. Wallis Intention without representation Journal of Philosophical Psychology 17 16 2004 209 224
30. C. Watkins, and P. Dayan Q-learning Machine Learning 8 3/4 1992 279 292
31. D. Xiao, and A.-H. Tan Self-organizing neural architectures and cooperative learning in multi-agent environment IEEE Transactions on Systems, Man, and Cybernetics - Part B 37 6 2007 1567 1580 (Pubitemid 350201163)