Fast and robust incremental action prediction for interactive agents

Computational Intelligence

Volumn 21, Issue 1, 2005, Pages 90-110

  Dinerstein, Jonathan ^a   Ventura, Dan ^a   Egbert, Parris K ^a  

^a 3361 TMCB   (United States)

Author keywords

Action prediction; Agent modeling; Autonomous agents; Plan recognition; User modeling

Indexed keywords

AUTONOMOUS AGENTS; COMPETITION; COMPUTER SOFTWARE; DECISION MAKING; LEARNING SYSTEMS; MATHEMATICAL MODELS; PERSONNEL TRAINING; PROBLEM SOLVING; ROBUSTNESS (CONTROL SYSTEMS); SIMULATORS; USER INTERFACES; VIRTUAL REALITY;

ACTION PREDICTION; AGENT MODELING; PLAN RECOGNITION; USER MODELING;

INTERACTIVE DEVICES;

EID: 14844345518     PISSN: 08247935     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.0824-7935.2005.00266.x     Document Type: Article

References (35)

1. BLUMBERG, B., M. DOWNIE, Y. IVANOV, M. BERLIN, M. P. JOHNSON, and B. TOMLINSON. 2002. Integrated learning for interactive synthetic characters. In Proceedings of SIGGRAPH 2002, pp. 417-426.
2. BROOKS, R. 1986. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 2:14-23.
3. BUI, H., D. KIERONSKA, and S. VENKATESH. 1996. Learning other agents' preferences in multiagent negotiation. In Thirteenth National Conference on Artificial Intelligence, pp. 114-119.
4. CARBERRY, S. 2001. Techniques for plan recognition. In User Modeling and User-Adapted Interaction, Vol. 11. pp. 31-48.
5. CARMEL, D., and S. MARKOVITCH. 1996a. Incorporating opponent models into adversary search. In Thirteenth National Conference on Artificial Intelligence, pp. 120-125.
6. CARMEL, D., and S. MARKOVITCH. 1996b. Learning models of intelligent agents. In Thirteenth National Conference on Artificial intelligence, pp. 62-67.
7. EVANS, R. 2002. Varieties in learning. In AI Game Programming Wisdom, pp. 567-578. Edited by E. Rabin. Charles River Media, Hingham MA.
8. GMYTRASIEWICZ, P., and E. DURFEE. 2000. Rational coordination in multi-agent environments. Autonomous Agents and Multi-Agent Systems, 3(4):319-350.
9. GMYTRASIEWICZ, P., and E. DURFEE. 2001. Rational communication in multi-agent environments. Autonomous Agents and Multi-Agent Systems, 4:233-272.
10. HU, J., and M. P. WELLMAN. 1998. Online learning about other agents in a dynamic multiagent system. In Second International Conference on Autonomous Agents, pp. 239-246.
11. ISBELL, C. JR., C. SHELTON, M. KEARNS, S. SINGH, and P. STONE. 2001. A social reinforcement learning agent. In Fifth International Conference on Autonomous Agents, pp. 377-384.
12. ISLA, D., R. BURKE, M. DOWNIE, and B. BLUMBERG. 2001. A layered brain architecture for synthetic creatures. In Proceedings of IJCAI, pp. 1051-1058.
13. KAMINKA, G., M. VELESO, S. SCHAFFER, C. SOLLITTO, R. ADOBBATI, A. MARSHALL, A. SCHOLER, and S. TEJADA. 2002. Gamebots: A flexible test bed for multiagent team research. Communications of the ACM, 45(1):43-45.
14. KASPER, M., G. FRICKE, K. STEUERNAGEL, and E. VON PUTTKAMER. 2001. A behavior-based mobile robot architecture for learning from demonstration. Robotics and Autonomous Systems, 34:153-164.
15. KERKEZ, B., and M. COX. 2003. Incremental case-based plan recognition with local predictions. International Journal of Artificial Intelligence Tools, 12(4):413-463.
16. LAIRD, J. 2001. It knows what you're going to do: Adding anticipation to the quakebot. In Proceedings of the Fifth International Conference on Autonomous Agents, pp. 385-392.
17. LITTMAN, M. 1994. Markov games as a framework for multi-agent reinforcement learning. In Proceedings of ML94, pp. 157-163.
18. MATARIC, M. 2000. Getting humanoids to move and imitate. IEEE Intelligent Systems, July: 18-24.
19. NADEL, L. 2003. Encyclopedia of Cognitive Science, Nature Pub. Group, London.
20. NICOLESCU, M. 2003. A framework for learning from demonstration, generalization and practice in human-robot domains. PhD Thesis, University of Southern California.
21. PRICE, R. 2002. Accelerating reinforcement learning through imitation. PhD Thesis, University of British Columbia.
22. REYNOLDS, C. 1987. Flocks, herds, and schools: A distributed behavioral model. In Proceedings of SIGGRAPH 1987, pp. 25-34.
23. ROVATSOS, M., G. WEIB, and B. WOLF. 2003. Multiagent learning for open systems: A study on opponent classification. In Lecture Notes on AI 2636, pp. 66-87. Edited by E. Alonso, D. Kudenko, and D. Kazakov. Springer.
24. RUSSELL, S., and P. NORVIG. 2003. Artificial Intelligence: A Modern Approach, second edition. Prentice-Hall, Englewood Cliffs, NJ.
25. SEN, S., and N. ARORA. 1997. Learning to take risks. In Collected papers from American Association for Artificial Intelligence (AAAI-97) workshop on multiagent learning, pp. 59-64.
26. STONE, P., and M. VELOSO. 1997. Multiagent systems: A survey from a machine learning perspective. Autonomous Robots, 8(3):345-383.
27. STONE, P. 2000. Layered Learning in Multi-Agent Systems: A Winning Approach to Robotic Soccer. MIT Press, Cambridge, MA.
28. SUTTON, R., and A. BARTO. 1998. Reinforcement Learning: An Introduction. MIT Press, Cambridge, Massachusetts.
29. TOMLINSON, B., and B. BLUMBERG 2002. Alphawolf: Social learning, emotion and development in autonomous virtual agents. In First NASA Goddard Space Flight Center/NASA Jet Propulsion Laboratory Workshop on Radical Agent Concepts.
30. TRAN, T., and R. COHEN 2002. A reputation-oriented reinforcement learning strategy for agents in electronic marketplaces. Computational Intelligence, 18(4):550-565.
31. VAN LENT, M., and J. LAIRD 1998. Behavior capture: Motion is only skin deep. In Proceedings of Lifelike Computer Characters.
32. VIDAL, J., and E. DURFEE 1997. Agents learning about agents: A framework and analysis. In Collected papers from American Association for Artificial Intelligence (AAAI-97) workshop on multiagent learning, pp. 71-76.
33. WEISS, G. 1999. Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. MIT Press.
34. WILSON, D. R., and T. MARTINEZ. 2000. An integrated instance-based learning algorithm. Computational Intelligence, 16(1):1-28.
35. ZHU, T., R. GREINER, and G. HAUBL. 2003. Learning a model of a web user's interests. In Ninth International Conference on User Modeling.