Learning continuous action models in a real-time strategy environment

Proceedings of the 21th International Florida Artificial Intelligence Research Society Conference, FLAIRS-21

Volumn , Issue , 2008, Pages 257-262

  Molineaux, Matthew ^a   Aha, David W ^b   Moore, Philip ^a  

^a KNEXUS RESEARCH CORPORATION   (United States)

^b NAVAL RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BASE-LINES; CASE-BASED REASONINGS; CONTINUOUS ACTIONS; CONTINUOUS MODELS; DISCRETE APPROXIMATIONS; EMPIRICAL STUDIES; INTEGRATED METHODS; OPTIMAL SOLUTIONS; STATE SPACES; TIME STRATEGIES;

ARTIFICIAL INTELLIGENCE; REAL TIME SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING;

CASE BASED REASONING;

EID: 55849083055     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Aha, D.W., Molineaux, M., & Ponsen, M. (2005). Learning to win: Case-based plan selection in a real-time strategy game. Proceedings of the Sixth International Conference on Case-Based Reasoning (pp. 5-20). Chicago, IL: Springer.
2. Aha, D.W., Muñoz-Avila, H., & van Lent, M. (Eds.) (2005). Reasoning, Representation, and Learning in Computer Games: Papers from the IJCAI Workshop (Technical Report AIC-05-127). Washington, DC: Naval Research Laboratory, Navy Center for Applied Research in Artificial Intelligence.
3. Aha, D. W., & Salzberg, S. L. (1994). Learning to catch: Applying nearest neighbor algorithms to dynamic control tasks. In P. Cheeseman & R. W. Oldford (Eds.), Selecting Models from Data: AI and Statistics IV. New York: Springer.
4. AIIDE (2007). 2007 ORTS RTS Game AI Competition. [http://www.cs.ualberta. ca/~mburo/orts/AIIDE07]
5. Albus, J.S. (1975). A new approach to manipulator control: The cerebellar model articulation controller. Journal of Dynamic Systems, Measurement, and Control, 97(3), 220-227.
6. Andrade, G., Ramalho, G., Santana, H., & Corruble, V. (2005). Extending reinforcement learning to provide dynamic game balancing. In (Aha et al., 2005).
7. Atkeson, C., Moore, A., & Schaal, S. (1997). Locally weighted learning. Artificial Intelligence Review, 11(1-5), 11-73
8. Buck, S., Beetz, M., & Schmitt, T. (2002). Approximating the value function for continuous space reinforcement learning in robot control. Proceedings of the International Conference on Intelligent Robots and Systems (pp. 1062-1067). Lausanne, Switzerland: IEEE Press.
9. Buro, M. (2002). ORTS: A hack-free RTS game environment. Proceedings of the International Computers and Games Conference (pp. 280-291). Edmonton, Canada: Springer.
10. Buro, M. (2003). Real-time strategy games: A new AI research challenge. Proceedings of the Eighteenth IJCAI (pp. 1534-1535). Acapulco, Mexico: Morgan Kaufmann.
11. Chan, H., Fern, A., Ray, S., Wilson, N., & Ventura, C. (2007). Online planning for resource production in real-time strategy games. In Proc. of the In. Conference on Automated Planning and Scheduling. Providence, Rhode Island: AAAI Press.
12. Gaskett, C., Wettergreen, D., & Zelinski, A. (1999). Q-learning in continuous state and action spaces. Proceedings of the Twelfth Australian Joint Conference on Artificial Intelligence (pp. 417-428). Sydney, Australia: Springer.
13. Guestrin, C., Koller, D., Gearhart, C., & Kanodia, N. (2003). Generalizing plans to new environments in relational MDPs. Proceedings of the Eighteenth IJCAI (pp. 1003-1010), Acapulco, Mexico: Morgan Kaufmann
14. Kaelbling, L.P., Littman, M.L., & Moore, A.W. (1996). Reinforcement learning: A survey. JAIR, 4, 237-285.
15. Marthi, B., Latham, D., Russell, S., & Guestrin, C. (2005). Concurrent hierarchical reinforcement learning. Proceedings of the Nineteenth International Joint Conference on AI. (pp. 779-785). Edinburgh, Scotland: Professional Book Center.
16. del R. Millán, J., Posenato, D., & Dedieu, E. (2002). Continuous-action Q-learning. Machine Learning, 49,247-265.
17. Flanagan, M. (2007). Michael Thomas Flanagan's Java Scientific Library. [http://www.ee.ucl.ac.uk/~mflanaga]
18. NIPS (2008). RL 2008 Competition: Real-Time Strategy. [http://rl-competition.org/content/view/20/36]
19. Ontañón, S., Mishra, K., Sugandh, N., & Ram, A. (2007). Case-based planning and execution for real-time strategy games. Proceedings of the Seventh International Conference on Case-Based Reasoning (pp. 164-178). Belfast, N. Ireland: Springer.
20. Ponsen, M.J.V., Lee-Urban, S., Muñoz-Avila, H., Aha, D.W., & Molineaux, M. (2005). Stratagus: An open-source game engine for research in RTS games. In (Aha et al., 2005).
21. Ponsen, M.S.V., Spronck, P., Muñoz-Avila, H., & Aha, D.W. (2006). Automatically generating game tactics through evolutionary learning. AI Magazine, 27(3), 75-84.
22. Ram, A., & Santamaria, J.C. (1997). Continuous case-based reasoning. Artificial Intelligence, 90(1-2), 25-77.
23. nd ed.). Upper Saddle River, NJ: Prentice Hall.
24. Sailer, F., Buro, M., Lanctot, M. (2007). Adversarial planning through strategy simulation. In Proceedings of the Symposium on Computational Intelligence in Games. Hawaii, HO: IEEE.
25. Santamaria, J.C., Sutton, R., & Ram, A. (1998). Experiments with reinforcement learning in problems with continuous state and action spaces. Adaptive Behavior, 6(2): 163-217.
26. Sharma, M., Holmes, M., Santamaria, J.C., Irani, A., Isbell, C., & Ram, A. (2007). Transfer learning in real-time strategy games using hybrid CBR/RL. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence. [http://www.ijcai.org/papers07/contents.php]
27. Sheppard, J.W., & Salzberg, S.L. (1997). A teaching strategy for memory-based control. AI Review, 11(1-5), 343-370.
28. Smart, W.D., & Kaelbling, L.P. (2000). Practical reinforcement learning in continuous spaces. Proceedings of the Eighteenth International Conference on Machine Learning (pp. 903-910). Stanford, CA: Morgan Kaufmann.
29. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
30. Takahashi, Y, Takeda, M., & Asada, M. (1999). Continuous valued Q-learning for vision-guided behavior acquisition. Proceedings of the International Conference on Multisensor Fusion and Integration for Intelligent Systems (pp.255-260). Taipei, Taiwan: IEEE Press.
31. TIELT (2007). Testbed for integrating and evaluating learning techniques, [http://www.tielt.org]