Fuzzy Q-learning in a nondeterministic environment: Developing an intelligent Ms. Pac-Man agent

CIG2009 - 2009 IEEE Symposium on Computational Intelligence and Games

Volumn , Issue , 2009, Pages 162-169

  DeLooze, Lori L ^a   Viner, Wesley R ^a,b  

^a UNITED STATES NAVAL ACADEMY   (United States)

^b United States Marine Corps   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CURRENT SITUATION; FUZZY-Q-LEARNING; LEARNING STRATEGY; MEMBERSHIP VALUES; SELF-LEARNING; VIDEO GAME;

ARTIFICIAL INTELLIGENCE; EDUCATION;

LEARNING ALGORITHMS;

EID: 71549136167     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIG.2009.5286478     Document Type: Conference Paper

References (18)

1. K. Uston, Mastering Ms. Pac-Man. Macdonald and Co. 1981.
2. S. Lucas, "Ms. Pac-Man Competition," Available at http://dces.essex.ac.uk/staff/sml/pacman/CEC2009Results.html (accessed 6/12/09).
3. A. Fitzgerald, P. Kemeraitis, and C. B. Congdon, "RAMP: A Rule-Based Agent for Ms. Pac-Man," in Proc. IEEE World Congress in Computational Intelligence (WCCI2008), Hong Kong, 2008.
4. "Ms. Pac-Man Game," Available at http://www.webpacman.com/ mspacman.htm (accessed 6/13/09).
5. L. A. Zadeh. Fuzzy sets. Journal of Information and Control, 8:338-353, 1965.
6. S. P. Singh, T. Jaakkola, and M. I. Jordan, "Reinforcement Learning with Soft State Aggregation," Advances in Neural Information Processing, 7:361-368, 1994.
7. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. MIT Press, 1998.
8. C. J. Watkins and P. Dayan. "Q-Learning," Machine Learning, 8:279-292, 1992.
9. H. Berenji and D. Vengerov, "Advantages of Cooperation between Reinforcement Learning Agents in Difficult Stochastic Problems," In Proc. IEEE International Conference on Fuzzy Systems, pages 871-876, 2000.
10. H. R. Berenji and D. Vengerov. "Cooperation and coordination between Fuzzy Reinforcement Learning Agents in Continuous State Partially Observable Markov Decision Processes," In Proc. IEEE International Fuzzy Systems Conference, pages 621-627, 1999.
11. D. Gu and H. Hu, "Reinforcement Learning of Fuzzy Logic Controllers for Quadruped Walking Robots," In Proc. 15th IFAC World Congress, 2002.
12. D. Gu and H. Hu, "Learning Fuzzy Logic Controller for Reactive Robot Behaviours," In Proc. International Conference on Advanced Intelligent Mechatronics, 2003.
13. J. Ammerlaan and D. Wright, "Adaptive Cooperative Fuzzy Logic Controller," In Proc ACS Conferences in Research and Practice in Information Technology (CRPIT), 2004.
14. T. Nakashima, M. Udo, and H. Ishibuchi, "Acquiring the Positioning Skill in a Soccer Game using Fuzzy Q-learning," In Proc. IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp. 1488-1491, 2003.
15. D. C.Wardell and G. L. Peterson, "Fuzzy State Aggregation and Policy Hill Climbing for Stochastic Environments," International Journal of Computational Intelligence and Applications, 6(3):413-428, 2006.
16. H. Handa, "Constitution of Ms. Pac-Man Player with Critical-Situation Learning Mechanism", In Proc. 4th International Workshop on Computational Intelligence and Applications, Hiroshima, Japan, 2008.
17. Data Structures and Algorithms in Java, John Wiley and Sons, 2006.
18. N. Wirth and M. Gallagher, "An Influence Map Model for Playing Ms. Pac-Man," In Proc of IEEE Symposium on Computational Intelligence and Games (CIG'08), Perth, Australia, 2008.