A markov game-adaptive fuzzy controller for robot manipulators

IEEE Transactions on Fuzzy Systems

Volumn 16, Issue 1, 2008, Pages 171-186

  Sharma, Rajneesh ^a   Gopal, M ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

Author keywords

Fuzzy Q learning (FQL); Markov game adaptive fuzzy controller; Markov games; SCARA robot; Two link robot arm

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; GAME THEORY; MANIPULATORS; MARKOV PROCESSES; ROBOTIC ARMS; ROBOTICS; STATE SPACE METHODS;

FUZZY Q-LEARNING; MARKOV GAME FORMULATION; ROBOT MANIPULATORS;

FUZZY CONTROL;

EID: 40549092708     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2007.903323     Document Type: Article

References (21)

1. R. Sharma and M. Gopal, "A robust Markov game controller for nonlinear systems," Appl. Soft Comput. J., vol. 7, no. 3, pp. 818-827, Jun. 2007.
2. R. Sharma and M. Gopal, "Reinforcement learning based game-the-oretic neural controller," in Proc. Amer. Control Conf., Minneapolis, MN, Jun. 14-16, 2006, pp. 2975-2980.
3. L. Jouffe, "Fuzzy inference system learning by reinforcement methods," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 28, no. 3, pp. 338-355, Aug. 1998.
4. P. Y. Glorennec and L. Jouffe, "Fuzzy Q-learning," in Proc. 6th IEEE Conf. Fuzzy Systems, Barcelona, Spain, Jul. 1-5, 1997, vol. 2, pp. 659-662.
5. C. K. Lin, "A reinforcement learning adaptive fuzzy controller for robots," Fuzzy Sets Syst., vol. 137, pp. 339-352, 2003.
6. M. Saad, L. A. Dessaint, P. Bigras, and Al-Haddad, "Adaptive versus neural adaptive control: Application to robotics," Int. J. Adapt. Control Signal Process., vol. 8, pp. 223-236, 1994.
7. F. L. Lewis, S. Jagannathan, and A. Yesildirek, Neural Network Control of Robotic Manipulators and Nonlinear Systems. London, U.K.: Taylor and Francis, 1999.
8. R. S. Sutton, A. G. Barto, and R. J. Williams, "Reinforcement learning is direct adaptive optimal control," IEEE Control Syst. Mag., vol. 12, no. 2, pp. 19-22, Feb. 1992.
9. J. Morimoto and K. Doya, "Robust reinforcement learning," Neural Comput., vol. 17, pp. 335-359, 2005.
10. Y. H. Kim and F. L. Lewis, "Direct-reinforcement-adaptive-learning neural network control for nonlinear systems," in Proc. American Control Conf., Albuquerque, NM, Jun. 1997, pp. 1804-1808.
11. M. L. Littman, "Value-function reinforcement learning in Markov games," J. Cogn. Syst. Res., vol. 2, pp. 55-66, 2001.
12. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction Cambridge, MA: MIT Press, 1998.
13. M. L. Littman, "Markov games as a framework for multi-agent reinforcement learning," in Proc. 11th Int. Conf. Machine Learning San Francisco, CA, 1994, pp. 157-163, Morgan Kaufmann.
14. G. Strang, Linear Algebra and Its Applications. Orlando, FL: Academic, 1980.
15. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
16. M. G. Lagoudakis and R. Parr, "Value function approximation in zero-sum Markov games," in Proc. 18th Conf. Uncertainty in Artificial Intelligence, Edmonton, AB, Canada, Aug. 1-4, 2002, pp. 283-292.
17. M. G. Lagoudakis and R. Parr, "Learning in zero-sum team Markov games using factored value functions," in Proc. Neural Information Processing Systems (NIPS): Natural and Synthetic, Vancouver, BC, Canada, Dec. 2002, pp. 1659-1666.
18. L. X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least-squares learning," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 807-814, Sep. 1992.
19. M. L. Littman, "Algorithms for sequential decision making," Ph.D. dissertation, Dept. Comput. Sci., Brown Univ., Providence, RL Mar. 1996.
20. M. Heger, "Consideration of risk in reinforcement learning," in Proc. 11th Int. Conf. Machine Learning, San Francisco, CA, 1994, pp. 105-111.
21. P. McCracken and M. Bowling, "Safe strategies for agent modeling in games," presented at the AAAI Fall Symposium on Artificial Multi-Agent Learning, San Jose, CA, Oct. 2004.