Q(λ)-learning fuzzy logic controller for a multi-robot system

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2010, Pages 4075-4080

  Desouky, Sameh F ^a   Schwartz, Howard M ^a  

^a CARLETON UNIVERSITY   (Canada)

Author keywords

Differential game; Function approximation; Fuzzy control; Multi robot; Pursuit evasion; Q( ) learning; Reinforcement learning

Indexed keywords

CLASSICAL CONTROL; CONTROL STRATEGIES; DIFFERENTIAL GAMES; FUNCTION APPROXIMATION; FUZZY INFERENCE SYSTEMS; FUZZY LOGIC CONTROLLERS; MULTI-ROBOT SYSTEMS; MULTIROBOTS; NOVEL TECHNIQUES; OUTPUT PARAMETERS; PURSUIT EVASION; Q-LEARNING; TRAINING DATA;

COMPUTER SIMULATION; CONTROLLERS; CYBERNETICS; FUZZY CONTROL; FUZZY SYSTEMS; GAME THEORY; INDUSTRIAL ROBOTS; MULTIPURPOSE ROBOTS; NEURAL NETWORKS; REINFORCEMENT LEARNING;

FUZZY INFERENCE;

EID: 78751479831     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2010.5641791     Document Type: Conference Paper

References (24)

1. X. Dai, C. K. Li, and A. B. Rad, "An approach to tune fuzzy controllers based on reinforcement learning for autonomous vehicle control," IEEE Transactions on Intelligent Transportation Systems, vol. 6, pp. 285-293, Sep. 2005.
2. M. Mucientes, D. L. Moreno, A. Bugarin, and S. Barro, "Design of a fuzzy controller in mobile robotics using genetic algorithms," Applied Soft Computing, vol. 7, no. 2, pp. 540-546, 2007.
3. S. F. Desouky and H. M. Schwartz, "Genetic based fuzzy logic controller for a wall-following mobile robot," in 2009 American Control Conference (ACC-09), (St. Louis, MO), pp. 3555-3560, IEEE, Jun. 2009.
4. S. F. Desouky and H. M. Schwartz, "Different hybrid intelligent systems applied for the pursuit-evasion game," in 2009 IEEE International Conference on Systems, Man, and Cybernetics, pp. 2677-2682, Oct. 2009.
5. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
6. M. Rodríguez, R. Iglesias, C. V. Regueiro, J. Correa, and S. Barro, "Autonomous and fast robot learning through motivation," Robotics and Autonomous Systems, vol. 55, pp. 735-740, Sep. 2007.
7. M. J. Er and C. Deng, "Obstacle avoidance of a mobile robot using hybrid learning approach," IEEE Transactions on Industrial Electronics, vol. 52, pp. 898-905, Jun. 2005.
8. H. Xiao, L. Liao, and F. Zhou, "Mobile robot path planning based on QANN," in IEEE International Conference on Automation and Logistics, (Jinan, China). pp. 2650-2654, Aug. 2007.
9. R. Vidal, O. Shakernia, H. J. Kim, D. H. Shim, and S. Sastry, "Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation," IEEE Transactions on Robotics and Automation, vol. 18, pp. 662-669, Oct. 2002.
10. Y. Ishiwaka, T. Satob, and Y. Kakazu, "An approach to the pursuit problem on a heterogeneous multiagent system using reinforcement learning," Robotics and Autonomous Systems, vol. 43, no. 4, pp. 245-256, 2003.
11. S. N. Givigi, H. M. Schwartz, and X. Lu, "A reinforcement learning adaptive fuzzy controller for differential games," Journal of Intelligent and Robotic Systems, 2009. DOI: 10.1007/s10846-009-9380-4.
12. L. Jouffe, "Fuzzy inference system learning by reinforcement methods," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 28, pp. 338-355, Aug. 1998.
13. Y. Duan and X. Hexu, "Fuzzy reinforcement learning and its application in robot navigation," in International Conference on Machine Learning and Cybernetics, vol. 2, (Guangzhou), pp. 899-904, IEEE, Aug. 2005.
14. A. Waldock and B. Carse, "Fuzzy q-learning with an adaptive representation," in 2008 IEEE 16th International Conference on Fuzzy Systems (FUZZ-IEEE), (Piscataway, NJ). pp. 720-725, 2008.
15. C. J. C. H. Watkins, Learning From Delayed Rewards. PhD thesis, Cambridge University, 1989.
16. C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, pp. 279-292, May 1992.
17. S. F. Desouky and H. M. Schwartz, "A novel technique to design a fuzzy logic controller using Q(λ)-learning and genetic algorithms in the pursuit-evasion game," in 2009 IEEE International Conference on Systems, Man, and Cybernetics, (San Antonio, TX), pp. 2683-2689, Oct. 2009.
18. S. F. Desouky and H. M. Schwartz, "A novel hybrid learning technique applied to a self-learning multi-robot system," in 2009 IEEE International Conference on Systems, Man, and Cybernetics, (San Antonio, TX), pp. 2690-2697, Oct. 2009.
19. D. Gu and H. Hu, "Accuracy based fuzzy Q-learning for robot behaviours," in International Conference on Fuzzy Systems, vol. 3, (Budapest, Hungary), pp. 1455-1460, Jul. 2004.
20. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its applications to modelling and control," IEEE Transactions on Systems. Man and Cybernetics, vol. SMC-15, pp. 116-132, Jan. 1985.
21. R. Isaacs, Differential Games. John Wiley and Sons, 1965.
22. J. Peng and R. J. Williams, "Incremental multi-step Q-learning," Machine Learning, vol. 22, pp. 283-290, Jan. 1996.
23. L. Jouffe, "Actor-critic learning based on fuzzy inference system," in IEEE International Conference on Systems, Man, and Cybernetics, vol. 1, (Beijing, China), pp. 339-344, Oct. 1996.
24. X. S. Wang, Y. H. Cheng, and J. Q. Yi, "A fuzzy actor-critic reinforcement learning network," Information Sciences, vol. 177, pp. 3764-3781, 2007.