Self-learning fuzzy logic controllers for pursuitevasion differential games

Robotics and Autonomous Systems

Volumn 59, Issue 1, 2011, Pages 22-33

  Desouky, Sameh F ^a   Schwartz, Howard M ^a  

^a CARLETON UNIVERSITY   (Canada)

Author keywords

Differential game; Function approximation; Fuzzy control; Genetic algorithms; Q( ) learning; Reinforcement learning

Indexed keywords

ACTION SPACES; CLASSICAL CONTROL; CONTINUOUS STATE; DIFFERENTIAL GAMES; DISCRETE STATE; FUNCTION APPROXIMATION; FUZZY INFERENCE SYSTEMS; FUZZY LOGIC CONTROLLERS; NOVEL TECHNIQUES; OUTPUT PARAMETERS; PURSUIT EVASION; Q-LEARNING; SELF-LEARNING FUZZY LOGIC CONTROLLERS; TRAINING DATA;

COMPUTER SIMULATION; CONTROLLERS; FUZZY CONTROL; FUZZY INFERENCE; FUZZY SYSTEMS; GAME THEORY; GENETIC ALGORITHMS; LEARNING ALGORITHMS; NEURAL NETWORKS; REINFORCEMENT LEARNING;

APPROXIMATION ALGORITHMS;

EID: 78649832013     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2010.09.006     Document Type: Article

References (54)

1. S. Micera, A.M. Sabatini, and P. Dario Adaptive fuzzy control of electrically stimulated muscles for arm movements Medical and Biological Engineering and Computing 37 1999 680 685
2. F. Daldaban, N. Ustkoyuncu, and K. Guney Phase inductance estimation for switched reluctance motor using adaptive neuro-fuzzy inference system Energy Conversion and Management 47 2006 485 493
3. S. Labiod, and T.M. Guerra Adaptive fuzzy control of a class of SISO nonaffine nonlinear systems Fuzzy Sets and Systems 158 10 2007 1126 1137 (Pubitemid 46428433)
4. H.K. Lam, and F.H.F. Leung Fuzzy controller with stability and performance rules for nonlinear systems Fuzzy Sets and Systems 158 2007 147 163
5. H. Hagras, V. Callaghan, and M. Colley Learning and adaptation of an intelligent mobile robot navigator operating in unstructured environment based on a novel online fuzzy-genetic system Fuzzy Sets and Systems 141 2004 107 160
6. M. Mucientes, D.L. Moreno, A. Bugarin, and S. Barro Design of a fuzzy controller in mobile robotics using genetic algorithms Applied Soft Computing 7 2 2007 540 546 (Pubitemid 46205475)
7. L.X. Wang Generating fuzzy rules by learning from examples IEEE Transactions on Systems, Man, and Cybernetics 22 1992 1414 1427
8. F. Herrera, M. Lozano, and J.L. Verdegay Tuning fuzzy logic controllers by genetic algorithms International Journal of Approximate Reasoning 12 1995 299 315
9. A. Lekova, L. Mikhailov, D. Boyadjiev, and A. Nabout Redundant fuzzy rules exclusion by genetic algorithms Fuzzy Sets and Systems 100 1998 235 243
10. S.F. Desouky, and H.M. Schwartz Genetic based fuzzy logic controller for a wall-following mobile robot 2009 American Control Conference 2009 IEEE Press St. Louis, MO 3555 3560
11. S.F. Desouky, H.M. Schwartz, Different hybrid intelligent systems applied for the pursuitevasion game, in: 2009 IEEE International Conference on Systems, Man, and Cybernetics, 2009, pp. 26772682.
12. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 MIT Press Cambridge, MA
13. L.P. Kaelbling, M.L. Littman, and A.P. Moore Reinforcement learning: a survey Journal of Artificial Intelligence Research 4 1996 237 285
14. W.D. Smart, L.P. Kaelbling, Effective reinforcement learning for mobile robots, in: IEEE International Conference on Robotics and Automation, Washington, DC, vol. 4, 2002, pp. 34043410.
15. C. Ye, N.H.C. Yung, and D. Wang A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics 33 2003 17 27
16. T. Kondo, and K. Ito A reinforcement learning with evolutionary state recruitment strategy for autonomous mobile robots control Robotics and Autonomous Systems 46 2004 111 124
17. D.A. Gutnisky, and B.S. Zanutto Learning obstacle avoidance with an operant behavior model Artificial Life 10 1 2004 65 81
18. M. Rodrguez, R. Iglesias, C.V. Regueiro, J. Correa, and S. Barro Autonomous and fast robot learning through motivation Robotics and Autonomous Systems 55 2007 735 740
19. X. Dai, C.K. Li, and A.B. Rad An approach to tune fuzzy controllers based on reinforcement learning for autonomous vehicle control IEEE Transactions on Intelligent Transportation Systems 6 2005 285 293
20. M.J. Er, and C. Deng Obstacle avoidance of a mobile robot using hybrid learning approach IEEE Transactions on Industrial Electronics 52 2005 898 905
21. H. Xiao, L. Liao, F. Zhou, Mobile robot path planning based on Q-ANN, in: IEEE International Conference on Automation and Logistics, Jinan, China, 2007, pp. 26502654. (Pubitemid 351370855)
22. R. Vidal, O. Shakernia, H.J. Kim, D.H. Shim, and S. Sastry Probabilistic pursuitevasion games: Theory, implementation, and experimental evaluation IEEE Transactions on Robotics and Automation 18 2002 662 669
23. Y. Ishiwaka, T. Satob, and Y. Kakazu An approach to the pursuit problem on a heterogeneous multiagent system using reinforcement learning Robotics and Autonomous Systems 43 4 2003 245 256
24. S.N. Givigi, H.M. Schwartz, and X. Lu A reinforcement learning adaptive fuzzy controller for differential games Journal of Intelligent and Robotic Systems 59 1 2010 3 30
25. L. Jouffe Fuzzy inference system learning by reinforcement methods IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 28 1998 338 355
26. Y. Duan, and X. Hexu Fuzzy reinforcement learning and its application in robot navigation International Conference on Machine Learning and Cybernetics vol. 2 2005 IEEE Press Guangzhou 899 904
27. L. Buoniu, R. Babuka, and B. de Schutter A comprehensive survey of multiagent reinforcement learning IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38 2008 156 172
28. A. Waldock, B. Carse, Fuzzy Q-learning with an adaptive representation, in: 2008 IEEE 16th International Conference on Fuzzy Systems (FUZZ-IEEE), Piscataway, NJ, 2008, pp. 720725.
29. C.J.C.H. Watkins, and P. Dayan Q-learning Machine Learning 8 1992 279 292
30. C.J.C.H. Watkins, Learning from delayed rewards. Ph.D. thesis, Cambridge University, 1989.
31. B. Bhanu, P. Leang, C. Cowden, Y. Lin, M. Patterson, Real-time robot learning, in: IEEE International Conference on Robotics and Automation, vol. 1, Seoul, Korea, 2001, pp. 491498.
32. K. Macek, I. Petrovi, N. Peri, A reinforcement learning approach to obstacle avoidance of mobile robots, in: 7th International Workshop on Advanced Motion Control, Maribor, Slovenia, 2002, pp. 462466.
33. T.M. Marin, T. Duckett, Fast reinforcement learning for vision-guided mobile robots, in: IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005, pp. 41704175.
34. Y. Yang, Y. Tian, H. Mei, Cooperative Q-learning based on blackboard architecture, in: International Conference on Computational Intelligence and Security Workshops, Harbin, China, 2007, pp. 224227.
35. S.F. Desouky, H.M. Schwartz, A novel technique to design a fuzzy logic controller using Q (λ ) -learning and genetic algorithms in the pursuitevasion game, in: 2009 IEEE International Conference on Systems, Man, and Cybernetics, San Antonio, TX, 2009, pp. 26832689.
36. C. Deng, M.J. Er, Real-time dynamic fuzzy Q-learning and control of mobile robots, in: 5th Asian Control Conference, vol. 3, 2004, pp. 15681576. (Pubitemid 40456006)
37. M.J. Er, Y. Zhou, Dynamic self-generated fuzzy systems for reinforcement learning, in: International Conference on Intelligence For Modelling, Control and Automation. Jointly with International Conference on Intelligent Agents, Web Technologies and Internet Commerce, 2005, pp. 193198.
38. V. Stephan, K. Debes, and H.M. Gross A new control scheme for combustion processes using reinforcement learning based on neural networks International Journal of Computational Intelligence and Applications 1 2001 121 136
39. X.W. Yan, Z.D. Deng, Z.Q. Sun, Genetic Takagi-Sugeno fuzzy reinforcement learning, in: IEEE International Symposium on Intelligent Control, Mexico City, Mexico, 2001, pp. 6772.
40. D. Gu, H. Hu, Accuracy based fuzzy Q-learning for robot behaviours, in: International Conference on Fuzzy Systems, Budapest, Hungary, vol. 3, 2004, pp. 14551460.
41. S.P. Singh, and R.S. Sutton Reinforcement learning with replacing eligibility traces Machine Learning 22 1996 123 158
42. E.H. Mamdani, and S. Assilian An experiment in linguistic synthesis with a fuzzy logic controller International Journal of Man-Machine Studies 7 1 1975 1 13
43. T. Takagi, and M. Sugeno Fuzzy identification of systems and its applications to modelling and control IEEE Transactions on Systems, Man and Cybernetics SMC-15 1985 116 132
44. J.H. Holland Genetic algorithms and the optimal allocation of trials SIAM Journal on Computing 2 2 1973 88 105
45. D.E. Goldberg Genetic Algorithms for Search, Optimization, and Machine Learning 1989 Addison-Wesley Reading
46. C. Karr Genetic algorithms for fuzzy controllers AI Expert 6 (2 1991 26 33
47. L. Ming, G. Zailin, and Y. Shuzi Mobile robot fuzzy control optimization using genetic algorithm Artificial Intelligence in Engineering 10 4 1996 293 298
48. Y.C. Chiou, and L.W. Lan Genetic fuzzy logic controller: An iterative evolution algorithm with new encoding method Fuzzy Sets and Systems 152 2005 617 635
49. R. Isaacs Differential Game 1965 John Wiley and Sons
50. S.M. LaValle Planning Algorithms 2006 Cambridge University Press
51. S.H. Lim, T. Furukawa, G. Dissanayake, H.F.D. Whyte, A time-optimal control strategy for pursuitevasion games problems, in: International Conference on Robotics and Automation, New Orleans, LA, 2004.
52. J. Peng, and R.J. Williams Incremental multi-step Q-learning Machine Learning 22 1996 283 290
53. L. Jouffe, Actor-critic learning based on fuzzy inference system, in: IEEE International Conference on Systems, Man, and Cybernetics, Beijing, China, vol. 1, 1996, pp. 339344.
54. X.S. Wang, Y.H. Cheng, and J.Q. Yi A fuzzy actor-critic reinforcement learning network Information Sciences 177 2007 3764 3781