Reinforcement interval type-2 fuzzy controller design by online rule generation and Q-value-aided ant colony optimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 39, Issue 6, 2009, Pages 1528-1542

  Juang, Chia Feng ^a   Hsu, Chia Hung ^a  

^a NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

Author keywords

Ant colony optimization (ACO); Fuzzy Q learning; Interval type 2 fuzzy sets; Reinforcement learning; Type 2 fuzzy systems

Indexed keywords

ANT COLONY OPTIMIZATION (ACO); ANT COLONY OPTIMIZATION ALGORITHMS; ANT-COLONY OPTIMIZATION; CONTROL PROBLEMS; CONTROLLER ROBUSTNESS; DESIGN METHOD; FUZZY CONTROLLER DESIGN; FUZZY CONTROLLERS; FUZZY Q-LEARNING; INPUT SPACE; INTERVAL TYPE-2 FUZZY SETS; LEVITATION CONTROL; NOISE ROBUSTNESS; PHEROMONE TRAILS; Q-VALUES; REINFORCEMENT SIGNAL; RULE GENERATION; RULE GENERATION METHOD; SYSTEM CONTROL; SYSTEM STRUCTURES; TYPE-2 FUZZY SYSTEMS;

CHAOTIC SYSTEMS; DESIGN; EDUCATION; FUZZY LOGIC; FUZZY SETS; MAGNETIC LEVITATION; OPTIMIZATION; REINFORCEMENT; REINFORCEMENT LEARNING; ROBUSTNESS (CONTROL SYSTEMS);

CONTROLLERS;

EID: 70349619381     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2020569     Document Type: Article

References (44)

1. R. S. Sutton and A. G. Barto, Reinforcement Learning. Cambridge,MA: MIT Press, 1998.
2. H. R. Berenji and P. Khedkar, "Learning and tuning fuzzy logic controller through reinforcement," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 724-740, Sep. 1992.
3. C. T. Lin and C. S. G. Lee, "Reinforcement structure/parameter learning for neuro-network-based fuzzy logic control system," IEEE Trans. Fuzzy Syst., vol. 2, no. 1, pp. 46-63, Feb. 1994.
4. L. Jouffe, "Fuzzy inference system learning by reinforcement methods," IEEE Trans. Syst., Man, Cybern. C: Appl. Rev., vol. 28, no. 3, pp. 338-355, Aug. 1998.
5. M. J. Er and C. Deng, "Online tuning of fuzzy inference systems using dynamic fuzzy Q-learning," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 34, no. 3, pp. 1478-1489, Jun. 2004.
6. K. Chiang, H. Y. Chung, and J. J. Lin, "A self-learning fuzzy logic controller using genetic algorithms with reinforcements," IEEE Trans. Fuzzy Syst., vol. 5, no. 3, pp. 460-467, Aug. 1997.
7. C. F. Juang, J. Y. Lin, and C. T. Lin, "Genetic reinforcement learning through symbiotic evolution for fuzzy controller design," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 30, no. 2, pp. 290-302, Apr. 2000.
8. C. J. Lin and Y. J. Xu, "Efficient reinforcement learning through dynamical symbiotic evolution for TSK-type fuzzy controller design," Int. J. Gen. Syst., vol. 34, no. 5, pp. 559-578, Oct. 2005.
9. C. F. Juang, "Combination of online clustering and Q-value-based GA for reinforcement fuzzy system design," IEEE Trans. Fuzzy Syst., vol. 13, no. 3, pp. 289-302, Jun. 2005.
10. N. N. Karnik, J. M. Mendel, and Q. Liang, "Type-2 fuzzy logic systems," IEEE Trans. Fuzzy Syst., vol. 7, no. 6, pp. 643-658, Dec. 1999.
11. J. M. Mendel, Uncertain Rule-Based Fuzzy Logic System: Introduction and New Directions. Upper Saddle River, NJ: Prentice-Hall, 2001.
12. Q. Liang and J. M. Mendel, "Equalization of nonlinear time-varying channels using type-2 fuzzy adaptive filters," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 551-563, Oct. 2000.
13. C. Hwang and F. C.-H. Rhee, "Uncertain fuzzy clustering: Interval type-2 fuzzy approach to C-means," IEEE Trans. Fuzzy Syst., vol. 15, no. 1, pp. 107-120, Feb. 2007.
14. H. Hagras, "A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots," IEEE Trans. Fuzzy Syst., vol. 12, no. 4, pp. 524-539, Aug. 2004.
15. G. M. Mendez and L. A. Leducl, "Hybrid learning algorithm for interval type-2 fuzzy logic systems," Control Intell. Syst., vol. 34, no. 3, pp. 206-215, 2006.
16. H. Hagras, "Type-2 FLCs: A new generation of fuzzy controllers," IEEE Comput. Intell. Mag., vol. 2, no. 1, pp. 30-43, Feb. 2007.
17. R. Sepúlveda, O. Castillo, P. Melin, A. Rodríguez-Díaz, and O. Montiel, "Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic," Inf. Sci., vol. 177, no. 10, pp. 2023-2048, May 2007.
18. L. Astudillo, O. Castillo, L. T. Aguilar, and R. Martinez, "Hybrid control for an autonomous wheeled mobile robot under perturbed torques," in Proc. 12th Int. Fuzzy Syst. Assoc. World Congr. Found. Fuzzy Logic Soft Comput., 2007, vol. 4529, pp. 594-603.
19. Z. Liu, Y. Zhang, and Y. Wang, "A type-2 fuzzy switching control system for biped robots," IEEE Trans. Syst., Man, Cybern. C: Appl. Rev., vol. 37, no. 6, pp. 1202-1213, Nov. 2007.
20. H. K. Lam and L. D. Seneviratne, "Stability analysis of interval type-2 fuzzy-model-based control systems," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 38, no. 3, pp. 617-628, Jun. 2008.
21. F. J. Lin, P. H. Chou, P. H. Shieh, and S. Y. Chen, "Robust control of an LUSM-based X-Y-χ motion control stage using an adaptive interval type-2 fuzzy neural network," IEEE Trans. Fuzzy Syst., vol. 17, no. 1, pp. 24-38, Feb. 2009.
22. Q. Liang and J. M. Mendel, "Interval type-2 fuzzy logic systems: Theory and design," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 535-550, Oct. 2000.
23. J. M. Mendel, "Computing derivatives in interval type-2 fuzzy logic system," IEEE Trans. Fuzzy Syst., vol. 12, no. 1, pp. 84-98, Feb. 2004.
24. H. Hagras, "Comments on Dynamical optimal training for interval type-2 fuzzy neural network (T2FNN)," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 36, no. 5, pp. 1206-1209, Oct. 2006.
25. C. F. Juang and Y. W. Tsao, "A self-evolving interval type-2 fuzzy neural network with online structure and parameter learning," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1411-1424, Dec. 2008.
26. C. F. Juang and Y. W. Tsao, "A type-2 self-organizing neural fuzzy system and its FPGA implementation," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 38, no. 6, pp. 1537-1548, Dec. 2008.
27. M. Dorigo, V. Maniezzo, and A. Colorni, "Ant system: Optimization by a colony of cooperating agents," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 26, no. 1, pp. 29-41, Feb. 1996.
28. M. Dorigo and T. Stützle, Ant Colony Optimization. Cambridge, MA: MIT, Jul. 2004.
29. J. Casillas, O. Cordon, I. F. Viana, and F. Herrera, "Learning cooperative linguistic rules using the best-worst ant system algorithm," Int. J. Intell. Syst., vol. 20, no. 4, pp. 433-452, Apr. 2005.
30. C. F. Juang, C. M. Lu, C. Lo, and C. Y. Wang, "Ant colony optimization algorithm for fuzzy controller design and its FPGA implementation," IEEE Trans. Ind. Electron., vol. 55, no. 3, pp. 1453-1462, Mar. 2008.
31. M. Dorigo and L. M. Gambardella, "Ant colony system: A cooperative learning approach to the traveling salesman problem," IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 53-66, Apr. 1997.
32. C. Blum and M. Dorigo, "The hypercube framework for ant colony optimization," IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 34, no. 2, pp. 1161-1172, Apr. 2004.
33. C. J. Wakins and P. Dayan, "Q-learning," Mach. Learn., vol. 8, no. 3, pp. 279-292, 1992.
34. C. F. Juang and C. T. Lin, "An on-line self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998.
35. C. F. Juang, S. H. Chiu, and S. W. Chang, "A self-organizing TS-type fuzzy network with support vector learning and its application to classification problems," IEEE Trans. Fuzzy Syst., vol. 15, no. 5, pp. 998-1008, Oct. 2007.
36. L. X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least-squares learning," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 807-814, Sep. 1992.
37. J. H. Chiang and P. Y. Hao, "Support vector learning mechanism for fuzzy rule-based modeling: A new approach," IEEE Trans. Fuzzy Syst. vol. 12, no. 1, pp. 1-12, Feb. 2004.
38. P. Y. Glorennec and L. Jouffe, "Fuzzy Q-learning," in Proc. IEEE Int. Conf. Fuzzy Syst., 1997, pp. 659-662.
39. S. G. Kong and B. Kosko, "Comparison of fuzzy and neural truck backer upper control systems," in Proc. Int. Joint Conf. Neural Netw., Jun. 1990, vol. 3, pp. 349-358.
40. L. X. Wang and J. M. Mendel, "Generating fuzzy rules by learning from examples," IEEE Trans. Syst., Man, Cybern., vol. 22, no. 6, pp. 1414-1427, Nov./Dec. 1992.
41. C. F. Juang and C. I. Lee, "A fuzzified neural fuzzy inference network for handling both linguistic and numerical information simultaneously," Neurocomputing, vol. 71, no. 1-3, pp. 342-352, Dec. 2007.
42. R. Alcala, J. Alcala-Fdez, J. Casillas, O. Cordon, and F. Herrera, "Hybrid learning models to get the interpretability-accuracy tradeoff in fuzzy modelling," Soft Comput., vol. 10, no. 9, pp. 717-734, May 2006.
43. S. M. Zhou and J. Q. Gan, "Low-level interpretability and high-level interpretability: A unified view of data-driven interpretable fuzzy system modelling," Fuzzy Sets Syst., vol. 159, no. 23, pp. 3091-3131, Dec. 2008.
44. J. V. de Oliveira, "Semantic constraints for membership function optimization," IEEE Trans. Syst., Man, Cybern. A: Syst., Humans, vol. 29, no. 1, pp. 128-138, Jan. 1999.