A self-evolving interval type-2 fuzzy neural network with online structure and parameter learning

IEEE Transactions on Fuzzy Systems

Volumn 16, Issue 6, 2008, Pages 1411-1424

  Juang, Chia Feng ^a   Tsao, Yu Wei ^b  

^a NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

^b INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE   (Taiwan)

Author keywords

Evolving system; Fuzzy neural networks (FNNs); Online fuzzy clustering; Structure learning; Type 2 fuzzy systems

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; CONTROL THEORY; EDUCATION; FUZZY CLUSTERING; FUZZY LOGIC; FUZZY RULES; FUZZY SETS; FUZZY SYSTEMS; KALMAN FILTERS; LEARNING ALGORITHMS; NEURAL NETWORKS; ONLINE SYSTEMS; SOLUTE TRANSPORT; SPURIOUS SIGNAL NOISE; VEGETATION;

ADAPTIVE NOISE CANCELLATIONS; CHAOTIC SIGNALS; EVOLVING SYSTEM; FILTER ALGORITHMS; FUZZY SET; GRADIENT DESCENT ALGORITHMS; INPUT SPACES; INPUT VARIABLES; LEARNING PERFORMANCES; NONLINEAR PLANTS; ONLINE CLUSTERING METHODS; ONLINE FUZZY CLUSTERING; ONLINE STRUCTURES; PARAMETER LEARNINGS; REDUCTION METHODS; RULE BASE; STRUCTURE LEARNING; TYPE-2 FUZZY SYSTEMS;

FUZZY NEURAL NETWORKS;

EID: 58149487281     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2008.925907     Document Type: Article

References (47)

1. N. N. Karnik, J. M. Mendel, and Q. Liang, "Type-2 fuzzy logic systems," IEEE Trans. Fuzzy Syst., vol. 7, no. 6, pp. 643-658, Dec. 1999.
2. J. M. Mendel and R. I. John, "Type-2 fuzzy sets made simple," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 117-127, Apr. 2002.
3. J. M. Mendel, Uncertain Rule-Based Fuzzy Logic System: Introduction and New Directions. Upper Saddle River, NJ: Prentice-Hall, 2001.
4. Q. Liang and J. M. Mendel, "Equalization of nonlinear time-varying channels using type-2 fuzzy adaptive filters," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 551-563, Oct. 2000.
5. H. B. Mitchell, "Pattern recognition using type-2 fuzzy sets," Inf. Sci., vol. 170, pp. 409-418, 2005.
6. P.Melin and O. Castillo, "Intelligent control of non-linear dynamic plants using type-2 fuzzy logic and neural networks," presented at the IEEE Int. Conf. Fuzzy Syst., Budapest, Hungary, Jul. 2004.
7. H. Hagras, "A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots," IEEE Trans. Fuzzy Syst., vol. 12, no. 4, pp. 524-539, Aug. 2004.
8. M. Melgarejo and C. Pena-Reyes, "Hardware architecture and FPGA implementation of a type-2 fuzzy system," in Proc. Great Lakes Symp. VLSI (GLSVLSI), Boston, MA, 2004, pp. 458-261.
9. R. I. John, P. R. Innocent, and M. R. Barnes, "Neuro-fuzzy clustering of radiographic tibia image data using type-2 fuzzy sets," Inf. Sci. vol. 125, pp. 203-220, 2000.
10. A. G. Luigi Di Lascio and A. Nappi, "Medical differential diagnosis through type-2 fuzzy sets," in Proc. IEEE Int. Conf. Fuzzy Syst., 2005, pp. 371-376.
11. C. T. Lin and C. S. G. Lee, Neural Fuzzy Systems: A Neural-Fuzzy Synergism to Intelligent Systems, ch. 19. Englewood Cliffs, NJ: Prentice-Hall, May 1996.
12. G. Mouzouris and J. M. Mendel, "A singular-value-QR decomposition based method for training fuzzy systems in uncertain environments," J. Intell. Fuzzy Syst., vol. 5, pp. 367-374, 1997.
13. J. Yen and L. Wang, "Simplifying fuzzy rule-based models using orthogonal transformation methods," IEEE Trans. Syst., Man, Cyber. B vol. 29, no. 1, pp. 13-24, Feb. 1999.
14. J. S. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May 1993.
15. S. L. Chiu, "Fuzzy model identification based on cluster estimation," J. Intell. Fuzzy Syst., vol. 2, pp. 267-278, 1994.
16. C. S. Ouyang, W. J. Lee, and S. J. Lee, "A TSK-type neurofuzzy network approach to system modeling problems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 4, pp. 751-767, Aug. 2005.
17. D. Kukolj and E. Levi, "Identification of complex systems based on neural and Takagi-Sugeno fuzzy model," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 272-282, Feb. 2004.
18. N. K. Kasabov and Q. Song, "DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 144-154, Apr. 2002.
19. P. P. Angelov and D. Filev, "An approach to online identification of Takagi-Sugeno fuzzy models," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 484-498, Feb. 2004.
20. M. Setnes, R. Babuska, U. Kaymak, and H. R. van Nauta Lemke, "Similarity measures in fuzzy rule base simplification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 28, no. 3, pp. 376-386, Jun. 1998.
21. Y. Jin, "Fuzzy modeling of high-dimensional systems: Complexity reduction and interpretability improvement," IEEE Trans. Fuzzy Syst. vol. 8, no. 2, pp. 212-221, Apr. 2000.
22. H. Wang, S. Kwong, Y. Jin, W. Wei, and K. Man, "A multi-objective hierarchical genetic algorithm for interpretable rule-based knowledge extraction," Fuzzy Sets Syst., vol. 149, no. 1, pp. 149-186, 2005.
23. R. Paiva and A. Dourado, "Interpretability and learning in neuro-fuzzy systems," Fuzzy Sets Syst., vol. 147, no. 1, pp. 17-38, 2004.
24. Q. Liang and J. M. Mendel, "Interval type-2 fuzzy logic systems: Theory and design," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 535-550, Oct. 2000.
25. C. H. Lee, Y. C. Lin, and W. Y. Lai, "Systems identification using type-2 fuzzy neural network (Type-2 FNN) systems," in Proc. IEEE Int. Symp. Comput. Intell. Robot. Autom., 2003, vol. 3, pp. 1264-1269.
26. C. H. Wang, C. S. Cheng, and T. T. Lee, "Dynamical optimal training for interval type-2 fuzzy neural network (T2FNN)," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 3, pp. 1462-1477, Jun. 2004.
27. J. M. Mendel, "Computing derivatives in interval type-2 fuzzy logic system," IEEE Trans. Fuzzy Syst., vol. 12, no. 1, pp. 84-98, Feb. 2004.
28. H. Hagras, "Comments on dynamical optimal training for interval type-2 fuzzy neural network (T2FNN)," IEEE Trans. Syst., Man Cybern. B, Cybern., vol. 36, no. 5, pp. 1206-1209, Oct. 2006.
29. G. M. Mendez and O. Castillo, "Interval type-2 TSK fuzzy logic systems using hybrid learning algorithm," in Proc. IEEE Int. Conf. Fuzzy Syst., May 22-25, 2005, pp. 230-235.
30. C. F. Juang and C. T. Lin, "An on-line self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998.
31. V. V. Cross and T. A. Sudkamp, Similarity and Compatibility in Fuzzy Set Theory: Assessment and Application. Heidelberg, Germany: Physica-Verlag, 2002.
32. D. Wu and J. M. Mendel, "A vector similarity measure for interval type-2 fuzzy sets," in Proc. IEEE Int. Conf. Fuzzy Syst., Jul. 2007, pp. 1-6.
33. L. Guo, "Estimating time-varying parameters by the Kalman filter based algorithm: Stability and convergence," IEEE Trans. Autom. Control vol. 35, no. 2, pp. 141-147, Feb. 1990.
34. J. J. Rubio and W. Yu, "Nonlinear system identificationwith recurrent neural networks and dead-zone Kalman filter algorithm," Neurocomputing, vol. 70, pp. 2460-2466, 2007.
35. O. Cordon, F. Herrera, F. Hoffmann, and L. Magdalena, Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy Knowledge Bases (Advances in Fuzzy Systems - Applications and Theory), vol. 19. Singapore: World Scientific, 2001.
36. M. Clerc and J. Kennedy, "The particle swarm - Explosion, stability, and convergence in a multidimentional complex space," IEEE Trans. Evol. Comput., vol. 6, no. 1, pp. 58-73, Feb. 2002.
37. C. J. Lin and C. T. Lin, "An ART-based fuzzy adaptive learning control network," IEEE Trans. Fuzzy Syst., vol. 5, no. 4, pp. 477-496, Nov. 1997.
38. C. T. Lin and C. F. Juang, "An adaptive neural fuzzy filter and its applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 27, no. 4, pp. 635-656, Aug. 1997.
39. O. Castillo and P. Melin, "Adaptive noise cancellation using type-2 fuzzy logic and neural networks," in Proc. IEEE Int. Conf. Fuzzy Syst., Jul. 2004, vol. 2, pp. 1093-1098.
40. K. B. Cho and B. H. Wang, "Radial basis function based adaptive fuzzy systems and their applications to system identification," Fuzzy Sets Syst., vol. 83, pp. 325-339, 1996.
41. J. Kim and N. K. Kasabov, "HyFIS: Adaptive neuro-fuzzy inference systems and their application to nonlinear dynamic systems," Neural Netw., vol. 12, pp. 1301-1319, 1999.
42. D. Nauk and R. Kruse, "Neuro-fuzzy systems for function approximation," Fuzzy Sets Syst., vol. 101, no. 2, pp. 261-271, 1999.
43. S. Wu and M. J. Er, "Dynamic fuzzy neural networks - A novel approach to function approximation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 30, no. 2, pp. 358-364, Apr. 2000.
44. M. Russo, "Genetic fuzzy learning," IEEE Trans. Evol. Comput., vol. 4, no. 3, pp. 259-273, Sep. 2000.
45. S. Paul and S. Kumar, "Subsethood-product fuzzy neural inference system (SuPFuNIS)," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 578-599, May 2002.
46. Y. Gao and M. J. Er, "NARMAX time series model prediction: Feedforward and recurrent fuzzy neural approaches," Fuzzy Sets Syst., vol. 150, pp. 331-350, 2005.
47. C. F. Juang, I. F. Chung, and C. H. Hsu, "Automatic construction of feedforward/recurrent fuzzy systems by clustering-aided simplex particle swarm optimization," Fuzzy Sets Syst., vol. 158, no. 18, pp. 1979-1996, Sep. 2007.