Data-based system modeling using a type-2 fuzzy neural network with a hybrid learning algorithm

IEEE Transactions on Neural Networks

Volumn 22, Issue 12 PART 2, 2011, Pages 2296-2309

  Yeh, Chi Yuan ^a   Jeng, Wen Hau Roger ^a   Lee, Shie Jue ^a  

^a NATIONAL SUN YAT SEN UNIVERSITY   (Taiwan)

Author keywords

Fuzzy clustering; Karnik Mendel algorithm; least squares estimation; particle swarm optimization; type reduction; type 2 fuzzy set

Indexed keywords

CRISP OUTPUT; DATA POINTS; FUZZY CLUSTERING METHOD; FUZZY RULE BASE; HYBRID LEARNING ALGORITHM; IF-THEN RULES; INPUT-OUTPUT TRAINING; LEAST SQUARES ESTIMATION; PARTICLE SWARM; REFINED TYPE; SELF-CONSTRUCTING; SYSTEM MODELING; TRAINING DATASET; TYPE REDUCTION; TYPE-2 FUZZY SET;

FEEDFORWARD NEURAL NETWORKS; FUZZY CLUSTERING; FUZZY CONTROL; FUZZY NEURAL NETWORKS; FUZZY RULES; FUZZY SYSTEMS; MEMBERSHIP FUNCTIONS; PARTICLE SWARM OPTIMIZATION (PSO); REFINING; STATISTICAL TESTS;

LEARNING ALGORITHMS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; DATA MINING; FACTUAL DATABASE; FEEDBACK SYSTEM; FUZZY LOGIC; METHODOLOGY; THEORETICAL MODEL;

DATA MINING; DATABASES, FACTUAL; FEEDBACK; FUZZY LOGIC; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER);

EID: 83655184649     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2170095     Document Type: Article

References (63)

1. L. A. Zadeh, "Fuzzy sets," Inf. Control, vol. 8, no. 3, pp. 338-353, Jun. 1965.
2. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, no. 9, pp. 1481-1497, Sep. 1990.
3. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, Jun. 1993.
4. J.-S. R. Jang and C.-T. Sun, "Neuro-fuzzy modeling and control," Proc. IEEE, vol. 83, no. 3, pp. 378-406, Mar. 1995.
5. S.-J. Lee and C.-S. Ouyang, "A neuro-fuzzy system modeling with self-constructing rule generationand hybrid SVD-based learning," IEEE Trans. Fuzzy Syst., vol. 11, no. 3, pp. 341-353, Jun. 2003.
6. C.-S. Ouyang, W.-J. Lee, and S.-J. Lee, "A TSK-type neurofuzzy network approach to system modeling problems," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 35, no. 4, pp. 751-767, Aug. 2005. (Pubitemid 41644058)
7. G. J. Klir and B. Yuan, Fuzzy Set and Fuzzy Logic. Englewood Cliffs, NJ: Prentice-Hall, May 1995.
8. L. A. Zadeh, "The concept of a linguistic variable and its application to approximate reasoning-I," Inf. Sci., vol. 8, no. 3, pp. 199-249, Jan. 1975.
9. N. N. Karnik, J. M. Mendel, and Q. Liang, "Type-2 fuzzy logic systems," IEEE Trans. Fuzzy Syst., vol. 7, no. 6, pp. 643-658, Dec. 1999. (Pubitemid 32212156)
10. Q. Liang and J. M. Mendel, "Interval type-2 fuzzy logic systems: Theory and design," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 535-550, Oct. 2000.
11. J. M. Mendel, UNCERTAIN Rule-Based Fuzzy Logic Systems: Introduction and New Directions. Englewood Cliffs, NJ: Prentice-Hall, Jan. 2001.
12. N. N. Karnik and J. M. Mendel, "Operations on type-2 fuzzy sets," Fuzzy Sets Syst., vol. 122, no. 2, pp. 327-348, Sep. 2001.
13. J. M. Mendel and R. I. B. John, "Type-2 fuzzy sets made simple," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 117-127, Apr. 2002. (Pubitemid 34554858)
14. J. M. Mendel, "Computing derivatives in interval type-2 fuzzy logic systems," IEEE Trans. Fuzzy Syst., vol. 12, no. 1, pp. 84-98, Feb. 2004.
15. J. M. Mendel, "Type-2 fuzzy sets and systems: An overview corrected reprint]," IEEE Comput. Intell. Mag., vol. 2, no. 1, pp. 20-29, Feb. 2007.
16. J. M. Mendel, "Advances in type-2 fuzzy sets and systems," Inf. Sci., vol. 177, no. 1, pp. 84-110, Jan. 2007. (Pubitemid 44566500)
17. J. M. Mendel, F. Liu, and D. Zhai, "α-plane representation for type-2 fuzzy sets: Theory and applications," IEEE Trans. Fuzzy Syst., vol. 17, no. 5, pp. 1189-1207, Oct. 2009.
18. Q. Liang and J. M. Mendel, "Equalization of nonlinear time-varying channels using type-2 fuzzy adaptive filters," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 551-563, Oct. 2000.
19. R. Sepúlveda, O. Castillo, P. Melin, and O. Montiel, "An efficient computational method to implement type-2 fuzzy logic in control applications," Anal. Design Intell. Syst. Soft Comput. Tech., vol. 41, pp. 45-52, Jun. 2007.
20. H. A. Hagras, "A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots," IEEE Trans. Fuzzy Syst., vol. 12, no. 4, pp. 524-539, Aug. 2004.
21. R. Sepúlveda, O. Castillo, P. Melin, A. Rodríguez- Díaz, and O. Montiel, "Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic," Inf. Sci., vol. 177, no. 10, pp. 2023-2048, May 2007. (Pubitemid 46356313)
22. F.-J. Lin and P.-H. Chou, "Adaptive control of two-axis motion control system using interval type-2 fuzzy neural network," IEEE Trans. Ind. Electron., vol. 56, no. 1, pp. 178-193, Jan. 2009.
23. R. Martínez, O. Castillo, and L. T. Aguilar, "Optimization of interval type-2 fuzzy logic controllers for a perturbed autonomous wheeled mobile robot using genetic algorithms," Inf. Sci., vol. 179, no. 13, pp. 2158-2174, Jun. 2009.
24. N. R. Cázarez-Castro, L. T. Aguilar, and O. Castillo, "Fuzzy logic control with genetic membership function parameters optimization for the output regulation of a servomechanism with nonlinear backlash," Expert Syst. Appl., vol. 37, no. 6, pp. 4368-4378, Jun. 2010.
25. N. R. Cázarez-Castro, L. T. Aguilar, and O. Castillo, "Hybrid geneticfuzzy optimization of a type-2 fuzzy logic controller," in Proc. 8th Int. Conf. Hyb. Intell. Syst., Barcelona, Spain, Sep. 2008, pp. 216-221.
26. R. Martínez-Soto, A. R. Díaz, O. Castillo, and L. T. Aguilar, "Type-2 fuzzy logic controllers optimization using genetic algoritms and particle swarm optimization," in Proc. IEEE Int. Conf. Granular Comput., San Jose, CA, Aug. 2010, pp. 724-727.
27. Q. Liang and J. M. Mendel, "Designing interval type-2 fuzzy logic systems using an SVD-QR method: Rule reduction," Int. J. Intell. Syst., vol. 15, no. 10, pp. 939-957, Oct. 2000.
28. O. Castillo and P. Melin, "Comparison of hybrid intelligent systems, neural networks and interval type-2 fuzzy logic for time series prediction," in Proc. Int. Joint Conf. Neural Netw., Orlando, FL, Aug. 2007, pp. 3086-3091.
29. M. H. F. Zarandi, B. Rezaee, I. B. Turksen, and E. Neshat, "A type-2 fuzzy rule-based expert system model for stock price analysis," Expert Syst. Appl., vol. 36, no. 1, pp. 139-154, Jan. 2009.
30. C.-S. Ouyang and S.-L. Liu, "An approach for construction and learning of interval type-2 TSK neuro-fuzzy systems," in Proc. IEEE Int. Conf. Fuzzy Syst., Aug. 2009, pp. 1517-1522.
31. Q. Liang and J. M. Mendel, "MPEG VBR video traffic modeling and classification using fuzzy technique," IEEE Trans. Fuzzy Syst., vol. 9, no. 1, pp. 183-193, Feb. 2001. (Pubitemid 32416237)
32. H. B. Mitchell, "Pattern recognition using type-II fuzzy sets," Inf. Sci., vol. 170, nos. 2-4, pp. 409-418, Feb. 2005. (Pubitemid 40183416)
33. J. Zeng and Z.-Q. Liu, "Type-2 fuzzy Markov random fields and their application to handwritten chinese character recognition," IEEE Trans. Fuzzy Syst., vol. 16, no. 3, pp. 747-760, Jun. 2008.
34. L. A. Lucas, T. M. Centeno, and M. R. Delgado, "General type-2 fuzzy classifiers to land cover classification," Int. J. Fuzzy Syst., vol. 10, no. 3, pp. 207-216, Sep. 2008.
35. D. Hidalgo, O. Castillo, and P. Melin, "Type-1 and type-2 fuzzy inference systems as integration methods in modular neural networks for multimodal biometry and its optimization with genetic algorithms," Inf. Sci., vol. 179, no. 13, pp. 2123-2145, Jun. 2009.
36. O. Mendoza, P. Melin, and O. Castillo, "Interval type-2 fuzzy logic and modular neural networks for face recognition applications," Appl. Soft Comput., vol. 9, no. 4, pp. 1377-1387, Sep. 2009.
37. P. Melin, O. Mendoza, and O. Castillo, "An improved method for edge detection based on interval type-2 fuzzy logic," Expert Syst. Appl., vol. 37, no. 12, pp. 8527-8535, Dec. 2010.
38. R. I. John, P. R. Innocent, and M. R. Barnes, "Neuro-fuzzy clustering of radiographic tibia image data using type 2 fuzzy sets," Inf. Sci., vol. 125, nos. 1-4, pp. 65-82, Jun. 2000.
39. L. D. Lascio, A. Gisolfi, and A. Nappi, "Medical differential diagnosis through type-2 fuzzy sets," in Proc. IEEE Int. Conf. Fuzzy Syst., Reno, NV, May 2005, pp. 371-376. (Pubitemid 41189535)
40. F. Liu, "An efficient centroid type-reduction strategy for general type-2 fuzzy logic system," Inf. Sci., vol. 179, no. 9, pp. 2224-2236, Apr. 2008.
41. N. N. Karnik and J. M. Mendel, "Centroid of a type-2 fuzzy set," Inf. Sci., vol. 132, nos. 1-4, pp. 195-220, Feb. 2001. (Pubitemid 32273094)
42. D. Wu and J. M. Mendel, "Enhanced Karnik-Mendel algorithms," IEEE Trans. Fuzzy Syst., vol. 17, no. 4, pp. 923-934, Aug. 2009.
43. C.-Y. Yeh, W.-H. R. Jeng, and S.-J. Lee, "An enhanced type-reduction algorithm for type-2 fuzzy sets," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 227-240, Apr. 2011.
44. S. Coupland and R. John, "A fast geometric method for defuzzification of type-2 fuzzy sets," IEEE Trans. Fuzzy Syst., vol. 16, no. 4, pp. 929-941, Aug. 2008.
45. W.-W. Tan and D. Wu, "Design of type-reduction strategies for type-2 fuzzy logic systems using genetic algorithms," Adv. Evolut. Comput. Syst. Design. Studies Comput. Intell., vol. 66, pp. 169-187, 2007.
46. Y. Lin, G. A. Cunningham, III, and S. V. Coggeshall, "Using fuzzy partitions to create fuzzy systems from input-output data and set the initial weights in a fuzzy neural network," IEEE Trans. Fuzzy Syst., vol. 5, no. 4, pp. 614-621, Nov. 1997. (Pubitemid 127768539)
47. C.-C. Wong and C.-C. Chen, "A hybrid clustering and gradient descent approach for fuzzy modeling," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 29, no. 6, pp. 686-693, Dec. 1999.
48. R. Thawonmas and S. Abe, "Function approximation based on fuzzy rules extracted from partitioned numerical data," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 29, no. 4, pp. 525-534, Aug. 1999.
49. C.-H. Wang, C.-S. Cheng, and T.-T. Lee, "Dynamical optimal training for interval type-2 fuzzy neural network (T2FNN)," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 34, no. 3, pp. 1462-1477, Jun. 2004.
50. H. Hagras, "Comments on dynamical optimal training for interval type-fuzzy neural network (T2FNN)," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 36, no. 5, pp. 1206-1209, Oct. 2006. (Pubitemid 44500790)
51. C.-H. Lee, T.-W. Hu, C.-T. Lee, and Y.-C. Lee, "A recurrent interval type-2 fuzzy neural network with asymmetric membership functions for nonlinear system identification," in Proc. IEEE Int. Conf. Fuzzy Syst., Hong Kong, Jun. 2008, pp. 1496-1502.
52. C.-F. Juang and Y.-W. Tsao, "A self-evolving interval type-2 fuzzy neural network with online structure and parameter learning," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1411-1424, Dec. 2008.
53. J. R. Castro, O. Castillo, P. Melin, and A. Rodríguez-Díaz, "A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks," Inf. Sci., vol. 179, no. 13, pp. 2175-2193, Jun. 2009.
54. J. Kennedy and R. C. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., Perth, Australia, Nov.-Dec. 1995, pp. 1942-1948.
55. Y.-T. Peng, C.-Y. Yeh, and S.-J. Lee, "A hierarchical SVD-based least squares method for parameter estimation," in Proc. Int. Conf. Data Eng. Internet Technol., Mar. 2011, pp. 219-222.
56. S. Greenfield, F. Chiclana, S. Coupland, and R. I. John, "The collapsing method of defuzzification for discretised interval type-2 fuzzy sets," Inf. Sci., vol. 179, no. 13, pp. 2055-2069, Jun. 2009.
57. S. Greenfield, F. Chiclana, and R. I. John, "Type-reduction of the discretised interval type-2 fuzzy set," in Proc. IEEE Int. Conf. Fuzzy Syst., Aug. 2009, pp. 738-743.
58. C. Wagner and H. Hagras, "zSlices based general type-2 FLC for the control of autonomous mobile robots in real world environments," in Proc. IEEE Int. Conf. Fuzzy Syst., Aug. 2009, pp. 718-725.
59. J. Yen and R. Langari, Fuzzy Logic: Intelligence, Control, and Information. Upper Saddle River, NJ: Prentice-Hall, Dec. 1999.
60. J.-S. Wang and C. S. G. Lee, "Self-adaptive neuro-fuzzy inference systems for classification applications," IEEE Trans. Fuzzy Syst., vol. 10, no. 6, pp. 790-802, Dec. 2002.
61. Neural Network Toolbox User's Guide, The MathWorks Inc., Natick, MA, 2008.
62. A. Asuncion and D. Newman. (2007). UCI Machine Learning Repository Online]. Available: http://www.ics.uci.edu/?mlearn/MLRepository.html
63. H. Motulsky, Intuitive Biostatistics. New York: Oxford Univ. Press, Oct. 1995.