Data-driven interval type-2 neural fuzzy system with high learning accuracy and improved model interpretability

IEEE Transactions on Cybernetics

Volumn 43, Issue 6, 2013, Pages 1781-1795

  Juang, Chia Feng ^a   Chen, Chi You ^a  

^a NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

Author keywords

Fuzzy neural networks (FNNs); interpretable fuzzy systems (FSs); sequence prediction; type 2 FSs

Indexed keywords

FUZZY NEURAL NETWORK (FNNS); INPUT-OUTPUT SPACES; INTERPRETABLE FUZZY SYSTEMS (FSS); NEURAL FUZZY SYSTEMS; PARAMETER LEARNING; RECURSIVE LEAST SQUARES ALGORITHMS; SEQUENCE PREDICTION; TYPE-2 FSS;

CLUSTERING ALGORITHMS; FUZZY NEURAL NETWORKS; FUZZY SETS; LEARNING ALGORITHMS;

FUZZY SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; DATA MINING; FACTUAL DATABASE; FUZZY LOGIC; METHODOLOGY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DATA MINING; DATABASES, FACTUAL; FUZZY LOGIC; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 84890064120     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2230253     Document Type: Article

References (52)

1. C. T. Lin and C. S. G. Lee, Neural Fuzzy Systems: A Neural-Fuzzy Synergism to Intelligent Systems. Englewood Cliffs, NJ: Prentice-Hall, May 1996.
2. O. Cordon, F. Herrera, F. Hoffmann, and L. Magdalena, Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy Knowledge Bases. Singapore: World Scientific, 2001.
3. J. Casillas, O. Cordon, F. Herrera, and L. Magdalena, Interpretability Issues in Fuzzy Modeling. Berlin, Germany: Springer-Verlag, 2003.
4. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference systems," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May/Jun. 1993.
5. N. K. Kasabov and Q. Song, "DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 144-154, Apr. 2002. (Pubitemid 34554860)
6. P. P. Angelov and D. Filev, "An approach to online identification of Takagi-Sugeno fuzzy models," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 484-498, Feb. 2004.
7. D. Kukolj and E. Levi, "Identification of complex systems based on neural and Takagi-Sugeno fuzzy model," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 272-282, Feb. 2004.
8. C. F. Juang and C. M. Chang, "Human body posture classification by a neural fuzzy network and home care system application," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 6, pp. 984-994, Nov. 2007.
9. E. D. Lughofer, "FLEXFIS: A robust incremental learning approach for evolving Takagi-Sugeno fuzzy models," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1393-1410, Dec. 2008.
10. W. L. Tung and C. Quek, "eFSM - A novel online neural-fuzzy semantic memory model," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 136-157, Jan. 2010.
11. C. F. Juang, T. C. Chen, and W. Y. Cheng, "Speedup of implementing fuzzy neural networks with high-dimensional inputs through parallel processing on graphic processing units," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 717-728, Aug. 2011.
12. Y. H. Chien, W. Y. Wang, Y. G. Leu, and T. T. Lee, "Robust adaptive controller design for a class of uncertain nonlinear systems using online T-S fuzzy-neural modeling approach," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 2, pp. 542-552, Apr. 2011.
13. P. Angelov, "Fuzzily connected multimodel systems evolving autonomously from data streams," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 898-910, Aug. 2011.
14. I. del Campo, K. Basterretxea, J. Echanobe, G. Bosque, and F. Doctor, "A system-on-chip development of a neuro-fuzzy embedded agent for ambient-intelligence environments," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 501-512, Apr. 2012.
15. A. H. Sonbol, M. S. Fadali, and S. Jafarzadeh, "TSK fuzzy function approximators: Design and accuracy analysis," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 3, pp. 702-712, Jun. 2012.
16. J. M. Mendel, "Computing derivatives in interval type-2 fuzzy logic system," IEEE Trans. Fuzzy Syst., vol. 12, no. 1, pp. 84-98, Feb. 2004.
17. H. Hagras, "Comments on dynamical optimal training for interval type-2 fuzzy neural network (SOT2FNN)," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 5, pp. 1206-1209, Oct. 2006. (Pubitemid 44500790)
18. C. F. Juang and Y. W. Tsao, "A self-evolving interval type-2 fuzzy neural network with on-line structure and parameter learning," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1411-1424, Dec. 2008.
19. C. F. Juang and Y. W. Tsao, "A type-2 self-organizing neural fuzzy system and its FPGA implementation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 6, pp. 1537-1548, Dec. 2008.
20. O. Uncu and I. B. Türksen, "Discrete interval type-2 fuzzy system models using uncertainty in learning parameters," IEEE Trans. Fuzzy Syst., vol. 15, no. 1, pp. 90-106, Feb. 2007. (Pubitemid 46444306)
21. R. H. Abiyev and O. Kaynak, "Type 2 fuzzy neural structure for identification and control of time-varying plants," IEEE Trans. Ind. Electron., vol. 57, no. 12, pp. 4147-4159, Dec. 2010.
22. C. F. Juang, R. B. Huang, andW. Y. Cheng, "An interval type-2 fuzzy neural network with support vector regression for noisy regression problems," IEEE Trans. Fuzzy Syst., vol. 18, no. 4, pp. 686-699, Aug. 2010.
23. M. A. Khanesar, E. Kayacan, M. Teshnehlab, and O. Kaynak, "Analysis of the noise reduction property of type-2 fuzzy logic systems using a novel type-2 membership function," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 5, pp. 1395-1406, Oct. 2011.
24. H. Ishibuchi and T. Yamamoto, "Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining," Fuzzy Sets Syst., vol. 141, no. 1, pp. 59-88, Jan. 2004.
25. P. Pulkkinen and H. Koivisto, "A dynamically constrained multiobjective genetic fuzzy system for regression problems," IEEE Trans. Fuzzy Syst., vol. 18, no. 1, pp. 161-177, Feb. 2010.
26. S. M. Zhou and J. Q. Gan, "Low-level interpretability and high-level interpretability: A unified view of data-driven interpretable fuzzy system modeling," Fuzzy Sets Syst., vol. 159, no. 23, pp. 3091-3131, Dec. 2008.
27. J. V. de Oliveira, "Semantic constraints for membership function optimization," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 29, no. 1, pp. 128-138, Jan. 1999.
28. Y. Jin, "Fuzzy modeling of high-dimensional systems: Complexity reduction and interpretability improvement," IEEE Trans. Fuzzy Syst., vol. 8, no. 2, pp. 212-221, Apr. 2000.
29. R. Paiva and A. Dourado, "Interpretability and learning in neuro-fuzzy systems," Fuzzy Sets Syst., vol. 147, no. 1, pp. 17-38, Oct. 2004.
30. R. Mikut, J. Jakel, and L. Groll, "Interpretability issues in data-based learning of fuzzy systems," Fuzzy Sets Syst., vol. 150, no. 2, pp. 179-197, Mar. 2005. (Pubitemid 40056017)
31. L. Chen, C. L. P. Chen, and W. Pedrycz, "A gradient-descent-based approach for transparent linguistic interface generation in fuzzy models," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 5, pp. 1219-1230, Oct. 2010.
32. J. M. Mendel, Uncertain Rule-Based Fuzzy Logic System: Introduction and New Directions. Upper Saddle River, NJ: Prentice-Hall, 2001.
33. V. V. Cross and T. A. Sudkamp, Similarity and Compatibility in Fuzzy Set Theory: Assessment and Application. Heidelberg, Germany: Physica-Verlag, 2002.
34. D. Wu and J. M. Mendel, "A vector similarity measure for interval type-2 fuzzy sets," in Proc. IEEE Int. Conf. Fuzzy Syst., Jul. 2007, pp. 1-6.
35. C. F. Juang and C. T. Lin, "An on-line self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998.
36. D. Nauk and R. Kruse, "Neuro-fuzzy systems for function approximation," Fuzzy Sets Syst., vol. 101, no. 2, pp. 261-271, Jan. 1999. (Pubitemid 129496792)
37. S. M. Chen and Y. K. Ko, "Fuzzy interpolative reasoning for sparse fuzzyrule- based systems based on cutting and transformation techniques," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1626-1648, Dec. 2008.
38. Z. H. Huang and Q. Shen, "Fuzzy interpolation and extrapolation: A practical approach," IEEE Trans. Fuzzy Syst., vol. 16, no. 1, pp. 13-28, Feb. 2008. (Pubitemid 351359125)
39. J. D. J. Rubio, "SOFMLS: Online self-organizing fuzzy modified least squares network," IEEE Trans. Fuzzy Syst., vol. 17, no. 6, pp. 1296-1309, Dec. 2009.
40. S. M. Chen and Y. C. Chang, "Weighted fuzzy rule interpolation based on GA-based weight-learning techniques," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 729-744, Aug. 2011.
41. S. M. Chen and Y. C. Chang, "Fuzzy rule interpolation based on interval type-2 Gaussian fuzzy sets and genetic algorithms," in Proc. IEEE Int. Conf. Fuzzy Syst., Taipei, Taiwan, Jun. 2011, pp. 448-454.
42. B. A. Sproule, M. Bazoon, K. I. Shulman, I. B. Turksen, and C. A. Naranjo, "Fuzzy logic pharmacokinetic modeling: An application to lithium concentration prediction," Clin. Pharmacol. Ther., vol. 62, no. 1, pp. 29-40, Jul. 1997. (Pubitemid 27327097)
43. P. Baranyi, L. T. Koczy, and T. D. Gedeon, "A generalized concept for fuzzy rule interpolation," IEEE Trans. Fuzzy Syst., vol. 12, no. 6, pp. 820-837, Dec. 2004. (Pubitemid 40009385)
44. H. Ishibuchi, T. Murata, and I. B. Türksen, "Single-objective and twoobjective genetic algorithms for selecting linguistic rules for pattern classification problems," Fuzzy Sets Syst., vol. 89, no. 2, pp. 135-150, Jul. 1997. (Pubitemid 127683667)
45. M. Cococcioni, P. Ducange, B. Lazzerini, and F. Marcelloni, "A Paretobased multi-objective evolutionary approach to the identification of Mamdani fuzzy systems," Soft Comput., vol. 11, no. 11, pp. 1013-1031, Sep. 2007. (Pubitemid 46865424)
46. H. Ishibuchi and Y. Nojima, "Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning," Int. J. Approx. Reason., vol. 44, no. 1, pp. 4-31, Jan. 2007.
47. M. Antonelli, P. Ducange, B. Lazzerini, and F. Marcelloni, "Multiobjective evolutionary learning of granularity, membership function parameters and rules of Mamdani fuzzy systems," Evol. Intell., vol. 2, no. 1/2, pp. 21-37, Nov. 2009.
48. M. Gacto, R. Alcala, and F. Herrera, "Integration of an index to preserve the semantic interpretability in the multi-objective evolutionary rule selection and tuning of linguistic fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 18, no. 3, pp. 515-531, Jun. 2010.
49. R. Alcala, M. J. Gacto, and F. Herrera, "A fast and scalable multiobjective genetic fuzzy system for linguistic fuzzy modeling in high-dimensional regression problems," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 666-681, Aug. 2011.
50. C. F. Juang, "Temporal problems solved by dynamic fuzzy network based on genetic algorithm with variable-length chromosomes," Fuzzy Sets Syst., vol. 142, no. 2, pp. 199-219, Mar. 2004.
51. W. Huang, L. Ding, S. K. Oh, C. W. Jeong, and S. C. Joo, "Identification of fuzzy inference system based on information granulation," KSII Trans. Internet Inf. Syst., vol. 4, no. 4, pp. 575-594, 2010.
52. W. Huang, S. K. Oh, and S. C. Joo, "Identification of fuzzy inference systems using multiobjective space search algorithm and information granulation," J. Elect. Eng. Technol., vol. 6, no. 6, pp. 853-866, Nov. 2011.