Efficient learning algorithms for three-layer regular feedforward fuzzy neural networks

IEEE Transactions on Neural Networks

Volumn 15, Issue 3, 2004, Pages 545-558

  Liu, Puyin ^a,b   Li, Hongxing ^a  

^a BEIJING NORMAL UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

Author keywords

function; Back propagation (BP) algorithm; Fuzzy BP algorithm; Fuzzy conjugate gradient algorithm; Regular fuzzy neural network

Indexed keywords

BACKPROPAGATION; COMPUTER SIMULATION; FUZZY SETS; INFERENCE ENGINES; LEARNING ALGORITHMS; MEMBERSHIP FUNCTIONS; OPTIMIZATION;

BACK-PROPAGATION ALGORITHM; FUZZY BACK-PROPAGATION ALGORITHM; FUZZY CONJUGATE GRADIENT ALGORITHM; REGULAR FUZZY NEURAL NETWORK; THREE-LAYER REGULAR FEEDFORWARD FUZZY NEURAL NETWORKS;

FEEDFORWARD NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; FUZZY LOGIC;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; FUZZY LOGIC; NEURAL NETWORKS (COMPUTER);

EID: 2542618358     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2004.824250     Document Type: Article

References (34)

1. R. A. Aliev, B. Fazlollahi, and R. M. Vahidov, "Genetic algorithm-based learning of fuzzy neural networks. Part I: Feed-forward fuzzy neural networks," Fuzzy Sets Syst., vol. 118, 3, pp. 351-358, 2001.
2. J. J. Buckley and Y. Hayashi, "Can fuzzy neural nets approximate continuous fuzzy functions," Fuzzy Sets Syst., vol. 61, no. 1, pp. 43-51, 1994.
3. ____, "Direct fuzzification of neural networks," in Proc. 1st Asian Fuzzy Syst. Symp., vol. 1, 1993, pp. 560-567.
4. M. Carozza and S. Rampone, "Function approximation from noise data by an incremental RBF network," Pattern Recogn., vol. 32, no. 12, pp. 2081-2083, 1999.
5. S. Chakraborty, K. Pal, and N. R. Pal, "A neuro-fuzzy framework for inference," Neural Networks, vol. 15, pp. 247-261, 2002.
6. C. Charalambous, "Conjugate gradient algorithm for efficient training of artificial neural networks," Proc. Inst. Elect. Eng. G, vol. 139, no. 2, pp. 301-310, 1992.
7. D. S. Chen and R. C. Jain, "A robust back propagation learning algorithm for function approximation," IEEE Trans. Neural Networks, vol. 7, pp. 467-479, Mar. 1996.
8. P. Diamond and P. Kloeden, Metric Spaces of Fuzzy Sets. Singapore: World Scientific, 1994.
9. J. Dunyak and D. Wunsch, "Training fuzzy number neural networks with alpha-cut refinements," in Proc. IEEE Int. Conf. Systems, Man, Cybernetics, vol. 1, 1997, pp. 189-194.
10. ____, "Fuzzy number neural networks," Fuzzy Sets Syst., vol. 108, no. 1, pp. 49-58, 1999.
11. T. Feuring, J. J. Buckley, and Y. Hayashi, "Fuzzy neural nets can solve the overfitting problem," in Proc. Int. Joint Conf. Neural Networks, vol. 4, 1999, pp. 4197-4201.
12. T. Feuring and W. M. Lippe, "The fuzzy neural network approximation lemma," Fuzzy Sets Syst., vol. 102, no. 2, pp. 227-237, 1999.
13. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley, 1989.
14. Y. Hayashi, J. J. Buckley, and E. Czogala, "Fuzzy neural network with fuzzy signals and weights," in Proc. Int. Joint Conf. Neural Networks, vol. 2, 1992, pp. 696-701.
15. S. Horikawa, T. Furuhashi, and Y. Uchikawa, "On fuzzy modeling using fuzzy neural networks with the bach-propagation algorithm," IEEE Trans. Neural Networks, vol. 3, pp. 801-806, Sept. 1992.
16. H. Ishibuchi, R. Fujioka, and H. Tanaka, "Neural networks that learn from fuzzy if-then rules," IEEE Trans. Fuzzy Syst., vol. 1, pp. 85-97, Feb. 1993.
17. H. Ishibuchi, K. Kwon, and H. A. Tanaka, "Learning algorithm of fuzzy neural networks with triangular fuzzy weights," Fuzzy Sets Syst., vol. 71, no. 2, pp. 277-293, 1995.
18. H. Ishibuchi, K. Morioka, and I. B. Turksen, "Learning by fuzzified neural networks," Int. J. Approx. Reason., vol. 13, no. 3, pp. 327-358, 1995.
19. H. Ishibuchi and M. Nii, "Numerical analysis of the learning of fuzzified neural networks from fuzzy if-then rules," Fuzzy Sets Syst., vol. 120, no. 2, pp. 281-307, 2001.
20. H. Ishibuchi, K. Kwon, and H. Tanaka, "Learning of fuzzy neural networks from fuzzy inputs and fuzzy targets," in Proc. 5th IFSA World Congr., vol. 1, 1993, pp. 147-150.
21. H. Ishibuchi, M. Nii, and C.-H. Oh, "Approximate realization of fuzzy mappings by regression models, neural networks and rule-based systems," in Proc. IEEE Int. Conf. Fuzzy Syst., vol. 2, 1999, pp. 939-944.
22. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 665-684, 1993.
23. P. V. Krishnamraju et al., "Genetic learning algorithms for fuzzy neural nets," in Proc. IEEE Int. Conf. Fuzzy Systems, vol. 2, 1994, pp. 1969-1974.
24. P. Liu, "On the approximation realization of fuzzy closure mapping by multilayer regular fuzzy neural network," Multiple Valued Logic, vol. 5, no. 2, pp. 463-480, 2000.
25. ____, "Analyzes of regular fuzzy neural networks for approximation capability," Fuzzy Sets Syst., vol. 114, no. 3, pp. 329-338, 2000.
26. ____, "Universal approximations of continuous fuzzy valued functions by multi-layer regular fuzzy neural networks," Fuzzy Sets Syst., vol. 119, no. 2, pp. 313-320, 2001.
27. P. Liu and H. Wang, "Research on approximation capability of regular fuzzy neural network to continuous fuzzy function," Sci. China, E, vol. 41, no. 2, pp. 143-151, 1999.
28. K. Mendel and Q. Liang, "Type-2 fuzzy logic systems," IEEE Trans. Fuzzy Syst., vol. 7, no. 6, pp. 788-800, 1999.
29. H. T. Nguyen, "A note on the extension principle for fuzzy sets," J. Math. Anal. Appl., vol. 64, no. 2, pp. 369-380, 1978.
30. S. Park and T. Han, "Iterative inversion of fuzzified neural networks," IEEE Trans. Fuzzy Syst., vol. 8, no. 3, pp. 268-280, 2000.
31. M. J. D. Powell, "Some convergence properties of the conjugate gradient method," Math. Prog., vol. 11, no. 1, pp. 42-49, 1976.
32. F. Scarselli and A. C. Tosi, "Universal approximation using feedforward neural networks: A survey of some existing methods, and some new results," Neural Networks, vol. 11, no. 1, pp. 15-37, 1998.
33. X. H. Zhang et al., "An efficient computational algorithm for min-max operations," Fuzzy Sets Syst., vol. 104, no. 2, pp. 297-304, 1999.
34. X. H. Zhang et al., "The min-max function differentiation and training of fuzzy neural networks," IEEE Trans. Neural Networks, vol. 7, pp. 1139-1150, Nov. 1996.