A new learning algorithm for a fully connected neuro-fuzzy inference system

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 10, 2014, Pages 1741-1757

  Chen, C L Philip ^a   Wang, Jing ^a   Wang, Chi Hsu ^b,c   Chen, Long ^a  

^a UNIVERSITY OF MACAU   (Macao)

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^c NORTHEASTERN UNIVERSITY AT QINHUANGDAO   (China)

Author keywords

Fully connected neuro fuzzy inference systems (F CONFIS); fuzzy logic; fuzzy neural networks; gradient descent; neural networks (NNs); neuro fuzzy system; optimal learning

Indexed keywords

FUZZY NEURAL NETWORKS;

GRADIENT DESCENT; NEURAL NETWORKS (NNS); NEURO-FUZZY INFERENCE SYSTEMS; NEUROFUZZY SYSTEM; OPTIMAL LEARNING;

FUZZY LOGIC;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; FUZZY LOGIC; HUMAN; LEARNING; PHYSIOLOGY; SYSTEM ANALYSIS;

ALGORITHMS; FUZZY LOGIC; HUMANS; LEARNING; NEURAL NETWORKS (COMPUTER); SYSTEMS INTEGRATION;

EID: 84907851602     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2306915     Document Type: Article

References (38)

1. A. Miranian and M. Abdollahzade, "Developing a local least-squares support vector machines-based neuro-fuzzy model for nonlinear and chaotic time series prediction," IEEE Trans. Neural Netw., vol. 24, no. 2, pp. 207-218, Feb. 2013.
2. E. Y. Cheu, C. Quek, and S. K. Ng, "ARPOP: An appetitive rewardbased pseudo-outer-product neural fuzzy inference system inspired from the operant conditioning of feeding behavior in Aplysia," IEEE Trans. Neural Netw., vol. 23, no. 2, pp. 317-328, Feb. 2012.
3. C. H. Wang, W. Y. Wang, T. T. Lee, and P.-S. Tseng, "Fuzzy B-spline membership function and its applications in fuzzy-neural control," IEEE Trans. Syst., Man, Cybern., vol. 25, no. 5, pp. 841-851, May 1995.
4. C. L. P. Chen and Y. H. Pao, "An integration of neural network and rule-based systems for design and planning of mechanical assemblies," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 5, pp. 1359-1371, Sep./Oct. 1993.
5. P. Melin and O. Castillo, "Adaptive intelligent control of aircraft systems with a hybrid approach combining neural networks, fuzzy logic and fractal theory," Appl. Soft Comput., vol. 3, no. 4, pp. 353-362, Dec. 2003.
6. Z. Deng, Y. Jiang, K. S. Choi, F. L. Chung, and S. Wang, "Knowledgeleverage-based TSK fuzzy system modeling," IEEE Trans. Neural Netw., vol. 24, no. 8, pp. 1200-1212, Aug. 2013.
7. C. Y. Yeh, W. H. R. Jeng, and S. J. Lee, "Data-Based system modeling using a type-2 fuzzy neural network with a hybrid learning algorithm," IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 2296-2309, Dec. 2011.
8. J. S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May 1993.
9. H. X. Li and C. L. P. Chen, "The equivalence between fuzzy logic systems and feedforward neural networks," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 356-365, Mar. 2000.
10. L. Teslíc, B. Hartmann, O. Nelles, and I. Škrjanc, "Nonlinear system identification by gustafson-kessel fuzzy clustering and supervised local model network learning for the drug absorption spectra process," IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 1941-1951, Dec. 2011.
11. X. H. Yu, "Can back-propagation error surface not have local minima," IEEE Trans. Neural Netw., vol. 3, no. 6, pp. 1019-1021, Nov. 1992.
12. X. H. Yu, G.-A. Chen, and S. Xin, "Dynamic learning rate optimization of the backpropagation algorithm," IEEE Trans. Neural Netw., vol. 6, no. 3, pp. 669-677, May 1995.
13. P. Melin and O. Castillo, "Intelligent control of a stepping motor drive using an adaptive neuro-fuzzy inference system," Inf. Sci., vol. 170, nos. 2-4, pp. 133-151, Feb. 2005.
14. L. Aguilar, P. Melin, and O. Castillo, "Intelligent control of a stepping motor drive using a hybrid neuro-fuzzy ANFIS approach," Appl. Soft Comput., vol. 3, no. 3, pp. 209-219, Nov. 2003.
15. D. S. Chen and R. C. Jain, "A robust back propagation learning algorithm for function approximation," IEEE Trans. Neural Netw., vol. 5, no. 3, pp. 467-479, May 1994.
16. K. C. Tan and H. J. Tang, "New dynamical optimal learning for linear multilayer FNN," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1562-1570, Nov. 2004.
17. J. Wang, C. H. Wang, and C. L. Philip Chen, "The bounded capacity of fuzzy neural networks (FNNs) via a new fully connected neural fuzzy iference system (F-CONFIS) with Its applications," IEEE Trans. Fuzzy Syst., doi 10.1109/TFUZZ.2013.2292972, 2014.
18. C. H. Wang, H. L. Liu, and C. T. Lin, "Dynamic optimal learning rates of a certain class of fuzzy neural networks and its applications with genetic algorithm," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 31, no. 3, pp. 467-475, Jun. 2001.
19. G. D. Magoulas, M. N. Vrahatis, and G. S. Androulakis, "Effective back-propagation with variable stepsize," Neural Netw., vol. 10, no. 1, pp. 69-82, 1997.
20. W. Wu, L. Li, J. Yang, and Y. Liu, "A modified gradient-based neurofuzzy learning algorithm and its convergence," Inf. Sci., vol. 180, no. 9, pp. 1630-1642, May 2010.
21. C. H. Wang, C. S. Cheng, and T. T. Lee, "Dynamical optimal learning for FNN and its applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 3, pp. 467-475, Jun. 2004.
22. H. J. Tang, K. C. Tan, and T. H. Lee, "Dynamical optimal learning for FNN and its applications," in Proc. IEEE Int. Conf. Fuzzy Syst., vol. 1. Jul. 2004, pp. 443-447.
23. J. S. R. Jang, C. T. Sun, and E. Mizutani, Neuro-fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Upper Saddle River, NJ, USA: Prentice-Hall, 1997.
24. C. H. Wang and J. S. Wen, "On the equivalence of a table lookup (TL)technique and fuzzy neural network (FNN) with block pulse membership functions (BPMFs) and its application to water injection control of an automobile," IEEE Trans Syst., Man, Cybern. C, Appl. Rev., vol. 38, no. 4, pp. 574-580, Jul. 2008.
25. C. C. Chuang, S. F. Su, and C. C. Hsiao, "The annealing robust backpropagation (ARBP) learning algorithm," IEEE Trans. Neural Netw., vol. 11, no. 5, pp. 1067-1076, Sep. 2000.
26. M. T. Hagan, H. B. Demuth, and M. Beale, Neural Network Design. Beijing, China: Machine Press, 2002.
27. A. K. Palit and G. Doeding, "Backpropagation based training algorithm for takagi-sugeno type MIMO neuro-fuzzy network to forecast electrical load time series," in Proc. IEEE Int. Conf. Fuzzy Syst., vol. 1, May 2002, pp. 86-91.
28. M. N. H. Siddique and M. O. Tokhi, "Training neural networks: Backpropagation vs. genetic algorithms," in Proc. Int. Joint Conf. Neural Netw., vol. 4. Jul. 2001. pp. 2673-2678.
29. J. Nocedal and S. J. Wright, Numerical Optimization. Second Edition. New York, NY, USA: Springer-Verlag, 2006.
30. J. L. Aznarte and J. M. Benítez, "Equivalences between neuralautoregressive time series models and fuzzy systems," IEEE Trans. Neural Netw., vol. 21, no. 9, pp. 1434-1444, Sep. 2010.
31. J. Nocedal and S. J. Wright, Numerical Optimization, 2nd ed. New York, NY, USA: Springer-Verlag, 2006.
32. L. Armijo, "Minimization of functions having Lipschitz continuous partial derivatives," Pacific J. Math., vol. 16, no. 1, pp. 1-4, 1966.
33. F. A. Potra and Y. Shi, "Efficient line search algorithm for unconstrained optimization," J. Optim. Theory Appl., vol. 85, no. 3, pp. 677-704, 1995.
34. W. Q. Zhao, K. Li, and G. W. Irwin, "A new gradient descent approach for local learning of fuzzy neural models," IEEE Trans. Fuzzy Syst., vol. 21, no. 1, pp. 30-44, Feb. 2013.
35. C. S. Ouyang, W. J. Lee, and S. J. Lee, "A TSK-type neuro fuzzy network approach to system modeling problems," IEEE Trans. Syst., Man, Cybern., vol. 35, no. 4, pp. 751-767, Aug. 2005.
36. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Netw., vol. 1, no. 1, pp. 4-26, Mar. 1990.
37. R. Jang, "ANFIS: Adaptive network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern. vol. 23, no. 3, pp. 665-685, May/Jun. 1993.
38. J. Zhao, W. Wang, Y. Liu, and W. Pedrycz, "A two-stage online prediction method for a blast furnace gas system and its application," IEEE Trans. Control Syst. Technol., vol. 19, no. 3, pp. 507-520, May 2011.