The bounded capacity of fuzzy neural networks (FNNs) via a new fully connected neural fuzzy inference system (F-CONFIS) with its applications

IEEE Transactions on Fuzzy Systems

Volumn 22, Issue 6, 2014, Pages 1373-1386

  Wang, Jing ^a   Wang, Chi Hsu ^b,c   Chen, C L Philip ^a  

^a UNIVERSITY OF MACAU   (Macao)

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^c NORTHEASTERN UNIVERSITY AT QINHUANGDAO   (China)

Author keywords

Capacity of neural networks; fuzzy neural networks (FNNs); fuzzy system; Iris data; neural networks

Indexed keywords

EID: 84907827113     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2013.2292972     Document Type: Article

References (49)

1. G. D. Wu, Z. W. Zhu, and P. H. Huang, "A TS-Type maximizingdiscriminability-based recurrent fuzzy network for classification problems," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 339-352, Apr. 2011.
2. C. H. Wang, W. Y. Wang, T. T. Lee, and P. S. Tseng, "Fuzzy B-spline membership function and its applications in fuzzy-neural control," IEEE Trans. Syst., Man, Cybern., vol. 25, no. 5, pp. 841-851, May 1995.
3. F. L. Chung, Z. H. Deng, and S. T.Wang, "From minimum enclosing ball to fast fuzzy inference system training on large datasets," IEEE Trans. Fuzzy Syst., vol. 17, no. 1, pp. 173-184, Feb. 2009.
4. C. F. Juang, T. C. Chen, and W. Y. Cheng, "Speedup of implementing fuzzy neural networks with high-dimensional inputs through parallel processing on graphic processing units," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 717-727, Aug. 2011.
5. C. T. Lin, W. C. Cheng, and S. F. Liang, "An on-line ICA-mixture-modelbased fuzzy neural network," IEEE Trans. Fuzzy Syst., vol. 52, no. 1, pp. 207-221, Jan. 2005.
6. C. L. P. Chen and Y. Lu, "FUZZ: A fuzzy-based concept formation system that integrates human categorization and numerical clustering," IEEE Trans. Syst., Man, Cybern., B, Cybern., vol. 27, no. 1, pp. 79-94, Feb. 1997.
7. K. M. Passino and S. Yurkovich, Fuzzy Control. Menlo Park, CA: Addison-Wesley, 1998.
8. C. L. P. Chen and Y.-H. Pao, "An integration of neural network and rulebased systems for design and planning of mechanical assemblies," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 5, pp. 1359-1371, Sep./Oct., 1993.
9. J. L. Castro, C. J. Mantas, and J. M. Benitez, "Interpretation of artificial neural networks by means of fuzzy rules," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 101-116, Jan. 2002.
10. E. Tron and M. Margaliot, "Mathematical modeling of observed natural behavior:Afuzzy logic approach," Fuzzy Sets Syst., vol. 146, pp. 437-450, 2004.
11. J. S. R. Jang, "ANFIS: Adaptive-Network-Based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May 1993.
12. H. X. Li and C. L. P. Chen, "The equivalence between fuzzy logic systems and feedforward neural networks," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 356-365, Mar. 2000.
13. J. R. Castro, O. Castillo, P. Melin, and A. Rodríguez-Díaz, "A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks," Inform. Sci., vol. 179, no. 13, pp. 2175-2193, 2009.
14. V. Kreinovich, H. T. Nguyen, and Y. Yam, "Fuzzy systems are universal approximators for a smooth function and its derivatives," Int. J Intell. Syst., vol. 15, no. 6, pp. 565-574, Jun. 2000.
15. L. X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least squares learning," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 807-814, Sep. 1992.
16. R. Hassine, F. Karray, A. M. Alimi, and M. Selmi, "Approximation properties of fuzzy systems for smooth functions and their first-order derivative," IEEE Trans. Syst., Man, Cybern., A, Syst., Humans, vol. 33, no. 2, pp. 160-168, Mar., 2003.
17. P. L. Narasimha, M. T. Manry, and F.Maldonado, "Upper bound on pattern storage in feedforward networks," in Proc. Int. Joint Conf. Neural Netw., Orlando, FL, USA, Aug. 2007, pp. 1714-1719.
18. R. J. Mceliece, "The capacity of the hopfield associative memory," IEEE Trans. Inform. Theory, vol. IT-33, no. 4, pp. 461-482, Jul., 1987.
19. A. Kuh and B. W. Dickson, "Information capacity of associative memories," IEEE Trans. Inform. Theory, vol. 35, no. 1, pp. 59-68, Jan. 1989.
20. T. M. Cover, "Capacity problems for linear machines," in Pattern Recognition, L. Kanal, Ed. Oklahoma City, OK, USA: Thompson, 1968, pp. 283-289.
21. S. Tamura, "Capabilities of a three-layer feedforward neural network," in Proc. Int. Joint Conf. Neural Netw., Nov. 1991, pp. 2757-2762.
22. S. C. Huang and Y Huang, "Bounds on the number of hidden neurons in multilayer perceptrons," IEEE Trans. Neural Netw., vol. 2, no. 1, pp. 47-55, Jan. 1991.
23. M. A. Sartori and P. J. Antsaklis, "A simple method to derive bounds on the size and to train multilayer neural networks," IEEE Tran. Neural Netw., vol. 2, no. 4, pp. 467-471, Jul. 1991.
24. G. B. Huang and H. A. Babri, "Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation function," IEEE Trans. Neural Netw., vol. 9, no. 1, pp. 224-229, Jan. 1998.
25. J. Wang, C. H. Wang, and C. L. P. Chen, "Finding the capacity of Fuzzy Neural Networks (FNNs) via its equivalent fully connected neural networks (FFNNs)," in Proc. IEEE Int. Conf. Fuzzy Syst., 2011, pp. 2193-2198.
26. J.Wang, C. H.Wang, and C. L. P. Chen, "On the BP training algorithm of Fuzzy Neural Networks (FNNs) via its equivalent fully connected neural networks(FFNNs)," in Proc. IEEE Int. Conf. Syst., Man, Cybern., Oct. 2011, pp. 1376-1381.
27. C. T. Lin, C. M. Yeh, S. F. Liang, and J. F. Chung, "Support-vector-based fuzzy neural network for pattern classification," IEEE Trans. Fuzzy Syst., vol. 14, no. 1, pp. 31-41, Feb. 2006.
28. A. Singh, C. Quek, and S. Y. Cho, "DCT-Yager FNN: A novel yager-based fuzzy neural network with the discrete clustering technique," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 625-644, Apr. 2008.
29. W. C. Wong, S. Y. Cho, and C. Quek, "R-POPTVR: A novel reinforcement-based POPTVR fuzzy neural network for pattern classification," IEEE Trans. Neural Netw., vol. 20, no. 11, pp. 31-41, Nov. 2009.
30. B. Hammer, "Generalization ability of folding networks," IEEE Trans. Knowledge Data Eng., vol. 13, no. 2, pp. 196-206, Mar./Apr. 2001.
31. E. H. Mamdani, "Application of fuzzy algorithms for control of simple dynamic plant," Proc. Inst. Elect. Eng., vol. 121, no. 12, pp. 1585-1588, 1976.
32. Z. H. Deng, K. S. Choi, F. L. Chung, and S. T. Wang, "Scalable TSK fuzzy modeling for very large datasets using minimal-enclosing-ball approximation," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 210-226, Apr. 2011.
33. C. F. Juang and C. D. Hsieh, "A fuzzy system constructed by rule generation and iterative linear SVR for antecedent and consequent parameter optimization," IEEE Trans. Fuzzy Syst., vol. 20, no. 2, pp. 372-384, Apr. 2012.
34. C. F. Juang and Y. C. Chang, "Evolutionary group-based particle swarmoptimized fuzzy controller with application to mobile robot navigation in unknown environments," IEEE Trans. Fuzzy Syst., vol. 19, no. 2, pp. 379-392, Apr. 2011.
35. A. K. Palit and G. Doeding, "Backpropagation based training algorithm for Takagi-Sugeno type MIMO neuro-fuzzy network to forecast electrical load time series," in Proc. IEEE Int. Conf. Fuzzy Syst., 2002, vol. 1, pp. 86-91.
36. S. Tong and H. X. Li, "Fuzzy adaptive sliding-mode control for MIMO nonlinear systems," IEEE Trans. Fuzzy Syst., vol. 11, no. 3, pp. 354-360, Jun., 2003.
37. S. Islam and P. X. Liu, "Robust adaptive fuzzy output feedback control system for robot manipulators," IEEE Trans. Fuzzy Syst., vol. 16, no. 2, pp. 288-296, Apr. 2011.
38. S. Horikawa, T. Furuhashi, and Y. Uchikawa, "On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm," IEEE Trans. Neural Netw., vol. 3, no. 5, pp. 801-806, Sep. 1992.
39. C. L. P. Chen, S. R. LeClair, and Y. H. Pao, "An incremental adaptive implementation of functional-link processing for function approximation, time-series prediction, and system identification," Neurocomput., vol. 18, no. 1-3, pp. 11-31, Jan. 1998.
40. Y. J. Liu, W. Wang, S. C. Tong, and Y. S. Liu, "Robust adaptive tracking control for nonlinear systems based on bounds of fuzzy approximation parameters," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 40, no. 1, pp. 170-184, Jan., 2010.
41. M. N. H. Siddique and M. O. Tokhi, "Training neural networks: Backpropagation vs. genetic algorithms," in Proc. Int. Joint Conf. Neural Netw., 2001, vol. 4, pp. 2673-2678.
42. C. H.Wang, H. L. Liu, and C. T. Lin, "Dynamic optimal learning rates of a certain class of fuzzy neural networks and its applications with genetic algorithm," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 31, no. 3, pp. 467-475, Jun. 2001.
43. C. H. Wang and J. S. Wen, "On the equivalence of a table lookup (TL) technique and fuzzy neural network (FNN) with block pulse membership functions (BPMFs) and its application to water injection control of an automobile," IEEE Trans Syst., Man, Cybern. C, Appl. Rev., vol. 38, no. 4, pp. 574-580, Jul. 2008.
44. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995.
45. C. S. Chen, "SRobust self-organizing neural-fuzzy control with uncertainty observer for MIMO nonlinear systems," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 694-706, Aug. 2011.
46. V. N. Vapnik, "An overview of statistical learning theory," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 988-999, Sep. 1999.
47. J. M. Leski, "TSK-fuzzy modeling based on insensitive learning," IEEE Trans. Fuzzy Syst., vol. 13, no. 2, pp. 181-193, Apr. 2005.
48. W. M. Thorburn, "Occam's razor," Mind, vol. 24, pp. 287-288, 1915.
49. J.Yu andM. S.Yang, "A generalized fuzzy clustering regularizationmodel with optimality tests and model complexity analysis," IEEE Trans. Fuzzy Syst., vol. 15, no. 5, pp. 904-915, Oct. 2007.