Extended neuro-fuzzy models of multilayer perceptrons

Fuzzy Sets and Systems

Volumn 142, Issue 2, 2004, Pages 221-242

  Zhang, Dong ^a   Bai, Xiao Li ^a   Cai, Kai Yuan ^a  

^a BEIHANG UNIVERSITY   (China)

Author keywords

Artificial neural network; f duality; Functional equality; Fuzzy rule based system; Interactive or; Neuro fuzzy modeling; Universal approximation

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATIONAL METHODS; COMPUTER SIMULATION; EXPERT SYSTEMS; LEARNING SYSTEMS; LINGUISTICS; MATHEMATICAL MODELS; MATHEMATICAL OPERATORS; MULTILAYER NEURAL NETWORKS;

F-DUALITY; FUNCTIONAL EQUALITY; FUZZY RULE-BASED SYSTEM; INTERACTIVE-OR; NEURO-FUZZY MODELING; UNIVERSAL APPROXIMATION;

FUZZY SETS;

EID: 0742303092     PISSN: 01650114     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0165-0114(03)00244-6     Document Type: Article

References (71)

1. Azeem M.F., et al. Generalization of adaptive neuro-fuzzy inference systems. IEEE Trans. Neural Networks. 11:2000;1332-1346.
2. Azimi-Sadjadi M.R., Liou R. Fast learning process of multilayer neural networks using recursive least squares technique. IEEE Trans. Signal Process. 40(2):1992;446-450.
3. Benitez J.M., et al. Are artificial neural networks black boxes. IEEE Trans. Neural Networks. 8:1997;1156-1164.
4. Bilbro G.L., Snyder W.E., Gamier S.J., Gault J.W. Mean field annealing: a formalism for constructing GNC-like algorithms. IEEE Trans. Neural Networks. 3:1992;131-138.
5. Buckley J.J. On the equivalence of neural nets and fuzzy expert systems. Fuzzy Sets and Systems. 53:1993;129-134.
6. Castro J.L. SEPARATE. a machine learning method based on semi-global partitions IEEE Trans. Neural Networks. 11:2000;710-720.
7. Chen S., et al. Parallel recursive prediction error algorithms for training layered neural network. Internat. J. Control. 51:1990;1215-1228.
8. Chin-Teng Lin, C.S. George Lee, Neural-network-based fuzzy logic control and decision system, IEEE Trans. Comput. 40 (1991) 1320-1336.
9. Chow T.W.S., Cho S.Y. An accelerated recurrent network training algorithm using IIR filter model and recursive least squares method. IEEE Trans. Circuits Systems - I: Fund. Theory Appl. 44:1997;1082-1086.
10. K.J. Cios, Ning Liu, A machine learning method for generation of a neural network architecture: a continuous ID3 algorithm, IEEE Trans. Neural Networks 3 (1992) 280-291.
11. Cybenko G. Approximations by superposition of a sigmoidal function. Math. Control, Signals Systems. 2:1989;303-314.
12. Dombi J. Basic concepts for a theory of evaluation. the aggregative operator Europ. J. Oper. Res. 10:1982;282-293.
13. Eiji Mizutani, J.-S. Jang, Coactive neural fuzzy modeling, in: Proc. of IEEE Internat. Conf. on Neural Networks, Vol. 2, Perth, Australia, 1995, pp. 760-765.
14. S.E. Fahlman, Faster-learning variations on back-propagation: an empirical study, in: Proc. of 1988 Connectionist Models Summer School, 1988, pp. 38-51.
15. Fukuda W.K.T., Tzafestas S.G. Learning algorithms of layered neural networks via extended Kalman filters. Internat. J. Systems Sci. 22:1991;753-768.
16. Gabrays B., Bargiela A. General fuzzy min-max neural networks for clustering and classification. IEEE Trans. Neural Networks. 11:2000;769-783.
17. Geman S., Geman D. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6:1984;721-741.
18. Goldberg D.E. Genetic Algorithms in Search, Optimization and Machine Learning. 1989;Addison Wesley, Reading, MA.
19. Guian Zhou, J. Si, Subset-based training and pruning of sigmoid neural networks, Neural Networks 12 (1999) 79-89.
20. Hagan M.T., Menhaj M.B. Training feedforward networks with the Marquardt algorithm. IEEE Trans. Neural Networks. 5:1994;989-993.
21. Holland J.H. Adaptation in Natural and Artificial Systems. 1975;The University of Michigan Press, Ann Arbor.
22. Hong-Xing Li, C.L. Philip Chen, The equivalence between fuzzy logic systems and feedforward neural networks, IEEE Trans. Neural Networks, 11 (2000) 356-365.
23. Hornik K., Stinchcombe M., White H. Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks. Neural Networks. 3:1990;551-560.
24. Hunt K.J., et al. Extending the functional equivalence of radial basis function networks and fuzzy inference systems. IEEE Trans. Neural Networks. 7:1996;776-781.
25. Jacobs R.A. Increased rate of convergence through learning rate adaptation. Neural Networks. 1:1988;295-307.
26. Jang J.-S. ANFIS. adaptive-network-based fuzzy inference system IEEE Trans. Systems, Man, Cybernet. 23:1993;665-685.
27. J.-S. Jang, Structure determination in fuzzy modeling: a fuzzy CART approach, in: Proc. of the 3rd IEEE Conf. on Fuzzy Systems, vol. 1, Orlando, FL, 1994, pp. 480-485.
28. Jang J.-S., Sun C.-T. Functional equivalence between radial basis function networks and fuzzy inference systems. IEEE Trans. Neural Networks. 4:1993;156-159.
29. J.-S. Jang, C.-T. Sun, Neuro-fuzzy modeling and control, in: Proc. IEEE 83(3) (1995) 378-406.
30. Jia-Lin Chen, Jyh-Yeong Chang, Fuzzy perceptron neural networks for classifiers with numerical data and linguistic rules as inputs, IEEE Trans. Fuzzy System 8 (2000) 730-745.
31. Karayiannis N.B. Accelerating the training of feedforward neural networks using generalized Hebbian rules for initializing the internal representations. IEEE Trans. Neural Networks. 7:1996;419-426.
32. Kim J., Kasabov N. HyFIS. adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems Neural Networks. 12:1999;1301-1319.
33. Kollias S., Anastassiou D. An adaptive least squares algorithm for the efficient training of artificial neural networks. IEEE Trans. Circuits systems. 36:1989;1092-1101.
34. Liguni Y., et al. A real-time learning algorithm for a multilayered neural network based on the extended Kalman filter. IEEE Trans. Signal Process. 40:1992;959-966.
35. Maniezzo V. Genetic evolution of the topology and weight distribution of neural networks. IEEE Trans. Neural Networks. 5:1994;39-53.
36. Merrill J.W.L., Port R.F. Fractally configured neural networks. Neural Networks. 4:1991;53-60.
37. Michakewuca Z. Genetic. Algorithm + Data Structure =Evolution Programs:1996;Springer, Berlin.
38. Narendra K.S., Parthsarathy K. Identification and control of dynamical systems using neural networks. IEEE Trans. Neural Networks. 1:1990;4-27.
39. Ngia L.S.H., Sjoberg J. Efficient training of neural nets for nonlinear adaptive filtering using a recursive Levenberg-Marquardt algorithm. IEEE Trans. Signal Process. 48:2000;1915-1927.
40. D. Nguyen, B. Widrow, Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights, in: Int. Joint Conf. Neural Networks, vol. 3, San Diego, CA, 1990, pp. 21-26.
41. Nilsson N.J. The Mathematical Foundations of Learning Machines. 1990;Morgan Kaufmann, Los Altos, CA.
42. D.B. Parker, Optimal algorithms for adaptive networks: second order back propagation, second order direct propagation, and second order Hebbian learning, in: Proc. IEEE Conf. on Neural Networks, vol. II, IEEE Press, Piscataway, NJ, 1987, pp. 593-600.
43. C. Peterson, J.R. Anderson, A mean field theory learning algorithm for neural networks, Complex Systems, vol. 1, IEEE Press, NJ, 1987, pp. 995-1019.
44. Quinlan I.R. Learning efficient classification procedures and their application to chess end-games. Michalski R.S., et al. Machine Learning. 1983;Morgan Kaufmann, Los Altos, CA.
45. Rigler A.K., Irvine J.M., Vogl T.P. Rescaling of variables in back propagation learning. Neural Networks. 4:1991;225-229.
46. Rumelhart D.E., Hinton G.E., Williams R.J. Learning representations by back-propagating errors. Nature. 32:1986;533-536.
47. Shah S., et al. Optimal filtering algorithms for fast learning in feedforward neural networks. Neural Networks. 5:1992;779-787.
48. Shann J.J., Fu H.C. A fuzzy neural network for rule acquiring on fuzzy control system. Fuzzy Sets and Systems. 71:1995;345-357.
49. Shlomo Geva, Kurt Malmstorm, Joaquin Sitte, Local cluster neural net: architecture, training and applications, Neurocomputing 20 (1998) 35-56.
50. Shin-ichi Horikawa, et al., On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm, IEEE Trans. Neural Networks 3 (1992) 801-806.
51. Silvert W. Symmetric summation: a class of operations on fuzzy sets. IEEE Trans. Systems Man Cybernet. 9:1979;657-659.
52. Simpson P.K. Fuzzy min-max neural networks-Part 2. clustering IEEE Trans. Fuzzy Systems. 1:1993;32-45.
53. Simpson P.K. Fuzzy min-max neural networks-Part 1. classification IEEE Trans. Neural Networks. 3:1994;776-786.
54. Siu-yeung Cho, T.W.S. Chow, Training multilayer neural networks using fast global learning algorithm - least-squares and penalized optimization methods, Neurocomputing 25 (1999) 115-131.
55. Smyth S.G. Designing multilayer perceptrons from nearest-neighbor systems. IEEE Trans. Neural Networks. 3:1992;329-333.
56. Sugeno M., Kang G.T. Structure identification of fuzzy model. Fuzzy Sets and Systems. 28:1988;15-33.
57. Sun C.-T. Rule-base structure identification in an adaptive-network-based fuzzy inference system. IEEE Trans. Fuzzy Systems. 2:1994;64-73.
58. Takagi T., Sugeno M. Fuzzy identification of systems and its applications to modeling and control. IEEE Trans. Systems, Man, and Cybernet. 15:1985;116-132.
59. Van Ooyen A., Nienhuis B. Improving the convergence of the back-propagation algorithm. Neural Networks. 5:1992;465-471.
60. Wang L.-X. Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans. Neural Networks. 3:1992;807-814.
61. R.L. Watrous, Learning algorithms for connectionist networks: applied gradient methods of nonlinear optimization, in: Proc. IEEE Conf. on Neural Networks, vol. II, IEEE Press, Piscataway, NJ, 1987, pp. 619-627.
62. Weir M.K. A method for self-determination of adaptive learning rates in back propagation. Neural Networks. 4:1991;371-379.
63. Wessels L.F.A., Barnard E. Avoiding false local minima by proper initialization of connections. IEEE Trans. Neural Networks. 3:1992;899-905.
64. Weymaere N., Martens J.-P. On the initialization and optimization of multilayer perceptrons. IEEE Trans. Neural Networks. 5:1994;738-751.
65. Whitley D., et al. Genetic algorithms and neural networks. optimizing connections and connectivity Computing. 14:1990;347-361.
66. B. Widrow, M.A. Lehr, 30 years of adaptive neural networks: perceptron, madline, and backpropagation, in: Proc. IEEE 78 (1990) 1415-1442.
67. Yager R.R. Connectives and quantifiers in fuzzy logic. Fuzzy Sets and Systems. 40:1991;39-75.
68. Yam J.Y.F., Chow T.W.S. Feedforward networks training speed enhancement by optimal initialization of the synaptic coefficients. IEEE Trans. Neural Networks. 12:2001;430-434.
69. Yam Y.F., Chow T.W.S. Extended backpropagation algorithm. Electron. Lett. 29:1993;1701-1702.
70. Yin Wang, Gang Rong, A self-organizing neural-network-based fuzzy system, Fuzzy Sets and Systems 103 (1999) 1-11.
71. Yutaka Fukuoka, et al., A modified back-propagation method to avoid false local minima, Neural Networks 11 (1998) 1059-1072.