The Chebyshev-polynomials-based unified model neural networks for function approximation

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 28, Issue 6, 1998, Pages 925-935

  Lee, Tsu Tian ^a   Jeng, Jin Tsong ^a  

^a NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

Function approximation; Neural network

Indexed keywords

CHEBYSHEV APPROXIMATION; ERROR ANALYSIS; FEEDFORWARD NEURAL NETWORKS; FUNCTION EVALUATION; LEARNING ALGORITHMS; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; POLYNOMIALS; RECURRENT NEURAL NETWORKS;

CHEBYSHEV-POLYNOMIAL-BASED (CPB) UNIFIED MODEL NEURAL NETWORKS;

NEURAL NETWORKS;

EID: 0032287679     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/3477.735405     Document Type: Article

References (44)

1. Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA: MIT Press, 1986, vol. 1, ch. 8, pp. 318-362.
2. G. Cybenko, "Approximation by superpositions of a sigmoidal function," Math. Contr., Signals, Syst., vol. 2, no. 4, pp. 303-314, 1989.
3. K. I. Funahashi, "On the approximate realization of continuous mappings by neural networks," Neural Networks, vol. 2, no. 3, pp. 183-192, 1989.
4. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, vol. 2, no. 5, pp. 359-366, 1989.
5. M. Stinchcombe and H. White, "Universal approximation using feedforward networks with nonsigmoid hidden layer activation functions," in Proc. Int. Joint Conf. Neural Networks, 1989, vol. 1, pp. 613-617.
6. K. Hornik, "Some new results on neural network approximation," Neural Networks, vol. 6, no. 8, pp. 1069-1072, 1993.
7. n) by multilayer feedforward networks and related problems," IEEE Trans. Neural Networks, vol. 6, pp. 25-30, Jan. 1995.
8. T. Chen and H. Chen, "Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems," IEEE Trans. Neural Networks, vol. 6, pp. 911-917, July 1995.
9. R. J. Williams and D. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural Computat., vol. 1, pp. 270-280, Summer 1989.
10. K. I. Funahashi and Y. Nakamura, "Approximation of dynamical systems by continuous time recurrent neural networks," Neural Networks, vol. 6, no. 6, pp. 801-806, 1993.
11. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 4-27, Jan. 1990.
12. V. T. Sunil Elanayar and Y. C. Shin, "Radial basis fonction neural network for approximation and estimation of nonlinear stochastic dynamic systems," IEEE Trans. Neural Networks, vol. 5, pp. 594-603, July 1994.
13. Q. Zhang and A. Benveniste, "Wavelet networks," IEEE Trans. Neural Networks, vol. 3, pp. 889-898, Nov. 1992.
14. J. N. Lin and R. Unbehauen, "Canonical piecewise-linear networks," IEEE Trans. Neural Networks, vol. 6, pp. 43-50, Jan. 1995.
15. J. N. Lin and R. Unbehauen, "Canonical representation from piecewise-linear function to piecewise-smooth functions," IEEE Trans. Circuits Syst., vol. 40, pp. 461-468, July 1993.
16. R. Batruni, "A multilayer neural network with piecewise-linear structure and back-propagation learning," IEEE Trans. Neural Networks, vol. 2, pp. 395-403, May 1991.
17. N. B. Karayiannis and A. N. Venetsanopoulos, Artificial Neural Networks Learning Algorithms, Performance Evaluation, and Applications. Norwell, MA: Kluwer, 1993, ch. 6, pp. 219-257.
18. K. Watanabe, T. Fukuda, and S. G. Tzafestas, "An adaptive control for CARMA systems using linear neural networks," Int. J. Contr., vol. 56, pp. 483-497, Aug. 1992.
19. V. Etxebarria, "Adaptive control of discrete systems using neural networks," in IEE Proc. Control Theory Applicat., July 1994, vol. 141, pp. 209-215.
20. C. L. Giles and T. Maxwell, "Learning, invariance, and generalization in high-order neural networks," Appl. Opt., vol. 26, pp. 4972-4978, Dec. 1987.
21. N. Sadegh, "A perceptron network for functional identification and control of nonlinear systems," IEEE Trans. Neural Networks, vol. 4, pp. 982-988, Nov. 1993.
22. G. G. Brown, A. J. Krijgsman, H. B. Verbruggen, and P. M. Bruijin, "Single-layer networks for nonlinear system identification," Eni. Applicat. Artif. Intell., vol. 7, pp. 227-243, June 1994.
23. M. S. Klassen and Y. H. Pao, "Characteristics of the functional-link net: A higher order delta rule net," IJCNN, vol. 1, pp. 507-513, 1988.
24. Y. H. Pao, S. M. Phillips, and D. J. Sobajic, "Neural-net computing and the intelligent control of systems," Int. J. Contr., vol. 56, pp. 263-289, Aug. 1992.
25. S. Chen and S. A. Billings, "Neural networks for nonlinear dynamic system modeling and identification," Int. J. Contr., vol. 56, pp. 319-346, Aug. 1992.
26. G. E. Fulcher and D. E. Brown, "A polynomial network for predicting temperature distributions," IEEE Trans. Neural Networks, vol. 5, pp. 372-379, May 1994.
27. A. G. Ivakhnenko, "Polynomial theory of complex systems," IEEE Trans. Syst., Man, Cybern., vol. SMC-1, pp. 364-378, Oct. 1971.
28. D. F. Specht, "Probabilistic neural networks and the polynomial adenine as complementary techniques for classification," IEEE Trans. Neural Networks, vol. 1, pp. 111-121, Mar. 1990.
29. _, "A general regression neural network," IEEE Trans. Neural Networks, vol. 2, pp. 568-576, Nov. 1991.
30. M. S. Chen and M. T. Manry, "Conventional modeling of the multilayer perceptron using polynomial basis functions," IEEE Trans. Neural Networks, vol. 4, pp. 164-166, Jan. 1993.
31. A. Abdulaziz and M. Farsi, "Non-linear system identification and control based on neural and self-turning control," Int. J. Adapt. Contr. Signal Process., vol. 7, pp. 297-307, July-Aug. 1993.
32. C. F. Gerald and P. O. Wheatley, Applied Numerical Analysis, 5th ed. Reading, MA: Addison-Wesley, 1994, ch. 10, pp. 696-748.
33. T. J. Rivlin, Chebyshev Polynomials Form Approximation Theory to Algebra and Number Theory, 2nd ed. New York: Wiley, 1990, ch. 3, pp. 155-191.
34. A. Namatame and N. Ueda, "Pattern classification with Chebyshev neural networks," Int. J. Neural Networks, vol. 3, pp. 23-31, Mar. 1992.
35. T. Poggio and F. Girosi, "Network for approximation and learning," Proc. IEEE, vol. 78, pp. 1481-1497, Sept. 1990.
36. T. T. Lee, J. T. Jeng, and C. L. Shih, "Discretization of continuous-time controllers via neural networks," submitted for publication.
37. W. Rudin, Real and Complex Analysis, 3rd ed. New York: McGraw-Hill, 1987, ch. 10, pp. 196-230.
38. R. Chapman and M. A. A. Rahman, "Chebyshev-Polynomial-base Schur algorithm," Proc. Inst. Elect. Eng., vol. 137, Feb. 1990.
39. J. D. Cole, "A new derivation of a closed form expression for Chebyshev polynomials of any order," IEEE Trans. Educ., vol. 32, pp. 390-392, Aug. 1989.
40. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: Macmillan, 1994, chs. 6, 7, and 13.
41. D. Elliott and D. F. Paget, "Error of truncated Chebyshev series and other near minimax polynomial approximation," J. Approx. Theory, vol. 50, pp. 49-57, 1987.
42. S. Haykin, Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice-Hall, 1991, pp. 477-507.
43. Neural Network Toolbox User's Guide. Natick, MA: The Math Works Inc., June 1992, ch. 5.
44. Y. C. Pati and P. S. Krishnaprasad, "Analysis and synthesis of feedforward neural networks using discrete affine wavelet transformations," IEEE Trans. Neural Networks, vol. 4, pp. 73-85, Jan. 1993.