On the efficiency of the orthogonal least squares training method for radial basis function networks

IEEE Transactions on Neural Networks

Volumn 7, Issue 1, 1996, Pages 195-200

  Sherstinsky, Alex ^a   Picard, Rosalind W ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; EFFICIENCY; ERRORS; IMAGE CODING; INTERPOLATION; LEAST SQUARES APPROXIMATIONS; MATRIX ALGEBRA; VECTORS;

ENERGY COMPACTION; ORTHOGONAL LEAST SQUARES TRAINING METHOD; RADIAL BASIS FUNCTION NETWORKS;

FEEDFORWARD NEURAL NETWORKS;

EID: 0029733132     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.478404     Document Type: Article

References (26)

1. G. Cybenko, "Approximations by superpositions of a sigmoidal function," Math. Contr. Signals Syst., vol. 2, no. 4, pp. 303-314, 1989.
2. T. Poggio and F. Girosi, "Networks and the best approximation property," Artificial Intell. Lab., Massachusetts Institute of Technology, A.I. Memo 1164, 1989.
3. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
4. S. Renais and R. Rohwer, "Phoneme classification experiments using radial basis functions," in Proc. IEEE Int. Joint Conf. Neural Networks, Washington, DC, June 1989, pp. I:461-467.
5. K. Ng, "A comparative study of the practical characteristics of neural network and conventional pattern classifiers," Master's thesis, Massachusetts Institute of Technology, Cambridge, MA, 1990.
6. R. P. Lippmann, "An introduction to computing with neural nets," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-4, pp. 4-22, Apr. 1987.
7. _, "Pattern classification using neural networks," IEEE Trans. Commun., vol. 27, no. 11, pp. 47-64, 1989.
8. D. S. Broomhead and D. Lowe, "Multivariable functional interpolation and adaptive networks," Complex Syst., vol. 2, pp. 321-355, 1988.
9. J. Moody and C. Darken, "Fast-learning in networks of locally-tuned processing units," Neural Computa., vol. 1, no. 2, pp. 281-294, 1989.
10. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to nonlinear system identification," Int. J. Contr., vol. 50, no. 5, pp. 1873-1896, 1989.
11. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Networks, vol. 2, pp. 302-309, Mar. 1991.
12. S. Chen and S. A. Billings, "Neural networks for nonlinear dynamic system modelling and identification," Int. J. Contr., vol. 56, no. 2, pp. 319-346, 1992.
13. S. Chen, S. A. Billings, and P. M. Grant, "Recursive hybrid algorithm for nonlinear system identification using radial basis function networks," Int. J. Contr., vol. 55, no. 5, pp. 1051-1070, 1992.
14. S. Mukhopadhyay and K. S. Narendra, "Disturbance rejection in nonlinear systems using neural networks," IEEE Trans. Neural Networks, vol. 4, pp. 63-72, Jan. 1993.
15. L.-X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least squares learning," IEEE Trans. Neural Networks, vol. 3, pp. 807-814, Sep. 1992.
16. J.-S. R. Jang and C.-T. Sun, "Functional equivalence between radial basis function networks and fuzzy inference systems," IEEE Trans. Neural Networks, vol. 4, pp. 156-159, Jan. 1993.
17. A. Sherstinsky and R. W. Picard, "On training Gaussian radial basis functions for image coding," M.I.T. Media Lab Vision Modeling Group, Tech. Rep. 188, Feb. 1992.
18. M. J. D. Powell, "Radial basis functions for multivariable interpolation: A review," in Algorithms for Approximation, J. C. Mason and M. G. Cox, Eds. Oxford, UK: Clarendon, 1987.
19. T. Poggio and F. Girosi, "A theory of networks for approximation and learning," Artificial Intell. Lab., Massachusetts Institute of Technology, A.I. Memo 1140, 1989.
20. _, "Extension of a theory of networks for approximation and learning: Dimensionality reduction and clustering," Artificial Intell. Lab., Massachusetts Institute of Technology, A.I. Memo 1167, 1990.
21. _, "Networks for approximation and learning," Proc. IEEE, vol. 78, pp. 1481-1497, Sept. 1990.
22. G. Strang, Linear Algebra and Its Applications, New York: Academic, 1980.
23. _, Introduction to Applied Mathematics. Cambridge, MA: Wellesley-Cambridge, 1986.
24. A. Papoulis, Probability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1965.
25. R. J. Clarke, Transform Coding of Images, Orlando, FL: Academic, 1985.
26. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Networks, vol. 2, pp. 459-473, 1989.