Radial basis function networks, regression weights, and the expectation - Maximization algorithm

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

Volumn 27, Issue 5, 1997, Pages 613-623

  Langari, Reza ^a,b   Wang, Liang ^a,b   Yen, John ^a,b  

^a IEEE   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; COMPUTER SIMULATION; OPTIMIZATION; PARAMETER ESTIMATION; REGRESSION ANALYSIS;

EXPECTATION MAXIMIZATION (EM) ALGORITHMS; RADIAL BASIS FUNCTION (RBF) NETWORKS; REGRESSION WEIGHTS;

NEURAL NETWORKS;

EID: 0031238274     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/3468.618260     Document Type: Article

References (33)

1. B. D. O. Anderson and J. B. Moore, Optimal Filtering. Englewood Cliffs, NJ: Prentice-Hall, 1979.
2. G. J. Bierman, Factorization Methods for Discrete Sequential Estimation. New York: Academic, 1977.
3. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
4. G. E. P. Box and G. M. Jenkins, Time Series Analysis: Forecasting and Control, 2nd ed. San Francisco, CA: Holden-Day, 1976.
5. D. S. Broomhead and D. Lowe, "Multivariable functional interpolation and adaptive networks," Complex Syst., vol. 2, pp. 321-355, 1988.
6. S. Chen, S. A. Billings, and P. M. Grant, "Recursive hybrid algorithm for nonlinear system identification using radial basis function networks," Int. J. Control, vol. 55, pp. 1051-1070, 1992.
7. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares algorithm for radial basis function networks," IEEE Trans. Neural Networks, vol. 2, pp. 302-309, 1991.
8. C. Chinrungrueng and C. H. Sequin, "Optimal adaptive K-means algorithm with dynamic adjustment of learning rate," IEEE Trans. Neural Networks, vol. 6, pp. 157-169, 1995.
9. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Statist. Soc., vol. B39, pp. 1-38, 1977.
10. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
11. M. Feder and E. Weinstein, "Parameter estimation of superimposed signals using the EM algorithm," IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 477-489, 1988.
12. J. A. S. Freeman and D. Saad, "Learning and generalization in radial basis function networks," Neural Comput., vol. 7, pp. 1000-1020, 1995.
13. J. A. S. Freeman and D. Saad, "Radial basis function networks: Generalization in over-realizable and unrealizable scenarios," Neural Networks, vol. 9, pp. 1521-1529, 1996.
14. G. C. Goodwin and R. L. Payne, Dynamic System Identification: Experiment Design and Data Analysis. New York: Academic, 1977.
15. C. J. Harris, C. G. Moore, and M. Brown, Intelligent Control: Aspects of Fuzzy Logic and Neural Networks. Singapore: World Scientific, 1993.
16. J. Hauser, S. Sastry, and P. Kokotovic, "Nonlinear control via approximate input-output linearization: The ball and beam example," IEEE Trans. Automat. Contr., vol. 37, pp. 392-398, 1992.
17. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: Macmillan, 1994.
18. M. J. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Comput., vol. 6, pp. 181-214, 1994.
19. T. Katayama and T. Hirai, "Parameter identification for noisy image via the EM algorithm," Signal Process., vol. 20, pp. 15-24, 1990.
20. P. G. Kaminski, A. E. Bryson, and S. F. Schmidt, "Discrete square-root filtering: A survey of current techniques," IEEE Trans. Automat. Contr., vol. 16, pp. 727-735, 1971.
21. J. A. Leonard and M. A. Kramer, "Radial basis function networks for classifying process faults," IEEE Control Syst. Mag., vol. 11, pp. 31-38, 1991.
22. J. Moody and C. J. Darken, "Fast learning in networks of locally-tuned processing units," Neural Comput., vol. 1, pp. 281-294, 1989.
23. M. J. D. Powell, "Radial basis functions for multivariable interpolation: A review," in IMA Conf. Approximation Functions Data, Shrivenham, U.K., 1985, pp. 143-167.
24. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, pp. 1481-1497, 1990.
25. R. A. Redner and H. R. Walker, "Mixture densities, maximum likelihood and the EM algorithm," SIAM Rev., vol. 26, pp. 195-239, 1984.
26. R. H. Shumway, "An approach to time series smoothing and forecasting using the EM algorithm," J. Time Series Anal., vol. 3, pp. 253-263, 1982.
27. G. Strang, Linear Algebra and Its Applications. New York: Academic, 1980.
28. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its application to modeling and control," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, pp. 116-132, 1985.
29. L. Wang and R. Langari, "Complex systems modeling via fuzzy logic," IEEE Trans. Syst., Man, Cybern., vol. 26, pp. 100-106, 1996.
30. L. Wang, G. Libert, and P. Manneback, "Kalman filtering algorithm based on singular value decomposition," in Proc. 31st IEEE Conf., Decision Control, Tucson, AZ, Dec. 1992, pp. 1224-1229.
31. L. X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least squares learning," IEEE Trans. Neural Networks, vol. 3, pp. 807-814, 1992.
32. D. Wettschereck and T. Dietterich, "Improving the performance of radial basis function networks by learning center locations," in Advances in Neural Information Processing Systems 4, J. Moody, S. J. Hanson, and R. P. Lippmann, Eds. San Mateo, CA: Morgan-Kaufmann, 1992, pp. 1133-1140.
33. L. Xu and M. I. Jordan, "EM learning on a generalized finite mixture model for combining multiple classifiers," in Proc. World Congr. Neural Networks 5, Portland, OR, 1993, pp. 227-230.