A joint stochastic gradient algorithm and its application to system identification with RBF networks

Proceedings of the World Congress on Intelligent Control and Automation (WCICA)

Volumn 1, Issue , 2006, Pages 1754-1758

  Chen, Badong ^b   Hu, Jinchun ^b   Li, Hongbo ^b   Sun, Zengqi ^a,b  

^a IEEE

^b TSINGHUA UNIVERSITY   (China)

Author keywords

ADALINE; MEE; MSE; RBF networks; Stochastic gradient algorithm

Indexed keywords

ADAPTIVE ALGORITHMS; ADAPTIVE FILTERING; IDENTIFICATION (CONTROL SYSTEMS); LEARNING SYSTEMS; MEAN SQUARE ERROR; RADIAL BASIS FUNCTION NETWORKS;

ADAPTIVE LINEAR NEURON; LEARNING THEORY; MINIMUM-ERROR-ENTROPY (MEE); STOCHASTIC GRADIENT ALGORITHM;

STOCHASTIC MODELS;

EID: 34047205722     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WCICA.2006.1712654     Document Type: Conference Paper

References (16)

1. B. Widrow and J. M. McCool, "A comparison of adaptive algorithms based on the methods of steepest descent and random search," IEEE Trans. Antennas Propagat., vol. AP-24, pp. 615-637, Sept. 1976.
2. L. L.Horowwitz and K. D. Senne, "Performance advantage of complex LMS for controlling narrow-band adaptive arrays," IEEE Trans. on Circuits and Systems, Vol. CAS-28, No. 6, pp. 562-576, 1981.
3. J. C. Principe, D. Xu and J. Fisher, "Information theoretic learning," in Unsupervised adaptive filtering, vol. I: Blind Source Separation, S. Haykin, Eds. New York: Wiley, 2000, pp. 265-319.
4. D. Erdogmus, J. C. Principe, "Convergence properties and data efficiency of the minimum error entropy criterion in adaline training," IEEE Transaction on signal processing, vol. 51, no.7, pp. 1966-1978, 2003.
5. D. Erdogmus, J. C. Principe, "Generalized information potential criterion for adaptive system training," IEEE Trans. on neural networks, Vol. 13, pp. 1035-1044, 2002.
6. E. Parzen, "On estimation of a probability density function and mode," in Time Series Analysis Papers. San Francisco, CA: Holden-Day, 1967.
7. C. E. Shannon, "A mathematical theory of communication," Bell Syst.Tech. J., vol. 27, pp.379-423, 623-656, 1948.
8. W. J. M. Kickert et al. "Some comments on cybernetics and control," IEEE Trans. Systems, Man and Cybernetics, Vol. SMC-8(11): 805-809, 1978.
9. M. Niranjan and F. Falliside, "Neural networks and radial basis functions for classifying static speech patterns," Computer Speech and Language, Vol. 4, pp. 275-289. 1990.
10. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. on Neural Networks, vol. 1, no. 1, pp. 4-27.1990.
11. S. A. Billings and S. Chen, "Neural networks and system identification," In K. Warwick et al. (eds), Neural Networks for Systems and Control, Peter Peregrinus, London, pp. 181-205. 1992.
12. G. P. Liu and V. Kadirkamanathan, "Multiobjective criteria for nonlinear model selection and identification with neural networks," IEE Proceedings, Part D, vol.146, no. 5, pp.373-382, 1999.
13. B. Widrow, M. E. Hoff, Jr., "Adaptive switching circuitry," in 1960 IRE WESCON Convention Rec., Part 4, pp. 96-104, 1960.
14. B. Widrow, "Generalization and information storage in networks of Adaline neurons," in M.C.Yovitz, G.T. Jacobi, and G.Goldstem, eds., Self-Organizing Systems, pp. 435-461. 1962.
15. D. Erdogmus, et al. "Online Entropy Manipulation: Stochastic Information Gradient," IEEE Signal Processing Letters, Vol. 10, no. 8, pp.242-245, 2003.
16. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal Least Square Algorithm for Radial Basis Function Networks," IEEE Trans. On Neural Networks, Vol. 2,No.2, pp. 302-309, 1991.