On-line step-size selection for training of adaptive systems

IEEE Signal Processing Magazine

Volumn 14, Issue 6, 1997, Pages 45-46

  Douglas, Scott C ^a   Cichocki, Andrzej ^b  

^a UNIVERSITY OF UTAH   (United States)

^b RIEKN   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE FILTERING; ALGORITHMS; CORRELATION THEORY; ONLINE SYSTEMS; SIGNAL PROCESSING; TIME VARYING SYSTEMS;

GRADIENT BASED STEP SIZE METHODS; LEAST MEAN SQUARE ALGORITHM; RECURSIVE LEAST SQUARES TECHNIQUE;

ADAPTIVE SYSTEMS;

EID: 0031269426     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.1997.637311     Document Type: Article

References (19)

1. B. Widrow and S.D. Stearns, Adaptive Signal Processing, Englewood Cliffs, NJ: Prentice-Hall, 1985.
2. S. Haykin, Neural Networks: A Comprehensive Foundation, Englewood Cliffs, NJ: Macmillan, 1994.
3. A.H. Sayed and T. Kailath, "A State-Space Approach to Adaptive RLS Filtering," IEEE Signal Processing Mag., vol. 11, no. 3, pp. 18-60, July 1994.
4. L. Ljung and T. Söderström, Theory and Practice of Recursive Identification. Cambridge, MA: MIT Press, 1983.
5. S. Singhal and L. Wu, "Training Feedforward Networks with the Extended Kalman Filter," IEEE Int. Conf. Acoust., Speech, Signal Processing, Glasgow, UK, vol. 2, pp. 1187-1190, May 1989.
6. H.J. Kushner and D.S. Clark, Stochastic Approximation Methods far Constrained and Unconstrained Systems, New York: Springer-Verlag, 1978.
7. D.T.M. Slock, "On The Convergence Behavior of the LMS and the Normalized LMS Algorithms, IEEE Trans. Signal Processing., vol. 41, pp. 2811-2825, Sept. 1993.
8. S.C. Douglas and T.H.-Y. Meng, "Normalized Data Nonlinearities for LMS Adaptation," IEEE Trans. Signal Processing, vol. 42, pp. 1352-1365, June 1994.
9. C. Darken and J. Moody, "Towards Faster Stochastic Gradient Search," Advances in Neural Information Processing Systems, vol. 4, (San Mateo, CA: Morgan Kaufman, 1991), pp. 1009-1016.
10. S. Amari, "A Theory of Adaptive Pattern Classifiers," IEEE Trans. Electron. Comput., vol. 16, pp. 299-307, 1967.
11. R.A. Jacobs, "Increased Rates of Convergence Through Learning Rate Adaptation," Int Neural Networks, vol. 1, pp. 295-307, 1988.
12. V.J. Mathews and Z. Xie, "A Stochastic Gradient Adaptive Filter with Gradient Adaptive Step Size," IEEE Trans. on Signal Processing, vol. 41, pp. 2075-2087, June 1993.
13. S.C. Douglas, "Generalized Gradient Step Sizes for Stochastic Gradient Adaptive Filters," Proc. Conf. Acoust., Speech, Signal Processing, Detroit, MI, vol. 2, pp. 1396-1399, May 1995.
14. H.J. Kushner and J. Yang, "Analysis of Adaptive Step-Size SA Algorithms for Parameter Tracking," IEEE Trans. Automatic Control, vol. 40, pp. 1403-1410, Aug. 1995.
15. S. Haykin, Adaptive Filter Theory, 3rd ed. Upper Saddle River, NJ: Prentice-Hall, 1996.
16. T.J. Shan and T. Kailath, "Adaptive Algorithms with an Automatic Gain Control Feature," TEEE Trans. Circuits Syst., vol. 35, pp. 122-127, Jan. 1988.
17. T. Aboulnasr and K. Mayyas, "A Robust Variable Step-Size LMS-Type Algorithm: Analysis and Simulations," IEEE Trans. Signal Processing, vol. 45, pp. 631-639, March 1997.
18. S. Karni and G. Zeng, "A New Convergence Factor for Adaptive Filters," IEEE Trans. Circuits Syst., vol. 36, pp. 1011-1012, July 1989.
19. A. Cichocki, S. Amari, M. Adachi, and W. Kasprzak, "Self-Adaptive Neural Networks for Blind Separation of Sources," Proc. Int. Symp. on Circuits & Syst., Atlanta, GA, vol. 2, pp. 157-161, May 1996.