Asymptotic analysis of stochastic gradient-based adaptive filtering algorithms with general cost functions

IEEE Transactions on Signal Processing

Volumn 44, Issue 9, 1996, Pages 2186-2194

  Sharma, Rajesh ^a   Sethares, William A ^b   Bucklew, James A ^a  

^a ALTARUM INSTITUTE   (United States)

^b University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; FUNCTIONS; RANDOM PROCESSES; STATISTICS;

COST FUNCTIONS; LEAST MEAN SQUARE;

ADAPTIVE FILTERING;

EID: 0030243253     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.536676     Document Type: Article

References (20)

1. S. Haykin, Adaptive Filter Theory. Englewood Cliffs. NJ: PrenticeHall, 1986.
2. [21 B. Widrow, and S. D. Stearns, Adaptive Signal Processing. Englewoo Cliffs, NJ: Prentice-Hall, 1985.
3. S. C. Douglas, T. H.-Y. Meng, "Stochastic gradient adaptation unde general error criteria." IEEE Trans. Signal Processing, vol. 42, pp 1335-1351, June 1994.
4. E. Eweda, "Almost sure convergence of a decreasing gain sign algorith for adaptive filtering," IEEE Trans. Acousi.. Speech, Signal Processing vol 36. pp. 1669-1671,Oct. 1988.
5. -. ''Convergence of the sign algorithm for adaptive filtering wit correlated data," IEEE Trans. Inform. Theory, vol. 37, pp. 1450-1457 Sept. 1991.
6. C. P. Kwong, "Dual sign-algorithm for adaptive filtering," IEEE Trans Commun., vol. COM-34, no. 12, pp. 1272-1275,Dec.1986.
7. W. A. Sethares, "Adaptive algorithms with nonlinear data and error, IEEE Trans. Signal Processing, vol. 40, pp. 2199-2206, Sept. 1992.
8. E. Walach and B. Widrow, "The least mean fourth (LMF) adaptiv algorithm and its family," IEEE Trans. Inform. Theory, vol. IT-30, pp 275-283,Mar. 1984.
9. N. J. Bershad and L. Z. Qu, "On the probability density function of th complex scalar LMS adaptive weights," IEEE Trans. Acoust., Speech Signal Processing, vol. 37, no. 1, pp. 43-56,Jan. 1989.
10. J. G. Proakis, "Channel identification for high speed digital communications," IEEE Trans. Automat. Contr., vol. AC-19, pp. 916-922, Dec 1974.
11. S. Roy and J. J. Shynk, "Analysis of the momentum LMS algorithm, IEEE Trans. Acoust, Speech, Signal Processing, vol. 38, no. 12, Dec 1990.
12. J. A. Bucklew, T. G. Kurtz, and W. A. Sethares, "Weak convergenc and local stability properties of fixed step size recursive algorithms, IEEE Trans. Inform. Theory, vol. 39, no. 3, pp. 966-978, May, 1993.
13. J. A. Bucklew and W. A. Sethares, "The covering problem and /< dependent adaptive algorithms," IEEE Trans. Signal Processing, vol 42, no. 10, pp. 2616-2627,Oct., 1994.
14. R. Sharma, W. A. Sethares, and J, A. Bucklew, "Analysis of momentu adaptive filtering algorithms," IEEE Trans. Signal Processing, submitte for publication.
15. R. Durrett, Probability: Theory and Examples. CA: Wadswort Brooks/Cole, 1991
16. C. R. Johnson, Jr., Lectures on Adaptive Parameter Estimation. Englewood Cliffs, NJ: Prentice-Hall, 1988.
17. P. Billingsley, Convergence of Pmhahility Measures. New York: Wi ley, 1968.
18. A. Benveniste, M. Metivier, and P. Priouret, Adaptive Algorithms an Stochastic Approximations. New York: Springer-Verlag, 1990.
19. H. J. Kushner, Approximation and Weak Convergence Methods fo Random Processes, MIT Press Series in Signal Processing, Optimization and Control. Cambridge, MA: MIT Press, 1984.
20. M. Vidyasagar, Nonlinear System Analysis. Englewood Cliffs. NJ Prentice-Hall, 1993.