Weak convergence and local stability properties of fixed step size recursive algorithms

IEEE Transactions on Information Theory

Volumn 39, Issue 3, 1993, Pages 966-978

  Bucklew, James A ^a   Kurtz, Thomas G ^a   Sethares, William A ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE SYSTEMS; ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; DIFFERENTIAL EQUATIONS; LEAST SQUARES APPROXIMATIONS; PARAMETER ESTIMATION; STABILITY;

ADAPTIVE FILTERING; FILTERING ALGORITHMS; LMS ALGORITHMS; LOCAL STABILITY; RECURSIVE ALGORITHMS;

SIGNAL FILTERING AND PREDICTION;

EID: 0027599550     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.256503     Document Type: Article

References (41)

1. M. A. Aizerman E. M. Braverman R. I. Rozonoer The method of potential functions for restoring the characteristic of a function from randomly observed points Automat. Remote Contr. 25 12 822 830 Dec. 1964
2. B. D.O. Anderson R. R. Bitmead C. R. Johnson P. V. Kokotovic R. L. Kosut I. M.Y. Mareels L. Praly B. D. Reidle Stability of Adaptive Systems: Passivity and Averaging Analysis 1986 MIT Press MA, Cambridge
3. B. D.O. Anderson I. M. Y. Mareels W. A. Sethares C. R. Johnson Averaging theory for sign-sign LMS Ρroc. 26th Ann. Allerton Conf. Commun., Contr., and Comput. Ρroc. 26th Ann. Allerton Conf. Commun., Contr., and Comput. 1988-Sept.
4. A. Benveniste M. Goursal G. Ruget Analysis of stochastic approximation schemes with discontinuous and dependent forcing terms with applications to data communication algorithms IEEE Trans. Automat Contr. AC-25 6 1042 1058 Dec. 1980
5. A. Benveniste M. Metivier P. Priouret Adaptive Algorithms and Stochastic Approximations 1990 Springer-Verlag New York
6. N. J. Bershad Comments on 'Comparison of the convergence of two algorithms for adaptive FIR digital filters IEEE Trans. Acoust., Speech, Signal Processing ASSP-33 1604 1606 Dec. 1985
7. N. J. Bershad L. Z. Qu On the probability density function of the complex scalar LMS adaptive weights IEEE Trans. Acoust., Speech, Signal Processing 37 1 43 56 Jan. 1989
8. P. Billingsley Convergence of Probability Measures 1968 John Wiley New York
9. R. R. Bitmead Convergence in distribution of LMS-type adaptive parameter estimates IEEE Trans. Automat. Contr. AC-28 1 54 60 Jan. 1983
10. Persistence of excitation conditions and the convergence of adaptive systems IEEE Trans. Inform. Theory IT-30 2 183 191 Mar. 1984
11. CCIT Red Book Oct. 1984 G721
12. S. Dasgupta C. R. Johnson Some comments on the behavior of sign-sign adaptive identifiers Syst. Contr. Lett. 7 75 82 Apr. 1986
13. D. L. Duttweiler Adaptive filter performance with nonlinearities IEEE Trans. Acoust., Speech, Signal Processing ASSP-30 578 586 Aug. 1982
14. L. J. Eriksson M. C. Allie R. A. Greiner The selection and application of an IIR adaptive filter for use in active sound attentuation IEEE Trans. Acoust., Speech, Signal Processing ASSP-35 4 437 438 Apr. 1987
15. S. Ethier T. Kurtz Markov Processes—Characterization and Convergence 1986 Wiley-Interscience New York
16. A. Gersho Adaptive filtering with binary reinforcement IEEE Trans. Inform. Theory IT-30 2 191 198 Mar. 1984
17. G. C. Goodwin K. S. Sin Adaptive Filtering, Prediction, and Control 1984 Prentice-Hall ΝJ, Englewood Cliffs
18. S. Haykin Adaptive Filter Theory 1986 Prentice-Hall ΝJ, Englewood Cliffs
19. N. S. Jayant P. Knoll Digital Coding of Waveforms 1984 Prentice-Hall NJ, Englewood Cliffs
20. T. G. Kurtz P. Protter Weak limit theorems for stochastic integrals and stochastic differential equations Ann. Probab. 19 1035 1070 1991
21. H. J. Kushner Approximation and Weak Convergence Methods for Random Processes Series in Signal Processing, Optimization, and Control 1984 MIT Press MA, Cambridge
22. H. J. Kushner D. S. Clark Stochastic Approximation Methods for Constrained and Unconstrained Systems 1978 Springer-Verlag New York
23. H. J. Kushner H. Huang Asymptotic properties of stochastic approximations with constant coefficients SIAM J. Contr. Optimizat. 19 1 87 105 Jan. 1981
24. H. J. Kushner A. Shwartz An invariant meausre approach to the convergence of stochastic approximations with state dependent noise SIAM J. Contr. Optimizat. 22 1 13 27 Jan. 1984
25. H. J. Kushner A. Shwartz Weak convergence and asymptotic properties of adaptive filters with constant gains IEEE Trans. Inform. Theory IT-30 2 177 182 Mar. 1984
26. R. W. Lucky Techniques for adaptive equalization of digital communication systems Bell Syst. Tech. J. 45 225 286 Feb. 1966
27. L. Ljung Analysis of recursive stochastic algorithms IEEE Trans. Automat. Contr. AC-22 4 551 575 Aug. 1977
28. M. Metivier P. Priouret Applications of a Kushner and Clark lemma to general classes of stochastic algorithms IEEE Trans. Inform. Theory IT-30 2 140 150 Mar. 1984
29. M. Metivier P. Priouret Theoremes de convergence presque sure pour une classe d'algorithmes stochastiques a pas decroissants Prob. Th. Rel. Fields 74 403 428 1987
30. J. L. Moschner Adaptive equalization via fast quantized state methods 1970 6796-1 Inform. Syst. Lab., Stanford Univ.
31. G. Pfiug Stochastic minimization with constant step-size: Asymptotic laws SIAM J. Contr. Optimizat. 24 655 666 1986
32. W. A. Sethares C. R. Johnson A comparison of two quantized state adaptive algorithms IEEE Trans. Acoust., Speech, Signal Processing 37 1 138 143 Jan. 1989
33. W. A. Sethares D. A. Lawrence C. R. Johnson R. R. Bitmead Parameter driftin LMS adaptive filters IEEE Trans. Acoust., Speech, Signal Processing ASSP-34 4 868 880 Aug. 1986
34. W. A. Sethares I. M.Y. Mareels B. D.O. Anderson C. R. Johnson Excitation conditions for sign-regressor LMS IEEE Trans. Circuits Syst. 35 6 613 625 June 1988
35. D. H. Shi F. Kozin On almost sure convergence of adaptive algorithms IEEE Trans. Automat. Contr. AC-31 471 474 1986
36. V. Solo The limiting behavior of LMS IEEE Trans. Acoust., Speech, Signal Processing 37 1909 1922 Dec. 1989
37. D. W. Strook S. R.S. Varadhan Multidimensional Diffusion Processes 1979 Springer-Verlag Berlin
38. Ν. A. Verhoeckx T. A.C.M. Claasen Some considerations on the design of adaptive filters with the sign algorithm IEEE Trans. Commun. COM-32 3 258 267 Mar. 1984
39. M. T. Wasan Stochastic Approximations 1969 Cambridge Univ. Press Cambridge
40. B. Widrow J. M. McCool M. G. Larimore C. R. Johnson Stationary and nonstationary learning characteristics of the LMS adaptive filter Proc. IEEE PROC-64 8 1151 1162 Aug. 1976
41. B. Widrow S. D. Stearns Adaptive Signal Processing 1985 Prentice-Hall NJ, Englewood Cliffs