Analysis of Stability and Performance of Adaptation Algorithms with Time-Invariant Gains

IEEE Transactions on Signal Processing

Volumn 52, Issue 1, 2004, Pages 103-116

  Ahlén, Anders ^a   Lindbom, Lars ^a   Sternad, Mikael ^a  

^a UPPSALA UNIVERSITY   (Sweden)

Author keywords

Adaptive filtering; Adaptive signal processing; Least mean squares method; Tracking

Indexed keywords

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; FIR FILTERS; GRADIENT METHODS; LEAST SQUARES APPROXIMATIONS; PARAMETER ESTIMATION; REGRESSION ANALYSIS; THEOREM PROVING; TIME VARYING SYSTEMS; TRACKING (POSITION); VECTORS;

MEAN SQUARE ERROR (MSE) METHODS; TIME-INVARIANT FILTERING;

ADAPTIVE FILTERING;

EID: 0348233349     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2003.820078     Document Type: Article

References (36)

1. A. Benveniste, "Design of adaptive algorithms for tracking of time-varying systems," Int. J. Adaptive Contr. Signal Process., vol. 1, pp. 3-29, 1987.
2. A. Benveniste, M. Métivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. Berlin, Heidelberg, Germany: Springer-Verlag, 1990.
3. L. Ljung and S. Gunnarsson, "Adaptation and tracking in system identification - A survey," Automatica, vol. 26, pp. 7-21, 1990.
4. S. Roy and J. J. Shynk, "Analysis of the momentum LMS algorithm," IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 2088-2098, 1990.
5. H. S. Dabis and T. J. Moir, "Least mean squares as a control system," Int. J. Adaptive Contr. Signal Process., vol. 54, pp. 321-335, 1991.
6. L. Lindbom, M. Sternad, and A. Ahlén, "Tracking of time-varying mobile radio channels. Part I: The wiener LMS algorithm," IEEE Trans. Commun., vol. 49, pp. 2207-2217, Dec. 2001.
7. M. Sternad, L. Lindbom, and A. Ahlén, "Wiener design of adaptation algorithms with time-invariant gains," IEEE Trans. Signal Processing, vol. 50, pp. 1895-1907, Aug. 2002.
8. E. Eweda and O. Macchi, "Tracking error bounds of adaptive nonstationary filtering," Automatica, vol. 21, pp. 293-302, 1985.
9. D. C. Farden, "Tracking properties of adaptive signal processing algorithms," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-29, pp. 439-446, June 1981.
10. L. Guo and L. Ljung, "Exponential stability of general tracking algorithms," IEEE Trans. Automat. Contr., vol. 40, pp. 1376-1387, Aug. 1995.
11. _, "Performance analysis of general tracking algorithms," IEEE Trans. Automat. Contr., vol. 40, pp. 1388-1402, Aug. 1995.
12. O. Macchi, "Optimization of adaptive identification for time-varying filters," IEEE Trans. Automat. Contr., vol. AC-31, pp. 283-287, Mar. 1986.
13. G. V. Moustakides, "Exponential convergence of products of random matrices: Application to adaptive algorithms," Int. J. Adaptive Contr. Signal Process., vol. 12, pp. 579-597, 1998.
14. I. D. Landau, "A feedback system approach to adaptive filtering," IEEE Trans. Inform. Theory, vol. 30, pp. 251-262, Mar. 1984.
15. C. P. Kwong, "Further results on the control-theoretic analysis of the LMS algorithm," IEEE Trans. Signal Processing, vol. 41, pp. 943-946, Feb. 1993.
16. 2-stable feedback structure for nonlinear adaptive filtering and identification," Automatica, vol. 33, pp. 13-30, 1997.
17. M. Rupp and A. H. Sayed, "A time-domain feedback analysis of filtered-error adaptive gradient algorithms," IEEE Trans. Signal Processing, vol. 44, pp. 1428-1439, June 1996.
18. A. H. Sayed and T. Y. Al-Naffouri, "Mean-square analysis of normalized leaky adaptive filters," in Proc. ICASSP, vol. 6, Salt Lake City, UT, May 2001, pp. 3873-3876.
19. O. Macchi, Adaptive Processing: The Least Mean Squares Approach With Applications in Transmission. Chichester, U.K.: Wiley, 1995.
20. A. Feuer and E. Weinstein, "Convergence analysis of the LMS filters with uncorrelated gaussian data," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-33, pp. 222-229, Feb. 1985.
21. W. A. Gardner, "Learning characteristics of stochastic-gradient- descent algorithms: A general study, analysis, and critique," Signal Process., vol. 6, pp. 113-133, 1984.
22. _, "Nonstationary learning characteristics of the LMS algorithm," IEEE Trans. Circuits Syst., vol. CS-34, pp. 1199-1207, Oct. 1987.
23. S. Haykin, Adaptive Filter Theory, second ed. Englewood Cliffs, NJ: Prentice Hall, 1991.
24. _, Adaptive Filter Theory, third ed. Englewood Cliffs, NJ: Prentice-Hall, 1996.
25. L. L. Horowitz and K. D. Senne, "Performance advantage of complex LMS for controlling narrow-band adaptive arrays," IEEE Trans. Acoust., Speech, Signal Processing, vol. 29, pp. 722-735, June 1981.
26. B. Widrow and E. Walach, "On the statistical efficiency of the LMS algorithm with nonstationary inputs," IEEE Trans. Inform. Theory, vol. IT-30, pp. 211-221, Mar. 1984.
27. T. Kailath, Linear Systems. Englewood Cliffs, NJ: Prentice-Hall, 1980.
28. M. Vidyasagar, Nonlinear Systems Analysis, second ed. London, U.K.: Prentice-Hall Int., 1993.
29. H. J. Kushner, Approximation and Weak Convergence Methods for Random Processes with Application to Stochastic System Theory. Cambridge, MA: MIT Press, 1984.
30. B. Widrow, J. M. McCool, M. G. Larimore, and C. R. Johnson, "Stationary and nonstationary learning characteristics of the LMS adaptive filter," Proc. IEEE, vol. 64, pp. 1151-1162, Aug. 1976.
31. L. Lindbom, A. Ahlén, M. Sternad, and M. Falkenström, "Tracking of time-varying mobile radio channels. Part II: A case study," IEEE Trans. Commun., vol. 50, pp. 156-167, Jan. 2002.
32. M. Sternad, L. Lindbom, and A. Ahlén. Robust wiener design of adaptation laws with constant gains, presented at IFAC Workshop on Adaptation and Learning in Control and Signal Processing. [Online]. Available: www.signal.uu.se/Publications/abstracts/c0113.html
33. L. Lindbom, "A Wiener filtering approach to the design of tracking algorithms," Ph.D. dissertation, Dept. Technol., Uppsala Univ., Uppsala, Sweden, 1995.
34. S. C. Douglas and W. Pan, "Exact expectation analysis of the LMS adaptive filter," IEEE Trans. Signal Processing, vol. 43, pp. 2863-2871, Dec. 1995.
35. V. Kucera, Analysis and Design of Discrete Linear Control Systems. Prague, Czech Republic: Academia, 1991.
36. T. Söderström and P. Stoica, System Identification. Englewood Cliffs, NJ: Prentice-Hall, 1989.