Analysis of LMS-Newton Adaptive Filtering Algorithms with Variable Convergence Factor

IEEE Transactions on Signal Processing

Volumn 43, Issue 3, 1995, Pages 617-627

  Diniz, Paulo S R ^a   de Campos, Marcello L R ^b   Antoniou, Andreas ^b  

^a FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

^b UNIVERSITY OF VICTORIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE FILTERING; CORRELATION METHODS; DIGITAL ARITHMETIC; ERROR ANALYSIS; LEAST SQUARES APPROXIMATIONS; MATRIX ALGEBRA; PERFORMANCE; VECTORS;

FIXED POINT ARITHMETIC; LEAST MEAN SQUARES; MEAN SQUARE ERROR; NEWTON ADAPTIVE FILTERING ALGORITHMS;

ADAPTIVE ALGORITHMS;

EID: 0029271428     PISSN: 1053587X     EISSN: 19410476     Source Type: Journal    
DOI: 10.1109/78.370617     Document Type: Article

References (26)

1. B. Widrow and S. D. Stearns, Adaptive Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1985.
2. J. E. Mazo, “On the independence theory of equalizer convergence,” Bell Syst. Tech. J., vol. 58, 962-993, 1979.
3. T. R. Fortescue, L. S. Kershenbaum, and B. E. Ydstie, “Implementation of self-tuning regulators with variable forgetting factors,” Automatica, vol. 17, pp. 831-835, 1981.
4. B. Toplis and S. Pasupathy, “Tracking improvements in fast RLS algorithms using a variable forgetting factor,” IEEE Trans. Acoust., Speech Signal Processing, vol. 36, 206-227, Feb. 1988.
5. J. B. Evans and B. Liu, “Variable step size methods for the LMS adaptive algorithm,” in Proc. Int. Symp. Circ. Syst., Philadelphia, PA, 1987, pp. 422-425.
6. J. B. Evans, “A new variable step size method suitable for efficient VLSI implementation,” in Proc. Int. Conf. Acoustics, Speech Signal Processing, Toronto, ON, Canada, 1991, pp. 2105-2108.
7. F. F. Yassa, “Optimality in the choice of the convergence factor for gradient-based adaptive algorithms,” IEEE Trans. Acoust., Speech Signal Processing, vol. ASSP-35, pp. 48-59, Jan. 1987.
8. T. J. Shan and T. Kailath, “Adaptive algorithms with an automatic gain control feature,” IEEE Trans. Circ. Syst., vol. 35, 122-127, Jan. 1988.
9. S. Karni and G. Zeng, “A new convergence factor for adaptive filters,” IEEE Trans. Circ. Syst., vol. 36, 1011-1012, 1989.
10. S. Karni and G. Zeng, “Comments on ' ‘Adaptive algorithms with an automatic gain control feature,’” IEEE Trans. Circ. Syst., vol. 37, pp. 974-975, July 1990.
11. T. J. Shan and T. Kailath, “Comments on “Comments on ' ‘Adaptive algorithms with an automatic gain control feature,’” IEEE Trans. Circ. Syst., vol. 37, p. 975, July 1990.
12. V. J. Mathews and Z. Xie, “Stochastic gradient adaptive filters with gradient adaptive step sizes,” in Proc. Int. Conf. Acoust., Speech Signal Processing, Albuquerque, NM, 1990, pp. 1385-1388.
13. P. S. R. Diniz and L. W. P. Biscainho, “Optimal convergence factor for the LMS/Newton algorithm,” in Proc. Int. Conf. Acoust., Speech Signal Processing, Toronto, Canada, 1991.
14. “Optimal variable step size for the LMS/Newton algorithm with application to subband adaptive filtering,” IEEE Trans. Signal Processing, vol. 40, 2825-2829, Nov. 1992.
15. L. Ljung and T. Soderstrom, Theory and Practice of Recursive Identification. London: MIT Press, 1983.
16. G. C. Goodwin and S. K. Sin, Adaptive Filtering Prediction and Control Englewood Cliffs, NJ: Prentice-Hall, 1984.
17. S. Haykin, Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice-Hall, 1992, 2nd. ed.
18. E. Eleftheriou and D. D. Falconer, “Tracking properties and steady-state performance of RLS adaptive filter algorithms,” IEEE Trans. Acoust., Speech Signal Processing, vol. ASSP-34, pp. 1097-1110, Oct. 1986.
19. B. Widrow, J. M McCool, M. G. Larimore, and C. R. Johnson Jr., “Stationary and nonstationary learning characteristics of the LMS adaptive filter,” Proc. IEEE, vol. 64, pp. 1151-1162, Aug. 1976.
20. B. Widrow and E. Walach, “On the statistical efficiency of the LMS algorithm with nonstationary inputs,” IEEE Trans. Inform. Theory, vol. IT-30, pp. 211-221, Mar. 1984.
21. S. McLaughlin, B. Mulgrew, and C. F. N. Cowan, “Performance bounds for exponentially windowed RLS algorithm in a nonstationary environment,” in Proc. IMA Conf. Math. Signal Processing, Warwick, England, Dec. 1988, pp. 449-464.
22. D. F. Marshall and W. K. Jenkins, “A fast quasi-Newton adaptive filtering algorithm,” IEEE Trans. Signal Processing, vol. 40, pp. 1652-1662, July 1992.
23. G. E. Bottomley and S. T. Alexander, “A novel approach for stabilizing recursive least squares filters,” IEEE Trans. Signal Processing, vol. 39, pp. 1770-1779, Aug. 1991.
24. C. G. Samson and V. U. Reddy, “Fixed point error analysis of the normalized ladder algorithm,” IEEE Trans. Acoust., Speech Signal Processing, vol. ASSP-31, pp. 1177-1191, Oct. 1983.
25. A. Antoniou, Digital Filters: Analysis, Design, and Applications. New York: McGraw-Hill, 1993, 2nd ed.
26. M. L. R. de Campos, M. G. Siqueira, A. Antoniou, and A. N. Willson Jr., “A QR-decomposition LMS-Newton adaptive filtering algorithm with variable convergence factor,” in Proc. IEEE Pacific Rim Conf. Commun. Comput. Signal Processing, Victoria, Canada, 1993, pp. 350-353.