Stationary and Nonstationary Learning Characteristics of the LMS Adaptive Filter

Proceedings of the IEEE

Volumn 64, Issue 8, 1976, Pages 1151-1162

  Widrow, Bernard ^a   Larimore, Michael G ^a   Johnson, C Richard ^a   Mccool, John M ^b  

^a STANFORD UNIVERSITY   (United States)

^b Space and Naval Warfare Systems Center Pacific   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE FILTERS;

COMPUTER PROGRAMMING - SUBROUTINES; CONTROL SYSTEMS, ADAPTIVE - ANALYSIS; MATHEMATICAL TECHNIQUES - LEAST SQUARES APPROXIMATIONS; SIGNAL FILTERING AND PREDICTION;

ELECTRIC FILTERS, DIGITAL;

EID: 0016987049     PISSN: 00189219     EISSN: 15582256     Source Type: Journal    
DOI: 10.1109/PROC.1976.10286     Document Type: Article

References (39)

1. B. Widrow and M. E. Hoff, “Adaptive switching circuits,” in 1960 WESCON Conv. Rec., Pt. 4, pp. 96–140.
2. N. Nilsson, Learning Machines. New York: McGraw-Hill, 1965.
3. J. Koford and G. Groner “The use of an adaptive threshold element to design a linear optimal pattern classifier,” IEEE Trans. Inform. Theory, vol. IT-12, pp. 42–50, Jan. 1966.
4. B. Widrow, P. Mantey, L. Griffiths, and B. Goode “Adaptive antenna systems,” Proc. IEEE, vol. 55, pp. 2143–2159, Dec. 1967.
5. B. Widrow, “Adaptive filters,” in Aspects of Network and System Theory, R. Kaiman and N. DeClaris, Eds. New York: Holt, Rinehart, and Winston, 1971, pp. 563–587.
6. S. P. Applebaum, “Adaptive arrays,” Special Projects Lab., Syracuse Univ. Res. Corp., Rep. SPL 769.
7. L. J. Griffiths “A simple adaptive algorithm for real-time processing in antenna arrays,” Proc. IEEE, vol. 57, pp. 1696–1704, Oct. 1969.
8. O. L. Frost III “An algorithm for linearly constrained adaptive array processing,” Proc. IEEE, vol. 60, pp. 926–935, Aug. 1972.
9. W. F. Gabriel “Adaptive arrays—An introduction,” Proc. IEEE, vol. 64, pp. 239–272, Feb. 1976.
10. F. W. Smith “Design of quasi-optimal minimum-time controllers,” IEEE Trans. Automat. Contr., vol. AC-11, pp. 71–77, Jan. 1966.
11. B. Widrow, “Adaptive model control applied to real-time blood-pressure regulation,” in Pattern Recognition and Machine Learning, Proc. Japan-U.S. Seminar on the Learning Process in Control Systems, K. S. Fu, Ed. New York: Plenum Press, 1971, pp. 310–324.
12. R. Lucky “Automatic equalization for digital communication,” Bell Syst. Tech. J., vol. 44, pp. 547–588, Apr. 1965.
13. M. DiToro, “A new method of high-speed adaptive serial communication through any time-variable and dispersive transmission medium,” in Conf. Record, 1965 IEEE Annual Communications Convention, pp. 763–767.
14. R. Lucky and H. Rudin “An automatic equalizer for general-purpose communication channels,” Bell Syst. Tech. J., vol. 46, pp. 2179–2208, Nov. 1967.
15. R. Lucky et al., Principles of Data Communication. New York: McGraw-Hill, 1968.
16. A. Gersho “Adaptive equalization of highly dispersive channels for data transmission,” Bell Syst. Tech. J., vol. 48, pp. 55–70, Jan. 1969.
17. M. Soudhi “An adaptive echo canceller,” Bell Syst. Tech. J., vol. 46, pp. 497–511, Mar. 1967.
18. B. Widrow et al., “Adaptive noise cancelling: Principles and applications,” Proc. IEEE, vol. 63, pp. 1692–1716, Dec. 1975.
19. P. E. Mantey, “Convergent automatic-synthesis procedures for sampled-data networks with feedback,” Stanford Electronics Laboratories, Stanford, CA, TR no. 7663-1, Oct. 1964.
20. P. M. Lion “Rapid identification of linear and nonlinear systems,” in Proc. 1966 JACC, Seattle, WA, pp. 605–615, Aug. 1966; also AIAA Journal, vol. 5, pp. 1835–1842, Oct. 1967.
21. R. E. Ross and G. M. Lance, “An approximate steepest descent method for parameter identification,” in Proc. 1969 JACC, Boulder, CO, pp. 483–487, Aug. 1969.
22. R. Hastings-James and M. W. Sage “Recursive generalized-least-squares procedure for online identification of process parameters,” Proc. IEE, vol. 116, pp. 2057–2062, Dec. 1969.
23. A. C. Soudack, K. L. Suryanarayanan, and S. G. Rao “A unified approach to discrete-time systems identification,” Int. J. Control, vol. 14, no. 6, pp. 1009–1029, Dec. 1971.
24. W. Schaufelberger, “Der Entwurf adaptiver Systeme nach der direckten Methode von Ljapunov,” Nachrichtentechnik, Nr. 5, pp. 151–157, 1972.
25. J. M. Mendel, Discrete Techniques of Parameter Estimation: The Equation Error Formulation. New York: Marcel Dekker,' Inc., 1973.
26. S. J. Merhav and E. Gabay, “Convergence properties in linear parameter tracking systems,” Identification and System Parameter Estimation-Part 2, Proc. 3rd IFAC Symp., P. Eykhoff, Ed. New York: American Elsevier Publishing Co., Inc., 1973, pp. 745–750.
27. R. V. Southwell, Relaxation Methods in Engineering Science. New York: Oxford, 1940.
28. D. J. Wilde, Optimum Seeking Methods. Englewood Cliffs, NJ: Prentice-Hall, 1964.
29. B. Widrow, “Adaptive sampled-data systems,” in Proc. First Intern. Cong. Intern. Federation of Automatic Control, Moscow, 1960.
30. H. Robbins, and S. Monro “A stochastic approximation method,” Ann. Math. Statist., vol. 22, pp. 400–407, 1951.
31. A. Dvoretzky, “On stochastic approximation,” in Proc. Third Berkeley Symp. Math. Statist. and Probability, J. Neyman, Ed. Berkeley, CA: University of California Press, 1956, pp. 39–55.
32. J. Makhoul “Linear prediction: A tutorial review,” Proc. IEEE, vol. 63, pp. 561–580, Apr. 1975.
33. L. J. Griffiths “Rapid measurement of digital instantaneous frequency,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-23, pp. 207–222, Apr. 1975.
34. Y. T. Chien, K. S. Fu, “Learning in non-stationary environment using dynamic stochastic approximation,” in Proc. 5th Allerton Conf. Circuit and Systems Theory, pp. 337–345, 1967.
35. T. P. Daniell and J. E. Brown III, “Adaptation in nonstationary applications,” in Proc. 1970 IEEE Symp. Adaptive Processes (9th), Austin, TX, paper no. XXIV-4, Dec. 1970.
36. L. D. Davisson “Steady-state error in adaptive mean-square minimization,” IEEE Trans. Inform. Theory, vol. IT-16, pp. 382–385, July 1970.
37. T. J. Schonfeld and M. Schwartz “A rapidly converging first-order training algorithm for an adaptive equalizer,” IEEE Trans. Inform. Theory, vol. IT-17, pp. 431–439, July 1971.
38. K. H. Mueller “A new, fast-converging mean-square algorithm for adaptive equalizers with partial-response signaling,” Bell Syst. Tech. J., vol. 54, pp. 143–153, Jan. 1975.
39. L. J. Griffiths and P. E. Mantey, “Iterative least-squares algorithm for signal extraction,” in Proc. Second Hawaii Int. Conf. System Sciences, Western Periodicals Co., pp. 767–770, 1969.