Convergence in Distribution of LMS-Type Adaptive Parameter Estimates

IEEE Transactions on Automatic Control

Volumn 28, Issue 1, 1983, Pages 54-60

  Bitmead, Robert R ^a  

^a JAMES COOK UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

CONTROL SYSTEMS, ADAPTIVE;

EID: 0020543225     PISSN: 00189286     EISSN: 15582523     Source Type: Journal    
DOI: 10.1109/TAC.1983.1103143     Document Type: Article

References (41)

1. R. R. Bitmead and B. D. O. Anderson, “Performance of adaptive estimation algorithms in dependent random environments,” IEEE Trans. Automat. Contr., vol. AC-25, pp. 788–794, Aug. 1980.
2. P. C. Young, “A general theory of modelling for badly defined systems,” in Modelling and Simulation of Land, Air and Water Resources Systems, G. C. Vansteenkiste, Ed. Amsterdam, The Netherlands: North-Holland, 1978.
3. R. R. Bitmead and B. D. O. Anderson, “Lyapunov techniques for the exponential stability of linear difference equations with random coefficients,” IEEE Trans. Automat. Contr., vol. AC-25, pp. 782–787, Aug. 1980.
4. B. Widrow, J. M. McCool, M. G. Larimore, and C. R. Johnson, Jr., “Stationary and nonstationary learning characteristics of the LMS adaptive filter,” Proc. IEEE, vol. 64, pp. 1151–1162, Aug. 1976.
5. M. H. A. Davis, Linear Estimation and Stochastic Control. London, England: Chapman & Hall, 1977.
6. A. E. Albert and L. A. Gardner, Jr., Stochastic Approximation and Nonlinear Regression. Cambridge, MA: MIT Press, 1967.
7. R. Kumar and J. B. Moore, “Inverse state and decorrelated state stochastic approximation,” in Proc. IFAC Conf., Darmstadt, West Germany, Sept. 1979.
8. L. D. Davisson, “Steady-state error in adaptive mean-square minimization,” IEEE Trans. Inform. Theory, vol. IT-16, pp. 382–385. July 1970.
9. P. Billingsley, Convergence of Probability Measures. New York: Wiley, 1968.
10. M. Iosifescu and R. Theodorescu, Random Processes and Learning. New York: Springer-Verlag, 1969.
11. M. Loève, Probability Theory. 4th ed. New York: Springer-Verlag, 1977, vols. I, II.
12. S. K. Jones, “Adaptive filtering with correlated training samples: A mean square error analysis,” Ph.D. dissertation, Dep. Elec. Eng., Southern Methodist Univ., Dallas. TX, Jan. 1973.
13. J.-K. Kim and L. D. Davisson. “Adaptive linear estimation for stationary M-dependent processes,” IEEE Trans. Inform. Theory, vol. IT-21, pp. 23–31, Jan. 1975.
14. P. H. Diananda, “Some probability limit theorems with statistical applications.” Proc. Cambridge Phil. Soc., vol. 49, pp. 239–246, 1953.
15. T. W. Anderson, “On asymptotic distributions of estimates of parameters of stochastic difference equations.” Ann. Math. Statist., vol. 30, pp. 676–687, 1959.
16. D. J. Aldous and G. K. Eagleson, “On mixing and stability of limit theorems,” Ann. Probabil., vol. 6, pp. 325–331, 1978.
17. A. Rényi, “On stable sequences of events.” Sankhya Ser. A., vol. 25, pp. 293–302, 1963.
18. H. Rootzén, “Fluctuations of sequences which converge in distribution,” Ann. Probabil. vol. 4, pp. 456–463, 1976.
19. G. K. Eagleson, “Some simple conditions for limit theorems to be mixing,” Teor. Verojamost. i Primenen, vol. 21, pp. 653–660, 1976.
20. J. S. White, “The limiting distribution of the serial correlation coefficient in the explosive case. Parts I. II,” Ann. Math. Statist., vol. 29. pp. 1188–1197, 1958 and vol. 30, pp. 831–834, 1959.
21. B. Widrow, “Adaptive filters,” in Aspects of Network and System Theory, R. E. Kalman and N. De Claris, Eds. New York: Holt, Rinehart and Winston, 1970.
22. A. Gersho, “Adaptive equalization of highly dispersive channels for data transmission,” Bell Syst. Tech. J., vol. 48, pp. 55–70, Jan. 1969.
23. K. D. Senne, “An exact solution to an adaptive linear estimation problem,” Frank J. Seiler Res. Lab., U.S. Air Force Syst. Command, Tech. Rep. SRL-TR-70–0014, Sept. 1970.
24. B. T. Polyak, “Convergence and convergence rate of iterative stochastic algorithms, I. General Case.” Automat. Remote Contr., pp. 1858–1868, Dec. 1976.
25. B. T. Polyak, “Convergence and convergence rate of iterative stochastic algorithms, II. The linear case,” Automat. Remote Contr., pp. 537–542, Apr. 1977.
26. J. M. Mendel, Discrete Techniques of Parameter Estimation: The Equation Error Formulation. New York: Marcel Dekker, 1973.
27. K. D. Senne, “Adaptive linear discrete-time estimation,” Ph.D. dissertation, Stanford Electron. Lab., Rep. SEL-68–090, June 1968.
28. B. Widrow, J. Glover, J. McCool, J. Kaunitz, C. Williams. R. Hearn, J. Zeidler, E. Dong, and R. Goodlin, “Adaptive noise random variables,” Z. Wahrscheinlichkeitstheorie und verw. Geb., vol. 12, pp. 155–171, 1969.
29. D. Graupe and E. Fogel, “A unified sequential identification structure based on convergence considerations,” Automatica, vol. 12, pp. 53–59, 541, 1976.
30. cancelling: Principles and applications,” Proc. IEEE, vol. 63. pp. 1692–1716, Dec. 1975.
31. T. P. Danieli, “Adaptive estimation with mutually correlated training sequences,” IEEE Trans. Syst. Sci. Cybem., vol. SSC-6, pp. 12–19, Jan. 1970.
32. D. C. Farden, J. C. Goding, and K. Sayood, “On the ‘desired behavior’ of adaptive signal processing algorithms,” in Proc. Int. Conf. Acoust., Speech. Signal Processing, Washington, DC. Apr. 1979.
33. L. Ljung, “Analysis of recursive stochastic algorithms,” IEEE Trans. Automat. Contr., vol. AC-22, pp. 551–575, Aug. 1977.
34. H. J. Kushner, “Convergence of recursive adaptive and identification procedures via weak convergence theory,” IEEE Trans. Automat. Contr., vol. AC-22, pp. 921–930, Dec. 1977.
35. D. C. Farden and L. L. Scharf, “Stochastic approximation with correlated data, I: Applications,” Dep. Elec. Eng., Univ. Rochester, Rochester, NY, Tech. Rep., Jan. 1979, submitted for publication.
36. D. C. Farden, “Stochastic approximation with correlated data,” IEEE Trans. Inform. Theory, vol. IT-27, pp. 105–113, Jan. 1981.
37. M. M. Sondhi and D. Mitra, “New results on the performance of a well-known class of adaptive filters,” Proc. IEEE, vol. 64, pp. 1583–1597, Nov. 1976.
38. R. R. Bitmead and B. D. O. Anderson, “Exponentially convergent behavior of simple stochastic estimation algorithms,” in Proc. 17th IEEE Conf. Decision Contr., San Diego, CA, 1979.
39. R. R. Bitmead, “Convergence properties of LMS adaptive estimators with unbounded dependent inputs,” in Proc. 20th IEEE Conf. Decision Contr., San Diego, CA, 1981, pp. 607–612.
40. W. Phillip, “The central limit problem for mixing sequences of random variables,” Z. Wahrscheinliclkeifstheorie und verw. Geb., vol. 12, pp. 155–171, 1969.
41. D. Graupe and E. Fogel, “A unified sequential identification struc-ture based on convergence considerations.” Aufomarica, vol. 12. pp. 53–59, 541. 1976.