Analysis of Recursive Stochastic Algorithms

IEEE Transactions on Automatic Control

Volumn 22, Issue 4, 1977, Pages 551-575

  Ljung, Lennart ^a  

^a LINKÖPING UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

RECURSIVE STOCHASTIC ALGORITHMS;

CONTROL SYSTEMS;

EID: 0017526570     PISSN: 00189286     EISSN: 15582523     Source Type: Journal    
DOI: 10.1109/TAC.1977.1101561     Document Type: Article

References (41)

1. L. Ljung, T. Soderstrom, and I. Gustavsson, “Counterexamples to general convergence of a commonly used recursive identification method,” IEEE Trans. Automat. Contr., vol. AC-20, pp. 643–652, Oct. 1975.
2. K.J. Astrom, U. Borisson, L. Ljung, and B. Wittenmark, “Theory and applications of adaptive regulators based on recursive identification,” in Proc. 6th IFAC Congress, Boston, MA, 1975. An extended version of this paper will appear in Automatica, Sept. 1977.
3. L. Ljung and S. Lindahl, “Convergence properties of a method for state estimation in power systems,” Int. J. Contr., vol. 22, pp. 113–118, July 1975.
4. L. Ljung and B. Wittenmark, “Analysis of a class of adaptive regulators,” in Proc. IFAC Symp. on Stochastic Control, Budapest, Sept. 1974.
5. L. Ljung, “Convergence of recursive, stochastic algorithms,” in Proc. IFAC Symp. on Stochastic Control, Budapest, Sept. 1974.
6. L. Ljung, “Strong convergence of a stochastic approximation algorithm,” Annals of Statistics, to be published; also available as Rep. LiTH-ISY-I-0126, Linkoping University, Linkoping, Sweden.
7. L. Ljung, “Theorems for the asymptotic analysis of recursive, stochastic algorithms,” Dep. Automat. Contr., Lund Institute of Technology, Lund, Sweden, Rep. 7522.
8. L. Ljung, “Convergence of recursive stochastic algorithms,” Division of Automatic Control, Lund Institute of Technology, Lund, Sweden, Rep. 7403, Feb. 1974.
9. W. Hahn, Stability of Motion. Berlin, Germany: Springer-Verlag, 1967.
10. R.W. Brockett, Finite Dimensional Linear Systems. New York: Wiley, 1970.
11. H. Robbins and S. Monro, “A stochastic approximation method,” Ann. Math. Stat., vol. 22, pp. 400–407, 1951.
12. J. Blum, “Multidimensional stochastic approximation methods,” Ann. Math. Stat., vol. 25, pp. 737–744, 1954.
13. M.A. Aizermann, E.M. Braverman, and L.I. Rozonoer, “Metod Potentsialnykh funktsij v teorii obuchenija mashin” (The method of potential functions in the theory of machine learning), Izd. Nauka, Moscow, 1970 (in Russian).
14. M.T. Wasan, Stochastic Approximation. Cambridge University Press, 1969.
15. Ya. Z. Tsypkin, Adaption and Learning in Automatic Systems. New York: Academic, 1971.
16. Ya. Z. Tsypkin, Foundations of the Theory of Learning Systems. New York: Academic, 1973.
17. J. Kiefer and J. Wolfowitz, “Stochastic estimation of the maximum of a regression function,” Ann. Math. Stat., vol. 23, pp. 462–466, 1952.
18. H.J. Kushner, “Stochastic approximation algorithms for the local optimization of functions with non-unique stationary points,” IEEE Trans. Automat. Contr., vol. AC-17, pp. 646–655, 1972.
19. H.J. Kushner and T. Gavin, “Stochastic approximation type methods for constrained systems: Algorithms and numerical results,” IEEE Trans. Automat. Contr., vol. AC-19, pp. 349–358, 1974.
20. K.S. Fu, “Learning system theory,” in System Theory, L.A. Zadeh and E. Polak, Eds. New York: McGraw-Hill, 1969, pp. 425–166.
21. G.N. Saridis, Z.J. Nikolic, and K.S. Fu, “Stochastic approximation algorithms for systems identification, estimation and decomposition of mixtures,” IEEE Trans. Syst. Sci. Cybern., vol. SSC-5, pp. 8–15, 1969.
22. Ya. Z. Tsypkin, “Self-learning-What is it?,” IEEE Trans. Automat. Contr., vol. AC-13, pp. 608–612, 1968.
23. E.M. Braverman, “The method of potential functions in the problem of training machines to recognize patterns without a teacher,” Automat. Remote Contr., vol. 27, pp. 1748–1770, 1966.
24. K.J. Astrom and P. Eykhoff, “System IdentificationA survey,” Automatica, vol. 7, pp. 123–164, 1971.
25. J.M. Mendel, Discrete Techniques of Parameter Estimation. New York: Marcel Dekker, 1973.
26. L.L. Scharf and D.C. Farden, “Optimum and adaptive array processing in frequence-wavenumber space,” in Proc. IEEE Conf. on Decision and Control, Phoenix, AZ, 1974, pp. 604–609.
27. D.C. Farden, “Stochastic approximation with correlated data,” Dep. Elect. Eng., Colorado State University, Fort Collins, CO, ONR Tech. Rep. 11.
28. I.D. Landau, “Unbiased recursive identification using model reference adaptive techniques,” IEEE Trans. Automat. Contr., vol. AC-21, pp. 194–202, Apr. 1976.
29. L. Ljung, “On positive real transfer functions and the convergence of some recursive schemes,” this issue, pp. 539–551.
30. T. Soderstrom, L. Ljung, and I. Gustavsson, “A comparative study of recursive identification methods,” Automatic Control, Lund Institute of Technology, Lund, Sweden, Rep. 7427, 1974.
31. L. Ljung, “Convergence of an adaptive filter algorithm,” Int. J. Contr., 1977, to be published.
32. K.J. Astrom and B. Wittenmark, “On self-tuning regulators,” Automatica, vol. 9, pp. 185–199, 1973.
33. L. Ljung and B. Wittenmark, “On a stabilizing property of adaptive regulators,” in Preprints 4th IF A C Symp. Identification, Part 3, Tbilisi, USSR, Paper 19. 1, pp. 380–389, 1976.
34. K.J. Astrom and B. Wittenmark, “Analysis of a self-tuning regulator for nonminimum phase systems,” in Proc. IFAC Symp. on Stochastic Control, Budapest, 1974.
35. D.P. Derevitskii and A.L. Fradkov, “Two models for analyzing the dynamics of adaptation algorithms,” Automat, and Remote Contr., vol. 35, pp. 59–67, 1974.
36. H.J. Kushner, “General convergence results for stochastic approximations via weak convergence theory,” Brown University, Providence, RI, LCDS Tech. Rep. 76–1, 1976.
37. H.J. Kushner, “Convergence of recursive adaptive and identification procedures via weak convergence theory,” IEEE Trans. Automat. Contr., to be published.
38. H. Cramer and M.R. Leadbetter,” Stationary and Related Stochastic Processes. New York: Wiley, 1967.
39. N.N. Krasovskij, Stability of Motion. Stanford, CA: Stanford University Press, 1963.
40. W. Hahn, Stability of Motion. Berlin, Germany: Springer-Verlag, 1967.
41. V.I. Zubov, Methods of A.M. Lyapunov and their Applications. Groningen, Holland: Noordhoff, 1964.