Adaptive linear quadratic gaussian control: The cost-biased approach revisited

SIAM Journal on Control and Optimization

Volumn 36, Issue 6, 1998, Pages 1890-1907

  Campi, M C ^a   Kumar, P R ^b  

^a UNIVERSITY OF BRESCIA   (Italy)

^b United States of America   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LINEAR CONTROL SYSTEMS; MATRIX ALGEBRA; OPTIMAL CONTROL SYSTEMS; SYSTEM STABILITY;

ADAPTIVE LINEAR QUADRATIC GAUSSIAN CONTROL; CERTAINTY EQUIVALENCE; COST BIASED APPROACH;

ADAPTIVE CONTROL SYSTEMS;

EID: 0032203343     PISSN: 03630129     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0363012997317499     Document Type: Article

References (26)

1. V. BORKAR AND P. P. VARAIYA, Adaptive control of Markov chains, I: Finite parameter set, IEEE Trans. Automat. Control, 24 (1979), pp. 953-958.
2. P. R. KUMAR, Optimal adaptive control of linear-quadratic-Gaussian systems, SIAM J. Control Optim., 21 (1983), pp. 163-178.
3. A. BECKER, P. R. KUMAR, AND C. Z. WEI, Adaptive control with the stochastic approximation algorithm: Geometry and convergence, IEEE Trans. Automat. Control, 30 (1985), pp. 330-338.
4. W. LIN, P. R. KUMAR, AND T. I. SEIDMAN, Will the self-tuning approach work for general cost criteria?, Systems Control Lett., 6 (1985), pp. 77-85.
5. T. E. DUNCAN AND B. PASIK-DUNCAN, Adaptive control of continuous-time linear stochastic systems, Math. Control Signals Systems, 3 (1990), pp. 45-60.
6. T. E. DUNCAN, P. MANDL, AND B. PASIK-DUNCAN, Control theory methods for consistency in some least squares identification problems, IEEE Trans. Automat. Control, 38 (1993), pp. 1289-1292.
7. H. F. CHEN AND L. GUO, Convergence rate of least squares identification and adaptive control for stochastic systems, Internat. J. Control, 44 (1986), pp. 1459-1476.
8. H. F. CHEN AND L. GUO, Asymptotically optimal adaptive control with consistent parameter estimates, SIAM J. Control Optim., 25 (1987), pp. 558-575.
9. H. F. CHEN AND L. GUO, Optimal adaptive control and consistent parameter estimates for ARMAX model with quadratic cost, SIAM J. Control Optim., 25 (1987), pp. 845-867.
10. H. F. CHEN AND L. GUO, A robust stochastic adaptive controller, IEEE Trans. Automat. Control, 33 (1988), pp. 1035-1043.
11. H. CHEN AND L. GUO, Identification and Stochastic Adaptive Control, Birkhas̈user, Basel, 1991.
12. L. GUO, Self-convergence of weighted least-squares with applications to stochastic adaptive control, IEEE Trans. Automat. Control, 41 (1996), pp. 79-89.
13. P. R. KUMAR AND A. BECKER, A new family of optimal adaptive controllers for Markov chains, IEEE Trans. Automat. Control, 27 (1982), pp. 137-146.
14. W. LIN AND P. R. KUMAR, Stochastic control of a queue with two servers of different rates, in Analysis and Optimization of Systems, Lecture Notes in Control and Inform. Sci., A. Bensoussan and J. L. Lions, eds., Springer-Verlag, 1982, Chap. 44.
15. P. R. KUMAR, Simultaneous identification and adaptive control of unknown systems over finite parameter sets, IEEE Trans. Automat. Control, 28 (1983), pp. 68-76.
16. P. R. KUMAR AND P. P. VARAIYA, Stochastic Systems: Estimation, Identification and Adaptive Control, Prentice-Hall, Englewood Cliffs, NJ, 1986.
17. D. P. BERTSEKAS, Dynamic Programming: Deterministic and Stochastic Models, Prentice-Hall, Englewood Cliffs, NJ, 1987.
18. P. R. KUMAR, Convergence of least-squares parameter estimate based adaptive control schemes, IEEE Trans. Automat. Control, 35 (1990), pp. 416-424.
19. S. BITTANTI, P. BOLZERN, AND M.C. CAMPI, Recursive least squares identification algorithms with incomplete excitation: Convergence analysis and application to adaptive control, IEEE Trans. Automat. Control, 35 (1990), pp. 1371-1373.
20. H. ROOTZEN AND J. STERNBY, Consistency in least squares estimation: A Bayesian approach, Automatica, 20 (1984), pp. 471-475.
21. M. C. CAMPI, The problem of pole-zero cancellation in transfer function identification and application to adaptive stabilization, Automatica, 32 (1996), pp. 849-857.
22. D. DELCHAMPS, Analytic feedback control and the algebraic Riccati equation, IEEE Trans. Automat. Control, 29 (1984), pp. 1031-1033.
23. Y. CHOW AND H. TEICHER, Probability Theory: Independence, Interchangeably, Martingales, 2nd ed., Springer-Verlag, New York, 1988.
24. P. R. KUMAR AND T. I. SEIDMAN, Stability in the sense of bounded average power, IMA J. Math. Control Inform., 2 (1985), pp. 109-122.
25. J. M. ORTEGA, Numerical Analysis: A Second Course, Academic Press, New York, 1972.
26. P. HALL AND C. C. HEYDE, Martingale Limit Theory and Its Application, Academic Press, Toronto, 1980.