Iterative linearization methods for approximately optimal control and estimation of non-linear stochastic system

International Journal of Control

Volumn 80, Issue 9, 2007, Pages 1439-1453

  Li, W ^a   Todorov, E ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ELECTRIC CURRENT CONTROL; FEEDBACK CONTROL; ITERATIVE METHODS; LINEARIZATION; OPTIMAL CONTROL SYSTEMS; STOCHASTIC MODELS;

BIOMECHANICAL CONTROL PROBLEM; COST-TO-GO FUNCTION; LINEAR-QUADRATIC-GAUSSIAN METHOD;

STOCHASTIC CONTROL SYSTEMS;

EID: 34548439851     PISSN: 00207179     EISSN: 13665820     Source Type: Journal    
DOI: 10.1080/00207170701364913     Document Type: Article

References (29)

1. M. Abu-Khalaf and F.L. Lewis, "Nearly optimal control laws for non-linear systems with saturating actuators using a neural network HJB approach", Automatica, 41, pp. 779-791, 2005.
2. A. Beghi and D. D'Alessandro, "Discrete-time optimal control with control-dependent noise and generalized Riccati difference equations", Automatica, 34, pp. 1031-1034, 1998.
3. D.P. Bertsekas, Dynamic Programming and Optimal Control, Belmont, Massachusetts, USA: Athena Scientific, 2000.
4. R.R. Bitmead, "Iterative control design approaches", IFAC World Congress, Sydney, Invited plenary paper, 9, pp. 381-384, 1993.
5. R. R. Bitmead, Iterative Optimal Control, in Lecture Notes on Iterative Identification and Control Design, P. Albertos and A. Sala (Eds), Strasbourg, France: European Science Foundation, 2000, pp. 153-166.
6. I.E. Brown, E.J. Cheng and G.E. Leob, "Measured and modeled properties of mammalian skeletal muscle. II. The effects of stimulus frequency on force-length and force-velocity relationships", J. Muscle Res. Cell Motil., 20, pp. 627-643, 1999.
7. A.E. Bryson and Y.-C. Ho, Applied Optimal Control, Massachusetts, USA: Blaisdell Publishing Company, 1969.
8. B.S. Chow and W.P. Birkemeier, "A new recursive filter for systems with multiplicative noise", IEEE Trans. Informat. Theory, 36, pp. 1430-1435, 1990.
9. M.C. De Oliveria and R.E. Skelton, "State feedback control of linear systems in the presence of devices with finite signal-to-noise ratio", Int. J. Cont., 74, pp. 1501-1509, 2001.
10. L. El Ghaoui, "State-feedback control of systems of multiplicative noise via linear matrix inequalities", Syst. Con. Lett., 24, pp. 223-228, 1995.
11. ∞ control and filtering of discrete-time stochastic systems with multiplicative noise", Automatica, 37, pp. 409-417, 2001.
12. C.M. Harris and D.M. Wolpert, "Signal-dependent noise determines motor planning", Nature, 394, pp. 780-784, 1998.
13. B. Hoff, "A computational description of the organization of human reaching and prehension". PhD thesis, University of Southern California, 1992.
14. A. Isidori, Non-linear Control Systems, New York, USA: Springer, 1995.
15. J.C. Jimenez and T. Ozaki, "Linear estimation of continuous-discrete linear state space models with multiplicative noise", Syst. Con. Lett., 47, pp. 91-101, 2002.
16. H. Kushner and P. Dupuis, Numerical Methods For Stochastic Control Problems in Continuous Time,, 2nd ed., New York, USA: Spinger, 2001.
17. W. Li and E. Todorov, "Iterative linear quadratic regulator design for non-linear biological movement systems", in Proceedings of the 1st International Conference on Informatics in Control, Automation and Robotics, Portugal, 1, 2004, pp. 222-229.
18. P. McLane, "Optimal stochastic control of linear systems with state-and control-dependent disturbances", IEEE Trans. Automat. Cont., 16, pp. 793-798, 1971.
19. J.B. Moore, X.Y. Zhou and E.B. Lim, "Discrete time LQG controls with control dependent noise", Syst. Con. Lett., 36, pp. 199-206, 1999.
20. C.K. Ng, L.Z. Liao and D. Li, "A globally convergent and efficient method for unconstrained discrete-time optimal, control", J. Global Optim., 23, pp. 401-421, 2002.
21. Y.A. Phillis, "Controller design of systems with multiplicative noise", IEEE Trans. Autom. Cont., 30, pp. 1017-1019, 1985.
22. Y.A. Phillis, "Estimation and control of systems with unknown covariance and multiplicative noise", IEEE Trans. Autom. Cont., 34, pp. 1075-1078, 1989.
23. M.A. Rami, X. Chen, J.B. Moore and X. Zhou, "Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls", IEEE Trans. Autom. Cont., 46, pp. 428-440, 2001.
24. E. Todorov and M. Jordan, "Optimal feedback control as a theory of motor coordination", Nature Neuroscience, 5, pp. 1226-1235, 2002.
25. E. Todorov and W. Li, "Optimal control methods suitable for biomechanical systems", in Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Cancun, Mexico, 2003, pp. 1758-1761.
26. E. Todorov, "Optimality principles in sensorimotor control", Nature Neuroscience, 1, pp. 907-915, 2004.
27. E. Todorov, "Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system", Neural Computation, 17, pp. 1084-1108, 2005.
28. Y. Uno, M. Kawato and R. Suzuki, "Formation and control of optimal trajectory in human multijoint arm movement: Minimum torque-change model", Biol. Cybern., 61, pp. 89-101, 1989.
29. J.L. Willems and J.C. Willems, "Feedback stabilizability for stochastic systems with state and control dependent noise", Automatica, 12, pp. 277-283, 1976.