Stochastic averaging in continuous time and its applications to extremum seeking

IEEE Transactions on Automatic Control

Volumn 55, Issue 10, 2010, Pages 2235-2250

  Liu, Shu Jun ^a   Krstic, Miroslav ^b  

^a SOUTHEAST UNIVERSITY   (China)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Extremum seeking; stochastic averaging; stochastic nonlinear control

Indexed keywords

AVERAGE SYSTEM; CONTINUOUS TIME; CONTINUOUS TIME NONLINEAR SYSTEMS; EXTREMUM SEEKING; EXTREMUM SEEKING ALGORITHM; GLOBAL EXPONENTIAL STABILITY; LIPSCHITZ SYSTEMS; NON-LINEAR DYNAMIC SYSTEMS; PERIODIC SIGNAL; STABILITY ANALYSIS; STABILITY THEOREMS; STATE SPACE; STATIC MAP; STOCHASTIC AVERAGING; STOCHASTIC EXCITATIONS; STOCHASTIC NONLINEAR CONTROL; STOCHASTIC PERTURBATIONS; VECTOR FIELDS;

CONTROL THEORY; DYNAMICAL SYSTEMS; NONLINEAR DYNAMICAL SYSTEMS; STOCHASTIC SYSTEMS; SYSTEM STABILITY; VECTOR SPACES;

CONTINUOUS TIME SYSTEMS;

EID: 77957707103     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2010.2043290     Document Type: Article

References (41)

1. K. B. Ariyur and M. Krstić, Real-Time Optimization by Extremum Seeking Control. Hoboken, NJ: Wiley-Interscience, 2003.
2. J. R. Baxter and G. A. Brosamler, "Energy and the law of the iterated logarithm," Math. Scandinavica, vol. 38, pp. 115-136, 1976.
3. A. Benveniste, M. Métivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. New York: Springer-Verlag, 1990.
4. G. Blankenship and G. C. Papanicolaou, "Stability and control of stochastic systems with wide-band noise disturbances. I," SIAM J. Appl. Math., vol. 34, no. 3, pp. 437-476, 1978.
5. N. N. Bogoliubov and Y. A. Mitropolsky, Asymptotic Methods in the Theory of Nonlinear Oscillation. New York: Gordon and Breach Science Publishers, Inc., 1961.
6. J.-Y. Choi, M. Krstić, K. B. Ariyur, and J. S. Lee, "Extremum seeking control for discrete time systems," IEEE Trans. Autom. Control, vol. 47, no. 2, pp. 318-323, Feb. 2002.
7. M. I. Freidlin and A. D. Wentzell, Random Perturbations of Dynamical Systems. New York: Springer-Verlag, 1984.
8. S. N. Hashemi and A. J. Heunis, "Averaging principle for diffusion processes," Stoch. Stoch. Rep., vol. 62, pp. 201-216, 1998.
9. H. K. Khalil, Nonlinear Systems, 3rd ed. Englewood Cliffs, NJ: Prentice Hall, 2002.
10. R. Z. Khas'minskiî, Stochastic Stability of Differential Equations. Alphen aan den Rijn, The Netherlands: Sijthoff &Noordhoff, 1980.
11. R. King, R. Becker, G. Feuerbach, L. Henning, R. Petz, W. Nitsche, O. Lemke, and W. Neise, "Adaptive flow control using slope seeking," in Proc. 14th IEEE Med. Conf. Control Autom., Jun. 28-30, 2006, pp. 1-6.
12. V. S. Korolyuk, "Average and stability of dynamical system with rapid stochastic switching," in Exploring Stochastic Laws, A. V. Skorokhod and Y. V. Borovskikh, Eds. Boston, MA: Brill Academic Publishers, 1995, pp. 219-232.
13. V. S. Korolyuk, "Stability of stochastic systems in the scheme of diffusion approximation," Ukr. Mat. Zh., vol. 50, no. 1, pp. 36-47, 1998.
14. V. S. Korolyuk and A. V. Swishchuk, Evolution Systems in Random Media. Boca Raton, FL: CRC Press, 1995.
15. M. Krstić and H.H. Wang, "Stability of extremum seeking feedback for general nonlinear dynamic systems," Automatica, vol. 36, pp. 595-601, 2000.
16. H. J. Kushner, Approximation and Weak Convergence Method for Random Processes, With Applications to Stochastic Systems Theory. Cambridge, MA: The MIT Press, 1984.
17. H. J. Kushner and G. Yin, Stochastic Approximation and Recursive Algorithms and Applications, 2nd ed. New York: Spinger-Verlag, 2003.
18. Y. Li, M. A. Rotea, G. T.-C. Chiu, L. G. Mongeau, and I.-S. Paek, "Extremum seeking control of a tunable thermoacoustic cooler," IEEE Trans. Control Syst. Technol., vol. 13, no., pp. 527-536, Jul. 2005.
19. R. S. Liptser and A. N. Shiryayev, Statistics of Random Processes 1. New York: Springer, 1977.
20. R. S. Liptser and A. N. Shiryayev, Theory of Martingales. Norwell, MA: Kluwer Academic Publishers, 1989.
21. S.-J. Liu and M. Krstić, "Continuous-time stochastic averaging on infinite interval for locally Lipschitz systems," SIAM J. Control Optim., submitted for publication.
22. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Autom. Control, vol. AC-22, no. 4, pp. 551-575, Aug. 1977.
23. L. Luo and E. Schuster, "Mixing enhancement in 2D magnetohydrody-namic channel flow by extremum seeking boundary control," in Proc. Amer. Control Conf., St. Louis, MO, Jun. 10-12, 2009, [CD ROM].
24. C. Manzie and M. Krstić, "Extremum seeking with stochastic perturbations," IEEE Trans. Autom. Control, vol. 54, no. 3, pp. 580-585, Mar. 2009.
25. W. H. Moase, C. Manzie, and M. J. Brear, "Newton-like extremum-seeking part I: Theory," in Proc. 48th IEEE Conf. Decision Control, Dec. 2009, pp. 3839-3844.
26. W. H. Moase, C. Manzie, and M. J. Brear, "Newton-like extremum-seeking part II: Simulation and experiments," in Proc. 48th IEEE Conf. Decision Control, Dec. 2009, pp. 3845-3850.
27. Y. Ou, C. Xu, E. Schuster, T. C. Luce, J. R. Ferron, M. L. Walker, and D. A. Humphreys, "Design and simulation of extremum-seeking open-loop optimal control of current profile in the DIII-D tokamak," Plasma Phys. Controlled Fusion, vol. 50, p. 115001, 2008.
28. E. Pardoux and A. Y. Veretennikov, "On the Poisson equation and diffusion approximation. I," Annals Probab., vol. 29, no. 3, pp. 1061-1085, 2001.
29. J. B. Roberts and P. D. Spanos, "Stochastic averaging: An approximate method of solving random vibration problems," Int. J. Non-Lin. Mech., vol. 21, no. 2, pp. 111-134, 1986.
30. J. A. Sanders, F. Verhulst, and J. Murdock, Averaging Methods in Nonlinear Dynamical Systems, 2nd ed. New York: Springer, 2007.
31. S. Sastry and M. Bodson, Adaptive Control: Stability, Convergence, and Robustness. Englewood Cliffs, NJ: Prentice Hall, 1989.
32. E. Schuster, N. Torres, and C. Xu, "Extremum seeking adaptive control of beam envelope in particle accelerators," in Proc. 2006 IEEE Conf. Control Appl., Munich, Germany, Oct. 4-6, 2006, pp. 1837-1842.
33. A. V. Skorokhod, Asymptotic Methods in the Theory of Stochastic Differential Equations Transl.:Translations of Mathematical Monographs. Providence, RI: Amer. Math. Soc., 1989.
34. A. V. Skorokhod, F. C. Hoppensteadt, and H. Salehi, Random Perturbation Methods With Applications in Science and Engineering. New York: Springer, 2002.
35. V. Solo and X. Kong, Adaptive Signal Processing Algorithms: Stability and Performance. Englewood Cliffs, NJ: Prentice Hall, 1994.
36. J. C. Spall, Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control. New York: Wiley-Interscience, 2003.
37. M. S. Stankovic and D. M. Stipanovic, "Stochastic extremum seeking with applications to mobile sensor networks," in Proc. Amer. Control Conf., St. Louis, MO, Jun. 10-12, 2009, [CD ROM].
38. M. S. Stankovic and D. M. Stipanovic, "Discrete time extremum seeking for automous for vehicle target tracking in stochastic environment," in Proc. 48th IEEE Conf. Decision Control, 2009, pp. 4541-4546.
39. Y. Tan, D. Nešić, and I. Mareels, "On non-local stability properties of extremum seeking control," Automatica, vol. 42, no. 6, pp. 889-903, 2006.
40. W. Wehner and E. Schuster, "Stabilization of neoclassical tearing modes in tokamak fusion plasmas via extremum seeking," in Proc. 3rd IEEE Multi-Conf. Syst. Control (MSC'09), Saint Petersburg, Russia, Jul. 8-10, 2009, pp. 853-860-.
41. W. Q. Zhu and Y. Q. Yang, "Stochastic averaging of quasi-non inte-grable-Hamiltonian systems," J. Appl. Mech., vol. 64, pp. 157-164, 1997.