SPSA with a fixed gain for intelligent control in tracking applications

Proceedings of the IEEE International Conference on Control Applications

Volumn , Issue , 2009, Pages 1415-1420

  Granichin, Oleg ^a   Gurevich, Lev ^a   Vakhitov, Alexander ^a  

^a ST PETERSBURG STATE UNIVERSITY   (Russian Federation)

Author keywords

[No Author keywords available]

Indexed keywords

ARBITRARY NOISE; CHANGING ENVIRONMENT; HIGH-DIMENSIONAL; IN-FIELD; MEAN SQUARE ESTIMATION; MULTIDIMENSIONAL OPTIMIZATION; NON-CONSTRAINED; NUMERICAL SIMULATION; RANDOM NOISE; SIMULTANEOUS PERTURBATION STOCHASTIC APPROXIMATION ALGORITHMS; TRACKING APPLICATION; TRACKING PROBLEM; UPPER BOUND;

APPROXIMATION ALGORITHMS; APPROXIMATION THEORY; COMPUTER SIMULATION; INTELLIGENT CONTROL;

CONSTRAINED OPTIMIZATION;

EID: 74049147049     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCA.2009.5280941     Document Type: Conference Paper

References (24)

1. Zhang, J., Zhao, R., and Tang, W., Fuzzy Age-Dependent Replacement Policy and SPSA Algorithm Based on Fuzzy Simulation, Information Sciences: An International Journal, 2008, vol. 178(2), pp. 573-583
2. Ning, Y., Tang, W., and Guo, C., Simultaneous Perturbation Stochastic Approximation Algorithm Combined with Neural Network and Fuzzy Simulation, Transactions of Tianjin University, 2008, vol. 14(1), pp. 4349
3. Maeda, Y. and De Figueiredo, R.J.P., Learning Rules for Neuro-Controller via Simultaneous Perturbation, IEEE Transactions on Neural Networks,1997, vol. 8, pp. 1119-1130
4. Ni, J. and Song, Q., Dynamic Pruning Algorithm for Multilayer Perceptron-Based Neural Control Systems, Neurocomputing,2006, vol. 69, pp. 20972111
5. Granichin O.N., Izmakova O.A. Randomized algorithms of stochastic approximation for self-learning problem, Automation and Remote Control, 2005, v. 66, No.8, pp.1239-1248.
6. Ji, X.D. and Familoni, B.D., A Diagonal Recurrent Neural Network-Based Hybrid Direct Adaptive SPSA Control System, IEEE Transactions on Automatic Control, 1999, vol. 44, pp. 1469-1473
7. Popkov A. Yu., "Gradient methods for nonstationary unconstrained optimization problems," Automat. Remote Control, No. 6, pp. 883-891, 2005.
8. Polyak B. T., Introduction to Optimization. New York: Optimization Software. 1987.
9. Kushner H., Yin G., Stochastic Approximation and Recursive Algorithms and Applications. Springer. 2003.
10. Granichin O. N., Polyak B. T., Randomized Algorithms of an Estimation and Optimization Under Almost Arbitrary Noises. Moscow: Nauka. 2003.
11. Granichin O. N., "Procedure of stochastic approximation with disturbances at the input," Automat. Remote Control, vol. 53, No 2, part 1, pp. 232-237, 1992.
12. Granichin O. N., "A stochastic recursive procedure with dependent noises in the observation that uses sample perturbations in the input," Vestnik Leningrad Univ. Math., vol. 22, No 1(4), pp. 27-31, 1989.
13. Polyak B. T., Tsybakov A. B., "Optimal order of accuracy for search algorithms in stochastic optimization," Problems of Information Transmission, vol. 26, No 2, pp. 126-133, 1990.
14. Spall J. C., "Multivariate stochastic approximation using a simultaneous perturbation gradient approximation," IEEE Trans. Automat. Contr., vol. 37, pp. 332-341, 1992.
15. Spall J. C., "Developments in stochastic optimization algorithms with gradient approximations based on function measurements," Proc. of the Winter Simulation Conf., pp. 207-214, 1994.
16. Gerencser L., "On fixed gain recursive estimation processes," J. of Mathematical Systems, Estimation and Control, vol. 6, No.3, pp. 355-358, 1996.
17. Gerencser L., Hill S. D., Vago Z. "Optimization over Discrete Sets via SPSA," Proc. of the IEEE Conf. on Decision and Control, pp. 1791-1795, 1999.
18. Borkar V. S., Stochastic Approximation. A Dynamical Systems View-point. Cambridge University Press. 2008.
19. Guo L., "Stability of recursive stochastic tracking algorithms," SIAM J. Control and Optimization, vol. 32, No 5, pp. 1195-1225, 1994.
20. Van der Vaart H. R., Yen E. H., "Weak Sufficient Conditions for Fatou's Lemma and Lebesgue's Dominated Convergence Theorem," Mathematics Magazine, vol. 44, No 3, pp. 442-453, 1968.
21. Chen H.-F., Duncan T. E., Pasik-Duncan B. A "Kiefer-Wolfowitz algorithm with randomized differences," IEEE Trans. Automat. Contr., vol. 44, No 3, pp. 442-453, 1999.
22. Gurevich L., Vakhitov A., "SPSA Algorithm for Tracking," In Proc. 12th International Student Olympiad on Automatic Control (Baltic Olympiad), pp. 52-57, 2008.
23. Granichin O. N., "Linear Regression and Filtering Under Nonstandard Assumptions (Arbitrary Noise)," IEEE Trans. Automat. Contr., vol. 44, No 3, pp. 442-453, 1999.
24. Katkovnik V. Ya., Khejsin V. E., "Dynamic stochastic approximation of polynomial drifts," Automat. Remote Control, vol. 40, No 5, pp. 700-708, 1979.