Parameter estimation using simultaneous perturbation stochastic approximation

Electrical Engineering in Japan (English translation of Denki Gakkai Ronbunshi)

Volumn 154, Issue 2, 2006, Pages 30-39

  Hirokami, Tatsuya ^a,b   Maeda, Yutaka ^a   Tsukada, Hiroyuki ^a  

^a KANSAI UNIVERSITY   (Japan)

^b KAWASAKI HEAVY INDUSTRIES LTD   (Japan)

Author keywords

Identification; Optimization; Parameter estimation; Simultaneous perturbation; Stochastic approximation

Indexed keywords

EVALUATION FUNCTIONS; IDENTIFICATION; SIMULTANEOUS PERTURBATION; STOCHASTIC APPROXIMATION;

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; EVALUATION; FUNCTIONS; IDENTIFICATION (CONTROL SYSTEMS); OPTIMIZATION; PERTURBATION TECHNIQUES; STOCHASTIC PROGRAMMING;

PARAMETER ESTIMATION;

EID: 29544437221     PISSN: 04247760     EISSN: None     Source Type: Journal    
DOI: 10.1002/eej.20239     Document Type: Article

References (26)

1. Saridis GN, Stein G. Stochastic approximation algorithms for linear discrete-time system identification. IEEE Trans Autom Control 1968;13:515-523.
2. Saridis ON. Stochastic approximation methods for identification and control - A survey. IEEE Trans Autom Control 1974;19:798-809.
3. Yahagi T. Theory of digital signal processing 3. Corona Publishing; 1985. (in Japanese)
4. Furuta K. Estimation and identification theory of linear dynamical systems. Corona Publishing; 1976. (in Japanese)
5. Robbins H, Monro S. A stochastic approximation method. Ann Math Stat 1951;22:400-407.
6. Venter H. An extension of the Robbins-Monro procedure. Ann Math Stat 1967;38:181-190.
7. Nevel'son MB, Khas'minskii RZ. An adaptive Robbins-Monro procedure. Autom Remote Control 1973;34:1594-1607.
8. Maeda Y, Kawamura Y, Minamoto S, Kojima Y. An extension of the adaptive Robbins-Monro procedure. Trans Soc Instrum Control Eng 1987;23:1186-1191. (in Japanese)
9. Uosaki K, Morita H. Maximum search by stochastic approximation on discrete set. Trans Soc Instrum Control Eng 1986;22:270-274. (in Japanese)
10. Maeda Y, Kawamura Y. On-line system optimization using extended adaptive Robbins-Monro procedure. Trans IEICE 1990;J73-A:626-631. (in Japanese)
11. Maeda Y, Kawamura Y. Optimization using the adaptive Robbins-Monro procedure for linear unknown stochastic systems. Trans IEICE 1990;J73-A:783-789. (in Japanese)
12. Kushner HJ, Clark DS. Stochastic approximation methods for constrained and unconstrained system. Springer-Verlag; 1978.
13. Spall JC. A stochastic approximation technique for generating maximum likelihood parameter estimates. Proc 1987 American Control Conference, p 1161-1167.
14. Alespector J, Meir R, Yuhas B, Jayakumar A, Lippe D. A parallel gradient descent method for learning in analog VLSI in neural networks. Advances in Neural Information Processing Systems 5 (Hanson SJ, Cowan JD, Lee C, editors). Morgan Kaufmann Publisher; 1993. p 836-844.
15. Cauwenberghs G. A fast stochastic error-descent algorithm for supervised learning and optimization. Advances in Neural Information Processing Systems 5 (Hanson SJ, Cowan JD, Lee C, editors). Morgan Kaufmann Publisher; 1993. p 244-251.
16. Maeda Y, Kanata Y. Learning rules for recurrent neural networks using perturbation and their application to neuro-control. Trans IEE Japan 1993;113-C:402-408. (in Japanese)
17. Maeda Y, Hirano H, Kanata Y. A learning rule of neural networks via simultaneous perturbation and its hardware implementation. Neural Networks 1995;8:251-259.
18. Maeda Y, Kanata Y. A learning rule of neural networks for neuro-controller. Proc 1995 World Congress of Neural Networks, Vol. 2, p II-402-II-405.
19. Maeda Y, de Figueiredo RJP. Learning rules for neuro-controller via simultaneous perturbation. IEEE Trans Neural Networks 1997;8:1119-1130.
20. Cauwenberghs G. An analog VLSI recurrent neural network learning a continuous-time trajectory. IEEE Trans Neural Networks 1996;7:346-361.
21. Spall JC. Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Trans Autom Control 1992;37:332-341.
22. Kiefer J, Wolfowitz J. Stochastic estimation of the maximum of a regression function. Ann Math Stat 1952;23:462-466.
23. Sagara S, Wada K. On-line modified least-squares parameter estimation of linear discrete dynamics systems. Int J Control 1977;25:329-343.
24. Wu Y, Katayama T. Identification of linear systems distorted by input-output noises based on biased compensated least-squares method. Trans Inst Syst Control Inf Eng 1992;5:454-460. (in Japanese)
25. Maeda Y. Time difference simultaneous perturbation method. Electron Lett 1996;32:1016-1018.
26. Spall JC. A one-measurement form of simultaneous perturbation stochastic approximation. Automatica 1997;33:109-112.