Global random optimization by simultaneous perturbation stochastic approximation

Johns Hopkins APL Technical Digest (Applied Physics Laboratory)

Volumn 25, Issue 2, 2004, Pages 91-99

  Maryak, John L ^a   Chin, Daniel C ^b  

^a APL ^*  (United States)

^b APL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

OPTIMIZATION ALGORITHMS; RANDOM OPTIMIZATION; SIMULATANEOUS PERTURBATION STOCHASTIC APPROXIMATION (SPSA);

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; GENETIC ALGORITHMS; ITERATIVE METHODS; OPTIMIZATION; PERTURBATION TECHNIQUES; PROBABILISTIC LOGICS; PROBLEM SOLVING; THEOREM PROVING;

RANDOM PROCESSES;

EID: 16244370086     PISSN: 02705214     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (27)

1. Reardon, B. E., Description of Stochastic Optimization Toolbox, v1.0, A1E(04)U-4-005, JHU/APL, Laurel, MD (20 Feb 2004).
2. Reardon, B. E., Palumbo, N. F., and Casper, S. G., "Simulation-Based Performance Optimization of Missile Guidance and Control Algorithms," in Proc. 11th Ann. AIAA/MDA Technology Conf. and Exhibit, Williamsburg, VA (29 Jul-2 Aug 2002).
3. Kushner, H. J., and Yin, G. G., Stochastic Approximation and Recursive Algorithms arid Applications, Springer, New York (2003).
4. Spall, J. C., Introduction to Stochastic Search and Optimization, John Wiley & Sons, Hoboken, NJ (2003).
5. Spall, J. C., "Multivariate Stochastic Approximation Using a Simultaneous Perturbation Gradient Approximation," IEEE Trans. Automat. Control 37, 332-341 (1992).
6. Spall, J. C., "An Overview of the Simultaneous Perturbation Method for Efficient Optimization," Johns Hopkins APL Tech. Dig. 19(4), 482-492 (1998).
7. Wang, I.-J., and Spall, J. C., "Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions," in Proc. IEEE Conf. on Decision and Control, Maui, HI, pp. 3808-3813 (9-12 Dec 2003).
8. Chin, D. C., "A More Efficient Global Optimization Algorithm Based on Styblinski and Tang," Neural Net. 7, 573-574 (1994).
9. d," SIAM J. Control Optim. 29, 999-1018 (1991).
10. Kushner, H. J., "Asymptotic Global Behavior for Stochastic Approximation and Diffusions with Slowly Decreasing Noise Effects: Global Minimization via Monte Carlo," SIAM J. Appl. Math. 47, 169-185 (1987).
11. Styblinski, M. A., and Tang, T.-S., "Experiments in Nonconvex Optimization: Stochastic Approximation with Function Smoothing and Simulated Annealing," Neural Net. 3, 467-483 (1990).
12. Fang, H., Gong, G., and Qian, M., "Annealing of Iterative Stochastic Schemes," SIAM J. Control Optim. 35, 1886-1907 (1997).
13. Spall, J. C., "Adaptive Stochastic Approximation by the Simultaneous Perturbation Method," IEEE Trans. Automat. Control 45, 1839-1853 (2000).
14. Chin, D. C., "Comparative Study of Stochastic Algorithms for System Optimization Based on Gradient Approximations," IEEE Trans. Systems Man Cybernetics, Part B: Cybernetics 27, 244-249 (1997).
15. Dippon, J., and Renz, J., "Weighted Means in the Stochastic Approximation of Minima," SIAM J. Control Optim. 35, 1811-1827 (1997).
16. n," SIAM J. Control Optim. 25, 737-753 (1987).
17. d," SIAM J. Control Optim. 31, 110-131 (1993).
18. Geman, S., and Geman, D., "Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images, IEEE Trans. Pattern Anal. Machine Intel. PAMI-6, 721-741 (1984).
19. Hajek, B., "Cooling Schedules for Optimal Annealing," Math. Oper. Res. 13, 311-329 (1988).
20. Yakowitz, S., L'Ecuyer, P., and Vazquez-Abad, F., "Global Stochastic Optimization with Low-Dispersion Point Sets," Operations Res. 48, 939-950 (2000).
21. Yin, G., "Rates of Convergence for a Class of Global Stochastic Optimization Algorithms," SIAM J. Optim. 10, 99-120 (1999).
22. Dippon, J., and Fabian, V., "Stochastic Approximation of Global Minimum Points," J. Statist. Plan. Inference 41, 327-347 (1994).
23. Yakowitz, S., "A Globally Convergent Stochastic Approximation," SIAM J. Control Optim. 31, 30-40 (1993).
24. Alrefaei, M. H., and Andradottir, S., "A Simulated Annealing Algorithm with Constant Temperature for Discrete Stochastic Optimization," Management Sci. 45, 748-764 (1999).
25. Maryak, J. L., and Chin, D. C., "Global Random Optimization by Simultaneous Perturbation Stochastic Approximation," in Proc. Am. Control Conf., Arlington, VA, pp. 756-762 (Jun 2001).
26. Maryak, J. L., and Chin, D. C., "Efficient Global Optimization Using SPSA," in Proc. Am. Control Conf., San Diego, CA, pp. 890-894 (1999).
27. Mitchell, M., An Introduction to Generic Algorithms, MIT Press, Cambridge, MA (1996).