Convergence analysis of sampling methods for perturbed Lipschitz functionss

Pacific Journal of Optimization

Volumn 5, Issue 2, 2009, Pages 339-349

  Finkel, D E ^a   Kelley, C T ^b  

^a MIT LINCOLN LABORATORY   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Clarke derivative; Lipschitz functions; Sampling methods

Indexed keywords

EID: 79958283585     PISSN: 13489151     EISSN: 13498169     Source Type: Journal    
DOI: None     Document Type: Article

References (37)

1. C. Audet and J.E. Dennis, Analysis of generalized pattern searches, SIAM J. Optim. 13 (2003) 889-903.
2. C. Audet and J.E. Dennis, Mesh adaptive direct search algorithms for constrained optimization, Tech. Rep. TR04-02, Department of Computational and Applied Mathematics, Rice Univeristy, 2004.
3. D.P. Bertsekas, On the Goldstein-Levitin-Polyak gradient projection method, IEEE Trans. Autom. Control 21 (1976) 174-184.
4. A.J. Booker, J.E. Dennis, P.D. Frank, D.B. Serafini, V. Torczon and M.W. Trosset, A rigorous framework for optimization of expensive function by surrogates, Structural Optimization 17 (1999) 1-13.
5. D.M. Bortz and C.T. Kelley, The simplex gradient and noisy optimization problems, in Computational Methods in Optimal Design and Control, J.T. Borggaard, J. Burns, E. Cliff and S. Schreck (eds.), vol. 24 of Progress in Systems and Control Theory, Birkhäuser, Boston, 1998, pp. 77-90.
6. R.G. Carter, Nonsequential dynamic programming for optimizing pipelines, Presentation at the 1999 SIAM Conference on Optimization.
7. R.G. Carter, Numerical experience with a class of algorithms for nonlinear optimization using inexact function and gradient information, SIAM J. Sci. Comput. 14 (1993) 368-388.
8. G.W. Characklis, B.R. Kirsch, K.E.M. Dillard and C.T. Kelley, More efficient optimization of long-term water supply portfolios. Submitted for publication, 2008.
9. G.W. Characklis, B.R. Kirsch, J. Ramsey, K.E.M. Dillard and C.T. Kelley, Developing portfolios of water supply transfers, Water Resources Research 42 (2006) W05403-1 - W05403-14.
10. T.D. Choi, Bound Constrained Optimization, PhD thesis, North Carolina State University, Raleigh, North Carolina, 1999.
11. T.D. Choi, O.J. Eslinger, C.T. Kelley, J.W. David and M. Etheridge, Optimization of automotive valve train components with implicit filtering, Optimization and Engineering 1 (2000) 9-28.
12. F. Clarke, Optimization and Nonsmooth Analysis, Canadien Mathematical Society Series of Monographs and Advanced Texts, Wiley-Interscience, New York, 1983.
13. A.R. Conn, K. Scheinberg, and P.L. Toint, Recent progress in unconstrained optimization without derivatives, Math. Prog. Ser. B 79 (1997) 397-414.
14. A.R. Conn, K. Scheinberg, and P.L. Toint, A derivative free optimization algorithm in practice, in Proceeedings of 7-th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, St Louis, MO. Sept 2-4, 1998., 1998.
15. A.R. Conn, K. Scheinberg and L.N. Vicente, Introduction to derivative-free optimization, unpublished manuscript, 2007.
16. J.W. David, C.Y. Cheng, T.D. Choi, C.T. Kelley and J. Gablonsky, Optimal design of high speed mechanical systems, Tech. Rep. CRSC-TR97-18, North Carolina State University, Center for Research in Scientific Computation, July 1997, Mathematical Modeling and Scientific Computing, to appear in Vol 9.
17. J.W. David, C.T. Kelley and C.Y. Cheng, Use of an implicit filtering algorithm for mechanical system parameter identification, 1996, SAE Paper 960358, 1996 SAE International Congress and Exposition Conference Proceedings, Modeling of CI and SI Engines, pp. 189-194, Society of Automotive Engineers, Washington, DC.
18. J.E. Dennis and R.B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, no. 16 in Classics in Applied Mathematics, SIAM, Philadelphia, 1996.
19. J.E. Dennis and V. Torczon, Direct search methods on parallel machines, SIAM J. Optim. 1 (1991) 448-474.
20. R. Fletcher, Practical methods of optimization, John Wiley and Sons, New York, 1987.
21. K.R. Fowler, C.T. Kelley, C.E. Kees and C.T. Miller, A hydraulic capture application for optimal remeidation design, in Proceedings of Computational Methods in Water Resources XV, C.T. Miller, M.W. Farthing, W.G. Gray and G.F. Pinter (eds.), Amsterdam, 2004, Elsevier, pp. 1149-1158.
22. K.R. Fowler, J.P. Reese, C.E. Kees, J.E. Dennis, C. T. Kelley, C.T. Miller, C. Audet, A. J. Booker, G. Couture, R.W. Darwin, M.W. Farthing, D.E. Finkel, J.M. Gablonsky, G. Gray and T.G. Kolda, A comparison of derivative-free optimization methods for groundwater supply and hydraulic capture problems, Advances in Water Resources 31 (2008) 743-757.
23. P.E. Gill, W. Murray and M.H. Wright, Practical Optimization, Academic Press, London, 1981.
24. P. Gilmore and C. T. Kelley, An implicit filtering algorithm for optimization of functions with many local minima, SIAM J. Optim. 5 (1995) 269-285.
25. P. Gilmore and C. T. Kelley, An implicit filtering algorithm for optimization of functions with many local minima, SIAM J. Optim. 5 (1995) 269-285.
26. R. Hooke and T.A. Jeeves, 'Direct search' solution of numerical and statistical problems, Journal of the Association for Computing Machinery 8 (1961) 212-229.
27. P.D. Hough, T.G. Kolda and V.J. Torczon, Asynchronous parallel pattern search for nonlinear optimization, SIAM J. Sci. Comput. 23 (2001) 134-156.
28. J. Jahn, Introduction to the Theory of Nonlinear Optimization, Springer, Berlin, 1994.
29. D. Jones, C. Perttunen and B. Stuckman, Lipschitzian optimization without the Lipschitz constant, J. Optim. Theory Appl. 79 (1993) 157-181.
30. C. Kelley, Iterative Methods for Optimization, Frontiers in Applied Mathematics, SIAM, Philadelphia, PA, first ed., 1999.
31. T. Kolda, R. Lewis and V. Torczon, Optimization by direct search: New perspective on some classical and modern methods, SIAM Review 45 (2003) 385-482.
32. R.M. Lewis and V. Torczon, Pattern search algorithms for linearly constrained minimization, SIAM J. Optim. 10 (2000) 917-941.
33. J. Nelder and R. Mead, A simplex method for function minimization, Comput. J. 7 (1965) 308-313.
34. J. Nocedal and S.J. Wright, Numerical Optimization, Springer, New York, 1999.
35. R. Rockafellar, Generalized directional derivatives and subgradients of nonconvex functions, Canadian Journal of Mathematics 32 (1980) 157-180.
36. V. Torczon, On the convergence of the multidimensional direct search, SIAM J. Optim. 1 (1991) 123-145.
37. W. Yu, Positive basis and a class of direct search techniques, Scientia Sinica, Speical Issue of Mathematics 1 (1979) 53-67.