An experimental methodology for response surface optimization methods

Journal of Global Optimization

Volumn 53, Issue 4, 2012, Pages 699-736

  Lizotte, Daniel J ^a   Greiner, Russell ^b   Schuurmans, Dale ^b  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Global optimization; Response surface; Surrogate model

Indexed keywords

EMPIRICAL EVALUATIONS; EMPIRICAL STUDIES; EVALUATING ALGORITHMS; EXPERIMENTAL METHODOLOGY; GAUSSIAN PROCESSES; GLOBAL OPTIMIZATION TECHNIQUES; LEVEL OF DIFFICULTIES; OBJECTIVE FUNCTIONS; REAL-WORLD PROBLEM; RESPONSE SURFACE; RESPONSE SURFACE METHOD; RESPONSE SURFACE OPTIMIZATION; RIGOROUS METHODOLOGIES; SHIFTING AND SCALING; SURROGATE MODEL; SYNTHETIC TESTS; TEST FUNCTIONS; TEST PROBLEM;

GLOBAL OPTIMIZATION; PARAMETER ESTIMATION; TEST FACILITIES;

SURFACE PROPERTIES;

EID: 84863783543     PISSN: 09255001     EISSN: 15732916     Source Type: Journal    
DOI: 10.1007/s10898-011-9732-z     Document Type: Article

References (40)

1. Adler, R. J., Taylor, J. E.: Random Fields and Geometry. Springer, Berlin (2007)
2. Audet, C., Dennis, J. J. E., Moore, D., Booker, A., Frank, P.: A surrogate-model-based method for constrained optimization. In: Proceedings of the 8th AIAA/NASA/USAF/ISSMO Symposium on Multidisciplinary Analysis and Optimization. Paper No. AIAA-2000-4891 (2000)
3. Bakker, T. M. D.: Design Optimization With Kriging Models. Delft University Press, Delft (2000)
4. Bardenet, R., Kegl, B.: Surrogating the surrogate: accelerating Gaussian-process-based global optimization with a mixture cross-entropy algorithm. In: Proceedings of the 27th Annual International Conference on Machine Learning (2010)
5. Boyle, P.: Gaussian processes for regression and optimisation. PhD thesis, Victoria University of Wellington (2006)
6. Chernova, S., Veloso, M.: An evolutionary approach to gait learning for four-legged robots. In: Intelligent Robots and Systems (2004)
7. Cox, D. D., John, S. SDO: a statistical method for global optimization. In:Multidisciplinary design optimization (Hampton, VA, 1995), pp. 315-329. SIAM, Philadelphia, PA (1997)
8. Csató, L., Opper, M.: Sparse representation for Gaussian process models. In: Leen, T. K., Dietterich, T. G., Tresp, V. (eds. ) Neural Information Processing Systems, vol. 13, TheMIT Press, Cambridge,MA (2001)
9. Deb, K., Thiele, L., Laumanns, M., Zitzler, E.: Scalable test problems for evolutionary multiobjective optimization. In: Jain, L., Wu, X., Abraham, A., Goldberg, R. (eds. ) Evolutionary Multiobjective Optimization., pp. 105-145. Springer, Berlin (2005)
10. Dixon, L., Szegö, G. (eds. ): Towards Global Optimisation, Chapter The global optimisation problem: an introduction, vol. 2, pp. 1-15. North-Holland, Amsterdam (1978)
11. Elder J. F.: Global Rd optimization when probes are expensive: the GROPE algorithm. In: Proceedings IEEE International Conference on Systems, Man, and Cybernetics, Chicago, Illinois (1992)
12. Floudas, C. A., Gounaris, C. E.: A review of recent advances in global optimization. J. Glob. Optim. 45, 3-38 (2009)
13. Gutmann, H.-M.: A radial basis function method for global optimization. J. Glob. Optim. 19, 201-227 (2001)
14. Huang, D., Allen,T. T., Notz,W. I.,Zeng, N.: Global optimization of stochastic black-box systems via sequential kriging meta-models. J. Glob. Optim. 34, 441-466 (2006)
15. Jones, D., Perttunen, C., Stuckman, B.: Lipschitzian optimizationwithout the lipschitz constant. Optim. Theory Appl. 79(1), 157-181 (1993)
16. Jones, D. R.: A taxonomy of global optimization methods based on response surfaces. J. Glob. Optim. 21, 345-383 (2001)
17. Jones, D. R., Schonlau, M., Welch, W. J.: Efficient global optimization of expensive black-box functions. J. Glob. Optim. 13, 455-492 (1998)
18. Khare, V., Yao, X., Deb, K.: Performance scaling of multi-objective evolutionary algorithms. In: Evolutionary Multi-Criterion Optimization, volume 2632/2003 of Lecture Notes in Computing Science. Springer, Berlin (2003)
19. Kushner, H.: A new method of locating the maximum of an arbitrary multipeak curve in the presence of noise. J. Basic Eng. 86, 97-106 (1964)
20. Lawrence, N., Seeger, M., Herbrich, R.: Fast sparse gaussian process methods: the informative vector machine. In: Becker, S. T. S., Obermayer, K. (eds. ) Advances in Neural Information Processing Systems, vol. 15, pp. 609-616. MIT Press, Cambridge, MA (2003)
21. Leary, S. J., Bhaskar, A., Keane, A. J.: A derivative based surrogate model for approximating and optimizing the output of an expensive computer simulation. J. Glob. Optim. 30, 39-58 (2004)
22. Li, R., Sudjianto, A.: Analysis of computer experiments using penalized likelihood in Gaussian kriging models. Technometrics 47, 111-120 (2005)
23. Lizotte, D. J.: Practical Bayesian optimization. PhD thesis, University of Alberta, Alberta (2008)
24. Lizotte, D. J., Wang, T., Bowling, M., Schuurmans, D.: Automatic gait optimization with Gaussian process regression. In: Proceedings of the International Joint Conference on Artificial Intelligence (2007)
25. MATLAB: Version 7. 10. 0 (R2010a). The MathWorks Inc., Natick, MA (2010)
26. Mockus, J.: Bayesian Approach to Global Optimization. Kluwer Academic Publishers, Dordrecht (1989)
27. Perttunen, C. D.: A nonparametric global optimization method using the rank transformation. In: Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, vol. 1, pp. 888-893 (2007)
28. Rasmussen, C. E.: Gaussian processes in machine learning. In: Bousquet, O., Luxburg, U. von , Rätsch, G. (eds. ) Advanced Lectures in Machine Learning: ML Summer Schools 2003, Springer, Berlin (2004)
29. Rasmussen, C. E., Williams, C. K. I.: Gaussian Processes for Machine Learning, chapter 9. 4 Derivative Observations. MIT Press, Cambridge (2006a)
30. Rasmussen, C. E.,Williams, C. K. I.: Gaussian Processes for Machine Learning, chapter 5Model Selection and Adaptation of Hyperparameters. MIT Press, Cambridge (2006b)
31. Rasmussen, C. E., Williams, C. K. I.: Gaussian Processes for Machine Learning, chapter 4. 2 Examples of Covariance Functions. MIT Press, Cambridge (2006c)
32. Rasmussen, C. E., Williams, C. K. I.: Gaussian Processes for Machine Learning, chapter 2 Regression. MIT Press, Cambridge (2006d)
33. Regis, C. A. S. R. G.: Improved strategies for radial basis function methods for global optimization. J. Glob. Optim. 37(1), 113-135 (2007)
34. Sacks, J., Welch, W. J., Mitchell, T. J., Wynn, H. P.: Design and analysis of computer experiments. Stat. Sci. 4,409-435 (1989)
35. Santner, T. J., Williams, B. J., Notz, W. I.: The Design and Analysis of Computer Experiments. Springer, Berlin (2003)
36. Sasena,M. J.: Flexibility and efficiency enhancements for constrained global design optimization with Kriging approximations. PhD thesis, University of Michigan, Ann Arbor (2002)
37. Schonlau, M.: Computer experiments and global optimization. PhD thesis, University of Waterloo, Waterloo (1997)
38. Shawe-Taylor, J., Cristiani, N.: Kernel methods for pattern analysis, chapter Properties of Kernels. MIT Press, Cambridge (2004)
39. Srinivas, N., Krause, A., Kakade, S., Seeger, M.: Gaussian process optimization in the bandit setting: No regret and experimental design. In: Proceedings of the 27th Annual International Conference on Machine Learning (2010)
40. Stuckman, B.: A global search method for optimizing nonlinear systems. In: Proceedings of the IEEE Conference on Systems, Man, and Cybernetics, vol. 1, pp 965-977 (1989)