Surrogating the surrogate: Accelerating Gaussian-process-based global optimization with a mixture cross-entropy algorithm

ICML 2010 - Proceedings, 27th International Conference on Machine Learning

Volumn , Issue , 2010, Pages 55-62

  Bardenet, Rémi ^a   Kégl, Balázs ^a  

^a UNIVERSITÉ PARIS SUD   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE GRIDS; COMPUTATIONAL BOTTLENECKS; CROSS ENTROPY; CROSS-ENTROPY METHOD; EXHAUSTIVE SEARCH; EXPECTED IMPROVEMENTS; FITNESS FUNCTIONS; GAUSSIAN PROCESSES; GAUSSIANS; GRID SEARCH; INITIAL OPTIMIZATION; MERIT FUNCTION; MODEL OPTIMIZATION; MULTI-MODAL; SURROGATE MODEL; SURROGATE OPTIMIZATION; TARGET FUNCTIONS;

ALGORITHMS; ENTROPY; FUNCTION EVALUATION; GAUSSIAN DISTRIBUTION; GLOBAL OPTIMIZATION; LEARNING SYSTEMS;

OPTIMIZATION;

EID: 77956526263     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Green, P. J. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82(4):711-732, 1995.
2. Haario, H., Saksman, E., and Tamminen, J. An adaptive Metropolis algorithm. Bernoulli, 7:223-242, 1998.
3. Hansen, N. The CMA evolution strategy: a comparing review. In Lozano, J.A., Larranaga, P., Inza, I., and Bengoetxea, E. (eds.), Towards a new evolutionary computation. Advances on Estimation of Distribution Algorithms, pp. 75-102. Springer, 2006.
4. Hornus, S. and Boissonnat, J. An efficient implementation of Delaunay triangulations in medium dimensions. Research Report RR-6743, INRIA, 2008.
5. Jones, D.R. A taxonomy of global optimization methods based on response surfaces. Journal of Global Optimization, 21:345-383, 2001.
6. Larrañaga, P. and Lozano, J. (eds.). Estimation of Distribution Algorithms. Springer, 2001.
7. Mockus, J., Tiesis, V., and Zilinskas, A. The application of Bayesian methods for seeking the extremum. In Dixon, L.C.W. and Szego, G.P. (eds.), Towards Global Optimization. North Holland, New York, 1978.
8. Preparata, F.P. and Shamos, M.I. Computational Geometry, an Introduction. Springer-Verlag, 1988.
9. Rasmussen, C.E. and Williams, C. Gaussian Processes for Machine Learning. MIT Press, 2006.
10. Robert, C. P. and Casella, G. Monte Carlo Statistical Methods. Springer-Verlag, New York, 2004.
11. Rubinstein, R. Y. and Kroese, D. P. The Cross-Entropy Method. Springer, 2004.
12. Srinivas, N., Krause, A., Kakade, S., and Seeger, M. Gaussian process bandits: An experimental design approach. NIPS Workshop on Adaptive Sensing, Active Learning and Experimental Design, 2009.
13. Villemonteix, J., Vazquez, E., and Walter, E. An informational approach to the global optimization of expensive-to-evaluate functions. Journal of Global Optimization, 2006.