Predictive Entropy Search for Bayesian optimization with unknown constraints

32nd International Conference on Machine Learning, ICML 2015

Volumn 2, Issue , 2015, Pages 1699-1707

  Hernández Lobato, José Miguel ^a   Gelbart, Michael A ^a   Hoffman, Matthew W ^b   Adams, Ryan P ^a   Ghahramani, Zoubin ^a  

^a HARVARD UNIVERSITY   (United States)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BENCHMARKING; CONSTRAINED OPTIMIZATION; ENTROPY; HEURISTIC METHODS; LEARNING SYSTEMS; PATHOLOGY;

BAYESIAN OPTIMIZATION; BENCH-MARK PROBLEMS; EFFECTIVE ALGORITHMS; EXPECTED IMPROVEMENTS; EXPENSIVE BLACK-BOX OPTIMIZATIONS; REAL-WORLD; UNIFIED SOLUTIONS;

OPTIMIZATION;

EID: 84969765655     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Frank, Andrew and Asuncion, Arthur. UCI machine learning repository, 2010.
2. Gardner, Jacob R., Kusner, Matt J., Xu, Zhixiang (Eddie), Weinberger, Kilian Q., and Cunningham, John P. Bayesian optimization with inequality constraints. In ICML, 2014.
3. Gelbart, Michael A., Snoek, Jasper, and Adams, Ryan P. Bayesian optimization with unknown constraints. In UAI, 2014.
4. Gelman, Andrew and Rubin, Donald R. A single series from the Gibbs sampler provides a false sense of security. In Bayesian Statistics, pp. 625-32. 1992.
5. Geweke, John. Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. In Bayesian Statistics, pp. 169-193, 1992.
6. Gramacy, Robert B. and Lee, Herbert K. H. Optimization under unknown constraints. Bayesian Statistics, 9, 2011.
7. Gramacy, Robert B., Gray, Genetha A., Digabel, Sebastien Le, Lee, Herbert K. H., Ranjan, Pritam, Wells, Garth, and Wild, Stefan M. Modeling an augmented Lagrangian for improved blackbox constrained optimization, 2014. arXiv: 1403.4890v2 [stat.CO].
8. Hennig, Philipp and Schuler, Christian J. Entropy search for information-efficient global optimization. JMLR, 13, 2012.
9. Hernández-Lobato, J. M, Hoffman, M. W., and Ghahramani, Z. Predictive entropy search for efficient global optimization of black-box functions. In NIPS. 2014.
10. Houlsby, N., Hernández-Lobato, J. M, Huszar, F., and Ghahramani, Z. Collaborative Gaussian processes for preference learning. In NIPS. 2012.
11. Jones, Donald R, Schonlau, Matthias, and Welch, William J. Efficient global optimization of expensive black-box functions. Journal of Global optimization, 13 (4):455-492, 1998.
12. Leobacher, Gunther and Pillichshammer, Friedrich. Introduction to quasi-Monte Carlo integration and applications. Springer, 2014.
13. Minka, Thomas P. A family of algorithms for approximate Bayesian inference. PhD thesis, Massachusetts Institute of Technology, 2001.
14. Mockus, Jonas, Tiesis, Vytautas, and Zilinskas, Antanas. The application of Bayesian methods for seeking the ex-tremum. Towards Global Optimization, 2, 1978.
15. Neal, Radford. Slice sampling. Annals of Statistics, 31: 705-767, 2000.
16. Neal, Radford. MCMC using Hamiltonian dynamics. In Handbook of Markov Chain Monte Carlo. Chapman and Hall/CRC, 2011.
17. Patil, Anand, Huard, David, and Fonnesbeck, Christopher. PyMC: Bayesian stochastic modelling in Python. Journal of Statistical Software, 2010.
18. Picheny, Victor. A stepwise uncertainty reduction approach to constrained global optimization. In AISTATS, 2014.
19. Plummer, Martyn, Best, Nicky, Cowles, Kate, and Vines, Karen. CODA: Convergence diagnosis and output analysis for MCMC. R News, 6(1):7-11, 2006.
20. Rasmussen, C. and Williams, C. Gaussian Processes for Machine Learning. MIT Press, 2006.
21. Schonlau, Matthias, Welch, William J, and Jones, Donald R. Global versus local search in constrained optimization of computer models. Lecture Notes-Monograph Series, pp. 11-25, 1998.
22. Snoek, Jasper. Bayesian Optimization and Semiparametric Models with Applications to Assistive Technology. PhD thesis, University of Toronto, Toronto, Canada, 2013.
23. Snoek, Jasper, Larochelle, Hugo, and Adams, Ryan P. Practical Bayesian optimization of machine learning algorithms. In NIPS, 2012.
24. Villemonteix, Julien, Vázquez, Emmanuel, and Walter, Eric. An informational approach to the global optimization of expensive-to-evaluate functions. Journal of Global Optimization, 44(4):509-534, 2009.