Predictive entropy search for efficient global optimization of black-box functions

Advances in Neural Information Processing Systems

Volumn 1, Issue January, 2014, Pages 918-926

  Hernández Lobato, José Miguel ^a   Hoffman, Matthew W ^a   Ghahramani, Zoubin ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; ENTROPY; FUNCTION EVALUATION; INFORMATION SCIENCE; INFORMATION THEORY; LEARNING SYSTEMS; OPTIMIZATION;

BAYESIAN OPTIMIZATION; BLACK-BOX FUNCTIONS; DIFFERENTIAL ENTROPY; EFFICIENT GLOBAL OPTIMIZATION; EXPECTED INFORMATIONS; NOVEL INFORMATION; OPTIMIZATION PROBLEMS; PREDICTIVE DISTRIBUTIONS;

GLOBAL OPTIMIZATION;

EID: 84930672144     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. I. Ahmad and P.-E. Lin. A nonparametric estimation of the entropy for absolutely continuous distributions. IEEE Transactions on Information Theory, 22(3):372-375, 1976.
2. B. S. Anderson, A. W. Moore, and D. Cohn. A nonparametric approach to noisy and costly optimization. In ICML, pages 17-24, 2000.
3. K. Bache and M. Lichman. UCI machine learning repository, 2013.
4. S. Bochner. Lectures on Fourier integrals. Princeton University Press, 1959.
5. E. Brochu, V. M. Cora, and N. de Freitas. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. Technical Report UBC TR-2009-23 and arXiv:1012.2599v1, Dept. of Computer Science, University of British Columbia, 2009.
6. E. Brochu, N. de Freitas, and A. Ghosh. Active preference learning with discrete choice data. In NIPS, pages 409-416, 2007.
7. E. H. Burrows, W.-K. Wong, X. Fern, F. W. R. Chaplen, and R. L. Ely. Optimization of ph and nitrogen for enhanced hydrogen production by synechocystis sp. pcc 6803 via statistical and machine learning methods. Biotechnology Progress, 25(4):1009-1017, 2009.
8. O. Chapelle and L. Li. An empirical evaluation of Thompson sampling. In NIPS, pages 2249-2257, 2011.
9. P. Hennig and C. J. Schuler. Entropy search for information-efficient global optimization. Journal of Machine Learning Research, 13, 2012.
10. M. W. Hoffman, E. Brochu, and N. de Freitas. Portfolio allocation for Bayesian optimization. In UAI, pages 327-336, 2011.
11. N. Houlsby, J. M. Hernández-Lobato, F. Huszar, and Z. Ghahramani. Collaborative Gaussian processes for preference learning. In NIPS, pages 2096-2104, 2012.
12. E. Jondeau and M. Rockinger. The copula-GARCH model of conditional dependencies: An international stock market application. Journal of international money and finance, 25(5):827-853, 2006.
13. D. R. Jones, M. Schonlau, and W. J. Welch. Efficient global optimization of expensive black-box functions. Journal of Global optimization, 13(4):455-492, 1998.
14. H. Kushner. A new method of locating the maximum of an arbitrary multipeak curve in the presence of noise. Journal of Basic Engineering, 86, 1964.
15. D. Lizotte. Practical Bayesian Optimization. PhD thesis, University of Alberta, Canada, 2008.
16. D. Lizotte, T. Wang, M. Bowling, and D. Schuurmans. Automatic gait optimization with Gaussian process regression. In IJCAI, pages 944-949, 2007.
17. D. J. MacKay. Information-based objective functions for active data selection. Neural Computation, 4(4):590-604, 1992.
18. T. P. Minka. A family of algorithms for approximate Bayesian inference. PhD thesis, Massachusetts Institute of Technology, 2001.
19. J. Močkus, V. Tiesis, and A. Žilinskas. The application of Bayesian methods for seeking the extremum. In L. Dixon and G. Szego, editors, Toward Global Optimization, Volume 2. Elsevier, 1978.
20. D. M. Negoescu, P. I. Frazier, and W. B. Powell. The knowledge-gradient algorithm for sequencing experiments in drug discovery. INFORMS Journal on Computing, 23(3):346-363, 2011.
21. A. Rahimi and B. Recht. Random features for large-scale kernel machines. In NIPS, pages 1177-1184, 2007.
22. C. E. Rasmussen and C. K. Williams. Gaussian processes for machine learning. The MIT Press, 2006.
23. M. W. Seeger. Bayesian inference and optimal design for the sparse linear model. Journal of Machine Learning Research, 9:759-813, 2008.
24. J. Snoek, H. Larochelle, and R. P. Adams. Practical Bayesian optimization of machine learning algorithms. In NIPS, pages 2960-2968, 2012.
25. E. Solak, R. Murray-Smith, W. E. Leithead, D. J. Leith, and C. E. Rasmussen. Derivative observations in Gaussian process models of dynamic systems. In NIPS, pages 1057-1064, 2003.
26. N. Srinivas, A. Krause, S. M. Kakade, and M. Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In ICML, pages 1015-1022, 2010.
27. J. Vanhatalo, J. Riihimäki, J. Hartikainen, P. Jylänki, V. Tolvanen, and A. Vehtari. Bayesian modeling with Gaussian processes using the matlab toolbox GPstuff (v3.3). CoRR, abs/1206.5754, 2012.
28. J. Villemonteix, E. Vazquez, and E. Walter. An informational approach to the global optimization of expensive-to-evaluate functions. Journal of Global Optimization, 44(4):509-534, 2009.
29. Z. Wang, S. Mohamed, and N. de Freitas. Adaptive Hamiltonian and Riemann Monte Carlo samplers. In ICML, 2013.
30. E. Westervelt and J. Grizzle. Feedback Control of Dynamic Bipedal Robot Locomotion. Control and Automation Series. CRC PressINC, 2007.