Gaussian process optimization with mutual information

31st International Conference on Machine Learning, ICML 2014

Volumn 2, Issue , 2014, Pages 1515-1523

  Contal, Emile ^a   Perchet, Vianney ^b   Vayatis, Nicolas ^a  

^a UNIVERSITÉ PARIS SACLAY   (France)

^b UNIVERSITÉ PARIS DESCARTES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER PROGRAMMING; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); GLOBAL OPTIMIZATION; LEARNING SYSTEMS; OPTIMIZATION;

EXPECTED IMPROVEMENTS; EXPONENTIAL FACTORS; GAUSSIAN PROCESSES; GENERIC ALGORITHM; MUTUAL INFORMATIONS; UPPER BOUND;

ALGORITHMS;

EID: 84919880069     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Audibert, J-Y., Bubeck, S., and Munos, R. Bandit view on noisy optimization. In Optimization for Machine Learning, pp. 431-454. MIT Press, 2011.
2. Auer, P., Cesa-Bianchi, N., and Fischer, P. Finite-time analysis of the multiarmed bandit problem. Machine Learning, 47(2-3):235-256, 2002.
3. Bercu, B. and Touati, A. Exponential inequalities for self- normalized martingales with applications. The Annals of Applied Probability, 18(5): 1848-1869, 2008.
4. Bubeck, S., Munos, R., Stoltz, G., and Szepesvari, C. X- Armed bandits. Journal of Machine Learning Research, 12:1655-1695, 2011.
5. Carpentier, A., Lazaric, A., Ghavamzadeh, M., Munos, R., and Auer, P. Upper-confidence-bound algorithms for active learning in multi-armed bandits. In Proceedings of the International Conference on Algorithmic Learning Theory, pp. 189-203. Springer-Verlag, 2011.
6. Chen, Y. and Krause, A. Near-optimal batch mode active learning and adaptive submodular optimization. In Proceedings of the International Conference on Machine Learning, icml.cc/Omnipress, 2013.
7. Contal, E., Buffoni, D., Robicquet, A., and Vayatis, N. Parallel Gaussian process optimization with upper confidence bound and pure exploration. In Machine Learning and Knowledge Discovery in Databases, volume 8188, pp. 225-240. Springer Berlin Heidelberg, 2013.
8. Cover, T. M. and Thomas, J. A. Elements of Information Theory. Wiley-Interscience, 1991.
9. Dani, V., Hayes, T. P., and Kakade, S. M. Stochastic linear optimization under bandit feedback. In Proceedings of the 21st Annual Conference on Learning Theory, pp. 355-366, 2008.
10. de Freitas, N., Smola, A. J., and Zoghi, M. Exponential regret bounds for Gaussian process bandits with deterministic observations. In Proceedings of the 29th International Conference on Machine Learning, icml.cc/Omnipress, 2012.
11. Desautels, T., Krause, A., and Burdick, J.W. Parallelizing exploration-exploitation tradeoffs with Gaussian process bandit optimization. In Proceedings of the 29th International Conference on Machine Learning, pp. 1191-1198. icml.cc/Omnipress, 2012.
12. Dutykh, D., Poncet, R, and Dias, F. The VOLNA code for the numerical modelling of tsunami waves: generation, propagation and inundation. European Journal of Mechanics B/Fluids, 30:598-615, 2011.
13. Flake, G. W. and Lawrence, S. Efficient SVM regression training with SMO. Machine Learning, 46(1-3):271- 290, 2002.
14. Floudas, C.A. and Pardalos, P.M. Optimization in Computational Chemistry and Molecular Biology: Local and Global Approaches. Nonconvex Optimization and Its Applications. Springer, 2000.
15. Grunewalder, S., Audibert, J-Y., Opper, M., and Shawe-Taylor, J. Regret bounds for Gaussian process bandit problems. In Proceedings of the International Conference on Artificial Intelligence and Statistics, pp. 273- 280. MIT Press, 2010.
16. Hill, E. M., Borrero, J. C., Huang, Z., Qiu, Q., Banerjee, P., Natawidjaja, D. H., Elosegui, P., Fritz, H. M., Suwargadi, B. W., Pranantyo, I. R., Li, L., Macpherson, K. A., Skanavis, V., Synolakis, C. E., and Sieh, K. The 2010 Mw 7.8 Mentawai earthquake: Very shallow source of a rare tsunami earthquake determined from tsunami field survey and near-field GPS data. J. Geophys. Res., 117: B06402-, 2012.
17. Jones, D. R., Schonlau, M., and Welch, W. J. Efficient global optimization of expensive black-box functions. Journal of Global Optimization, 13(4):455-492, December 1998.
18. Kleinberg, R. Nearly tight bounds for the continuum-armed bandit problem. In Advances in Neural Information Processing Systems 17, pp. 697-704. MIT Press, 2004.
19. Krause, A. and Ong, C.S. Contextual Gaussian process bandit optimization. In Advances in Neural Information Processing Systems 24, pp. 2447-2455, 2011.
20. Kuss, M., Pfingsten, T., Csato, L., and Rasmussen, C.E. Approximate inference for robust Gaussian process regression. Max Planck Inst. Biological Cybern., Tubingen, GermanyTech. Rep, 136, 2005.
21. Mockus, J. Bayesian approach to global optimization. Mathematics and its applications. Kluwer Academic, 1989.
22. Osborne, Michael. Bayesian Gaussian processes for sequential prediction, optimisation and quadrature. PhD thesis, Oxford University New College, 2010.
23. Rasmussen, C. E. and Williams, C. Gaussian Processes for Machine Learning. MIT Press, 2006.
24. Snoek, J., Larochelle, H., and Adams, R. P. Practical bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems 25, pp. 2960-2968, 2012.
25. Srinivas, N., Krause, A., Kakade, S., and Seeger, M. Gaussian process optimization in the bandit setting: No regret and experimental design. In Proceedings of the International Conference on Machine Learning, pp. 1015-1022. icml.cc/Omnipress, 2010.
26. Srinivas, N., Krause, A., Kakade, S., and Seeger, M. Information-theoretic regret bounds for Gaussian process optimization in the bandit setting. IEEE Transactions on Information Theory, 58(5):3250-3265, 2012.
27. Stefanakis, T. S., Dias, F., Vayatis, N., and Guillas, S. Long-wave runup on a plane beach behind a conical island. In Proceedings of the World Conference on Earthquake Engineering, 2012.
28. Stefanakis, T. S., Contal, E., Vayatis, N., Dias, F., and Synolakis, C. E. Can small islands protect nearby coasts from tsunamis ? An active experimental design approach. arXiv preprint arXiv: 1305.7385, 2013.
29. Wang, G. and Shan, S. Review of metamodeling techniques in support of engineering design optimization. Journal of Mechanical Design, 129(4): 370-380, 2007.
30. Ziemba, W. T. and Vickson, R. G. Stochastic optimization models in finance. World Scientific Singapore, 2006.