Bayesian optimization for likelihood-free inference of simulator-based statistical models

Journal of Machine Learning Research

Volumn 17, Issue , 2016, Pages 1-47

  Gutmann, Michael U ^a,b   Corander, Jukka ^a  

^a UNIVERSITY OF HELSINKI   (Finland)

^b AALTO UNIVERSITY   (Finland)

Author keywords

Approximate Bayesian computation; Bayesian inference; Computational efficiency; Intractable likelihood; Latent variables

Indexed keywords

BAYESIAN NETWORKS; COMPUTATIONAL EFFICIENCY; DYNAMICAL SYSTEMS; INFERENCE ENGINES; NONLINEAR DYNAMICAL SYSTEMS;

APPROXIMATE BAYESIAN; BAYESIAN INFERENCE; BAYESIAN OPTIMIZATION; INTRACTABLE LIKELIHOOD; LATENT VARIABLE; LIKELIHOOD FUNCTIONS; PROBABILISTIC MODELING; STATISTICAL INFERENCE;

SIMULATORS;

EID: 84989211355     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Review

References (67)

1. S. Aeschbacher, M.A. Beaumont, and A. Futschik. A novel approach for choosing summary statistics in approximate Bayesian computation. Genetics, 192(3):1027-1047, 2012.
2. J. Azimi, A. Fern, and X.Z. Fern. Batch Bayesian optimization via simulation matching. In Advances in Neural Information Processing Systems 23 (NIPS), 2010.
3. M.A. Beaumont, W. Zhang, and D.J. Balding. Approximate Bayesian computation in population genetics. Genetics, 162(4):2025-2035, 2002.
4. M.A. Beaumont, J.-M. Cornuet, J.-M. Marin, and C.P. Robert. Adaptive approximate Bayesian computation. Biometrika, 96(4):983-990, 2009.
5. M. Blum. Approximate Bayesian computation: A nonparametric perspective. Journal of the American Statistical Association, 105(491):1178-1187, 2010.
6. E. Brochu, V.M. Cora, and N. de Freitas. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv:1012.2599, 2010.
7. O. Cappé, A. Guillin, J.M. Marin, and C.P. Robert. Population Monte Carlo. Journal of Computational and Graphical Statistics, 13(4):907-929, 2004.
8. O. Chapelle and L. Li. An empirical evaluation of Thompson sampling. In Advances in Neural Information Processing Systems 24 (NIPS), 2011.
9. B. Chen, A. Krause, and R.M. Castro. Joint optimization and variable selection of high-dimensional Gaussian processes. In Proceedings of the 29th International Conference on Machine Learning (ICML), 2012.
10. E. Contal, D. Buffoni, A. Robicquet, and N. Vayatis. Parallel Gaussian process optimization with upper confidence bound and pure exploration. In Machine Learning and Knowledge Discovery in Databases (ECML PKDD), 2013.
11. D.D. Cox and S. John. A statistical method for global optimization. In Proceedings of the IEEE Conference on Systems, Man and Cybernetics, 1992.
12. D.D. Cox and S. John. SDO: A statistical method for global optimization. In Multidisciplinary Design Optimization: State-of-the-Art, 1997.
13. D.D. Cox, J.-S. Park, and C.E. Singer. A statistical method for tuning a computer code to a data base. Computational Statistics & Data Analysis, 37(1):77-92, 2001.
14. C. Currin, T. Mitchell, M. Morris, and D. Ylvisaker. Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. Journal of the American Statistical Association, 86(416):953-963, 1991.
15. P. Del Moral, A. Doucet, and A. Jasra. Sequential Monte Carlo samplers. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68(3):411-436, 2006.
16. T. Desautels, A. Krause, and J.W. Burdick. Parallelizing exploration-exploitation tradeoffs in Gaussian process bandit optimization. Journal of Machine Learning Research, 15:3873-3923, 2014.
17. P.J. Diggle and R.J. Gratton. Monte Carlo methods of inference for implicit statistical models. Journal of the Royal Statistical Society. Series B (Methodological), 46(2):193-227, 1984.
18. J. Djolonga, A. Krause, and V. Cevher. High-dimensional Gaussian process bandits. In Advances in Neural Information Processing Systems 26 (NIPS), 2013.
19. P. Fearnhead and D. Prangle. Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 74(3):419-474, 2012.
20. K. Fukumizu, L. Song, and A. Gretton. Kernel Bayes' rule: Bayesian inference with positive definite kernels. Journal of Machine Learning Research, 14:3753-3783, 2013.
21. C. Gouriéroux, A. Monfort, and E. Renault. Indirect inference. Journal of Applied Econometrics, 8(S1):S85-S118, 1993.
22. M.U. Gutmann and J. Hirayama. Bregman divergence as general framework to estimate unnormalized statistical models. In Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI), 2011.
23. M.U. Gutmann and A. Hyvärinen. Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics. Journal of Machine Learning Research, 13:307-361, 2012.
24. M.U. Gutmann, R. Dutta, S. Kaski, and J. Corander. Likelihood-free inference via classification. arXiv:1407.4981, 2014.
25. F. Hartig, J.M. Calabrese, B. Reineking, T. Wiegand, and A. Huth. Statistical inference for stochastic simulation models - theory and application. Ecology Letters, 14(8):816-827, 2011.
26. J. Hensman, N. Fusi, and N.D. Lawrence. Gaussian processes for big data. In Proceedings of the 29th Conference on Uncertainty in Artificial Intelligence (UAI), 2013.
27. G.E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002.
28. A. Hyvärinen. Estimation of non-normalized statistical models using score matching. Journal of Machine Learning Research, 6:695-709, 2005.
29. D.R. Jones. A taxonomy of global optimization methods based on response surfaces. Journal of Global Optimization, 21(4):345-383, 2001.
30. P. Joyce and P. Marjoram. Approximately sufficient statistics and Bayesian computation. Statistical Applications in Genetics and Molecular Biology, 7(1):Article 26, 2008.
31. K. Kandasamy, J. Schneider, and B. Póczos. High dimensional Bayesian optimisation and bandits via additive models. In Proceedings of the 32nd International Conference on Machine Learning (ICML), 2015.
32. M.C. Kennedy and A. O'Hagan. Bayesian calibration of computer models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 63(3):425-464, 2001.
33. J. Kim and C.D. Scott. Robust kernel density estimation. Journal of Machine Learning Research, 13:2529-2565, 2012.
34. Y.P. Mack and M. Rosenblatt. Multivariate k-nearest neighbor density estimates. Journal of Multivariate Analysis, 9(1):1-15, 1979.
35. J.-M. Marin, P. Pudlo, C.P. Robert, and R.J. Ryder. Approximate Bayesian computational methods. Statistics and Computing, 22(6):1167-1180, 2012.
36. P. Marjoram, J. Molitor, V. Plagnol, and S. Tavaré. Markov chain Monte Carlo without likelihoods. Proceedings of the National Academy of Sciences, 100(26):15324-15328, 2003.
37. E. Meeds and M. Welling. GPS-ABC: Gaussian process surrogate approximate Bayesian computation. In Proceedings of the 30th Conference on Uncertainty in Artificial Intelligence (UAI), 2014.
38. H. Niederreiter. Low-discrepancy and low-dispersion sequences. Journal of Number Theory, 30(1):51-70, 1988.
39. E. Numminen, L. Cheng, M. Gyllenberg, and J. Corander. Estimating the transmission dynamics of Streptococcus pneumoniae from strain prevalence data. Biometrics, 69(3):748-757, 2013.
40. M.A. Nunes and D.J. Balding. On optimal selection of summary statistics for approximate Bayesian computation. Statistical Applications in Genetics and Molecular Biology, 9(1):Article 34, 2010.
41. A. O'Hagan. Bayesian analysis of computer code outputs: A tutorial. Reliability Engineering & System Safety, 91(10-11):1290-1300, 2006.
42. E. Parzen. On estimation of a probability density function and mode. The Annals of Mathematical Statistics, 33(3):1065-1076, 1962.
43. M. Pihlaja, M.U. Gutmann, and A. Hyvärinen. A family of computationally efficient and simple estimators for unnormalized statistical models. In Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence (UAI), 2010.
44. J.K. Pritchard, M.T. Seielstad, A. Perez-Lezaun, and M.W. Feldman. Population growth of human Y chromosomes: A study of Y chromosome microsatellites. Molecular Biology and Evolution, 16(12):1791-1798, 1999.
45. J. Quiñonero-Candela and C.E. Rasmussen. A unifying view of sparse approximate Gaussian process regression. Journal of Machine Learning Research, 6:1939-1959, 2005.
46. C.E. Rasmussen. Gaussian processes to speed up hybrid Monte Carlo for expensive Bayesian integrals. In Bayesian Statistics 7: The 7th Valencia International Meeting, 2003.
47. C.E. Rasmussen and C.K.I. Williams. Gaussian processes for machine learning. MIT Press, 2006.
48. W.E. Ricker. Stock and recruitment. Journal of the Fisheries Research Board of Canada, 11(5):559-623, 1954.
49. C.P. Robert and G. Casella. Monte Carlo Statistical Methods. Springer, 2004.
50. M. Rosenblatt. Remarks on some nonparametric estimates of a density function. The Annals of Mathematical Statistics, 27(3):832-837, 1956.
51. D. Russo and B. Van Roy. Learning to optimize via posterior sampling. Mathematics of Operations Research, 39(4):1221-1243, 2014.
52. J. Sacks, W.J. Welch, T.J. Mitchell, and H.P. Wynn. Design and analysis of computer experiments. Statistical Science, 4:409-435, 1989.
53. A. Shah, A. Wilson, and Z. Ghahramani. Student-t processes as alternatives to Gaussian processes. In Proceedings of the 17th International Conference on Artificial Intelligence and Statistics (AISTATS), 2014.
54. S.A. Sisson, Y. Fan, and M.M. Tanaka. Sequential Monte Carlo without likelihoods. Proceedings of the National Academy of Sciences, 104(6):1760-1765, 2007.
55. J. Snoek, H. Larochelle, and R.P. Adams. Practical Bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems 25 (NIPS), 2012.
56. J. Snoek, O. Rippel, K. Swersky, R. Kiros, N. Satish, N. Sundaram, M.M.A. Patwary, Prabhat, and R.P. Adams. Scalable Bayesian optimization using deep neural networks. In Proceedings of the 32nd International Conference on Machine Learning (ICML), 2015.
57. N. Srinivas, A. Krause, M. Seeger, and S.M. Kakade. Gaussian process optimization in the bandit setting: No regret and experimental design. arXiv:0912.3995v2, 2010.
58. N. Srinivas, A. Krause, S.M. Kakade, and M. Seeger. Information-theoretic regret bounds for Gaussian process optimization in the bandit setting. IEEE Transactions on Information Theory, 58(5):3250-3265, 2012.
59. W.R. Thompson. On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika, 25(3/4):285-294, 1933.
60. M. Titsias. Variational learning of inducing variables in sparse Gaussian processes. In Proceedings of the 12th International Conference on Artificial Intelligence and Statistics (AISTATS), 2009.
61. T. Toni, D. Welch, N. Strelkowa, A. Ipsen, and M.P.H. Stumpf. Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. Journal of the Royal Society Interface, 6(31):187-202, 2009.
62. M.P. Wand and M.C. Jones. Kernel Smoothing. Chapman & Hall/CRC Monographs on Statistics & Applied Probability, 1995.
63. Z. Wang, M. Zoghi, F. Hutter, D. Matheson, and N. de Freitas. Bayesian optimization in high dimensions via random embeddings. In International Joint Conference on Artificial Intelligence (IJCAI), 2013.
64. L. Wasserman. All of statistics. Springer, 2004.
65. D. Wegmann, C. Leuenberger, and L. Excoffier. Efficient approximate Bayesian computation coupled with Markov chain Monte Carlo without likelihood. Genetics, 182(4):1207-1218, 2009.
66. R. Wilkinson. Accelerating ABC methods using Gaussian processes. In Proceedings of the 17th International Conference on Artificial Intelligence and Statistics (AISTATS), 2014.
67. S.N. Wood. Statistical inference for noisy nonlinear ecological dynamic systems. Nature, 466(7310):1102-1104, 2010.