Frank-Wolfe Bayesian quadrature: Probabilistic integration with theoretical guarantees

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 1162-1170

  Briol, François Xavier ^a   Oates, Chris J ^b   Girolami, Mark ^a   Osborne, Michael A ^c  

^a UNIVERSITY OF WARWICK   (United Kingdom)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; CYTOLOGY; INFORMATION SCIENCE; INTEGRATION;

EMPIRICAL PERFORMANCE; NUMERICAL ERRORS; PROBABILISTIC INTEGRATION; STATE-OF-THE-ART METHODS; STATISTICAL INFERENCE; SUPER-EXPONENTIAL; THEORETICAL GUARANTEES; THEORETICAL TREATMENTS;

PROBABILITY DISTRIBUTIONS;

EID: 84965112904     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. F. Bach. On the Equivalence between Quadrature Rules and Random Features. arXiv:1502.06800, 2015.
2. F. Bach, S. Lacoste-Julien, and G. Obozinski. On the Equivalence between Herding and Conditional Gradient Algorithms. In Proceedings of the 29th International Conference on Machine Learning, pages 1359-1366, 2012.
3. F.-X. Briol, C. J Oates, M. Girolami, M. Osborne, and D. Sejdinovic. Probabilistic Integration. arXiv:1512.00933, 2015.
4. Y. Chen, M. Welling, and A. Smola. Super-Samples from Kernel Herding. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 109-116, 2010.
5. P. Conrad, M. Girolami, S. Särkkä, A. Stuart, and K. Zygalakis. Probability Measures for Numerical Solutions of Differential Equations. arXiv:1506.04592, 2015.
6. P. Diaconis. Bayesian Numerical Analysis. Statistical Decision Theory and Related Topics IV, pages 163-175, 1988.
7. J. Dick and F. Pillichshammer. Digital Nets and Sequences - Discrepancy Theory and Quasi-Monte Carlo Integration. Cambridge University Press, 2010.
8. M. Frank and P. Wolfe. An Algorithm for Quadratic Programming. Naval Research Logistics Quarterly, 3:95-110, 1956.
9. D. Garber and E. Hazan. Faster Rates for the Frank-Wolfe Method over Strongly-Convex Sets. In Proceedings of the 32nd International Conference on Machine Learning, pages 541-549, 2015.
10. Z. Ghahramani and C. Rasmussen. Bayesian Monte Carlo. In Advances in Neural Information Processing Systems, pages 489-496, 2003.
11. T. Gunter, R. Garnett, M. Osborne, P. Hennig, and S. Roberts. Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature. In Advances in Neural Information Processing Systems, 2014.
12. J. B. Hamrick and T. L. Griffiths. Mental Rotation as Bayesian Quadrature. In NIPS 2013 Workshop on Bayesian Optimization in Theory and Practice, 2013.
13. P. Hennig. Probabilistic Interpretation of Linear Solvers. SIAM Journal on Optimization, 25:234-260, 2015.
14. P. Hennig, M. Osborne, and M. Girolami. Probabilistic Numerics and Uncertainty in Computations. Proceedings of the Royal Society A, 471(2179), 2015.
15. F. Huszar and D. Duvenaud. Optimally-Weighted Herding is Bayesian Quadrature. In Uncertainty in Artificial Intelligence, pages 377-385, 2012.
16. M. Jaggi. Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization. In Proceedings of the 30th International Conference on Machine Learning, volume 28, pages 427-435, 2013.
17. S. Lacoste-Julien, F. Lindsten, and F. Bach. Sequential Kernel Herding: Frank-Wolfe Optimization for Particle Filtering. In Proceedings of the 18th International Conference on Artificial Intelligence and Statistics, pages 544-552, 2015.
18. C. J. Oates, F. Dondelinger, N. Bayani, J. Korkola, J. W. Gray, and S. Mukherjee. Causal Network Inference using Biochemical Kinetics. Bioinformatics, 30(17):i468-i474, 2014.
19. C. J. Oates and M. Girolami. Control Functionals for Quasi-Monte Carlo Integration. In Proceedings of the 19th Conference on Artificial Intelligence and Statistics (to appear), 2016.
20. C. J. Oates, M. Girolami, and N. Chopin. Control Functionals for Monte Carlo Integration. arXiv: 1410.2392, 2015.
21. A. O'Hagan. Monte Carlo is Fundamentally Unsound. Journal of the Royal Statistical Society, Series D, 36(2):247-249, 1984.
22. A. O'Hagan. Bayes-Hermite Quadrature. Journal of Statistical Planning and Inference, 29:245-260, 1991.
23. M. Osborne, R. Garnett, S. Roberts, C. Hart, S. Aigrain, and N. Gibson. Bayesian Quadrature for Ratios. In Proceedings of the 15th International Conference on Artificial Intelligence and Statistics, pages 832-840, 2012.
24. A. B. Owen. A Constraint on Extensible Quadrature Rules. Numerische Mathematik, pages 1-8, 2015.
25. S. Särkkä, J. Hartikainen, L. Svensson, and F. Sandblom. On the Relation between Gaussian Process Quadratures and Sigma-Point Methods. Journal of Advances in Information Fusion (to appear), 2015.
26. M. Schober, D. Duvenaud, and P. Hennig. Probabilistic ODE solvers with Runge-Kutta means. In Advances in Neural Information Processing Systems 27, pages 739-747, 2014.
27. B. Sriperumbudur, A. Gretton, K. Fukumizu, B. Schölkopf, and G. Lanckriet. Hilbert Space Embeddings and Metrics on Probability Measures. Journal of Machine Learning Research, 11:1517-1561, 2010.