Bayesian active learning for posterior estimation

IJCAI International Joint Conference on Artificial Intelligence

Volumn 2015-January, Issue , 2015, Pages 3605-3611

  Kandasamy, Kirthevasan ^a   Schneider, Jeff ^a   Póczos, Barnabás ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; BAYESIAN; GAUSSIAN PROCESSES; GENERATING SAMPLES; POSTERIOR ESTIMATIONS; QUERY STRATEGIES; REAL EXAMPLE;

ARTIFICIAL INTELLIGENCE;

EID: 84949748958     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Ryan Prescott Adams, Iain Murray, and David J. C. MacKay. The Gaussian Process Density Sampler. In NIPS, 2008.
2. Eric Brochu, Vlad M. Cora, and Nando de Freitas. A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. CoRR, 2010.
3. Brent Bryan, Jeff Schneider, Robert Nichol, Christopher Miller, Christopher Genovese, and Larry Wasserman. Active learning for identifying function threshold boundaries. In Advances in Neural Information Processing Systems. MIT Press, Cambridge, MA, 2006.
4. T. M. Davis et al. Scrutinizing Exotic Cosmological Models Using ESSENCE Supernova Data Combined with Other Cosmological Probes. The Astrophysical Journal, pages 716-725, 2007.
5. Daniel Foreman-Mackey, David W. Hogg, Dustin Lang, and Jonathan Goodman. emcee: The MCMC Hammer, January 2013.
6. Kenji Fukumizu, Le Song, and Arthur Gretton. Kernel Bayes' Rule: Bayesian Inference with Positive Definite Kernels. Journal of Machine Learning Research, 2014.
7. Daniel Golovin and Andreas Krause. Adaptive Submodularity: Theory and Applications in Active Learning and Stochastic Optimization. Journal of Artificial Intelligence Research (JAIR), 2011.
8. Alkis Gotovos, Nathalie Casati, Gregory Hitz, and Andreas Krause. Active Learning for Level Set Estimation. In IJCAI 2013, Proceedings of the 23rd International Joint Conference on Artificial Intelligence, Beijing, China, August 3-9, 2013, 2013.
9. Tom Gunter, Michael A. Osborne, Roman Garnett, Philipp Hennig, and Stephen J. Roberts. Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature. In Advances in Neural Information Processing Systems, 2014.
10. László Györfi, Micael Kohler, Adam Krzyzak, and Harro Walk. A Distribution Free Theory of Nonparametric Regression. Springer Series in Statistics, 2002.
11. Kirthevasan Kandasamy, Jeff Schneider, and Barnabás Póczos. High Dimensional Bayesian Optimisation and Bandits via Additive Models. In International Conference on Machine Learning, 2015.
12. Andreas Krause, Ajit Singh, and Carlos Guestrin. Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies. J. Mach. Learn. Res., 2008.
13. David Landau and Kurt Binder. A Guide to Monte Carlo Simulations in Statistical Physics. Cambridge University Press, 2005.
14. Jun S. Liu. Monte Carlo strategies in Scientific computing. Springer, 2001.
15. Yifei Ma, Roman Garnett, and Jeff Schneider. Active Area Search via Bayesian Quadrature. In International Conference on Artificial Intelligence and Statistics, 2014.
16. David J. C. MacKay. Information Theory, Inference, and Learning Algorithms. Cambridge University Press, 2003.
17. Jean-Michel Marin, Pierre Pudlo, Christian P. Robert, and Robin J. Ryder. Approximate Bayesian computational methods. Statistics and Computing, 2012.
18. Paul Marjoram, John Molitor, Vincent Plagnol, and Simon Tavaré. Markov Chain Monte Carlo without Likelihoods. Proceedings of the National Academy of Sciences of the United States of America, 2003.
19. J.B. Mockus and L.J. Mockus. Bayesian approach to global optimization and application to multiobjective and constrained problems. Journal of Optimization Theory and Applications, 1991.
20. M. Osborne, D. Duvenaud, R. Garnett, C. Rasmussen, S. Roberts, and Z. Ghahramani. Active Learning of Model Evidence Using Bayesian Quadrature. In Neural Information Processing Systems, 2012.
21. David Parkinson, Pia Mukherjee, and Andrew R Liddle. A Bayesian model selection analysis of WMAP3. Physical Review, D73:123523, 2006.
22. Gareth W. Peters, Y. Fan, and Scott A. Sisson. On sequential Monte Carlo, partial rejection control and approximate Bayesian computation. Statistics and Computing, 2012.
23. C.E. Rasmussen and C.K.I. Williams. Gaussian Processes for Machine Learning. Adaptative computation and machine learning series. University Press Group Limited, 2006.
24. Christian P. Robert and George Casella. Monte Carlo Statistical Methods (Springer Texts in Statistics). Springer-Verlag New York, Inc., 2005.
25. Sambu Seo, Marko Wallat, Thore Graepel, and Klaus Obermayer. Gaussian Process Regression: Active Data Selection and Test Point Rejection. In International Joint Conference on Neural Networks, 2000.
26. Burr Settles. Active Learning Literature Survey. Technical report, University of Wisconsin-Madison, 2010.
27. John Skilling. Nested sampling for general Bayesian computation. Bayesian Anal., 2006.
28. Niranjan Srinivas, Andreas Krause, Sham Kakade, and Matthias Seeger. Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design. In International Conference on Machine Learning, 2010.
29. M. Tegmark et al. Cosmological Constraints from the SDSS Luminous Red Galaxies. Physical Review, December 2006.