Coresets for scalable Bayesian logistic regression

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 4087-4095

  Huggins, Jonathan H ^a   Campbell, Trevor ^a   Broderick, Tamara ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; HIERARCHICAL SYSTEMS; ITERATIVE METHODS; REGRESSION ANALYSIS;

APPROXIMATION QUALITY; CONSTRUCTION ALGORITHMS; EFFICIENT CONSTRUCTION; LOGISTIC REGRESSION MODELS; LOGISTIC REGRESSIONS; MINIMAL ADDITIONAL EFFORTS; THEORETICAL GUARANTEES; UNCERTAINTY QUANTIFICATIONS;

INFERENCE ENGINES;

EID: 85019259132     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. P. K. Agarwal, S. Har-Peled, and K. R. Varadarajan. Geometric approximation via coresets. Combinatorial and computational geometry, 52: 1-30, 2005.
2. D. Arthur and S. Vassilvitskii. k-means++: The advantages of careful seeding. In Symposium on Discrete Algorithms, pages 1027-1035. Society for Industrial and Applied Mathematics, 2007.
3. O. Bachem, M. Lucic, S. H. Hassani, and A. Krause. Approximate K-Means++ in Sublinear Time. In AAAI Conference on Artificial Intelligence, 2016.
4. R. Bardenet, A. Doucet, and C. C. Holmes. On Markov chain Monte Carlo methods for tall data. arXiv.org, May 2015.
5. M. J. Betancourt. The Fundamental Incompatibility of Hamiltonian Monte Carlo and Data Subsampling. In International Conference on Machine Learning, 2015.
6. T. Broderick, N. Boyd, A. Wibisono, A. C. Wilson, and M. I. Jordan. Streaming Variational Bayes. In Advances in Neural Information Processing Systems, Dec. 2013.
7. T. Campbell, J. Straub, J. W. Fisher, III, and J. P. How. Streaming, Distributed Variational Inference for Bayesian Nonparametrics. In Advances in Neural Information Processing Systems, 2015.
8. R. Entezari, R. V. Craiu, and J. S. Rosenthal. Likelihood Inflating Sampling Algorithm. arXiv.org, May 2016.
9. D. Feldman and M. Langberg. A unified framework for approximating and clustering data. In Symposium on Theory of Computing. ACM Request Permissions, June 2011.
10. D. Feldman, M. Faulkner, and A. Krause. Scalable training of mixture models via coresets. In Advances in Neural Information Processing Systems, pages 2142-2150, 2011.
11. D. Feldman, M. Schmidt, and C. Sohler. Turning big data into tiny data: Constant-size coresets for k-means, pca and projective clustering. In Symposium on Discrete Algorithms, pages 1434-1453. SIAM, 2013.
12. A. Gelman, A. Jakulin, M. G. Pittau, and Y.-S. Su. A weakly informative default prior distribution for logistic and other regression models. The Annals of Applied Statistics, 2(4): 1360-1383, Dec. 2008.
13. E. I. George and R. E. McCulloch. Variable selection via Gibbs sampling. Journal of the American Statistical Association, 88(423): 881-889, 1993.
14. H. Haario, E. Saksman, and J. Tamminen. An adaptive Metropolis algorithm. Bernoulli, pages 223-242, 2001.
15. L. Han, T. Yang, and T. Zhang. Local Uncertainty Sampling for Large-Scale Multi-Class Logistic Regression. arXiv.org, Apr. 2016.
16. M. D. Hoffman, D. M. Blei, C. Wang, and J. Paisley. Stochastic variational inference. The Journal of Machine Learning Research, 14: 1303-1347, 2013.
17. M. Lucic, O. Bachem, and A. Krause. Strong Coresets for Hard and Soft Bregman Clustering with Applications to Exponential Family Mixtures. In International Conference on Artificial Intelligence and Statistics, 2016.
18. D. Maclaurin and R. P. Adams. Firefly Monte Carlo: Exact MCMC with Subsets of Data. In Uncertainty in Artificial Intelligence, Mar. 2014.
19. M. Rabinovich, E. Angelino, and M. I. Jordan. Variational consensus Monte Carlo. arXiv.org, June 2015.
20. G. O. Roberts and R. L. Tweedie. Exponential convergence of Langevin distributions and their discrete approximations. Bernoulli, 2(4): 341-363, Nov. 1996.
21. S. L. Scott, A. W. Blocker, F. V. Bonassi, H. A. Chipman, E. I. George, and R. E. McCulloch. Bayes and big data: The consensus Monte Carlo algorithm. In Bayes 250, 2013.
22. S. Srivastava, V. Cevher, Q. Tran-Dinh, and D. Dunson. WASP: Scalable Bayes via barycenters of subset posteriors. In International Conference on Artificial Intelligence and Statistics, 2015.
23. Y. W. Teh, A. H. Thiery, and S. Vollmer. Consistency and fluctuations for stochastic gradient Langevin dynamics. Journal of Machine Learning Research, 17(7): 1-33, Mar. 2016.
24. M. Welling and Y. W. Teh. Bayesian Learning via Stochastic Gradient Langevin Dynamics. In International Conference on Machine Learning, 2011.