Distributed variational inference in sparse Gaussian process regression and latent variable models

Advances in Neural Information Processing Systems

Volumn 4, Issue January, 2014, Pages 3257-3265

  Gal, Yarin ^a   Van Der Wilk, Mark ^a   Rasmussen, Carl E ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); INFERENCE ENGINES; INFORMATION SCIENCE; REGRESSION ANALYSIS; UNCERTAINTY ANALYSIS;

COMPUTATIONAL RESOURCES; GAUSSIAN PROCESSES; LATENT VARIABLE MODELS; NONLINEAR DIMENSIONALITY REDUCTION; PROBABILISTIC INFERENCE; SPARSE GAUSSIAN PROCESS; UNCERTAINTY ESTIMATES; VARIATIONAL INFERENCE;

BIG DATA;

EID: 84937892781     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Arnold, S. (1981). The theory of linear models and multivariate analysis. Wiley series in probability and mathematical statistics: Probability and mathematical statistics. Wiley.
2. Asuncion, A. U., Smyth, P., and Welling, M. (2008). Asynchronous distributed learning of topic models. In Advances in Neural Information Processing Systems, pages 81-88.
3. Brockwell, A. E. (2006). Parallel Markov Chain Monte Carlo simulation by Pre-Fetching. Journal of Computational and Graphical Statistics, 15(1):pp. 246-261.
4. Dean, J. and Ghemawat, S. (2008). MapReduce: Simplified data processing on large clusters. Commun. ACM, 51(1): 107-113.
5. Gal, Y. and Ghahramani, Z. (2014). Pitfalls in the use of parallel inference for the Dirichlet process. In Proceedings of the 31th International Conference on Machine Learning (ICML-14).
6. Hensman, J., Fusi, N., and Lawrence, N. D. (2013). Gaussian processes for big data. In Nicholson, A. and Smyth, P., editors, UAI. AUAI Press.
7. Hoffman, M. D., and Blei, D. M., Wang, C., and Paisley, J. (2013). Stochastic Variational Inference. JOURNAL OF MACHINE LEARNING RESEARCH, 14: 1303-1347.
8. Lawrence, N. (2005). Probabilistic non-linear principal component analysis with gaussian process latent variable models. The Journal of Machine Learning Research, 6: 1783-1816.
9. Lovell, D., and Adams, R. P., and Mansingka, V. (2012). Parallel Markov chain Monte Carlo for Dirichlet process mixtures. In Workshop on Big Learning, NIPS.
10. Møller, M. F. (1993). A scaled conjugate gradient algorithm for fast supervised learning. Neural networks, 6(4): 525-533.
11. Quiñonero-Candela, J. and Rasmussen, C. E. (2005). A unifying view of sparse approximate gaussian process regression. Journal of Machine Learning Research, 6: 2005.
12. Rasmussen, C. E. and Williams, C. K. I. (2006). Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). The MIT Press.
13. Titsias, M. and Lawrence, N. (2010). Bayesian gaussian process latent variable model.
14. Titsias, M. K. (2009). Variational learning of inducing variables in sparse Gaussian processes. Technical report, Technical Report.
15. Wilkinson, D. J. (2005). Parallel Bayesian computation. In Kontoghiorghes, E. J., editor, Handbook of Parallel Computing and Statistics, Volume 184, pages 477-508. Chapman and Hall/CRC, Boca Raton, FL, USA.
16. Williamson, S., Dubey, A., and Xing, E. P. (2013). Parallel Markov Chain Monte Carlo for non-parametric mixture models. In Proceedings of the 30th International Conference on Machine Learning (ICML-13), pages 98-106.