Nested expectation propagation for gaussian process classification with a multinomial probit likelihood

Journal of Machine Learning Research

Volumn 14, Issue 1, 2013, Pages 75-109

  Riihimaki, Jaakko ^a   Jylanki, Pasi ^a   Vehtari, Aki ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Approximate inference; Expectation propagation; Gaussian process; Multiclass classification; Multinomial probit

Indexed keywords

APPROXIMATE INFERENCE; EXPECTATION PROPAGATION; GAUSSIAN PROCESSES; MULTI-CLASS CLASSIFICATION; MULTINOMIALS;

GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC);

NUMERICAL METHODS;

EID: 84873476296     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (31)

1. Kian Ming A. Chai. Variational multinomial logit Gaussian process. Journal of Machine Learning Research, 13:1745-1808, 2012.
2. Botond Cseke and Tom Heskes. Approximate marginals in latent Gaussian models. Journal of Machine Learning Research, 12:417-454, 2011.
3. Simon Duane, A. D. Kennedy, Brian J. Pendleton, and Duncan Roweth. Hybrid Monte Carlo. Physics Letters B, 195(2):216-222, 1987.
4. Andrew Frank and Arthur Asuncion. UCI Machine Learning Repository. University of California, Irvine, School of Information and Computer Sciences, 2010. URL http://archive.ics.uci. edu/ml.
5. Mark Girolami and Simon Rogers. Variational Bayesian multinomial probit regression with Gaussian process priors. Neural Computation, 18:1790-1817, 2006. (Pubitemid 44036395)
6. Mark Girolami and Mingjun Zhong. Data integration for classification problems employing Gaussian process priors. In Advances in Neural Information Processing Systems 19, pages 465-472. The MIT Press, 2007.
7. Ricardo Henao and Ole Winther. PASS-GP: Predictive active set selection for Gaussian processes. In IEEE International Workshop on Machine Learning for Signal Processing, pages 148-153, 2010.
8. Daniel Hernandez-Lobato, Jose M. Hernandez-Lobato, and Pierre Dupont. Robust multi-class Gaussian process classification. In Advances in Neural Information Processing Systems 24, pages 280-288, 2011.
9. Jonathan J. Hull. A database for handwritten text recognition research. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(5):550-554, 1994.
10. Hyun-Chul Kim and Zoubin Ghahramani. Bayesian Gaussian process classification with the EM-EP algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(12):1948-1959, 2006. (Pubitemid 46405706)
11. Malte Kuss and Carl E. Rasmussen. Assessing approximate inference for binary Gaussian process classification. Journal of Machine Learning Research, 6:1679-1704, 2005.
12. Thomas P. Minka. A Family of Algorithms for Approximate Bayesian Inference. PhD thesis, Massachusetts Institute of Technology, 2001a.
13. Thomas P. Minka. Expectation Propagation for approximative Bayesian inference. In Proceedings of the 17th Conference on Uncertainty in Artificial Intelligence, pages 362-369. Morgan Kaufmann, San Francisco, CA, 2001b.
14. Thomas P. Minka. Divergence measures and message passing. Technical report, Microsoft Research, Cambridge, 2005.
15. Thomas P. Minka and John Lafferty. Expectation-propagation for the generative aspect model. In Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence, pages 352-359. Morgan Kaufmann, San Francisco, CA, 2002.
16. Radford M. Neal. Bayesian Learning for Neural Networks. Springer-Verlag, 1996.
17. Radford M. Neal. Regression and classification using Gaussian process priors (with discussion). In Bayesian Statistics 6, pages 475-501. Oxford University Press, 1998.
18. Hannes Nickisch and Carl E. Rasmussen. Approximations for binary Gaussian process classification. Journal of Machine Learning Research, 9:2035-2078, 2008.
19. Manfred Opper and OleWinther. Expectation consistent approximate inference. Journal ofMachine Learning Research, 6:2177-2204, 2005.
20. Yuan Qi, Thomas P. Minka, Rosalind W. Picard, and Zoubin Ghahramani. Predictive automatic relevance determination by expectation propagation. In Proceedings of the 21st International Conference on Machine Learning, pages 671-678, 2004. (Pubitemid 40290867)
21. Carl E. Rasmussen and Christopher K. I.Williams. Gaussian Processes for Machine Learning. The MIT Press, 2006.
22. H°avard Rue, Sara Martino, and Nicolas Chopin. Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. Journal of the Royal Statistical Society (Series B), 71(2):319-392, 2009.
23. Matthias Seeger. Expectation propagation for exponential families. Technical report, Max Planck Institute for Biological Cybernetics, Tubingen, Germany, 2005.
24. Matthias Seeger and Michael Jordan. Sparse Gaussian process classification with multiple classes. Technical report, University of California, Berkeley, CA, 2004.
25. Matthias Seeger, Neil Lawrence, and Ralf Herbrich. Efficient nonparametric Bayesian modelling with sparse Gaussian process approximations. Technical report, Max Planck Institute for Biological Cybernetics, Tubingen, Germany, 2006.
26. Alexander Smola, Vishy Vishwanathan, and Eleazar Eskin. Laplace propagation. In Advances in Neural Information Processing Systems 16. The MIT Press, 2004.
27. Edward Snelson and Zoubin Ghahramani. Compact approximations to Bayesian predictive distributions. In Proceedings of the 22nd International Conference on Machine Learning, pages 840-847, 2005.
28. Luke Tierney and Joseph B. Kadane. Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81(393):82-86, 1986.
29. Marcel van Gerven, Botond Cseke, Robert Oostenveld, and Tom Heskes. Bayesian source localization with the multivariate Laplace prior. In Advances in Neural Information Processing Systems 22, pages 1901-1909, 2009.
30. Aki Vehtari and Jouko Lampinen. Bayesian model assessment and comparison using crossvalidation predictive densities. Neural Computation, 14(10):2439-2468, 2002.
31. Christopher K. I. Williams and David Barber. Bayesian classification with Gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12):1342-1351, 1998. (Pubitemid 128741378)