Bayesian generalized kernel mixed models

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 111-139

  Zhang, Zhihua ^a   Dai, Guang ^a   Jordan, Michael I ^b  

^a ZHEJIANG UNIVERSITY   (China)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayesian model averaging; Gaussian processes; Generalized kernel models; Reproducing kernel Hilbert spaces; Silverman's g prior

Indexed keywords

BAYESIAN MODEL AVERAGING; GAUSSIAN PROCESSES; KERNEL MODELS; REPRODUCING KERNEL HILBERT SPACES; SILVERMAN'S G-PRIOR;

APPROXIMATION THEORY; BAYESIAN NETWORKS; COMPUTATION THEORY; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); LEARNING ALGORITHMS; MARKOV PROCESSES; MONTE CARLO METHODS;

HILBERT SPACES;

EID: 79551678757     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (55)

1. J. H. Albert and S. Chib. Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88(422):669-679, 1993.
2. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan. Multiple kernel learning, conic duality, and the SMO algorithm. In Proceedings of the Twenty-first International Conference on Machine Learning, 2004.
3. J. M. Bernardo and A. F. M. Smith. Bayesian Theory. John Wiley and Sons, New York, 1994.
4. S. P. Brooks. Quantitative convergence diagnosis for (Pubitemid 128405026)
5. C. M. Carvalho, N. G. Polson, and J. G. Scott. The horseshoe estimator for sparse signals. Biometrika, 97(2):465-480, 2010.
6. S. Chakraborty, M. Ghosh, and B. K. Mallick. Bayesian nonlinear regression for large p small n problems. Technical report, Department of Statistics, University of Florida, 2005.
7. P. J. Diggle, J. A. Tawn, and R. A. Moyeed. Model-based geostatistics (with discussions). Applied Statistics, 47(3):299-350, 1998.
8. M. Figueiredo. Adaptive sparseness for supervised learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9):1150-1159, 2003.
9. E. I. George and R. E. McCulloch. Approaches for Bayesian variable selection. Statistica Sinica, 7:339-374, 1997. (Pubitemid 127084819)
10. M. A. Girolami and S. Rogers. Variational Bayesian multinomial probit regression with Gaussian process priors. Neural Computation, 18:1790-1817, 2006. (Pubitemid 44036395)
11. P. J. Green. Discussion of Dr. Silverman's paper. Journal of the Royal Statistical Society, Series B, 47(1):29, 1985.
12. P. J. Green. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82:711-732, 1995.
13. A.K. Gupta and D.K. Nagar. Matrix Variate Distributions. Chapman & Hall/CRC, 2000.
14. C. Hans. Bayesian lasso regression. Biometrika, 96(4):835-845, 2009.
15. D. A. Harville. Maximum likelihood approaches to variance component estimation and to related problems. Journal of the American Statistical Association, 72(358):320-338, 1977.
16. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer-Verlag, New York, 2001.
17. C. C. Holmes and L. Held. Bayesian auxiliary variable models for binary and multinomial regression. Bayesian Analysis, 1(1):145-168, 2006.
18. R. Kohn, M. Smith, and D. Chan. Nonparametric regression using linear combinations of basis functions. Statistics and Computing, 11:313-322, 2001.
19. N. D. Lawrence,M. Seeger, and R. Herbrich. Fast sparse Gaussian process methods: the informative vector machine. In Advances in Neural Information Processing Systems 15, 2003.
20. Y. Lee, Y. Lin, and G.Wahba. Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data. Journal of the American Statistical Association, 99(465):67-81, 2004. (Pubitemid 38545195)
21. Q. Li and N. Lin. The Bayesian elastic net. Bayesian Analysis, 5(1):151-170, 2010.
22. F. Liang, R. Paulo, G. Molina, M. A. Clyde, and J. O. Berger. Mixtures of g-priors for Bayesian variable selection. Journal of the American Statistical Association, 103(481):410-423, 2008.
23. F. Liang, K. Mao, M. Liao, R. F. MacLehose, and D. B. Dunson. Nonparametric Bayesian kernel models. In Discussion Paper 2005-09, Duke University ISDS, 2009.
24. R. F. MacLehose and D. B. Dunson. Nonparametric Bayes kernel-based priors for functional data analysis. Statistica Sinica, 19:611-629, 2009.
25. B. K. Mallick, D. Ghosh, and M. Ghosh. Bayesian classification of tumours by using gene expression data. Journal of the Royal Statistical Society Series B, 67:219-234, 2005. (Pubitemid 40465872)
26. K. V. Mardia, J. T. Kent, and J. M. Bibby. Multivariate Analysis. Academic Press, New York, 1979.
27. P. McCullagh and J. A. Nelder. Generalized Linear Models. Chapman and Hall, New York, 1989.
28. T. P. Minka. Expectation propagation for approximate Bayesian inference. In Proceedings of the 7th Conference in Uncertainty in Artificial Intelligence (UAI), pages 362-369, 2001.
29. R. M. Neal. Regression and classification using Gaussian process priors (with discussion). In J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, editors, Bayesian Statistics, volume 6, pages 475-501. Oxford University Press, 1999.
30. D. J. Nott and P. J. Green. Bayesian variable selection and the Swendsen-Wang algorithm. Journal of Computational and Graphical Statistics, 13(1):1-17, 2004.
31. T. Park and G. Casella. The Bayesian lasso. Journal of the American Statistical Association, 103 (482):681-686, 2008.
32. N. S. Pillai, Q. Wu, F. Liang, S. Mukherjee, and R. L. Wolpert. Characterizing the function space for Bayesian kernel models. Journal of Machine Learning Research, 8:1769-1797, 2007. (Pubitemid 47258008)
33. J. Quiñonero-Candela and C. E. Rasmussen. A unifying view of sparse approximate Gaussian process regression. Journal of Machine Learning Research, 6:1939-1959, 2005. (Pubitemid 41798128)
34. A. E. Raftery, D.Madigan, and D. Hoeting. Bayesian model averaging for linear regression. Journal of the American Statistical Association, 92:179-191, 1997.
35. C. E. Rasmussen and C. K. I. Williams. Gaussian Processes for Machine Learning. MIT Press, Cambridge, MA, 2006.
36. G. Rätsch, T. Onoda, and K. Müller. Soft margins for Adaboost. Machine Learning, 42:287-320, 2001. (Pubitemid 32188795)
37. N. Sha, M. Vannucci, M. G. Tadesse, P. J. Brown, I. Dragoni, N. Davies T. C. Roberts, A. Contestabile, M. Salmon, C. Buckley, and F. Falciani. Bayesian variable selection in multinomial probit models to identify molecular signatures of disease stage. Biometrics, 60:812-819, 2004. (Pubitemid 39181128)
38. B. W. Silverman. Some aspects of the spline smoothing approach to non-parametric regression curve fitting (with discussion). Journal of the Royal Statistical Society, Series B, 47(1):1-52, 1985.
39. M. Smith and R. Kohn. Nonparametric regression using Bayesian variable selection. Journal of Econometrics, 75:317-344, 1996.
40. A. J. Smola and P. Bartlett. Sparse greedy Gaussian process regression. In Advances in Neural Information Processing Systems 13, 2001.
41. E. Snelson and Z. Ghahramani. Sparse Gaussian processes using pseudo-inputs. In Neural Information Processing Systems 18, 2006.
42. E. L. Snelson. Flexible and Efficient Gaussian Process Models for Machine Learning. PhD thesis, University College London, 2007.
43. P. Sollich. Bayesian methods for support vector machines: evidence and predictive class probabilities. Machine Learning, 46:21-52, 2001.
44. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B, 58:267-288, 1996.
45. M. E. Tipping. Sparse Bayesian learning and the relevance vector machine. Journal of Machine Learning Research, 1:211-244, 2001. (Pubitemid 33687203)
46. V. Vapnik. Statistical Learning Theory. John Wiley and Sons, New York, 1998.
47. G. Wahba. Spline Models for Observational Data. SIAM, Philadelphia, 1990.
48. M. West. Bayesian factor regression models in the "large p, small n" paradigm. In J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith, and M. West, editors, Bayesian Statistics 7, pages 723-732. Oxford University Press, 2003.
49. C. K. I. Williams and D. Barber. Bayesian classification with Gaussian processes. IEEE Trans. PAMI, 20(12):1342-1351, 1998. (Pubitemid 128741378)
50. C. K. I. Williams and M. Seeger. Using the Nyström method to speed up kernel machines. In Advances in Neural Information Processing Systems 13, 2001.
51. A. Zellner. On assessing prior distributions and Bayesian regression analysis with g-prior distributions. In P. K. Goel and A. Zellner, editors, Bayesian Inference and Decision Techniques: Essays in Honor of Bruno de Finetti, pages 233-243. North-Holland, Amsterdam, 1986.
52. Z. Zhang and M. I. Jordan. Bayesian multicategory support vector machines. In the Twenty-Second Conference on Uncertainty in Artificial Intelligence (UAI), 2006.
53. Z. Zhang, G. Wu, and E. Y Chang. Semiparametric regression using Student t processes. IEEE Transactions on Neural Networks, 18(6):1572-1588, 2007. (Pubitemid 350148413)
54. Z. Zhang,M. I. Jordan, and D.-Y. Yeung. Posterior consistency of the Silverman g-prior in Bayesian model choice. In Advances in Neural Information Processing Systems 22, 2008.
55. J. Zhu and T. Hastie. Kernel logistic regression and the import vector machines. Journal of Computational and Graphical Statistics, 14(1):185-205, 2005. (Pubitemid 40447832)