Variational inference for count response semiparametric regression

Bayesian Analysis

Volumn 10, Issue 4, 2015, Pages 991-1023

  Luts, J ^a   Wand, M P ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Approximate bayesian inference; Generalized additive mixed models; Mean field variational bayes; Penalized splines; Real time semiparametric regression

Indexed keywords

EID: 84979895357     PISSN: 19360975     EISSN: 19316690     Source Type: Journal    
DOI: 10.1214/14-BA932     Document Type: Article

References (37)

1. Albert, J. H. and Chib, S. (1993). "Bayesian analysis of binary and polychotomous response data." Journal of the American Statistical Association, 88: 669-679. MR1224394. doi: http://dx.doi.org/10.1080/01621459.1993.10476321
2. Barber, D. and Bishop, C. M. (1998). "Ensemble learning for multi-layer networks." In: Jordan, M. I., Kearns, K. J., and Solla, S. A. (eds.), Advances in Neural Information Processing Systems, 10, 395-401. Cambridge, Massachusetts: MIT Press.
3. Bishop, C. M. (2008). "A new framework for machine learning." In: J. M. Zurada et al., (eds.), World Congress on Computational Intelligence, 2008 Plenary/Invited Lectures, Lecture Notes in Computer Science, 5050, 1-24. Heidelberg, Germany: Springer-Verlag
4. Chopin, N., Jacob, P. E., and Papaspiliopoulos, O. (2013). "SMC2: an efficient algorithm for sequential analysis of state space models." Journal of the Royal Statistical Society: Series B, 75: 397-426. doi: http://dx.doi.org/10.1111/j.1467-9868.2012.01046.x
5. Consonni, G. and Marin, J.-M. (2007). "Mean-field variational approximate Bayesian inference for latent variable models." Computational Statistics and Data Analysis, 52: 790-798. MR2418528. doi: http://dx.doi.org/10.1016/j.csda.2006.10.028
6. Damien, P., Wakefield, J., and Walker, S. (1999). "Gibbs sampling for Bayesian nonconjugate and hierarchical models by using auxiliary variables." Journal of the Royal Statistical Society, Series B, 61: 331-345. MR1680334. doi: http://dx.doi.org/ 10.1111/1467-9868.00179
7. Efron, B. (1979). "Bootstrap methods: another look at the jackknife." The Annals of Statistics, 7: 1-26. MR0515681. doi: http://dx.doi.org/10.1214/aos/1176344552
8. Fan, Y., Leslie, D. S. and Wand, M. P. (2008). "Generalised linear mixed model analysis via sequential Monte Carlo sampling." Electronic Journal of Statistics, 2: 916-938. doi: http://dx.doi.org/10.1214/07-EJS158
9. Frühwirth-Schnatter, S., Frühwirth, R., Held, L., and Rue, H. (2009). "Improved auxiliary mixture sampling for hierarchical models of non-Gaussian data." Statistics and Computing, 19: 479-492. MR2565319. doi: http://dx.doi.org/10.1007/s11222-008-9109-4
10. Gelman, A. (2006). "Prior distributions for variance parameters in hierarchical models." Bayesian Analysis, 1: 515-533. doi: http://dx.doi.org/10.1214/06-BA107A. 996
11. Girolami, M. and Rogers, S. (2006). "Variational Bayesian multinomial probit regression." Neural Computation, 18: 1790-1817. MR2230854. doi: http://dx.doi.org/ 10.1162/neco.2006.18.8.1790
12. Honkela, A., Raiko, T., Kuusela, M., Tornio, M. and Karhunen, J. (2010). "Approximate Riemannian conjugate gradient learning for fixed-form variational Bayes." Journal of Machine Learning Research, 11: 3235-3268.
13. Jaakkola, T. S. and Jordan, M. I. (2000). "Bayesian parameter estimation via variational methods." Statistics and Computing, 10: 25-37. doi: http://dx.doi.org/10.1023/A:1008932416310
14. Knowles, D. A. and Minka, T. P. (2011). "Non-conjugate message passing for multinomial and binary regression." In: Shawe-Taylor, J., Zamel, R. S., Bartlett, P., Pereira, F., and Weinberger, K. Q. (eds.), Advances in Neural Information Processing Systems 24, 1701-1709.
15. Lawless, J. F. (1987). "Negative Binomial and mixed Poisson regression." Canadian Journal of Statistics, 15: 209-225. MR0926553. doi: http://dx.doi.org/10.2307/ 3314912
16. Leetaru, K. H. and Schrodt, P. A. (2013). "A 30-year georeferenced global event database: The Global Database of Events, Language, and Tone (GDELT)." In: International Studies Association Conference. San Francisco, USA.
17. Li, Y. and Ruppert, D. (2008). "On the asymptotics of penalized splines." Biometrika, 95: 415-436. MR2521591. doi: http://dx.doi.org/10.1093/biomet/asn010
18. Luts, J., Broderick, T., and Wand, M. P. (2014). "Real-time semiparametric regression." Journal of Computational and Graphical Statistics, 23: 589-615. MR3224647. doi: http://dx.doi.org/10.1080/10618600.2013.810150
19. Magnus, J. R. and Neudecker, H. (1999). Matrix Differential Calculus with Applications in Statistics and Econometrics, Revised Edition. Chichester UK: Wiley.
20. Marley, J. K. and Wand, M. P. (2010). "Non-standard semiparametric regression via BRugs." Journal of Statistical Software, 37: 1-30.
21. Menictas, M. and Wand, M. P. (2015). "Variational inference for heteroscedastic semiparametric regression." Australian and New Zealand Journal of Statistics, 57: in press.
22. Michalak, S., DuBois, A., DuBois, D., Vander Wiel, S., and Hogden, J. (2012). "Developing systems for real-time streaming analysis." Journal of Computational and Graphical Statistics, 21: 561-580. MR2970908. doi: http://dx.doi.org/10.1080/10618600.2012.657144
23. Minka, T. P. (2001). "Expectation propagation for approximate Bayesian inference." In: Proceedings of Conference on Uncertainty in Artificial Intelligence, 362-369.
24. Mittal, S., Madigan, D., Burd, R. S., and Suchard, M. A. (2013). "High-dimensional, massive sample-size Cox proportional hazards regression for survival analysis." Biostatistics, 15: 287-294.
25. O'Sullivan, F. (1986). "A statistical perspective on ill-posed inverse problems (with discussion)." Statistical Science, 1: 502-527.
26. R Development Core Team (2015). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. http://www.R-project.org/
27. Rue, H., Martino, S., and Chopin, N. (2009). "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations (with discussion)." Journal of the Royal Statistical Society, Series B, 71: 319-392. doi: http://dx.doi.org/10.1111/j.1467-9868.2008.00700.x
28. Ruppert, D., Wand, M. P., and Carroll, R. J. (2003). Semiparametric Regression. New York: Cambridge University Press. MR1998720. doi: http://dx.doi.org/10.1017/CBO9780511755453
29. Ruppert, D., Wand, M. P., and Carroll, R. J. (2009). "Semiparametric regression during 2003-2007." Electronic Journal of Statistics, 3: 1193-1256. MR2566186. doi: http://dx.doi.org/10.1214/09-EJS525
30. Spiegelhalter, D. J., Thomas, A., Best, N. G., Gilks, W. R., and Lunn, D. (2003). BUGS: Bayesian inference using Gibbs sampling. Medical Research Council Biostatistics Unit, Cambridge, UK. http://www.mrc-bsu.cam.ac.uk/bugs
31. Tan, L. S. L. and Nott, D. J. (2013). "Variational inference for generalized linear mixed models using partially noncentred parametrizations." Statistical Science, 28: 168-188. MR3112404. doi: http://dx.doi.org/10.1214/13-STS418
32. Thurston, S. W., Wand, M. P., and Weincke, J. K. (2000). "Negative binomial additive models." Biometrics, 56: 139-144. doi: http://dx.doi.org/10.1111/j.0006-341X.2000.00139.x
33. Wainwright, M. J. and Jordan, M. I. (2008). "Graphical models, exponential families, and variational inference." Foundation and Trends in Machine Learning, 1: 1-305. doi: http://dx.doi.org/10.1561/2200000001
34. Wand, M. P. (2014). "Fully simplified Multivariate Normal updates in non-conjugate variational message passing." Journal of Machine Learning Research, 15: 1351-1369.
35. Wand, M. P. and Ormerod, J. T. (2008). "On O'Sullivan penalised splines and semiparametric regression." Australian and New Zealand Journal of Statistics, 50: 179-198. MR2431193. doi: http://dx.doi.org/10.1111/j.1467-842X.2008.00507.x
36. Wand, M. P., Ormerod, J. T., Padoan, S. A., and Frühwirth, R. (2011). "Mean field variational Bayes for elaborate distributions." Bayesian Analysis, 6: 847-900. MR2869967. doi: http://dx.doi.org/10.1214/11-BA631
37. Wiencke, J., Thurston, S. W., Kelsey, K. T., Varkonyi, A.,Wain, J. C.,Mark, E. J., and Christiani, D. C. (1999). "Early age at smoking initiation and tobacco carcinogen DNA damage in the lung." Journal of the National Cancer Institute, 91: 614-619. doi: http://dx.doi.org/10.1093/jnci/91.7.614