Real-Time Semiparametric Regression

Journal of Computational and Graphical Statistics

Volumn 23, Issue 3, 2014, Pages 589-615

  Luts, J ^a   Broderick, T ^b   Wand, M P ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Approximate Bayesian inference; Generalized additive models; Mean field variational Bayes; Mixed models; Online variational Bayes; Penalized splines; Wavelets

Indexed keywords

EID: 84904979938     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.2013.810150     Document Type: Article

References (49)

1. Albert, J.H., and Chib, S. (1993), “Bayesian Analysis of Binary and Polychotomous Response Data,” Journal of the American Statistical Association, 88, 669–679.
2. Armagan, A., Dunson, D.B., and Lee, J. (2013), “Generalized Double Pareto Shrinkage,” Statistica Sinica, 23, 119–143.
3. Bishop, C.M. (2006), Pattern Recognition and Machine Learning, New York: Springer.
4. Cameron, A.C., and Trivedi, P.K. (2005), Microeconometrics: Methods and Applications, New York: Cambridge University Press.
5. Carvalho, C.M., Polson, N.G., and Scott, J.G. (2010), “The Horseshoe Estimator for Sparse Signals,” Biometrika, 97, 465–480.
6. Consonni, G., and Marin, J.-M. (2007), “Mean-field Variational Approximate Bayesian Inference for Latent Variable Models,” Computational Statistics and Data Analysis, 52, 790–798.
7. Croissant, Y. (2011), Ecdat 0.1. “Datasets for Econometrics,” R package, Available at cran.r-project.org
8. 1 Convergence of Kernel Estimators of Regression Functions With Application to Discrimination,” Zeitschrift für Wahrscheinlichkeitstheorie und Vervandte Gebiete, 51, 15–25.
9. Faes, C., Ormerod, J.T., and Wand, M.P. (2011), “Variational Bayesian Inference for Parametric and Nonparametric Regression With Missing Data,” Journal of the American Statistical Association, 106, 959–971.
10. Fricker, R.D., and Chang, J.T. (2008), “A Spatio-Temporal Methodology for Real-time Biosurveillance,” Quality Engineering, 20, 465–477.
11. Girolami, M., and Rogers, S. (2006), “Variational Bayesian Multinomial Probit Regression,” Neural Computation, 18, 1790–1817.
12. Gradshteyn, I.S., and Ryzhik, I.M. (1994), Tables of Integrals, Series, and Products (5th ed.), San Diego, California: Academic Press.
13. Griffin, J.E., and Brown, P.J. (2011), “Bayesian Hyper Lassos With Non-convex Penalization,” Australian and New Zealand Journal of Statistics, 53, 423–442.
14. Härdle, W. (1990), Applied Nonparametric Regression, Cambridge: Cambridge University Press.
15. Hoffman, M., Blei, D., and Bach, F. (2010), “Online Learning for Latent Dirichlet Allocation,” in Advances in Neural Information Processing Systems 23, eds. J. Lafferty, C. K.I. Williams, J. Shawe-Taylor, R.S. Zemel, and A. Culotta, Vancouver, Canada: Neural Information Processing Systems Foundation, pp. 856–864.
16. Huang, A., and Wand, M.P. (2013), “Simple Marginally Noninformative Prior Distributions for Covariance Matrices,” Bayesian Analysis, 2, Number 2, 439–452.
17. Jaakkola, T.S., and Jordan, M.I. (2000), “Bayesian Parameter Estimation via Variational Methods,” Statistics and Computing, 10, 25–37.
18. Jank, W., and Shmueli, G. (2007), “Modelling Concurrency of Events in Online Auctions via Spatiotemporal Semiparametric Models,” Applied Statistics, 56, 1–27.
19. Johnstone, I.M., and Silverman, B.W. (2005), “Empirical Bayes Selection of Wavelet Thresholds,” The Annals of Statistics, 33, 1700–1752.
20. Kaimi, I., and Diggle, P.J. (2011), “A Hierarchical Model for Real-time Monitoring of Variation in Risk of Non-Specific Gastro-intestinal Infections,” Epidemiology and Infection, 139, 1854–1862.
21. Kammann, E.E., and Wand, M.P. (2003), “Geoadditive Models,” Journal of the Royal Statistical Society, Series C, 52, 1–18.
22. Krzyzak, A., and Pawlak, M. (1984), “Almost Everywhere Convergence of a Recursive Regression Function Estimate and Classification,” IEEE Transactions on Information Theory, IT-30, 91–93.
23. Langford, J., Li, L., and Zhang, T. (2009), “Sparse Online Learning Via Truncated Gradient,” Journal of Machine Learning Research, 10, 777–801.
24. Louis, T.A. (1982), “Finding the Observed Information Matrix When Using the EM Algorithm,” Journal of the Royal Statistical Society, Series B, 44, 226–233.
25. Luenberger, D.G., and Ye, Y. (2008), Linear and Nonlinear Programming (3rd ed.), New York: Springer.
26. McCulloch, C.E., Searle, S.R., and Neuhaus, J.M. (2008), Generalized, Linear, and Mixed Models (2nd ed.), New York: Wiley.
27. Menictas, M., and Wand, M.P. (2013), “Variational Inference for Marginal Longitudinal Semiparametric Regression,” Stat, 2, 61–71.
28. Michalak, S., DuBois, A., DuBois, D., Wiel, S., and Hogden, J. (2012), “Developing Systems for Real-time Streaming Analysis,” Journal of Computational and Graphical Statistics, 21, 561–580.
29. Neville, S. E., Ormerod, J. T., and Wand, M. P. (2013), “Mean Field Variational Bayes for Continuous Sparse Signal Shrinkage: Pitfalls and Remedies,”. available at matt-wand.utsacademics.info/papers.html.
30. Ng, S.-K., McLachlan, G.J., and Lee, A.H. (2006), “An Incremental EM-based Learning Approach for Online Prediction of Hospital Resource Utilization,” Artificial Intelligence in Medicine, 36, 257–267.
31. Ormerod, J.T., and Wand, M.P. (2010), “Explaining Variational Approximations,” The American Statistician, 64, 140–153.
32. Ruppert, D., Wand, M.P., and Carroll, R.J. (2003), Semiparametric Regression, New York: Cambridge University Press.
33. Ruppert, D., Wand, M.P., and Carroll, R.J. (2009), “Semiparametric Regression During 2003–2007,” Electronic Journal of Statistics, 3, 1193–1256.
34. Ryan, J. A. (2012), “quantmod 0.3. Quantitative Financial Modelling Framework,”. R package, Available at cran.r-project.org.
35. Smith, A. D. A. C., and Wand, M.P. (2008), “Streamlined Variance Calculations for Semiparametric Mixed Models,” Statistics in Medicine, 27, 435–448.
36. Tchumtchoua, S., Dunson, D. B., and Morris, J. S. (2012), “Online Variational Bayes Inference for High-dimensional Correlated Data,”. unpublished manuscript. Available at www.stat.duke.edu/∼dunson/ submitted.html.
37. Wainwright, M.J., and Jordan, M.I. (2008), “Graphical Models, Exponential Families, and Variational Inference,” Foundation and Trends in Machine Learning, 1, 1–305.
38. Wand, M.P. (2009), “Semiparametric Regression and Graphical Models,” Australian and New Zealand Journal of Statistics, 51, 9–41.
39. Wand, M.P., and Jones, M.C. (1995), Kernel Smoothing, London: Chapman and Hall.
40. Wand, M.P., and Ormerod, J.T. (2008), “On Semiparametric Regression With O’Sullivan Penalized Splines,” Australian and New Zealand Journal of Statistics, 50, 179–198.
41. Wand, M.P., and Ormerod, J.T. (2011), “Penalized Wavelets: Embedding Wavelets Into Semiparametric Regression,” Electronic Journal of Statistics, 5, 1654–1717.
42. Wang, C., Paisley, J., and Blei, D.M. (2011), “Online Variational Inference for the Hierarchical Dirichlet Process,” in International Conference on Artificial Intelligence and Statistics, 2011,. Fort Lauderdale, FL, USA.
43. Wang, B., and Titterington, D.M. (2005), “Inadequacy of Interval Estimates Corresponding to Variational Bayesian Approximations,” in Proceedings of the 10th International Workshop on Artificial Intelligence, eds. R.G. Cowell and Z. Ghahramani, Barbados: Society for Artificial Intelligence and Statistics, pp. 373–380.
44. Welham, S.J., Cullis, B.R., Kenward, M.G., and Thompson, R. (2007), “A Comparison of Mixed Model Splines for Curve Fitting,” Australian and New Zealand Journal of Statistics, 49, 1–23.
45. Wolverton, C.T., and Wagner, T.J. (1969), “Asymptotically Optimal Discriminant Functions for Pattern Recognition,” IEEE Transactions on Information Theory, IT-15, 258–265.
46. Wood, S.N. (2006), Generalized Additive Models: An Introduction With R. Boca Raton, Florida: Chapman & Hall/CRC.
47. Yamato, H. (1971), “Sequential Estimation of a Continuous Probability Density Function and Model,” Bulletin of Mathematical Statistics, 14, 1–12.
48. Zhang, T. (2004), “Solving Large Scale Linear Prediction Problems Using Stochastic Gradient Descent Algorithms,” in Proceedings of the Twenty-First International Conference on Machine Learning, ed. C.E. Brodley, Banff, Canada: The International Machine Learning Society, pp. 919–926.
49. Zhao, Y., Staudenmayer, J., Coull, B.A., and Wand, M.P. (2006), “General Design Bayesian Generalized Linear Mixed Models,” Statistical Science, 21, 35–51.