Spike-and-slab priors for function selection in structured additive regression models

Journal of the American Statistical Association

Volumn 107, Issue 500, 2012, Pages 1518-1532

  Scheipl, Fabian ^a   Fahrmeir, Ludwig ^a   Kneib, Thomas ^b  

^a UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF GÖTTINGEN   (Germany)

Author keywords

Generalized additive mixed models; Parameter expansion; Penalized splines; Spatial regression; Stochastic search variable selection

Indexed keywords

EID: 84871993172     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2012.737742     Document Type: Article

References (52)

1. Bae, K., and Mallick, B. (2004), "Gene Selection Using a Two-Level Hierar-chical Bayesian Model," Bioinformatics, 20, 3423-3430.
2. Baglama, J., and Reichel, L. (2006), "Augmented Implicitly Restarted Lanczos Bidiagonalization Methods," SIAM Journal on Scientific Computing, 27, 19-42.
3. Baladandayuthapani, V., Mallick, B., andCarroll, R. (2005), "SpatiallyAdaptive Bayesian Penalized Regression Splines (P-Splines)," Journal of Computa-tional and Graphical Statistics, 14, 378-394.
4. Barbieri, M., and Berger, J. (2004), "Optimal Predictive Model Selection," The Annals of Statistics, 32, 870-897.
5. Brezger, A., and Lang, S. (2006), "Generalized Structured Additive Regression Based on Bayesian P-Splines," Computational Statistics & Data Analysis, 50, 967-991.
6. Bühlmann, P., and Hothorn, T. (2007), "Boosting Algorithms: Regularization, Prediction and Model Fitting," Statistical Science, 22, 477-505.
7. Carvalho, C., Polson, N., and Scott, J. (2010), "The Horseshoe Estimator for Sparse Signals," Biometrika, 97, 465-480.
8. Chipman, H., George, E., and McCulloch, R. (2010), "BART: Bayesian Ad-ditive Regression Trees," The Annals of Applied Statistics, 4, 266-298.
9. Cottet, R., Kohn, R., andNott, D. (2008), "VariableSelectionandModelAverag-ing in Semiparametric Overdispersed Generalized Linear Models," Journal of the American Statistical Association, 103, 661-671.
10. Crainiceanu, C., Ruppert, D., Claeskens, G., and Wand, M. P. (2005), "Ex-act Likelihood Ratio Tests for Penalised Splines," Biometrika, 92, 91-103.
11. Crainiceanu, C. M., Ruppert, D., and Wand, M. P. (2005), "Bayesian Analysis for Penalized Spline Regression Using WinBUGS," Journal of Statistical Software, 14, 1-24.
12. Denison, D., Mallick, B., and Smith, A. (1998), "Bayesian MARS," Statistics and Computing, 8, 337-346.
13. Dimatteo, I., Genovese, C. R., and Kass, R. E. (2001), "Bayesian Curve-fitting With Free-Knot Splines," Biometrika, 88, 1055-1071.
14. Fahrmeir, L., Kneib, T., and Lang, S. (2004), "Penalized Structured Additive Regression for Space-Time Data: A Bayesian Perspective," Statistica Sinica, 14, 731-761.
15. Fahrmeir, L., and Tutz, G. (2001), Multivariate Statistical Modelling Based on Generalized Linear Models, New York: Springer.
16. Gelman, A., Van Dyk, D., Huang, Z., and Boscardin, J. (2008), "Using Redun-dant Parameterizations to Fit Hierarchical Models," Journal of Computa-tional and Graphical Statistics, 17, 95-122.
17. George, E., and McCulloch, R. (1993), "Variable Selection via Gibbs Sam-pling," Journal of the American Statistical Association, 88, 881-889.
18. Greven, S., Crainiceanu, C., Küchenhoff, H., and Peters, A. (2008), "Restricted Likelihood Ratio Testing for Zero Variance Components in Linear Mixed Models," Journal of Computational and Graphical Statistics, 17, 870-891.
19. Hofner, B., Kneib, T., Hartl, W., and Küchenhoff, H. (2011), "Building Cox-Type Structured Hazard Regression Models With Time-Varying Effects," Statistical Modelling, 11, 3-24.
20. Hothorn, T., Buehlmann, P., Kneib, T., Schmid, M., and Hofner, B. (2010), mboost: Model-Based Boosting, R package version 2. 0-0.
21. Huang, J., Horowitz, J., and Wei, F. (2010), "Variable Selection in Non-parametric Additive Models," The Annals of Statistics, 38, 2282-2313.
22. Ishwaran, H., and Rao, J. (2005), "Spike and Slab Variable Selection: Fre-quentist and Bayesian Strategies," The Annals of Statistics, 33, 730-773.
23. Krivobokova, T., Crainiceanu, C. M., andKauermann, G. (2008), "FastAdaptive Penalized Splines," Journal of Computational and Graphical Statistics, 17, 1-20.
24. Lang, S., and Brezger, A. (2004), "Bayesian P-Splines," Journal of Computa-tional and Graphical Statistics, 13, 183-212.
25. Lewis, B. (2009), Irlba: Fast Partial SVD by Implicitly-Restarted Lanczos Bid i-agonalization, R package version 0. 1. 1.
26. Lin, Y., and Zhang, H. (2006), "Component Selection and Smoothing in Multi-variate Nonparametric Regression," The Annals of Statistics, 34, 2272-2297.
27. Marra, G., and Wood, S. (2011), "Practical Variable Selection for General-ized Additive Models," Computational Statistics and Data Analysis, 55, 2372-2387.
28. Meier, L., van der Geer, S., and Bühlmann, P. (2009), "High-Dimensional Additive Modeling," The Annals of Statistics, 37, 3779-3821.
29. Meyer, D., Leisch, F., and Hornik, K. (2003), "The Support Vector Machine Under Test," Neurocomputing, 55, 169-186.
30. Mitchell, T., and Beauchamp, J. (1988), "Bayesian Variable Selection in Linear Regression," Journal of the American Statistical Association, 83, 1023-1032.
31. Morris, J. S., and Carroll, R. J. (2006), "Wavelet-Based Functional Mixed Models," Journal of the Royal Statistical Society, Series B, 68, 179-199.
32. O'Hara, R., and Sillanpää, M. (2009), "A Review of Bayesian Variable Selection Methods: What, How, and Which?," Bayesian Analysis, 4, 85-118.
33. Panagiotelis, A., and Smith, M. (2008), "Bayesian Identification, Se-lection and Estimation of Semiparametric Functions in High-Dimensional Additive Models," Journal of Econometrics, 143, 291-316.
34. Polson, N., and Scott, J. (2010), "Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction," in Bayesian Statistics 9, eds. J. Bernardo, M. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith, and M. West, Oxford: Oxford University Press, pp. 76-106.
35. Ravikumar, P., Liu, H., Lafferty, J., and Wasserman, L. (2009), "Sparse Additive Models," Journal of the Royal Statistical Society, Series B, 71, 1009-1030.
36. Reich, B., Storlie, C., and Bondell, H. (2009), "Variable Selection in Bayesian Smoothing Spline ANOVA Models: Application to Deterministic Computer Codes," Technometrics, 51, 110-120.
37. Rue, H., and Held, L. (2005), Gaussian Markov Random Fields, London: Chap-man & Hall/CRC.
38. Ruppert, D., Wand, M. P., and Carroll, R. J. (2003), Semiparametric Regression, Cambridge: Cambridge University Press.
39. Sabanés Bové, D., and Held, L. (2011), "Hyper-g Priors for Generalized Linear Models," Bayesian Analysis, 6, 1-24.
40. Sabanés Bové, D., Held, L., and Kauermann, G. (2011), "Hyper-g Priors for Generalised Additive Model Selection With Penalised Splines," Technical Report, University of Zurich.
41. Scheipl, F. (2010), "Normal-Mixture-of-Inverse-Gamma Priors for Bayesian Regularization and Model Selectionin Generalized Additive Models," Tech-nical Report 84, Department of Statistics, LMU München.
42. Scheipl, F. (2011a), Bayesian Regularization and Model Choice in Structured Ad-ditive Regression, München: Dr. Hut Verlag.
43. Scheipl, F. (2011b, 9), "SpikeSlabGAM: Bayesian Variable Selection, Model Choice and Regularization for Generalized Additive Mixed Models in R," Journal of Statistical Software, 43, 1-24.
44. Scheipl, F. (2012), spikeSlabGAM: Bayesian Model Selection for Generalized Ad-ditive Mixed Models, R package version 1. 1-3.
45. Scheipl, F., Greven, S., and Küchenhoff, H. (2008), "Size and Power of Tests for a Zero Random Effect Variance or Polynomial Regression in Additive and Linear Mixed Models," Computational Statistics & Data Analysis, 52, 3283-3299.
46. Scheipl, F., Kneib, T., and Fahrmeir, L. (in press), "Penalized Likelihood and Bayesian Function Selection in Regression Models," Advances in Statistical Analysis.
47. Storlie, C., Bondell, H., Reich, B., and Zhang, H. (2011), "The Adaptive COSSO for Nonparametric Surface Estimation and Model Selection," Statistica Sinica, 21, 679-705.
48. Wand, M. P. (2000), "A Comparison of Regression Spline Smoothing Proce-dures," Computational Statistics, 15, 443-462.
49. Wood, S., Kohn, R., Shively, T., and Jiang, W. (2002), "Model Selection in Spline Nonparametric Regression," Journal of the Royal Statistical Society, Series B, 64, 119-139.
50. Yau, P., Kohn, R., and Wood, S. (2003), "Bayesian Variable Selection and Model Averaging in High-Dimensional Multinomial Nonparametric Regression," Journal of Computational and Graphical Statistics, 12, 23-54.
51. Zhu, H., Brown, P., and Morris, J. S. (2011), "Robust, Adaptive Functional Re-gression in Functional Mixed Model Framework," Journal of the American Statistical Association, 106, 1167-1179.
52. Zhu, H., Vannucci, M., and Cox, D. (2010), "A Bayesian Hierarchical Model for Classification With Selection of Functional Predictors," Biometrics, 66, 463-473.