Bayesian variable and transformation selection in linear regression

Journal of Computational and Graphical Statistics

Volumn 11, Issue 3, 2002, Pages 485-507

  Hoeting, Jennifer A ^a   Raftery, Adrian E ^a   Madigan, David ^a  

^a Immunology and Pathology   (United States)

Author keywords

Bayesian model averaging; Change point transformation; Markov chain Monte Carlo model composition; Model uncertainty; Posterior model probability

Indexed keywords

EID: 0036749901     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186002501     Document Type: Article

References (41)

1. Best, N.G., Cowles, M.K., and Vines, S.K. (1995), CODA Convergence Diagnosis and Output Analysis Software for Gibbs Sampler Output.
2. Box, G.E.P., and Cox, D.R. (1964), "An Analysis of Transformations" (with discussion), Journal of the Royal Statistical Society, Series B, 26, 211-246.
3. Box, G.E.P., and Tidwell, P.W. (1962), "Transformation of the Independent Variables," Technometrics, 4, 531-550.
4. Breiman, L., and Friedman, J.H. (1985), "Estimating Optimal Transformations for Multiple Regression and Correlation" (with discussion), Journal of the American Statistical Association, 80, 580-619.
5. Clyde, M., DeSimone, H., and Parmigiani, G. (1996), "Prediction via Orthoganalized Model Mixing," Journal of the American Statistical Association, 91, 1197-1208.
6. Clyde, M., and George, E.I. (1999), "Empirical Bayes Estimation in Wavelet Nonparameteric Regression," in Bayesian Inference in Wavelet Based Models, eds. P. Muller, and B. Vidakovic, New York: Springer-Verlag, pp. 309-322.
7. Draper, D. (1995), "Assessment and Propagation of Model Uncertainty," Journal of the Royal Statistical Society, Series B, 57, 45-97.
8. Edwards, W., Lindman, H., and Savage, L.J. (1963), "Bayesian Statistical Inference for Psychological Research," Psychological Review, 70, 193-242.
9. Fernandez, C., Ley, E., and Steel, M.F.J. (1997), "Statistical Modeling of Fishing Activities in the North Atlantic," Technical Report, Department of Econometrics, Tilburg University, the Netherlands.
10. _, (1998), "Benchmark Priors for Bayesian Model Averaging," Technical Report, Department of Econometrics, Tilburg University, the Netherlands.
11. Friedman, J.H. (1991), "Multivariate Adaptive Regression Splines," The Annals of Statistics, 19, 1-141.
12. Friedman, J.H., and Silverman, B.W. (1989), "Flexible Parsimonious Smoothing and Additvie Modelling" (with discussion), Technometrics, 31, 3-39.
13. Garthwaite, P.H., and Dickey, J.M. (1992), "Elicitation of Prior Distributions for Variable-Selection Problems in Regression," Annals of Statistics, 20, 1697-1719.
14. Geisser, S. (1980), Discussion of "Sampling and Bayes' Inference in Scientific Modeling and Robustness" by G.E.P. Box, Journal of the Royal Statistical Society, Series A, 143, 416-417.
15. George, E.I., and McCulloch, R.E. (1993), "Variable Selection via Gibbs Sampling," Journal of the American Statistical Association, 88, 881-889.
16. Good, I.J. (1952), "Rational Decisions," Journal of the Royal Statistical Society, Series B, 14, 107-114.
17. Hahn, G.J., and Meeker, W.Q. (1993), "Assumptions for Statistical Inference," The American Statistician, 47, 1-11.
18. Hastie, T., and Tibshirani, R. (1990), Generalized Additive Models, London: Chapman and Hall.
19. Hoeting, J.A. (1994), "Accounting for Model Uncertainty in Linear Regression," PhD thesis, University of Washington.
20. Hoeting, J.A., Madigan, D., Raftery, A.E., and Volinsky, C.T. (1999), "Bayesian Model Averaging: A Tutorial" (with discussion), Statistical Science, 14, 382-417; corrected version of the paper available at http://www. stat.washington.edu/www/research/online/hoeting1999.pdf.
21. Hoeting, J.A., Raftery, A.E., and Madigan, D. (1996), "A Method for Simultaneous Variable Selection and Outlier Identification in Linear Regression," Journal of Computational Statistics and Data Analysis, 22, 251-271.
22. Jeffreys, H. (1961), Theory of Probability (3rd ed.), London: Oxford University Press.
23. Kadane, J.B., Dickey, J.M., Winker, R.L., Smith, W.S., and Peters, S.C. (1980), "Interactive Elicitation of Opinion for a Normal Linear Model," Journal of the American Statistical Association, 75, 845-854.
24. Kass, R.E., and Raftery, A.E. (1995), "Bayes Factors," Journal of the American Statistical Association, 90, 773-795.
25. Kooperberg, C., Stone, C.J., and Truong, Y.K. (1995), "Hazard Regression," Journal of the American Statistical Association, 90, 78-94.
26. Leamer, E.E. (1978), Specification Searches, New York: Wiley.
27. Madigan, D., and York, J. (1995), "Bayesian Graphical Models for Discrete Data," International Statistical Review, 63, 215-232.
28. Miller, A.J. (1990), Subset Selection in Regression, London: Chapman and Hall.
29. Pazzani, M. (1996), "Constructive Induction of Cartesian Product Attributes," in Information, Statistics and Induction in Science, Melbourne, Australia.
30. Raftery, A.E. (1994), "Change Point and Change Curve Modeling in Stochastic Processes and Spatial Statistics," Journal of Applied Statistical Science, 1,403-424.
31. _, (1996), "Approximate B ayes Factors and Accounting for Model Uncertainty in Generalised Linear Models," Biometrika, 83, 251-266.
32. Raftery, A.E., Lewis, S.M., and Aghajanian, A. (1995), "Demand or Ideation? Evidence From the Iranian Marital Fertility Decline," Demography, 32, 159-182.
33. Raftery, A.E., Lewis, S.M., Aghajanian, A., and Kahn, M.J. (1996), "Event History Analysis of World Fertility Survey Data," Mathematical Population Studies, 6, 129-153.
34. Raftery, A.E., Madigan, D., and Hoeting, J. (1997), "Bayesian Model Averaging for Linear Regression Models," Journal of the American Statistical Association, 92, 179-191.
35. Raftery, A.E., and Richardson, S. (1996), "Model Selection for Generalized Linear Models via Glib, with Application to Epidemiology," in Bayesian Biostatistics, eds. D.A. Berry and D.K. Stangi, New York: Dekker, pp. 321-354.
36. Raiffa, H., and Schlaifer, R. (1961), Applied Statistical Decision Theory, Cambridge, MA: The MIT Press.
37. Regal, R., and Hook, E.B. (1991), "The Effects of Model Selection on Confidence Intervals for the Size of a Closed Population," Statistical Medicine, 10, 717-721.
38. Smith, A.F.M., and Roberts, G.O. (1993), "Bayesian Computation via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods" (with discussion), Journal of the Royal Statistical Society, Series B, 55, 3-23.
39. Smith, M., and Kohn, R. (1996), "Nonparametric Regression Using Bayesian Variable Selection," Journal of Econometrics, 75, 317-343.
40. Volinsky, C.T. (1997), "Bayesian Model Averaging for Censored Survival Models," PhD thesis, Univ. of Washington.
41. Weisberg, S. (1985), Applied Linear Regression (2nd ed.), New York: Wiley.