Model uncertainty

Statistical Science

Volumn 19, Issue 1, 2004, Pages 81-94

  Clyde, Merlise ^a   George, Edward I ^b  

^a DUKE UNIVERSITY   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Bayes factors; Classification arid regression trees; Linear and nonparametric regression; Model averaging; Objective prior distributions; Reversible jump Markov chain Monte Carlo; Variable selection

Indexed keywords

EID: 4043115647     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/088342304000000035     Document Type: Article

References (130)

1. ABRAMOVICH, F., SAPATINAS, T. and SILVERMAN, B. W. (1998). Wavelet thresholding via a Bayesian approach. J. R. Stat. Soc. Ser. B Stat. Methodol. 60 725-749.
2. AKAIKE, H. (1973). Information theory and an extension of the maximum likelihood principle. In Second International Symposium on Information Theory (B. Petrov and F. Csáki, eds.) 267-281. Akadémiai Kiadó, Budapest.
3. ANDRIEU, C., DOUCET, A. and ROBERT, C. (2004). Computational advances for and from Bayesian analysis. Statist. Sci. 19 118-127.
4. ATAY-KAYIS, A. and MASSAM, H. (2002). The marginal likelihood for decomposable and nondecomposable graphical Gaussian models. Technical report, Dept. Mathematics, York Univ.
5. BARBIERI, M. M. and BERGER, J. (2004). Optimal predictive model selection. Ann. Statist. 32 870-897.
6. BARTLETT, M. (1957). A comment on D. V. Lindley's statistical paradox. Biometrika 44 533-534.
7. BERGER, J. O., GHOSH, J. K. and MUKHOPADHYAY, N. (2003). Approximations and consistency of Bayes factors as model dimension grows. J. Statist. Plann. Inference 112 241-258.
8. BERGER, J. O. and PERICCHI, L. R. (1996a). The intrinsic Bayes factor for linear models. In Bayesian Statistics 5 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 25-44. Oxford Univ. Press.
9. BERGER, J. O. and PERICCHI, L. R. (1996b). The intrinsic Bayes factor for model selection and prediction. J. Amer. Statist. Assoc. 91 109-122.
10. BERGER, J. O. and PERICCHI, L. R. (1998). Accurate and stable Bayesian model selection: The median intrinsic Bayes factor. Sankhȳa Ser. B 60 1-18.
11. BERGER, J. O. and PERICCHI, L. (2001). Objective Bayesian methods for model selection: Introduction and comparison (with discussion). In Model Selection (P. Lahiri, ed.) 135-207. IMS, Beachwood, OH.
12. BERNARDO, J. M. and SMITH, A. F. M. (1994). Bayesian Theory. Wiley, New York.
13. BESAG, J. and GREEN, P. J. (1993). Spatial statistics and Bayesian computation (with discussion). J. Roy. Statist. Soc. Ser. B 55 25-37.
14. BREIMAN, L., FRIEDMAN, J. H., OLSHEN, R. A. and STONE, C. J. (1984). Classification and Regression Trees. Wadsworth, Belmont, CA.
15. BROOKS, S. P., GIUDICI, P. and ROBERTS, G. O. (2003). Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions (with discussion). J. R. Stat. Soc. Ser. B Stat. Methodol 65 3-55.
16. BROWN, P. J., FEARN, T. and VANNUCCI, M. (1999). The choice of variables in multivariate regression: A non-conjugate Bayesian decision theory approach. Biometrika 86 635-648.
17. BROWN, P. J., VANNUCCI, M. and FEARN, T. (1998). Multivariate Bayesian variable selection and prediction. J. R. Stat. Soc. Ser. B Stat. Methodol. 60 627-641.
18. BROWN, P. J., VANNUCCI, M. and FEARN, T. (2002). Bayes model averaging with selection of regressors. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 519-536.
19. BUNTINE, W. (1992). Learning classification trees. Statist. Comput. 2 63-73.
20. CARLIN, B. P. and CHIB, S. (1995). Bayesian model choice via Markov chain Monte Carlo methods. J. Roy. Statist. Soc. Ser. B 57 473-484.
21. CASELLA, G. and MORENO, E. (2002). Objective Bayes variable selection. Technical Report 2002-023, Dept. Statistics, Univ. Florida.
22. CHEN, M.-H. (1994). Importance-weighted marginal Bayesian posterior density estimation. J. Amer. Statist. Assoc. 89 818-824.
23. CHEN, M.-H., IBRAHIM, J. G., SHAO, Q.-M. and WEISS, R. E. (2003). Prior elicitation for model selection and estimation in generalized linear mixed models. J. Statist. Plann. Inference 111 57-76.
24. CHEN, M.-H., IBRAHIM, J. G. and YIANNOUTSOS, C. (1999). Prior elicitation, variable selection and Bayesian computation for logistic regression models. J. R. Stat. Soc. Ser. B Stat. Methodol. 61 223-242.
25. CHEN, M.-H, and SHAO, Q.-M. (1997). On Monte Carlo methods for estimating ratios of normalizing constants. Ann. Statist. 25 1563-1594.
26. CHEN, M.-H., SHAO, Q.-M. and IBRAHIM, J. G. (2000). Monte Carlo Methods in Bayesian Computation. Springer, New York.
27. CHIB, S. (1995). Marginal likelihood from the Gibbs output. J. Amer. Statist. Assoc. 90 1313-1321.
28. CHIB, S. and JELIAZKOV, I. (2001). Marginal likelihood from the Metropolis-Hastings output. J. Amer. Statist. Assoc. 96 270-281.
29. CHIPMAN, H. A. (1996). Bayesian variable selection with related predictors. Canad. J. Statist. 24 17-36.
30. CHIPMAN, H. A., GEORGE, E. I. and MCCULLOCH, R. E. (1998). Bayesian CART model search (with discussion). J. Amer. Statist. Assoc. 93 935-960.
31. CHIPMAN, H. A., GEORGE, E. I. and MCCULLOCH, R. E. (2001), The practical implementation of Bayesian model selection (with discussion). In Model Selection (P. Lahiri, ed.) 65-134. IMS, Beachwood, OH.
32. CHIPMAN, H. A., GEORGE, E. I. and MCCULLOCH, R. E. (2003). Bayesian treed generalized linear models (with discussion). In Bayesian Statistics 7 (J. M. Bernardo, M. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith and M. West, eds.) 85-103. Oxford Univ. Press.
33. CHIPMAN, H. A., KOLACZYK, E. D. and MCCULLOCH, R. E. (1997). Adaptive Bayesian wavelet shrinkage. J. Amer. Statist. Assoc. 92 1413-1421.
34. CLYDE, M. (1999). Bayesian model averaging and model search strategies (with discussion). In Bayesian Statistics 6 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds,) 157-185. Oxford Univ. Press.
35. CLYDE, M. (2001). Discussion of "The practical implementation of Bayesian model selection," by H. A. Chipman, E. I. George and R. E. McCulloch. In Model Selection (P. Lahiri, ed.) 117-124. IMS, Beachwood, OH.
36. CLYDE, M., DESIMONE, H. and PARMIGIANI, G. (1996). Prediction via orthogonalized model mixing. J. Amer. Statist. Assoc. 91 1197-1208.
37. CLYDE, M. and GEORGE, E. I. (2000). Flexible empirical Bayes estimation for wavelets. J. R. Stat. Soc. Ser. B Stat. Methodol. 62 681-698.
38. CLYDE, M., PARMIGIANI, G. and VIDAKOVIC, B. (1998). Multiple shrinkage and subset selection in wavelets. Biometrika 85 391-401.
39. CUI, W. (2002). Variable selection: Empirical Bayes vs. fully Bayes. Ph.D. dissertation, Dept. Management Science and Information Systems, Univ. Texas, Austin.
40. DAWID, A. and LAURITZEN, S. (2001). Compatible prior distributions. In Bayesian Methods with Applications to Science, Policy, and Official Statistics, Selected Papers from ISBA 2000: The Sixth World Meeting of the International Society for Bayesian Analysis (E. I. George, ed,) 109-118. Eurostat, Luxembourg.
41. DELLAPORTAS, P. and FORSTER, J. J. (1999). Markov chain Monte Carlo model determination for hierarchical and graphical log-linear models. Biometrika 86 615-633.
42. DELLAPORTAS, P., FORSTER, J. J. and NTZOUFRAS, I. (2002). On Bayesian model and variable selection using MCMC. Statist. Comput. 12 27-36.
43. DELLAPORTAS, P., GIUDICI, P. and ROBERTS, G. (2003). Bayesian inference for nondecomposable graphical Gaussian models. Sankhȳa Ser. A. 65 43-55.
44. DEMPSTER, A. M. (1972). Covariance selection. Biometrics 28 157-175.
45. DENISON, D. G. T., HOLMES, C., MALLICK, B. K. and SMITH, A. F. M. (2002). Bayesian Methods for Nonlinear Classification and Regression. Wiley, New York.
46. DENISON, D. G. T., MALLICK, B. K. and SMITH, A. F. M. (1998a). Automatic Bayesian curve fitting. J. R. Stat. Soc. Ser. B Stat. Methodol. 60 333-350.
47. DENISON, D. G. T., MALLICK, B. K. and SMITH, A. F. M. (1998b). A Bayesian CART algorithm. Biometrika 85 363-377.
48. DENISON, D. G. T., MALLICK, B. K. and SMITH, A. F. M. (1998c). Bayesian MARS. Statist. Comput. 8 337-346.
49. DICICCIO, T. J., KASS, R. E., RAFTERY, A. and WASSERMAN, L. (1997). Computing Bayes factors by combining simulation and asymptotic approximations. J. Amer. Statist. Assoc. 92 903-915.
50. DRAPER, D. (1995). Assessment and propagation of model uncertainty (with discussion). J. Roy. Statist. Soc. Ser. B 57 45-97.
51. DRAPER, D. and FOUSKAKIS, D. (2000). A case study of stochastic optimization in health policy: Problem formulation and preliminary results. J. Global Optimization 18 399-416.
52. DUPUIS, J. A. and ROBERT, C. P. (2003). Variable selection in qualitative models via an entropic explanatory power. J. Statist. Plann. Inference 111 77-94.
53. FERÁNDEZ, C., LEY, E. and STEEL, M. F. (2001). Benchmark priors for Bayesian model averaging. J. Econometrics 100 381-427.
54. FOSTER, D. P. and GEORGE, E. I. (1994). The risk inflation criterion for multiple regression. Ann. Statist. 22 1947-1975.
55. FURNIVAL, G. M. and WILSON, R. W., JR. (1974). Regression by leaps and bounds. Technometrics 16 499-511.
56. GEISSER, S. (1993). Predictive Inference. An Introduction. Chapman and Hall, London.
57. GELFAND, A. E., DEY, D. K. and CHANG, H. (1992). Model determination using predictive distributions, with implementation via sampling-based methods (with discussion). In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 147-167. Oxford Univ. Press.
58. GELFAND, A. E. and GHOSH, S. K. (1998). Model choice: A minimum posterior predictive loss approach. Biometrika 85 1-11.
59. GELFAND, A. E. and SMITH, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. J. Amer. Statist. Assoc. 85 398-409.
60. GELMAN, A. and MENG, X.-L. (1998). Simulating normalizing constants: From importance sampling to bridge sampling to path sampling. Statist. Sci. 13 163-185.
61. GEORGE, E. I. (1999). Discussion of "Bayesian model averaging and model search strategies," by M. Clyde. In Bayesian Statistics 6 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 175-177. Oxford Univ. Press.
62. GEORGE, E. I. (2000). The variable selection problem. J. Amer. Statist. Assoc. 95 1304-1308.
63. GEORGE, E. I. and FOSTER, D. P. (2000). Calibration and empirical Bayes variable selection. Biometrika 87 731-747.
64. GEORGE, E. I. and MCCULLOCH, R. E. (1993). Variable selection via Gibbs sampling. J. Amer. Statist. Assoc. 88 881-889.
65. GEORGE, E. I. and MCCULLOCH, R. E. (1997). Approaches for Bayesian variable selection. Statist. Sinica 7 339-374.
66. GEORGE, E. I., MCCULLOCH, R. and TSAY, R. (1996). Two approaches to Bayesian model selection with applications. In Bayesian Analysis in Statistics and Econometrics: Essays in Honor of Arnold Zellner (D. Berry, K. Chaloner and J. Geweke, eds.) 339-348. Wiley, New York.
67. GEWEKE, J. (1996). Variable selection and model comparison in regression. In Bayesian Statistics 5 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 609-620. Oxford Univ. Press.
68. GIUDICI, P. and GREEN, P. J. (1999). Decomposable graphical Gaussian model determination. Biometrika 86 785-801.
69. GODSILL, S. J. (2001). On the relationship between Markov chain Monte Carlo methods for model uncertainty. J. Comput. Graph. Statist. 10 230-248.
70. GREEN, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82 711-732.
71. GREEN, P. J. (2003). Trans-dimensional Markov chain Monte Carlo. In Highly Structured Stochastic Systems (P. J. Green, N. L. Hjort and S. Richardson, eds.) 179-206. Oxford Univ. Press.
72. HAN, C. and CARLIN, B. P. (2001). Markov chain Monte Carlo methods for computing Bayes factors: A comparative review. J. Amer. Statist. Assoc. 96 1122-1132.
73. HANSEN, M. H. and KOOPERBERG, C. (2002). Spline adaptation in extended linear models (with discussion). Statist. Sci. 17 2-51.
74. HANSEN, M. H. and YU, B. (2001). Model selection and the principle of minimum description length. J. Amer. Statist. Assoc. 96 746-774.
75. HODGES, J. S. (1987). Uncertainty, policy analysis and statistics (with discussion). Statist. Sci. 2 259-275.
76. HOETING, J. A., MADIGAN, D., RAFTERY, A. E. and VOLINSKY, C. T. (1999). Bayesian model averaging: A tutorial (with discussion). Statist. Sci. 14 382-417. (Corrected version available at http://www.stat.washington. edu/www/research/online/hoeting1999.pdf.)
77. HOETING, J. A., RAFTERY, A. E. and MADIGAN, D. (2002). Bayesian variable and transformation selection in linear regression. J. Comput. Graph. Statist. 11 485-507.
78. IBRAHIM, J. G., CHEN, M.-H. and MACEACHERN, S. N. (1999). Bayesian variable selection for proportional hazards models. Canad. J. Statist. 27 701-717.
79. IBRAHIM, J. G., CHEN, M.-H. and RYAN, L. M. (2000). Bayesian variable selection for time series count data. Statist. Sinica 10 971-987.
80. JOHNSTONE, I. and SILVERMAN, B. (2004). Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences. Ann. Statist. 32 1594-1649.
81. JORDAN, M. I. (2004). Graphical models. Statist. Sci. 19 140-155.
82. KASS, R. E. and RAFTERY, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90 773-795.
83. KEY, J. T., PERICCHI, L. R. and SMITH, A. F. M. (1999). Bayesian model choice: What and why? In Bayesian Statistics 6 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 343-370. Oxford Univ. Press.
84. KOHN, R., MARRON, J. S. and YAU, P. (2000). Wavelet estimation using Bayesian basis selection and basis averaging. Statist. Sinica 10 109-128.
85. LEAMER, E. E. (1978a). Regression selection strategies and revealed priors. J. Amer. Statist. Assoc. 73 580-587.
86. LEAMER, E. E. (1978b). Specification Searches: Ad Hoc Inference with Nonexperimental Data. Wiley, New York.
87. LEWIS, S. M. and RAFTERY, A. E. (1997). Estimating Bayes factors via posterior simulation with the Laplace-Metropolis estimator. J. Amer. Statist. Assoc. 92 648-655.
88. LIANG, F., PAULO, R., MOLINA, G., CLYDE, M. and BERGER, J. (2003). Gaussian hyper-geometric and other mixtures of g-priors for Bayesian variable selection. Technical report, Statistical and Applied Mathematical Sciences Inst, Research Triangle Park, NC.
89. LIANG, F., TRUONG, Y. and WONG, W. H. (2001). Automatic Bayesian model averaging for linear regression and applications in Bayesian curve fitting. Statist, Sinica 11 1005-1029.
90. LlNDLEY, D. V. (1968). The choice of variables in multiple regression (with discussion). J. Roy. Statist. Soc. Ser. B 30 31-66.
91. MADIGAN, D. and RAFTERY, A. E. (1994). Model selection and accounting for model uncertainty in graphical models using Occam's window. J. Amer. Statist. Assoc. 89 1535-1546.
92. MADIGAN, D. and YORK, J. (1995). Bayesian graphical models for discrete data. Internat. Statist. Rev. 63 215-232.
93. MARRIOTT, J. M., SPENCER, N. M. and PETTITT, A. N. (2001). A Bayesian approach to selecting covariates for prediction. Scand. J. Statist. 28 87-97.
94. MCCULLAGH, P. and NELDER, J. A. (1989). Generalized Linear Models, 2nd ed. Chapman and Hall, London.
95. MENG, X.-L. and WONG, W. H. (1996). Simulating ratios of normalizing constants via a simple identity: A theoretical exploration. Statist. Sinica 6 831-860.
96. MILLER, A. J. (2002). Subset Selection in Regression, 2nd ed. Chapman and Hall, London.
97. MITCHELL, T. J. and BEAUCHAMP, J. J. (1988). Bayesian variable selection in linear regression (with discussion). J. Amer. Statist. Assoc. 83 1023-1032.
98. MÜLLER, P. and QUINTANA, F. A. (2004). Nonparametric Bayesian data analysis. Statist. Sci. 19 95-110.
99. NTZOUFRAS, I., DELLAPORTAS, P. and FORSTER, J. J. (2003). Bayesian variable and link determination for generalised linear models. J. Statist. Plann. Inference 111 165-180.
100. NTZOUFRAS, I., FORSTER, J. J. and DELLAPORTAS, P. (2000). Stochastic search variable selection for log-linear models. J. Statist. Comput. Simulation 68 23-37.
101. O'HAGAN, A. (1995). Fractional Bayes factors for model comparison (with discussion). J. Roy. Statist. Soc. Ser. B 57 99-138.
102. PAULER, D. K. (1998). The Schwarz criterion and related methods for normal linear models. Biometrika 85 13-27.
103. PAULER, D. K., WAKEFIELD, J. C. and KASS, R. E. (1999). Bayes factors and approximations for variance component models. J. Amer. Statist. Assoc. 94 1242-1253.
104. PÉREZ, J. and BERGER, J. O. (2000). Expected posterior prior distributions for model selection. Technical Report 00-08, Institute of Statistics and Decision Sciences, Duke Univ.
105. RAFTERY, A. E. (1996). Approximate Bayes factors and accounting for model uncertainty in generalised linear models. Biometrika 83 251-266.
106. RAFTERY, A. E., MADIGAN, D. and HOETING, J. A. (1997). Bayesian model averaging for linear regression models. J. Amer. Statist. Assoc. 92 179-191.
107. RAFTERY, A. E., MADIGAN, D. and VOLINSKY, C. T. (1996). Accounting for model uncertainty in survival analysis improves predictive performance. In Bayesian Statistics 5 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 323-349. Oxford Univ. Press.
108. ROVERATO, A. (2002). Hyper inverse Wishart distribution for non-decomposable graphs and its application to Bayesian inference for Gaussian graphical models. Scand. J. Statist. 29 391-411.
109. SAN MARTINI, A. and SPEZZAFERRI, F. (1984). A predictive model selection criterion. J. Roy. Statist. Soc. Ser. B 46 296-303.
110. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461-464.
111. SHIVELY, T. S., KOHN, R. and WOOD, S. (1999). Variable selection and function estimation in additive nonparametric regression using a data-based prior (with discussion). J. Amer. Statist. Assoc. 94 777-806.
112. SMITH, A. F. M. and ROBERTS, G. O. (1993). Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods (with discussion). J. Roy. Statist. Soc. Ser. B 55 3-23.
113. SMITH, M. and KOHN, R. (1996). Nonparametric regression using Bayesian variable selection. J. Econometrics 75 317-343.
114. SMITH, M. and KOHN, R. (1997). A Bayesian approach to nonparametric bivariate regression. J. Amer. Statist. Assoc. 92 1522-1535.
115. SMITH, M. and KOHN, R. (2002). Parsimonious covariance matrix estimation for longitudinal data. J. Amer. Statist. Assoc. 97 1141-1153.
116. STEWART, L. and DAVIS, W. W. (1986). Bayesian posterior distributions over sets of possible models with inferences computed by Monte Carlo integration. The Statistician 35 175-182.
117. STRAWDERMAN, W. E. (1971). Proper Bayes minimax estimators of the multivariate normal mean. Ann. Math. Statist. 42 385-388.
118. TIERNEY, L. (1994). Markov chains for exploring posterior distributions (with discussion). Ann. Statist. 22 1701-1728.
119. TIERNEY, L. and KADANE, J. (1986). Accurate approximations for posterior moments and marginal densities. J. Amer. Statist. Assoc. 81 82-86.
120. VERDINELLI, I. and WASSERMAN, L. (1995). Computing Bayes factors using a generalization of the Savage-Dickey density ratio. J. Amer. Statist. Assoc. 90 614-618.
121. VOLINSKY, C. T., MADIGAN, D., RAFTERY, A. E. and KRONMAL, R. A. (1997). Bayesian model averaging in proportional hazard models: Assessing the risk of a stroke. Appl. Statist. 46 433-448.
122. WAKEFIELD, J. and BENNETT, J. (1996). The Bayesian modeling of covariates for population pharmacokinetic models. J. Amer. Statist. Assoc. 91 917-927.
123. WANG, X. (2002). Bayesian variable selection for generalized linear models. Ph.D. dissertation, Dept. Management Science and Information Systems, Univ. Texas, Austin.
124. WOLFE, P. J., GODSILL, S. J. and NG, W.-J. (2004). Bayesian variable selection and regularisation for time-frequency surface estimation. J. R. Stat. Soc. Ser B Stat. Methodol. To appear.
125. WONG, F., CARTER, C. and KOHN, R. (2003). Efficient estimation of covariance selection models. Biometrika 90 809-830.
126. WOOD, S. and KOHN, R. (1998). A Bayesian approach to robust binary nonparametric regression. J. Amer. Statist. Assoc. 93 203-213.
127. WOOD, S., KOHN, R., SHIVELY, T. and JIANG, W. (2002). Model selection in spline nonparametric regression. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 119-139.
128. ZELLNER, A. (1984). Posterior odds ratios for regression hypotheses: General considerations and some specific results. In Basic Issues in Econometrics (A. Zellner, ed.) 275-305. Univ. Chicago Press.
129. ZELLNER, A. (1986). On assessing prior distributions and Bayesian regression analysis with g-prior distributions. In Bayesian Inference and Decision Techniques: Essays in Honor of Bruno de Finetti (P. K. Goel and A. Zellner, eds.) 233-243. North-Holland, Amsterdam.
130. ZELLNER, A. and Slow, A. (1980). Posterior odds ratios for selected regression hypotheses. In Bayesian Statistics. Proceedings of the First Valencia International Meeting Held in Valencia (Spain) (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 585-603. Valencia Univ. Press.