Bayesian model averaging: A tutorial

Statistical Science

Volumn 14, Issue 4, 1999, Pages 382-401

  Hoeting, Jennifer A ^a   Madigan, David ^b   Raftery, Adrian E ^c   Volinsky, Chris T ^b  

^a Veterinary Dentistry and Oral Surgery   (United States)

^b AT AND T LABS RESEARCH   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Bayesian graphical models; Bayesian model averaging; Learning; Markov chain Monte Carlo; Model uncertainty

Indexed keywords

EID: 0001259111     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/ss/1009212519     Document Type: Article

References (98)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In Second International Symposium on Information Theory (B. Petrox and F. Caski, eds.) 267.
2. Barnard, G. A. (1963). New methods of quality control. J. Roy. Statist. Soc. Ser. A 126 255.
3. Bates, J. M. and Granger, C. W. J. (1969). The combination of forecasts. Operational Research Quarterly 20 451-468.
4. Berger, J. O. and Delampady, M. (1987). Testing precise hypotheses. Statist. Sci. 2 317-352.
5. Berger, J. O. and Sellke, T. (1987). Testing a point null hypothesis (with discussion). J. Amer. Statist. Assoc. 82 112-122.
6. Bernardo, J. and Smith, A. (1994). Bayesian Theory. Wiley, Chichester.
7. Besag, J. E., Green, p., Higdon, D. and Mengerson, K. (1995). Bayesian computation and stochastic systems. Statist. Sci. 10 3-66.
8. Breiman, L. (1996). Bagging predictors. Machine Learning 26 123-140.
9. Breiman, L. and Friedman, J. H. (1985). Estimating optimal transformations for multiple regression and correlation (with discussion). J. Amer. Statist. Assoc. 80 580-619.
10. Brozek, J., Grande, F., Anderson, J. and Keys, A. (1963). Den-sitometric analysis of body composition: revision of some quantitative assumptions. Ann. New York Acad. Sci. 110 113-140.
11. Buckland, S. T., Burnham, K. P. and Augustin, N. H. (1997). Model selection: an integral part of inference. Biometrics 53 275-290.
12. Buntine, W. (1992). Learning classification trees. Statist. Com-put. 2 63-73.
13. Carlin, B. P. and Chib, S. (1993). Bayesian model choice via Markov chain Monte Carlo. J. Roy. Statist. Soc. Ser. B 55 473-484.
14. Carlin, B. P. and Polson, N. G. (1991). Inference for nonconjugate Bayesian models using the Gibbs sampler. Canad. J. Statist. 19 399-405.
15. Chan, P. K. and Stolfo, S. J. (1996). On the accuracy of metalearning for scalable data mining. J. Intelligent Integration of Information 8 5-28.
16. Chatfield, C. (1995). Model uncertainty, data mining, and statistical inference (with discussion). J. Roy. Statist. Soc. Ser. A 158 419-466.
17. Chib, S. and Greenberg, E. (1995). Understanding the Metropolis-Hastings algorithm. Amer. Statist. 40 327-335.
18. Clemen, R. T. (1989). Combining forecasts: a review and annotated bibliography. Internat. J. Forecasting 5 559-583.
19. Clyde, M., DeSimone, H. and Parmigiani, G. (1996). Prediction via orthoganalized model mixing. J. Amer. Statist. Assoc. 91 1197-1208.
20. Cox, D. R. (1972). Regression models and life tables (with discussion). J. Roy. Statist. Soc. Ser. B 34 187-220.
21. Dawid, A. P. (1984). Statistical theory: the prequential approach. J Roy. Statist. Soc. Ser. A 147 278-292.
22. Dickinson, J. P. (1973). Some statistical results on the combination of forecasts. Operational Research Quarterly 24 253-260.
23. Dijkstra, T. K. (1988). On Model Uncertainty and Its Statistical Implications. Springer, Berlin.
24. Draper, D. (1995). Assessment and propagation of model uncertainty. J. Roy. Statist. Soc. Ser. B 57 45-97.
25. Draper, D., Gaver, D. p., Goel, P. K., Greenhouse, J. B., Hedges, L. V., Morris, C. N., Tucker, J. and Waternaux, C. (1993). Combining information: National Research Council Panel on Statistical Issues and Opportunities for Research in the Combination of Information. National Academy Press, Washington, DC.
26. Draper, D., Hodges, J. S., Leamer, E. E., Morris, C. N. and Rubin, D. B. (1987). A research agenda for assessment and propagation of model uncertainty. Technical Report Rand Note N-2683-RC, RAND Corporation, Santa Monica, California.
27. Edwards, W., Lindman, H. and Savage, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review 70 193-242.
28. Fernandez, C., Ley, E. and Steel, M. F. (1997). Statistical modeling of fishing activities in the North Atlantic. Technical report, Dept. Econometrics, Tilburg Univ., The Netherlands.
29. Fernandez, C., Ley, E. and Steel, M. F. (1998). Benchmark priors for Bayesian model averaging. Technical report, Dept. Econometrics, Tilburg Univ., The Netherlands.
30. Fleming, T. R. and Harrington, D. H. (1991). Counting Processes and Survival Analysis. Wiley, New York.
31. Freedman, D. a., Navidi, W. and Peters, S. C. (1988). On the impact of variable selection in fitting regression equations. In On Model Uncertainty and Its Statistical Implications (T. K. Dijkstra, ed.) 1-16. Springer, Berlin.
32. FREUND, Y. (1995). Boosting a weak learning algorithm by majority. Inform. and Comput. 121 256-285.
33. Fried, L. P., Borhani, N. O., Enright, P., Furberg, C. D., Gardin, J. M., Kronmal, R. A., Kuller, L. H., Manolio, T. A, Mittelmark, M. B, Newman, A, O’Leary, D. H, Psaty, B, Rautaharju, P, Tracy, R. P. and Weiler, P. G. (1991). The cardiovascular health study: design and rationale. Annals of Epidemiology 1 263-276.
34. Furnival, G. M. and Wilson, R. W. (1974). Regression by leaps and bounds. Technometrics 16 499-511.
35. Geisser, S. (1980). Discussion on sampling and Bayes’ inference in scientific modeling and robustness (by GEPB). J. Roy. Statist. Soc. Ser. A 143 416-417.
36. George, E. and McCulloch, R. (1993). Variable selection via Gibbs sampling. J. Amer. Statist. Assoc. 88 881-889.
37. George, E. I. (1986a). Combining minimax shrinkage estimators. J. Amer. Statist. Assoc. 81 437-445.
38. George, E. I. (1986b). A formal Bayes multiple shrinkage estimator. Commun. Statist. Theory Methods (SpecialIssue on Stein-type multivariate estimation) 15 2099-2114.
39. George, E. I. (1986c). Minimax multiple shrinkage estimation. Ann. Statist. 14 188-205.
40. George, E. I. (1999). Bayesian model selection. In Encyclopedia of Statistical Sciences Update 3. Wiley, New York. To appear.
41. Good, I. J. (1950). Probability and the weighing of evidence. Griffin, London.
42. Good, I. J. (1952). Rational decisions. J. Roy. Statist. Soc. Ser. B 14 107-114.
43. Grambsch, P. M., Dickson, E. R., Kaplan, M., LeSage, G., Fleming, T. R. and Langworthy, A. L. (1989). Extramural crossvalidation of the Mayo primary biliary cirrhosis survival model establishes its generalizability. Hepatology 10 846-850.
44. Green, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82 711-732.
45. Heckerman, D., Geiger, D. and Chickering, D. M. (1994). Learning Bayesian networks: the combination of knowledge and statistical data. In Uncertainty in Artificial Intelligence, Proceedings of the Tenth Conference (B. L. de Mantaras and D. Poole, eds.) 293-301. Morgan Kaufman, San Francisco.
46. Hodges, J. S. (1987). Uncertainty, policy analysis, and statistics. Statist. Sci. 2 259-291.
47. Hoeting, J. A. (1994). Accounting for model uncertainty in linear regression. Ph.D. dissertation, Univ. Washington, Seattle.
48. Hoeting, J. A., Raftery, A. E. and Madigan, D. (1996). A method for simultaneous variable selection and outlier identification in linear regression. J. Comput. Statist. 22 251-271.
49. Hoeting, J. A., Raftery, A. E. and Madigan, D. (1999). Bayesian simultaneous variable and transformation selection in linear regression. Technical Report 9905, Dept. Statistics, Colorado State Univ. Available at www.stat.colostate.edu.
50. Ibrahim, J. G. and Laud, P. W. (1994). A predictive approach to the analysis of designed experiments. J. Amer. Statist. Assoc. 89 309-319.
51. Johnson, R. W. (1996). Fitting percentage of body fat to simple body measurements. J. Statistics Education 4.
52. Kass, R. E. and Raftery, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc. 90 773-795.
53. Kass, R. E. and Wasserman, L. (1995). A reference Bayesian test for nested hypotheses with large samples. J. Amer. Statist. Assoc. 90 928-934.
54. KATCH, F. and McARDLE, W. (1993). Nutrition, Weight Control, and Exercise, 4th ed. Williams and Wilkins, Philadelphia.
55. Kearns, M. J., SCHAPIRE, R. E. and Sellie, L. M. (1994). Toward efficient agnostic learning. Machine Learning 17 115-142.
56. KINCAID, D. and Cheney, W. (1991). Numerical Analysis. Brooks/Cole, Pacific Grove, CA.
57. Kuk, A. Y. C. (1984). All subsets regression in a proportional hazards model. Biometrika 71 587-592.
58. Kwok, S. and Carter, C. (1990). Multiple decision trees. In Uncertainty in Artificial Intelligence (R. Shachter, T. Levitt, L. Kanal and J. Lemmer, eds.) 4 323-349. North-Holland, Amsterdam.
59. LAURITZEN, S. L. (1996). Graphical Models. Clarendon Press, Oxford.
60. LAURITZEN, S. L., Thiesson, B. and SPIEGELHALTER, D. J. (1994). Diagnostic systems created by model selection methods: a case study. In Uncertainty in Artificial Intelligence (P. Cheeseman and W. Oldford, eds.) 4 143-152. Springer Berlin.
61. LAWLESS, J. and Singhal, K. (1978). Efficient screening of nonnormal regression models. Biometrics 34 318-327.
62. LEAMER, E. E. (1978). Specification Searches. Wiley, New York.
63. LOHMAN, T. (1992). Advance in Body Composition Assessment, Current Issues in Exercise Science. Human Kinetics Publishers, Champaign, IL.
64. Madigan, D., Andersson, S. A., Perlman, M. and Volinsky, C. T. (1996a). Bayesian model averaging and model selection for Markov equivalence classes of acyclic digraphs. Comm. Statist. Theory Methods 25 2493-2520.
65. Madigan, D., Andersson, S. A., Perlman, M. D. and Volinsky, C. T. (1996b). Bayesian model averaging and model selection for Markov equivalence classes of acyclic digraphs. Comm. Statist. Theory Methods 25 2493-2519.
66. Madigan, D., Gavrin, J. and Raftery, A. E. (1995). Elicting prior information to enhance the predictive performance of Bayesian graphical models. Comm. Statist. Theory Methods 24 2271-2292.
67. Madigan, D. and Raftery, A. E. (1991). Model selection and accounting for model uncertainty in graphical models using Occam’s window. Technical Report 213, Univ. Washington, Seattle.
68. MADIGAN, D. and Raftery, A. E. (1994). Model selection and accounting for model uncertainty in graphical models using Occam’s window. J. Amer. Statist. Assoc. 89 1535-1546.
69. Madigan, D., Raftery, A. E., York, J. C., Bradshaw, J. M. and Almond, R. G. (1994). Strategies for graphical model selection. In Selecting Models from Data: Artificial Intelligence and Statistics (P. Cheeseman and W. Oldford, eds.) 4 91-100. Springer, Berlin.
70. MADIGAN, D. and York, J. (1995). Bayesian graphical models for discrete data. Internat. Statist. Rev. 63 215-232.
71. Markus, B. H., Dickson, E. R., Grambsch, P. M., Fleming, T. R., Mazzaferro, V., Klintmalm, g., Weisner, R. H., Van Thiel, D. H. and STARZL, T. E. (1989). Efficacy of liver transplantation in patients with primary biliary cirrhosis. New England J. Medicine 320 1709-1713.
72. MATHEsoN, J. E. and WINKLER, R. L. (1976). Scoring rules for continuous probability distributions. Management Science 22 1087-1096.
73. McCULLAGH, P. and NELDER, J. (1989). Generalized Linear Models, 2nd ed. Chapman &Hall, London.
74. Miller, A. J. (1990). Subset Selection in Regression. Chapman and Hall, London.
75. Penrose, K., Nelson, A. and Fisher, A. (1985). Generalized body composition prediction equation for men using simple measurement techniques (abstract). Medicine and Science in Sports and Exercise 17 189.
76. Philips, D. B. and Smith, A. F. M. (1994). Bayesian model comparison via jump diffusions. Technical Report 94-20, Imperial College, London.
77. Raftery, A. E. (1993). Bayesian model selection in structural equation models. In Testing Structural Equation Models (K. Bollen and J. Long, eds.) 163-180. Sage, Newbury Park, CA.
78. Raftery, A. E. (1995). Bayesian model selection in social research (with discussion). In Sociological Methodology 1995 (P. V. Marsden, ed.) 111-195. Blackwell, Cambridge, MA.
79. Raftery, A. E. (1996). Approximate Bayes factors and accounting for model uncertainty in generalised linear models. Biometrika 83 251-266.
80. Raftery, A. E., Madigan, D. and Hoeting, J. (1997). Bayesian model averaging for linear regression models. J. Amer. Statist. Assoc. 92 179-191.
81. Raftery, A. E., Madigan, D. and Volinsky, C. T. (1996). Accounting for model uncertainty in survival analysis improves predictive performance (with discussion). In Bayesian Statistics 5 (J. Bernardo, J. Berger, A. Dawid and A. Smith, eds.) 323-349. Oxford Univ. Press.
82. Rao, J. S. and Tibshirani, R. (1997). The out-of-bootstrap method for model averaging and selection. Technical report, Dept. Statistics, Univ. Toronto.
83. Regal, R. and Hook, E. B. (1991). The effects of model selection on confidence intervals for the size of a closed population. Statistics in Medicine 10 717-721.
84. Roberts, H. V. (1965). Probabilistic prediction. J. Amer. Statist. Assoc. 60 50-62.
85. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461-46.
86. Smith, A. F. M. and Roberts, G. O. (1993). Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods (with discussion). J. Roy. Statist. Soc. Ser. B 55 3-23.
87. Spiegelhalter, D. J. (1986). Probabilistic prediction in patient management and clinical trials. Statistics in Medicine 5 421-433.
88. Spiegelhalter, D. j., Dawid, a., Lauritzen, S. and Cowell, R. (1993). Bayesian analysis in expert systems (with discussion). Statist. Sci. 8 219-283.
89. Spiegelhalter, D. J. and Lauritzen, S. (1990). Sequential updating of conditional probabilities on directed graphical structures. Networks 20 579-605.
90. Stewart, L. (1987). Hierarchical Bayesian analysis using Monte Carlo integration: computing posterior distributions when there are many possible models. The Statistician 36 211-219.
91. Taplin, R. H. (1993). Robust likelihood calculation for time series. J. Roy. Statist. Soc. Ser. B 55 829-836.
92. Thompson, E. A. and Wijsman, E. M. (1990). Monte Carlo methods for the genetic analysis of complex traits. Technical Report 193, Dept. Statistics, Univ. Washington, Seattle.
93. Tierney, L. and Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities. J. Amer. Statist. Assoc. 81 82-86.
94. Volinsky, C. T. (1997). Bayesian model averaging for censored survival models. Ph.D. dissertation, Univ. Washington, Seattle.
95. Volinsky, C. T., Madigan, D., Raftery, A. E. and Kronmal, R. A. (1997). Bayesian model averaging in proportional hazard models: assessing the risk of a stroke. J. Roy. Statist. Soc. Ser. C 46 433-448.
96. Weisberg, S. (1985). Applied Linear Regression, 2nd ed. Wiley, New York.
97. Wolpert, D. H. (1992). Stacked generalization. Neural Networks 5 241-259.
98. York, j., Madigan, D., Heuch, I. and Lie, R. T. (1995). Estimating a proportion of birth defects by double sampling: a Bayesian approach incorporating covariates and model uncertainty. J. Roy. Statist. Soc. Ser. C 44 227-242.