Model Selection and Hypothesis Testing based on Objective Probabilities and Bayes Factors

Handbook of Statistics

Volumn 25, Issue , 2005, Pages 115-149

  Pericchi, Luis Raúl ^a  

^a NONE

Author keywords

Bayes factors; Bayesian information criterion (BIC); Bayesian model selection; conventional priors; expected posterior priors; fractional Bayes factors; intrinsic Bayes factors; intrinsic priors; training samples; universal lower bound; well calibrated priors

Indexed keywords

EID: 67649371494     PISSN: 01697161     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0169-7161(05)25004-6     Document Type: Review

References (70)

1. Aitkin M. Posterior Bayes factors (with discussion). J. Roy. Statist. Soc., Ser. B 53 (1991) 111-142
2. Araújo, M.I., Pereira, B.B. (2003). A comparison among Bayes factors for separated models: Some simulation results. Elsevier Preprint
3. Barbieri M., and Berger J. Optimal predictive variable selection. Ann. Statist. 32 3 (2004) (In press)
4. Bayarri M.J., and Berger J.O. Quantifying surprise in the data and model verification. In: Bernardo J.M., et al. (Ed). Bayesian Statistics, vol. 6 (1998), Oxford University Press 53-82
5. Berger J. Bayes factors. In: Kotz S., et al. (Ed). Encyclopedia of Statistical Sciences, Update Volume 3 (1999), Wiley, New York 20-29
6. Berger J. Could Fisher, Jeffreys and Neyman have agreed on testing? (with discussion). Statist. Sci. 18 1 (2003) 1-32
7. Berger J., and Bernardo J.M. On the development of the reference prior method. In: Bernardo J.M., et al. (Ed). Bayesian Statistics, vol. IV (1992), Oxford University Press, London 35-60
8. Berger J., and Pericchi L. The intrinsic Bayes factor for model selection and prediction. J. Amer. Statist. Assoc. 91 (1996) 109-122
9. Berger J., and Pericchi L. The intrinsic Bayes factor for linear models. In: Bernardo J.M., et al. (Ed). Bayesian Statistics, vol. 5 (1996), Oxford University Press, London 23-42
10. Berger J., and Pericchi L. On the justification of default and intrinsic Bayes factors. In: Lee J.C., et al. (Ed). Modeling and Prediction (1997), Springer-Verlag, New York 276-293
11. Berger J., and Pericchi L. Accurate and stable Bayesian model selection: The median intrinsic Bayes factor. Sankya B 60 (1998) 1-18
12. Berger J., and Pericchi L. Objective Bayesian model methods for model selection: Introduction and comparison (with discussion). In: Lahiri P. (Ed). IMS Lecture Notes - Monograph Series vol. 38 (2001) 135-207
13. Berger J., and Pericchi L. Training samples in objective Bayesian model selection. Ann. Statist. 32 3 (2004) 841-869
14. Berger J., and Sellke T. Testing a point null hypothesis: The irreconcilability of P-values and evidence. J. Amer. Statist. Assoc. 82 (1987) 112-122
15. Berger J., Pericchi L., and Varshavsky J. Bayes factors and marginal distributions in invariant situations. Sankya A 60 (1998) 307-321
16. Berger J., Ghosh J.K., and Mukhopadhyay N. Approximations and consistency of Bayes factors as model dimension grows. J. Statist. Plann. Inference 112 (2003) 241-258
17. Bernardo J.M., and Smith A.F.M. Bayesian Theory (1994), Wiley, Chichester
18. Casella, G., Moreno, E. (2002). Objective Bayesian variable selection. Tech. Report, University of Florida, Department of Statistics
19. Chen, M.H., Shao, Q.M., Ibrahim, J.G. (2000). Monte Carlo Methods in Bayesian Computation. Springer Series in Statistics
20. Chipman H., George E.I., and McCulloch R.E. The practical implementation of Bayesian model selection (with discussion). In: Lahiri P. (Ed). IMS Lecture Notes - Monograph Series, vol. 38 (2001) 65-134
21. Clyde M., and George E.I. Flexible empirical Bayes estimation for wavelets. J. Roy. Statist. Soc., Ser. B 62 (2000) 681-698
22. Cox D.R. Tests of separate families of hypotheses. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1 (1961), University of California Press, Berkeley 105-123
23. Cox D.R., and Hinkley D.V. Theoretical Statistics (1974), Chapman and Hall, London
24. De Santis, F., Spezzaferri, F. (1996). Comparing hierarchical models using Bayes factor and fractional Bayes factors: A robust analysis. In: Berger, J., et al. (Eds.), Bayesian Robustness, vol. 29. IMS Lecture Notes, Hayward
25. De Santis F., and Spezzaferri F. Alternative Bayes factors for model selection. Canad. J. Statist. 25 (1997) 503-515
26. De Santis, F., Spezzaferri, F. (1998a). Consistent fractional Bayes factor for linear models. Pubblicazioni Scientifiche del Dipartimento di Statistica, Probab. e Stat. Appl., Serie a, n. 19, Univ. di Roma "La Sapienza"
27. De Santis F., and Spezzaferri F. Bayes factors and hierarchical models. J. Statist. Plann. Inference 74 (1998) 323-342
28. De Santis F., and Spezzaferri F. Methods for robust and default Bayesian model selection: The fractional Bayes factor approach. Internat. Statist. Rev. 67 (1999) 1-20
29. Dmochowski J. Intrinsic priors via Kullback-Leibler geometry. In: Bernardo J.M., et al. (Ed). Bayesian Statistics, vol. 5 (1996), Oxford University Press, London 543-549
30. Dudley R., and Haughton D. Information criteria for multiple data sets and restricted parameters. Statistica Sinica 7 (1997) 265-284
31. Findley D.F. Counterexamples to parsimony and BIC. Ann. Inst. Statist. Math. 43 (1991) 505-514
32. Gelfand A.E., and Dey D.K. Bayesian model choice: Asymptotics and exact calculations. J. Roy. Statist. Soc., Ser. B 56 (1994) 501-514
33. George E.I., and Foster D.P. Empirical Bayes variable selection. Biometrika 87 (2000) 731-747
34. Ghosh J.K., and Samanta T. Nonsubjective Bayesian testing - an overview. J. Statist. Plann. Inference 103 1 (2002) 205-223
35. Good I.J. Probability and the Weighing of Evidence (1950), Haffner, New York
36. Good I.J. Weight of evidence: A brief survey. In: Bernardo J.M., DeGroot M., Lindley D., and Smith A.F.M. (Eds). Bayesian Statistics, vol. 2 (1985), North-Holland, Amsterdam 249-270
37. Haughton D. On the choice of a model to fit data from an exponential family. Ann. Statist. 16 (1988) 342-355
38. Holmes S., Morris C., and Tibshirani R. Bradley Efron: A conversation with good friends. Statist. Sci. 18 2 (2003) 268-281
39. Jeffreys H. Theory of Probability (1961), Oxford University Press, London
40. Kass R.E., and Raftery A. Bayes factors. J. Amer. Statist. Assoc. 90 (1995) 773-795
41. Kass R.E., and Vaidyanathan S.K. Approximate Bayes factors and orthogonal parameters, with application to testing equality of two binomial proportions. J. Roy. Statist. Soc. 54 (1992) 129-144
42. Kass R.E., and Wasserman L. A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. J. Amer. Statist. Assoc. 90 (1995) 928-934
43. Key J.T., Pericchi L.R., and Smith A.F.M. Bayesian model choice: What and why?. In: Bernardo J.M., et al. (Ed). Bayesian Statistics, vol. 6 (1999), Oxford University Press 343-370
44. Kim S., and Sun D. Intrinsic priors for model selection using an encompassing model. Life Time Data Anal. 6 (2000) 251-269
45. Lempers F.B. Posterior Probabilities of Alternative Linear Models (1971), University of Rotterdam Press, Rotterdam
46. Lingham R., and Sivaganesan S. Testing hypotheses about the power law process under failure truncation using intrinsic Bayes factors. Ann. Inst. Statist. Math. 49 (1997) 693-710
47. Lingham R., and Sivaganesan S. Intrinsic Bayes factor approach to a test for the power law process. J. Statist. Plann. Inference 77 (1999) 195-220
48. Moreno E., Bertolino F., and Racugno W. An intrinsic limiting procedure for model selection and hypothesis testing. J. Amer. Statist. Assoc. 93 (1998) 1451-1460
49. Nadal, N., (1999). El análisis de varianza basado en los factores de Bayes intrínsecos. Ph.D. thesis, Universidad Simón Bolívar, Venezuela
50. Neal, R. (2001). Transferring prior information between models using imaginary data. Tech. Report 0108, Dept. Statistics, Univ. Toronto
51. O'Hagan A. Fractional Bayes factors for model comparisons. J. Roy. Statist. Soc., Ser. B 57 (1995) 99-138
52. O'Hagan A. Properties of intrinsic and fractional Bayes factors. Test 6 (1997) 101-118
53. Pauler D. The Schwarz criterion and related methods for normal linear models. Biometrika 85 1 (1998) 13-27
54. Pérez, J.M. (1998). Development of conventional prior distributions for model comparisons. Ph.D. thesis, Purdue University
55. Pérez J.M., and Berger J. Expected posterior prior distributions for model selection. Biometrika 89 (2002) 491-512
56. Pericchi, L.R. (2005). Approximations and synthesis of Bayes factors. II Congreso Bayesiano Latinoamericano, Cobal II, San Juan de los Cabos, Baja California, Feb. 6-11, 2005
57. Pericchi L.R., and Pérez M.E. Posterior robustness with more than one sampling model. J. Statist. Plann. Inference 40 (1994) 279-294
58. Raftery A.E., Madigan D., and Volinsky C.T. Accounting for model uncertainty in survival analysis improves predictive performance. In: Bernardo J.M., et al. (Ed). Bayesian Statistics, vol. 5 (1996), Oxford University Press, London 323-349
59. Rodríguez A., and Pericchi L.R. Intrinsic Bayes factors for dynamic linear models. In: George E., and Nanopoulos P. (Eds). Bayesian Methods, with Applications to Science, Policy and Official Statistics (2001), Eurostat, Luxembourg 459-468
60. Sansó, B., Pericchi, L.R., Moreno, E. (1996). On the robustness of the intrinsic Bayes factor for nested models. In: Berger, J., et al. (Eds.), Bayesian Robustness, IMS Lecture Notes, vol. 29. Hayward, pp. 157-176
61. Schluter, P.J., Deely, J.J., Nicholson, A.J. (1999). The averaged Bayes factor: A new method for selecting between competing models. Technical Report, University of Canterbury
62. Schwarz G. Estimating the dimension of a model. Ann. Statist. 6 (1978) 461-464
63. Sellke T., Bayarri M.J., and Berger J. Calibration of P-values for testing precise null hypotheses. Amer. Statist. 55 (2001) 62-71
64. Shively T.S., Kohn R., and Wood S. Variable selection and function estimation in additive nonparametric regression using a data-based prior (with discussion). J. Amer. Statist. Assoc. 94 (1999) 777-806
65. Spiegelhalter D.J. A test for normality against symmetric alternatives. Biometrika 68 2 (1977) 415-418
66. Spiegelhalter D.J., and Smith A.F.M. Bayes factors for linear and log-linear models with vague prior information. J. Roy. Statist. Soc., Ser. B 44 (1982) 377-387
67. Stone M. Comments on model selection criteria of Akaike and Schwarz. J. Roy. Statist. Soc., Ser. B 41 (1979) 276-278
68. Yang, Ch. (2003). Objective Bayesian training sample based model selection methodologies with application to microarray data analysis. M.Sc. thesis, University of Puerto Rico, Department of Mathematics
69. Zellner A. On assessing prior distributions and Bayesian regression analysis with g-prior distributions. In: Goel P.K., and Zellner A. (Eds). Bayesian Inference and Decision Techniques: Essays in Honor of Bruno de Finetti (1986), North-Holland, Amsterdam 233-243
70. Zellner A., and Siow. Posterior odds for selected regression hypotheses. In: Bernardo J.M., et al. (Ed). Bayesian Statistics, vol. 1 (1980), Valencia University Press, Valencia 585-603