Default priors for Bayesian and frequentist inference

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 72, Issue 5, 2010, Pages 631-654

  Fraser, D A S ^a   Reid, N ^a   Marras, E ^b   Yi, G Y ^c  

^a UNIVERSITY OF TORONTO   (Canada)

^b CENTER FOR ADVANCED STUDIES   (Italy)

^c UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Invariant prior; Jeffreys prior; Likelihood asymptotics; Marginalization paradox; Non informative prior; Nuisance parameter; Objective prior; Subjective prior

Indexed keywords

EID: 80052743539     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2010.00750.x     Document Type: Article

References (51)

1. Barndorff-Nielsen, O. E. (1986) Inference on full or partial parameters based on the standardized signed log likelihood ratio. Biometrika, 73, 307-322.
2. Bayes, T. (1763) An essay towards solving a problem in the doctrine of chances. Phil. Trans. R. Soc. Lond., 53, 370-418; 54, 296-325.
3. Bédard, M., Fraser, D. A. S. and Wong, A. (2007) Higher accuracy for Bayesian and frequentist inference: large sample theory for small sample likelihood. Statist. Sci., 22, 301-321.
4. Berger, J. (2006) The case for objective Bayesian analysis. Baysn Anal., 1, 385-402.
5. Berger, J. and Bernardo, J. (1992) On the development of the reference prior method. In Bayesian Statistics 4 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 35-60. Oxford: Clarendon.
6. Berger, J., Bernardo, J. and Sun, D. (2009) The formal definition of reference priors. Ann. Statist., 37, 905-938.
7. Bernardo, J. M. (1979) Reference posterior distributions for Bayesian inference (with discussion). J. R. Statist. Soc. B, 41, 113-147.
8. Box, G. E. P. and Cox, D. R. (1964) An analysis of transformations (with discussion). J. R. Statist. Soc. B, 26, 211-252.
9. Box, G. and Tiao, G. C. (1973) Bayesian Inference in Statistical Analysis. Reading: Addison-Wesley.
10. Brazzale, A. R., Davison, A. and Reid, N. (2007) Applied Asymptotics. Cambridge: Cambridge University Press.
11. Cakmak, S., Fraser, D. and Reid, N. (1994) Multivariate asymptotic model: exponential and location approximations. Util. Math., 46, 21-31.
12. Casella,G., DiCiccio, T. andWells, M. (1995) Inference based on estimating functions in the presence of nuisance parameters: comment, Alternative aspects of conditional inference. Statist. Sci., 10, 179-185.
13. Clarke, B. (2007) Information optimality and Bayesian modelling. J. Econmetr., 38, 405-429.
14. Clarke, B. and Barron, A. (1994) Jeffreys prior is asymptotically least favorable under entropy risk. J. Statist. Planng Inf., 41, 37-60.
15. Clarke, B. and Yuan, A. (2004) Partial information reference priors: derivation and interpretations. J. Statist. Planng Inf., 123, 313-345.
16. Cox, D. and Hinkley, D. (1974) Theoretical Statistics. London: Chapman and Hall.
17. Datta, G. and Ghosh, M. (1995) Some remarks on noninformative priors. J. Am. Stastist. Ass., 90, 1357-1363.
18. Datta, G. and Mukerjee, R. (2004) Probability Matching Priors: Higher Order Asymptotics. New York: Springer.
19. Davison, A. C., Fraser, D. A. S. and Reid, N. (2006) Improved likelihood inference for discrete data. J. R. Statist. Soc. B, 68, 495-508.
20. Dawid, A. P., Stone, M. and Zidek, J. (1973) Marginalization paradoxes in Bayesian and structural inference (with discussion). J. R. Statist. Soc. B, 35, 189-233.
21. DiCiccio, T. and Martin, M. (1991) Approximations of marginal tail probabilities for a class of smooth functions with applications to Bayesian and conditional inference. Biometrika, 78, 891-902.
22. Eaves, D. (1983) On Bayesian nonlinear regression with an enzyme example. Biometrika, 70, 373-379.
23. Fraser, D. A. S. (1964) Local conditional sufficiency. J. R. Statist. Soc. B, 26, 46-51.
24. Fraser, D. A. S. (1979) Inference and Linear Models. New York: McGraw-Hill.
25. Fraser, D. A. S. (2003) Likelihood for component parameters. Biometrika, 90, 327-339.
26. Fraser, D. A. S. and Reid, N. (1993) Third order asymptotic models: likelihood functions leading to accurate approximations to distribution functions. Statist. Sin., 3, 67-82.
27. Fraser, D. A. S. and Reid, N. (2002) Strong matching of frequentist and Bayesian inference. J. Statist. Planng Inf., 103, 263-285.
28. Fraser, D. A. S., Reid, N. and Wu, J. (1999) A simple general formula for tail probabilities for frequentist and Bayesian inference. Biometrika, 86, 249-264.
29. Fraser, D. A. S. and Sun, Y. (2010) Some corrections for Bayes curvature. Pak. J. Statist., to be published.
30. George, E. and McCulloch, R. (1993) On obtaining invariant prior distributions. J. Statist. Planng Inf., 37, 169-179.
31. Ghosh, J., Chakrabarti, A. and Samanta, T. (2009) Entropies and metrics that lead to Jeffreys and reference priors. Technical Report. Indian Statistical Institute, Calcutta. (Available from http://www-stat.wharton. upenn.edu/statweb/Conference/OBayes09/lectures.htm.) Goldstein, M. (2006) Subjective Bayesian analysis: principles and practice. Baysn Anal., 1, 403-420.
32. Goldstein, M. (2006) Subjective Bayesian analysis: principles and practice. Baysn Anal., 1, 403-420.
33. Jeffreys, H. (1961) Theory of Probability, 3rd edn. Oxford: Oxford University Press.
34. Kass, R. (1990) Data-translated likelihood and Jeffreys's rules. Biometrika, 77, 107-114.
35. Kass, R. and Wasserman, L. (1996) Formal rules for selecting prior distributions: a review and annotated bibliography. J. Am. Statist. Ass., 91, 1343-1370.
36. Lin, X., Sun, D. and Berger, J. (2009) Objective Bayes analysis under semi-invariance structure. University of South Carolina, Columbia. (Available from http://www-stat.wharton.upenn.edu/statweb/ Conference/OBayes09/lectures.htm.) Liseo, B. (1993) Elimination of nuisance parameters with reference priors. Biometrika, 80, 295-304.
37. Liseo, B. (1993) Elimination of nuisance parameters with reference priors. Biometrika, 80, 295-304.
38. Little, R. (2006) Calibrated Bayes: a Bayes/frequentist roadmap. Am. Statistn, 60, 1-11.
39. Peers, H.W. (1965) On confidence points and Bayesian probability points in the case of several parameters. J. R. Statist. Soc. B, 27, 9-16.
40. Pierce, D. and Peters, D. (1994) Higher-order asymptotics and the likelihood principle: one-parameter models. Biometrika, 81, 1-10.
41. Reid, N. (2003) Asymptotics and the theory of inference. Ann. Statist., 31, 1695-1731.
42. Reid, N. and Fraser, D. (2010) Mean log-likelihood and higher order approximation. Biometrika, 97, 159-170.
43. Stein, C. (1959) An example of wide discrepancy between fiducial and confidence intervals. Ann. Math. Statist., 30, 877-880.
44. Stigler, S. M. (1982) Thomas Bayes's Bayesian inference. J. R. Statist. Soc. A, 145, 250-258.
45. Sun, D. and Ye, K. (1996) Frequentist validity of posterior quantiles for a two-parameter exponential family. Biometrika, 83, 55-65.
46. Tibshirani, R. (1989) Noninformative priors for one parameter of many. Biometrika, 76, 705-708.
47. Tierney, L. andKadane, J. (1986) Accurate approximations for posterior moments and marginal densities. J. Am. Statist. Ass., 81, 82-87.
48. Wasserman, L. (2000) Asymptotic inference for mixture models using data-dependent priors. J. R. Statist. Soc. B, 62, 159-180.
49. Welch, B. L. and Peers, H.W. (1963) On formulae for confidence points based in intervals of weighted likelihoods. J. R. Statist. Soc. B, 25, 318-329.
50. Yang, R. and Berger, J. (1996) A catalog of noninformative priors. Discussion Paper 97-42. Institute of Statistics and Decision Sciences, Duke University, Durham. (Available from citeseer.ist.psu.edu/old/401050.html.)
51. Zellner, A. (1988) Optimal information processing and Bayes' theorem. Am. Statistn, 42, 278-284.