Objective priors: An introduction for frequentists

Statistical Science

Volumn 26, Issue 2, 2011, Pages 187-202

  Ghosh, Malay ^a  

^a UNIVERSITY OF FLORIDA   (United States)

Author keywords

Asymptotic expansion; Divergence criterion; Firstorder probability matching; Jeffreys' prior; Left haar priors; Location family; Location scale family; Multiparameter; Orthogonality; Reference priors; Right haar priors; Scale family; Second order probability matching; Shrinkage argument

Indexed keywords

EID: 83055193534     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/10-STS338     Document Type: Article

References (64)

1. Amari, S. (1982). Differential geometry of curved exponential families-Curvatures and information loss. Ann. Statist. 10 357-387. MR0653513
2. Bayes, T. (1763). An essay towards solving a problem in the doctrine of chances. Philos. Trans. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 53 370-418.
3. Berger, J. O. (1985). Statistical Decision Theory and Related Topics, 2nd ed. Springer, New York. MR0804611
4. Berger, J. O. and Bernardo, J. M. (1989). Estimating a product of means. Bayesian analysis with reference priors. J. Amer. Statist. Assoc. 84 200-207. MR0999679
5. Berger, J. O. and Bernardo, J. M. (1992a). On the development of reference priors (with discussion). In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 35-60. Oxford Univ. Press, New York. MR1380269
6. Berger, J. O. and Bernardo, J. M. (1992b). Reference priors in a variance components problem. In Bayesian Analysis in Statistics and Econometrics (P. K. Goel and N. S. Iyengar, eds.) 177-194. Springer, New York. MR1194392
7. Berger, J. O., Bernardo, J. M. and Sun, D. (2009). The formal definition of reference priors. Ann. Statist. 37 905-938. MR2502655
8. Berger, J. O., De Oliveira, V. and Sanso, B. (2001). Objective Bayesian analysis of spatially correlated data. J. Amer. Statist. Assoc. 96 1361-1374. MR1946582
9. Berger, J. O. and Yang, R. (1994). Noninformative priors and Bayesian testing for the Ar(1) model. Econometric Theory 10 461-482. MR1309107
10. Bernardo, J. M. (1979). Reference posterior distributions for Bayesian inference (with discussion). J. R. Stat. Soc. Ser. B Stat. Methodol. 41 113-147. MR0547240
11. Bernardo, J. M. (2005). Reference analysis. In Handbook of Bayesian Statisics 25 (D. K. Dey and C. R. Rao, eds.). North-Holland, Amsterdam. MR2490522
12. Bhattacharyya, A. K. (1943). On a measure of divergence between two statistical populations defined by their probability distributions. Bull. Calcutta Math. Soc. 35 99-109. MR0010358
13. Bickel, P. J. and Ghosh, J. K. (1990). A decomposition for the likelihood ratio statistic and the Bartlett correction-A Bayesian argument. Ann. Statist. 18 1070-1090. MR1062699
14. Clarke, B. and Barron, A. (1990). Information-theoretic asymptotics of Bayes methods. IEEE Trans. Inform. Theory 36 453-471. MR1053841
15. Clarke, B. and Barron, A. (1994). Jeffreys' prior is asymptotically least favorable under entropy risk. J. Statist. Plann. Inference 41 37-60. MR1292146
16. Clarke, B. and Sun, D. (1997). Reference priors under the chisquare distance. Sankhyā A 59 215-231. MR1665703
17. Clarke, B. and Sun, D. (1999). Asymptotics of the expected posterior. Ann. Inst. Statist. Math. 51 163-185. MR1704652
18. Cressie, N. and Read, T. R. C. (1984). Multinomial goodnessof-fit tests. J. Roy. Statist. Soc. Ser. B 46 440-464. MR0790631
19. Cox, D. R. and Reid, N. (1987). Parameter orthogonality and approximate conditional inference (with discussion). J. Roy Statist. Soc. Ser. B 53 79-109. MR0893334
20. Datta, G. S. (1996). On priors providing frequentist validity of Bayesian inference for multiple parametric functions. Biometrika 83 287-298. MR1439784
21. Datta, G. S. and Ghosh, J. K. (1995a). On priors providing frequentist validity for Bayesian inference. Biometrika 82 37-45. MR1332838
22. Datta,G. S. Andghosh, J. K. (1995b). Noninformative priors for maximal invariant in group models. Test 4 95-114. MR1365042
23. Datta, G. S. and Ghosh, M. (1995c). Some remarks on noninformative priors. J. Amer. Statist. Assoc. 90 1357-1363. MR1379478
24. Datta, G. S. and Ghosh, M. (1995d). Hierarchical Bayes estimators of the error variance in one-way ANOVA models. J. Statist. Plann. Inference 45 399-411. MR1341333
25. Datta, G. S. and Ghosh, M. (1996). On the invariance of noninformative priors. Ann. Statist. 24 141-159. MR1389884
26. Datta, G. S., Ghosh, M. and Mukerjee, R. (2000). Some new results on probability matching priors. Calcutta Statist. Assoc. Bull. 50 179-192. MR1843620
27. Datta, G. S., Ghosh, M. Andkim, Y. (2002). Probability matching priors for one-way unbalanced rendom effects models. Statist. Decisions 20 29-51. MR1904422
28. Datta, G. S. and Mukerjee, R. (2004). Probability Matching Priors: Higher Order Asymptotics. Springer, New York. MR2053794
29. Datta, G. S., Mukerjee, R., Ghosh, M. and Sweeting, T. J. (2000). Bayesian prediction with approximate frequentist validity. Ann. Statist. 28 1414-1426. MR1805790
30. Datta, G. S. and Sweeting, T. J. (2005). Probability matching priors. In Bayesian Thinking, Modeling and Computation. Handbook of Statistics 25 (D. K. Dey and C. R. Rao, eds.). North-Holland, Amsterdam. MR2490523
31. Ferguson, T. (1996). A Course in Large Sample Theory. Chapman & Hall/Crc Press, Boca Raton, Fl. MR1699953
32. Fraser, D. A. S. and Reid, N. (2002). Strong matching of frequentist and Bayesian parametric inference. J. Statist. Plann. Inference 103 263-285. MR1896996
33. Ghosal, S. (1997). Reference priors in multiparameter nonregular cases. Test 6 159-186. MR1466439
34. Ghosal, S. (1999). Probability matching priors for nonregular cases. Biometrika 86 956-964. MR1741992
35. Ghosh, J. K., Delampady, M. and Samanta, T. (2006). An Introduction to Bayesian Analysis. Springer, New York. MR2247439
36. Ghosh, M. and Liu, R. (2011). Moment matching priors. Sankhyā A. To appear.
37. Ghosh, J. K. and Mukerjee, R. (1992). Non-informative priors (with discussion). In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 195-210. Oxford Univ. Press, New York. MR1380277
38. Ghosh, J. K., Sinha, B. K. and Joshi, S. N. (1982). Expansion for posterior probability and integrated Bayes risk. In Statistical Decision Theory and Related Topics III 1 403-456. Academic Press, New York. MR0705299
39. Ghosh, M., Carlin, B. P. and Srivastava, M. S. (1994). Probability matching priors for linear calibration. Test 4 333-357. MR1379796
40. Ghosh, M. Andheo, J. (2003). Default Bayesian priors for regression models with second-order autogressive residuals. J. Time Ser. Anal. 24 269-282. MR1984597
41. Ghosh, M., Mergel, V. and Liu, R. (2011). A general divergence criterion for prior selection. Ann. Inst. Statist. Math. 63 43-58.
42. Ghosh, M. and Mukerjee, R. (1998). Recent developments on probability matching priors. In Applied Statistical Science III (S. E. Ahmed, M. Ahsanullah and B. K. Sinha, eds.) 227-252. Nova Science Publishers, New York. MR1673669
43. Ghosh, M., Yin, M. and Kim, Y.-H. (2003). Objective Bayesian inference for ratios of regression coefficients in linear models. Statist. Sinica 13 409-422. MR1977734
44. Halmos, P. (1950). Measure Theory. Van Nostrand, New York. MR0033869
45. Hartigan, J. A. (1964). Invariant prior densities. Ann. Math. Statist. 35 836-845. MR0161406
46. Hartigan, J. A. (1998). The maximum likelihood prior. Ann. Statist. 26 2083-2103. MR1700222
47. Hellinger, E. (1909). Neue Begründung der Theorie quadratischen Formen von unendlichen vielen Veränderlichen. J. Reine Angew. Math. 136 210-271.
48. Huzurbazar, V. S. (1950). Probability distributions and orthogonal parameters. Proc. Camb. Phil. Soc. 46 281-284. MR0034567
49. Jeffreys, H. (1961). Theory of Probability and Inference, 3rd ed. Cambridge Univ. Press, London.
50. Johnson, R. A. (1970). Asymptotic expansions associated with posterior distribution. Ann. Math. Statist. 41 851-864. MR0263198
51. Kass, R. E. and Wasserman, L. (1996). The selection of prior distributions by formal rules. J. Amer. Statist. Assoc. 91 1343-1370. MR1478684
52. Laplace, P. S. (1812). Theorie Analytique des Probabilities. Courcier, Paris.
53. Lindley, D. V. (1956). On the measure of the information provided by an experiment. Ann. Math. Statist. 27 986-1005. MR0083936
54. Liu, R. (2009). On some new contributions towards objective priors. Unpublished Ph.D. dissertation. Dept. Statistics, Univ. Florida, Gainesville, Fl. MR2714091
55. Morris, C. N. Andnormand, S. L. (1992). Hierarchical models for combining information and for meta-analysis. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 321-344. Oxford. Univ. Press, New York. MR1380284
56. Mukerjee, R. and Dey, D. K. (1993). Frequentist validity of posterior quantiles in the presence of a nuisance parameter: Higherorder asymptotics. Biometrika 80 499-505. MR1248017
57. Mukerjee, R. and Ghosh, M. (1997). Second-order probability matching priors. Biometrika 84 970-975. MR1625016
58. Nachbin, L. (1965). The Haar Integral. Van Nostrand, New York. MR0175995
59. Reid, N. (1996). Likelihood and Bayesian approximation methods (with discussion). In Bayesian Statistics 5 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 351-368. Oxford Univ. Press, New York. MR1425414
60. Severini, T. A., Mukerjee, R. and Ghosh, M. (2002). On an exact probability matching property of right-invariant priors. Biometrika 89 952-957. MR1946524
61. Staicu, A.-M. and Reid, N. (2008). On probability matching priors. Canad. J. Statist. 36 613-622. MR2532255
62. Tibshirani, R. J. (1989). Noninformative priors for one parameter of many. Biometrika 76 604-608. MR1040654
63. Welch, B. L. and Peers, H. W. (1963). On formulae for confidence points based on integrals of weighted likelihoods. J. Roy Statist. Soc. Ser. B 35 318-329. MR0173309
64. Ye, K. (1994). Bayesian reference prior analysis on the ratio of variances for the balanced one-way random effect model. J. Statist. Plann. Inference 41 267-280. MR1309613