Harold Jeffreys's theory of probability revisited

Statistical Science

Volumn 24, Issue 2, 2009, Pages 141-172

  Robert, Christian P ^a,b   Chopin, Nicolas ^b,c   Rousseau, Judith ^a,b  

^a UNIVERSITÉ PARIS DAUPHINE   (France)

^b Institut National de la Statistique et des etudes economiques   (France)

^c ENSAE National School for Statistics and Economic Administration   (France)

Author keywords

finite measure; Bayes factor; Bayesian foundations; Goodness of fit; Jeffreys's prior; Kullback divergence; Noninformative prior; p values; Tests

Indexed keywords

EID: 77955125911     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/09-STS284     Document Type: Article

References (82)

1. ALDRICH, J. (2008). R. A. Fisher on Bayes and Bayes' theorem. Bayesian Anal. 3 161-170.
2. BALASUBRAMANIAN, V. (1997). Statistical inference, Occam's razor, and statistical mechanics on the space of probability distributions. Neural Comput. 9 349-368.
3. BASU, D. (1988). Statistical Information and Likelihood: A Collection of Critical Essays by Dr. D. Basu. Springer, New York.
4. BAUWENS, L. (1984). Bayesian Full Information of Simultaneous Equations Models Using Integration by Monte Carlo. Lecture Notes in Economics and Mathematical Systems 232. Springer, New York.
5. BAYARRI, M. and GARCIA-DONATO, G. (2007). Extending conventional priors for testing general hypotheses in linear models. Biometrika 94 135-152.
6. BAYES, T. (1963). An essay towards solving a problem in the doctrine of chances. Phil. Trans. Roy. Soc. 53 370-418.
7. BEAUMONT,M.,ZHANG,W and BALDING, D. (2002). Approximate Bayesian computation in population genetics. Genetics 162 2025-2035.
8. BERGER, J. (1985). Statistical Decision Theory and Bayesian Analysis, 2nd ed. Springer, New York.
9. BERGER,J.and BERNARDO, J. (1992). On the development of the reference prior method. In Bayesian Statistics 4 (J. Berger, J. Bernardo, A. Dawid and A. Smith, eds.) 35-49. Oxford Univ. Press, London.
10. BERGER,J.,BERNARDO,J.and SUN, D. (2009). Natural induction: An objective Bayesian approach. Rev. R. Acad. Cien. Serie A Mat. 103 125-135.
11. BERGER,J.,BOUKAI,B.andWANG, Y. (1997). Unified frequentist and Bayesian testing of a precise hypothesis (with discussion). Statist. Sci. 12 133-160.
12. BERGER,J.and JEFFERYS, W. (1992). Sharpening Ockham's razor on a Bayesian strop. Amer. Statist. 80 64-72.
13. BERGER,J.and PERICCHI, L. (1996). The intrinsic Bayes factor for model selection and prediction. J. Amer. Statist. Assoc. 91 109-122.
14. BERGER,J.,PERICCHI,L.and VARSHAVSKY, J. (1998). Bayes factors and marginal distributions in invariant situations. Sankhyā Ser. A 60 307-321.
15. BERGER,J.,PHILIPPE,A.and ROBERT, C. (1998). Estimation of quadratic functions: Reference priors for non-centrality parameters. Statist. Sinica 8 359-375.
16. BERGER,J.and ROBERT, C. (1990). Subjective hierarchical Bayes estimation of a multivariate normal mean: On the frequentist interface. Ann. Statist. 18 617-651.
17. BERGER,J.and SELLKE, T. (1987). Testing a point-null hypothesis: The irreconcilability of significance levels and evidence (with discussion). J. Amer. Statist. Assoc. 82 112-122.
18. BERGER,J.and WOLPERT, R. (1988). The Likelihood Principle, 2nd ed. IMS Lecture Notes-Monograph Series 9. IMS, Hayward.
19. BERNARDO, J. (1979). Reference posterior distributions for Bayesian inference (with discussion). J. Roy. Statist. Soc. Ser. B 41 113-147.
20. BERNARDO,J.and SMITH, A. (1994). Bayesian Theory. Wiley, New York.
21. BILLINGSLEY, P. (1986). Probability and Measure, 2nd ed. Wiley, New York.
22. BROEMELING,L.and BROEMELING, A. (2003). Studies in the history of probability and statistics xlviii the Bayesian contributions of Ernest Lhoste. Biometrika 90 728-731.
23. CASELLA,G.and BERGER, R. (2001). Statistical Inference, 2nd ed. Wadsworth, Belmont, CA.
24. DACUNHA-CASTELLE,D.and GASSIAT, E. (1999). Testing the order of a model using locally conic parametrization: Population mixtures and stationary ARMA processes. Ann. Statist. 27 1178-1209.
25. DARMOIS, G. (1935). Sur les lois de probabilité à estimation exhaustive. Comptes Rendus Acad. Sciences Paris 200 1265-1266.
26. DAWID, A. (1984). Present position and potential developments: Some personal views. Statistical theory. The prequential approach (with discussion). J. Roy. Statist. Soc. Ser. A 147 278-292.
27. DAWID, A. (2004). Probability, causality and the empirical world: A Bayes-de Finetti-Popper-Borel synthesis. Statist. Sci. 19 44-57.
28. DAWID,A.,STONE,N.and ZIDEK, J. (1973). Marginalization paradoxes in Bayesian and structural inference (with discussion). J. Roy. Statist. Soc. Ser. B 35 189-233.
29. DE FINETTI, B. (1974). Theory of Probability, vol. 1. Wiley, New York.
30. DE FINETTI, B. (1975). Theory of Probability, vol. 2. Wiley, New York.
31. DEGROOT, M. (1970). Optimal Statistical Decisions.McGrawHill, New York.
32. DEGROOT, M. (1973). Doing what comes naturally: Interpreting a tail area as a posterior probability or as a likelihood ratio. J. Amer. Statist. Assoc. 68 966-969.
33. DIACONIS,P.and YLVISAKER, D. (1985). Quantifying prior opinion. In Bayesian Statistics 2 (J. Bernardo, M. DeGroot, D. Lindley and A. Smith, eds.) 163-175. North-Holland, Amsterdam.
34. EARMAN, J. (1992). Bayes or Bust. MIT Press, Cambridge, MA.
35. FELLER, W. (1970). An Introduction to robability Theory and Its Applications, vol. 1. Wiley, New York.
36. FELLER, W. (1971). An Introduction to Probability Theory and Its Applications, vol. 2. Wiley, New York.
37. FIENBERG, S. (2006). When did Bayesian inference become "Bayesian"? Bayesian Anal. 1 1-40.
38. GHOSH,M.and MEEDEN, G. (1984). A new Bayesian analysis of a random effects model. J. Roy. Statist. Soc. Ser. B 43 474-482.
39. GOOD, I. (1962). Theory of Probability by Harold Jeffreys. J. Roy. Statist. Soc. Ser. A 125 487-489.
40. GOOD, I. (1980). The contributions of Jeffreys to Bayesian statistics. In Bayesian Analysis in Econometrics and Statistics: Essays in Honor of Harold Jeffreys 21-34. North-Holland, Amsterdam.
41. GOURIÉROUX,C.and MONFORT, A. (1996). Statistics and Econometric Models. Cambridge Univ. Press.
42. GRADSHTEYN,I.and RYZHIK, I. (1980). Tables of Integrals, Series and Products. Academic Press, New York.
43. HALDANE, J. (1932). A note on inverse probability. Proc. Cambridge Philos. Soc. 28 55-61.
44. HUZURBAZAR, V. (1976). Sufficient Statistics. Marcel Dekker, New York.
45. JAAKKOLA,T.and JORDAN, M. (2000). Bayesian parameter estimation via variational methods. Statist. Comput. 10 25-37.
46. JEFFREYS, H. (1931). Scientific Inference, 1st ed. Cambridge Univ. Press.
47. JEFFREYS, H. (1937). Scientific Inference, 2nd ed. Cambridge Univ. Press.
48. JEFFREYS, H. (1939). Theory of Probability, 1st ed. The Clarendon Press, Oxford.
49. JEFFREYS, H. (1948). Theory of Probability, 2nd ed. The Clarendon Press, Oxford.
50. JEFFREYS, H. (1961). Theory of Probability, 3rded. Oxford Classic Texts in the Physical Sciences. Oxford Univ. Press, Oxford.
51. KASS, R. (1989). The geometry of asymptotic inference (with discussion). Statist. Sci. 4 188-234.
52. KASS,R.and WASSERMAN, L. (1996). Formal rules of selecting prior distributions: A review and annotated bibliography. J. Amer. Statist. Assoc. 91 343-1370.
53. KOOPMAN, B. (1936). On distributions admitting a sufficient statistic. Trans. Amer. Math. Soc. 39 399-409.
54. LE CAM, L. (1986). Asymptotic Methods in Statistical Decision Theory. Springer, New York.
55. LHOSTE, E. (1923). Le calcul des probabilités appliqué à l'artillerie. Revue D'Artillerie 91 405-423, 516-532, 58-82 and 152-179.
56. LINDLEY, D. (1953). Statistical inference (with discussion). J. Roy. Statist. Soc. Ser. B 15 30-76.
57. LINDLEY, D. (1957). A statistical paradox. Biometrika 44 187-192.
58. LINDLEY, D. (1962). Theory of Probability by Harold Jeffreys. J. Amer. Statist. Assoc. 57 922-924.
59. LINDLEY, D. (1971). Bayesian Statistics, A Review.SIAM, Philadelphia.
60. LINDLEY, D. (1980). Jeffreys's contribution to modern statistical thought. In Bayesian Analysis in Econometrics and Statistics: Essays in Honor of Harold Jeffreys 35-39. North-Holland, Amsterdam.
61. LINDLEY,D.and SMITH, A. (1972). Bayes estimates for the linear model. J. Roy. Statist. Soc. Ser. B 34 1-41.
62. MACKAY, D. J. C. (2002). Information Theory, Inference & Learning Algorithms. Cambridge Univ. Press.
63. MARIN,J.-M.,MENGERSEN,K.and ROBERT, C. (2005). Bayesian modelling and inference on mixtures of distributions. In Handbook of Statistics (C. Rao and D. Dey, eds.) 25. Springer, New York.
64. MARIN,J.-M.and ROBERT, C. (2007). Bayesian Core. Springer, New York.
65. PITMAN, E. (1936). Sufficient statistics and intrinsic accuracy. Proc. Cambridge Philos. Soc. 32 567-579.
66. POPPER, K. (1934). The Logic of Scientific Discovery.Hutchinson and Co., London. (English translation, 1959.).
67. RAIFFA, H. (1968). Decision Analysis: Introductory Lectures on Choices Under Uncertainty. Addison-Wesley, Reading, MA.
68. RAIFFA,H.and SCHLAIFER, R. (1961). Applied statistical decision theory. Technical report, Division of Research, Graduate School of Business Administration, Harvard Univ.
69. RISSANEN, J. (1983). A universal prior for integers and estimation by minimum description length. Ann. Statist. 11 416-431.
70. RISSANEN, J. (1990). Complexity of models. In Complexity, Entropy, and the Physics of Information (W. Zurek, ed.) 8. Addison-Wesley, Reading, MA.
71. ROBERT, C. (1996). Intrinsic loss functions. Theory and Decision 40 191-214.
72. ROBERT, C. (2001). The Bayesian Choice, 2nd ed. Springer, New York.
73. ROBERT,C.and CASELLA, G. (1994). Distance penalized losses for testing and confidence set evaluation. Test 3 163-182.
74. ROBERT,C.and CASELLA, G. (2004). Monte Carlo Statistical Methods, 2nd ed. Springer, New York.
75. RUBIN, H. (1987). A weak system of axioms for rational behavior and the nonseparability of utility from prior. Statist. Decision 5 47-58.
76. SAVAG E, L. (1954). The Foundations of Statistical Inference.Wiley, New York.
77. STIGLER, S. (1999). Statistics on the Table: The History of Statistical Concepts and Methods. Harvard Univ. Press, Cambridge, MA.
78. TANNER,M.and WONG, W. (1987). The calculation of posterior distributions by data augmentation. J. Amer. Statist. Assoc. 82 528-550.
79. TIBSHIRANI, R. (1989). Noninformative priors for one parameter of many. Biometrika 76 604-608.
80. WALD, A. (1950). Statistical Decision Functions. Wiley, New York.
81. WELCH,B.and PEERS, H. (1963). On formulae for confidence points based on integrals of weighted likelihoods. J. Roy. Statist. Soc. Ser. B 25 318-329.
82. ZELLNER, A. (1980). Introduction. In Bayesian Analysis in Econometrics and tatistics: Essays in Honor of Harold Jeffreys 1-10. North-Holland, Amsterdam.