Harold Jeffreys's default Bayes factor hypothesis tests: Explanation, extension, and application in psychology

Journal of Mathematical Psychology

Volumn 72, Issue , 2016, Pages 19-32

  Ly, Alexander ^a   Verhagen, Josine ^a   Wagenmakers, Eric Jan ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Bayes factors; Harold Jeffreys; Model selection

Indexed keywords

EID: 84940056135     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2015.06.004     Document Type: Article

References (72)

1. Andraszewicz S., Scheibehenne B., Rieskamp J., Grasman R.P.P.P., Verhagen A.J., Wagenmakers E.-J. An introduction to Bayesian hypothesis testing for management research. Journal of Management 2015, 41:521-543.
2. Anscombe F.J. Graphs in statistical analysis. The American Statistician 1973, 27(1):17-21.
3. Bartlett M.S. A comment on D. V. Lindley's statistical paradox. Biometrika 1957, 44:533-534.
4. Bayarri M., Berger J., Forte A., García-Donato G. Criteria for Bayesian model choice with application to variable selection. The Annals of statistics 2012, 40(3):1550-1577.
5. Berger J.O. Statistical decision theory and Bayesian analysis 1985, Springer Verlag.
6. Berger J.O. Bayes factors. Encyclopedia of statistical sciences, Vol. 1 2006, 378-386. Wiley, Hoboken, NJ. 2nd ed. S. Kotz, N. Balakrishnan, C. Read, B. Vidakovic, N.L. Johnson (Eds.).
7. Berkson J. Some difficulties of interpretation encountered in the application of the chi-square test. Journal of the American Statistical Association 1938, 33:526-536.
8. Boekel W., Wagenmakers E.-J., Belay L., Verhagen A.J., Brown S.D., Forstmann B. A purely confirmatory replication study of structural brain-behavior correlations. Cortex 2015, 66:115-133.
9. Bolt B. The constitution of the core: seismological evidence. Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences 1982, 306(1492):11-20.
10. Cook A. Sir Harold Jeffreys. 2 April 1891-18 March 1989. Biographical Memoirs of Fellows of the Royal Society 1990, 36:302-333.
11. Dickey J.M., Lientz B.P. The weighted likelihood ratio, sharp hypotheses about chances, the order of a Markov chain. The Annals of Mathematical Statistics 1970, 41:214-226.
12. Edwards W., Lindman H., Savage L.J. Bayesian statistical inference for psychological research. Psychological Review 1963, 70:193-242.
13. Gamerman D., Lopes H.F. Markov chain Monte Carlo: Stochastic simulation for Bayesian inference 2006, Chapman & Hall/CRC, Boca Raton, FL.
14. Geisser S. The contributions of Sir Harold Jeffreys to Bayesian inference. Bayesian analysis in econometrics and statistics: essays in Honor of Harold Jeffreys 1980, 13-20. North-Holland, Amsterdam. A. Zellner, Kadane, B. Joseph (Eds.).
15. Markov chain Monte Carlo in practice 1996, Chapman & Hall/CRC, Boca Raton (FL). W.R. Gilks, S. Richardson, D.J. Spiegelhalter (Eds.).
16. Gino F., Wiltermuth S.S. Evil genius? How dishonesty can lead to greater creativity. Psychological Science 2014, 4:973-981.
17. Good I.J. The contributions of Jeffreys to Bayesian statistics. Bayesian analysis in econometrics and statistics: essays in Honor of Harold Jeffreys 1980, 21-34. North-Holland Publishing Company, Amsterdam, The Netherlands. A. Zellner (Ed.).
18. Gradshteyn I.S., Ryzhik I.M. Table of integrals, series, and products 2007, Academic Press. 7 ed.
19. Huzurbazar V.S. Sir Harold Jeffreys: Recollections of a student. Chance 1991, 4(2):18-21.
20. Jaynes E.T. Probability theory: the logic of science 2003, Cambridge University Press, Cambridge.
21. Jeffreys H. The earth, its origin, history and physical constitution 1924, Cambridge University Press.
22. Jeffreys H. Scientific inference 1931, Cambridge University Press.
23. Jeffreys H. Some tests of significance, treated by the theory of probability. Proceedings of the Cambridge Philosophical Society 1935, 31(2):203-222.
24. Jeffreys H. An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences 1946, 186(1007):453-461.
25. Jeffreys H. Theory of probability 1948, Oxford University Press, Oxford, UK. 2 ed.
26. Jeffreys H. The present position in probability theory. The British Journal for the Philosophy of Science 1955, 5:275-289.
27. Jeffreys H. Theory of probability 1961, Oxford University Press, Oxford, UK. 3 ed.
28. Jeffreys H. Scientific inference 1973, Cambridge University Press, Cambridge, UK. 3 ed.
29. Jeffreys H. Some general points in probability theory. Bayesian analysis in econometrics and statistics: essays in Honor of Harold Jeffreys 1980, 451-453. North-Holland, Amsterdam. A. Zellner, Kadane, B. Joseph (Eds.).
30. Jeffreys H., Jeffreys B.S. Methods of mathematical physics 1946, Cambridge University Press, Cambridge, UK.
31. Johnson V.E. Revised standards for statistical evidence. Proceedings of the National Academy of Sciences of the United States of America 2013, 110:19313-19317.
32. Klugkist I., Laudy O., Hoijtink H. Inequality constrained analysis of variance: a Bayesian approach. Psychological Methods 2005, 10(4):477.
33. Lee M.D., Wagenmakers E.-J. Bayesian cognitive modeling: A practical course 2013, Cambridge University Press.
34. Lewis S.M., Raftery A.E. Estimating Bayes factors via posterior simulation with the Laplace-Metropolis estimator. Journal of the American Statistical Association 1997, 92(438):648-655.
35. Liang F., Paulo R., Molina G., Clyde M.A., Berger J.O. Mixtures of g priors for Bayesian variable selection. Journal of the American Statistical Association 2008, 103(481).
36. Lindley D.V. A statistical paradox. Biometrika 1957, 44:187-192.
37. Lindley D.V. Jeffreys's contribution to modern statistical thought. Bayesian analysis in econometrics and statistics: essays in Honor of Harold Jeffreys 1980, 35-39. North-Holland Publishing Company, Amsterdam, The Netherlands. A. Zellner (Ed.).
38. Lindley D.V. Sir Harold Jeffreys. Chance 1991, 4(2):10-14. 21.
39. Liu C.C., Aitkin M. Bayes factors: Prior sensitivity and model generalizability. Journal of Mathematical Psychology 2008, 52:362-375.
40. Ly A., Marsman M., Verhagen A., Grasman R., Wagenmakers E.-J. A tutorial on Fisher information. Journal of Mathematical Psychology 2015, (submitted for publication).
41. Marin J.-M., Robert C.P. On resolving the savage-dickey paradox. Electronic Journal of Statistics 2010, 4:643-654.
42. Mednick S. The associative basis of the creative process. Psychological Review 1962, 69(3):220-232.
43. Morey R.D., Wagenmakers E.-J. Simple relation between Bayesian order-restricted and point-null hypothesis tests. Statistics & Probability Letters 2014, 92:121-124.
44. Mulder J. Bayes factors for testing inequality constrained hypotheses: Issues with prior specification. British Journal of Mathematical and Statistical Psychology 2014, 67(1):153-171.
45. Mulder J. Bayes factors for testing order-constrained hypotheses on correlations. Journal of Mathematical Psychology 2016, 72:104-115.
46. Mulder J., Hoijtink H., Klugkist I. Equality and inequality constrained multivariate linear models: objective model selection using constrained posterior priors. Journal of Statistical Planning and Inference 2010, 140(4):887-906.
47. Myung I.J. Tutorial on maximum likelihood estimation. Journal of Mathematical Psychology 2003, 47:90-100.
48. Myung I.J., Forster M.R., Browne M.W. Model selection [Special issue]. Journal of Mathematical Psychology 2000, 44(1-2).
49. Myung I.J., Pitt M.A. Applying Occam's razor in modeling cognition: A Bayesian approach. Psychonomic Bulletin & Review 1997, 4(1):79-95.
50. Oberhettinger F. Hypergeometric functions. Handbook of mathematical functions with formulas, graphs, and mathematical tables 1972, 555-566. Dover Publications, New York. M. Abramowitz, I.A. Stegun (Eds.).
51. O'Hagan A., Forster J. Kendall's advanced theory of statistics Vol. 2B: Bayesian inference 2004, Arnold, London. 2nd ed.
52. Pericchi L.R., Liu G., Torres D. Objective Bayes factors for informative hypotheses: Completing" the informative hypothesis and "splitting" the Bayes factor. Bayesian evaluation of informative hypotheses 2008, 131-154. Springer Verlag, New York. H. Hoijtink, I. Klugkist, P.A. Boelen (Eds.).
53. Ramsey F.P. Truth and probability. The foundations of mathematics and other logical essays 1926, 156-198. Kegan Paul, London. R.B. Braithwaite (Ed.).
54. Robert C.P., Chopin N., Rousseau J. Harold Jeffreys's theory of probability revisited. Statistical Science 2009, 141-172.
55. Rouder J.N., Speckman P.L., Sun D., Morey R.D., Iverson G. Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review 2009, 16(2):225-237.
56. Senn S. Comment. Statistical Science 2009, 24(2):185-186.
57. Stulp G., Buunk A.P., Verhulst S., Pollet T.V. Tall claims? Sense and nonsense about the importance of height of US presidents. The Leadership Quarterly 2013, 24(1):159-171.
58. Swirles B. Harold Jeffreys: Some reminiscences. Chance 1991, 4(2):22-23. 26.
59. van Erven T., Grünwald P., de Rooij S. Catching up faster by switching sooner: A predictive approach to adaptive estimation with an application to the AIC-BIC dilemma. Journal of the Royal Statistical Society B 2012, 74:361-417.
60. Vanpaemel W. Prior sensitivity in theory testing: An apologia for the Bayes factor. Journal of Mathematical Psychology 2010, 54:491-498.
61. Wagenmakers E.-J., Grünwald P., Steyvers M. Accumulative prediction error and the selection of time series models. Journal of Mathematical Psychology 2006, 50:149-166.
62. Wagenmakers, E.-J., Lee, M. D., Rouder, J. N., & Morey, R. D. (2014). Another statistical paradox, or why intervals cannot be used for model comparison. (submitted for publication).
63. Wagenmakers E.-J., Lodewyckx T., Kuriyal H., Grasman R. Bayesian hypothesis testing for psychologists: A tutorial on the Savage-Dickey method. Cognitive Psychology 2010, 60:158-189.
64. Wagenmakers, E.-J., Verhagen, A.J., & Ly, A. How to quantify the evidence for the absence of a correlation. Behavior Research Methods, (in press).
65. Wagenmakers, E.-J., Verhagen, A.J., Ly, A., Matzke, D., Steingroever, H., Rouder, J.N., & Morey, R.D. The need for Bayesian hypothesis testing in psychological science. In S. O. Lilienfeld, & I. Waldman (Eds.), Psychological science under scrutiny: recent challenges and proposed solutions. John Wiley and Sons, (in press).
66. Wagenmakers E.-J., Waldorp L. Model selection: Theoretical developments and applications [Special issue]. Journal of Mathematical Psychology 2006, 50(2).
67. Wetzels R., Matzke D., Lee M.D., Rouder J.N., Iverson G.J., Wagenmakers E.-J. Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science 2011, 6:291-298.
68. Wetzels R., Raaijmakers J.G., Jakab E., Wagenmakers E.-J. How to quantify support for and against the null hypothesis: A flexible WinBUGS implementation of a default Bayesian t test. Psychonomic Bulletin & Review 2009, 16(4):752-760.
69. Wrinch D., Jeffreys H. On certain fundamental principles of scientific inquiry. Philosophical Magazine 1921, 42:369-390.
70. Zellner A. Introduction. Bayesian analysis in econometrics and statistics: essays in honor of Harold Jeffreys 1980, 1-10. North-Holland Publishing Company, Amsterdam, The Netherlands. A. Zellner (Ed.).
71. Zellner A. On assessing prior distributions and Bayesian regression analysis with g-prior distributions. Bayesian Inference and Decision Techniques: Essays in Honor of Bruno De Finetti 1986, 6:233-243.
72. Zellner A., Siow A. Posterior odds ratios for selected regression hypotheses. Bayesian statistics: proceedings of the first international meeting held in Valencia, vol.~1 1980, 585-603. Springer. J.M. Bernardo, M.H. DeGroot, D.V. Lindley, A.F. Smith (Eds.).