How to quantify the evidence for the absence of a correlation

Behavior Research Methods

Volumn 48, Issue 2, 2016, Pages 413-426

  Wagenmakers, Eric Jan ^a   Verhagen, Josine ^a   Ly, Alexander ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Bayes factor; Hypothesis test; Statistical evidence

Indexed keywords

BAYES THEOREM; HUMAN; PROCEDURES; STATISTICS;

BAYES THEOREM; HUMANS; STATISTICS AS TOPIC;

EID: 84936816624     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-015-0593-0     Document Type: Article

References (46)

1. Anscombe, F.J. (1973). Graphs in statistical analysis. The American Statistician, 27, 17–21.
2. Bargh, J.A., & Shalev, I. (2012). The substitutability of physical and social warmth in daily life. Emotion, 12, 154–162.
3. Bem, D.J., Utts, J., & Johnson, W.O. (2011). Must psychologists change the way they analyze their data? Journal of Personality and Social Psychology, 101, 716–719.
4. Berger, J.O., & Wolpert, R.L. (1988). The likelihood principle (2nd ed.) Hayward (CA): Institute of Mathematical Statistics.
5. Boekel, W., Wagenmakers, E.-J., Belay, L., Verhagen, A.J., Brown, S.D., & Forstmann, B. (in press). A purely confirmatory replication study of structural brain-behavior correlations. Cortex.
6. Cohen, J. (1994). The earth is round (p<.05). American Psychologist, 49, 997–1003.
7. Cornfield, J. (1969). The Bayesian outlook and its application. Biometrics, 25, 617–657.
8. Dickey, J.M., & Lientz, B.P. (1970). The weighted likelihood ratio, sharp hypotheses about chances, the order of a Markov chain. The Annals of Mathematical Statistics, 41, 214–226.
9. Dienes, Z. (2008). Understanding psychology as a science: An introduction to scientific and statistical inference. New York: Palgrave MacMillan.
10. Dienes, Z. (2014). Using Bayes to get the most out of non-significant results. Frontiers in Psychology, 5, 781.
11. Donnellan, M.B., Lucas, R.E., & Cesario, J. (in press). On the association between loneliness and bathing habits: Nine replications of Bargh and Shalev (2012) Study 1. Emotion.
12. Edwards, W. (1965). Tactical note on the relation between scientific and statistical hypotheses. Psychological Bulletin, 63, 400– 402.
13. Edwards, W., Lindman, H., & Savage, L.J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193–242.
14. Gallistel, C.R. (2009). The importance of proving the null. Psychological Review, 116, 439–453.
15. Gradshteyn, I.S., & Ryzhik, I.M. (2007). Table of integrals, series, and products. In Jeffrey, A., & Zwillinger, D. (Eds.) 7th edn. Academic Press.
16. Hodges, J.L., & Lehmann, E.L. (1954). Testing the approximate validity of statistical hypotheses. Journal of the Royal Statistical Society B, 16, 261–268.
17. r e p. Psychological Methods, 15, 172–181.
18. Jeffreys, H. (1961). Theory of probability, 3rd edn. Oxford, UK: Oxford University Press.
19. Jeffreys, H. (1980). Some general points in probability theory. In Zellner, A. (Ed.) Bayesian analysis in econometrics and statistics: Essays in honor of Harold Jeffreys (pp. 451–453). Amsterdam, The Netherlands: North-Holland Publishing Company.
20. Kass, R.E., & Raftery, A.E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795.
21. Klugkist, I., Laudy, O., & Hoijtink, H. (2005). Inequality constrained analysis of variance: A Bayesian approach. Psychological Methods, 10, 477–493.
22. Lee, M.D., & Wagenmakers, E.-J. (2013). Bayesian modeling for cognitive science: A practical course. Cambridge: Cambridge University Press.
23. Lindley, D.V. (2014). That wretched prior. Significance, 1, 85–87.
24. Ly, A., Verhagen, A.J., & Wagenmakers, E.-J. (2015). Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, extension, and application in psychology. Manuscript under revision for the special issue on Bayes factors for the Journal of Mathematical Psychology.
25. Meehl, P.E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806–834.
26. Morey, R.D., & Rouder, J.N. (2011). Bayes factor approaches for testing interval null hypotheses. Psychological Methods, 16, 406–419.
27. Morey, R.D., & Wagenmakers, E.-J. (2014). Simple relation between Bayesian order-restricted and point-null hypothesis tests. Statistics and Probability Letters, 92, 121–124.
28. Oberhettinger, F. (1972). Hypergeometric functions. In Abramowitz, M., & Stegun, I. A. (Eds.) Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables (pp. 555–566). New York: Dover.
29. Robert, C.P., Chopin, N., & Rousseau, J. (2009). Harold Jeffreys’s Theory of Probability revisited. Statistical Science, 141–172.
30. Rogers, J.L., Howard, K.I., & Vessey, J.T. (1993). Using significance tests to evaluate equivalence between two experimental groups. Psychological Bulletin, 113, 553–565.
31. Rouder, J.N. (2014). Optional stopping: No problem for Bayesians. Psychonomic Bulletin & Review, 21, 301–308.
32. Rouder, J.N., Speckman, P.L., Sun, D., Morey, R.D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225– 237.
33. Rozeboom, W.W. (1960). The fallacy of the null–hypothesis significance test. Psychological Bulletin, 57, 416–428.
34. Simonsohn, U. (in press). Small telescopes: Detectability and the evaluation of replication results. Psychological Science.
35. Verhagen, A.J., & Wagenmakers, E.-J. (2014). Bayesian tests to quantify the result of a replication attempt. Journal of Experimental Psychology: General, 143, 1457–1475.
36. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779–804.
37. Wagenmakers, E.-J., Lodewyckx, T., Kuriyal, H., & Grasman, R. (2010). Bayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method. Cognitive Psychology, 60, 158–189.
38. Wagenmakers, E.-J., Verhagen, A.J., Ly, A., Bakker, M., Lee, M.D., Matzke, D., & et al. (in press). A power fallacy. Behavior Research Methods.
39. Wagenmakers, E.-J., Verhagen, A.J., Ly, A., Matzke, D., Steingroever, H., Rouder, J.N., & et al. (in press). The need for Bayesian hypothesis testing in psychological science. In Lilienfeld, S. O., & Waldman, I. (Eds.) Psychological science under scrutiny: Recent challenges and proposed solutions. John Wiley and Sons.
40. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H.L.J. (2011). Why psychologists must change the way they analyze their data: The case of psi. Journal of Personality and Social Psychology, 100, 426–432.
41. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van derMaas, H.L.J., & Kievit, R.A. (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7, 627–633.
42. Westlake, W.J. (1976). Symmetrical confidence intervals for bioequivalence trials. Biometrics, 32, 741–744.
43. Wetzels, R., & Wagenmakers, E.-J. (2012). A default Bayesian hypothesis test for correlations and partial correlations. Psychonomic Bulletin & Review, 19, 1057–1064.
44. Wrinch, D., & Jeffreys, H. (1919). On some aspects of the theory of probability. Philosophical Magazine, 38, 715–731.
45. Wrinch, D., & Jeffreys, H. (1921). On certain fundamental principles of scientific inquiry. Philosophical Magazine, 42, 369–390.
46. Wrinch, D., & Jeffreys, H. (1923). On certain fundamental principles of scientific inquiry. Philosophical Magazine, 45, 368–374.