Using the Coefficient of Confidence to Make the Philosophical Switch From A Posteriori to A Priori Inferential Statistics

Educational and Psychological Measurement

Volumn 77, Issue 5, 2017, Pages 831-854

  Trafimow, David ^a  

^a NEW MEXICO STATE UNIVERSITY   (United States)

Author keywords

a posteriori statistics; a priori statistics; coefficient of confidence; confidence interval; squared coefficient of confidence; standard error of the mean

Indexed keywords

EID: 85029494765     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164416667977     Document Type: Article

References (36)

1. Bakan D., (1966). The test of significance in psychological research. Psychological Bulletin, 66, 1-29. doi:10.1037/h0020412
2. Berkson J., (1938). Some difficulties of interpretation encountered in the application of the chi-square test. Journal of the American Statistical Association, 33, 526-542. doi:10.2307/2279690
3. Cohen J., (1990). Things I have learned (so far). The American Psychologist, 45, 1304-1312. doi:10.1037/0003-066X.45.12.1304
4. Cohen J., (1994). The earth is round (p <.05). The American Psychologist, 49, 997-1003. Retrieved from http://psycnet.apa.org/index.cfm?fa=buy.optionToBuy&uid=1995-12080-001
5. Edwards W., Lindman H., Savage L., (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193-242. doi.org/10.1037/h0044139
6. Fidler F., Loftus G. R., (2009). Why figures with error bars should replace p values: Some conceptual arguments and empirical demonstrations. Journal of Psychology, 217(1), 27-37. doi:10.1027/0044-3409.217.1.27
7. Fisher R. A., (1973). Statistical methods and scientific inference (3rd ed.). London, England: Collier Macmillan.
8. Gigerenzer G., (1993). The superego, the ego, and the id in statistical reasoning. In Keren G., Lewis C., (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 311-339). Hillsdale, NJ: Erlbaum.
9. Harris R. J., Quade D., (1992). The minimally important difference significant criterion for sample size. Journal of Educational Statistics, 17(1), 27-49. doi:10.3102/10769986017001027
10. Hays W. L., (1994). Statistics (5th ed.). Fort Worth, TX: Harcourt Brace College.
11. Hogben L., (1957). Statistical theory. London, England: Allen & Unwin.
12. Ioannidis J. P., (2005). Why most published research findings are false. PLoS Medicine, 2, e124. doi:10.1371/journal.pmed.0020124
13. Ioannidis J. P., (2012). Why science is not necessarily self-correcting. Perspectives on Psychological Science, 7, 645-654. doi:10.1177/1745691612464056
14. Jaynes E., (2003). Probability theory: The logic of science. Cambridge, England: Cambridge University Press.
15. Krueger J., (2001). Null hypothesis significance testing: On the survival of a flawed method. The American Psychologist, 56(1), 16-26. doi:10.1037//0003-066X.56.1.16
16. Loftus G. R., (1996). Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science, 5, 161-171. doi:10.1111/1467-8721.ep11512376
17. Loscalzo J., (2012). Irreproducible experimental results: Causes, (mis)interpretations, and consequences. Circulation, 125, 1211-1214. doi:10.1161/CIRCULATIONAHA.112.098244
18. Lykken D. E., (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151-159. doi:10.1037/h0026141
19. Mayo D., (1996). Error and the growth of experimental knowledge. Chicago, IL: University of Chicago Press.
20. Meehl P. E., (1967). Theory testing in psychology and physics: A methodological paradox. Philosophy of Science, 34, 103-115. Retrieved from http://www.jstor.org/stable/186099
21. Meehl P. E., (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834. Retrieved from http://psycnet.apa.org/index.cfm?fa=buy.optionToBuy&id=1979-25042-001
22. Morey R. D., Hoekstra R., Rouder J. N., Lee M. D., Wagenmakers E.-J., (2016). The fallacy of placing confidence in confidence intervals. Psychonomic Bulletin & Review, 23, 103-123.
23. Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251). doi:10.1126/science.aac4716
24. Pashler H., Wagenmakers E. J., (2012). Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science, 7, 528-530. doi:10.1177/1745691612465253
25. Popper K. R., (1983). Realism and the aim of science. London, England: Routledge.
26. Rozeboom W. W., (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416-428. doi:10.1037/h0042040
27. Schmidt F. L., (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-129. Retrieved from http://psycnet.apa.org/index.cfm?fa=buy.optionToBuy&id=1996-04469-001
28. Schmidt F. L., Hunter J. E., (1997). Eight objections to the discontinuation of significance testing in the analysis of research data. In Harlow L., Mulaik S. A., Steiger J. H., (Eds.), What if there were no significance tests? (pp. 37-64). Mahwah, NJ: Erlbaum.
29. Simmons J. P., Nelson L. D., Simonsohn U., (2011). False positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. doi:10.1177/0956797611417632
30. Suppes P., (1994). Qualitative theory of subjective probability. In Wright G., Ayton P., (Eds.), Subjective probability (pp. 17-38). Chichester, England: Wiley.
31. Thompson B., (1992). Two and one-half decades of leadership in measurement and evaluation. Journal of Counseling and Development, 70, 434-438. doi:10.1002/j.1556-6676.1992.tb01631.x
32. Trafimow D., (2003). Hypothesis testing and theory evaluation at the boundaries: Surprising insights from Bayes’s theorem. Psychological Review, 110, 526-535. doi:10.1037/0033-295X.110.3.526
33. Trafimow D., (2005). The ubiquitous Laplacian assumption: Reply to Lee and Wagenmakers. Psychological Review, 112, 669-674. doi:10.1037/0033-295X.112.3.669
34. Trafimow D., (2006). Using epistemic ratios to evaluate hypotheses: An imprecision penalty for imprecise hypotheses. Genetic, Social, and General Psychology Monographs, 132, 431-462. doi:10.3200/MONO.132.4.431-462
35. Trafimow D., (2013). Descriptive versus inferential cheating. Frontiers in Theoretical and Philosophical Psychology, 4, 627. doi:10.3389/fpsyg.2013.00627
36. Trafimow D., Rice S., (2009). A test of the null hypothesis significance testing procedure correlation argument. Journal of General Psychology, 136, 261-269. doi:10.3200/GENP.136.3.261-270