Performing Inferential Statistics Prior to Data Collection

Educational and Psychological Measurement

Volumn 77, Issue 2, 2017, Pages 204-219

  Trafimow, David ^a   MacDonald, Justin A ^a  

^a NEW MEXICO STATE UNIVERSITY   (United States)

Author keywords

a priori procedure; complexity; confidence; precision

Indexed keywords

EID: 85015740659     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164416659745     Document Type: Article

References (33)

1. Bakan D, (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437. doi:10.1037/h0020412
2. Berkson J., (1938). Some difficulties of interpretation encountered in the application of the chi-square test. Journal of the American Statistical Association, 33, 526-542. doi:10.2307/2279690
3. Cohen J., (1994). The earth is round (p <.05). American Psychologist, 49, 997-1003.
4. Fidler F., Loftus G. R., (2009). Why figures with error bars should replace p values: Some conceptual arguments and empirical demonstrations. Journal of Psychology, 217, 27-37. doi:10.1027/0044-3409.217.1.27
5. Fisher R. A., (1973). Statistical methods and scientific inference (3rd ed.). London, England: Collier Macmillan.
6. Gigerenzer G., (1993). The superego, the ego, and the id in statistical reasoning. In Keren G., Lewis C., (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 311-339). Hillsdale, NJ: Erlbaum.
7. Harris R. J., Quade D., (1992). The minimally important difference significant criterion for sample size. Journal of Educational Statistics, 17(1), 27-49. doi:10.3102/10769986017001027
8. Hays W. L., (1994). Statistics (5th ed.). Fort Worth, TX: Harcourt Brace.
9. Hoekstra R., Morey R. D., Rouder J. N., Wagenmakers E.-J., (2014). Robust misinterpretation of confidence intervals. Psychonomic Bulletin & Review, 21, 1157-1164. doi:10.3758/s13423-013-0572-3
10. Hogben L., (1957). Statistical theory. London, England: Allen & Unwin.
11. Kutner M. H., Nachtsheim C. J., Neter J., Li W., (2005). Applied linear statistical models (5th ed.). Boston, MA: WCB/McGraw-Hill.
12. Loftus G. R., (1996). Psychology will be a much better science when we change the way we analyze data. Current Directions in Psychological Science, 5(6), 161-171. doi:10.1111/1467-8721.ep11512376
13. Lykken D. E., (1968). Statistical significance in psychological research. Psychological Bulletin, 70(3, Pt 1), 151-159. http://doi:10.1037/h0026141
14. Marcoulides G. A., Saunders C., (2006). PLS: A silver bullet? MIS Quarterly, 30, iii-ix.
15. Mayo D., (1996). Error and the growth of experimental knowledge. Chicago, IL: University of Chicago Press.
16. Meehl P. E., (1967). Theory testing in psychology and physics: A methodological paradox. Philosophy of Science, 34(2), 103-115. Retrieved from http://www.jstor.org/stable/186099
17. Meehl P. E., (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
18. Morey R. D., Hoekstra R., Rouder J. N., Lee M. D., Wagenmakers E.-J., (2016). The fallacy of placing confidence in confidence intervals. Psychonomic Bulletin & Review, 23, 103-123. doi:10.3758/s13423-015-0947-8
19. Popper K. R., (1983). Realism and the aim of science. London, England: Routledge.
20. Rozeboom W. W., (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416-428. doi:10.1037/h0042040
21. Schmidt F. L., (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-129.
22. Schmidt F. L., Hunter J. E., (1997). Eight objections to the discontinuation of significance testing in the analysis of research data. In Harlow L., Mulaik S. A., Steiger J. H., (Eds.), What if there were no significance tests? (pp. 37-64). Mahwah, NJ: Erlbaum.
23. Speelman C. P., McGann M., (2013). How mean is the mean?Frontiers in Psychology, 4, 451. doi:10.3389/fpsyg.2013.00451
24. Suppes P., (1994). Qualitative theory of subjective probability. In Wright G., Ayton P., (Eds.), Subjective probability (pp. 17-38). Chichester, England: Wiley.
25. Thompson B., (1992). Two and one-half decades of leadership in measurement and evaluation. Journal of Counseling and Development, 70, 434-438. doi:10.1002/j.1556-6676.1992.tb01631.x
26. Trafimow D., (2003). Hypothesis testing and theory evaluation at the boundaries: Surprising insights from Bayes’s theorem. Psychological Review, 110, 526-535. doi:10.1037/0033-295X.110.3.526
27. Trafimow D., (2006). Using epistemic ratios to evaluate hypotheses: An imprecision penalty for imprecise hypotheses. Genetic, Social, and General Psychology Monographs, 132, 431-462. doi:10.3200/MONO.132.4.431-462
28. Trafimow D., (2016). Using the coefficient of confidence to make the philosophical switch from a posteriori to a priori inferential statistics. Educational and Psychological Measurement. Advance online publication. doi:10.1177/0013164416667977
29. Trafimow D., Rice S., (2009). A test of the null hypothesis significance testing procedure correlation argument. Journal of General Psychology, 136, 261-269. doi:10.3200/GENP.136.3.261-270
30. Walker E., Nowacki A. S., (2011). Understanding equivalence and noninferiority testing. Journal of General Internal Medicine, 26, 192-196. doi:10.1007/s11606-010-1513-8
31. Wellek S., (2010). Testing statistical hypotheses of equivalence and noninferiority (2nd ed.). Boca Raton, FL: Chapman & Hall/CRC.
32. Wolf E. J., Harrington K. M., Clark S. L., Miller M. W., (2013). Sample size requirements for structural equation models: An evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 73, 913-934. doi:10.1177/0013164413495237
33. Yuan K.-H., Chan W., Marcoulides G. A., Bentler P. M., (2016). Assessing structural equation models by equivalence testing with adjusted fit indexes. Structural Equation Modeling, 23, 319-330. doi:10.1080/10705511.2015.1065414