A reconceptualization of significance testing

Theory & Psychology

Volumn 24, Issue 6, 2014, Pages 852-859

  Perezgonzalez, Jose D ^a  

^a MASSEY UNIVERSITY   (New Zealand)

Author keywords

Fisher; Neyman Pearson; NHST; Null Hypothesis Significance Testing; significance testing; statistical hypotheses

Indexed keywords

EID: 84919631708     PISSN: 09593543     EISSN: 14617447     Source Type: Journal    
DOI: 10.1177/0959354314546157     Document Type: Article

References (37)

1. American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
2. Berger J. O. (2003). Could Fisher, Jeffreys and Neyman have agreed on testing? Statistical Science, 18(1), 1–32.
3. Christensen R. (2005). Testing Fisher, Neyman, Pearson, and Bayes. The American Statistician, 59(2), 121–126.
4. Cohen J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
5. Cohen J. (1994). The Earth is round (p <.05). American Psychologist, 49(12), 997–1003.
6. Cortina J. M. Dunlap W. P. (1997). On the logic and purpose of significance testing. Psychological Methods, 2(2), 161–172.
7. Fisher R. A. (1925). Statistical methods for research workers. Edinburgh, UK: Oliver and Boyd.
8. Fisher R. A. (1955). Statistical methods and scientific induction. Journal of the Royal Statistical Society, Series B (Methodological), 17(1), 69–78.
9. Fisher R. A. (1959). Statistical methods and scientific inference (2nd ed.). Edinburgh, UK: Oliver and Boyd.
10. Fisher R. A. (1960). The design of experiments (7th ed.). Edinburgh, UK: Oliver and Boyd.
11. Frick R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods, 1(4), 379–390.
12. Gigerenzer G. (2004). Mindless statistics. The Journal of Socio-Economics, 33, 587–606.
13. Goodman S. N. (1993). P values, hypothesis tests, and likelihood: Implications for epidemiology of a neglected historical debate. American Journal of Epidemiology, 137(5), 485–496.
14. Goodman S. N. (1999). Toward evidence-based medical statistics: 1. The p-value fallacy. Annals of Internal Medicine, 130(12), 995–1004.
15. Hager W. (2013). The statistical theories of Fisher and of Neyman and Pearson: A methodological perspective. Theory & Psychology, 23, 251–270. doi:10.1177/0959354312465483
16. Halpin P. F. Stam H. J. (2006). Inductive inference or inductive behavior: Fisher and Neyman–Pearson approaches to statistical testing in psychological research (1940–1960). American Journal of Psychology, 119(4), 625–653.
17. Hubbard R. (2004). Alphabet soup: Blurring the distinctions between p's and α's in psychological research. Theory & Psychology, 14, 295–327. doi:10.1177/0959354304043638
18. Hubbard R. (2011). The widespread misinterpretation of p-values as error probabilities. Journal of Applied Statistics, 38(11), 2617–2626.
19. Hubbard R. Bayarri M. J. (2003). Confusion over measures of evidence (p's) versus errors (α's) in classical statistical testing. The American Statistician, 57(3), 171–178. doi:10.1198/0003130031856
20. Huberty C. J. (1993). Historical origins of statistical testing practices: The treatment of Fisher versus Neyman–Pearson views in textbooks. Journal of Experimental Education, 61(4), 317–333.
21. Johnstone D. J. (1986). Tests of significance in theory and practice. Journal of the Royal Statistical Society, Series D (The Statistician), 35(5), 491–504.
22. Jones L. V. Tukey J. W. (2000). A sensible formulation of the significance test. Psychological Methods, 5(4), 411–414. doi:10.1037//1082–989X.5.4.411
23. Kline R. B. (2004). Beyond significance testing: Reforming data analysis methods in behavioral research. Washington, DC: APA.
24. Krueger J. (2001). Null hypothesis significance testing: On the survival of a flawed method. American Psychologist, 56(1), 16–26. doi:10.1037//0003–066X.56.1.16
25. Lehmann E. I. (1993). The Fisher, Neyman–Pearson theories of testing hypotheses: One theory or two? Journal of the American Statistical Association, 88(424), 1242–1249.
26. Lindquist E. F. (1940). Statistical analysis in educational research. Boston, MA: Houghton Mifflin.
27. Louçã F. (2008). The widest cleft in statistics: How and why Fisher opposed Neyman and Pearson (Working Papers WP/02/2008/DE/UECE). Lisbon, Portugal: School of Economics and Management, Technical University of Lisbon. Retrieved from https://www.repository.utl.pt/bitstream/10400.5/2327/1/wp022008.pdf
28. Neyman J. (1953). First course in probability and statistics. New York, NY: Henry Holt.
29. Neyman J. Pearson E. S. (1928). On the use and interpretation of certain test criteria for purposes of statistical inference: Part I. Biometrika, 20(A), 175–263.
30. Neyman J. Pearson E. S. (1933). On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London, Series A, 231, 289–337.
31. Nickerson R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5(2), 241–301. doi:10.1037//1082–989X.5.2.241
32. Pearson E. S. (1955). Statistical concepts in the relation to reality. Journal of the Royal Statistical Society, Series B (Methodological), 17(2), 204–207.
33. Rosnow R. L. Rosenthal R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44(10), 1276–1284.
34. Schmidt F. L. (1992). What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47(10), 1173–1181.
35. Schweder T. (1988). A significant version of the basic Neyman–Pearson theory for scientific hypothesis testing. Scandinavian Journal of Statistics, 15(4), 225–242.
36. Wainer H. (1999). One cheer for null hypothesis significance testing. Psychological Methods, 4(2), 212–213.
37. Wilkinson L., & the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54(8), 594–604.