Fisher, Neyman-Pearson or NHST? A tutorial for teaching data testing

Frontiers in Psychology

Volumn 6, Issue MAR, 2015, Pages

  Perezgonzalez, Jose D ^a  

^a MASSEY UNIVERSITY   (New Zealand)

Author keywords

Fisher; Neyman Pearson; NHST; Null hypothesis significance testing; Statistical education; Teaching statistics; Test of significance; Test of statistical hypotheses

Indexed keywords

EID: 84926454206     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.00223     Document Type: Review

References (73)

1. American Psychological Association. (2010). Publication Manual of the American Psychological Association, 6th Edn. Washington, DC: APA.
2. Bakan, D. (1966). The test of significance in psychological research. Psychol. Bull. 66, 423-437. doi: 10.1037/h0020412.
3. Benjamini, Y., and Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B Stat. Methodol. 57, 289-300.
4. Berger, J. O. (2003). Could Fisher, Jeffreys and Neyman have agreed on testing? Stat. Sci. 18, 1-32. doi: 10.1214/ss/1056397485.
5. Carver, R. P. (1978). The case against statistical significance testing. Harv. Educ. Rev. 48, 378-399. doi: 10.1080/00220973.1993.10806591.
6. Carver, R. P. (1993). The case against statistical significance testing, revisited. J. Exp. Educ. 61, 287-292. doi: 10.1080/00220973.1993.10806591.
7. Christensen, R. (2005). Testing Fisher, Neyman, Pearson, and Bayes. Am. Stat. 59, 121-126. doi: 10.1198/000313005X20871.
8. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. New York, NY: Psychology Press.
9. Cortina, J. M., and Dunlap, W. P. (1997). On the logic and purpose of significance testing. Psychol. Methods 2, 161-172. doi: 10.1037/1082-989X.2.2.161.
10. Cumming, G. (2014). The new statistics: why and how. Psychol. Sci. 25, 7-29. doi: 10.1177/0956797613504966.
11. Dancey, C. P., and Reidy, J. (2014). Statistics Without Maths for Psychology, 6th Edn. Essex: Pearson Education.
12. Dienes, Z. (2014). Using Bayes to get the most out of non-significant results. Front. Psychol. 5:781. doi: 10.3389/fpsyg.2014.00781.
13. Efron, B. (1981). Nonparametric estimates of standard error: the jackknife, the bootstrap and other methods. Biometrika 68, 589-599. doi: 10.1093/biomet/68.3.589.
14. Fisher, R. A. (1932). Inverse probability and the use of likelihood. Proc. Camb. Philos. Soc. 28, 257-261. doi: 10.1017/S0305004100010094.
15. Fisher, R. A. (1954). Statistical Methods for Research Workers, 12th Edn. Edinburgh: Oliver and Boyd.
16. Fisher, R. A. (1955). Statistical methods and scientific induction. J. R. Stat. Soc. Ser. B. Stat. Methodol. 17, 69-78.
17. Fisher, R. A. (1960). The Design of Experiments, 7th Edn. Edinburgh: Oliver and Boyd.
18. Fisher, R. A. (1973). Statistical Methods and Scientific Inference, 3rd Edn. London: Collins Macmillan.
19. Franco, A., Malhotra, N., and Simonovits, G. (2014). Publication bias in the social sciences: unlocking the file drawer. Science 345, 1502-1505. doi: 10.1126/science.1255484.
20. Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychol. Methods 1, 379-390. doi: 10.1037/1082-989X.1.4.379.
21. Gigerenzer, G. (2004). Mindless statistics. J. Soc. Econ. 33, 587-606. doi: 10.1016/j.socec.2004.09.033.
22. Gill, P. M. W. (2007). Efficient calculation of p-values in linear-statistic permutation significance tests. J. Stat. Comput. Simul. 77, 55-61. doi: 10.1080/10629360500108053.
23. Goodman, S. N. (1993). P values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate. Am. J. Epidemiol. 137, 485-496.
24. Goodman, S. N. (1999). Toward evidence-based medical statistics. 1: the p-value fallacy. Ann. Intern. Med. 130, 995-1004. doi: 10.7326/0003-4819-130-12-199906150-00008.
25. Hagen, R. L. (1997). In praise of the null hypothesis statistical test. Am. Psychol. 52, 15-24. doi: 10.1037/0003-066X.52.1.15.
26. Hager, W. (2013). The statistical theories of Fisher and of Neyman and Pearson: a methodological perspective. Theor. Psychol. 23, 251-270. doi: 10.1177/0959354312465483.
27. Halpin, P. F., and Stam, H. J. (2006). Inductive inference or inductive behavior: fisher and Neyman-Pearson approaches to statistical testing in psychological research (1940-1960). Am. J. Psychol. 119, 625-653. doi: 10.2307/20445367.
28. Holland, B. S., and Copenhaver, M. D. (1987). An improved sequentially rejective Bonferroni test procedure. Biometrics 43, 417-423. doi: 10.2307/2531823.
29. Hubbard, R. (2004). Alphabet soup. Blurring the distinctions between p's and a's in psychological research. Theor. Psychol. 14, 295-327. doi: 10.1177/0959354304043638.
30. Huberty, C. J. (1987). On statistical testing. Educ. Res. 8, 4-9. doi: 10.3102/0013189X016008004.
31. Huberty, C. J. (1993). Historical origins of statistical testing practices: the treatment of Fisher versus Neyman-Pearson views in textbooks. J. Exp. Educ. 61, 317-333. doi: 10.1080/00220973.1993.10806593.
32. Johnstone, D. J. (1986). Tests of significance in theory and practice. Statistician 35, 491-504. doi: 10.2307/2987965.
33. Johnstone, D. J. (1987). Tests of significance following R. A. Fisher. Br. J. Philos. Sci. 38, 481-499. doi: 10.1093/bjps/38.4.481.
34. Jones, L. V., and Tukey, J. W. (2000). A sensible formulation of the significance test. Psychol. Methods 5, 411-414. doi: 10.1037/1082-989X.5.4.411.
35. Kline, R. B. (2004). Beyond Significance Testing. Reforming Data Analysis Methods in Behavioral Research. Washington, DC: APA.
36. Krueger, J. (2001). Null hypothesis significance testing. On the survival of a flawed method. Am. Psychol. 56, 16-26. doi: 10.1037/0003-066X.56.1.16.
37. Kruskal, W. (1980). The significance of Fisher: a review of R. A. Fisher: the life of a scientist. J. Am. Stat. Assoc. 75, 1019-1030. doi: 10.2307/2287199.
38. Lehman, E. L. (1993). The Fisher, Neyman-Pearson theories of testing hypothesis: one theory or two? J. Am. Stat. Assoc. 88, 1242-1249. doi: 10.1080/01621459.1993.10476404.
39. Lehmann, E. L. (2011). Fisher, Neyman, and the creation of classical statistics. New York, NY: Springer.
40. Lindley, D. V. (1965). Introduction to Probability and Statistics from a Bayesian Viewpoint, Part 1: Probability; Part 2: Inference. Cambridge: Cambridge University Press.
41. Lindquist, E. F. (1940). Statistical Analysis in Educational Research. Boston, MA: Houghton Mifflin.
42. Louçã, F. (2008). Should the Widest Cleft in Statistics-How and Why Fisher Opposed Neyman and Pearson. WP/02/2008/DE/UECE, Technical University of Lisbon. Available online at: http://www.iseg.utl.pt/departamentos/economia/wp/wp022008deuece.pdf.
43. Lovell, D. P. (2013). Biological importance and statistical significance. J. Agric. Food Chem. 61, 8340-8348. doi: 10.1021/jf401124y.
44. Ludbrook, J. (2013). Should we use one-sided or two-sided p values in tests of significance? Clin. Exp. Pharmacol. Physiol. 40, 357-361. doi: 10.1111/1440-1681.12086.
45. Macdonald, R. R. (1997). On statistical testing in psychology. Br. J. Psychol. 88, 333-347. doi: 10.1111/j.2044-8295.1997.tb02638.x.
46. Macdonald, R. R. (2002). The incompleteness of probability models and the resultant implications for theories of statistical inference. Underst. Stat. 1, 167-189. doi: 10.1207/S15328031US0103_03.
47. Newman, I., Fraas, J., and Herbert, A. (2001). "Testing non-nil null hypotheses with T tests of group means: a monte carlo study," in Annual Meeting Mid-Western Educational Research Association (Chicago, IL).
48. Neyman, J. (1935). On the problem of confidence intervals. Ann. Math. Stat. 6, 111-116. doi: 10.1214/aoms/1177732585.
49. Neyman, J. (1942). Basic ideas and some recent results of the theory of testing statistical hypotheses. J. R. Stat. Soc. 105, 292-327. doi: 10.2307/2980436.
50. Neyman, J. (1953). First Course in Probability and Statistics. New York, NY: Henry Holt.
51. Neyman, J. (1955). The problem of inductive inference. Commun. Pure Appl. Math. III, 13-46. doi: 10.1002/cpa.3160080103.
52. Neyman, J. (1956). Note on an article by Sir Ronald Fisher. J. R. Stat. Soc. Ser. B. Stat. Methodol. 18, 288-294.
53. Neyman, J. (1967). R. A. Fisher (1890-1962): an appreciation. Science 156, 1456-1460. doi: 10.1126/science.156.3781.1456.
54. Neyman, J., and Pearson, E. S. (1928). On the use and interpretation of certain test criteria for purposes of statistical inference: part I. Biometrika 20A, 175-240. doi: 10.2307/2331945.
55. Neyman, J., and Pearson, E. S. (1933). On the problem of the most efficient tests of statistical hypotheses. Philos. Trans. R. Soc. Lond. A 231, 289-337. doi: 10.1098/rsta.1933.0009.
56. Nickerson, R. S. (2000). Null hypothesis significance testing: a review of an old and continuing controversy. Psychol. Methods 5, 241-301. doi: 10.1037/1082-989X.5.2.241.
57. Nunnally, J. (1960). The place of statistics in psychology. Educ. Psychol. Meas. 20, 641-650. doi: 10.1177/001316446002000401.
58. Orlitzky, M. (2012). How can significance tests be deinstitutionalized? Organ. Res. Methods 15, 199-228. doi: 10.1177/1094428111428356.
59. Pearson, E. S. (1955). Statistical concepts in the relation to reality. J. R. Stat. Soc. Ser. B Stat. Methodol. 17, 204-207.
60. Pearson, E. S. (1990). 'Student' a Statistical Biography of William Sealy Gosset. Oxford: Claredon Press.
61. Perezgonzalez, J. D. (2014). A reconceptualization of significance testing. Theor. Psychol. 24, 852-859. doi: 10.1177/0959354314546157.
62. Perezgonzalez, J. D. (2015). Confidence intervals and tests are two sides of the same research question. Front. Psychol. 6:34. doi: 10.3389/fpsyg.2015.00034.
63. Rosenthal, R. (1984). Meta-Analytic Procedures for Social Research. Beverly Hills, CA: Sage.
64. Rosnow, R. L., and Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. Am. Psychol. 44, 1276-1284. doi: 10.1037/0003-066X.44.10.1276.
65. Savage, I. R. (1957). Nonparametric statistics. J. Am. Stat. Assoc. 52, 331-344. doi: 10.1080/01621459.1957.10501392.
66. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: implications for training of researchers. Psychol. Methods 1, 115-129. doi: 10.1037/1082-989X.1.2.115.
67. Spielman, S. (1973). A refutation of the Neyman-Pearson theory of testing. Br. J. Philos. Sci. 24, 201-222. doi: 10.1093/bjps/24.3.201.
68. Spielman, S. (1978). Statistical dogma and the logic of significance testing. Philos. Sci. 45, 120-135. doi: 10.1086/288784.
69. Tukey, J. W. (1977). Exploratory Data Analysis. Reading, MA: Addison-Wesley.
70. Wainer, H. (1999). One cheer for null hypothesis significance testing. Psychol. Methods 4, 212-213. doi: 10.1037/1082-989X.4.2.212.
71. Wald, A. (1950). Statistical Decision Functions. Ney York, NY: Wiley.
72. Wilkinson, L., and the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals. Guidelines and explanations. Am. Psychol. 54, 594-604. doi: 10.1037/0003-066X.54.8.594.
73. Williams, R. H., Zimmerman, D. W., Ross, D. C., and Zumbo, B. D. (2006). Twelve British Statisticians. Raleigh, NC: Boson Books.