Alphabet Soup: Blurring the Distinctions Betweenp’s anda’s in Psychological Research

Theory & Psychology

Volumn 14, Issue 3, 2004, Pages 295-327

  Hubbard, Raymond ^a  

^a DRAKE UNIVERSITY   (United States)

Author keywords

Fisher; hybrid statistical model; inductive behavior; inductive inference; Neyman Pearson

Indexed keywords

EID: 3042651101     PISSN: 09593543     EISSN: None     Source Type: Journal    
DOI: 10.1177/0959354304043638     Document Type: Article

References (103)

1. American Psychological Association. (1994). Publication manual of the American Psychological Association(4th ed.).Washington, DC: Author.
2. American Psychological Association. (2001). Publication manual of the American Psychological Association(5th ed.).Washington, DC: Author.
3. Anderson, D.R.,Burnham, K.P., &Thompson, W.(2000).Null hypothesis testing: Problems, prevalence, and an alternative. Journal of Wildlife Management, 64,912–923.
4. Barnard, G.A.(1985). A coherent view of statistical inference.Technical Report Series,Department of Statistics & Actuarial Science, University of Waterloo, Ontario, Canada.
5. Berger, J.O., &Delampady, M.(1987).Testing precise hypotheses(with comments). Statistical Science, 2,317–352.
6. Carlson, R.(1976).The logic of tests of significance. Philosophy of Science, 43,116–128.
7. Carver, R.P.(1978).The case against statistical significance testing. Harvard Educational Review, 48,378–399.
8. Chow, S.L.(1996). Statistical significance: Rationale, validity and utility. Thousand Oaks, CA: Sage.
9. Chow, S.L.(1998).Pr¥ecis of statistical significance: Rationale, validity and utility(with comments). Behavioral and Brain Sciences, 21,169–239.
10. Clark, C.M.(1999).Further considerations of null hypothesis testing. Journal of Clinical and Experimental Neuropsychology, 21,283–284.
11. Clark-Carter, D.(1997).The account taken of statistical power in research published in the British Journal of Psychology. British Journal of Psychology, 88,71–83.
12. Cohen, J.(1990).Things I have learned(so far). American Psychologist, 45,1304–1312.
13. Cohen, J.(1994).The earth is round(p<.05). American Psychologist, 49,997–1003.
14. Cornfield, J.(1966),Sequential trials, sequential analysis, and the likelihood principle. The American Statistician, 20,18–23.
15. Cortina, J.M., &Dunlap, W.P.(1997).On the logic and purpose of significance testing. Psychological Methods, 2,161–172.
16. Cumming, G., &Finch, S.(2001).A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61,532–574.
17. Daniel, L.G.(1998).Statistical significance testing: A historical overview of misuse and misinterpretation with implications for the editorial policies of educational journals. Research in the Schools, 5,23–32.
18. Dar, R.,Serlin, R.C., &Omer, H.(1994).Misuse of statistical tests in three decades of psychotherapy research. Journal of Consulting and Clinical Psychology, 62,75–82.
19. Dixon, P., &O’Reilly, T.(1999).Scientific versus statistical inference. Canadian Journal of Experimental Psychology, 53,133–149.
20. Falk, R., &Greenbaum, C.W.(1995).Significance tests die hard: The amazing persistence of a probabilistic misconception. Theory & Psychology, 5,75–98.
21. Fidler, F.(2002).The fifth edition of the APA Publication Manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement, 62,749–770.
22. Finch, S.,Cumming, G., &Thomason, N.(2001).Reporting of statistical inference in the Journal of Applied Psychology: Little evidence of reform. Educational and Psychological Measurement, 61,181–210.
23. Fisher, R.A.(1925). Statistical methods for research workers. Edinburgh: Oliver & Boyd.
24. Fisher, R.A.(1929).The statistical method in psychical research. Proceedings of the Society for Psychical Research, London, 39,189–192.
25. Fisher, R.A.(1935 a). The design of experiments. Edinburgh: Oliver & Boyd.
26. Fisher, R.A.(1935 b).Statistical tests. Nature, 136,474-474.
27. Fisher, R.A.(1950). Contributions to mathematical statistics.London: Chapman & Hall.
28. Fisher, R.A.(1955).Statistical methods and scientific induction. Journal of the Royal Statistical Society, B, 17,69–78.
29. Fisher, R.A.(1956). Statistical methods and scientific inference. Edinburgh: Oliver & Boyd.
30. Fisher, R.A.(1958).The nature of probability. The Centennial Review of Arts and Sciences, 2,261–274.
31. Fisher, R.A.(1959). Statistical methods and scientific inference(2nd rev. ed.).Edinburgh: Oliver & Boyd.
32. Fisher, R.A.(1966). The design of experiments(8th ed.). Edinburgh: Oliver & Boyd.
33. Frick, R.W.(1996).The appropriate use of null hypothesis testing. Psychological Methods, 1,379–390.
34. Gibbons, J.D., &Pratt, J.W.(1975).P-values: Interpretation and methodology. The American Statistician, 29,20–25.
35. Gigerenzer, G.(1993). The superego, the ego, and the id in statistical reasoning. In G. Keren&C.A. Lewis(Eds.), A handbook for data analysis in the behavioral sciences–Methodological issues(pp. 311–339).Hillsdale, NJ: Erlbaum.
36. Gigerenzer, G., &Murray, D.J.(1987). Cognition as intuitive statistics. Hillsdale, NJ: Erlbaum.
37. Gigerenzer, G.,Swijtink, Z.,Porter, T.,Daston, L.,Beatty, J., &Kruger, L.(1989). The empire of chance. New York: Cambridge University Press.
38. Goodman, S.N.(1992).A comment on replication, P-values and evidence. Statistics in Medicine, 11,875–879.
39. Goodman, S.N.(1993).pvalues, hypothesis tests, and likelihood: Implications for epidemiology of a neglected historical debate. American Journal of Epidemiology, 137,485–496.
40. Goodman, S.N.(1999).Toward evidence-based medical statistics. 1: The Pvalue fallacy. Annals of Internal Medicine, 130,995–1004.
41. Grayson, D.,Pattison, P., &Robins, G.(1997).Evidence, inference, and the ‘rejection’ of the significance test. Australian Journal of Psychology, 49,64–70.
42. Hacking, I.(1965). Logic of statistical inference. New York: Cambridge University Press.
43. Hinkley, D.V.(1987).Comment. Journal of the American Statistical Association, 82,128–129.
44. Hogben, L.(1957). Statistical theory. New York: Norton.
45. Hubbard, R.(1995).The earth is highly significantly round(p<.0001). American Psychologist, 50,1098-1098.
46. Hubbard, R., &Lindsay, R.M.(2002).How the emphasis on ‘original’ empirical marketing research impedes knowledge development. Marketing Theory, 2,381–402.
47. Hubbard, R.,Parsa, R.A., &Luthy, M.R.(1997).The spread of statistical significance testing in psychology: The case of the Journal of Applied Psychology, 1917–1994. Theory & Psychology, 7,545–554.
48. Hubbard, R., &Ryan, P.A.(2000).The historical growth of statistical significance testing in psychology–and its future prospects. Educational and Psychological Measurement, 60,661–681.
49. Huberty, C.J.(1993).Historical origins of statistical testing practices: The treatment of Fisher versus Neyman–Pearson views in textbooks. Journal of Experimental Education, 61,317–333.
50. Huberty, C.J., &Pike, C.J.(1999). On some history regarding statistical testing. In B. Thompson(Ed.), Advances in social science methodology(Vol. 5, pp. 1–22).Stamford, CT: JAI Press.
51. Hyde, J.S.(2001).Reporting effect sizes: The roles of editors, textbook authors, and publication manuals. Educational and Psychological Measurement, 61,225–228.
52. Johnstone, D.J.(1986).Tests of significance in theory and practice(with comments). The Statistician, 35,491–504.
53. Johnstone, D.J.(1987 a). On the interpretation of hypothesis tests following Neyman and Pearson. In R. Viertl(Ed.), Probability and Bayesian statistics(pp. 311–339).New York: Plenum.
54. Johnstone, D.J.(1987 b).Tests of significance following R.A. Fisher. The British Journal for the Philosophy of Science, 38,481–499.
55. Kempthorne, O.(1976).Of what use are tests of significance and tests of hypothesis. Communications in Statistics–Theory and Methods, A5(8),763–777.
56. Keuzenkamp, H.A., &Magnus, J.R.(1995).On tests and significance in econometrics. Journal of Econometrics, 67,5–24.
57. Kirk, R.E.(1996).Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56,746–759.
58. Krantz, D.H.(1999).The null hypothesis testing controversy in psychology. Journal of the American Statistical Association, 44,1372–1381.
59. Krueger, J.(2001).Null hypothesis significance testing: On the survival of a flawed method. American Psychologist, 56,16–26.
60. Kyburg, H.E.(1974). The logical foundations of statistical inference. Dordrecht: Reidel.
61. Leavens, D.A., &Hopkins, W.D.(1998).Intentional communication by chimpanzees: A cross-sectional study of the use of referential gestures. Developmental Psychology, 34,813–822.
62. LeCam, L., &Lehmann, E.L.(1974).J. Neyman: On the occasion of his 80th birthday. The Annals of Statistics, 2,vii–xiii.
63. Lehmann, E.L.(1993).The Fisher, Neyman-Pearson theories of testing hypotheses: One theory or two? Journal of the American Statistical Association, 88,1242–1249.
64. Lindsay, R.M.(1995).Reconsidering the status of tests of significance: An alternative criterion of adequacy. Accounting, Organizations and Society, 20,35–53.
65. Loftus, G.R.(1996).Psychology will be a much better science when we change the way we analyze data. Psychological Science, 7,161–171.
66. Macdonald, R.R.(1997).On statistical testing in psychology. British Journal of Psychology, 88,333–347.
67. McCloskey, D.N., &Ziliak, S.T.(1996).The standard error of regressions. Journal of Economic Literature, 34,97–114.
68. Meehl, P.E.(1967).Theory-testing in psychology and physics: A methodological paradox. Philosophy of Science, 34,103–115.
69. Mulaik, S.A.,Raju, N.S., &Harshman, R.A.(1997). There is a time and a place for significance testing. In L.L. Harlow, S.A. Mulaik, &J.H. Steiger(Eds.), What if there were no significance tests?(pp. 65–116).Hillsdale, NJ: Erlbaum.
70. Nester, M.R.(1996).An applied statistician’s creed. Applied Statistics, 45,401–410.
71. Neyman, J.(1942).Basic ideas and some recent results of the theory of testing statistical hypotheses. Journal of the Royal Statistical Society, 105,292–327.
72. Neyman, J.(1950). First course in probability and statistics. New York: Holt.
73. Neyman, J.(1957).‘Inductive behavior’ as a basic concept of philosophy of science. International Statistical Review, 25,7–22.
74. Neyman, J.(1961).Silver jubilee of my dispute with Fisher. Journal of the Operations Research Society of Japan, 3,145–154.
75. Neyman, J.(1962).Two breakthroughs in the theory of statistical decision making. Review of the International Statistical Institute, 30,11–27.
76. Neyman, J.(1967).R.A. Fisher (1890–1962), an appreciation. Science, 156,1456–1460.
77. Neyman, J.(1971). Foundations of behavioristic statistics (with comments). In V.P. Godambe&D.A. Sprott(Eds.), Foundations of statistical inference(pp. 1–19).Toronto: Holt, Rinehart & Winston of Canada.
78. Neyman, J.(1977).Frequentist probability and frequentist statistics. Synthese, 36,97–131.
79. Neyman, J., &Pearson, E.S.(1928 a).On the use and interpretation of certain test criteria for purposes of statistical inference. Part I. Biometrika, 20A,175–240.
80. Neyman, J., &Pearson, E.S.(1928 b).On the use and interpretation of certain test criteria for purposes of statistical inference. Part II. Biometrika, 20A,263–294.
81. Neyman, J., &Pearson, E.S.(1933).On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London, Ser. A, 231,289–337.
82. Nickerson, R.S.(2000).Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5,241–301.
83. Nix, T.W., &Barnette, J.J.(1998).The data analysis dilemma: Ban or abandon. A review of null hypothesis significance testing. Research in the Schools, 5,3–14.
84. Oakes, M.(1986). Statistical inference: A commentary for the social and behavioral sciences. New York: Wiley.
85. Pearson, E.S.(1962).Some thoughts on statistical inference. Annals of Mathematical Statistics, 33,394–403.
86. Pearson, E.S.(1990). ‘ Student’ a statistical biography of William Sealy Gosset.Oxford: Clarendon Press.
87. Pearson, K.(1900).On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. London, Edinburgh and Dublin Philosophical Magazine and Journal of Science, 50,157–175.
88. Reid, C.(1982). Neyman–from life. Berlin: Springer-Verlag.
89. Rosnow, R.L., &Rosenthal, R.(1989).Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44,1276–1284.
90. Royall, R.M.(1997). Statistical evidence: A likelihood paradigm. New York: Chapman & Hall.
91. Rozeboom, W.W.(1960).The fallacy of the null-hypothesis significance test. Psychological Bulletin, 57,416–428.
92. Sawyer, A.G., &Peter, J.P.(1983).The significance of statistical significance tests in marketing research. Journal of Marketing Research, 20,122–133.
93. Schmidt, F.L.(1996).Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1,115–129.
94. Seidenfeld, T.(1979). Philosophical problems of statistical inference: Learning from R.A. Fisher. Dordrecht: Reidel.
95. Spielman, S.(1974).The logic of tests of significance. Philosophy of Science, 41,211–226.
96. Thompson, B.(1994 a).Guidelines for authors. Educational and Psychological Measurement, 54,837–847.
97. Thompson, B.(1994 b).The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample results. Journal of Personality, 62,157–176.
98. Thompson, B.(1997).Editorial policies regarding statistical significance tests: Further comments. Educational Researcher, 26,29–32.
99. Thompson, B.(1999).If statistical significance tests are broken/misused, what practices should supplement or replace them? Theory & Psychology, 9,165–181.
100. Thompson, B.(2002).What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31,25–32.
101. Tryon, W.W.(1998).The inscrutable null hypothesis. American Psychologist, 53,796-796.
102. Wilkinson, L., &the APA Task Force on Statistical Inference. (1999).Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54,594–604.
103. Zabell, S.L.(1992) Fisher and the fiducial argument. Statistical Science, 7,369–387.