Publication bias in sport and exercise psychology: The games we play

International Journal of Sport Psychology

Volumn 32, Issue 4, 2001, Pages 386-399

  Spence, John C ^a   Blanchard, Chris ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Exercise psychology; Null hypothesis testing; Publication bias; Sport psychology; Statistical significance

Indexed keywords

EID: 0035486226     PISSN: 00470767     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (56)

1. Abelson, R. P. (1997). On the surprising longevity of flogged horses: Why there is a case for the significance test. Psychological Science, 8, 12-15.
2. American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
3. Angell, M. (1989). Negative studies. New England Journal of Medicine, 321, 464-466.
4. Atkinson, D. R., Furlong, M. J., & Wampold, B. E. (1982). Statistical significance, reviewer evaluations, and the scientific process: Is there a (statistically) significant relationship? Journal of Counseling Psychology, 29, 189-194.
5. Begg, C. B. (1994). Publication bias. In H. Cooper, & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 400-409). New York: Russell Sage Foundation.
6. Bozarth, J. D., & Roberts, R. R. (1972). Signifying significant significance. American Psychologist, 27, 774-775.
7. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
8. Cohen, J. (1994). The earth is round (p<.05). American Psychologist, 49, 997-1003.
9. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton Mifflin.
10. Cooper, H., DeNeve, K., & Charlton, K. (1997). Finding the missing science: The fate of studies submitted for review by a human subjects committee. Psychological Methods, 2, 447-452.
11. Coursol, A., & Wagner, E. (1986). Effect of positive findings on submission and acceptance rates: A note on meta-analysis bias. Professional Psychology, 17, 136-137.
12. Desharnais, R., Jobin, J., Cote, C., Levesque, L., & Godin, G. (1993). Aerobic exercise and the placebo effect: A controlled study. Psychosomatic Medicine, 55, 149-154.
13. Dickersin, K. (1990). The existence of publication bias and risk factors for its occurrence. JAMA, 263, 1385-1389.
14. Easterbrook, P. J., Berlin, J. A., Gopalan, R., & Matthews, D. R. (1991). Publication bias in clinical research. Lancet, 337, 867-872.
15. Falk, R., & Greenbaum, C. W. (1995). Significance tests die hard: The amazing persistence of a probabilistic misconception. Theory & Psychology, 5, 75-98.
16. Fowler, R. L. (1985). Testing for substantive significance in applied research by specifying nonzero effect null hypotheses. Journal of Applied Psychology, 70, 215-218.
17. Freiman, J. A., Chalmers, T. C., Smith, H., Kuebler, R. R. (1978). The importance of beta, the type II error and sample size in the design and interpretation of the randomized controlled trial: Survey of 71 "negative" trials. New England Journal of Medicine, 299, 690-694.
18. Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods, 1, 379-390.
19. Gauvin, L., Spence, J. C., & Anderson, S. (1999). Exercise and psychological well-being in the adult population: Reality or wishful thinking?. In J. M. Rippe (Ed.), Lifestyle medicine (pp. 957-966). Maiden, MA: Blackwell Science.
20. Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychology Bulletin, 82, 1-20.
21. Harlow, L. L., Muliak, S. A., & Steiger, J. H. (Eds.). (1997). What if there were no significance tests? Mahwah, NJ: Lawrence Erlbaum Associates.
22. Hedges, L. V. (1984). Estimation of effect size under nonrandom sampling: The effects of cenr soring studies yielding statistically insignificant mean differences. Journal of Educational Statistics, 9, 61-85.
23. Jones, B. J., & Brewer, J. K. (1972). An analysis of the power of statistical tests reported in the Research Quarterly. Research Quarterly for Exercise and Sport, 43, 23-30.
24. Lane, D. M., & Dunlop, W. P. (1978). Estimating effect size: Bias resulting from the significance criterion in editorial decisions. British Journal of Mathematical and Statistical Psychology, 31, 107-112.
25. Light, R. J., & Smith, P. V. (1971). Accumulating evidence: Procedure for resolving contradictions among different research studies. Harvard Educational Review, 47, 429-471.
26. Lykken, D. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151-159.
27. Mahoney, M. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research, 1, 161-175.
28. McNemar, Q. (1960). At random: Sense and nonsense. American Psychologist, 15, 295-300.
29. Meehl, P. E. (1967). Theory-testing in psychology and physics: A methodological paradox. Philosophy of Science, 34, 103-115.
30. Mills, J. L. (1993). Data torturing. New England Journal of Medicine, 329, 1196-1199.
31. Morrison, D. E., & Henkel, R. E. (Eds.) (1970). The significance test controversy: A reader. Chicago: Aldine Publishing Company.
32. Nickerson, R. S. (2000). Null hypothesis testing: A review of an old and continuing controversy. Psychological Methods, 5, 241-301.
33. North, T. C., McCullagh, P., & Tran, Z. V. (1990). Effect of exercise on depression. Exercise and Sport Sciences Reviews, 18, 379-415.
34. Oakes, M. (1986). Statistical inference: A commentary for the social and behavioural sciences. Chichester, England: John Wiley & Sons.
35. Petruzzello, S. J., Landers, D. M., Hatfield, B. D., Kubitz, K. A., & Salazar, W. (1991). A meta-analysis on the anxiety-reducing effects of acute and chronic exercise: Outcomes and mechanisms. Sports Medicine, 11, 143-182.
36. Popper, K. R. (1959). The logic of scientific discovery. New York: Basic Books.
37. Rosenthal, R. (1979). The "file drawer problem" and tolerance for null results. Psychological Bulletin, 86, 638-641.
38. Rossi, J. S. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646-656.
39. Rozeboom, W. W. (1997). Good science is abductive, not hypothetico-deductive. In L. L. Harlow, S. A. Muliak, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 335-391). Mahwah, NJ: Lawrence Erlbaum Associates.
40. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training researchers. Psychological Methods, 1, 115-129.
41. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
42. Shadish, W. R., Doherty, M., & Montgomery, L. M. (1989). How many studies in the file drawer? An estimate from the family/marital psychotherapy literature. Clinical Psychology Review, 9, 589-603.
43. Simes, R. J. (1987). Confronting publication bias: A cohort design for meta-analysis. Statistics in Medicine, 6, 11-29.
44. Smart, R. G. (1964). The importance of negative results in psychological research. Canadian Psychologist, 5a, 225-232.
45. Smith, N. C. (1970). Replication studies: A neglected aspect of psychological research. American Psychologist, 25, 970-975.
46. Solomon, C. R. (1998). Psychology of the scientist: LXXII. About publishing: A commentary. Psychological Reports, 82, 17-18.
47. Speed, H. D., & Andersen, M. B. (1997). Powerless in the face of small effects: Power in sport psychology research (abstract). Journal of Applied Sport Psychology, 9(Suppl.), S158.
48. Sterling, T. D. (1959). Publication decision and the possible effects on inferences drawn from tests of significance - or vice versa. Journal of the American Statistical Association, 54, 30-34.
49. Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995). Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. The American Statistician, 49, 108-112.
50. Stern, J. M., & Simes, R. J. (1997). Publication bias: Evidence of delayed publication in a cohort study of clinical research projects. British Medical Journal, 315, 640-645.
51. Sutlive, V. H., & Ulrich, D. A. (1998). Interpreting statistical significance and meaningfulness in adapted physical activity research. Adapted Physical Activity Quarterly, 15, 103-118.
52. Thomas, J. R., Lochbaum, M. R., Landers, D. M., & He, C. (1997). Planning significant and meaningful research in exercise science: Estimating sample size. Research Quarterly for Exercise and Sport, 68, 33-43.
53. Thomas, J. R., Salazar, W., & Landers, D. M. (1991). What is missing in p<.05? Effect size. Research Quarterly for Exercise and Sport, 62, 344-348.
54. Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25(2), 26-30.
55. Wang, M. C., & Bushman, B. J. (1998). Using the normal quantile plot to explore meta-analytic data sets. Psychological Methods, 3, 46-54.
56. Wilkinson, L., & the Task Force on Statistical Inference (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.