A communication researchers' guide to null hypothesis significance testing and alternatives

Human Communication Research

Volumn 34, Issue 2, 2008, Pages 188-209

  Levine, Timothy R ^a   Weber, René ^b   Park, Hee Sun ^a   Hullett, Craig R ^c  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF ARIZONA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 41149126604     PISSN: 03603989     EISSN: 14682958     Source Type: Journal    
DOI: 10.1111/j.1468-2958.2008.00318.x     Document Type: Article

References (49)

1. Abelson, R. P 1985). A variance explanation paradox: When little is a lot. Psychological Bulletin, 97, 129 133.
2. Abelson, R. P. (1997). A retrospective on the significance test ban of 1999 (if there were no significance tests, they would be invented). In L. L. Harlow, S. A. Mulaik J. H. Steiger (Eds What if there were no significance tests? (pp. 117 141). Mahwah, NJ : LEA.
3. Aiken, L. S. West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA : Sage.
4. Alf, E. F. Jr. Graf, R. G. (1999). Asymptotic confidence limits for the difference between two squared multiple correlations: A simplified approach. Psychological Methods, 4, 70 75.
5. Azen, R. Budescu, D. V. (2003). The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods, 8, 129 148.
6. Bird, K 2002). Confidence intervals for effect sizes in analysis of variance. Educational and Psychological Measurement, 62, 197 226.
7. Bond, C. F. Jr. DePaulo, B. M. (2006). Accuracy of deception judgments. Review of Personality and Social Psychology, 10, 214 234.
8. Budescu, D. V. (1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542 551.
9. Burgoon, J. K., Buller, D. B., Dillman, L. Walther, J. B. (1995). Interpersonal deception IV. Effects of suspicion on perceived communication and nonverbal behavior dynamics. Human Communication Research, 22, 163 196.
10. Bushman, B. J. Anderson, C. A. (2001). Media violence and the American public. American Psychologist, 56, 477 489.
11. Canary, D. J. Hause, K. S. (1993). Is there any reason to research sex differences in communication? Communication Quarterly, 41, 129 144.
12. Carson, K. P., Schriesheim, C. A. Kinicki, A. J. (1990). The usefulness of the "fail-safe" statistic in meta-analysis. Educational and Psychological Measurement, 50, 233 243.
13. Cohen, J 1988). Statistical power analysis for the behavioral sciences (2nd ed Hillsdale, NJ : LEA.
14. Cohen, J., Cohen, P., West, S. G. Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed Mahwah, NJ : LEA.
15. Courville, T. Thompson, B 2001). Use of structure coefficients in published multiple regression articles: B is not enough. Educational and Psychological Measurement, 61, 229 248.
16. Cumming, G. Finch, S 2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 532 574.
17. Cumming, G. Finch, S 2005). Confidence intervals and how to read pictures of data. American Psychologist, 60, 170 180.
18. Ferguson, C. J. (2007). Evidence for publication bias in video game violence effects literature: A meta-analytic review. Aggression and Violent Behavior, 12, 470 482.
19. Ferguson, G. A. (1966). Statistical analysis in psychology and education. New York : McGraw-Hill.
20. Fidler, F. Thompson, B 2001). Computing confidence intervals for ANOVA fixed- and random-effects effect sizes. Educational and Psychological Measurement, 61, 575 604.
21. Fowler, R. L. (1985). Testing for substantive significance in applied research by specifying nonzero effect null hypotheses. Journal of Applied Psychology, 70, 215 218.
22. Graf, R. G. Alf, E. F. Jr. 1999). Correlations redux: Asymptotic confidence limits for partial and squared multiple correlations. Applied Psychological Measurement, 23, 116 119.
23. Hoenig, J. M. Heisey, D. M. (2001). The abuse of power: The pervasive fallacy of power calculations for data analysis. American Statistician, 55, 19 24.
24. Hullet, C. R. Levine, T. R. (2003). The overestimation of effect sizes from F values in meta-analysis: The cause and a solution. Communication Monographs, 70, 52 67.
25. Hunter, J. E. Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA : Sage.
26. Klemmert, H 2004). Äquivalenz- und Effekttests in der psychologischen Forschung Equivalence and effect tests in psychological research Frankfurt/Main, Germany : Peter Lang.
27. Kraemer, H. C. Thiemann, S 1987). How many subjects? Statistical power analysis in research. Beverly Hills, CA : Sage.
28. Levine, T. R. (2001). Dichotomous and continuous views of deception: A reexamination of deception ratings in information manipulation theory. Communication Research Reports, 18, 230 240.
29. Levine, T. R. Hullett, C 2002). Eta-square, partial eta-square, and misreporting of effect size in communication research. Human Communication Research, 28, 612 625.
30. Levine, T. R., Weber, R., Hullett, C. R., Park, H. S. Lindsey, L 2008). A critical assessment of null hypothesis significance testing in quantitative communication research. Human Communication Research, 34, 171 187.
31. Meehl, P. E. (1986). What social scientists don't understand. In D. W. Fiske R. A. Shweder (Eds Meta-theory in social science (pp. 315 338). Chicago : University of Chicago Press.
32. Mendoza, J. L. Stafford, K. L. (2001). Confidence intervals, power calculation, and sample size estimation for the squared multiple correlation coefficient under the fixed and random regression models: A computer program and useful standard tables. Educational and Psychological Measurement, 61, 650 667.
33. Murphy, K. R. Myors, B 1999). Testing the hypothesis that treatments have negligible effects: Minimum-effect tests in the general linear model. Journal of Applied Psychology, 84, 234 248.
34. Natrella, M. G 1960). The relation between confidence intervals and tests of significance - A teaching aid. American Statistician, 14, 20 38.
35. Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241 301.
36. O'Keefe, D. J. (in press). Post hoc power, observed power, a priori power, retrospective power, prospective power, achieved power: Sorting out appropriate uses of statistical power analyses. Communication Methods and Measures.
37. Park, H. S., Levine, T. R., Kingsley Westerman, C. Y., Orfgen, T. Foregger, S 2007). The effects of argument quality and involvement type on attitude formation and attitude change: A test of dual-process and social judgment predictions. Human Communication Research, 33, 81 102.
38. Pedhazur, E. J. (1997). Multiple regression in behavioral research (3rd ed Forth Worth, TX : Harcourt.
39. Plomin, R. Spinath, F. M. (2004). Intelligence: Genetics, genes, and genomics. Journal of Personality and Social Psychology, 86, 112 129.
40. Prentice, D. A. Miller, D. T. (1992). When small effects are impressive. Psychological Bulletin, 112, 160 164.
41. Richard, F. D., Bond, C. F. Stokes-Zoota, J. J. (2003). One hundred years of social psychology quantitatively described. Review of General Psychology, 7, 331 363.
42. Rosenthal, R 1979). The "file drawer problem" and tolerance for null results. Psychological Bulletin, 86, 638 641.
43. Rozin, P 2001). Social psychology and science: Some lessons from Solomon Asch. Personality and Social Psychology Review, 5, 2 14.
44. Schmidt, F. L. Hunter, J. E. (1997). Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In L. L. Harlow, S. A. Mulaik J. H. Steiger (Eds What if there were no significance tests? (pp. 37 64). Mahwah, NJ : LEA.
45. Smithson, M 2001). Correct confidence intervals for various regression effect sizes and parameters: The importance of noncentral distributions in computing intervals. Educational and Psychological Measurement, 61, 605 632.
46. Thompson, B 2007). Effect sizes, confidence intervals, and confidence intervals for effect sizes. Psychology in the Schools, 44, 423 432.
47. Thompson, B. Borrello, G. M. (1985). The importance of structure coefficients in regression research. Educational and Psychological Measurement, 45, 203 209.
48. Trafimow, D 2003). Hypothesis testing and theory evaluation at the boundaries: Surprising insights from Bayes's theorem. Psychological Review, 110, 526 535.
49. Weber, R., Levine, T. R. Klemmert, H 2007). Testing equivalence in communication research. Manuscript submitted for publication.