Computing contrasts, effect sizes, and counternulls on other people's published data: General procedures for research consumers

Psychological Methods

Volumn 1, Issue 4, 1996, Pages 331-340

  Rosnow, Ralph L ^a   Rosenthal, Robert ^b,c  

^a TEMPLE UNIVERSITY   (United States)

^b HARVARD UNIVERSITY   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000099239     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.1.4.331     Document Type: Article

References (47)

1. Abelson, R. P. (1985). A variance explanation paradox: When a little is a lot. Psychological Bulletin, 97, 129-133.
2. American Psychological Association. (1983). Publication manual of the American Psychological Association (3rd ed.). Washington, DC: Author.
3. American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
4. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 1-29.
5. Cohen, J. (1962). The statistical power of abnormal-social psychological research. Journal of Abnormal and Social Psychology, 65, 145-153.
6. Cohen, J. (1965). Some statistical issues in psychological research. In B. B. Wolman (Ed.), Handbook of clinical psychology (pp. 95-121). New York: McGraw-Hill.
7. Cohen, J. (1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.
8. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
9. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
10. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
11. Haase, R. F., Waechter, D. M., & Solomon, G. S. (1982). How significant is a significant difference? Average effect size of research in counseling psychology. Journal of Counseling Psychology, 29, 58-65.
12. Hale, G. A. (1977). On use of ANOVA in developmental research. Child Development, 48, 1101-1106.
13. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.
14. Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984). Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15, 336-352.
15. Judd, C. M., McClelland, G. H., & Culhane, S. E. (1995). Data analysis: Continuing issues in the everyday analysis of psychological data. Annual Review of Psychology, 46, 433-465.
16. Kendall, P. C., & Grove, W. M. (1988). Normative comparisons in therapy outcome. Behavioral Assessment, 10, 147-158.
17. Keppel, G. (1991). Design and analysis: A researcher's handbook (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
18. Kirk, R. (1995). Experimental design: Procedures for the behavioral sciences (3rd ed.). Pacific Grove, CA: Brooks/Cole.
19. Kraemer, H. C., & Thiemann, S. (1987). How many subjects? Statistical power analysis in research. Beverly Hills, CA: Sage.
20. Nelson, N., Rosenthal, R., & Rosnow, R. L. (1986). Interpretation of significance levels and effect sizes by psychological researchers. American Psychologist, 41, 1299-1301.
21. Ozer, D. J. (1985). Correlation and the coefficient of determination. Psychological Bulletin, 97, 307-315.
22. Paquin, M. J. R. (1983). Beyond significant yet meaningless results in psychotherapy research. Psychotherapy: Theory, Research and Practice, 20, 38-40.
23. Rosenthal, R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775-777.
24. Rosenthal, R. (1994). Parametric measures of effect size. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 231-244). New York: Russell Sage Foundation.
25. Rosenthal, R. (1995a). Progress in clinical psychology: Is there any? Clinical Psychology: Science and Practice, 2, 133-150.
26. Rosenthal, R. (1995b). Writing meta-analytic reviews. Psychological Bulletin, 118, 183-192.
27. Rosenthal, R., & Rosnow, R. L. (1985). Contrast analysis: Focused comparisons in the analysis of variance. New York: Cambridge University Press.
28. Rosenthal, R., & Rosnow, R. L. (1991). Essentials of behavioral research: Methods and data analysis (2nd ed.). New York: McGraw-Hill.
29. Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1996). Contrast analysis in behavioral research. Unpublished manuscript, Harvard University, Cambridge, MA.
30. Rosenthal, R., & Rubin, D. B. (1982). A simple general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166-169.
31. Rosenthal, R., & Rubin, D. B. (1984). Multiple contrasts and ordered Bonferonni procedures. Journal of Educational Psychology, 76, 1028-1034.
32. Rosenthal, R., & Rubin, D. B. (1994). The counternull value of an effect size: A new statistic. Psychological Science, 5, 329-334.
33. Rosnow, R. L., & Rosenthal, R. (1988). Focused tests of significance and effect size estimation in counseling psychology. Journal of Counseling Psychology, 35, 203-208.
34. Rosnow, R. L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
35. Rosnow, R. L., & Rosenthal, R. (1995). "Some things you learn aren't so": Cohen's paradox, Asch's paradigm, and the interpretation of interaction. Psychological Science, 6, 3-9.
36. Rosnow, R. L., & Rosenthal, R. (1996a). Beginning behavioral research: A conceptual primer (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
37. Rosnow, R. L., & Rosenthal, R. (1996b). Contrasts and interactions redux: Five easy pieces. Psychological Science, 7, 253-257.
38. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
39. Serlin, R. C., & Lapsley, D. K. (1985). Rationality in psychological research: The good-enough principle. American Psychologist, 40, 78-83.
40. Snedecor, G. (1956). Statistical methods (5th ed.). Ames: Iowa State College Press.
41. Steering Committee of the Physicians' Health Study Research Group. (1988). Preliminary report: Findings from the aspirin component of the ongoing physicians' health study. New England Journal of Medicine, 318, 262-264.
42. Tatsuoka, M. (1993). Effect size. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 461-479). Hillsdale, NJ: Erlbaum.
43. Thompson, B. (Ed.). (1993). Statistical significance testing in contemporary practice: Some proposed alternatives with comments from journal editors [Special issue]. Journal of Experimental Education, 61(4).
44. Tukey, J. W. (1969). Analyzing data: Sanctification or detective work? American Psychologist, 24, 83-91.
45. Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
46. Tukey, J. W. (1991). The philosophy of multiple comparisons. Statistical Science, 6, 100-116.
47. Zuckerman, M., Hodgins, H. S., Zuckerman, A., & Rosenthal, R. (1993). Contemporary issues in the analysis of data: A survey of 551 psychologists. Psychological Science, 4, 49-53.