Power and Measures of Effect Size in Analysis of Variance with Fixed Versus Random Nested Factors

Psychological Methods

Volumn 8, Issue 4, 2003, Pages 497-517

  Siemer, Matthias ^a   Joormann, Jutta ^b  

^a UNIVERSITY OF GREIFSWALD   (Germany)

^b RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; EPIDEMIOLOGY; HUMAN; MONTE CARLO METHOD; OUTCOME ASSESSMENT; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL; STATISTICS;

ANALYSIS OF VARIANCE; BIAS (EPIDEMIOLOGY); HUMANS; MONTE CARLO METHOD; OUTCOME ASSESSMENT (HEALTH CARE); PSYCHOMETRICS; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIALS;

EID: 0346199347     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.8.4.497     Document Type: Article

References (37)

1. Beutler, L. E., Machado, P. P., & Allstetter Neufeldt, S. (1994). Therapist variables. In E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 229-269). New York: Wiley.
2. Bonge, D. R., Schuldt, W. J., & Harper, Y. Y. (1992). The experimenter-as-fixed-effects fallacy. The Journal of Psychology, 126, 477-486.
3. Clark, H. H. (1973). The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior, 12, 335-359.
4. Clark, H. H. (1976). Reply to Wike & Church. Journal of Verbal Learning and Verbal Behavior, 15, 249-255.
5. Cohen, J. (1976). Random means random. Journal of Verbal Learning and Verbal Behavior, 15, 261-262.
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
7. 2 a source of Type 1 or Type 2 error? Journal of Verbal Learning and Verbal Behavior, 18, 243-256.
8. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation. Design and analysis issues for field settings. Chicago: Rand McNally.
9. Crits-Christoph, P., & Mintz, J. (1991). Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. Journal of Consulting and Clinical Psychology, 59, 20-26.
10. Durham, D. C., Murphy, T., Allan, T., Richard, K., Treliving, L. R., & Fenton, G. W. (1994). Cognitive therapy, analytic therapy, and anxiety management training for generalized anxiety disorder. British Journal of Psychiatry, 165, 973-982.
11. Elkin, I. (1994). The NIMH Treatment of Depression Collaborative Research Program: Where we began and where we are. In S. L. Garfield & A. E. Bergin (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 114-139). New York: Wiley.
12. Elkin, I. (1999). A major dilemma in psychotherapy outcome research: Disentangling therapists from therapies. Clinical Psychology: Science and Practice, 6, 10-32.
13. Hopkins, K. (1982). The unit of analysis: Group means versus individual observations. American Educational Research Journal, 19, 5-18.
14. Kazdin, A. E. (1994). Methodology, design, and evaluation in psychotherapy research. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 19-71). New York: Wiley.
15. Keppel, G. (1976). Words as random variables. Journal of Verbal Learning and Verbal Behavior, 15, 262-265.
16. Keppel, G. (1991). Design and analysis: A researcher's handbook (3rd ed.). Upper Saddle River, NJ: Prentice Hall.
17. Lindman, H. R. (1992). Analysis of variance in experimental design. New York: Springer.
18. Lipsey, M. W. (2000). Statistical conclusion validity for intervention research. A significant (p < .05) problem. In L. Bickman (Ed.), Contributions to research design: Donald Campbell's legacy (pp. 101-120). Newbury Park, CA: Sage.
19. Luborsky, L., Singer, B., & Luborsky, L. (1975). Comparative studies of psychotherapies: Is it true that "everyone has won and all must have prizes"? Archives of General Psychiatry, 32, 995-1008.
20. Maxwell, S. E., & Delaney, H. D. (1990). Designing experiments and analyzing data. A model comparison perspective. Pacific Grove, CA: Brooks/Cole.
21. McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46.
22. Moerbeek, M., van Breukelen, G. J. P., & Berger, M. P. F. (2000). Design issues for experiments in multilevel populations. Journal of Educational and Behavioral Statistics, 25, 257-270.
23. Rao, C. R., & Kleffe, J. (1988). Estimation of variance components and applications. Amsterdam: Elsevier.
24. Raudenbush, S. W. (1993). Hierarchical linear models and experimental design. In L. K. Edwards (Ed.), Applied analysis of variance in behavioral science (pp. 459-495). New York: Marcel Dekker.
25. Raudenbush, S. W. (1997). Statistical analysis and optimal design for cluster randomized trials. Psychological Methods, 2, 173-185.
26. Reichardt, C. S., & Gollob, H. F. (1999). Justifying the use and increasing the power of a t test for a randomized experiment with a convenience sample. Psychological Methods, 4, 117-124.
27. Scheirer, C. J., & Geller, S. E. (1979). The analysis of random effects in modeling studies. Child Development, 50, 752-757.
28. Seligman, M. E. P. (1995). The effectiveness of psychotherapy: The Consumer Reports study. American Psychologist, 50, 965-974.
29. Siemer, M. (1997). What exactly is random about random effects? Methods of Psychological Research - Online, 2, 139-151. Retrieved from http://www.mpr-online.de
30. Smith, J. E. K. (1976). The assuming-will-make-it-so fallacy. Journal of Verbal Learning and Verbal Behavior, 15, 262-263.
31. Snijders, T. A. B., & Bosker, R. J. (1993). Standard errors and sample size for 2-level research. Journal of Educational Statistics, 18, 237-259.
32. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Erlbaum.
33. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes." Psychological Bulletin, 122, 203-215.
34. Wampold, B. E., & Serlin, R. C. (2000). The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods, 5, 425-433.
35. Wike, E. L., & Church, J. D. (1976). Comments on Clark's "The language-as-fixed-effect fallacy." Journal of Verbal Learning and Verbal Behavior, 15, 249-255.
36. Wilkinson, L., & the Task Force on Statistical Inference. (1999). Statistical methods in psychological journals: Guidelines and explanations. American Psychologist, 54, 594-604.
37. Winer, B. J., Brown, D. R., & Michels, K. M. (1991). Statistical principles in experimental design (3rd ed.). New York: McGraw-Hill.