Evaluating models for partially clustered designs

Psychological Methods

Volumn 16, Issue 2, 2011, Pages 149-165

  Baldwin, Scott A ^a   Bauer, Daniel J ^b   Stice, Eric ^c   Rohde, Paul ^c  

^a BRIGHAM YOUNG UNIVERSITY   (United States)

^b University of North Carolina at Chapel Hill   (United States)

^c OREGON RESEARCH INSTITUTE   (United States)

Author keywords

Intervention studies; Intraclass correlation; Multilevel models; Partially clustered data

Indexed keywords

ARTICLE; CLUSTER ANALYSIS; HUMAN; MATHEMATICAL COMPUTING; METHODOLOGY; PSYCHOLOGY; PSYCHOTHERAPY; STATISTICAL ANALYSIS; STATISTICS; TREATMENT OUTCOME;

CLUSTER ANALYSIS; DATA INTERPRETATION, STATISTICAL; HUMANS; MATHEMATICAL COMPUTING; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PSYCHOLOGY; PSYCHOTHERAPY; RESEARCH DESIGN;

EID: 79958845424     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0023464     Document Type: Article

References (40)

1. Baldwin S.A., Murray D.M., Shadish W. Empirically supported treatments or Type I errors? Problems with the analysis of data from group-administered treatments. Journal of Consulting and Clinical Psychology 2005, 73:924-935. doi: 10.1037/0022-006X.73.5.924.
2. Baldwin S.A., Stice E., Rohde P. Statistical analysis of group-administered intervention data: Reanalysis of two randomized trials. Psychotherapy Research 2008, 18:365-376. doi: 10.1080/10503300701796992.
3. Bauer D.J., Sterba S.K., Hallfors D.D. Evaluating group-based interventions when control participants are ungrouped. Multivariate Behavioral Research 2008, 43:210-236. doi: 10.1080/00273170802034810.
4. Beck J.G., Coffey S.F., Foy D.W., Keane T.M., Blanchard E.B. Group cognitive behavior therapy for chronic posttraumatic stress disorder: An initial randomized pilot study. Behavior Therapy 2009, 40:82-92. doi: 10.1016/j.beth.2008.01.003.
5. Crits-Christoph P., Baranackie K., Kurcias J.S., Beck A.T., Carroll K., Perry K., Zitrin C. Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research 1991, 1:81-91. doi: 10.1080/10503309112331335511.
6. Crits-Christoph P., Mintz J. Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. Journal of Consulting and Clinical Psychology 1991, 59:20-26. doi: 10.1037/0022-006X.59.1.20.
7. Donner A., Birkett N., Buck C. Randomization by cluster: Sample size requirements and analysis. American Journal of Epidemiology 1981, 114:906-914.
8. Faes C., Molenberghs G., Aerts M., Verbeke G., Kenward M.G. The effective sample size and an alternative small-sample degrees-of-freedom method. American Statistician 2009, 63:389-399. doi: 10.1198/tast.2009.08196.
9. Fitzmaurice G.M., Laird N.M., Ware J.H. Applied longitudinal data analysis 2004, Wiley, Hoboken, NJ.
10. Herzog T.A., Lazev A.B., Irvin J.E., Juliano L.M., Greenbaum P.E., Brandon T.H. Testing for group membership effects during and after treatment: The example of group therapy for smoking cessation. Behavior Therapy 2002, 33:29-43. doi: 10.1016/S0005-7894(02)80004-1.
11. Hoover D.R. Clinical trials of behavioural interventions with heterogeneous teaching subgroup effects. Statistics in Medicine 2002, 21:1351-1364. doi: 10.1002/sim.1139.
12. Imel Z.E., Baldwin S.A., Bonus K., Macoon D. Beyond the individual: Group effects in mindfulness-based stress reduction. Psychotherapy Research 2008, 18:735-742. doi: 10.1080/10503300802326038.
13. Kenny D.A., Judd C.M. Consequences of violating the independence assumption in analysis of variance. Psychological Bulletin 1986, 99:422-431. doi: 10.1037/0033-2909.99.3.422.
14. Kenny D.A., Kashy D.A., Bolger N. Data analysis in social psychology. The Handbook of Social Psychology 1998, 1:233-265. Oxford University Press, New York, NY. 4th ed. D.T. Gilbert, S.T. Fiske, G. Lindzey (Eds.).
15. Kenny D.A., Mannetti L., Pierro A., Livi S., Kashy D.A. The statistical analysis of data from small groups. Journal of Personality and Social Psychology 2002, 83:126-137. doi: 10.1037/0022-3514.83.1.126.
16. Kenward M.G., Roger J.H. Small sample inference for fixed effects from restricted maximum likelihood. Biometrics 1997, 53:983-997. doi: 10.2307/2533558.
17. Kim D.-M., Wampold B.E., Bolt D.M. Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research 2006, 16:161-172. doi: 10.1080/10503300500264911.
18. Lee K.J., Thompson S.G. The use of random effects models to allow for clustering in individually randomized trials. Clinical Trials 2005, 2:163-173. doi: 10.1191/1740774505cn082oa.
19. Littell R.C., Milliken G.A., Stroup W.W., Wolfinger R.D., Schabenberger O. SAS for mixed models 2006, SAS Institute, Cary, NC. 2nd ed.
20. Lutz W., Leon S., Martinovich Z., Lyons J.S., Stiles W.B. Therapist effects in outpatient psychotherapy: A three-level growth curve approach. Journal of Counseling Psychology 2007, 54:32-39. doi: 10.1037/0022-0167.54.1.32.
21. Martindale C. The therapist-as-fixed-effect fallacy in psychotherapy research. Journal of Consulting and Clinical Psychology 1978, 46:1526-1530. doi: 10.1037/0022-006X.46.6.1526.
22. Moerbeek M., Wong W.K. Sample size formulae for trials comparing group and individual treatments in a multilevel model. Statistics in Medicine 2008, 27:2850-2864. doi: 10.1002/sim.3115.
23. Morgan-Lopez A.A., Fals-Stewart W. Consequences of misspecifying the number of latent treatment attendance classes in modeling group membership turnover within ecologically valid behavioral treatment trials. Journal of Substance Abuse Treatment 2008, 35:396-409. doi: 10.1016/j.jsat.2008.03.002.
24. Murray D.M. Design and analysis of group-randomized trials 1998, Oxford University Press, New York, NY.
25. Murray D.M., Hannan P.J., Baker W.L. A Monte Carlo study of alternative responses to intraclass correlation in community trials: Is it ever possible to avoid Cornfield's penalties?. Evaluation Review 1996, 20:313-337. doi: 10.1177/0193841X9602000305.
26. Myers J.L., DiCecco J.V., Lorch R.F. Group dynamics and individual performances: Pseudogroup and quasi-F analyses. Journal of Personality and Social Psychology 1981, 40:86-98. doi: 10.1037/0022-3514.40.1.86.
27. Nye B., Konstantopoulos S., Hedges L.V. How large are teacher effects?. Educational Evaluation and Policy Analysis 2004, 26:237-257. doi: 10.3102/01623737026003237.
28. Öst L.-G. Efficacy of the third wave of behavioral therapies: A systematic review and meta-analysis. Behaviour Research and Therapy 2008, 46:296-321. doi: 10.1016/j.brat.2007.12.005.
29. Roberts C. Cluspower [Computer software and manual] 2008, Retrieved from http://personalpages.manchester.ac.uk/staff/chris.roberts/.
30. Roberts C., Roberts S.A. Design and analysis of clinical trials with clustering effects due to treatment. Clinical Trials 2005, 2:153-162. doi: 10.1191/1740774505cnO76oas.
31. Satterthwaite F.E. An approximate distribution of estimates of variance components. Biometrics Bulletin 1946, 2:110-114. doi: 10.2307/3002019.
32. Serlin R.C., Wampold B.E., Levin J.R. Should providers of treatment be regarded as a random factor? If it ain't broke, don't " fix" it: A comment on Siemer and Joorman (2003). Psychological Methods 2003, 8:524-534. doi: 10.1037/1082-989X.8.4.524.
33. Siemer M., Joorman J. Assumptions and consequences of treating providers in therapy studies as fixed versus random effects: Reply to Crits-Christoph, Tu, and Gallop (2003) and Serline, Wampold, and Levin (2003). Psychological Methods 2003, 8:535-544. doi: 10.1037/1082-989X.8.4.535.
34. Siemer M., Joorman J. Power and measures of effect size in analysis of variance with fixed versus random nested factors. Psychological Methods 2003, 8:497-517. doi: 10.1037/1082-989X.8.4.524s.
35. Singer J.D. Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics 1998, 23:323-355.
36. Stice E. A prospective test of the dual pathway model of bulimic pathology: Mediating effects of dieting and negative affect. Journal of Abnormal Psychology 2001, 110:124-135. doi: 10.1037/0021-843X.110.1.124.
37. Stice E., Shaw H., Burton E., Wade E. Dissonance and healthy weight eating disorder prevention programs: A randomized efficacy trial. Journal of Consulting and Clinical Psychology 2006, 74:263-275. doi: 10.1037/0022-006X.74.2.263.
38. Wampold B.E., Brown G.S. Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology 2005, 73:914-923. doi: 10.1037/0022-006X.73.5.914.
39. Wampold B.E., Serlin R.C. The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods 2000, 5:425-433. doi: 10.1037//1082-989x.5.4.425.
40. Zucker D.M. An analysis of variance pitfall: The fixed effects analysis in a nested design. Educational and Psychological Measurement 1990, 50:731-738. doi: 10.1177/0013164490504002.