A priori power analysis in longitudinal three-level multilevel models: An example with therapist effects

Psychotherapy Research

Volumn 20, Issue 3, 2010, Pages 273-284

  de Jong, Kim ^a   Moerbeek, Mirjam ^b   van der Leeden, Rien ^c  

^a Research Department   (Netherlands)

^b UTRECHT UNIVERSITY   (Netherlands)

^c LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Multilevel modeling; Outcome research; Statistical power; Therapist effect

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; HUMAN; HUMAN RELATION; LONGITUDINAL STUDY; MULTILEVEL ANALYSIS; OUTCOME ASSESSMENT; PATIENT; PSYCHOMETRY; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL; REPRODUCIBILITY; SAMPLE SIZE; STATISTICAL MODEL; STATISTICS;

ANALYSIS OF VARIANCE; HUMANS; LONGITUDINAL STUDIES; MODELS, STATISTICAL; MULTILEVEL ANALYSIS; OUTCOME ASSESSMENT (HEALTH CARE); PATIENT DROPOUTS; PROFESSIONAL-PATIENT RELATIONS; PSYCHOMETRICS; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; STATISTICS AS TOPIC;

EID: 77951685086     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503300903376320     Document Type: Article

References (50)

1. Adams, G., Gulliford, M. C., Ukoumunne, O. C., Eldridge, S., Chinn, S., & Campbell, M. J. (2004). Patterns of intracluster correlation from primary care research to inform study design and analysis. Journal of Clinical Epidemiology, 57, 785-794.
2. Borm, G. F., Melis, R. J. F., Teerenstra, S., & Peer, P. G. M. (2005). Pseudo cluster randomization: A treatment allocation method to minimize contamination and selection bias. Statistics in Medicine, 24, 3535-3547.
3. Bosker, R. J., Snijders, T. A., & Guldemond, H. (1996). PINT (power in two-level designs). Estimating standard errors of regression coefficients in hierarchical linear models for power calculations. Groningen, the Netherlands: Rijksuniversiteit Groningen.
4. Campbell, M. K., Mollison, J., & Grimshaw, J. M. (2001). Cluster trials in implementation research: Estimation of intracluster correlation coefficients and sample size. Statistics in Medicine, 20,391-399.
5. Cohen, J. (2002). A power primer. Psychological Bulletin, 112(1), 155-159.
6. Crits-Christoph, P., Baranackie, K., Kurcias, J. S., Beck, A. T., Carroll, K., Perry, K., et al. (1991). Meta analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1(2), 81-91.
7. Crits-Christoph, P., & Gallop, R. (2006). Therapist effects in the National Institute of Mental Health Treatment of Depression Collaborative Research Program and other psychotherapy studies. Psychotherapy Research, 16(2), 178-181.
8. Donner, A., & Klar, N. (2000). Design and analysis of cluster randomization trials in health research. London: Edward Arnold.
9. Elkin, I., Falconnier, L., Martinovich, Z., & Mahoney, C. (2006). Therapist effects in the National Institute of Mental Health Treatment of Depression Collaborative Research Program. Psychotherapy Research, 16(2), 144-160.
10. Elkin, I., Shea, M. T., Watkins, J. T., Imber, S. D., Sotsky, S., Collins, J., et al. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: General effectiveness of treatments. Archives of General Psychiatry, 46(11), 971-982.
11. Finch, A. E., Lambert, M. J., & Schaalje, B. G. (2001). Psychotherapy quality control: The statistical generation of expected recovery curves for integration into an early warning system. Clinical Psychology and Psychotherapy, 8, 231-242.
12. Goldstein, H. (2003). Multilevel statistical models (3rd ed). London: Edward Arnold.
13. Haas, E., Hill, R. D., Lambert, M. J., & Morrell, B. (2002). Do early responders to psychotherapy maintain treatment gains? Journal of Clinical Psychology, 58(9), 1157-1172.
14. Haringsma, R., Engels, G. I., Van der Leeden, R., & Spinhoven, P. (2006). Predictors of response to the coping with depression course for older adults. A field study. Ageing and Mental Health, 10(4),424-434.
15. Harmon, C., Hawkins, E. J., Lambert, M. J., Slade, K., & Whipple, J. L. (2005). Improving outcomes for poorly responding clients: The use of clinical support tools and feedback to clients. Journal of Clinical Psychology, 61(2), 175-185.
16. Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14(3), 308-327.
17. Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken, NJ: Wiley.
18. Hedges, L. V., & Hedberg, E. C. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29(1), 60-87.
19. Hox, J. J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.
20. Kim, D.-M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16(2),161-172.
21. Lambert, M. J., Morton, J. J., Hatfield, D., Harmon, C., Hamilton, S., Shimokawa, K., et al. (2003). Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire). Orem, UT: American Professional Credentialing Services LLC.
22. Lambert, M. J., Whipple, J. L., Bishop, M. J., Vermeersch, D. A., Gray, G. V., & Finch, A. E. (2002). Comparison of empirically-derived and rationally-derived methods for identifying patients at risk for treatment failure. Clinical Psychology and Psychotherapy, 9, 149-164.
23. Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11(1), 49-68.
24. Lueger, R. J., Howard, K. I., Martinovich, Z., Lutz, W., Anderson, E. E., & Grissom, G. (2001). Assessing treatment progress of individual patients using expected treatment response models. Journal of Consulting and Clinical Psychology, 69(2),150-158.
25. Lutz, W. (2002). Patient-focused psychotherapy research and individual treatment progress as scientific groundwork for an empirically based clinical practice. Psychotherapy Research, 12(3),251-272.
26. Lutz, W., Leon, S. C., Martinovich, Z., Lyons, J. S., & Stiles, W. B. (2007). Therapist effects in outpatient psychotherapy: A three-level growth curve approach. Journal of Counseling Psychology, 54(1), 32-39.
27. Lutz, W., Lowry, J., Kopta, S., Einstein, D. A., & Howard, K. I. (2001). Prediction of dose-response relations based on patient characteristics. Journal of Clinical Psychology, 57(7), 889-900.
28. Lutz, W., Martinovich, Z., & Howard, K. I. (1999). Patient profiling: An application of random coefficient regression models to depicting the response of a patient to outpatient psychotherapy. Journal of Consulting and Clinical Psychology, 67(4),571-577.
29. Lutz, W., Rafaeli, E., Howard, K. I., & Martinovich, Z. (2002). Adaptive modeling of progress in outpatient psychotherapy. Psychotherapy Research, 12(4), 427-443.
30. Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1(3), 86-92.
31. Moerbeek, M. (2004). The consequence of ignoring a level of nesting in multilevel analysis. Multivariate Behavioral Research, 39(1),129-149.
32. Moerbeek, M. (2005). Randomization of clusters versus randomization of persons within clusters: Which is preferable. The American Statistician, 59(1), 72-78.
33. Moerbeek, M. (2006). Power and money in cluster randomized trials: When is it worth measuring a covariate? Statistics in Medicine, 25(15), 2607-2617.
34. Moerbeek, M. (2008). Powerful and cost-efficient designs for longitudinal intervention studies with two treatment groups. Journal of Educational and Behavioral Statistics, 33(1), 41-61.
35. Nich, C., & Carroll, K. (1997). Now you see it, now you don't: A comparison of traditional versus random-effects regression models in the analysis of longitudinal follow-up data from a clinical trial. Journal of Consulting and Clinical Psychology, 65(2), 252-261.
36. Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology and Psychotherapy, 10(6), 361-373.
37. Raudenbusch, S. W. (1988). Educational applications of hierarchical linear models: A review. Journal of Educational Statistics, 13, 85-116.
38. Raudenbusch, S. W. (1997). Statistical analysis and optimal design for cluster randomized trials. Psychological Methods, 2(2),173-185.
39. Raudenbusch, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed). Thousand Oaks, CA: Sage.
40. Reise, S. P., & Duan, N. (2003). Design issues in multilevel studies. In S. P. Reise & N. Duan (Eds.), Multilevel modeling: methodological advances, issues and applications (pp. 285-298). Mahwah, NJ: Erlbaum.
41. Slee, N., Garnefski, N., Van der Leeden, R., Arensman, E., & Spinhoven, P. (2008). Cognitive behavioural intervention for self-harm: Randomised controlled trial. British Journal of Psychiatry, 192, 202-211.
42. Snijders, T. A., & Bosker, R. J. (1993). Standard errors and sample sizes for two-level research. Journal of Educational Statistics, 18, 237-259.
43. Snijders, T. A., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. London: Sage.
44. Soldz, S. (2006). Models and meanings: Therapist effects and the stories we tell. Psychotherapy Research, 16(2), 173-177.
45. Spybrook, J., Raudenbush, S. W., Liu, X.-F., Congdon, R., & Martínez, A. (2008). Optimal design (Version 1.76). Ann Arbor: University of Michigan.
46. Tasca, G. A., Balfour, L., Ritchie, K., & Bissada, H. (2007). The relationship between attachment scales and group therapy alliance: Growth differs by treatment type for women with binge-eating disorder. Group Dynamics: Theory. Research and Practice, 11(1), 1-14.
47. Van der Leeden, R. (1998). Multilevel analysis of repeated measures data. Quality and Quantity, 32, 15-29.
48. Wampold, B. E., & Bolt, D. M. (2006). Therapist effects: Clever ways to make them (and everything else) disappear. Psychotherapy Research, 16(2), 184-187.
49. Wampold, B. E., & Serlin, R. C. (2000). The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods, 5(4), 425-433.
50. Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003). Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. Journal of Counseling Psychology, 50(1), 59-68.