Generalizability theory in psychotherapy research: The impact of multiple sources of variance on the dependability of psychotherapy process ratings

Psychotherapy Research

Volumn 19, Issue 4-5, 2009, Pages 397-408

  Wasserman, Rachel H ^a   Levy, Kenneth N ^a   Loken, Eric ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Outcome research; Process research; Statistical methodology

Indexed keywords

ARTICLE; DISCRIMINANT ANALYSIS; HUMAN; LEARNING; METHODOLOGY; PSYCHOLOGICAL THEORY; PSYCHOMETRY; PSYCHOTHERAPY; RESEARCH; STATISTICS;

DISCRIMINANT ANALYSIS; GENERALIZATION (PSYCHOLOGY); HUMANS; PSYCHOLOGICAL THEORY; PSYCHOMETRICS; PSYCHOTHERAPY; RESEARCH;

EID: 77953144625     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503300802579156     Document Type: Article

References (27)

1. Allen, M. J., and Yen, W. M. (1979). Introduction to measurement theory. Prospect Heights, IL: Waveland Press.
2. Appelbaum, A. J., and Levy, K. N. (2002). Supportive psychotherapy for borderline patients: A psychoanalytic research perspective. American Journal of Psychoanalysis, 62(2), 201-202.
3. Brennan, R. L. (1992). Elements of generalizability theory. Iowa City, IA: American College Testing Program.
4. Brennan, R. L. (2001). Generalizability theory. New York: Springer.
5. Clarkin, J. F., Foelsch, P. A., Levy, K. N., Hull, J. W., Delaney, J. C., and Kernberg, O. F. (2001). The development of a psychodynamic treatment for patients with borderline personality disorders: A preliminary study of behavioral change. Journal of Personality Disorders, 15, 487-495.
6. Cone, J. D. (1977). The relevance of reliability and validity for behavioral assessment. Behavior Therapy, 8, 411-426.
7. Cranford, J. A., Shrout, P. E., Iida, M., Rafaeli, E., Yip, T., and Bolger, N. (2006). A procedure for evaluating sensitivity to within-person change: Can mood measures in diary studies detect change reliably? Personality and Social Psychology Bulletin, 32, 917-929.
8. Cronbach, L. J., Gleser, G. C., Nanda, H., and Rajaratnam, N. (1972). The dependability of behavioral assessment measurements. New York: Wiley.
9. Halvorsen, M. S., Hagtvet, K. A., and Monsen, J. T. (2006). The reliability of self-image change scores in psychotherapy research: An application of generalizability theory. Psychotherapy: Theory, Research, Practice. Training, 43, 308-321.
10. Hintze, J. M., and Matthews, W. J. (2004). The generalizability of systematic direct observations across time and setting: A preliminary investigation of the psychometrics of behavioral observation. School Psychology Review, 33(2), 258-270.
11. Hoyt, W. T. (2002). Bias in participant ratings of psychotherapy process: An initial generalizability study. Journal of Counseling Psychology, 49(1), 35-46.
12. Hoyt, W. T., and Melby, J. N. (1999). Dependability of measurement in counseling psychology: An introduction to generalizability theory. The Counseling Psychologist, 27(3), 325-352.
13. Levy, K. N., Clarkin, J. F., Yeomans, F. E., Scott, L. N., Wasserman, R. H., and Kernberg, O. F. (2006). The mechanisms of change in the treatment of borderline personality disorder with transference focused psychotherapy. Journal of Clinical Psychology, 62, 481-501.
14. Levy, K. N., Wasserman, R. H., Clarkin, J. F., Eubanks-Carter, C., and Fisher, C. (2005). The Psychotherapy Process Rating Scale for Borderline Personality Disorder (PPRS-BPD). Unpublished rating scale, The Pennsylvania State University.
15. Linehan, M. M. (1993). Cognitive-behavioral treatment of borderline personality disorder. New York: Guilford Press.
16. Lynch, T. R., Chapman, A. L., Rosenthal, M. Z., Kuo, J. R., and Linehann, M. M. (2006). Mechanisms of change in dialectical behavior therapy: Theoretical and empirical observations. Journal of Clinical Psychology, 62(4), 459-480.
17. McGraw, K. O., and Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46.
18. Mellenbergh, G. J. (2001). Outline of a faceted theory of item response data. In A. Boomsma, M. A. J. van Duijn and T. A. B. Snijders (Eds), Essays on item response theory (pp. 415-432). New York: Springer.
19. O’Brian, N., O’Brian, S., Packman, A., and Onslow, M. (2003). Generalizability theory: I. Assessing reliability of observational data in the communication sciences. Journal of Speech, Language. and Hearing Research, 46, 711-717.
20. Rao, C. R. (1971). Estimation of variance and covariance components-MINQUE theory. Journal of Multivariate Analysis, 1, 257-275.
21. Rockland, L. H. (1992). Supportive therapy for borderline patients. New York: Guilford Press.
22. Searle, S. R. (1987). Linear models for unbalanced data. New York: Wiley.
23. Shavelson, R. J., and Webb, N. M. (1991). Generalizability theory: A primer. London: Sage.
24. Shavelson, R. J., Webb, N. M., and Rowley, G. L. (1989). Generalizability theory. American Psychologist, 44, 922-932.
25. SPSS Inc. (2006). SPSS 15.0 user’s guide. Englewood Cliffs, NJ: Prentice Hall.
26. Tinsley, H. E., and Weiss, D. J. (1975). Inter-rater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358-376.
27. Verhelst, N. D., and Verstralen, H. H. F. M. (2001). An IRT model for multiple raters. In A. Boomsma, M. A. J. van Duijn and T. A. B. Snijders (Eds), Essays on item response theory (pp. 89-108). New York: Springer.