Quantitative naturalistic methods for detecting change points in psychotherapy research: An illustration with alliance ruptures

Psychotherapy Research

Volumn 22, Issue 6, 2012, Pages 621-637

  Eubanks Carter, Catherine ^a   Gorman, Bernard S ^b   Muran, J Christopher ^c  

^a YESHIVA UNIVERSITY   (United States)

^b NASSAU COMMUNITY COLLEGE   (United States)

^c ADELPHI UNIVERSITY   (United States)

Author keywords

alliance; process research; statistical methodology

Indexed keywords

ARTICLE; HEALTH CARE QUALITY; HUMAN; HUMAN RELATION; METHODOLOGY; PSYCHOTHERAPY; STATISTICS; TREATMENT OUTCOME;

HUMANS; PROCESS ASSESSMENT (HEALTH CARE); PROFESSIONAL-PATIENT RELATIONS; PSYCHOTHERAPEUTIC PROCESSES; PSYCHOTHERAPY; RESEARCH DESIGN; STATISTICS AS TOPIC; TREATMENT OUTCOME;

EID: 84869181587     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503307.2012.693772     Document Type: Article

References (69)

1. Aderka, I.M., Nickerson, A., Bøe, H.J. and Hofmann, S.G. 2012. Sudden gains during psychological treatments of anxiety and depression: A meta-analysis. Journal of Consulting and Clinical Psychology, 80: 93-101.
2. Agnew, R.M., Harper, H., Shapiro, D.A. and Barkham, M. 1994. Resolving a challenge to the therapeutic relationship: A single-case study. British Journal of Medical Psychology, 67: 155-170.
3. Agnew-Davies, R., Stiles, W.B., Hardy, G.E., Barkham, M. and Shapiro, D.A. 1998. Alliance structure assessed by the Agnew Relationship Measure (ARM). British Journal of Clinical Psychology, 37: 155-172.
4. Alemi, F. 2004. Tukey's control chart. Quality Management in Health Care, 13: 216-221.
5. Battle, C.C., Imber, S.D., Hoehn-Saric, R., Stone, A.R., Nash, E.R. and Frank, J.D. 1966. Target complaints as criteria of improvement. American Journal of Psychotherapy, 20: 184-192.
6. Bergin, A.E. and Strupp, H.H. 1972. Changing frontiers in the science of psychotherapy, Chicago: Aldine.
7. Berk, E., Safran, J.D., Muran, J.C., & Eubanks-Carter, C. 2010, June. The development of the Segmented Working Alliance Inventory-Observer Form (S-WAI-O). In C. Eubanks-Carter (Chair), Advances in observer-based methods for identifying and examining alliance ruptures and resolutions and their relationship to process and outcome. Panel conducted at the annual meeting of the Society for Psychotherapy Research, Asilomar, California.
8. Borckardt, J.J. 2006. DataTool (Version 1.0) [Computer software]. Knoxville, TN: ClinicalResearcher.
9. Callahan, C.D. and Barisa, M.T. 2005. Statistical process control and rehabilitation outcome: The single-subject design reconsidered. Rehabilitation Psychology, 50: 24-33.
10. Cattell, R. B. 1966. The scree test for the number of factors. Multivariate Behavioral Research, 1: 245-276.
11. Derogatis, L.R. 1983. SCL-90-R: Administration, scoring, & procedures manual II, Towson, MD: Clinical Psychiatric Research.
12. Duncan, A.J. 1986. Quality control and industrial statistics, 5th ed, Homewood, IL: Irwin.
13. Endicott, J., Spitzer, R.L., Fleiss, J.L. and Cohen, J. 1976. The Global Assessment Scale: A procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33: 766-771.
14. Erdman, C. and Emerson, J.W. 2007. Bcp: An R package for performing a Bayesian analysis of change point problems. Journal of Statistical Software, 23(3): 1-13.
15. Eubanks-Carter, C., Muran, J.C. and Safran, J.D. 2010. "Alliance ruptures and resolution". In The therapeutic alliance: An evidence-based approach to practice and training, Edited by: Muran, J.C. and Barber, J.P. 74-94. New York: Guilford Press.
16. Finch, A.E., Lambert, M.J. and Schaalje, B.G. 2001. Psychotherapy quality control: The statistical generation of expected recovery curves for integration into an early warning system. Clinical Psychology & Psychotherapy, 8: 231-242.
17. First, M.B., Spitzer, R.L., Gibbon, M. and Williams, J.B.W. 1995. Structured Clinical Interview for DSM-IV, New York: Biometrics Research Department, New York Psychiatric Institute.
18. Fisher, W.D. 1958. On grouping for maximum homogeneity. Journal of the American Statistical Association, 53: 789-798.
19. Fox, J. 2005. The R Commander: A basic-statistics graphical user interface to R. Journal of Statistical Software, 14: 1-42.
20. Gorman, B.S. and Allison, D.B. 1996. "Statistical alternatives for single-case designs". In Design and analysis of single-case research, Edited by: Franklin, R.D., Allison, D.B. and Gorman, B.S. 159-214. Hillsdale, NJ: Lawrence Erlbaum.
21. Greenberg, L.S. 1986. Change process research. Journal of Consulting and Clinical Psychology, 54: 4-9.
22. Greenberg, L.S. and Watson, J.C. 2006. "Change process research". In Evidence-based practices in mental health: Debate and dialogue on the fundamental questions, Edited by: Norcross, J.C., Beutler, L.E. and Levant, R.F. 81-89. Washington, DC: American Psychological Association.
23. Hartigan, J.A. 1975. Clustering algorithms, New York: Wiley.
24. Hayes, A.M., Laurenceau, J.-P., Feldman, G., Strauss, J.L. and Cardaciotto, L. 2007. Change is not always linear: The study of nonlinear and discontinuous patterns of change in psychotherapy. Clinical Psychology Review, 27: 715-723.
25. Hoaglin, D.C., Mosteller, F., & Tukey, J.W. 2000. Understanding robust and exploratory data analysis. New York: Wiley-Interscience.
26. Hopwood, C.J., Pincus, A.L., DeMoor, R.M. and Koonce, E.A. 2008. Psychometric characteristics of the Inventory of Interpersonal Problems-Short Circumplex (IIP-SC) with college students. Journal of Personality Assessment, 90: 615-618.
27. Horowitz, L.M., Alden, L.E., Wiggens, J.S. and Pincus, A.L. 2000. Inventory of Interpersonal Problems, New York: The Psychological Corporation.
28. Horvath, A.O. and Greenberg, L.S. 1989. Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology, 36: 223-233.
29. Huber, P. J. 1981. Robust Statistics, New York: Wiley.
30. Jacobson, N.S. and Truax, P. 1991. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59: 12-19.
31. Kazdin, A.E. 2007. Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3: 1-27.
32. Kim, H.-J., Fay, M.P., Feuer, E.J. and Midthune, D.N. 2000. Permutation tests for joinpoint regression with applications to cancer rates. Statistics in Medicine, 19: 335-351.
33. Kivlighan, D.M. and Shaughnessy, P. 2000. Patterns of working alliance development: A typology of client's working alliance ratings. Journal of Counseling Psychology, 47: 362-371.
34. Klein, M.H., Benjamin, L.S., Treece, C., Rosenfeld, R. and Greist, J. 1993. The Wisconsin Personality Inventory: Development, reliability and validity. Journal of Personality Disorders, 7: 285-303.
35. Kramer, U., de Roten, Y., Beretta, V., Michel, L. and Despland, J.-N. 2008. Patient's and therapist's views of early alliance building in dynamic psychotherapy: Patterns and relation to outcome. Journal of Counseling Psychology, 55: 89-95.
36. Lambert, M. 2007. Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychotherapy Research, 17: 1-14.
37. Marmar, C.R., Weiss, D.S. and Gaston, L. 1989. Toward the validation of the California Therapeutic Alliance Rating System. Psychological Assessment, 1: 46-52.
38. Mergenthaler, E. 1996. Emotion-abstraction patterns in verbatim protocols: A new way of describing psychotherapeutic processes. Journal of Consulting and Clinical Psychology, 64: 1306-1315.
39. Muran, J.C. 2002. A relational approach to understanding change: Plurality and contextualism in a psychotherapy research program. Psychotherapy Research, 12: 113-138.
40. Muran, J.C., Safran, J.D., Gorman, B.S., Samstag, L.W., Eubanks-Carter, C. and Winston, A. 2009. The relationship of early alliance ruptures and their resolution to process and outcome in three time-limited psychotherapies for personality disorders. Psychotherapy: Theory, Research, Practice, Training, 46: 233-248.
41. Muran, J.C., Safran, J.D., Samstag, L.W. and Winston, A. 1992. Patient and therapist postsession questionnaires, Version 1992, New York: Beth Israel Medical Center.
42. Muran, J.C., Safran, J.D., Samstag, L.W. and Winston, A. 2005. Evaluating an alliance-focused treatment for personality disorders. Psychotherapy: Theory, Research, Practice, Training, 42: 532-545.
43. National Cancer Institute. 2008. Joinpoint Regression Program, Version 3.3 [Computer software]. Retrieved from http://srab.cancer.gov/joinpoint/.
44. Page, E.S. 1954. Continuous inspection schemes. Biometrika, 41: 100-115.
45. Pande, P.S., Neuman, R.P. and Cavanagh, R.R. 2000. The Six Sigma way: How GE, Motorola, and other top companies are honing their performance, New York: McGraw-Hill.
46. Pascual-Leone, A. 2009. Dynamic emotional processing in experiential therapy: Two steps forward, one step back. Journal of Consulting and Clinical Psychology, 77: 113-126.
47. Pfadt, A. and Wheeler, D.J. 1995. Using statistical process control to make data-based clinical decisions. Journal of Applied Behavior Analysis, 28: 349-370.
48. R Development Core Team. 2004. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
49. Roberts, S.W. 1959. Control chart tests based on geometric moving averages. Technometrics, 1: 239-250.
50. Rodionov, S. 2004. A sequential algorithm for testing climate regime shifts. Geophysical Research Letters, 31, L09204. doi:10.1029/2004GL019448.
51. Safran, J.D. and Muran, J.C. 1996. The resolution of ruptures in the therapeutic alliance. Journal of Consulting and Clinical Psychology, 64: 447-458.
52. Safran, J.D. and Muran, J.C. 2000. Negotiating the therapeutic alliance: A relational treatment guide, New York: Guilford Press.
53. Safran, J.D., Muran, J.C. and Eubanks-Carter, C. 2011. "Repairing alliance ruptures". In Psychotherapy relationships that work: Evidence-based responsiveness, 2nd ed, Edited by: Norcross, J.C. 224-238. New York: Oxford University Press.
54. Scrucca, L. 2004. qcc: an R package for quality control charting and statistical process control. R News, 4(1): 11-17.
55. Shewhart, W.A. 1931. Economic control of quality of manufactured product, Princeton, NJ: Van Nostrand-Reinhold Co.
56. Soldz, S., Budman, S., Demby, A. and Merry, J. 1995. A short form of the Inventory of Interpersonal Problems Circumplex scales. Assessment, 2: 53-63.
57. Sommerfeld, E., Orbach, I., Zim, S. and Mikulincer, M. 2008. An in-session exploration of ruptures in working alliance and their associations with clients' core conflictual relationship themes, alliance-related discourse, and clients' postsession evaluation. Psychotherapy Research, 18: 377-388.
58. Stevens, C.L., Muran, J.C., Safran, J.D., Gorman, B.S. and Winston, A. 2007. Levels and patterns of the therapeutic alliance in brief psychotherapy. American Journal of Psychotherapy, 61: 109-129.
59. Stiles, W.B., Glick, M.J., Osatuke, K., Hardy, G.E., Shapiro, D.A.Agnew-Davies, R. 2004. Patterns of alliance development and the rupture-repair hypothesis: Are productive relationships U-shaped or V-shaped?. Journal of Counseling Psychology, 51: 81-92.
60. Strauss, J.L., Hayes, A.M., Johnson, S.L., Newman, C.F., Brown, G.K.Barber, J.P. 2006. Early alliance, alliance ruptures, and symptom change in a nonrandomized trial of cognitive therapy for avoidant and obsessive-compulsive personality disorders. Journal of Consulting and Clinical Psychology, 74: 337-345.
61. Tang, T.Z. and DeRubeis, R.J. 1999. Sudden gains and critical sessions in cognitive-behavioral therapy for depression. Journal of Consulting and Clinical Psychology, 67: 894-904.
62. Taylor, W.A. 2000. Change-Point Analyzer [Computer software]. Libertyville, IL: Taylor Enterprises, Inc.
63. Tracey, T.J. and Kokotovic, A.M. 1989. Factor structure of the Working Alliance Inventory. Psychological Assessment, 1: 207-210.
64. Tryon, G.S., Blackwell, S.C. and Hammel, E.F. 2008. The magnitude of client and therapist working alliance ratings. Psychotherapy: Theory, Research, Practice, Training, 45: 546-551.
65. Wild, C.J. and Seber, G.A.F. 2000. Chance encounters: A first course in data analysis and inference, New York: John Wiley & Sons.
66. Western Electric. 1956. Statistical Quality Control Handbook. Indianapolis, IN: Western Electric Corporation.
67. Wheeler, D.J. and Chambers, D.S. 1992. Understanding statistical process control, 2nd ed, Knoxville, TN: SPC Press.
68. Woodall, W.H. 2000. Controversies and contradictions in statistical process control. Journal of Quality Technology, 32: 341-350.
69. Zeileis, A., Leisch, F., Hornik, K. and Kleiber, C. 2002. strucchange: An R package for testing for structural change in linear regression models. Journal of Statistical Software, 7: 1-38.