Methods for Analyzing Psychotherapy Outcomes: A Review of Clinical Significance, Reliable Change, and Recommendations for Future Directions

Journal of Personality Assessment

Volumn 82, Issue 1, 2004, Pages 50-59

  Wise, Edward A ^a  

^a Mental Health Resources   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL SIGNIFICANCE; DATA ANALYSIS; METHODOLOGY; PSYCHOTHERAPY; RELIABILITY; REVIEW; STATISTICAL ANALYSIS; STATISTICAL PARAMETERS; TREATMENT OUTCOME;

EID: 1642579691     PISSN: 00223891     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327752jpa8201_10     Document Type: Review

References (60)

1. Abramowitz, J. S. (1998). Does cognitive behavior therapy cure obsessive-compulsive disorder? A meta-analytic evaluation of clinical significance. Behavior Therapy, 29, 339-355.
2. American Psychiatric Association. (2000). Diagnostic and statistical manual (4th ed.). Washington, DC: Author.
3. Bauer, S., Lambert, M. J., & Nielsen, S. L. (2003). Clinical significance methods: A comparison of statistical techniques. Manuscript submitted for publication.
4. Beck, A. T., & Steer, R. A. (1987). Beck Drepression Inventory manual. San Antonio, TX: The Psychological Corporation, Harcourt Brace Jovanovich.
5. Beckstead, D. J., Hatch, A. L., Lambert, M. J., Eggett, D. L., Goates, M. K., & Vermeersch, D. A. (2003). Clinical significance of the Outcome Questionnaire (OQ-45.2). The Behavior Analyst Today, 4, 79-90.
6. Christensen, L., & Mendoza, J. L. (1986). A method of assessing change in a single subject: An alteration of the RC index. Behavior Therapy, 15, 305-308.
7. Derogatis, L. R. (1983). SCL-90-R: Administration, scoring and procedures manual (2nd ed.). Towson, MD: Clinical Psychometric Research.
8. Dolan, B. M., Evans, C., & Wilson, J. (1992). Therapeutic community treatment for personality disordered adults: Changes in neurotic symptomatology on follow-up. International Journal of Social Psychiatry, 38, 243-250.
9. Ferguson, R. J., Robinson, A. B., & Splaine, M. (2002). Use of the Reliable Change Index to evaluate clinical significance in SF-36 outcomes. Quality of Life Research, 11, 509-516.
10. Follette, W. C., & Callaghan, G. M. (1996). The importance of the principle of clinical significance-Defining significant to whom and for what purpose: A response to Tingey, Lambert, Burlingame, and Hansen. Psychotherapy Research, 6, 133-143.
11. Grissom, G. R., Lyons, J. S., & Lutz, W. (2002). Standing on the shoulders of a giant: Development of an outcome management system based on the dose model and phase model of psychotherapy. Psychotherapy Research, 12, 397-412.
12. ID. Behaviour Research and Therapy, 51, 693-700.
13. Hageman, W. L., & Arrindell, W. A. (1999a). Clinically significant and practical?: Enhancing precision does make a difference: Reply to McGlinchey and Jacobson, Hsu, and Speer. Behaviour Research and Therapy, 37, 1219-1233.
14. Hageman, W. L., & Arrindell, W. A. (1999b). Establishing clinically significant change: Increment of precision and the distinction between individual and group level analysis. Behaviour Research and Therapy, 37, 1169-1193.
15. Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology: Science and Practice, 9, 329-343.
16. Howard, K. I., Leuger, R., Maling, M., & Martinovich, Z. (1993). A phase model of psychotherapy: Causal medication of outcome. Journal of Consulting and Clinical Psychology, 61, 678-685.
17. Hsu, L. M. (1989). Reliable changes in psychotherapy: Taking into account regression toward the mean. Behavioral Assessment, 11, 459-467.
18. Hsu, L. M. (1996). On the identification of clinically significant client changes: Reinterpretation of Jacobson's cut scores. Journal of Psychopathology and Behavioral Assessment, 18, 371-385.
19. Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984). Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15, 336-352.
20. Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1986). Toward a standard definition of clinically significant change. Behavior Therapy, 15, 309-311.
21. Jacobson, N. S., Follette, W. C., Revenstorf, D., Baucom, D. H., Hahlweg, K., & Margolin, G. (1984). Variability in outcome and clinical significance of behavioral marital therapy: A re-analysis of outcome. Journal of Consulting and Clinical Psychology, 52, 497-504.
22. Jacobson, N. S., & Revenstorf, D. (1988). Statistics for assessing the clinical significance of psychotherapy techniques: Issues, problems and new developments. Behavioral Assessment, 10, 133-145.
23. Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999). Methods for determining the clinical significance of treatment effects: Description, application and alternatives. Journal of Consulting and Clinical Psychology, 67, 300-307.
24. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
25. Kazdin, A. E. (1999). The meanings and measurement of clinical significance. Journal of Consulting and Clinical Psychology, 67, 332-339.
26. Kazdin, A. E. (2001). Almost clinically significant (p. < .10): Current measures may only approach clinical significance. Clinical Psychology: Science and Practice, 8, 455-462.
27. Kendall, P. C., & Grove, W. M. (1988). Normative comparisons in therapy outcome. Behavioral Assessment, 10, 147-158.
28. Lambert, M. J., Hansen, N. B., Umphress, V., Lunnen, K., Okiishi, J., Burlingame, G., et al. (1996). Administration and scoring manual for the Outcome Questionnaire (OQ-45.2). Wilmington, DE: American Professional Credentialing Services.
29. Lecrubier, Y. (2002). How do you define remission? Acta Psychiatrica Scandinavica, 106(Suppl. 415), 7-11.
30. Lunnen, K. M., & Ogles, B. M. (1998). A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology, 66, 400-410.
31. Maassen, G. H. (2001). The unreliable change of reliable change indices. Behaviour Research and Therapy, 39, 495-498.
32. Martinovich, A., Saunders, S., & Howard, K. I. (1996). Some comments on "Assessing clinical significance." Psychotherapy Research, 6, 124-132.
33. McGlinchey, J. B., Atkins, D. C., & Jacobson, N. S. (2002). Clinical significant methods: Which one to use and how useful are they? Behavior Therapy, 33, 529-550.
34. McGlinchey, J. B., & Jacobson, N. S. (1999). Clinically significant but impractical?: A response to Hageman and Arrindell. Behaviour Research and Therapy, 37, 1211-1217.
35. Miller, G. A. (1956). The number seven plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63, 81-97.
36. Nietzel, M. T., Russell, R. L., Hemmings, K. A., & Gretter, M. L. (1987). Clinical significance of psychotherapy for unipolar depression: A meta-analytic approach to social comparison. Journal of Consulting & Clinical Psychology, 55, 156-161.
37. Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003). Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation. Medical Care, 41, 582-592.
38. Nunnally, J. C., & Kotsch, W. E. (1983). Studies of individual subjects: Logic and methods of analysis. British Journal of Clinical Psychology, 22, 83-93.
39. Ogles, B. M., Lambert, M. J., & Masters, K. S. (1996). Assessing outcome in clinical practice. Boston: Allyn & Bacon.
40. Ogles, B. M., Lambert, M. J., & Sawyer, J. D. (1995). Clinical significance of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Journal of Consulting and Clinical Psychology, 63, 321-326.
41. Ogles, B. M., Lunnen, K. M., & Bonesteel, K. (2001). Clinical significance: History, application and current practice. Clinical Psychology Review, 21, 421-446.
42. Robinson, L. A., Berman, J. S., & Neimeyer, R. A. (1990). Psychotherapy for the treatment of depression: A comprehensive review of controlled outcome research. Psychological Bulletin, 108, 30-49.
43. Seggar, L. B., Lambert, M. J., & Hansen, N. B. (2002). Assessing clinical significance: Application to the Beck Depression Inventory. Behavior Therapy, 33, 253-269.
44. Shadish, W., Matt, G., Navarro, A., Siegle, G., Crits-Christoph, P., Hazelrigg, M., et al. (1997). Evidence that therapy works in clinically representative conditions. Journal of Consulting and Clinical Psychology, 65, 355-365.
45. Sheehan, D. V. (1986). The anxiety disease. New York: Bantam.
46. Sheldrick, R. C., Kendall, P. C., & Heimberg, R. G. (2001). The clinical significance of treatments: A comparison of three treatment for conduct disordered children. Clinical Psychology: Science and Practice, 8, 418-430.
47. Smith, M., Glass, G., & Miller, T. (1980). The benefits of psychotherapy. Baltimore: Johns Hopkins University Press.
48. Speer, D. C. (1992). Clinically significant change: Jacobson and Truax (1991) revisited. Journal of Consulting and Clinical Psychology, 60, 402-408.
49. Speer, D. C. (1999). What is the role of two-wave designs in clinical research? Comment on Hageman and Arrindell. Behaviour Research and Therapy, 37, 1203-1210.
50. Speer, D. C., & Greenbaum, P. E. (1995). Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach. Journal of Consulting and Clinical Psychology, 63, 1044-1048.
51. Temkin, N. R., Heaton, R. K., Grant, I., Dikmen, S., & Sureyya S. (1999). Detecting significant change in neuropsychological test performance: A comparison of four models. Journal of the International Neuropsychological Society, 5, 357-369.
52. Tingey, R. C. (1989). Assessing clinical significance: Extension in methods an application to the SCL-90-R. Dissertation Abstracts International, 50(04B), 1659.
53. Tingey, R. C., Lambert, M. L., Burlingame, G. M., & Hansen, N. B. (1996a). Assessing clinical significance: Proposed extensions to the method. Psychotherapy Research, 6, 109-103.
54. Tingey, R. C., Lambert, M. L., Burlingame, G. M., & Hansen, N. B. (1996b). Clinically significant change: Practical indicators for evaluating psychotherapy outcome. Psychotherapy Research, 6, 144-153.
55. Wampold, B. E. (2001). The great psychotherapy debate: Models, methods and findings. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
56. Wampold, B. E., & Jenson, W. R. (1986). Clinical significance revisited. Behavior Therapy, 17, 302-305.
57. Ware, J. E. (1993). SF-36 Health Survey: Manual and interpretation guide. Boston: Nimrod.
58. Weissman, M. M., Klerman, G. L., Paykel, E. S., Prusoff, B., & Hanson, B. (1974). Treatment effects in the social adjustment of depressed patients. Archives of General Psychiatry, 30, 771-778.
59. Westin, D., & Morrison, K. (2001). A multidimensional meta-analysis of treatments for depression, panic, and generalized anxiety disorder: An empirical examination of the status of empirically supported therapies. Journal of Consulting and Clinical Psychology, 69, 875-899.
60. Wise, E. A. (in press). Psychotherapy outcome and satisfaction methods applied to intensive outpatient programming in a private practice setting. Psychotherapy: Theory, Research and Practice.