How Consistent Are Clinical Significance Classifications When Calculation Methods and Outcome Measures Differ?

Clinical Psychology: Science and Practice

Volumn 19, Issue 2, 2012, Pages 167-179

  Ronk, Fiona R ^a   Hooke, Geoffrey R ^a   Page, Andrew C ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

Clinical significance; Depression; Outcomes monitoring; Recovery

Indexed keywords

EID: 84867153890     PISSN: 09695893     EISSN: 14682850     Source Type: Journal    
DOI: 10.1111/j.1468-2850.2012.01281.x     Document Type: Article

References (34)

1. Andrews, G., & Slade, T. (2001). Interpreting scores on the Kessler Psychological Distress Scale (K10). Australian and New Zealand Journal of Public Health, 25(6), 494-497.
2. Barnett, A. G., van der Pols, J. C., & Dobson, A. J. (2005). Regression to the mean: What it is and how to deal with it. International Journal of Epidemiology, 34(1), 215-220.
3. Bauer, S., Lambert, M. J., & Nielsen, S. L. (2004). Clinical significance methods: A comparison of statistical techniques. Journal of Personality Assessment, 82(1), 60-70.
4. Beckstead, D. J., Hatch, A. L., Lambert, M. J., Eggett, D. L., Goates, M. K., & Vermeersch, D. A. (2003). Clinical significance of the Outcome Questionnaire (OQ-45.2). The Behavior Analyst Today, 4(1), 86-96.
5. Brazier, J. E., Harper, R., Jones, N. M., O'Cathain, A., Thomas, K. J., Usherwood, T., et al. (1992). Validating the SF-36 health survey questionnaire: New outcome measure for primary care. BMJ, 305(6846), 160-164.
6. Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage.
7. Davidson, L., Drake, R., Schmutte, T., Dinzeo, T., & Andres-Hyman, R. (2009). Oil and water or oil and vinegar? Evidence-based medicine meets recovery. Community Mental Health Journal, 45(5), 323-332.
8. Enders, C. K. (2010). Applied missing data analysis. New York: Guilford Press.
9. Endicott, J., Nee, J., Harrison, W., & Blumenthal, R. (1993). Quality of Life Enjoyment and Satisfaction Questionnaire: A new measure. Psychopharmacology Bulletin, 29(2), 321-326.
10. Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12(1), 19-30.
11. Hageman, W. J., & Arrindell, W. A. (1999). Establishing clinically significant change: Increment of precision between individual and group level of analysis. Behaviour Research and Therapy, 37, 1169-1193.
12. Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., et al. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61(2), 155-163.
13. Hsu, L. M. (1989). Reliable changes in psychotherapy: Taking into account regression toward the mean. Behavioral Assessment, 11, 459-467.
14. Hsu, L. M. (1995). Regression toward the mean associated with measurement error and the identification of improvement and deterioration in psychotherapy. Journal of Consulting and Clinical Psychology, 63(1), 141-144.
15. Hsu, L. M. (1996). On the identification of clinically significant client changes: Reinterpretation of Jacobson's cut scores. Journal of Psychopathology and Behavioral Assessment, 18(4), 371-385.
16. Hsu, L. M. (1999). Caveats concerning comparisons of change rates obtained with five methods of identifying significant client changes: Comment on Speer and Greenbaum (1995). Journal of Consulting and Clinical Psychology, 67(4), 594-598.
17. Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984). Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15(4), 336-352.
18. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12-19.
19. Lambert, M. J., Gregersen, A. T., & Burlingame, G. (2004). The Outcome Questionnaire-45. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (3rd ed., Vol. 3, pp. 191-234). Mahwah, NJ: Lawrence Erlbaum.
20. Lambert, M. J., Okiishi, J. C., Finch, A. E., & Johnson, L. D. (1998). Outcome assessment: From conceptualization to implementation. Professional Psychology: Research and Practice, 29(1), 63-70.
21. Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy: Theory, Research, Practice, Training, 48(1), 72-79.
22. Linn, R. L., & Slinde, J. A. (1977). The determination of the significance of change between pre- and posttesting periods. Review of Educational Research, 47(1), 121-150.
23. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
24. Lovibond, P. F., & Lovibond, S. H. (1995). Self-report scales (DASS) for the differentiation and measurement of depression, anxiety, and stress. Behaviour Research and Therapy, 33, 335-343.
25. Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales (2nd ed.). Sydney: Psychology Foundation.
26. Newnham, E. A., Harwood, K. E., & Page, A. C. (2007). Evaluating the clinical significance of responses by psychiatric inpatients to the mental health subscales of the SF-36. Journal of Affective Disorders, 98(1-2), 91-97.
27. Nunnally, J. C., & Kotsch, W. E. (1983). Studies of individual subjects: Logic and methods of analysis. British Journal of Clinical Psychology, 22, 83-93.
28. Ogles, B. M., Lambert, M. J., Weight, D. G., & Payne, I. R. (1990). Agoraphobia outcome measurement: A review and meta-analysis. Psychological Assessment, 2(3), 317-325.
29. Page, A. C., Hooke, G. R., & Morrison, D. L. (2007). Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. British Journal of Clinical Psychology, 46(3), 283-297.
30. Rapaport, M. H., Clary, C., Fayyad, R., & Endicott, J. (2005). Quality-of-life impairment in depressive and anxiety disorders. American Journal of Psychiatry, 162(6), 1171-1178.
31. Ritsner, M., Kurs, R., Kostizky, H., Ponizovsky, A., & Modai, I. (2002). Subjective quality of life in severely mentally ill patients: A comparison of two instruments. Quality of Life Research, 11(6), 553-561.
32. Speer, D. C. (1992). Clinically significant change: Jacobson and Truax (1991) revisited. Journal of Consulting and Clinical Psychology, 60(3), 402-408.
33. Speer, D. C., & Greenbaum, P. E. (1995). Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach. Journal of Consulting and Clinical Psychology, 63(6), 1044-1048.
34. Tingey, R., Lambert, M., Burlingame, G., & Hansen, N. (1996). Assessing clinical significance: Proposed extensions to method. Psychotherapy Research, 6(2), 109-123.