Validity of clinically significant change classifications yielded by Jacobson-Truax and Hageman-Arrindell methods

BMC Psychiatry

Volumn 16, Issue 1, 2016, Pages

  Ronk, Fiona R ^a,b   Hooke, Geoffrey R ^a,b   Page, Andrew C ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^b Perth Clinic   (Australia)

Author keywords

Clinical significance; Outcomes; Quality of life; Recovery; Validity

Indexed keywords

CLASSIFICATION; CONSUMER; DEPRESSION ANXIETY STRESS SCALE; HOSPITAL PATIENT; HOSPITAL READMISSION; HUMAN; MAJOR CLINICAL STUDY; MENTAL HOSPITAL; QUALITY OF LIFE; QUESTIONNAIRE; VALIDITY; ADULT; AUSTRALIA; FEMALE; HOSPITALIZATION; MALE; MENTAL DISORDERS; MIDDLE AGED; PROCEDURES; PSYCHOTHERAPY; REPRODUCIBILITY; STANDARDS; STATISTICS AND NUMERICAL DATA; TREATMENT OUTCOME; VALIDATION STUDY; YOUNG ADULT;

ADULT; AUSTRALIA; FEMALE; HOSPITALIZATION; HUMANS; INPATIENTS; MALE; MENTAL DISORDERS; MIDDLE AGED; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PSYCHOTHERAPY; QUALITY OF LIFE; REPRODUCIBILITY OF RESULTS; SURVEYS AND QUESTIONNAIRES; YOUNG ADULT;

EID: 84975247345     PISSN: None     EISSN: 1471244X     Source Type: Journal    
DOI: 10.1186/s12888-016-0895-5     Document Type: Article

References (57)

1. Lambert MJ, Ogles BM. Using clinical significance in psychotherapy outcome research: the need for a common procedure and validity data. Psychoth Res. 2009;19:493-501.
2. Newnham EA, Page AC. Bridging the gap between best evidence and best practice in mental health. Clin Psychol Rev. 2011;30:127-42.
3. Jacobson NS, Follette WC, Revenstorf D. Psychotherapy outcome research: methods for reporting variability and evaluating clinical significance. Behav Ther. 1994;15:336-52.
4. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Cons Clin Psychol. 1991;59:12-9.
5. Schmuckler MA. What is ecological validity? A dimensional analysis. Infancy. 2001;2:419-36.
6. Derogatis LB, Cleary PA. Confirmation of the dimensional structure of the SCL-90: a study in construct validation. J Clin Psychol. 1977;3:981-9.
7. Ankuta GY, Abeles N. Client satisfaction, clinical significance, and meaningful change in psychotherapy. Prof Psychol-Res Pr. 1993;24:70-4.
8. Lunnen KM, Ogles BM. A multiperspective, multivariable evaluation of reliable change. J Consult Clin Psychol. 1998;66:400-10.
9. Ogles BM, Lambert MJ, Sawyer JD. Clinical significance of the national institute of mental health treatment of depression collaborative research program data. J Consult Clin Psychol. 1995;63:321-6.
10. Lambert MJ, Okiishi JC, Finch AE, Johnson LD. Outcome assessment: from conceptualization to implementation. Prof Psychol-Res Pr. 1998;1998:29.
11. Beckstead DJ, Hatch AL, Lambert MJ, Eggett DL, Goates MK, Vermeersch DA. Clinical significance of the outcome questionnaire (OQ-45.2). Behav Analyst Today. 2003;4:86-96.
12. Newnham EA, Harwood KE, Page AC. Evaluating the clinical significance of responses by psychiatric inpatients to the mental health subscales of the SF-36. J Affective Disorders. 2007;98:91-7.
13. Brazier JE, Harper R, Jones NM, O'Cathain A, Thomas KJ, Usherwood T, Westlake L. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;05(6846):160-4.
14. Wise EA. Evidence-based effectiveness of a private practice intensive outpatient program with dual diagnosis patients. J Dual Diagnosis. 2010;6:25-45.
15. Ronk FR, Hooke GR, Page AC. How consistent are clinical significance classifications when calculation methods and outcome measures differ? Clin Psychol-Sci Pr. 2012;19:167-79.
16. Hsu LM. Reliable changes in psychotherapy: taking into account regression toward the mean. Behav Assess. 1989;11:459-67.
17. Hsu LM. Regression toward the mean associated with measurement error and the identification of improvement and deterioration in psychotherapy. J Consult Clin Psychol. 1995;63:141-4.
18. Nunnally JC, Kotsch WE. Studies of individual subjects: logic and methods of analysis. Br J Clin Psychol. 1983;22:83-93.
19. Hageman WJ, Arrindell WA. Establishing clinically significant change: increment of precision between individual and group level of analysis. Behav Res Ther. 1999;37:1169-93.
20. Speer DC. Clinically significant change: Jacobson and Truax (1991) revisited. J Consult Clin Psychol. 1992;60:402-8.
21. Bryk AS, Raudenbush SW. Hierarchical linear models: applications and data analysis methods. Newbury Park: Sage, 1992.
22. McGlinchey JB, Atkins DC, Jacobson NS. Clinical significance methods: Which one to use and how useful are they? Behav Ther. 2002;33:529-50.
23. Hsu LM. Caveats concerning comparisons of change rates obtained with five methods of identifying significant client changes: comment on Speer and Greenbaum (1995). J Consult Clin Psychol. 1999;67:594-8.
24. Clarke SP, Oades LG, Crowe TP, Caputi P, Deane FP. The role of symptom distress and goal attainment in promoting aspects of psychological recovery for consumers with enduring mental illness. J Ment Health. 2009;18:389-97.
25. Jacobson NA, Greenley D. What is recovery? A conceptual model and explication. Psychiatric Serv. 2001;52:482-5.
26. Davidson L, Drake R, Schmutte T, Dinzeo T, Andres-Hyman R. Oil and water or Oil and vinegar? Evidence-based medicine meets recovery. Community Ment Hlt J. 2009;45:323.
27. Zimmerman M, Martinez J, Attiullah N, Friedman M, Toba C, Boerescu DA. Why do some depressed outpatients who are not in remission according to the Hamilton Depression Rating Scale nonetheless consider themselves to be in remission? Depress Anxiety. 2012;29:891-5.
28. Corrigan PW, Salzer M, Ralph RO, Sangster Y, Keck L. Examining the factor structure of the recovery assessment scale. Schiz Bull. 2004;30:1035-41.
29. Gladis MM, Gosch EA, Dishuk NM, Crits-Christoph P. Quality of life: expanding the scope of clinical significance. J Consult Clin Psychol. 1999;67:320-31.
30. Trivedi MH, Rush AJ, Wisniewski SR, Warden D, McKinney W, Downing M, Berman SR, Farabaugh A, Luther JF, Nierenberg AA. Factors associated with health-related quality of life among outpatients with major depressive disorder: a STAR* D report. J Clin Psychiat. 2006;67:1-478.
31. Endicott J, Nee J, Harrison W, Blumenthal R. Quality of life enjoyment and satisfaction questionnaire: a new measure. Psychopharmacol Bull. 1993;29:321-6.
32. Hope ML, Hooke GR, Page AC. The value of adding quality of life measures to assessments of outcomes in mental health. Qual Life Res. 2009;18:647-55.
33. ACHS. Clinical indicator user manual: mental health inpatient version 6. Melbourne: ACHS; 2012.
34. Hodgson RE, Lewis M, Boardman AP. Prediction of readmission to acute psychiatric units. Soc Psych Psych Epid. 2001;36:304.
35. Lyons JS, O'Mahoney MT, Miller SI, Neme J, Kabat J, Miller F. Predicting readmission to the psychiatric hospital in a managed care environment: Implications for quality indicators. Am J Psychiat. 1997;154:337-40.
36. Callaly T, Trauer T, Hyland M, Coombs T, Berk M. An examination of risk factors for readmission to acute adult mental health services within 28 days of discharge in the Australian setting. Austral Psychiat. 2011;19:221-5.
37. Byrne SL, Hooke GR, Page AC. Readmission: a useful indicator of the quality of inpatient psychiatric care. J Affect Disorders. 2011;126:206-13.
38. Byrne SL, Hooke GR, Page AC. Readmission to psychiatric hospital following treatment for depression with electroconvulsive therapy: the effect of planned readmissions. J ECT. 2012;28:e12-3.
39. Corrigan PW, Giffort D, Rashid F, Leary M, Okeke I. Recovery as a psychological construct. Community Ment Health J. 1999;35:231-9.
40. Hancock N, Bund A, Honey A, James G, Tamsett S. Improving measurement properties of the recovery assessment scale with rasch analysis. Am J Occ Ther. 2011;65:77-85.
41. Sklar M, Groessl EJ, O'Connell M, Davidson L, Aarons GA. Instruments for measuring mental health recovery: a systematic review. Clin Psychol Rev. 2013;33:1082-95.
42. Burgess P, Pirkis J, Coombs T, Rosen A. Assessing the value of existing recovery measures for routine use in Australian mental health services. Aust NZ J Psychiat. 2011;45:267-80.
43. Wing J, Beevor AS, Curtis RH, Park SBG, Hadden S, Burns A. Health of the Nation Outcome Scales (HoNOS): research and development. Br J Psychiat. 1998;172:11-8.
44. Newnham EA, Harwood KE, Page AC. The subscale structure and clinical utility of the health of the nation outcome scale. J Ment Health. 2009;18:326-34.
45. Lovibond PF, Lovibond SH. Self-report scales (DASS) for the differentiation and measurement of depression, anxiety, and stress. Behav Res Ther. 1995;33:335-43.
46. Henry JD, Crawford JR. The short form version of the Depression Anxiety Stress Scales (DASS 21): construct validity and normative data in a large non clinical sample. Br J Clin Psychol. 2005;44:227-39.
47. Page AC, Hooke GR, Morrison DM. Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. Br J Clin Psychol. 2007;46:283-97.
48. Ronk FR, Korman JR, Hooke GR, Page AC. Assessing clinical significance of treatment outcomes using the DASS-21. Psycholl Assess. 2013;25:1103-10.
49. Ritsner M, Kurs R, Kostizky H, Ponizovsky A, Modai I. Subjective quality of life in severely mentally ill patients: a comparison of two instruments. Qual Life Res. 2002;11:553.
50. Hsu LM. On the identification of clinically significant client changes: reinterpretation of Jacobson's cut scores. J Psychopathol Behav Assess. 1996;18:371-85.
51. Cohen J. Statistical power analysis for the behavioral sciences. New Jersey: Lawrence Erlbaum Associates; 1988.
52. Rollnick S, Miller WR, Butler C. Motivational interviewing in health care: helping patients change behavior. New York: Guilford Press; 2008.
53. Lambert MJ, Whipple JL, Vermeersch DA, Smart DW, Hawkins EJ, Nielsen SL, Goates M. Enhancing psychotherapy outcomes via providing feedback on client progress: a replication. Clin Psychol Psychother. 2002;9:91-103.
54. Dyer K, Hooke GR, Page AC. Effects of providing domain specific progress monitoring and feedback to therapists and patients on outcome. Psychoth Res. 2016;26:297-306. doi: 10.1080/10503307.2014.983207.
55. Shimokawa K, Lambert MJ, Smart DW. Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and mega-analytic review of a psychotherapy quality assurance system. J Consult Clin Psychol. 2011;78:298-311.
56. Restifo E, Kashyap S, Hooke GR, Page AC. Daily monitoring of temporal trajectories of suicidal ideation predict self-injury: a novel application of patient progress monitoring. Psychother Res. 2015;25:705-13.
57. Atkinson M, Zibin S, Chuang H. Characterizing quality of life among patients with chronic mental illness: a critical examination of the self-report methodology. Am J Psychiat. 1997;154:99-105.