Measuring youths' perceptions of counseling impact: Description, psychometric evaluation, and longitudinal examination of the youth counseling impact scale v.2

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 39, Issue 1-2, 2012, Pages 104-117

  Kearns, Marcia A ^a   Athay, M Michele ^b   Riemer, Manuel ^c  

^a UNIVERSITY OF MISSOURI   (United States)

^b VANDERBILT UNIVERSITY   (United States)

^c WILFRID LAURIER UNIVERSITY   (Canada)

Author keywords

Change events; Counseling impact; Measurement; Psychometrics; Session impact; Therapeutic processes; Treatment progress; YCIS; Youths

Indexed keywords

ADOLESCENT; ARTICLE; COUNSELING; FEMALE; HUMAN; LONGITUDINAL STUDY; MALE; MENTAL DISEASE; PSYCHOLOGIC TEST; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; STANDARD; TREATMENT OUTCOME;

ADOLESCENT; COUNSELING; FEMALE; HUMANS; LONGITUDINAL STUDIES; MALE; MENTAL DISORDERS; PSYCHOLOGICAL TESTS; PSYCHOMETRICS; TREATMENT OUTCOME;

EID: 84858704851     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-012-0414-z     Document Type: Article

References (74)

1. ME Addis NS Jacobson 1996 Reasons for depression and the process and outcome of cognitive-Behavioral psychotherapies Journal of Consulting and Clinical Psychology 64 1417 1424 8991328 10.1037/0022-006X.64.6.1417 1:STN:280:DyaK2s7ksFOktg%3D%3D (Pubitemid 27014846)
2. CA Alfano AA Pina IK Villalta DC Beidel RT Ammerman LE Crosby 2009 Mediators and moderators of outcome in the behavioral treatment of childhood social phobia Journal of the American Academy of Child and Adolescent Psychiatry 48 945 953 19625981 10.1097/CHI.0b013e3181af8216
3. American Psychological Association Presidential Task Force on Evidence-Based Practice 2006 Evidence-based practice in psychology American Psychologist 61 271 285 10.1037/0003-066X.61.4.271 (Pubitemid 43815184)
4. D Andrich 1978 A rating formulation for ordered response categories Psychometrika 43 561 573 10.1007/BF02293814
5. Athay, M. M.; Riemer, M.; & Bickman, L. (2012). The Symptoms and Functioning Severity Scale (SFSS): Psychometric evaluation and differences among youth, caregiver, and clinician ratings over time. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-012- 0403-2.
6. L Bickman S Kelley C Breda AR Vides de Andrade M Riemer 2011 Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design Psychiatric Services 62 1423 1429 22193788 10.1176/appi.ps. 002052011
7. Bickman, L.; Riemer, M.; Kelley, S.; Tempesti, T.; Brannan, A.; Athay, M.; et al. (2010). Manual of the peabody treatment progress battery. Nashville, TN: Vanderbilt University.
8. Bickman, L.; Riemer, M.; Lambert, E.; Kelley, S.; Breda, C.; Dew, S.; et al. (2007). Manual of the Peabody treatment progress battery [Electronic version]. Nashville, TN: Vanderbilt University.
9. CLH Bockting P Spinhoven MWJ Koeter LF Wouters I Visser AH Schene 2006 Differential predictors of response to preventive cognitive therapy in recurrent depression: A 2-year prospective study Psychotherapy and Psychosomatics 75 229 236 16785772 10.1159/000092893 (Pubitemid 43938874)
10. Browne, M. W. C.; & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park: Sage.
11. JR Bussell 2001 Exploring the role of therapy process and outcome in interventions that target adolescent identity and intimacy Dissertation Abstracts International: Section B: The Sciences and Engineering 61 10-B 5553
12. Clarkin, J.; & Levy, K. (2004). The influence of client variables on psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed.; pp. 194-226). New York: Wiley.
13. J Curry P Rohde A Simons S Silva B Vitiello C Kratochvil, et al. 2006 Predictors and moderators of acute outcome in the Treatment for Adolescents with Depression Study (TADS) Journal of the American Academy of Child and Adolescent Psychiatry 45 1427 1439 17135988 10.1097/01.chi.0000240838.78984.e2 (Pubitemid 44900916)
14. A Dunne W Thompson R Leitch 2000 Adolescent males' experience of the counselling process Journal of Adolescence 23 79 93 10700374 10.1006/jado.1999.0300 1:STN:280:DC%2BD3c7mslagtA%3D%3D (Pubitemid 30156672)
15. JA Durlak T Fuhrman C Lampman 1991 Effectiveness of cognitive-behavior therapy for maladapting children: A meta-analysis Psychological Bulletin 110 204 214 1835106 10.1037/0033-2909.110.2.204 1:STN:280:DyaK38%2Flt1ymsQ%3D%3D
16. R Elliott 1985 Helpful and nonhelpful events in brief counseling interviews: An empirical taxonomy Journal of Counseling Psychology 32 307 322 10.1037/0022-0167.32.3.307
17. R Elliott M Wexler 1994 Measuring the impact of sessions in process-experiential therapy of depression: The session impacts scale Journal of Counseling Psychology 41 166 174 10.1037/0022-0167.41.2.166
18. SE Embretson 1996 The new rules of measurement Psychological Assessment 8 341 349 10.1037/1040-3590.8.4.341 (Pubitemid 27077258)
19. SL Eugster BE Wampold 1996 Systematic effects of participant role on evaluation of the psychotherapy session Journal of Consulting and Clinical Psychology 64 1020 1028 8916631 10.1037/0022-006X.64.5.1020 1:STN:280: DyaK2s%2FnsVSrsQ%3D%3D (Pubitemid 26349581)
20. Forgatch, M. S.; & Patterson, G. R. (2010). Parent Management Training-Oregon Model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed.; pp. 159-178). New York: Guilford.
21. AM Garcia JJ Sapyta PS Moore JB Freeman ME Franklin JS March, et al. 2010 Predictors and moderators of treatment outcome in the Pediatric Obsessive Compulsive Treatment Study (POTS I) Journal of the American Academy of Child and Adolescent Psychiatry 49 1024 1033 20855047 10.1016/j.jaac.2010.06.013
22. AF Garland KM Hawley L Brookman-Frazee MS Hurlburt 2008 Identifying common elements of evidence-based psychosocial treatments for children''s disruptive behavior problems Journal of the American Academy of Child and Adolescent Psychiatry 47 505 514 18356768 10.1097/CHI.0b013e31816765c2 (Pubitemid 351591599)
23. ST Gaynor VR Weersing DJ Kolko B Birmaher J Heo DA Brent 2003 The prevalence and impact of large sudden improvements during adolescent therapy for depression: A comparison across cognitive-behavioral, family, and supportive therapy Journal of Consulting and Clinical Psychology 71 386 393 12699032 10.1037/0022-006X.71.2.386 (Pubitemid 36323942)
24. ML Handwerk JC Huefner GL Smith K Clopton KE Hoff CP Lucas 2006 Gender differences in adolescents in residential treatment American Journal of Orthopsychiatry 76 312 324 16981810 10.1037/0002-9432.76.3.312 (Pubitemid 44454281)
25. NB Hansen MJ Lambert 2003 An evaluation of the dose-response relationship in naturalistic treatment settings using survival analysis Mental Health Services Research 5 1 12 12602642 10.1023/A:1021751307358 (Pubitemid 36192988)
26. A Harkness SO Lillienfeld 1997 Individual differences science for treatment planning: Personality traits Psychological Assessment 9 349 360 10.1037/1040-3590.9.4.349 (Pubitemid 28137189)
27. SC Harmon MJ Lambert DM Smart E Hawkins SL Nielsen K Slade, et al. 2007 Enhancing outcome for potential treatment failures: Therapist-client feedback and clinical support tools Psychotherapy Research 17 379 392 10.1080/10503300600702331 (Pubitemid 46930271)
28. AM Hayes JP Laurenceau G Feldman JL Strauss LA Cardaciotto 2007 Change is not always linear: The study of nonlinear and discontinuous patterns of change in psychotherapy Clinical Psychology Review 27 715 723 17316941 10.1016/j.cpr.2007.01.008 (Pubitemid 46899299)
29. SW Henggeler 1999 Multisystemic therapy: An overview of clinical procedures, outcomes, and policy implications Child and Adolescent Mental Health 4 2 10 10.1111/1475-3588.00243
30. AO Horvath L Luborsky 1993 The role of the therapeutic alliance in psychotherapy Journal of Consulting and Clinical Psychology 61 4 561 573 8370852 10.1037/0022-006X.61.4.561 1:STN:280:DyaK3szotFWnug%3D%3D (Pubitemid 23230079)
31. L Hu PM Bentler 1999 Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling 6 1 55 10.1080/10705519909540118
32. J Janzen M Fitzpatrick M Drapeau 2008 Processes involved in client-nominated relationship building incidents: Client attachment, attachment to therapist, and session impact Psychotherapy: Theory, Research, Practice, Training 45 377 390 10.1037/a0013310
33. PY Ji 2002 The role of attachment status in predicting longitudinal relationships between session-impact events and the working alliance within an adolescent client population Dissertation Abstracts International: Section B: The Sciences and Engineering 62 12-B 5966
34. AE Kazdin 2008 Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care American Psychologist 63 146 159 18377105 10.1037/0003-066X.63.3.146
35. S Kellett S Clarke L Matthews 2006 Session impact and outcome in group psychoeducative cognitive behavioural therapy Behavioural and Cognitive Psychotherapy 35 335 342 10.1017/S135246580600347X
36. R King M Bambling W Reid I Thomas 2006 Telephone and online counselling for young people: A naturalistic comparison of session outcome, session impact and therapeutic alliance Counselling & Psychotherapy Research 6 175 181 10.1080/14733140600874084
37. GG Kolden 1996 Change in early sessions of dynamic therapy: Universal processes and the generic model of psychotherapy Journal of Consulting and Clinical Psychology 64 489 496 8698941 10.1037/0022-006X.64.3.489 1:STN:280:DyaK28zgtVOqsQ%3D%3D (Pubitemid 26230543)
38. GG Kolden SM Chisholm-Stockard TJ Strauman SC Tierney EA Mullen KL Schneider 2006 Universal session-level change processes in an early session of psychotherapy: Path models Journal of Consulting and Clinical Psychology 74 327 336 16649877 10.1037/0022-006X.74.2.327 (Pubitemid 43807364)
39. GG Kolden KI Howard 1992 An empirical test of the generic model of psychotherapy Journal of Psychotherapy Practice & Research 1 225 236
40. GG Kolden TJ Strauman M Gittleman JL Halverson E Heerey KL Schneider 2000 The Therapeutic Realizations Scale-Revised (TRS-R): Psychometric characteristics and relationship to treatment process and outcome Journal of Clinical Psychology 56 9 1207 1220 10987692 10.1002/1097-4679(200009)56: 9<1207::AID-JCLP7>3.0.CO;2-Z 1:STN:280:DC%2BD3M7gvFGqtw%3D%3D
41. MJ Lambert DE Barley 2001 Research summary on the therapeutic relationship and psychotherapy outcome Psychotherapy: Theory, Research, Practice, Training 38 357 361 10.1037/0033-3204.38.4.357 (Pubitemid 34521343)
42. MJ Lambert JL Whipple DA Vermeersch DW Smart EJ Hawkins SL Nielsen, et al. 2002 Enhancing psychotherapy outcomes via providing feedback on client progress: A replication Clinical Psychology & Psychotherapy 9 91 103 10.1002/cpp.324 (Pubitemid 40309230)
43. JP Laurenceau AM Hayes GC Feldman 2007 Some methodological and statistical issues in the study of change processes in psychotherapy Clinical Psychology Review 27 682 695 17328996 10.1016/j.cpr.2007.01.007 (Pubitemid 46899298)
44. D Le Grange J Lock WS Agras A Moye SW Bryson B Jo, et al. 2012 Moderators and mediators of remission in family-based treatment and adolescent focused therapy for Anorexia Nervosa Behaviour Research and Therapy 50 85 92 22172564 10.1016/j.brat.2011.11.003
45. Linacre, J. (2007). Winsteps Rasch measurement (Version 3.64.2). Chicago, IL: MESA Press.
46. B Mallinckrodt 1994 Session impact in counseling process research: Comment on Elliott and Wexler (1994) and Stiles et al. (1994) Journal of Counseling Psychology 41 186 190 10.1037/0022-0167.41.2.186
47. DJ Martin JP Garske MK Davis 2000 Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review Journal of Consulting and Clinical Psychology 68 438 450 10883561 10.1037/0022-006X.68.3.438 1:STN:280:DC%2BD3czjvFOktw%3D%3D
48. Maton, K. I.; Schellenbach, C. J.; Leadbeater, B. J.; & Solarz, A. L. (Eds.). (2004). Investing in children, youth, families, and communities: Strengths-based research and policy. Washington, D.C.: American Psychological Association.
49. Ogles, B. M.; Lambert, M. J.; & Fields, S. A. (2002). Essentials of outcome assessment. New York: Wiley.
50. JS Ogrodniczuk WE Piper AS Joyce M McCallum 2001 Effect of patient gender on outcome in two forms of short-term individual psychotherapy Journal of Psychotherapy Practice Research 10 69 78 1:STN:280:DC%2BD3M7ms1GrsQ%3D%3D (Pubitemid 32240156)
51. DE Orlinsky KI Howard 1967 The good therapy hour: Experiential correlates of patients' and therapists' evaluations of therapy sessions Archives of General Psychiatry 16 621 632 6023951 10.1001/archpsyc.1967.01730230105013 1:STN:280:DyaF2s7jslejtA%3D%3D
52. Orlinsky, D. E.; Roonestad, M.; & Willutzki, U. (2004). Fifty years of psychotherapy process-outcome research: Continuity and change. In M. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed.; pp. 307-389). New York: Wiley.
53. EB Owens SP Hinshaw HC Kraemer LE Arnold HB Abikoff DP Cantwell, et al. 2003 Which treatment for whom for ADHD? Moderators of treatment response in the MTA Journal of Consulting and Clinical Psychology 71 540 552 12795577 10.1037/0022-006X.71.3.540 (Pubitemid 36605344)
54. JO Prochaska CC DiClemente JC Norcross 1992 In search of how people change: Applications to addictive behaviors American Psychologist 47 1102 1114 1329589 10.1037/0003-066X.47.9.1102 1:STN:280:DyaK3s%2Fjs1OnsA%3D%3D
55. SP Reise NG Waller 2009 Item response theory and clinical measurement Annual Review of Clinical Psychology 5 27 48 18976138 10.1146/annurev.clinpsy. 032408.153553
56. S Reynolds WB Stiles M Barkham DA Shapiro GE Hardy A Rees 1996 Acceleration of changes in session impact during contrasting time-limited psychotherapies Journal of Consulting and Clinical Psychology 64 577 586 8698952 10.1037/0022-006X.64.3.577 1:STN:280:DyaK28zgtVyjtg%3D%3D (Pubitemid 26230552)
57. Riemer, M.; Williams, N. J.; & Kearns, M. A. (unpublished manuscript). Caregiver reports on youth counseling impact: Description and psychometric evaluation of the Youth Counseling Impact Scale-Caregiver Version.
58. Riemer, M.; Athay, M. M.; Bickman, L.; Breda, C.; Kelley, S. D.; & Vides de Andrade, A. (2012). The Peabody Treatment Progress Battery: History and methods for developing a comprehensive measurement battery for youth mental health. Administration and Policy in Mental Health and Mental Health Services Research. doi: 10.1007/s10488-012-0404-1.
59. M Riemer MA Kearns 2010 Description and psychometric evaluation of the Youth Counseling Impact Scale Psychological Assessment 22 259 268 20528053 10.1037/a0018507
60. JS Schmitt RP Di Fabio 2004 Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria Journal of Clinical Epidemiology 57 1008 1018 15528051 10.1016/j.jclinepi.2004.02.007 (Pubitemid 39446639)
61. SR Shirk M Karver 2003 Prediction of treatment outcome from relationship variables in child and adolescent therapy: A meta-analytic review Journal of Consulting and Clinical Psychology 71 452 464 12795570 10.1037/0022-006X.71.3. 452 (Pubitemid 36605336)
62. SR Shirk MS Karver R Brown 2011 The alliance in child and adolescent psychotherapy Psychotherapy 48 17 24 21401270 10.1037/a0022181
63. MA Southam-Gerow PC Kendall VR Weersing 2001 Examining outcome variability: Correlates of treatment response in a child and adolescent anxiety clinic Journal of Clinical Child Psychology 30 422 436 11501258 10.1207/S15374424JCCP3003-13 1:STN:280:DC%2BD3MvlsF2mug%3D%3D (Pubitemid 33658633)
64. V Spek I Nyklícek P Cuijpers V Pop 2008 Predictors of outcome of group and internet-based cognitive behavior therapy Journal of Affective Disorders 105 137 145 17543392 10.1016/j.jad.2007.05.001 (Pubitemid 350236359)
65. WB Stiles 1980 Measurement of the impact of psychotherapy sessions Journal of Consulting and Clinical Psychology 48 176 185 7365056 10.1037/0022-006X.48.2.176 1:STN:280:DyaL3c7mtVKltw%3D%3D (Pubitemid 10064023)
66. WB Stiles S Reynolds GE Hardy A Rees M Barkham DA Shapiro 1994 Evaluation and description of psychotherapy sessions by clients using the Session Evaluation Questionnaire and the Session Impacts Scale Journal of Counseling Psychology 41 175 185 10.1037/0022-0167.41.2.175
67. TZ Tang RJ DeRubeis 1999 Sudden gains and critical sessions in cognitive-behavioral therapy for depression Journal of Consulting and Clinical Psychology 67 894 904 10596511 10.1037/0022-006X.67.6.894 1:STN:280: DC%2BD3c%2FmsVejug%3D%3D
68. TZ Tang RJ DeRubeis R Beberman T Pham 2005 Cognitive changes, critical sessions, and sudden gains in cognitive-behavioral therapy for depression Journal of Consulting and Clinical Psychology 73 168 172 15709844 10.1037/0022-006X.73.1.168 (Pubitemid 40223905)
69. TZ Tang L Luborsky T Andrusyna 2002 Sudden gains in recovering from depression: Are they also found in psychotherapies other than cognitive-behavioral therapy? Journal of Consulting and Clinical Psychology 70 444 447 11952204 10.1037/0022-006X.70.2.444 (Pubitemid 34274890)
70. JM Thomas KA Guskin 2001 Disruptive behavior in young children: What does it mean? Journal of the American Academy of Child and Adolescent Psychiatry 40 44 51 11195561 10.1097/00004583-200101000-00015 1:STN:280:DC%2BD3M7gslemuw%3D%3D (Pubitemid 32047227)
71. L Timulak 2010 Significant events in psychotherapy: An update of research findings Psychology and Psychotherapy: Theory, Research and Practice 83 421 447 10.1348/147608310X499404
72. JR Weisz B Weiss SS Han DA Granger T Morton 1995 Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies Psychological Bulletin 117 450 468 7777649 10.1037/0033-2909.117.3.450 1:STN:280:DyaK2M3ps1Clsw%3D%3D
73. BD Wright JM Linacre 1994 Reasonable mean-square fit values Rasch Measurement Transactions 8 370
74. C Zahn-Waxler EA Shirtcliff K Marceau 2008 Disorders of childhood and adolescence: Gender and psychopathology Annual Review of Clinical Psychology 4 275 303 18370618 10.1146/annurev.clinpsy.3.022806.091358 (Pubitemid 351668619)