Clinical validity of the counseling center assessment of psychological symptoms-62 (CCAPS-62): Further evaluation and clinical applications

Journal of Counseling Psychology

Volumn 59, Issue 4, 2012, Pages 575-590

  McAleavey, Andrew A ^a   Nordberg, Samuel S ^a   Hayes, Jeffrey A ^a   Castonguay, Louis G ^a   Locke, Benjamin D ^a   Lockard, Allison J ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

CCAPS 62; Counseling; Item response theory; Receiver operator characteristic (ROC) curves; Validity

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; COUNSELING; FACTORIAL ANALYSIS; FEMALE; HEALTH SERVICE; HUMAN; MALE; MENTAL DISEASE; MIDDLE AGED; MULTICENTER STUDY; PSYCHOLOGIC TEST; PSYCHOMETRY; RECEIVER OPERATING CHARACTERISTIC; REPRODUCIBILITY; SELF REPORT; UNITED STATES; VALIDATION STUDY;

ADOLESCENT; ADULT; COUNSELING; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MIDDLE AGED; PSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; ROC CURVE; SELF REPORT; STUDENT HEALTH SERVICES; UNITED STATES; YOUNG ADULT;

EID: 84874341277     PISSN: 00220167     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029855     Document Type: Article

References (65)

1. Agliata, A. K., &Renk, K. (2009). College students' affective distress: The role of expectation discrepancies and communication. Journal of Child and Family Studies, 18, 396-411. doi:10.1007/s10826-008-9244-8
2. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
3. Baker, R. W., &Siryk, B. (1986). Exploratory intervention with a scale measuring adjustment to college. Journal of Counseling Psychology, 33, 31-38. doi:10.1037/0022-0167.33.1.31
4. Barkham, M., Stiles, W. B., Lambert, M. J., &Mellor-Clark, J. (2010). Building a rigorous and relevant knowledgebase for the psychological therapies. In M. Barkham, G. E. Hardy, &J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence in the psychological therapies (pp. 21-61). Chichester, England: Wiley-Blackwell. doi: 10.1002/9780470687994.ch2
5. Barr, V., Rando, R., Krylowicz, B., &Winfield, E. (2010). The Association for University and College Counseling Center Directors annual survey. Retrieved from http://aucccd.org/img/pdfs/directors_survey_2009_nm .pdf
6. Beavers, W. R., Hampson, R. B., &Hulgus, Y. F. (1985). Commentary: The Beavers systems approach to family assessment. Family Process, 24, 398-405. doi:10.1111/j.1545-5300.1985.00398.x
7. Beavers, W. R., Hampson, R. B., &Hulgus, Y. F. (1990). Beavers systems model manual. Dallas, TX: Southwest Family Institute.
8. Beck, A. T., Epstein, N., Brown, G., &Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56, 893-897. doi:10.1037/0022- 006X.56.6.893
9. Beck, A. T., Steer, R. A., &Garbin, M. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100. doi:10.1016/0272-7358(88)90050-5
10. Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., &Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571. doi:10.1001/archpsyc.1961.01710120031004
11. Blanco, C., Okuda, M., Wright, C., Hasin, D. S., Grant, B. F., Liu, S.-M., &Olfson, M. (2008). Mental health of college students and their non-college-attending peers: Results from the national epidemiologic study on alcohol and related conditions. Archives of General Psychiatry, 65, 1429-1437. doi:10.1001/archpsyc.65.12.1429
12. Boswell, J. F., McAleavey, A. A., Castonguay, L. G., Hayes, J. A., &Locke, B. D. (in press). The effect of previous mental health service utilization on change in counseling clients' depressive symptoms. Journal of Counseling Psychology.
13. Browne, M. W., &Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen &J. S. Long (Eds.), Testing structural equation models (pp. 445-455). Newbury Park, CA: Sage.
14. Castonguay, L. G., Locke, B. D., &Hayes, J. A. (2011). The center for collegiate mental health: An example of a practice-research network in university counseling centers. Journal of College Student Psychotherapy, 25, 105-119. doi:10.1080/87568225.2011.556929
15. Center for Collegiate Mental Health. (2012). 2011 annual report (Publication No. STA 12-59). Retrieved from http://ccmh.squarespace.com/ storage/CCMH_AnnualReport_2011.pdf
16. Center for the Study of Collegiate Mental Health. (2009). Standardized data set [Unpublished instrument]. Retrieved from http://ccmh .squarespace.com/storage/SDS-Client-REV-6 -1-2009-Details.pdf
17. Cizek, G. J. (2012). Defining and distinguishing validity: Interpretations of score meaning and justifications of test use. Psychological Methods, 17, 31-43. doi:10.1037/a0026975
18. Derogatis, L. R. (1992). SCL-90-R administration, scoring, and procedures manual II. Towson, MD: Clinical Psychometric Research.
19. Diemer, M. A., Wang, Q., &Dunkle, J. H. (2009). Counseling center intake checklists at academically selective institutions: Practice and measurement implications. Journal of College Student Psychotherapy, 23, 135-150. doi:10.1080/87568220902743728
20. Eisenberg, D., Hunt, J., Speer, N., &Zivin, K. (2011). Mental health service utilization among college students in the United States. Journal of Nervous and Mental Disease, 199, 301-308. doi:10.1097/NMD .0b013e3182175123
21. Erdur-Baker, O., Aberson, C. L., Barrow, J. C., &Draper, M. R. (2006). Nature and severity of college students' psychological concerns: A comparison of clinical and nonclinical national samples. Professional Psychology: Research and Practice, 37, 317-323. doi:10.1037/0735- 7028.37.3.317
22. Gallagher, R. P. (2009). National survey of counseling center directors. Alexandria, VA: International Association of Counseling Services.
23. Garner, D. M., Olmsted, M. P., Polivy, J., &Garfinkel, P. E. (1984). Comparison between weight preoccupied women and anorexia nervosa. Psychosomatic Medicine, 46, 255-266.
24. Hayes, J. A., Locke, B. D., &Castonguay, L. G. (2011). The Center for Collegiate Mental Health: Practice and research working together. Journal of College Counseling, 14, 101-104. doi:10.1002/j.2161-1882.2011 .tb00265.x
25. Hayes, J. A., Youn, S. J., Castonguay, L. G., Locke, B. D., McAleavey, A. A., &Nordberg, S. (2011). Rates and predictors of counseling center use among college students of color. Journal of College Counseling, 14, 105-116. doi:10.1002/j.2161-1882.2011.tb00266.x
26. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., &Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064. doi:10.1037/0003-066X .51.10.1059
27. Hoyt, W. D., &Ross, S. D. (2003). Clinical and subclinical eating disorders in counselling center clients: A prevalence study. Journal of College Student Psychotherapy, 17, 39-54. doi:10.1300/J035v17n04_06
28. Hu, L.-T., &Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
29. Jacobson, N. S., &Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19. doi:10.1037/ 0022-006X.59.1.12
30. Kettmann, J. D. J., Schoen, E. G., Moel, J. E., Cochran, S. V., Greenberg, S. T., &Corkery, J. M. (2007). Increasing severity of psychopathology at counseling centers: A new look. Professional Psychology: Research and Practice, 38, 523-529. doi:10.1037/0735-7028.38.5.523
31. Kopta, S. M., &Lowry, J. L. (2002). Psychometric evaluation of the Behavioral Health Questionnaire-20: A brief instrument for assessing global mental health and the three phases of psychotherapy outcome. Psychotherapy Research, 12, 413-426. doi:10.1093/ptr/12.4.413
32. Kraus, D. R., Castonguay, L. G., Boswell, J. F., Nordberg, S. S., &Hayes, J. A. (2011). Therapist effectiveness: Implications for accountability and patient care. Psychotherapy Research, 21, 267-276. doi:10.1080/ 10503307.2011.563249
33. Kraus, D. R., Seligman, D. A., &Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285-314. doi:10.1002/jclp.20084
34. Kroenke, K., Spitzer, R. L., &Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606 - 613. doi:10.1046/j.1525-1497.2001 .016009606.x
35. Lambert, M. J., Hansen, N. B., &Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172. doi: 10.1037/0022-006X.69.2.159
36. Lambert, M. J., Hansen, N. B., Umpress, V., Lunnen, K., Okiishi, J., Burlingame, G. M., &Reisinger, C. W. (2001). Administration and scoring manual for the OQ-45. Orem, UT: American Professional Credentialing Services.
37. Lambert, M. J., &Hawkins, E. J. (2004). Measuring outcome in professional practice: Considerations in selecting and using brief outcome instruments. Professional Psychology: Research and Practice, 35, 492- 499. doi:10.1037/0735-7028.35.5.492
38. Lambert, M. J., &Ogles, B. M. (2009). Using clinical significance in psychotherapy outcome research: The need for a common procedure and validity data. Psychotherapy Research, 19, 493-501. doi:10.1080/ 10503300902849483
39. LeMoult, J., Castonguay, L. G., Joorman, J., &McAleavey, A. A. (in press). Depression: Basic research and clinical implications. In L. G. Castonguay &T. Oltmanns (Eds.), Psychopathology: Bridging the gap between basic empirical findings and clinical practice. New York, NY: Guilford Press.
40. Locke, B. D., Buzolitz, J. S., Lei, P.-W., Boswell, J. F., McAleavey, A. A., Sevig, T. D., . . . Hayes, J. A. (2011). Development of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62). Journal of Counseling Psychology, 58, 97-109. doi:10.1037/a0021282
41. Locke, B. D., McAleavey, A. A., Zhao, Y., Lei, P.-W., Hayes, J. A., Castonguay, L. G., . . . Lin, Y.-C. (2012). Development and initial validation of the Counseling Center Assessment of Psychological Symptoms-34 (CCAPS-34). Measurement and Evaluation in Counseling and Development, 45, 151-169. doi:10.1177/0748175611432642
42. McAleavey, A. A., Nordberg, S. S., Kraus, D., &Castonguay, L. G. (2012). Errors in outcome monitoring: Implications for real-world psychotherapy. Canadian Psychology, 53, 105-114. doi:10.1037/a0027833
43. McFall, R. M., &Treat, T. A. (1999). Quantifying the information value of clinical assessments with signal detection theory. Annual Review of Psychology, 50, 215-241. doi:10.1146/annurev.psych.50.1.215
44. Millon, T., Strack, S., Millon-Niedbala, M., &Grossman, S. D. (2008). Using the Millon College Counseling Inventory to assess student mental health needs. Journal of College Counseling, 11, 159-172. doi:10.1002/ j.2161-1882.2008.tb00032.x
45. Minami, T., Davies, D. R., Tierney, S. C., Bettmann, J. E., McAward, S. M., Averill, L. A., . . . Wampold, B. E. (2009). Preliminary evidence on the effectiveness of psychological treatments delivered at a university counseling center. Journal of Counseling Psychology, 56, 309-320. doi:10.1037/a0015398
46. Mintz, L. B., &O'Halloran, M. (2000). The Eating Attitudes Test: Validation with DSM-IV eating disorder criteria. Journal of Personality Assessment, 74, 489-503. doi:10.1207/S15327752JPA7403_11
47. Muthén, B. O. (1998 -2004). Mplus technical appendices. Los Angeles, CA: Muthén &Muthén.
48. Muthén, B. O., &Asparouhov, T. (2002). Latent variable analysis with categorical outcomes: Multiple-group and growth modeling in Mplus (Mplus Web notes No. 4, v. 5). Retrieved from http://www.statmodel .com
49. Muthén, L. K., &Muthén, B. O. (1998 -2011). Mplus user's guide (6th ed.). Los Angeles, CA: Muthén &Muthén
50. Newman, M. G., Kachin, K. E., Zuellig, A. R., Constatino, M. J., &Cashman-McGrath, L. (2003). The social phobia diagnostic questionnaire: Preliminary validation of a new self-report diagnostic measure of social phobia. Psychological Medicine, 33, 623- 635. doi:10.1017/ S0033291703007669
51. Okiishi, J. C., Lambert, M. J., Eggett, D., Nielsen, S. L., Dayton, D. D., &Vermeersch, D. A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their patients' psychotherapy outcome. Journal of Clinical Psychology, 62, 1157- 1172. doi:10.1002/jclp.20272
52. Reynolds, W. M. (1982). Development of reliable and valid short forms of the Marlowe-Crowne Social Desirability Scale. Journal of Clinical Psychology, 38, 119-125. doi:10.1002/1097-4679(198201)38:1=119:: AID-JCLP2270380118=3.0.CO;2-I
53. Roberts, R. E., Lewinsohn, P. M., &Seeley, J. R. (1991). Screening for adolescent depression: A comparison of depression scales. Journal of the American Academy of Child &Adolescent Psychiatry, 30, 58-66. doi:10.1097/00004583-199101000-00009
54. Robertson, J. M., Benton, S. L., Newton, F. B., Downey, R. G., Marsh, P. A., Benton, S. A., . . . Shin, K.-H. (2006). K-State Problem Identification Rating Scales for College Students. Measurement and Evaluation in Counseling and Development, 39, 141-160.
55. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34, 100-114.
56. Saunders, J. B., Aasland, O. G., Babor, T. F., de la Fuente, J. R., &Grant, M. (1993). Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction, 88, 791-804. doi:10.1111/j.1360-0443.1993.tb02093.x
57. Sharkin, B. S. (2004). Assessing changes in categories but not severity of counseling center clients' problems across 13 years: Comment on Benton, Robertson, Tseng, Newton, and Benton (2003). Professional Psychology: Research and Practice, 35, 313-315. doi:10.1037/0735-7028 .35.3.313
58. Sharkin, B. S., &Coulter, L. P. (2005). Empirically supporting the increasing severity of college counseling center client problems: Why is it so challenging? Journal of College Counseling, 8, 165-171. doi:10.1002/j .2161-1882.2005.tb00083.x
59. Slade, T., &Watson, D. (2006). The structure of common DSM-IV and ICD-10 mental disorders in the Australian general population. Psychological Medicine, 36, 1593-1600. doi:10.1017/S0033291706008452
60. Spielberger, C. D. (1999). STAXI-2: The State-Trait Anger Expression Inventory professional manual. Odessa, FL: Psychological Assessment Resources.
61. Steer, R. A., Ranieri, W. F., Beck, A. T., &Clark, D. A. (1993). Further evidence for the validity of the Beck Anxiety Inventory with psychiatric outpatients. Journal of Anxiety Disorders, 7, 195-205. doi:10.1016/ 0887-6185(93)90002-3
62. Stevens, J. (1996). Applied multivariate statistics for the social sciences (3rd ed.). Mahwah, NJ: Erlbaum.
63. Stulz, N., &Crits-Chrisoph, P. (2010). Distinguishing anxiety and depression in self-report: Purification of the Beck Anxiety Inventory and Beck Depression Inventory-II. Journal of Clinical Psychology, 66, 927-940. doi:10.1002/jclp.20701
64. Stulz, N., Lutz, W., Leach, C., Lucock, M., &Barkham, M. (2007). Shapes of early change in psychotherapy under routine outpatient conditions. Journal of Consulting and Clinical Psychology, 75, 864-874. doi: 10.1037/0022-006X.75.6.864
65. Tutty, L. M. (1995). Theoretical and practical issues in selecting a measure of family functioning. Research on Social Work Practice, 5, 80-106. doi:10.1177/104973159500500107