Response shifts in mental health interventions: An illustration of longitudinal measurement invariance

Psychological Assessment

Volumn 25, Issue 2, 2013, Pages 520-531

  Fokkema, Marjolein ^a   Smits, Niels ^a   Kelderman, Henk ^a   Cuijpers, Pim ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Beck Depression Inventory; Iongitudinal measurement invariance; Reliability; Response shift

Indexed keywords

IMIPRAMINE; PLACEBO;

ARTICLE; BECK DEPRESSION INVENTORY; CONFIRMATORY FACTOR ANALYSIS; CORRELATION ANALYSIS; DIAGNOSTIC ERROR; FACTORIAL ANALYSIS; HUMAN; LONGITUDINAL STUDY; MAJOR DEPRESSION; MENTAL HEALTH; PSYCHOLOGIC ASSESSMENT; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL (TOPIC); RELIABILITY; SCORING SYSTEM; SELF REPORT; SYMPTOMATOLOGY; TREATMENT RESPONSE;

ADULT; ANTIDEPRESSIVE AGENTS; DEPRESSION; DEPRESSIVE DISORDER, MAJOR; DIAGNOSTIC SELF EVALUATION; FEMALE; HUMANS; LONGITUDINAL STUDIES; MALE; MENTAL HEALTH; PSYCHOTHERAPY; SELF REPORT; TREATMENT OUTCOME;

EID: 84882594434     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0031669     Document Type: Article

References (66)

1. Ahmed, S., Bourbeau, J., Maltais, F., & Mansour, A. (2009). The Oort structural equation modeling approach detected a response shift after a COPD self-management program not detected by the Schmitt technique. Journal of Clinical Epidemiology, 62, 1165-1172.
2. Ahmed, S., Mayo, N., Corbiere, M., Wood-Dauphinee, S., Hanley, J., & Cohen, R. (2005). Change in quality of life of people with stroke over time: True change or response shift?. Quality of Life Research, 14, 611-627.
3. Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 523, 317-332.
4. Beck, A. (1979). Cognitive therapy of depression. New York, NY: Guilford Press.
5. Beck, A., & Beamesderfer, A. (1974). Assessment of depression: The depression inventory. In P. Pichot (Ed.), Psychological measurements in psychopharmacology: Modern problems in pharmacopsychiatry (Vol. 7, pp. 151-169). Oxford, England: Karger.
6. Beck, A., Steer, R., & Garbin, M. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100.
7. Beck, A., Ward, C., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571.
8. Bentler, P. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
9. Bollen, K. (1989). Structural equations with latent variables. New York, NY: Wiley.
10. Boomsma, A., & Hoogland, J. (2001). The robustness of LISREL modeling revisited. In R. Cudeck, S. Du Toit, & D. Sörbom (Eds.), Structural equation modeling: Present and future. A festschrift in honor of Karl Jöreskog (pp. 139-168). Lincolnwood, IL: Scientific Software International.
11. Browne, M., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. Bollen & J. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
12. Byrne, B. (1995). Strategies in testing for an invariant second-order factor structure: A comparison of EQS and LISREL. Structural Equation Modeling: A Multidisciplinary Journal, 2, 53-72.
13. Byrne, B., & Baron, P. (1993). The Beck Depression Inventory: Testing and cross-validating a hierarchical factor structure for nonclinical adolescents. Measurement and Evaluation in Counseling and Development, 26, 164-178.
14. Byrne, B., & Baron, P. (1994). Measuring adolescent depression: Tests of equivalent factorial structure for English and French versions of the Beck Depression Inventory. Applied Psychology: An International Review, 43, 33-47.
15. Byrne, B., Baron, P., & Balev, J. (1996). The Beck Depression Inventory: Testing for its factorial validity and invariance across gender for Bulgarian non-clinical adolescents. Personality and Individual Differences, 21, 641-651.
16. Byrne, B., Baron, P., & Campbell, T. (1993). Measuring adolescent depression: Factorial validity and invariance of the Beck Depression Inventory across gender. Journal of Research on Adolescence, 3, 127-143.
17. Byrne, B., Baron, P., & Campbell, T. (1994). The Beck Depression Inventory (French version): Testing for gender-invariant factorial structure for nonclinical adolescents. Journal of Adolescent Research, 9, 166-179.
18. Byrne, B., Baron, P., Larsson, B., & Melin, L. (1996). Measuring depression for Swedish nonclinical adolescents: Factorial validity and equivalence of the Beck Depression Inventory across gender. Scandinavian Journal of Psychology, 37, 37-45.
19. Byrne, B., & Campbell, L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology, 30, 555-574.
20. Byrne, B., Shavelson, R., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466.
21. Chen, F., Curran, P., Bollen, K., Kirby, J., & Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research, 36, 462-494.
22. Cheung, G., & Rensvold, R. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
23. Cuijpers, P., Geraedts, A., van Oppen, P., Andersson, G., Markowitz, J., & van Straten, A. (2011). Interpersonal psychotherapy for depression: A meta-analysis. American Journal of Psychiatry, 168, 581-592.
24. De Beurs, E., den Hollander-Gijsman, M., Van Rood, Y., van Der Wee, N., Giltay, E., Van Noorden, M., . . . Zitman, F. (2011). Routine outcome monitoring in the Netherlands: Practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clinical Psychology & Psychotherapy, 18, 1-12.
25. Elkin, I., Parloff, M., Hadley, S., & Autry, J. (1985). NIMH Treatment of Depression Collaborative Research Program. Archives of General Psychiatry, 42, 305-316.
26. Elkin, I., Shea, T., Watkins, J., Imber, S., Sotsky, S., Collins, J., . . . Parloff, M. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: General effectiveness of treatments. Archives of General Psychiatry, 46, 971-982.
27. Golembiewski, R., Billingsley, K., & Yeager, S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs. Journal of Applied Behavioral Science, 12, 133-157.
28. Graham, J. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576.
29. Hamilton, M. (1960). A rating scale for depression. Journal of Neurology, Neurosurgery and Psychiatry, 23, 56-62.
30. Hattie, J. (1985). Methodology review: Assessing unidimensionality of tests and itenls. Applied Psychological Measurement, 9, 139-164.
31. Horn, J., & McArdle, J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117-144.
32. Hu, L., & Bentler, P. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
33. Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
34. Jöreskog, K. (1990). New developments in LISREL: Analysis of ordinal variables using polychoric correlations and weighted least squares. Quality & Quantity, 24, 387-404.
35. Jöreskog, K., & Sörbom, D. (1996). LISREL 8: User's reference guide. Chicago, IL: Scientific Software International.
36. Klerman, G., Weissman, M., Rounsaville, B., & Chevron, E. (1984). Interpersonal psychotherapy of depression. Northvale, NJ: Jason Aronson.
37. Lambert, M., Hansen, N., & Finch, A. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172.
38. Louks, J., Hayne, C., & Smith, J. (1989). Replicated factor structure of the Beck Depression Inventory. Journal of Nervous and Mental Disease, 177, 473-479.
39. MacCallum, R., Roznowski, M., & Necowitz, L. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504.
40. Marsh, H., Hau, K., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling, 11, 320-341.
41. McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum Associates.
42. Meade, A., Johnson, E., & Braddy, P. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93, 568-592.
43. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525-543.
44. Millsap, R. (2011). Statistical approaches to measurement invariance. New York, NY: Routledge.
45. Millsap, R., & Hartog, S. (1988). Alpha, beta, and gamma change in evaluation research: A structural equation approach. Journal of Applied Psychology, 73, 574-584.
46. Montgomery, S., & åsberg, M. (1979). A new depression scale designed to be sensitive to change. British Journal of Psychiatry, 134, 382-389.
47. Norman, P., & Parker, S. (1996). The interpretation of change in verbal reports: Implications for health psychology. Psychology & Health, 11, 301-314.
48. Oort, F. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14, 587-598.
49. R Development Core Team. (2010). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from http://www.R-project.org
50. Reise, S., Widaman, K., & Pugh, R. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
51. Revelle, W., & Zinbarg, R. (2009). Coefficients alpha, beta, omega, and the GLB: Comments on Sijtsma. Psychometrika, 74, 145-154.
52. Schafer, J. (2002). norm: Analysis of multivariate normal datasets with missing values (version 1.0 -9.2) [Computer software manual]. Retrieved from http://cran.r-project.org/
53. Schaubroeck, J., & Green, S. (1989). Confirmatory factor analytic procedures for assessing change during organizational entry. Journal of Applied Psychology, 74, 892-900.
54. Schmitt, N. (1982). The use of analysis of covariance structures to assess beta and gamma change. Mulitivariate Behavioral Research, 17, 343-358.
55. Shafer, A. (2006). Meta-analysis of the factor structures of four depression questionnaires: Beck, CES-D, Hamilton, and Zung. Journal of Clinical Psychology, 62, 123-146.
56. Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach's alpha. Psychometrika, 74, 107-120.
57. Spitzer, R., Endicott, J., & Robins, E. (1978). Research diagnostic criteria: Rationale and reliability. Archives of General Psychiatry, 35, 773-782.
58. Steenkamp, J.-B., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. The Journal of Consumer Research, 25, 78-90.
59. Steer, R., Iguchi, M., & Platt, J. (1992). Use of the revised Beck Depression Inventory with intravenous drug users not in treatment. Psychology of Addictive Behaviors, 6, 225-232.
60. Steiger, J. H., Shapiro, A., & Browne, M. W. (1985). On the multivariate asymptotic distribution of sequential chi-square statistics. Psychometrika, 50, 253-263.
61. Uher, R., Farmer, A., Maier, W., Rietschel, M., Hauser, J., Marusic, A., . . . Aitchison, K. (2008). Measuring depression: Comparison and integration of three scales in the GENDEP study. Psychological Medicine, 38, 289-300.
62. Vandenberg, R., & Lance, C. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70.
63. Vandenberg, R., & Self, R. (1993). Assessing newcomers' changing commitments to the organization during the first 6 months of work. Journal of Applied Psychology, 78, 557-568.
64. Yin, P., & Fan, X. (2000). Assessing the reliability of Beck Depression Inventory scores: Reliability generalization across studies. Educational and Psychological Measurement, 60, 201-223.
65. Yoon, M., & Millsap, R. (2007). Detecting violations of factorial invariance using data-based specification searches: A Monte Carlo study. Structural Equation Modeling: A Multidisciplinary Journal, 14, 435- 463.
66. Zhang, B., Fokkema, M., Cuijpers, P., Li, J., Smits, N., & Beekman, A. (2011). Measurement invariance of the Center for Epidemiological Studies Depression Scale (CES-D) among Chinese and Dutch elderly. BMC Medical Research Methodology, 11, 74-85.