Analyzing True Change in Longitudinal Multitrait-Multimethod Studies: Application of a Multimethod Change Model to Depression and Anxiety in Children

Developmental Psychology

Volumn 46, Issue 1, 2010, Pages 29-45

  Geiser, Christian ^a   Eid, Michael ^a   Nussbeck, Fridtjof W ^b   Courvoisier, Delphine S ^c   Cole, David A ^d  

^a FREIE UNIVERSITÄT BERLIN   (Germany)

^b UNIVERSITY OF ZURICH   (Switzerland)

^c UNIVERSITY OF GENEVA   (Switzerland)

^d VANDERBILT UNIVERSITY   (United States)

Author keywords

convergent and discriminant validity; latent change analysis; latent difference models; longitudinal confirmatory factor analysis; multitrait multimethod analysis

Indexed keywords

ANXIETY; ARTICLE; CHI SQUARE DISTRIBUTION; CHILD; DEPRESSION; FACTORIAL ANALYSIS; HUMAN; LONGITUDINAL STUDY; METHODOLOGY; PERSONALITY TEST; PSYCHOLOGICAL ASPECT; PSYCHOLOGICAL MODEL; PSYCHOLOGICAL RATING SCALE; PSYCHOLOGY; SELF CONCEPT; STATISTICS;

ANXIETY; CHI-SQUARE DISTRIBUTION; CHILD; DEPRESSION; FACTOR ANALYSIS, STATISTICAL; HUMANS; LONGITUDINAL STUDIES; MODELS, PSYCHOLOGICAL; PERSONALITY ASSESSMENT; PSYCHIATRIC STATUS RATING SCALES; PSYCHOLOGY; SELF CONCEPT;

EID: 76449119468     PISSN: 00121649     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0017888     Document Type: Article

References (80)

1. Allen J.P., Porter M.R., McFarland C.F., Marsh P.A., and McElhaney K.B. The two faces of adolescents' success with peers: Adolescent popularity, social adaptation, and deviant behavior. Child Development 76 (2005) 747-760
2. Arbuckle J.L. Full information estimation in the presence of incomplete data. In: Marcoulides G.A., and Schumacker R.E. (Eds). Advanced structural equation modeling (1996), Erlbaum, Mahwah, NJ 243-277
3. Bandalos D.L. The use of Monte Carlo studies in structural equation modeling research. In: Hancock G.R., and Mueller R.O. (Eds). Structural equation modeling: A second course (2006), Information Age Publishing, Greenwich, CT 385-426
4. Bentler P.M. Comparative fit indexes in structural models. Psychological Bulletin 107 (1990) 238-246
5. Bollen K.A. Structural equations with latent variables (1989), Wiley, New York, NY
6. Bollen K.A., and Curran P.J. Latent curve models: A structural equation perspective (2006), Wiley, New York, NY
7. Bollen K.A., and Stine R.A. Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods and Research 21 (1992) 205-229
8. Burns G.L., and Haynes S.N. Clinical psychology: Construct validation with multiple sources of information and multiple settings. In: Eid M., and Diener E. (Eds). Handbook of multimethod measurement in psychology (2006), American Psychological Association, Washington, DC 401-418
9. Burns G.L., Walsh J.A., and Gomez R. Convergent and discriminant validity of trait and source effects in ADHD-inattention and hyperactivity/impulsivity measures across a 3-month interval. Journal of Abnormal Child Psychology 15 (2003) 529-541
10. Byrne B.M., Shavelson R.J., and Muthén B. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin 105 (1989) 456-466
11. Campbell D.T., and Fiske D.W. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56 (1959) 81-105
12. Ciesla J.A., Cole D.A., and Steiger J.H. Extending the trait-state-occasion model: How important is within-wave measurement equivalence?. Structural Equation Modeling 14 (2007) 77-97
13. Cole D.A., Martin J.M., Peeke L., Henderson A., and Harwell J. Validation of depression and anxiety measures in White and Black youths: Multitrait-multimethod analyses. Psychological Assessment 10 (1998) 261-276
14. Cole D.A., Martin J.M., and Powers B. A competency-based model of child depression: A longitudinal study of peer, parent, teacher, and self-evaluations. Journal of Child Psychology & Psychiatry & Allied Disciplines 38 (1997) 505-514
15. Cole D.A., Martin J.M., Powers B., and Truglio R. Modeling causal relations between academic and social competence and depression: A multitrait-multimethod longitudinal study of children. Journal of Abnormal Psychology 105 (1996) 258-270
16. Cole D.A., and Maxwell S.E. Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology 112 (2003) 558-577
17. Cole D.A., Truglio R., and Peeke L. Relation between symptoms of anxiety and depression in children: A multitrait-multimethod-multigroup assessment. Journal of Consulting and Clinical Psychology 65 (1997) 110-119
18. Courvoisier D.S., Nussbeck F.W., Eid M., Geiser C., and Cole D.A. Analyzing the convergent validity of states and traits: Development and application of multimethod latent state-trait models. Psychological Assessment 20 (2008) 270-280
19. Cudeck R. Multiplicative models and MTMM matrices. Journal of Educational Statistics 13 (1988) 131-147
20. Dumenci L. Multitrait-multimethod analysis. In: Brown S.D., and Tinsley H.E.A. (Eds). Handbook of applied multivariate statistics and mathematical modeling (2000), Academic Press, San Diego, CA 583-611
21. Duncan T.E., Duncan S.C., and Strycker L.A. An introduction to latent variable growth curve modeling: Concepts, issues, and applications. 2nd ed. (2006), Erlbaum, Mahwah, NJ
22. Eid M. A multitrait-multimethod model with minimal assumptions. Psychometrika 65 (2000) 241-261
23. Eid M., and Diener E. Handbook of multimethod measurement in psychology (2006), American Psychological Association, Washington, DC
24. Eid M., Lischetzke T., and Nussbeck F.W. Structural equation models for multitrait-multimethod data. In: Eid M., and Diener E. (Eds). Handbook of multimethod measurement in psychology (2006), American Psychological Association, Washington, DC 283-299
25. Eid M., Lischetzke T., Nussbeck F.W., and Trierweiler L.I. Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple indicator CT-C (M-1) model. Psychological Methods 8 (2003) 38-60
26. Eid M., Schneider C., and Schwenkmezger P. Do you feel better or worse? The validity of perceived deviations of mood states from mood traits. European Journal of Personality 13 (1999) 283-306
27. Finney S.J., and DiStefano C. Non-normal and categorical data in structural equation modeling. In: Hancock G.R., and Mueller R.O. (Eds). Structural equation modeling: A second course (2006), Information Age Publishing, Greenwich, CT 269-314
28. Fiske D.W., and Campbell D.T. Citations do not solve problems. Psychological Bulletin 112 (1992) 393-395
29. Funder D.C. On the accuracy of personality judgment: A realistic approach. Psychological Review 102 (1995) 652-670
30. Ghisletta P., and Lindenberger U. Exploring the structural dynamics of the link between sensory and cognitive functioning in old age: Longitudinal evidence from the Berlin Aging Study. Intelligence 33 (2005) 555-587
31. Hertzog C., and Nesselroade J.R. Assessing psychological change in adulthood: An overview of methodological issues. Psychology and Aging 18 (2003) 639-657
32. Hu L., and Bentler P.M. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods 3 (1998) 424-453
33. Hu L., and Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 6 (1999) 1-55
34. Jöreskog K.G. Simultaneous factor analysis in several populations. Psychometrika 36 (1971) 409-426
35. Jöreskog K.G. Statistical models and methods for analysis of longitudinal data. In: Jöreskog K.G., and Sörbom D. (Eds). Advances in factor analysis and structural equation models (1979), Abt, Cambridge, MA 129-169
36. Julian M.W. The consequences of ignoring multilevel data structures in nonhierarchical covariance modeling. Structural Equation Modeling 8 (2001) 325-352
37. Kenny D.A. An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix. Journal of Experimental Social Psychology 12 (1976) 247-252
38. Kovacs M. The Children's Depression Inventory (CDI). Psychopharmacology Bulletin 21 (1985) 995-998
39. Kwok O., Haine R.A., Sandler I.N., Ayers T.S., Wolchik S.A., and Tein J.-Y. Positive parenting as a mediator of the relations between parental psychological distress and mental health problems of parentally bereaved children. Journal of Clinical Child and Adolescent Psychology 34 (2005) 260-271
40. Lance C.E., Noble C.L., and Scullen S.E. A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods 7 (2002) 228-244
41. Little R.J.A., and Rubin D.B. Statistical analysis with missing data (2003), Wiley, New York, NY
42. Little T.D., Cunningham W.A., Shahar G., and Widaman K.F. To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling 9 (2002) 151-173
43. Majdandzic M., and van den Boom D.C. Multimethod longitudinal assessment of temperament in early childhood. Journal of Personality 75 (2007) 121-167
44. Marsh H.W. Confirmatory factor analysis of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement 13 (1989) 335-361
45. Marsh H.W., and Bailey M. Confirmatory factor analysis of multitrait-multimethod data: A comparison of alternative models. Applied Psychological Measurement 15 (1991) 47-70
46. Marsh H.W., and Grayson D. Longitudinal confirmatory factor analysis: Common, time-specific, item-specific, and residual-error components of variance. Structural Equation Modeling 1 (1994) 116-145
47. Marsh H.W., and Grayson D.A. Latent variable models of multitrait-multimethod data. In: Hoyle R.H. (Ed). Structural equation modeling: Concepts, issues, and applications (1995), Sage, Thousands Oaks, CA 177-198
48. McArdle J.J. Dynamic but structural equation modeling of repeated measures data. In: Cattell R.B., and Nesselroade J. (Eds). Handbook of multivariate experimental psychology (1988), Plenum Press, New York, NY 561-614
49. McArdle J.J., and Hamagami F. Latent difference score structural models for linear dynamic analysis with incomplete longitudinal data. In: Collins L.M., and Sayer A.G. (Eds). New methods for the analysis of change (2001), American Psychological Association, Washington, DC 137-175
50. McArdle J.J., and Nesselroade J.R. Using multivariate data to structure developmental change. In: Cohen S.H., and Reese H.W. (Eds). Life-span developmental psychology: Methodological innovations (1994), Erlbaum, Hillsdale, NJ 223-267
51. Meredith W., and Horn J. The role of factorial invariance in modeling growth and change. In: Collins L.M., and Sayer A.G. (Eds). New methods for the analysis of change (2001), American Psychological Association, Washington, DC 203-240
52. Morris A.S., Robinson L.R., and Eisenberg N. Applying a multimethod perspective to the study of developmental psychology. In: Eid M., and Diener E. (Eds). Handbook of multimethod measurement in psychology (2006), American Psychological Association, Washington, DC 371-384
53. Muthén B.O. Mplus technical appendices (1998-2004), Muthén & Muthén, Los Angeles, CA
54. Muthén B.O., and Muthén L.K. How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling 4 (2002) 599-620
55. Muthén B.O., and Satorra A. Complex sample data in structural equation modeling. In: Marsden P.V. (Ed). Sociological methodology (1995), American Sociological Association, Washington, DC 267-316
56. Muthén L.K., and Muthén B.O. Mplus user's guide. 5th ed. (1998-2007), Author, Los Angeles, CA
57. Ostrov J.M., and Crick N.R. Forms and functions of aggression during early childhood: A short-term longitudinal study. School Psychology Review 36 (2007) 22-43
58. Paxton P., Curran P.J., Bollen K.A., Kirby J., and Chen F. Monte Carlo experiments: Design and implementation. Structural Equation Modeling 8 (2001) 287-312
59. Raffalovich L.E., and Bohrnstedt G.W. Common, specific, and error variance components of factor models: Estimation with longitudinal data. Sociological Methods & Research 15 (1987) 385-405
60. Reynolds C.R., and Richmond B.O. What I think and feel: A revised measure of children's manifest anxiety. Journal of Abnormal Child Psychology 6 (1978) 271-280
61. Satorra A., and Bentler P.M. Corrections to test statistics and standard errors in covariance structure analysis. In: von Eye A., and Clogg C.C. (Eds). Latent variable analysis: Applications for developmental research (1994), Sage, Thousand Oaks, CA 399-419
62. Satorra A., and Bentler P.M. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 66 (2001) 507-514
63. Schafer J.L., and Graham J.W. Missing data: Our view of the state of the art. Psychological Methods 7 (2002) 147-177
64. Schermelleh-Engel K., Moosbrugger H., and Müller H. Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Methods of Psychological Research-Online 8 (2003) 23-74
65. Schwarz G.E. Estimating the dimension of a model. Annals of Statistics 6 (1978) 461-464
66. Sörbom D. Detection of correlated errors in longitudinal data. British Journal of Mathematical and Statistical Psychology 28 (1975) 138-151
67. Steiger J.H. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research 25 (1990) 173-180
68. Steyer R., Eid M., and Schwenkmezger P. Modeling true intraindividual change: True change as a latent variable. Methods of Psychological Research-Online 2 (1997) 21-33
69. Steyer R., Ferring D., and Schmitt M.J. States and traits in psychological assessment. European Journal of Psychological Assessment 8 (1992) 79-98
70. Steyer R., Partchev I., and Shanahan M. Modeling true intra-individual change in structural equation models: The case of poverty and children's psychosocial adjustment. In: Little T.D., Schnabel K.U., and Baumert J. (Eds). Modeling longitudinal and multiple-group data: Practical issues, applied approaches, and specific examples (2000), Erlbaum, Hillsdale, NJ 109-126
71. Steyer R., Schmitt M., and Eid M. Latent state-trait theory and research in personality and individual differences. European Journal of Personality 13 (1999) 389-408
72. Tisak J., and Tisak M.S. Permanency and ephemerality of psychological measures with application to organizational commitment. Psychological Methods 5 (2000) 175-198
73. Tram J.M., and Cole D.A. A multimethod examination of the stability of depressive symptoms in childhood and adolescence. Journal of Abnormal Psychology 115 (2006) 674-686
74. Vautier S. A longitudinal SEM approach to STAI data: Two comprehensive multitrait-multistate models. Journal of Personality Assessment 83 (2004) 167-179
75. Vautier S., Steyer R., and Boomsma A. The true change model with individual method effects: Reliability issues. British Journal of Mathematical and Statistical Psychology 61 (2008) 369-399
76. Widaman K.F. Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement 9 (1985) 1-26
77. Widaman K.F., and Reise S.P. Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In: Bryant K.J., Windle M., and West S.G. (Eds). The science of prevention: Methodological advances from alcohol and substance abuse research (1997), American Psychological Association, Washington, DC 281-324
78. Wothke W. Covariance components analysis of the multitrait-multimethod matrix. In: Shrout P.E. (Ed). Personality research, methods, and theory: A festschrift honoring Donald W. Fiske (1995), Erlbaum, Hillsdale, NJ 125-144
79. Wothke W. Longitudinal and multi-group modeling with missing data. In: Little T.D., Schnabel K.U., and Baumert J. (Eds). Modeling longitudinal and multilevel data: Practical issues, applied approaches, and specific examples (2000), Erlbaum, Hillsdale, NJ 219-240
80. Zhou Q., Eisenberg N., Losoya S.H., Fabes R.A., Reiser M., Guthrie I.K., and Shepard S.A. The relations of parental warmth and positive expressiveness to children's empathy-related responding and social functioning: A longitudinal study. Child Development 73 (2002) 893-915