Cross-informant symptoms from CBCL, TRF, and YSR: Trait and method variance in a normative sample of Russian youths

Psychological Assessment

Volumn 22, Issue 4, 2010, Pages 893-911

  Grigorenko, Elena L ^a   Geiser, Christian ^b   Slobodskaya, Helena R ^c   Francis, David J ^d  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

^c INSTITUTE OF PHYSIOLOGY   (Russian Federation)

^d UNIVERSITY OF HOUSTON   (United States)

Author keywords

CBCL; Correlated trait correlated method minus one CT C(M 1); Russian youth; TRF; YSR

Indexed keywords

ADOLESCENT; ARTICLE; CHILD; CHILD BEHAVIOR CHECKLIST; CHILD PSYCHIATRY; FEMALE; HUMAN; MALE; MENTAL DISEASE; PARENTAL ATTITUDE; PSYCHOLOGICAL RATING SCALE; RUSSIAN FEDERATION; SCHOOL CHILD; SELF REPORT; STATISTICAL ANALYSIS; STATISTICAL MODEL; SYMPTOMATOLOGY; SYSTEMATIC ERROR; TEACHER REPORT FORM; VALIDITY; VARIANCE; YOUTH SELF REPORT;

ADOLESCENT; BIAS (EPIDEMIOLOGY); CHARACTER; CHECKLIST; CHILD; CHILD BEHAVIOR DISORDERS; CROSS-CULTURAL COMPARISON; FEMALE; HUMANS; MALE; OBSERVER VARIATION; PERSONALITY ASSESSMENT; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RUSSIA; STATISTICS AS TOPIC;

EID: 78650122708     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0020703     Document Type: Article

References (94)

1. Achenbach T.M. The classification of children's psychiatric symptoms: A factor analytic study. Psychological Monographs 1966, 80:1-37.
2. Achenbach T.M. The Child Behavior Profile: I. Boys aged 6-11. Journal of Consulting and Clinical Psychology 1978, 46:478-488.
3. Achenbach T.M. Manual for the Child Behavior Checklist/4-18 and 1991 profile 1991, Department of Psychiatry, University of Vermont, Burlington, VT.
4. Achenbach T.M. Manual for the Teacher's Report Form and 1991 profile 1991, Department of Psychiatry, University of Vermont, Burlington, VT.
5. Achenbach T.M. Manual for the Youth Self-Report and 1991 profile 1991, Department of Psychiatry, University of Vermont, Burlington, VT.
6. Achenbach T.M. Empirically based taxonomy: How to use syndromes and profile types derived from the CBCL/4-18, TRF, and YSR 1993, University of Vermont, Department of Psychiatry, Burlington, VT.
7. Achenbach T.M. As others see us: Clinical and research implications of cross-informant correlations for psychopathology. Current Directions in Psychological Science 2006, 15:94-98.
8. Achenbach T.M., Dumenci L. Advances in empirically based assessment: Revised cross-informant syndromes and new DSM-oriented scales for the CBCL, YSR, and TRF: Comment on Lengua, Sadowksi, Friedrich, and Fisher. Journal of Consulting and Clinical Psychology 2001, 69:699-702.
9. Achenbach T.M., Dumenci L., Rescorla L.A. Ten-year comparisons of problems and competencies for national samples of youth: Self, parent and teacher reports. Journal of Emotional and Behavioral Disorders 2002, 10:194-203.
10. Achenbach T.M., Edelbrock C. Manual for the Child Behavior Checklist and Revised Child Behavior Profile 1983, University of Vermont, Department of Psychiatry, Burlington, VT.
11. Achenbach T.M., Krukowski R.A., Dumenci L., Ivanova M.Y. Assessment of adult psychopathology: Meta-analyses and implications of cross-informant correlations. Psychological Bulletin 2005, 131:361-382.
12. Achenbach T.M., McConaughy S.H., Howell C.T. Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin 1987, 10:213-232.
13. Achenbach T.M., Rescorla L.A. Manual for the ASEBA school-age forms and profiles 2001, University of Vermont Research Center for Children, Youth, & Families, Burlington, VT.
14. Arbuckle J.L. Full information estimation in the presence of incomplete data. Advanced structural equation modeling 1996, 243-277. Erlbaum, Mahwah, NJ. G.A. Marcoulides, R.E. Schumacker (Eds.).
15. Becker A., Hagenberg N., Roessner V., Woerner W., Rothenberger A. Evaluation of the self-reported SDQ in a clinical setting: Do self-reports tell us more than ratings by adult informants?. European Child and Adolescent Psychiatry 2004, 13:17-24.
16. Begovac I., Rudan V., Skocic M., Filipovic O., Szirovicza L. Comparison of self-reported and parent-reported emotional and behavioral problems in adolescents from Croatia. Collegium Antropologicum 2004, 28:393-401.
17. Bentler P.M. Comparative fit indexes in structural models. Psychological Bulletin 1990, 107:238-246.
18. Berg-Nielsen T.S., Vika A., Dahl A.A. When adolescents disagree with their mothers: CBCL-YSR discrepancies related to maternal depression and adolescent self-esteem. Child: Care, Health, & Development 2003, 29:207-213.
19. Bérubé R.L., Achenbach T.M. Bibliography of published studies using the Achenbach System of Empirically Based Assessment (ASEBA) 2002, University of Vermont, Research Center for Children, Youth, & Families, Burlington, VT.
20. Biederman J., Mick E., Faraone S.V. Biased maternal reporting of child psychopathology?. Journal of the American Academy of Child & Adolescent Psychiatry 1998, 37:10-12.
21. Burns G.L., Haynes S.N. Clinical psychology: Construct validation with multiple sources of information and multiple settings. Handbook of multimethod measurement in psychology 2006, 401-418. American Psychological Association, Washington, DC. M. Eid, E. Diener (Eds.).
22. Campbell D.T., Fiske D.W. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 1959, 56:81-105.
23. Carlson G.A., Kashani J.H., Thomas M.D., Vaidya A., Daniel A.E. Comparison of two structured interviews on a psychiatrically hospitalized population of children. Journal of the American Academy of Child & Adolescent Psychiatry 1987, 26:645-648.
24. Carter A.S., Grigorenko E.L., Pauls D.L. A Russian adaptation of the Child Behavior Checklist: Psychometric properties and associations with child and maternal affective symptomatology and family functioning. Journal of Abnormal Child Psychology 1995, 23:663-686.
25. Courvoisier D.S., Nussbeck F.W., Eid M., Geiser C., Cole D.A. Analyzing the convergent and discriminant validity of states and traits: Development and applications of multimethod latent state-trait models. Psychological Assessment 2008, 20:270-280.
26. De Groot A., Koot H.M., Verhulst F.C. Cross-cultural generalizability of the Child Behavior Checklist cross-informant syndromes. Psychological Assessment 1994, 6:225-230.
27. De Groot A., Koot H.M., Verhulst F.C. Cross-cultural generalizability of the Youth Self-Report and Teacher's Report Form cross-informant syndromes. Journal of Abnormal Child Psychology 1996, 24:651-664.
28. De Los Reyes A., Kazdin A.E. Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin 2005, 131:483-509.
29. Drotar D., Stein R.E.K., Perrin E.C. Methodological issues in using the Child Behavior Checklist and its related instruments in clinical child psychology research. Journal of Clinical Child Psychology 1995, 24:184-192.
30. Duhig A.M., Renk K., Epstein M.K., Phares V. Interparental agreement on internalizing, externalizing, and total behavior problems: A meta-analysis. Clinical Psychology Science and Practice 2000, 7:435-453.
31. Eid M. A multitrait-multimethod model with minimal assumptions. Psychometrika 2000, 65:241-261.
32. Eid M., Lischetzke T., Nussbeck F.W. Structural equation models for multitrait-multimethod data. Handbook of multimethod measurement in psychology 2006, 283-299. American Psychological Association, Washington, DC. M. Eid, E. Diener (Eds.).
33. Eid M., Lischetzke T., Nussbeck F.W., Trierweiler L.I. Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple indicator CT-C(M - 1) model. Psychological Methods 2003, 8:38-60.
34. Eid M., Nussbeck F.W., Geiser C., Cole D.A., Gollwitzer M., Lischetzke T. Structural equation modeling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods 2008, 13:230-253.
35. Enders C.K. Applied missing data analysis 2010, Guilford Press, New York, NY.
36. Erol N., Simsek Z., Öner O., Munir K. Epidemiology of attention problems among Turkish children and adolescents: A national study. Journal of Attention Disorders 2008, 11:538-545.
37. Fabrega H., Ulrich R., Loeber R. Adolescent psychopathology as a function of informant and risk status. Journal of Nervous and Mental Disease 1996, 184:27-34.
38. Fiske D.W., Campbell D.T. Citations do not solve problems. Psychological Bulletin 1992, 112:393-395.
39. Funder D.C., West S.G. Consensus, self-other agreement, and accuracy in personality judgment: An introduction. Journal of Personality 1993, 61:457-476.
40. Gartstein M.A., Slobodskaya H.R., Kinsht I.A. Cross-cultural differences in temperament in the first year of life: United States of America (U.S.) and Russia. International Journal of Behavioral Development 2003, 27:316-328.
41. Geiser C. Multitrait-multimethod-multioccasion modeling 2009, AVM, München, Germany.
42. Geiser C., Eid M., Nussbeck F.W. On the meaning of the latent variables in the CT-C(M - 1) model: A comment on Maydeu-Olivares and Coffman (2006). Psychological Methods 2008, 13:49-57.
43. Goodman R., Meltzer H., Bailey V. The strengths and difficulties questionnaire: A pilot study on the validity of the self-report version. European Child and Adolescent Psychiatry 1998, 7:125-130.
44. Goodman R., Slobodskaya H., Knyazev G.G. Russian child mental health: A cross-sectional study of prevalence and risk factors. European Child & Adolescent Psychiatry 2005, 14:28-33.
45. Hellinckx W., Grietens H., De Munter A. Parent-reported problem behavior in 12-16-year-old American and Russian children: A cross-national comparison. International perspectives on child and adolescent mental health: Selected Proceedings of the First International Conference on Child & Adolescent Mental Health 2000, 205-222. Elsevier, Kidlington, England. N. Singh, J.P. Leung, A. Singh (Eds.).
46. Herjanic B., Reich W. Development of a structured psychiatric interview for children: Agreement between child and parent on individual symptoms. Journal of Abnormal Child Psychology 1982, 10:307-324.
47. Heubeck B.G. Cross-cultural generalizability of CBCL syndromes across three continents: From the USA and Holland to Australia. Journal of Abnormal Child Psychology 2000, 28:439-450.
48. Hu L., Bentler P.M. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods 1998, 3:424-453.
49. Hu L., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6:1-55.
50. Jensen P.S., Rubio-Stipec M., Canino G., Bird H.R., Dulcan M.K., Schwab-Stone M.E., Lahey B.B. Parent and child contributions to diagnosis of mental disorder: Are both informants always necessary?. Journal of the American Academy of Child & Adolescent Psychiatry 1999, 38:1569-1579.
51. Knyazev G.G., Slobodskaya H.R., Safronova M.V., Kinsht I.A. School adjustment and health in Russian adolescents. Psychology, Health & Medicine 2002, 7:143-155.
52. Knyazev G.G., Zupancic M., Slobodskaya H.R. Child personality in Slovenia and Russia: Structure and mean level of traits in parent and self-ratings. Journal of Cross-Cultural Psychology 2008, 39:317-334.
53. Krol N.P.C.M., De Bruyn E.E.J., van Aarle E.J.M., van den Bercken J.H.L. Computerized screening for DSM classifications using CBCL/YSR extended checklists: A clinical try-out. Computers in Human Behavior 2001, 17:315-337.
54. Kuznetsova I.V., Grigorenko E.L., Voronkova O.I. Initial diagnostics of abnormal development in school settings using the CBCL. Shkola Zdorovia 1996, 3:48-60.
55. Lahey B.B., Flagg E.W., Bird H.R., Schwab-Stone M.E., Canino G., Dulcan M.K., Regier D.A. The NIMH Methods for the Epidemiology of Child and Adolescent Mental Disorders (MECA) Study: Background and methodology. Journal of the American Academy of Child & Adolescent Psychiatry 1996, 35:855-864.
56. Lau A.S., Garland A.F., Yeh M., McCabe K.M., Wood P.A., Hough R.L. Race/ethnicity and inter-informant agreement in assessing adolescent psychopathology. Journal of Emotional and Behavioral Disorders 2004, 12:145-156.
57. Lengua L.J., Sadowski C.A., Friedrich W.N., Fisher J. Rationally and empirically derived dimensions of children's symptomatology: Expert ratings and confirmatory factor analyses of the CBCL. Journal of Consulting and Clinical Psychology 2001, 69:683-698.
58. Little R.J.A., Rubin D.B. Statistical analysis with missing data 2003, Wiley, New York, NY.
59. Loeber R., Green S.M., Lahey B.B., Stouthamer-Loeber M. Optimal informants on childhood disruptive behaviors. Development and Psychopathology 1989, 1:317-337.
60. Macmann G.M., Barnett D.W., Lopez E.J. The Child Behavior Checklist/4-18 and related materials: Reliability and validity of syndromal assessment. School Psychology Review 1993, 22:322-333.
61. Marsh H.W. Multitrait-multimethod analyses: Inferring each trait/method combination with multiple indicators. Applied Measurement in Education 1993, 6:49-81.
62. Marsh H.W., Hau K.-T., Balla J.R., Grayson D. Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research 1998, 33:181-220.
63. Marsh H.W., Hocevar D. A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of Applied Psychology 1988, 73:107-117.
64. Martin J.L., Ford C.B., Dyer-Friedman J., Tang J., Huffman L.C. Patterns of agreement between parent and child ratings of emotional and behavioral problems in an outpatient clinical setting: When children endorse more problems. Developmental and Behavioural Pediatrics 2004, 25:150-155.
65. McAuley C., Trew K. Children's adjustment over time in foster care: Cross-informant agreement, stability, and placement disruption. British Journal of Social Work 2000, 30:91-107.
66. McConaughy S.H., Achenbach T.M. Comorbidity of empirically based syndromes in matched general population and clinical samples. Journal of Child Psychology and Psychiatry 1994, 35:1141-1157.
67. Messick S. Validity of psychological assessment. American Psychologist 1995, 50:741-749.
68. Montgomery E. Self- and parent assessment of mental health: Disagreement on externalizing and internalizing behaviour in young refugees from the Middle East. Clinical Child Psychology & Psychiatry 2008, 13:49-63.
69. Muris P., Merckelbach H., Walczak S. Aggression and threat perception abnormalities in children with learning and behavior problems. Child Psychiatry and Human Development 2002, 33:147-163.
70. Muthén L.K., Muthén B.O. Mplus user's guide 2006, Author, Los Angeles, CA.
71. Reich W., Herjanic B., Welner Z., Gandhy P.R. Development of a structured psychiatric interview for children: Agreement on diagnosis comparing child and parent interviews. Journal of Abnormal Child Psychology 1982, 10:325-336.
72. Renk K., Phares V. Cross-informant ratings of social competence in children and adolescents. Clinical Psychology Review 2004, 24:239-254.
73. Rescorla L., Achenbach T.M., Ivanova M.Y., Dumenci L., Almqvist F., Bilenberg N., Verhulst F. Epidemiological comparisons of problems and positive qualities reported by adolescents in 24 countries. Journal of Consulting and Clinical Psychology 2007, 75:351-358.
74. Rousseau C., Drapeau A. Parent-child agreement on refugee children's psychiatric symptoms: A transcultural perspective. Journal of the American Academy of Child & Adolescent Psychiatry 1998, 37:629-636.
75. Sawyer M.G., Baghurst P., Mathias J. Differences between informants' reports describing emotional and behavioural problems in community and clinic-referred children: A research note. Journal of Child Psychology and Psychiatry 1992, 33:441-449.
76. Schafer J.L., Graham J.W. Missing data: Our view of the state of the art. Psychological Methods 2002, 7:147-177.
77. Schermelleh-Engel K., Moosbrugger H., Müller H. Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online 2003, 8:23-74.
78. Schwab-Stone M.E., Shaffer D., Dulcan M.K., Jensen P.S., Fisher P., Bird H.R., Rae D.S. Criterion validity of the NIMH Diagnostic Interview Schedule for Children Version 2.3 (DISC-2.3). Journal of the American Academy of Child & Adolescent Psychiatry 1996, 35:878-888.
79. Sechrest L., Davis M., Stickle T., McKnight P. Understanding "method" variance. Research design: Donald Campbell's legacy 2000, 63-87. Sage, Thousand Oaks, CA. L. Bickman (Ed.).
80. Seiffge-Krenke I., Kollmar F. Discrepancies between mothers' and fathers' perceptions of sons' and daughters' problem behaviour: A longitudinal analysis of parent-adolescent agreement on internalising and externalising problem behaviour. Journal of Child Psychology & Psychiatry & Allied Disciplines 1998, 39:687-697.
81. Share D.L. On the anglocentricities of current reading research and practice: The perils of overreliance on an "outlier" orthography. Psychological Bulletin 2008, 134:584-615.
82. Slobodskaya H.R. Competence, emotional and behavioral problems in Russian adolescents. European Child and Adolescent Psychiatry 1999, 8:173-180.
83. Smith S.R. Making sense of multiple informants in child and adolescent psychopathology: A guide for clinicians. Journal of Psychoeducational Assessment 2007, 25:139-149.
84. Stanger C., Lewis M. Agreement among parents, teachers, and children on internalizing and externalizing behaviour problems. Journal of Clinical Child Psychology 1993, 22:107-115.
85. Stanger C., MacDonald V.V., McConaughy S.H., Achenbach T.M. Predictors of cross-informant syndromes among children and youths referred for mental health services. Journal of Abnormal Child Psychology 1996, 24:597-614.
86. Steiger J.H. Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research 1990, 25:173-180.
87. Stevens G.W., Vollebergh W.A., Pels T.V., Crijnen A.A. Predicting internalizing problems in Moroccan immigrant adolescents in the Netherlands. Social Psychiatry & Psychiatric Epidemiology 2005, 40:1003-1011.
88. van den Ende J., Verhulst F.C. Informant, gender and age differences in ratings of adolescent problem behaviour. European Child and Adolescent Psychiatry 2005, 14:117-126.
89. Wahlsten V.S., Ahmad A., Von Knorring A.L. Do Kurdistanian and Swedish parents and children differ in their rating of competence and behavioural problems?. Nordic Journal of Psychiatry 2002, 56:279-283.
90. Wals M., Hillegers M.H., Reichart C.G., Ormel J., Nolen W.A., Verhulst F.C. Prevalence of psychopathology in children of a bipolar parent. Journal of the American Academy of Child & Adolescent Psychiatry 2001, 40:1094-1102.
91. Wothke W. Longitudinal and multi-group modeling with missing data. Modeling longitudinal and multilevel data: Practical issues, applied approaches, and specific examples 2000, 219-240. Erlbaum, Hillsdale, NJ. T.D. Little, K.U. Schnabel, J. Baumert (Eds.).
92. Youngstrom E., Loeber R., Stouthamer-Loeber M. Patterns and correlates of agreement between parent, teacher, and male adolescent ratings of externalizing and internalizing problems. Journal of Consulting and Clinical Psychology 2000, 68:1038-1050.
93. Zahn-Waxler C., Klimes-Dougan B., Slattery M.J. Internalizing problems of childhood and adolescence: Prospects, pitfalls, and progress in understanding the development of anxiety and depression. Development & Psychopathology 2000, 12:443-466.
94. Zimmerman R.S., Khoury E., Vega W., Gil A., Warheit G. Teacher and parent perceptions of behavior problems among a sample of African American, Hispanic, and Non-Hispanic White students. American Journal of Community Psychology 1995, 23:181-197.