Multilevel multitrait-multimethod latent analysis of structurally different and interchangeable raters of school climate

Psychological Assessment

Volumn 27, Issue 3, 2015, Pages 1097-1109

  Konold, Timothy ^a   Cornell, Dewey ^a  

^a UNIVERSITY OF VIRGINIA   (United States)

Author keywords

Informants; Multilevel confirmatory factor analysis; Multitrait multimethod; School climate

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; BULLYING; CONVERGENT VALIDITY; CORRELATION ANALYSIS; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MIDDLE SCHOOL; MULTILEVEL ANALYSIS; MULTITRAIT MULTIMETHOD; NORMAL HUMAN; SCHOOL; SOCIAL ENVIRONMENT; SOCIAL PROBLEM; SOCIAL SUPPORT; STUDENT; TEACHER; TEASING; CHILD; FACTOR ANALYSIS; HUMAN RELATION; ORGANIZATION; ORGANIZATION AND MANAGEMENT; SCHOOL TEACHER;

ADOLESCENT; BULLYING; CHILD; FACTOR ANALYSIS, STATISTICAL; HUMANS; INTERPERSONAL RELATIONS; MULTILEVEL ANALYSIS; ORGANIZATIONAL CULTURE; SCHOOL TEACHERS; SCHOOLS; SOCIAL ENVIRONMENT; STUDENTS;

EID: 84940109085     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000098     Document Type: Article

References (54)

1. American Institutes for Research. (2013). School Climate Survey Compendia. Retrieved from http://safesupportivelearning.ed.gov/topic-research/school-climate-measurement/school-climate-survey-compendium
2. Austin, G., & Duerr, M. (2005). Guidebook for the California Healthy Kids Survey. Part III. School Climate Survey for teachers and other staff, 2005-2006 ed. WestEd. Retrieved from http://www.wested.org/pub/docs/chks_surveys_summary.html
3. Bandyopadhyay, S., Cornell, D., & Konold, T. (2009). Internal and external validity of three school climate scales from the School Climate Bullying Survey. School Psychology Review, 38, 338-355.
4. Bauer, D. J., Howard, A. L., Baldasaro, R. E., Curran, P. J., Hussong, A. M., Chassin, L., & Zucker, R. A. (2013). A trifactor model for integrating ratings across multiple informants. Psychological Methods, 18, 475-493. http://dx.doi.org/10.1037/a0032475
5. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness-of-fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606. http://dx.doi.org/10.1037/0033-2909.88.3.588
6. Bleidorn, W., & Peters, A. L. (2011). A multilevel multitrait-multimethod analysis of self- and peer-reported daily affective experiences. European Journal of Personality, 25, 398-408. http://dx.doi.org/10.1002/per.804
7. Bradshaw, C. P., Sawyer, A. L., & O'Brennan, L. M. (2007). Bullying and peer victimization at school: Perceptual differences between students and school staff. School Psychology Review, 36, 361-382.
8. Browne, M., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. Bollen&J. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
9. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105. http://dx.doi.org/10.1037/h0046016
10. Carretero-Dios, H., Eid, M., & Ruch, W. (2011). Analyzing multitrait-multimethod data with multilevel confirmatory factor analysis: An application to the validation of the State-Trait Cheerfulness inventory. Journal of Research in Personality, 45, 153-164. http://dx.doi.org/10.1016/j.jrp.2010.12.007
11. Cohen, J., McCabe, E. M., Michelli, N. M., & Pickeral, T. (2009). School climate: Research, policy, practice, and teacher education. Teachers College Record, 111, 180-213.
12. Cornell, D., Gregory, A., Huang, F., & Fan, X. (2013). Perceived prevalence of teasing and bullying predicts high school dropout rates. Journal of Educational Psychology, 105, 138-149. http://dx.doi.org/10.1037/a0030416
13. Cornell, D., Huang, F., Konold, T., Meyer, P., Lacey, A., Nekvasil, E.,.. Shukla, K. (2013). Tech. Rep. No. of the Virginia Secondary School Climate Survey: 2013 Results for 7th and 8th Grade Students and Teachers. Executive Summary. Charlottesville, VA: Curry School of Education, University of Virginia.
14. Dary, T., & Pickeral, T. (Eds.). (2013). School Climate: Practices for Implementation and Sustainability. A School Climate Practice Brief, Number 1. New York: National School Climate Center.
15. Dedrick, R. F., & Greenbaum, P. E. (2011). Multilevel confirmatory factor analysis of a scale measuring interagency collaboration of children's mental health agencies. Journal of Emotional and Behavioral Disorders, 19, 27-40. http://dx.doi.org/10.1177/1063426610365879
16. Dyer, N. G., Hanges, P. J., & Hall, R. J. (2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. The Leadership Quarterly, 16, 149-167. http://dx.doi.org/10.1016/j.leaqua.2004.09.009
17. Eid, M., Lischetzke, T., Nussbeck, F. W., & Trierweiler, L. I. (2003). Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple-indicator CT-C(M-1) model. Psychological Methods, 8, 38-60. http://dx.doi.org/10.1037/1082-989X.8.1.38
18. Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M., & Lischetzke, T. (2008). Structural equation modeling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods, 13, 230-253. http://dx.doi.org/10.1037/a0013219
19. Ellert, U., Ravens-Sieberer, U., Erhart, M., & Kurth, B. M. (2011). Determinants of agreement between self-reported and parent-assessed quality of life for children in Germany-results of the German Health Interview and Examination Survey for Children and Adolescents (KiGGS). Health and Quality of Life Outcomes, 9, 102. http://dx.doi.org/10.1186/1477-7525-9-102
20. Fan, X., Thompson, B., & Wang, L. (1999). Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Structural Equation Modeling, 6, 56-83. http://dx.doi.org/10.1080/10705519909540119
21. Gregory, A., Cornell, D., Fan, X., Sheras, P., Shih, T., & Huang, F. (2010). Authoritative school discipline: High school practices associated with lower bullying and victimization. Journal of Educational Psychology, 102, 483-496. http://dx.doi.org/10.1037/a0018562
22. Grimm, K. J., Pianta, R. C., & Konold, T. R. (2009). Longitudinal multitrait-multimethod models for developmental research. Multivariate Behavioral Research, 44, 233-258. http://dx.doi.org/10.1080/00273170902794230
23. Hu, L., & Bentler, P. M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76-99). Thousand Oaks, CA: Sage.
24. Hu, L., & Bentler, P. M. (1999). Cutoffcriteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118
25. Huang, R., Cornell, D., Konold, R., Meyer, P., Lacey, A., Nekvasil, E.,.. Shukla, K. (2014). Factor structure and concurrent validity of the teacher version of the Authoritative School Climate Survey. Manuscript submitted for publication.
26. Juvonen, J., Nishina, A., & Graham, S. (2000). Peer harassment, psychological adjustment, and school functioning in early adolescence. Journal of Educational Psychology, 92, 349-359. http://dx.doi.org/10.1037/0022-0663.92.2.349
27. Kenny, D. A., & Kashy, D. A. (1992). Analysis of multtrait-multimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112, 165-172. http://dx.doi.org/10.1037/0033-2909.112.1.165
28. Klein, J., Cornell, D., & Konold, T. (2012). Relationships between bullying, school climate, and student risk behaviors. School Psychology Quarterly, 27, 154-169. http://dx.doi.org/10.1037/a0029350
29. Konishi, C., Hymel, S., Zumbo, B. D., & Li, Z. (2010). Do school bullying and student-teacher relationships matter for academic achievement? A multilevel analysis. Canadian Journal of School Psychology, 25, 19-39.
30. Konold, T., Cornell, D., Huang, F., Meyer, P., Lacey, A., Nekvasil, E.. Shukla, K. (2014). Multilevel multi-informant structure of the authoritative school climate survey. School Psychology Quarterly, 29, 238-255. http://dx.doi.org/10.1037/spq0000062
31. Konold, T. R., & Glutting, J. J. (2008). ADHD and method variance: A latent variable approach applied to a nationally representative sample of college freshmen. Journal of Learning Disabilities, 41, 405-416. http://dx.doi.org/10.1177/0022219408321111
32. Konold, T. R., & Pianta, R. C. (2007). The influence of informants' on ratings of children's behavioral functioning: A latent variable approach. Journal of Psychoeducational Assessment, 25, 222-236. http://dx.doi.org/10.1177/0734282906297784
33. Konold, T. R., & Shukla, K. D. (2014). Informant effects on behavioral and academic associations: A latent variable longitudinal examination. Psychology in the Schools, 51, 554-566.
34. Kozlowski, S. W. J., & Klein, K. J. (2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein&W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions and new directions (pp. 3-90). San Francisco, CA: Jossey-Bass.
35. Lacey, A., & Cornell, D. (2013). The impact of bullying climate on school-wide academic performance. Journal of Applied School Psychology, 29, 262-283. http://dx.doi.org/10.1080/15377903.2013.806883
36. Lacey, A., Cornell, D., & Konold, T. R. (2015). The relationships between teasing and bullying and middle school standardized exam performance. Manuscript under review.
37. Lance, C. E., Noble, C. L., & Scullen, S. E. (2002). A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods, 7, 228-244. http://dx.doi.org/10.1037/1082-989X.7.2.228
38. MacNeil, A. J., Prater, D. L., & Busch, S. (2009). The effects of school culture and climate on student achievement. International Journal of Leadership in Education, 12, 73-84. http://dx.doi.org/10.1080/13603120701576241
39. Marsh, H. W., & Grayson, D. (1995). Latent variable models of multitrait-multimethod data. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 177-198). Thousand Oaks, CA: Sage.
40. McDermott, P. A., Watkins, M. W., & Rhoad, A. M. (2014). Whose IQ is it?-Assessor bias variance in high-stakes psychological assessment. Psychological Assessment, 26, 207-214. http://dx.doi.org/10.1037/a0034832
41. Mehta, S. B., Cornell, D., Fan, X., & Gregory, A. (2013). Bullying climate and school engagement in ninth-grade students. The Journal of School Health, 83, 45-52. http://dx.doi.org/10.1111/j.1746-1561.2012.00746.x
42. Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338-354. http://dx.doi.org/10.1111/j.1745-3984.1991.tb00363.x
43. Nussbeck, F. W., Eid, M., Geiser, C., Courvoisier, D. S., & Lischetzke, T. (2009). A CTC(M-1) model for different types of raters. Methodology, 5, 88-98.
44. Olweus, D. (2007). The Olweus Bullying Questionnaire. Center City, MN: Hazelden.
45. Rajmil, L., López, A. R., López-Aguilà, S., & Alonso, J. (2013). Parentchild agreement on health-related quality of life (HRQOL): A longitudinal study. Health and Quality of Life Outcomes, 11, 101. http://dx.doi.org/10.1186/1477-7525-11-101
46. Ripski, M. B., & Gregory, A. (2009). Unfair, unsafe, and unwelcome: Do high school students' perceptions of unfairness, hostility, and victimization in school predict engagement and achievement. Journal of School Violence, 8, 355-375. http://dx.doi.org/10.1080/15388220903132755
47. Sundblad, G. M., Saartok, T., & Engström, L. M. T. (2006). Child-parent agreement on reports of disease, injury and pain. BMC Public Health, 6, 276. http://dx.doi.org/10.1186/1471-2458-6-276
48. Thornberry, T. P., Lizotte, A. J., Krohn, M. D., Farnworth, M., & Jang, S. J. (1991). Testing interactional theory: An examination of reciprocal causal relationships among family, school, and delinquency. The Journal of Criminal Law&Criminology, 82, 3-35. http://dx.doi.org/10.2307/1143788
49. U.S. Department of Education. (2010). Safe and Supportive Schools. Retrieved from http://www2.ed.gov/programs/safesupportiveschools/applicant.html
50. van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2012). Agreement of informants on emotional and behavioral problems from childhood to adulthood. Psychological Assessment, 24, 293-300. http://dx.doi.org/10.1037/a0025500
51. Waasdorp, T. E., Pas, E. T., O'Brennan, L. M., & Bradshaw, C. P. (2011). A multilevel perspective on the climate of bullying: Discrepancies among students, school staff, and parents. Journal of School Violence, 10, 115-132. http://dx.doi.org/10.1080/15388220.2010.539164
52. Waterman, C., McDermott, P. A., Fantuzzo, J. W., & Gadsden, V. L. (2012). The matter of assessor variance in early childhood education-Or whose score is it anyway? Early Childhood Research Quarterly, 27, 46-54. http://dx.doi.org/10.1016/j.ecresq.2011.06.003
53. Waters, E., Stewart-Brown, S., & Fitzpatrick, R. (2003). Agreement between adolescent self-report and parent reports of health and well-being: Results of an epidemiological study. Child: Care, Health and Development, 29, 501-509. http://dx.doi.org/10.1046/j.1365-2214.2003.00370.x
54. Wiebke, B., & Peters, A. L. (2011). A multilevel multitrait-multimethod analysis of self- and peer-reported daily affective experiences. European Journal of Personality, 25, 398-408. http://dx.doi.org/10.1002/per.804