Measuring Psychosocial Environments Using Individual Responses: an Application of Multilevel Factor Analysis to Examining Students in Schools

Prevention Science

Volumn 16, Issue 5, 2015, Pages 718-733

  Dunn, Erin C ^a,b,c   Masyn, Katherine E ^d   Jones, Stephanie M ^e   Subramanian, S V ^f   Koenen, Karestan C ^g  

^a MASSACHUSETTS GENERAL HOSPITAL   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

^c BROAD INSTITUTE OF MIT AND HARVARD   (United States)

^d GEORGIA STATE UNIVERSITY   (United States)

^e HARVARD GRADUATE SCHOOL OF EDUCATION   (United States)

^f HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^g Department of Medicine   (United States)

Author keywords

Ecological; Factor analysis; Latent variable; Multilevel; School climate; School environment

Indexed keywords

ADOLESCENT; CHILD BEHAVIOR DISORDERS; FEMALE; HUMAN; LONGITUDINAL STUDY; MALE; MULTILEVEL ANALYSIS; NATIONAL LONGITUDINAL STUDY OF ADOLESCENT HEALTH; PSYCHOLOGICAL MODEL; PSYCHOLOGY; QUESTIONNAIRE; SCHOOL; SELF CONCEPT; SOCIAL ADAPTATION; SOCIAL CHANGE; SOCIAL ENVIRONMENT; STUDENT; SUBSTANCE-RELATED DISORDERS; UNITED STATES;

ADOLESCENT; CHILD BEHAVIOR DISORDERS; FEMALE; HUMANS; LONGITUDINAL STUDIES; MALE; MODELS, PSYCHOLOGICAL; MULTILEVEL ANALYSIS; NATIONAL LONGITUDINAL STUDY OF ADOLESCENT HEALTH; SCHOOLS; SELF CONCEPT; SOCIAL ADJUSTMENT; SOCIAL CHANGE; SOCIAL ENVIRONMENT; STUDENTS; SUBSTANCE-RELATED DISORDERS; SURVEYS AND QUESTIONNAIRES; UNITED STATES;

EID: 84930277129     PISSN: 13894986     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11121-014-0523-x     Document Type: Article

References (35)

1. Anderson, C. (1982). The search for school climate: A review of the research. Review of Educational Research, 52(3), 368–420.
2. Aud, S., Hussar, W., Planty, M., Snyder, T., Bianco, K., Fox, M., & Drake, L. (2010). The condition of education 2010 (NCES 2010–028). Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.
3. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.
4. Bradshaw, C. P., Koth, C. Q., Thornton, L. A., & Leaf, P. J. (2009). Altering school climate through school-wide positive behavioral interventions and supports: Findings from a group-randomized effectiveness trial. Prevention Science, 10, 100–115.
5. Brand, S., Felner, R. D., Shim, M., Seitsinger, A., & Dumas, T. (2003). Middle school improvement and reform: Development and validation of a school-level assessment of climate, cultural pluralism, and school safety. Journal of Educational Psychology, 95, 570–588.
6. Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
7. Cohen, J., & Geier, V. K. (2010). School climate research summary. New York, NY: Center for Social and Emotional Education.
8. Cohen, J., McCabe, L., Michelli, N. M., & Pickeral, T. (2009). School climate: Research, policy, teacher education, and practice. Teachers College Record, 111(1), 180–213.
9. Dedrick, R. F., & Greenbaum, P. E. (2011). Multilevel confirmatory factor analysis of a scale measuring interagency collaboration of children's mental health agencies. Journal of Emotional and Behavioral Disorders, 19, 27–40.
10. Diez Roux, A. V. (2002). A glossary for multilevel analysis. Journal of Epidemiology and Community Health, 56, 588–594.
11. Dunn, E. C., Masyn, K. E., Yudron, M., Jones, S. M., & Subramanian, S. V. (2014). Translating multilevel theory into multilevel research: Challenge and opportunities for understanding the social determinants of psychiatric disorders. Social Psychiatry and Psychiatric Epidemiology, 49, 859–872.
12. Dyer, N. G., Hanges, P. J., & Hall, R. J. (2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. The Leadership Quarterly, 16, 149–167.
13. Eccles, J. S., & Roeser, R. W. (2011). School and community influences on human development. In M. H. Bornstein & M. E. Lamb (Eds.), Developmental science: An advanced textbook (6th ed., pp. 571–643). New York, NY: Psychology Press.
14. Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491.
15. Greenberg, M. T., Weissberg, R. P., O'Brien, M. U., Zins, J. E., Fredericks, L., Resnik, H., & Elias, M. J. (2003). Enhancing school-based prevention and youth development through coordinated social, emotional, and academic learning. American Psychologist, 58(6–7), 466–474.
16. Harris, K. M. (2013). The add health study: design and accomplishments: Carolina Population Center, University of North Carolina at Chapel Hill.
17. Haynes, N. M., Emmons, C. L., & Ben-Avie, M. (2001). The school development program student, staff, and parent school climate surveys. New Haven, CT: Yale Child Study Center.
18. Hox, J. J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.
19. James, L. R., Choi, C. C., Ko, C. H. E., McNeil, P. K., Minton, M. K., Wright, M. A., & Kim, K. (2008). Organizational and psychological climate: A review of theory and research. The European Work and Organizational Psychologist, 17(1), 5–32.
20. Jones, S. M., Brown, J. L., & Aber, J. L. (2011). Two-year impacts of a universal school-based social-emotional and literacy intervention: An experiment in translational developmental research. Child Development, 82(2), 533–554.
21. Kline, P. (1994). An easy guide to factor analysis. London, England: Routledge.
22. Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.
23. Marsh, H. W., Ludtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthen, B., & Nagengast, B. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44, 764–802.
24. Muthen, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28(4), 338–354.
25. Muthen, B. O. (1994). Multilevel covariance structure analysis. Sociological Methods & Research, 22, 376–398.
26. Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus user's guide (6th edition ed.). Los Angeles, CA: Muthén & Muthén.
27. National School Climate Center. The Comprehensive School Climate Inventory, from http://www.schoolclimate.org. Accessed 9 June 2013.
28. Reise, S. P., Ventura, J., Neuchterlein, K. H., & Kim, K. H. (2005). An illustration of multilevel factor analysis. Journal of Personality Assessment, 84(2), 126–136.
29. Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child and Family Psychology Review, 3(4), 223–241.
30. Shinn, M. (1990). Mixing and matching: Levels of conceptualization, measurement, and statistical analysis in community research. In P. Tolan, C. Keys, F. Chertok, & L. A. Jason (Eds.), Researching community psychology: Issues of theory and methods (pp. 111–126). Washington, DC: American Psychological Association.
31. Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180.
32. Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Boston, MA: Allyn and Bacon.
33. Toland, M. D., & De Ayala, R. J. (2005). A multilevel factor analysis of students’ evaluations of teaching. Educational and Psychological Measurement, 65(2), 272–296.
34. Van Horn, M. L. (2003). Assessing the unit of measurement for school climate through psychometric and outcome analyses of the school climate survey. Educational and Psychological Measurement, 63(6), 1002–1019.
35. Zullig, K. J., Koopman, T. M., Patton, J. M., & Ubbes, V. A. (2010). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28(2), 139–152.