Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error

Multivariate Behavioral Research

Volumn 44, Issue 6, 2009, Pages 764-802

  Marsh, Herbert W ^a   Lüdtke, Oliver ^b   Robitzsch, Alexander ^c   Trautwein, Ulrich ^b   Asparouhov, Tihomir ^d   Muthén, Bengt ^e   Nagengast, Benjamin ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^c Institute for Educational Progress   (Germany)

^d Muthen and Muthen   (United States)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77951656763     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273170903333665     Document Type: Article

References (76)

1. Asparouhov, T., & Muthén, B. (2003). Full-information maximum-likelihood estimation of general two-level latent variable models with missing data: A technical report. Los Angeles: Muthén & Muthén.
2. Asparouhov, T., & Muthén, B. (2006, August). Multilevel modeling of complex survey data. Proceedings of the Joint Statistical Meeting, Seattle, WA. ASA section on Survey Research Methods, 2718-2726.
3. Asparouhov, T., & Muthén, B. (2007). Constructing covariates in multilevel regression. Mplus Web Notes: No. 11. Los Angeles: Muthén & Muthén.
4. Baumert, J., Bos, W., & Lehmann, R. (Eds.). (2000). TIMSS/III: Dritte Internationale Mathematikund Naturwissenschaftsstudie-Mathematische und naturwissenschaftliche Bildung am Ende der Schullaufbahn [TIMSS/III: Third international mathematics and science study-students' knowledge of mathematics and science at the end of secondary education]. Opladen, Germany: Leske and Budrich.
5. Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregationand analysis. In K. J. Klein & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco: Jossey-Bass.
6. Bliese, P. D., Chan, D., & Ployhart, R. E. (2007). Multilevel methods: Future directions in measurement, longitudinal analyses, and nonnormal outcomes. Organizational Research Methods, 10, 551-563.
7. Bovaird, J. A. (2007). Multilevel structural equation models for contextual factors. In T. D. Little, J. A. Bovaird, & N. A. Card. Modeling contextual effects in longitudinal studies (pp. 149-182). Mahwah, NJ: Erlbaum.
8. Bruner, J. (1996). A narrative model of self construction. Psyke & Logos, 17, 154-170.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Mahwah, NJ: Erlbaum.
10. Cronbach, L. J. (1976). Research on classrooms and schools: Formulations of questions, design and analysis. Stanford, CA: Stanford Evaluation Consortium.
11. Croon, M. A., & van Veldhoven, M. J. P. M. (2007). Predicting group level variables from variables measured at the individual level: A latent variable multilevel model. Psychological Methods, 12, 45-57.
12. Enders, C. K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121-138.
13. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge, UK: Cambridge University Press.
14. Goldstein, H. (2003). Multilevel statistical models. London: Edward Arnold.
15. Goldstein, H., & McDonald, R. P. (1988). A general-model for the analysis of multilevel data. Psychometrika 53, 455-467.
16. Härnqvist, K. (1978). Primary mental abilities of collective and individual levels. Journal of Educational Psychology, 70, 706-716.
17. Iverson, G. R. (1991). Contextual analysis. Sage University Paper Series on Quantitative Approaches in the Social Sciences, 07-081. Newbury Park, CA: Sage.
18. Kane, M. T., Gillmore, G. M., & Crooks, T. J. (1976). Student evaluations of teaching: The generalizability of class means. Journal of Educational Measurement, 13, 171-183.
19. Kaplan, D. (2000). Structural equation modeling: Foundations and extensions. Newbury Park, CA: Sage.
20. Klein, A., & Moosbrugger, H. (2000). Maximum likelihood estimation of latent interaction effects with the LMS method. Psychometrika, 65, 457-474.
21. Kozlowski, S. W. J., & Klein, K. J. (2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 3-90). San Francisco: Jossey-Bass.
22. Kreft, I. G. G., de Leeuw, J., & Aiken, L. S. (1995). The effect of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30, 1-21.
23. LaHuis, D. M., & Ferguson, M. W. (2009). The accuracy of significance tests for slope variance components in multilevel random coefficient models. Organizational Research Methods, 12, 418-443.
24. Lee, S.-Y. (2007). Structural equation modeling: A Bayesian approach. West Sussex, UK: Wiley.
25. Lee, S.-Y., & Poon, W.-Y. (1998). Analysis of two-level structural equation models via EM type algorithms. Statistica Sinica, 8, 749-766.
26. Lüdtke, O., Köller, O., Marsh, H. W., & Trautwein, U. (2005). Teacher frame of reference and the big-fish-little-pond effect. Contemporary Educational Psychology, 30, 263-285.
27. Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203-229.
28. Lüdtke, O., Marsh, H. W., Robitzsch, A., & Trautwein, U. (2009). A 2 2 taxonomy of multilevel latent covariate models: Accuracy and bias trade-offs in full and partial error-correction models. Manuscript submitted for publication.
29. Marsh, H. W. (1984). Self-concept: The application of a frame of reference model to explain paradoxical results. Australian Journal of Education, 28, 165-181.
30. Marsh, H. W. (1987). The big-fish-little-pond effect on ASC. Journal of Educational Psychology, 79,280-295.
31. Marsh, H. W. (1991). The failure of high ability high schools to deliver academic benefits: The importance of ASC and educational aspirations. American Educational Research Journal, 28, 445-480.
32. Marsh, H. W. (1994). Using the National Educational Longitudinal Study of 1988 to evaluate theoretical models of self-concept: The Self-Description Questionnaire. Journal of Educational Psychology, 86, 439-456.
33. Marsh, H. W. (2007). Self-concept theory, measurement and research into practice: The role of self concept in educational psychology-25th Vernon-Wall lecture series. London: British Psychological Society.
34. Marsh, H. W., Chessor, D., Craven, R. G., & Roche, L. (1995). The effects of gifted and talented programs on ASC: The big fish strikes again. American Educational Research Journal, 32, 285-319.
35. Marsh, H. W., & Craven, R. (2002). The pivotal role of frames of reference in ASC formation: The big fish little pond effect. In F. Pajares & T. Urdan (Eds.), Adolescence and education (Vol. 2, pp. 83-123). Greenwich, CT: Information Age.
36. Marsh, H. W., & Craven, R. G. (2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1, 133-163.
37. Marsh, H. W., & Hau, K. T. (2003). Big fish little pond effect on academic self-concept: A crosscultural (26 country) test of the negative effects of academically selective schools. American Psychologist, 58, 364-376.
38. Marsh, H. W., & Hau, K.-T. (2007). Applications of latent-variable models in educational psychology: The need for methodological-substantive synergies. Contemporary Educational Psychology, 32,151-171.
39. Marsh, H. W., Hau, K., & Craven, R. G. (2004). The big-fish-little-pond effect stands up to scrutiny. American Psychologist, 59, 268-271.
40. Marsh, H. W., Kong, C.-K., & Hau, K.-T. (2000). Longitudinal multilevel models of the big-fishlittle-pond effect on academic self-concept: Counterbalancing contrast and reflected-glory effects in Hong Kong schools. Journal of Personality & Social Psychology, 78, 337-349.
41. Marsh, H. W., Martin, A. J., & Cheng, J. (2008). How we judge ourselves from different perspectives: Contextual influences on self-concept formation. In M. L. Maehr, S. Karabenick, & T. Urdan (Eds.), Advances in motivation and achievement: Social psychological perspectives (Vol. 15, pp. 315-356). New York: Elsevier.
42. Marsh, H. W., & O'Mara, A. (2008, July). Have researchers underestimated the big-fish-littlepond-effect? Development of long-term total negative effects of school-average ability on diverse educational outcomes. Paper presented at the 2008 International Congress of Psychology, Berlin, Germany.
43. Marsh, H. W., & O'Neill, R. (1984). Self Description Questionnaire III (SDQ III): The construct validity of multidimensional self-concept ratings by late-adolescents. Journal of Educational Measurement, 21, 153-174.
44. Marsh, H. W., & Parker, J. (1984). Determinants of student self-concept: Is it better to be a relatively large fish in a small pond even if you don't learn to swim as well? Journal of Personality and Social Psychology, 47, 213-231.
45. Marsh, H. W., & Rowe, K. J. (1996). The negative effects of school-average ability on academic self-concept-an application of multilevel modelling. Australian Journal of Education, 40(1), 65-87.
46. Marsh, H. W., Seaton, M., Trautwein, U., Lüdtke, O., Hau, K. T., O'Mara, A. J., et al. (2008). The big-fish-little-pond-effect stands up to critical scrutiny: Implications for theory, methodology, and future research. Educational Psychology Review, 20, 319-350.
47. Marsh, H. W., Trautwein, U., Lüdtke, O., & Köller, O. (2008). Social comparison and big-fish-littlepond effects on self-concept and other self-belief constructs: Role of generalized and specific others. Journal of Educational Psychology, 100, 510-524.
48. Marsh, H. W., Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2006). Integration of multidimensional self-concept and core personality constructs: Construct validation and relations to well-being and achievement. Journal of Personality, 74, 403-455.
49. Marsh, H. W., Wen, Z., & Hau, K. (2004). Structural equation models of latent interactions: Evaluation of alternative estimation strategies and indicator construction. Psychological Methods, 9,275-300.
50. Marsh, H. W., Wen, Z., & Hau, K.-T. (2006). Structural equation models of latent interaction and quadratic effects. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (pp. 225-265). Greenwich, CT: Information Age.
51. Marsh, H. W., Wen, Z., Hau, K.-T., Little, T. D., Bovaird, J. A., & Widaman, K. F. (2007). Unconstrained structural equation models of latent interactions: Contrasting residual-and meancentered approaches. Structural Equation Modeling, 4, 570-580.
52. Marsh, H. W., & Yeung, A. S. (1998). Longitudinal structural equation models of academic selfconcept and achievement: Gender differences in the development of math and English constructs. American Educational Research Journal, 35, 705-738.
53. McDonald, R. P. (1993). A general-model for 2-level data with responses missing at random. Psychometrika, 58, 575-585.
54. McDonald, R. P. (1994). The bilevel reticular action model for path-analysis with latent-variables. Sociological Methods & Research, 22, 399-413.
55. Mehta, P. D., & Neale, M. C. (2005). People are variables too: Multilevel structural equations modeling. Psychological Methods, 10, 259-284.
56. Morgan, S. L., & Winship, C. (2007). Counterfactuals and causal inference: Methods and principles for social research. Cambridge, UK: Cambridge University Press.
57. Muthén, B. (1989). Latent variable modelling in heterogeneous populations. Psychometrika, 54, 557-585.
58. Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338-354.
59. Muthén, B. O. (1994). Multilevel covariance structure-analysis. Sociological Methods & Research, 22,376-398.
60. Muthén, B., & Satorra, A. (1995). Complex sample data in structural equation modeling. Sociological methodology, 25, 216-316.
61. Muthén, L. K., & Muthén, B. O. (2006-2008). Mplus user's guide. Los Angeles: Author.
62. Ntzoufras, I. (2009). Bayesian modelling using WinBUGS. Hoboken, NJ: Wiley.
63. O'Brien, R. M. (1990). Estimating the reliability of aggregate-level: Variables based on individuallevel characteristics. Sociological Methods and Research, 18, 473-504.
64. Rabe-Hesketh, S., Skrondal, A., & Pickles, A. (2004). Generalized multilevel structural equation modeling. Psychometrika, 69, 167-190.
65. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Thousand Oaks, CA: Sage.
66. Raykov, T., & Marcoulides, G. A. (2004). Using the Delta Method for approximate interval estimation of parametric functions in covariance structure models. Structural Equation Modeling, 11, 659-675.
67. Schwanzer, A. D., Trautwein, U., Lüdtke, O., & Sydow, H. (2005). Entwicklung eines Instruments zur Erfassung des Selbstkonzepts junger Erwachsener [Development of a questionnaire on young adults' self-concept]. Diagnostica, 51, 183-194.
68. Searle, S. R., Casella, G., & McCulloch, C. E. (1992). Variance components. New York: Wiley.
69. Segawa, E., Emery, S., & Curry, S. J. (2008). Extended generalized linear latent and mixed model. Journal of Educational and Behavioral Statistics, 33, 464-484.
70. Seligman, M. E. P., & Csikszentmihalyi, M. (2000). Positive psychology: An introduction. American Psychologist, 55, 5-14.
71. Skrondal, A., & Laake, P. (2001). Regression among factor scores. Psychometrika, 66, 563-576.
72. Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models. Boca Raton, FL: Chapman & Hall/CRC.
73. Swaminathan, H., & Rogers, H. J. (2008). Estimation procedures for hierarchical linear models. In A. A. O'Connell & D. B. McCoach (Eds.), Multilevel modelling of educational data (pp. 469-520). Charlotte, NC: Information Age.
74. Thompson, B. (2002). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 25-32.
75. Tymms, P. (2004). Effect sizes in multilevel models. In I. Schagen & K. Elliot (Eds.), But what does it mean? The use of effect sizes in educational research (pp. 55-66). London: National Foundation for Educational Research.
76. Zimprich, D., Perren, S., & Hornung, R. (2005). A two-level confirmatory factor analysis of a modified Rosenberg self-esteem scale. Educational & Psychological Measurement, 65, 465-481.