Classroom Climate and Contextual Effects: Conceptual and Methodological Issues in the Evaluation of Group-Level Effects

Educational Psychologist

Volumn 47, Issue 2, 2012, Pages 106-124

  Marsh, Herbert W ^a,b,c   Lüdtke, Oliver ^d,e   Nagengast, Benjamin ^d   Trautwein, Ulrich ^d   Morin, Alexandre J S ^b,f   Abduljabbar, Adel S ^c   Köller, Olaf ^g  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF WESTERN SYDNEY   (Australia)

^c KING SAUD UNIVERSITY   (Saudi Arabia)

^d UNIVERSITY OF TÜBINGEN   (Germany)

^e HUMBOLDT UNIVERSITY   (Germany)

^f UNIVERSITÉ DE SHERBROOKE   (Canada)

^g LEIBNIZ INSTITUTE FOR SCIENCE AND MATHEMATICS EDUCATION   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84860112315     PISSN: 00461520     EISSN: None     Source Type: Journal    
DOI: 10.1080/00461520.2012.670488     Document Type: Article

References (74)

1. Ames, C. 1992. Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84: 261-271.
2. Baumert, J., Lehmann, R. H., Lehrke, M., Schmitz, B., Clausen, M., Hosenfeld, I. and... Neubrand, J. 1997. TIMSS: Mathematisch- Naturwissenschaftlicher Unterricht im internationalen Vergleich., Opladen, Germany: Leske and Budrich. [TIMSS: Mathematics and science instruction in an international comparison]
3. Bliese, P. D. 2000. "Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis". In Multilevel theory, research, and methods in organizations, Edited by: Klein, K. J. and Kozlowski, S. W. 349-381. San Francisco, CA: Jossey-Bass.
4. Bliese, P. D., Chan, D. and Ployhart, R. E. 2007. Multilevel methods: Future directions in measurement, longitudinal analyses, and nonnormal outcomes. Organizational Research Methods, 10: 551-563.
5. Brennan, R. L. 2001. Generalizability theory, New York, NY: Springer-Verlag.
6. Brophy, J. 1988. Educating teachers about managing classrooms and students. Teaching and Teacher Education, 4: 1-18.
7. Ciani, K. D., Middleton, M. J., Summers, J. J. and Sheldon, K. M. 2010. Buffering against performance classroom goal structures: The importance of autonomy support and classroom community. Contemporary Educational Psychology, 35: 88-99.
8. Covington, M. V. 2001. Goal theory, motivation, and school achievement: An integrative review. Annual Review of Psychology, 51: 171-200.
9. Cronbach, L. J. 1976. Research on classrooms and schools: Formulations of questions, design and analysis, Stanford, CA: Stanford Evaluation Consortium.
10. Croon, M. A. and van Veldhoven, M. J. P. M. 2007. Predicting group level variables from variables measured at the individual level: A latent variable multilevel model. Psychological Methods, 12: 45-57.
11. Enders, C. K. and Tofighi, D. 2007. Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12: 121-138.
12. Evertson, C., Emmer, E., Sanford, J. and Clements, B. 1983. Improving classroom management: An experiment in elementary school classrooms. The Elementary School Journal, 84: 173-188.
13. Fast, L. A., Lewis, J. L., Bryant, M. J., Bocian, K. A., Cardullo, R. A., Rettig, M. and Hammond, K. A. 2010. Does math self-efficacy mediate the effect of the perceived classroom environment in standardized math test performance. Journal of Educational Psychology, 102: 729-740.
14. Foster, E. M. 2010. Causal inference and developmental psychology. Developmental Psychology, 46: 1454-1480.
15. Goldstein, H. 2003. Multilevel statistical models, London, UK: Edward Arnold.
16. Goldstein, H. and McDonald, R. P. 1988. A general-model for the analysis of multilevel data. Psychometrika, 53: 455-467.
17. Harker, R. and Tymms, P. 2004. The effects of student composition on school outcomes. School Effectiveness and School Improvement, 15: 177-199.
18. Heckhausen, J. and Heckhausen, H. 2008. Motivation and action, 2nd ed., New York, NY: Cambridge University Press.
19. Helmke, A., Schneider, W. and Weinert, F. E. 1986. Quality of instruction and classroom learning outcomes: The German contribution to the IEA Classroom Environment Study. Teaching & Teacher Education, 2: 1-18.
20. Hoyt, W. T. 2000. Rater bias in psychological research: When is it a problem and what can we do about it?. Psychological Methods, 5: 64-85.
21. Hutchison, D. 2007. When is a compositional effect not a compositional effect?. Quality & Quantity, 41: 219-232.
22. Iverson, G. R. 1991. "Contextual analysis". In Sage University Paper Series on Quantitative Approaches in the Social Sciences, 07-081. Newbury Park, CA: Sage.
23. Jöreskog, K. G. and Sörbom, D. 1988. LISREL 7 - A guide to the program and applications, 2nd ed., Chicago, IL: SPSS.
24. Kane, M. T., Gillmore, G. M. and Crooks, T. J. 1976. Student evaluations of teaching: The generalizability of class means. Journal of Educational Measurement, 13: 171-183.
25. Kaplan, D. 2000. Structural equation modeling: Foundations and extensions, Newbury Park, CA: Sage.
26. Kozlowski, S. W. J. and Klein, K. J. 2000. "A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes". In Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions, Edited by: Klein, K. J. and Kozlowski, S. W. J. 3-90. San Francisco, CA: Jossey-Bass.
27. Kreft, I. G. G., de Leeuw, J. and Aiken, L. S. 1995. The effect of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30: 1-21.
28. LaHuis, D. M. and Ferguson, M. W. 2009. The accuracy of significance tests for slope variance components in multilevel random coefficient models. Organizational Research Methods, 12: 418-443.
29. Lewis, R. 2001. Classroom discipline and student responsibility: The students' view. Teaching & Teacher Education, 17: 307-319.
30. Little, R. J. A. and Rubin, D. B. 1987. Statistical analysis with missing data, New York, NY: Wiley.
31. Lüdtke, O., Köller, O., Marsh, H. W. and Trautwein, U. 2005. Teacher frame of reference and the big-fish-little-pond effect. Contemporary Educational Psychology, 30: 263-285.
32. Lüdtke, O., Marsh, H. W, Robitzsch, A. and Trautwein, U. 2011. A 2 × 2 taxonomy of multilevel latent contextual models: Accuracy-bias trade-offs in full and partial error-correction models. Psychological Methods, 16: 444-467. doi 10.1037/a0024376.
33. Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T. and Muthén, B. 2008. The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13: 203-229.
34. Lüdtke, O, Robitzsch, A, Trautwein, U. and Kunter, M. 2009. Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modeling. Contemporary Educational Psychology, 34: 120-131.
35. Mainhard, M. T., Brekelmans, M. and Wubbels, T. 2011. Coercive and supportive teacher behaviour: Within- and across-lesson associations with the classroom social climate. Learning and Instruction, 21: 345-354.
36. Marsh, H. W. 1990. Causal ordering of academic self-concept and academic achievement: A multiwave, longitudinal panel analysis. Journal of Educational Psychology, 82: 646-656.
37. Marsh, H. W. 2007a. "Application of confirmatory factor analysis and structural equation modeling in sport and exercise psychology". In Handbook of sport psychology, 3rd ed., Edited by: Tenenbaum, G. and Eklund, R. C. 774-798. Hoboken, NJ: Wiley.
38. Marsh, H. W. 2007b. Self-concept theory, measurement and research into practice: The role of self concept in educational psychology-25th Vernon-Wall lecture series, London, UK: British Psychological Society.
39. Marsh, H. W., Byrne, B. M. and Yeung, A. S. 1999. Causal ordering of academic self-concept and achievement: Reanalysis of a pioneering study and revised recommendations. Educational Psychologist, 34: 155-167.
40. Marsh, H. W. and Craven, R. G. 2006. Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1: 133-163.
41. Marsh, H. W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B. O. and Nagengast, B. 2009. Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44: 764-802.
42. Marsh, H. W., Martin, A. J. and Cheng, J. H. S. 2008. A multilevel perspective on gender in classroom motivation and climate: Potential benefits of male teachers for boys?. Journal of Educational Psychology, 100: 78-95.
43. Marsh, H. W., Seaton, M., Trautwein, U., Lüdtke, O., Hau, K. T., O'Mara, A. J. and Craven, R. G. 2008. The big-fish-little-pond-effect stands up to critical scrutiny: Implications for theory, methodology, and future research. Educational Psychology Review, 20: 319-350.
44. Marshall, H. H. and Weinstein, R. S. 1984. Classroom factors affecting students' self-evaluations. Review of Educational Research, 54: 301-326.
45. Matheny, K. B. and Edwards, C. R. 1974. Academic improvement through an experimental classroom management system. Journal of School Psychology, 12: 222-232.
46. McDonald, R. P. 1993. A general-model for 2-level data with responses missing at random. Psychometrika 58,: 575-585.
47. McDonald, R. P. 1994. The bilevel reticular action model for path-analysis with latent-variables. Sociological Methods & Research, 22: 399-413.
48. McDonald, R. P. 2010. Structural models and the art of approximation. Perspectives on Psychological Science, 5: 675-686.
49. Metha, P. D. and Neale, M. C. 2005. People are variables too: Multilevel structural equations modeling. Psychological Methods, 10: 259-284.
50. Midgley, C. 2002. Goals, goal structures, and patterns of adaptive learning, Hillsdale, NJ: Erlbaum.
51. Miller, A. D. 2006, August. Teacher-student relationships in classroom motivation: A critical review of goal structures, Washington, DC: Paper presented at the meeting of the American Psychological Association.
52. Miller, A. D. and Murdock, T. B. 2007. Modeling latent true scores to determine the utility of aggregate student perceptions as classroom indicators in HLM: The case of classroom goal structures. Contemporary Educational Psychology, 32: 83-104.
53. Mischo, C. and Rheinberg, F. 1995. Erziehungsziele von Lehrern und individuelle Bezugsnormen der Leistungsbewertung [Educational goals and teachers' preference of individual reference-norms in evaluating academic achievement]. Zeitschrift für Pädagogische Psychologie, 9: 139-151.
54. Möller, J. and Köller, O. 2001. Frame of reference effects following the announcement of exam results. Contemporary Educational Psychology, 26: 277-287.
55. Morgan, S. L. and Winship, C. 2007. Counterfactuals and causal inference: Methods and principles for social research., Cambridge, UK: Cambridge University Press.
56. Muthén, B. 1989. Latent variable modelling in heterogeneous populations. Psychometrika, 54: 557-585.
57. Muthén, B. O. 1994. Multilevel covariance structure-analysis. Sociological Methods & Research, 22: 376-398.
58. Muthén, L. K. and Muthén, B. O. 2006-2010. Mplus user's guide, Los Angeles, CA: Muthén & Muthén.
59. Nagengast, B. and Marsh, H. W. 2011. The negative effect of school average ability on science self-concept in the UK, the UK countries and the world: The Big-Fish-Little-Pond-Effect for PISA 2006. Educational Psychology, 31: 629-656.
60. Papaioannou, A., Marsh, H. W. and Theodorakis, Y. 2004. A multilevel approach to motivational climate in physical education and sport settings: An individual or a group level construct?. Journal of Sport and Exercise Psychology, 26: 90-118.
61. Preacher, K. J., Zhang, Z. and Zyphur, M. J. 2011. Alternative methods for assessing mediation in multilevel data: The advantage of multilevel SEM. Structural Equation Modeling, 18: 161-182.
62. Preacher, K. J., Zyphur, M. J. and Zhang, Z. 2010. A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods, 15: 209-233.
63. Rabe-Hesketh, S., Skrondal, A. and Pickles, A. 2004. Generalized multilevel structural equation modeling. Psychometrika, 69: 167-190.
64. Raudenbush, S. W. and Bryk, A. S. 2002. Hierarchical linear models, 2nd ed., Thousand Oaks, CA: Sage.
65. Rheinberg, F. 1980. Leistungsbewertung und Lernmotivation, Göttingen, Germany: Hogrefe. [Performance evaluation and motivation for learning]
66. Rheinberg, F. and Krug, S. 1999. Motivationsförderung im Schulalltag, Göttingen, Germany: Hogrefe. [Enhancing motivation in school]
67. Rutter, M., Maughan, B., Mortimore, P., Ouston, J. and Smith, A. 1979. Fifteen thousand hours: Secondary schools and their effects on children, Cambridge, MA: Harvard University Press.
68. Schafer, J. L. 1997. Analysis of incomplete multivariate data, Boca Raton, FL: Chapman & Hall.
69. Shin, Y. and Raudenbush, S. W. 2010. A latent cluster-mean approach to the contextual effects model with missing data. Journal of Educational and Behavioral Statistics, 35: 26-53.
70. Skrondal, A. and Laake, P. 2001. Regression among factor scores. Psychometrika, 66: 563-576.
71. Snijders, T. A. B. and Bosker, R. J. 1999. Multilevel analysis: An introduction to basic and advanced multilevel modeling, Thousand Oaks, CA: Sage.
72. Trautwein, U., Lüdtke, O., Köller, O. and Baumert, J. 2006. Self-esteem, academic self-concept, and achievement: How the learning environment moderates the dynamics of self-concept. Journal of Personality and Social Psychology, 90: 334-349.
73. Trautwein, U., Lüdtke, O., Marsh, H. W., Köller, O. and Baumert, J. 2006. Tracking, grading, and student motivation: Using group composition and status to predict self-concept and interest in ninth grade mathematics. Journal of Educational Psychology, 98: 788-806.
74. Wang, M.-T. and Holcombe, R. 2010. Adolescents' perceptions of school environment, engagement, and academic achievement in middle school. American Educational Research Journal, 47: 633-662.