Consequences of omitting the classroom in multilevel models of schooling: An illustration using opportunity to learn and reading achievement

School Effectiveness and School Improvement

Volumn 23, Issue 3, 2012, Pages 305-326

  Martínez, José Felipe ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

multilevel modeling; opportunity to learn; schooling effects

Indexed keywords

EID: 84865001319     PISSN: 09243453     EISSN: 17445124     Source Type: Journal    
DOI: 10.1080/09243453.2012.678864     Document Type: Article

References (42)

1. Beaton, A.L. and O'Dwyer, L.M. 2002. "Separating school, classroom, and student variances and their relationship to socio-economic status". In Secondary analysis of the TIMSS data, Edited by: Robitaille, D.F. and Robitaille, B.A.E. 211-231. Boston, MA: Kluwer.
2. Bryk, A.S. and Raudenbush, S.W. 2002. Hierarchical linear models: Applications and data analysis methods, (2nd ed.), Thousand Oaks, CA: Sage.
3. Burstein, L. 1980. "The analysis of multilevel data in educational research and evaluation". In Review of research in education, Edited by: Berliner, D. 158-233. Washington, DC: American Educational Research Association.
4. Carroll, J.B. 1963. A model of school learning. Teachers College Record, 64: 723-733.
5. Coleman, J.S., Campbell, E., Hobson, C., McPartland, J., Mood, A., Weinfeld, F.D. and York, R. 1966. Equality of educational opportunity, Washington, DC: U.S. Government Printing Office.
6. Cooley, W. and Leinhardt, G. 1980. The instructional dimensions study. Educational Evaluation and Policy Analysis, 2: 7-25.
7. Creemers, B.P.M. 1994. The effective classroom, New York, NY: Cassell.
8. Creemers, B.P.M. and De Jong, R. 2001. Explaining differences in student outcomes. Journal of Classroom Interactions, 37(2): 16-27.
9. Creemers, B.P.M. and Kyriakides, L. 2008. The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools, Abingdon, UK: Routledge.
10. Creemers, B.P.M., Kyriakides, L. and Sammons, P. 2010. Methodological advances in education effectiveness research, New York, NY: Routledge.
11. De Fraine, B., Van Damme, J., Van Landeghem, G. and Opdenakker, M.-C. 2003. The effect of schools and classes on language achievement. British Educational Research Journal, 29: 841-859.
12. Dunkin, M.J. and Biddle, B.J. 1974. The study of teaching, New York, NY: Holt, Rinehart and Winston.
13. Floden, R.E. 2002. "Measuring opportunity to learn". In Methodological advances in cross-national surveys of educational achievement, Edited by: Porter, A.C. and Gamoran, A. 231-266. Washington, DC: National Academy Press.
14. Gamoran, A. 1991. "Schooling and achievement: Additive versus interactive models". In Schools, classrooms, and pupils: International studies of schooling from a multilevel perspective, Edited by: Willms, J.D. and Raudenbush, S.W. 37-51. San Diego, CA: Academic Press.
15. Goldstein, H. 1997. Methods in school effectiveness research. School Effectiveness and School Improvement, 8: 369-395.
16. Herman, J.L., Klein, D.C.D. and Abedi, J. 2000. Assessing student's opportunity to learn: Teacher and student perspectives. Educational Measurement: Issues and Practice, 19(4): 16-24.
17. Hill, P.W. and Rowe, R.K. 1996. Multilevel modeling in school effectiveness research. School Effectiveness and School Improvement, 7: 1-34.
18. Hutchinson, D. and Healy, M. 2001. The effect on variance component estimates of ignoring a level in a multilevel model. Multilevel Modeling Newsletter, 13(2): 4-5.
19. Kyriakides, L., Campbell, R.J. and Gagatsis, A. 2000. The significance of the classroom effect in primary schools: An application of Creemers' comprehensive model of educational effectiveness. School Effectiveness and School Improvement, 11: 501-529.
20. Kyriakides, L. and Creemers, B.P.M. 2008. Using a multidimensional approach to measure the impact of classroom-level factors upon student achievement: A study testing the validity of the dynamic model. School Effectiveness and School Improvement, 19: 183-205.
21. Lundberg, I. 1994. "The teaching of reading". In The IEA study of reading literacy: Achievement and instruction in thirty-two school systems, Edited by: Elley, W.B. 149-192. Oxford, UK: Pergamon.
22. Martínez, J.F. and Goldschmidt, P. Comparing student and teacher reports on opportunity to learn and their relationship to student achievement: A multilevel analysis approach. Paper presented at the Annual meeting of the American Educational Research Association. April.
23. Moerbeek, M. 2004. The consequence of ignoring a level of nesting in multilevel analysis. Multivariate Behavioral Research, 39: 127-149.
24. Muthén, B. 1991. Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28: 338-354.
25. Muthén, B., Huang, L.C., Jo, B., Khoo, S.T., Nelson Goff, G., Novak, J. and Shih, J. 1995. Opportunity-to-learn effects on achievement: Analytical aspects. Educational Evaluation and Policy Analysis, 17: 371-403.
26. Muthén, L. and Muthén, B. 1998. Mplus user's guide, Los Angeles, CA: Authors.
27. Nye, B., Konstantopoulos, S. and Hedges, L.V. 2004. How large are teacher effects?. Educational Evaluation and Policy Analysis, 26: 237-257.
28. Opdenakker, M.-C. and Van Damme, J. 2000a. The importance of identifying levels in multilevel analysis: The effects of ignoring the top or intermediate levels in school effectiveness research. School Effectiveness and School Improvement, 11: 103-130.
29. Opdenakker, M.-C. and Van Damme, J. 2000b. Effects of schools, teaching staff and classes on achievement and wellbeing in secondary education: Similarities and differences between school outcomes. School Effectiveness and School Improvement, 11: 165-196.
30. Opdenakker, M.-C. and Van Damme, J. 2006. Differences between secondary schools: A study about school context, group composition, school practice, and school effects with special attention to public and Catholic schools and types of schools. School Effectiveness and School Improvement, 17: 87-117.
31. Pearson Assessment. 1996. Stanford Achievement Test Series, Ninth Edition-Complete Battery (Kindergarten through grade 13) Retrieved from http://www.pearsonassessments.com/HAIWEB/Cultures/en-us/Productdetail.htm?Pid=E132C
32. Reynolds, D., Sammons, P., De Fraine, B., Townsend, T. and Van Damme, J. Educational effectiveness research (EER): A state of the art review. Paper presented to the Annual Meeting of the International Congress for School Effectiveness and Improvement. January.
33. Rowan, B., Correnti, R. and Miller, R.J. 2002. What large-scale survey research tells us about teacher effects on student achievement: Insights from the prospects study of elementary schools, Philadelphia, PA: Consortium for Policy Research in Education.
34. Rowe, K.J., Hill, P.W. and Holmes-Smith, P. 1995. methodological issues in educational performance and school effectiveness research: A discussion with worked examples. Australian journal of Education, 39: 217-248.
35. Scheerens, J. 1992. Effective schooling: Research, theory and practice, New York, NY: Cassell.
36. Scheerens, J. and Creemers, B.P.M. 1989. Conceptualizing school effectiveness. International Journal of Educational Research, 7: 691-706.
37. Smith, M.S. 1972. "Equality of educational opportunity: The basic findings reconsidered". In On equality of educational opportunity, Edited by: Mosteller, F. and Moynihan, D.P. 230-342. New York, NY: Vintage Books.
38. Snijders, T.A.B. and Bosker, R. 1999. Multilevel analysis: An introduction to basic and advanced multilevel modeling, Thousand Oaks, CA: Sage.
39. Teddlie, C. 1994. "The integration of classroom and school process data in school effectiveness research". In Advances in school effectiveness research and practice, Edited by: Reynolds, D., Creemers, B.P.M., Nesselrodt, P.S., Schaffer, E.C., Stringfield, S. and Teddlie, C. 189-205. Oxford, UK: Elsevier.
40. Thorndike, E.L. 1939. On the fallacy of imputing the correlations found for groups to the individuals or smaller groups composing them. American Journal of Psychology, 52: 122-124.
41. Van den Noortgate, W., Opdenakker, M.-C. and Onghena, P. 2005. The effects of ignoring a level in multilevel analysis. School Effectiveness and School Improvement, 16: 281-303.
42. Van Landeghem, G., De Fraine, B. and Van Damme, J. 2005. The consequence of ignoring a level of nesting in multilevel analysis: A comment. Multivariate Behavioral Research, 40: 423-434.