Examining relationships among elementary schools' contexts, leadership, instructional practices, and added-year outcomes: A regression discontinuity approach

School Effectiveness and School Improvement

Volumn 21, Issue 4, 2010, Pages 377-408

  Heck, Ronald H ^a   Moriyama, Karen ^a  

^a UNIVERSITY OF HAWAII   (United States)

Author keywords

Absolute schooling effects; Modeling educational effectiveness; Regression discontinuity; School instructional practices; School leadership

Indexed keywords

EID: 78649669779     PISSN: 09243453     EISSN: 17445124     Source Type: Journal    
DOI: 10.1080/09243453.2010.500097     Document Type: Article

References (118)

1. Alspaugh, J.W., & Gao, R. (2003). School size as a factor in elementary school achievement. New York, NY: Institute for Education and Social Policy. (ERIC Document Reproduction Service No. ED475062)
2. Andrews, M., Duncombe, W., & Yinger, J. (2002). Revisiting economies of size in American education: Are we any closer to a consensus? Economics of Education Review, 21, 245-262.
3. Barnes, G., Crowe, E., & Schaefer, B. (2007). The cost of teacher turnover in five school districts: A pilot study. Washington, DC: National Commission on Teaching and America's Future.
4. Barth, R. (1990). Improving schools from within. San Francisco, CA: Jossey-Bass.
5. Barth, R. (2001). Teacher leader. Phi Delta Kappan, 82, 443-449.
6. Baumert, J., Stanat, P., & Watermann, R. (2005, August). Social and intellectual composition of schools' effects on student outcomes. Paper presented at the European Association for Research on Learning and Instruction (EARLI) conference, Nicosia, Cyprus.
7. Bloom, H.S., Hill, C.J., Black, A.R., & Lipsey, M.W. (2008). Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions. Journal of Research on Educational Effectiveness, 1, 289-328.
8. Boe, E.E., Cook, L.H., & Sunderland, R.J. (2008). Teacher turnover: Examining exit attrition, teaching area transfer, and school migration. Exceptional Children, 75(1), 7-31.
9. Bosker, R.J., & Scheerens, J. (1994). Conceptual and methodological advances in educational effectiveness research. International Journal of Educational Research, 21, 123-231.
10. Boyd, D., Goldhaber, D., Lankford, H., & Wyckoff, J. (2007). The effect of certification and preparation on teacher quality. Future of Children, 17(1), 45-68.
11. Boyd, D., Grossman, P., Lankford, H., Loeb, S., & Wyckoff, J. (2006). How changes in entry requirement alter the teacher workforce and affect student achievement. Education Finance and Policy, 1, 176-216.
12. Brookover, W., Beady, C., Flood, P., Schweitzer, J., & Wisenbaker, J. (1979). School social systems and student achievement - Schools can make a difference. New York, NY: Praeger.
13. Cahan, S., & Cohen, N. (1989). Age versus schooling effects on intelligence development. Child Development, 60, 1239-1249.
14. Cahan, S., & Davis, D. (1987). A between-grade-levels approach to the investigation of the absolute effects of schooling on achievement. American Educational Research Journal, 24, 1-12.
15. Cain, G.G. (1975). Regression and selection models to improve nonexperimental comparisons. In C.A. Bennett & A.A. Lumsdaine (Eds.), Evaluation and experiment: Some critical issues in assessing social programs (pp. 297-317). New York, NY: Academic Press.
16. California Department of Education. (2005). California Standardized Testing and Reporting (STAR). Retrieved from http://star.cde.ca.gov/star2005/Viewreport.asp
17. Coe, R., & Fitz-Gibbon, C. (1998). School effectiveness research: Criticisms and recommendations. Oxford Review of Education, 24, 421-438.
18. Cook, T.D. (2008). Waiting for life to arrive: A history of the regression-discontinuity design in psychology, statistics and economics. Journal of Econometrics, 142, 636-654. Retrieved from www.sciencedirect.com
19. Cook, T.D., & Campbell, D.T. (1979). Quasi-experimentation: Design and analysis for field settings. Chicago, IL: Rand McNally.
20. Creemers, B.P.M. (1994). The effective classroom. London, UK: Cassell.
21. Creemers, B.P.M., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. London, UK: Routledge.
22. Darling-Hammond, L. (2000, January). Teacher quality and student achievement: A review of state policy evidence. Education Policy Analysis Archives, 8(1), 1-49. Retrieved from http://epaa.asu.edu/epaa/v8n1/
23. Darling-Hammond, L., Holtzman, D.J., Gatlin, S.J., & Heilig, J.V. (2005). Does teacher preparation matter? Evidence about teacher certification, Teach for America and teacher effectiveness. Education Policy Analysis Archives, 13(42). Retrieved from http://epaa.asu.edu/epaa/v13n42/
24. De Jong, R., Westerhof, K.J., & Kruiter, J.H. (2004). Empirical evidence of a comprehensive model of school effectiveness: A multilevel study in mathematics in the 1st year of junior general education in the Netherlands. School Effectiveness and School Improvement, 15, 3-31.
25. Dworkin, A.G., & Lorence, J. (2007). Non-promotional school change and the achievement of Texas students: Possible public school choice outcomes under No Child Left Behind. In A.R. Sadovnik, J. O'Day, G. Bohrnstedt, & K. Borman (Eds.), No Child Left Behind and the reduction of the achievement gap: Sociological perspectives on federal education policy, (pp. 243-266). London, UK: Routledge.
26. Fenwick, L.T., Smith, G.A., & Blackman, M. (2000). If you move, you lose? Student mobility, academic achievement, and learning. The Principal Advisor, 1(2), 1-2.
27. Finn, J.D., & Voelkl, K.E. (1993). School characteristics related to student engagement. Journal of Negro Education, 62, 249-268.
28. Friedkin, S., & Necochea, J. (1988). School system size and performance: A contingency perspective. Educational Evaluation and Policy Analysis, 13, 189-202.
29. Goldhaber, D. (2002). The mystery of good teaching. Education Next, 2(1), 50-55.
30. Goldhaber, D.D., & Brewer, D.J. (2000). Does teacher certification matter? High school teacher certification status and student achievement. Educational Evaluation and Policy Analysis, 22, 129-145.
31. Goldstein, H. (1997). Methods in school effectiveness research. School Effectiveness and School Improvement, 8, 369-395.
32. Gray, J., Peng, W.J., Steward, S., & Thomas, S. (2004). Towards a typology of gender-related school effects: Some new perspectives on a familiar problem. Oxford Review of Education, 30, 529-550.
33. Gronn, P. (2002). Distributed leadership as a unit of analysis. The Leadership Quarterly, 13, 423-451.
34. Guin, K. (2004). Chronic teacher turnover in urban elementary schools. Education Policy Analysis Archives, 12(42), 1-25.
35. Gunzenhauser, M.G., & Hyde, A.M. (2007). What is the value of public school accountability? Educational Theory, 57, 489-507.
36. Hall, G., & Hord, S. (2001). Implementing change: Patterns, principles, and potholes. Boston, MA: Allyn & Bacon.
37. Harcourt Brace Educational Measurement. (1997). Stanford Achievement Test (9th ed.). San Antonio, TX: Author.
38. Heck, R.H. (2000). Examining the impact of school quality on school outcomes and improvement: A value added approach. Educational Administration Quarterly, 36, 513-552.
39. Heck, R.H. (2006). Assessing school achievement progress: Comparing alternative approaches. Educational Administration Quarterly, 42, 667-699.
40. Heck, R.H., & Hallinger, P. (2009, April). Testing a dynamic model of organizational leadership and school improvement. Paper presented at the Annual Meeting of the American Educational Research Association, San Diego, CA.
41. Heck, R.H., & Hallinger, P. (2010, May). Examining the moderating effect of instructionallyfocused leadership on teacher effectiveness and student learning. Paper presented at the Annual Meeting of the American Educational Research Association, Denver, CO.
42. Hill, P.W., & Rowe, K.J. (1996). Multilevel modeling in school effectiveness research. School Effectiveness and School Improvement, 7, 1-34.
43. Hox, J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum.
44. Howley, C. (1999). The Matthew project: State report for Ohio (Columbus, OH, Ohio State University). (ERIC Document Reproduction Service No. ED 433175)
45. Imbens, G.W., & Lemieux, T. (2008). Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142, 615-635. Retrieved from www.sciencedirect.com
46. Ingersoll, R.M. (2001). Teacher turnover and teacher shortages: An organizational analysis. American Educational Research Journal, 38, 499-534.
47. Kane, T.J., Rockoff, J.E., & Staiger, D.O. (2008). What does certification tell us about teacher effectiveness? Evidence from New York City. Economics of Education Review, 27, 615-631.
48. Kyriakides, L. (2004). Differential school effectiveness in relation to sex and social class: Some implications for policy evaluation. Educational Research and Evaluation, 10, 141-161.
49. Kyriakides, L., Campbell, R.J., & Gagatsis, A. (2000). The significance of the classroom effect in primary schools: An application of Creemers' comprehensive model of educational effectiveness, School Effectiveness and School Improvement, 11, 501-529.
50. Kyriakides, L., & Creemers, B.P.M. (2008). A longitudinal study on the stability over time of school and teacher effects on student outcomes. Oxford Review of Education, 34, 521-545.
51. Kyriakides, L., Creemers, B., Antoniou, P., & Demetriou, D. (2009). A synthesis of studies searching for school factors: Implications for theory and research. British Educational Research Journal. Advance online publication. doi:10.1080/01411920903165603
52. Kyriakides, L., & Luyten, H. (2009). The contribution of schooling to the cognitive development of secondary education students in Cyprus: An application of regression discontinuity with multiple cut-off points. School Effectiveness and School Improvement, 20, 167-186.
53. Kyriakides, L., & Tsangaridou, N. (2008). Towards the development of generic and differentiated models of educational effectiveness: A study on school and teacher effectiveness in physical education. British Educational Research Journal, 34, 807-883.
54. Lee, V.E., & Loeb, S. (2000). School size in Chicago elementary schools: Effects on teachers' attitudes and students' achievement. American Educational Research Journal, 37, 3-31.
55. Leithwood, K., & Jantzi, D. (1999). Transformational school leadership effects: A replication. School Effectiveness and School Improvement, 10, 451-479.
56. Leithwood, K., & Jantzi, D. (2006). Transformational school leadership for large-scale reform: Effects on students, teachers, and their classroom practices. School Effectiveness and School Improvement, 17, 201-227.
57. Leithwood, K., Mascall, B., & Strauss, T. (2009). What we have learned, where we go from here. In K. Leithwood, B. Mascall, & T. Strauss (Eds.), Distributed leadership according to the evidence (pp. 269-282). New York, NY: Routledge.
58. Leva-cić, R., Malmberg, I., Steele, F., & Smees, R. (2004, January). The relationship between school climate and head teacher leadership, and pupil attainment: Evidence from a sample of English secondary schools. Paper presented at the International Congress for School Effectiveness and Improvement, Rotterdam, The Netherlands.
59. Linn, R.L. (2006). Validity of inferences from test-based educational accountability systems. Journal of Personnel Evaluation in Education, 19, 5-15.
60. Linn, R.L., & Haug, C. (2002). Stability of school-building accountability scores and gains. Educational Evaluation and Policy Analysis, 24, 29-36.
61. Lubienski, S.T., Lubienski, C., & Crane, C.C. (2008). Achievement differences and school type: The role of school climate, teacher certification, and instruction. American Journal of Education, 115, 97-138.
62. Luyten, H. (2006). An empirical assessment of the absolute effect of schooling: Regressiondiscontinuity applied to TIMSS-95. Oxford Review of Education, 32, 397-429. Retrieved from Academic Search Premier.
63. Luyten, H., Peschar, J., & Coe, R. (2008). Effects of schooling on reading performance, reading engagement, and reading activities of 15-year-olds in England. American Educational Research Journal, 45, 319-342.
64. Luyten, H., Tymms, P., & Jones, P. (2009). Assessing school effects without controlling for prior achievement? School Effectiveness and School Improvement, 20, 145-165.
65. Ma, X. (2008). Within-school gender gaps in reading, mathematics, and science literacy. Comparative Education Review, 52, 437-460.
66. Marks, H., & Printy, S. (2003). Principal leadership and school performance: An integration of transformational and instructional leadership. Educational Administration Quarterly, 39, 370-397.
67. McMillen, B. (2004, October 22). School size, achievement, and achievement gaps. Education Policy Analysis Archives, 12(58). Retrieved from http://epaa.asu.edu/epaa/v12n58/
68. Mehana, M., & Reynolds, A.J. (2004). School mobility and achievement: A meta-analysis. Children and Youth Services Review, 26(1), 93-119.
69. Mortimore, P., Sammons, P., Stoll, L., Lewis, D., & Ecob, R. (1988). School matters. Wells, UK: Open Books.
70. Mulford, B., & Silins, H. (2003). Leadership for organisational learning and improved student outcomes - What do we know? Cambridge Journal of Education, 33, 175-195.
71. Mullis, I., Martin, M., Gonzales, E.,& Kennedy, A. (2003). PIRLS 2001 international report: IEA's study of reading literacy achievement in primary schools. Chestnut Hill, MA: Boston College.
72. Munoz, M.A., & Chang, F.C. (2007). The elusive relationship between teacher characteristics and student academic growth: A longitudinal multilevel model for change. Journal of Personnel Evaluation in Education, 20, 147-164.
73. Murnane, R.J., & Steele, L. (2007). What is the problem: The challenge of providing effective teachers of all children. Future of Children, 17(1), 15-43.
74. Muthén, L., & Muthén, B. (1998-2006). Mplus user's guide. Los Angeles, CA: Authors.
75. Nash, N. (2004). A pilot study on school size and student achievement. Athens, Greece: University of Georgia.
76. No Child Left Behind Act of 2001, Public Law No. 107-110, 115 Stat. 1425, Section 9101 (23).
77. Opdenakker, M.-C., & Van Damme, J. (2001). Relationship between school composition and characteristics of school process and their effect on mathematics achievement. British Educational Research Journal, 27, 407-432.
78. Opdenakker, M.-C., & Van Damme, J. (2007). Do school context, student composition and school leadership affect school practice and outcomes in secondary education? British Educational Research Journal, 33, 179-206. Retrieved from http://www.informaworld.com
79. Palardy, G.J., & Rumberger, R.W. (2008). Teacher effectiveness in first grade: The importance of background qualifications, attitudes, and instructional practices for student learning. Educational Evaluation and Policy Analysis, 30, 111-140.
80. Pedhazur, E.J., & Schmelkin, L.P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum Associates.
81. Pungello, E.P., Kupersmidt, J.B., Burchinal, M.R., & Patterson, C.J. (1996). Environmental risk factors and children's achievement from middle childhood to early adolescence. Developmental Psychology, 32, 755-767.
82. Raykov, T., & Marcoulides, G.A. (2006). A first course in structural equation modeling (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
83. Raykov, T., & Marcoulides, G.A. (2008). An introduction to applied multivariate analysis (2nd ed.). New York, NY: Taylor & Francis.
84. Reardon, S.F., & Robinson, J. (2007). Patterns and trends in racial/ethnic and socioeconomic academic achievement gaps. In H. Ladd & E. Fiske (Eds.), Handbook of research in education finance and policy (pp. 497-516). New York, NY: Routledge.
85. Robinson, V.M.J., Lloyd, C.A., & Rowe, K. (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44(5), 635-674.
86. Robitaille, D. (1989). Students' achievement: Population A. In D. Robitaille & R. Garden (Eds.), The IEA Study of Mathematics II: Contexts and outcomes of school mathematics. Oxford, UK: Pergamon.
87. Rowan, B., Chiang, F.S., & Miller, R.J. (1997). Using research on employee's performance to study the effects of teachers on students' achievement. Sociology of Education, 70, 256-284.
88. Rowan, B., Correnti, R., & Miller, R.J. (2002). What large-scale survey research tells us about teacher effects on student achievement: Insights from the Prospects Study of Elementary Schools. Teachers College Record, 104, 1525-1567.
89. Rutter, M., & Maughan, B. (2002). School effectiveness findings 1979-2002. Journal of School Psychology, 40, 451-475.
90. Sammons, P., & Luyten, H. (2009). Editorial article for special issue on alternative methods for assessing school effects and schooling effects. School Effectiveness and School Improvement, 20, 133-143.
91. Sammons, P., Nuttall, D., & Cuttance, P. (1993). Differential school effectiveness: Results from a reanalysis of the Inner London Education Authority's Junior School Project Data. British Educational Research Journal, 19, 381-405.
92. Sanderson, D.R. (2004). Transiency, test scores, and the public: One school district's story. Studies in Educational Evaluation, 30, 225-236.
93. Scheerens, J. (1990). School effectiveness research and the development of process indicators of school functioning. School Effectiveness and School Improvement, 1, 61-80.
94. Scheerens, J. (1992). Effective schooling: Research, theory and practice. New York, NY: Cassell.
95. Scheerens, J., & Bosker, R. (1997). The foundations of educational effectiveness. New York, NY: Pergamon.
96. Scheerens, J., Gilas, C., & Thomas, S. (2003). Educational evaluation, assessment and monitoring: A systematic approach. Lisse, The Netherlands: Swets & Zweitlinger.
97. Seidel, T., & Shavelson, R.J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77, 454-499.
98. Shadish, W.R., Cook, T.D., & Campbell, D.T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
99. Sirin, S.R. (2005). Socioeconomic status and academic achievement: A meta-analytic review of research. Review of Educational Research, 75, 417-453.
100. State Department of Education. (2001). School Quality Survey Dimension Descriptions. Honolulu, HI: Department of Education. Retrieved from http://arch.k12.hi.us/PDFs/sqs/DimDesc.pdf
101. State Department of Education. (2005). School Quality Survey Statewide Summary. Honolulu, HI: Department of Education. Retrieved from http://arch.k12.hi.us/PDFs/sqs/2005/SQS0.pdf
102. Stoll, L., & Fink, D. (1996). Changing our schools. London, UK: Open University Press.
103. Stover, D. (2000). Schools grapple with high student mobility rates. School Board News, 11, 1-8.
104. Stringfield, S.C., & Slavin, R.E. (1992). A hierarchical longitudinal model for elementary school effects. In B.P.M. Creemers & G.J. Reezigt (Eds.), Evaluation of educational effectiveness (pp. 35-69). Groningen, he etherlands: ICO, Interuniversity Center for Educational Research.
105. Stronge, J.H., Ward, T.J., Tucker, P.D., & Hindman, J.L. (2007). What is the relationship between teacher quality and student achievement? An exploratory study. Journal of Personnel Evaluation in Education, 20, 165-184. Retrieved from http://www.springerlink.com
106. Teddlie, C., & Reynolds, D. (Eds.). (2000). The international handbook of school effectiveness research. London, UK: Falmer Press.
107. Tennessee Department of Education. (2005). Tennessee statewide report card 2005. Retrieved from http://www.k-12.state-tn.us/rptcrd05/state1.asp
108. Thomas, S., Sammons, P., Mortimore, P., & Smees, R. (1995, September). Differential secondary school effectiveness: Examining the size, extent and consistency of school and departmental effects on GCSE outcomes for different groups of students over three years. Paper presented at the European Conference on Educational Research/British Educational Research Association annual conference, University of Bath, Bath, UK.
109. U.S. Department of Education. (2000). National Assessment of Educational Progress (NAEP) trends in academic progress. National Center for Education Statistics (NCES97-986r), Office of Educational Research and Improvement. Washington DC: Author.
110. U.S. Department of Education. (2001). The nation's report card: Fourth-grade reading highlights 2000. Institute of Education Sciences, National Center for Education Statistics (NCES 2001-1499). Washington DC: Author.
111. U.S. Department of Education. (2002). Meeting the highly qualified teachers challenge. Washington, DC: Author.
112. U.S. Department of Education. (2006). The condition of education 2006. Institute of Education Sciences, National Center for Education Statistics (NCES 2006-071). Washington, DC: U.S. Government Printing Office.
113. Van de Grift, W.J.C.M., & Houtveen, A.A.M. (2006). Underperformance in primary schools. School Effectiveness and School Improvement, 17, 255-273.
114. Wayne, A.J., & Youngs, P. (2003). Teacher characteristics and student achievement gains: A review. Review of Educational Research, 73, 89-122.
115. Wenglinsky, H. (2002). How schools matter: The link between teacher classroom practices and student academic performance. Education Policy Analysis Archives, 10(12). Retrieved from http://epaa.asu.edu/epaa/v10n12/
116. Willms, J. (1992). Monitoring school performance. A guide for educators. London, UK: Falmer Press.
117. Witziers, B., Bosker, R.J., & Krüger, M. (2003). Educational leadership and student achievement: The elusive search for an association. Educational Administration Quarterly, 39, 398-425. Retrieved from http://eaq.sagepub.com
118. Zhang, Y. (2002, April). DIF in a large-scale mathematics assessment: The interaction of gender and ethnicity. Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA. (ERIC Document Reproduction Service No. ED 464 152)