Assessing teacher, classroom, and school effects, including fiscal effects

Peabody Journal of Education

Volumn 79, Issue 4, 2004, Pages 4-32

  Odden, Allan ^a   Borman, Geoffrey ^a   Fermanich, Mark ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b SONOMA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 49549083674     PISSN: 0161956X     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327930pje7904_2     Document Type: Article

References (133)

1. Alexander, K. L., Eckland, B. K., & Griffin, L. J. (1975). The Wisconsin model of socioeconomic achievement: A replication. American Journal of Sociology, 81, 324-342.
2. Arnold, C. (1992). An introduction to hierarchical linear models. Measurement and Evaluation in Counseling and Development, 25(2), 58–90.
3. Ballou, D., & Podgursky, M. (1997). Teacher pay and teacher quality. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research.
4. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
5. Bossert, S., Dwyer, D., Rowan, B., & Lee, G. (1982). The instructional management role of the principal. Educational Administration Quarterly, 18, 34–64.
6. Bransford, J. D., Brown, A. L., & Cocking, R. R. E. (1999). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy Press.
7. Brookover, W. C., Brady, C., & Flood, P. (1979). School systems and student achievement: Schools can make a difference. New York: Praeger.
8. Brophy, J., & Good, T. L. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 328–375). New York: Macmillan.
9. Bruer, J. T. (1993). Schools for thought. Cambridge, MA: MIT Press.
10. Bryk, A. S., & Raudenbush, S. W. (1988). Toward a more appropriate conceptualization of research on school effects: A three-level hierarchical linear model. American Journal of Education, 97, 65–108.
11. Burstein, L. (1980). The analysis of multi-level data in educational research and evaluation. Review of Research in Education, 8, 158–233.
12. Canady, R., & Rettig, M. (1996). Block scheduling: A catalyst for change in high schools. Princeton, NJ: Eye on Education, Inc.
13. Card, D., & Krueger, A. B. (1992). Does school quality matter? Returns to education and the characteristics of public schools in the United States. The Journal of Political Economy, 100, 1–40.
14. Cohen, M. (1983). Instructional, management and social conditions in effective schools. In A. Odden & L. D. Webb (Eds.), School finance and school improvement linkages for the 1980s (pp. 17–50). Cambridge, MA: Ballinger.
15. Coleman, J. S., Campbell, E., Hobson, C., McPartland, J., Mood, A., Weinfeld, R., et al. (1966). Equality of educational opportunity. Washington, DC: U.S. Government Printing Office.
16. Corcoran, T. B. (1995). Helping teachers teach well: Transforming professional development (Report No. RB–16–June 1995). Philadelphia: Consortium for Policy Research in Education.
17. Danielson, C. (1996). Enhancing professional practice: A framework for teaching. Alexandria, VA: Association for Supervision and Curriculum Development.
18. Darling-Hammond, L., & Youngs, P. (2002). Defining “highly qualified teachers”: What does “scientifically based research” actually tell us? Educational Researcher, 31(9), 13–25.
19. Desimone, L., Porter, A. C., Birman, B. F., Garet, M. S., & Yoon, K. S. (2002). How do district management and implementation strategies relate to the quality of professional development that districts provide to teachers? Teachers College Record 104, 1265–1312.
20. Desimone, L. M., Porter, A. C., Garet, M. S., Yoon, K. S., & Birman, B. F. (2002). Effects of professional development on teachers’ instruction: Results from a three-year longitudinal study. Educational Evaluation and Policy Analysis, 24, 81–112.
21. Edmonds, R. (1979). Effective schools for the urban poor. Educational Leadership, 37(1), 15–24.
22. Ehrenberg, R.G., & Brewer, D. J. (1994). Do school and teacher characteristics matter?: Evidence from high school and beyond. Economics of Education Review, 13, 1–17.
23. Ehrenberg, R. G., & Brewer, D. J. (1995). Did teachers’ verbal ability and race matter in the 1960s?: Coleman revisited. Economics of Education Review, 14, 1–21.
24. Elmore, R. F. (2002). Bridging the gap between standards and achievement: The imperative for professional development in education. Washington, DC: Albert Shanker Institute.
25. Fennema, E., & Romberg, T. (1999). Mathematics classrooms that promote understanding. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
26. Ferguson, R. F. (1991, Summer). Paying for public education: New evidence on how and why money matters. Harvard Journal on Legislation, 28, 465–497.
27. Ferguson, R. F. (1998). Teachers’ perceptions and expectations and the Black–White test score gap. In C. Jencks & M. Phillips (Eds.), The Black–White test score gap (pp. 273–317). Washington, DC: Brookings Institute.
28. Ferguson, R. F., & Ladd, H. F. (1996). How and why money matters: An analysis of Alabama schools. In H.F. Ladd (Ed.), Holding schools accountable: Performance-based reform in education (pp. 265–298). Washington, DC: Brookings Institute.
29. Fermanich, M. (2002). School spending for professional development: A cross case analysis of seven schools in one urban district. Elementary School Journal 103, 27–50.
30. Fermanich, M. (2003). School resources and student achievement: The effect of school-level resources on instructional practices and student outcomes in Minneapolis public schools. Unpublished doctoral dissertation, University of Wisconsin–Madison.
31. Finn, J. (1993, August). School engagement and students at risk (NCES Publication No. 93470). Washington, DC: National Center for Education Research, Statistics, Research and Development Reports.
32. Finn, J. D. (2002). Small classes in American schools: Research, practice, and politics. Phi Delta Kappan, 83, 551–560.
33. Finn, J. D., & Achilles, C. M. (1999). Tennessee’s class size study: Findings, implications, misconceptions. Educational Evaluation and Policy Analysis, 21, 97–110.
34. Finn, J. D., Gerger, S. B., Achilles, C. M., & Zaharias, J. B. (2001). The enduring effects of small classes. Teachers College Record, 103, 145–183.
35. Folger, J. (Ed.). (1992). Project STAR and class size policy [Special issue]. Peabody Journal of Education, 67(1).
36. Gallagher, H. A. (2004/this issue). Vaughn Elementary’s innovative teacher evaluation system: Are teacher evaluation scores related to growth in student achievement? Peabody Journal of Education, 79(4), 79–107.
37. Gamoran, A. (1992). The variable effects of high school tracking. American Sociological Review, 57, 812–828.
38. Gamoran, A. (1993). Alternative uses of ability grouping in secondary schools: Can we bring high-quality instruction to low-ability classes? American Journal of Education, 101, 1–22.
39. Gamoran, A. (1996). Curriculum standardization and equality of opportunity in Scottish secondary education, 1984–1990. Sociology of Education, 29, 1–21.
40. Gamoran, A. (1997). Curriculum change as a reform strategy: Lessons from the United States and Scotland. Teachers College Record, 98, 608–628.
41. Gamoran, A. (1998). Differentiation and opportunity in restructured schools. American Journal of Education, 106, 385–415.
42. Gamoran, A., Porter, A. C., Smithson, J., & White, P. A. (1997). Upgrading high school mathematics instruction: Improving learning opportunities for low-income youth. Education Evaluation and Policy Analysis, 19, 325–338.
43. Garet, M., Birman, B., Porter, A. C., Yoon, K., & Desimone, L. (2002). What makes professional development effective? Analysis of a national sample of teachers. American Education Research Journal, 38, 915–945.
44. Goldhaber, D. D. (2001). How has teacher compensation changed? In W. Fowler, Jr. (Ed.), Selected papers in school finance, 2000 (pp. 11–40). Washington, DC: U.S. Department of Education, National Center for Education Statistics.
45. Goldhaber, D. D. (2002). The mystery of good teaching. Education Next, 2(1), 50–55.
46. Goldhaber, D. D., & Brewer, D. J. (1997). Evaluating the effect of teacher degree level on educational performance. In W. J. Fowler (Ed.), Developments in school finance, 1996 (pp. 197–210). Washington, DC: National Center for Education Statistics, U.S. Department of Education.
47. Goldhaber, D., & Brewer, D. (1999). Teacher licensing and student achievement. In M. Kanstoroom & C. E. Finn (Eds.), Better teachers, better schools (pp. 83–102). Washington, DC: Thomas B. Fordham Foundation.
48. Goldhaber, D. D., & Brewer, D. J. (2000). Does teacher certification matter? High school teacher certification status and student achievement. Educational Evaluation and Policy Analysis, 22, 129–145.
49. Goldhaber, D., & Player, D. (2003). What different benchmarks suggest about how financially attractive it is to teach in public schools. Madison: University of Wisconsin, Wisconsin Center for Education Research, Consortium for Policy Research in Education.
50. Greenwald, R., Hedges, L. V., & Laine, R. D. (1996). The effect of school resources on student achievement. Review of Educational Research, 66, 361–396.
51. Grissmer, D. (Ed.). (1999). Class size: Issues and new findings [Special issue]. Educational Evaluation and Policy Analysis, 21(2).
52. Grissmer, D. (2001). Research directions for understanding the relationship of educational resources to educational outcomes. In S. Chaikind & W. J. Fowler (Eds.), Education finance in the new millennium (pp. 139–155). Larchmont, NY: Eye On Education.
53. Hallinger, P., & Heck, R. H. (1996). Reassessing the principal’s role in school effectiveness: A review of empirical research, 1980–1995. Educational Administration Quarterly, 32(1), 5–45.
54. Hallinger, P., & Heck, R. H. (1998). Exploring the principal’s contribution to school effectiveness: 1980–1995. School Effectiveness and School Improvement, 9, 157–191.
55. Hanushek, E. A. (1986). The economics of schooling: Production and efficiency in public schools. Journal of Economic Literature, 24, 1141–1177.
56. Hanushek, E. A. (1989). The impact of differential expenditures on school performance. Educational Researcher, 18(4), 45–65.
57. Hanushek, E. A. (1992). The trade-off between child quantity and quality. Journal of Political Economy, 100, 85–117.
58. Hanushek, E. A. (1996). Measuring investment in education. Journal of Economic Perspectives, 10(4), 9–31.
59. Hanushek, E. A., Kain, J. F., & Rivkin, S. G. (1998). Teachers, schools, and academic achievement (Working Paper No. 6691). Cambridge, MA: National Bureau of Economic Research.
60. Heck, R. H., Larsen, T. J., & Marcoulides, G. A. (1990). Instructional leadership and school achievement: Validation of a causal model. Educational Administration Quarterly, 26(2), 94–125.
61. Hedges, L. V., & Greenwald, R. (1996). Have times changed? The relation between school resources and student performance. In G. Burtless (Ed.), Does money matter? The effect of school resources on student achievement and adult success (pp. 74–92). Washington, DC: Brookings Institute.
62. Hedges, L. V., Laine, R. D., & Greenwald, R. (1994). Does money matter? A meta-analysis of studies of the effects of differential school inputs on student outcomes. Educational Researcher, 23(3), 5–14.
63. Heistad, D. (1999, April). Teachers who beat the odds: Value-added reading instruction in Minneapolis 2nd grade classrooms. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Quebec, Canada.
64. Holtzapple, E. (2001). Report on the validation of teachers evaluation system instructional domain ratings. Cincinnati, OH: Cincinnati Public Schools.
65. Holtzapple, E. (2002, November). Validating a teacher evaluation system. Paper presented at the annual meeting of the American Evaluation Association, Washington, DC.
66. Jencks, C. S., & Mayer, S. E. (1990). The social consequences of growing up in a poor neighborhood. In L. E. Lynn & M. McGeary (Eds.), Inner-city poverty in the United States (pp. 111–186). Washington, DC: National Academy of Sciences.
67. Jencks, C. S., & Phillips, M. (1998). The Black–White test score gap. Washington, DC: Brookings Institute.
68. Jencks, C. S., Smith, M., Ackland, H., Bane, M. J., Cohen, D., Ginter, H., et al. (1972). Inequality: A reassessment of the effect of the family and schooling in America. New York: Basic Books.
69. Kimball, S. M., White, B., Milanowski, A. T., & Borman, G. (2004/this issue). Examining the relationship between teacher evaluation and student assessment results in Washoe County. Peabody Journal of Education, 79(4), 54–78.
70. Krueger, A. B. (1999). Experimental estimates of education production functions. Quarterly Journal of Economics, 114, 497–533.
71. Krueger, A. B., & Whitmore, D. M. (2001). Would smaller classes help close the Black–White achievement gap? (Working Paper No. 451). Princeton, NJ: Princeton University. Retrieved June 1, 2002, from http://www.irs.princeton.edu/pubs/pdfs/451.pdf
72. Lee, V., & Smith, J. (1997). High school size: Which works best, and for whom? Educational Evaluation and Policy Analysis, 19, 205–228.
73. Little, J. W. (1993). Teachers’ professional development in a climate of education reform. Educational Evaluation and Policy Analysis, 15, 129–151.
74. Louis, K. S., & Marks, H. M. (1998). Does professional community affect the classroom? Teachers’ work and student experiences in restructuring schools. American Journal of Education, 106, 532–575.
75. Marks, H. M. (2000). Student engagement in instructional activity: Patterns in the elementary, middle and high school years. American Educational Research Journal, 37, 153–184.
76. Meyer, R. H. (1996). Value-added indicators of school performance. In E. A. Hanushek & D. W. Jorgenson (Eds.), Improving America’s schools: The role of incentives (pp. 197–223). Washington, DC: National Academy Press.
77. Meyer, R. H. (2001). Estimation of teacher and school performance in the Denver public schools: A feasibility study. Madison: University of Wisconsin–Madison, Wisconsin Center for Educational Research.
78. Milanowski, A. (2004/this issue). The relation between teacher performance evaluation scores and student achievement: Evidence from Cincinnati. Peabody Journal of Education, 79(4), 33–53.
79. Miles, K. H., Odden, A., Fermanich, M., Archibald, S., & Gallagher, H. A. (in press). Understanding and comparing district investment in professional development: Methods and lessons from four districts. Journal of Education Finance.
80. Minorini, P., & Sugarman, S. (1999). Educational adequacy and the courts: The promise and problems of moving to a new paradigm. In H. Ladd, R. Chalk, & J. Hansen (Eds.), Equity and adequacy in education finance: Issues and perspectives (pp. 175–208). Washington, DC: National Academy Press.
81. Monk, D. H. (1994). Subject area preparation of secondary math and science teachers and student achievement. Economics of Education Review, 13, 125–145.
82. Monk, D. H., & King, J. (1994). Multilevel teacher resource effects on pupil performance in secondary mathematics and science: The case of teacher subject-matter preparation. In R. Ehrenberg (Ed.), Contemporary policy issues: Choices and consequences in education (pp. 29–58). Ithaca, NY: ILR Press.
83. Murnane, R. J. (1975). The impact of school resources on the learning of inner city children. Cambridge, MA: Ballinger.
84. Murnane, R. J. (1983). Quantitative studies of effective schools: What have we learned? In A. Odden & L. D. Webb (Eds.), School finance and school improvement: Linkages for the 1980’s (pp. 193–209). Cambridge, MA: Ballinger.
85. Murnane, R. J., & Phillips, B. R. (1981). What do effective teachers of inner-city children have in common? Social Science Research, 10, 83–100.
86. Murphy, J. (1994). Transformational change and the evolving role of the principal: Early empirical evidence. In J. Murphy & K. Seashore Louis (Eds.), Reshaping the principalship: Insights from transformational reform efforts (pp. 20–53). Thousand Oaks, CA: Corwin Press.
87. Newmann, F. (1992). Student engagement and achievement in American secondary schools. New York: Teachers College Press.
88. Newmann, F. M., & Wehlage, G. G. (1995). Successful school restructuring: A report to the public and educators. Madison: University of Wisconsin–Madison, Center on Organization and Restructuring of Schools.
89. No Child Left Behind Act of 2001, Pub. L. No. 107–110, 115 Stat. 1425. (2002).
90. Nye, B. A., Hedges, L. V., & Konstantopulos, S. (2001a). Are effects of small classes cumulative: Evidence from a Tennessee experiment. The Journal of Educational Research, 94, 336–345.
91. Nye, B. A., Hedges, L. V., & Konstantopulos, S. (2001b). The long-term effects of small classes in early grades: Lasting benefits in mathematics achievement at grade nine. Journal of Experimental Education, 69, 245–258.
92. Odden, A. (2003). An early assessment of comprehensive teacher compensation change plans. In D. Monk & M. Plecki (Vol. Eds.), School finance and teacher quality: Exploring the connections. 2003 Yearbook of the American Education Finance Association (pp. 209–228). Larchmont, NY: Eye on Education.
93. Odden, A., Archibald, S., Fermanich, M., & Gallagher, H. A. (2002). A cost framework for professional development. The Journal of Education Finance, 28, 51–74.
94. Pavan, B. (1992). The benefits of nongraded schools. Educational Leadership, 50(2), 22–25.
95. Picus, L. O. (2001). In search of more productive schools: A guide to resource allocation in education. Eugene: ERIC Clearinghouse on Educational Management, University of Oregon.
96. Porter, A. C. (1994). National standards and school improvement in the 1990s: Issues and promise. American Journal of Education, 102, 421–449.
97. Porter, A. C. (1998, October). Curriculum reform and measuring what is taught: Measuring the quality of education processes. Paper presented at the annual meeting of the Association for Public Policy Analysis and Management, New York.
98. Porter, A. C. (2002). Measuring the content of instruction: Uses in research and practice. Educational Researcher, 31(7), 3–14.
99. Porter, A. C., & Smithson, J. (2001). Are content standards being implemented in the classroom? A methodology and some tentative answers. In S. H. Fuhrman (Ed.), From the capitol to the classroom: Standards-based reform in the states (100th Yearbook of the National Science Foundation on Grant No. SPA–8953446 to the Consortium for Policy Research in Education). Madison: University of Wisconsin, Wisconsin Center for Education Research.
100. Purkey, S. C., & Smith, M. S. (1983). Effective schools: A review. The Elementary School Journal, 83, 427–452.
101. Raudenbush, S. W., & Bryk, A. S. (1986). Ahierarchical model for studying school effects. Sociology of Education, 59, 1–17.
102. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage.
103. Raywid, M. A. (1997–1998). Synthesis of research: Small schools: A reform that works. Educational Leadership, 55(4), 34–39.
104. Reynolds, D., Teddlie, C., Creemer, B., Scheerens, J., & Townsend, T. (2000). An introduction to school effectiveness research. In C. Teddlie & D. Reynolds (Eds.), The international handbook of school effectiveness research (pp. 3–25). London: Falmer.
105. Rice, J. K. (2001). Illuminating the black box: The evolving role of education productivity research. In S. Chaikind & W. J. Fowler (Eds.), Education finance in the new millennium (pp. 121–138). Larchmont, NY: Eye On Education.
106. Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2001). Teachers, schools, and academic achievement. Unpublished manuscript, Amherst College, Amherst, MA.
107. Rosenshine, B., & Stevens, R. (1986). Teaching functions. In M. C. Witrick (Ed.), Handbook of research on teaching (pp. 376–391). New York: Macmillan.
108. Rowan, B. (1999). Assessing teacher quality: Insights from school effectiveness research. Unpublished manuscript, University of Michigan, Ann Arbor.
109. Rowan, B., Camburn, E., & Richard, C. (2002, March). Using logs to measure the “enacted curriculum” in large-scale surveys: Insights from the study of instructional improvement. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
110. Rowan, B., Chiang, F.-S., & Miller, R. J. (1996, April). Using research on employee performance to study teaching effectiveness: An analysis of teacher effects on student achievement in mathematics using NELS 88 Data. Paper presented at the annual meeting of the American Educational Research Association, New York.
111. Rowan, B., Chiang, F.-S., & Miller, R. J. (1997). Using research on employees’ performance to study the effects of teachers on students’ achievement. Sociology of Education, 70, 256–284.
112. Rowan, B., Correnti, R., & Miller, R. J.(2002). What large-scale, survey research tells us about teacher effects on student achievement: Insights from the prospects study of elementary schools. Teachers College Record, 104, 1525–1567.
113. Sanders, W. L. (2000). Value-added assessment from student achievement data. Cary, NC: Create National Evaluation Institute.
114. Sanders, W. L., & Horn, S. P. (1994). The Tennessee Value-Added Assessment System (TVAAS): Mixed-model methodology in educational assessment. Journal of Personnel Evaluation in Education, 8, 299–311.
115. Sanders, W. L., & Rivers, J. C. (1996). Cumulative and residual effects of teachers on future student academic achievement. Knoxville: University of Tennessee Value-Added Research and Assessment Center.
116. Scheerens, J., Nanninga, C. R., & Pelgrum, W. J. H. (1989). Generalizability of instructional and school effectiveness indicators across nations: Preliminary results of a secondary analysis of the IEA Second Mathematics Study. In B. Creemer, T. Peters, & D. Reynolds (Eds.), Proceedings of the Second International Congress, Rotterdam 1989 (pp. 199–209). Lisse, The Netherlands: Swets & Zeitinger.
117. Sewell, W. H., Haller, A. O., & Portes, A. (1969). The educational and early occupational attainment process. American Sociological Review, 27, 517–522.
118. Sewell, W. H., & Hauser, R. M. (1975). Education, occupation, and earnings: Achievement in the early career. New York: Academic.
119. Slavin, R. (1987). Ability grouping and student achievement in elementary schools: Abest evidence synthesis. Review of Educational Research, 57, 293–336.
120. Slavin, R. (1992). The nongraded elementary school: Great potential but keep it simple. Educational Leadership, 50(2), 24–25.
121. Slavin, R., & Karweit, N. (1985). Effects of whole class, ability grouped and individualized instruction on mathematics achievement. American Educational Research Journal, 22, 351–357.
122. Smith, J. B., Lee, V. E., & Newmann, F. M. (2001). Instruction and achievement in Chicago elementary schools. Report of the Chicago Annenberg Research Project. Chicago: Consortium on Chicago School Research. (Available from http://www.consortium-chicago.org/publications/pdfs/p0f01.pdf)
123. Smylie, M. (1996). From bureaucratic control to building human capital: The importance of teacher learning in education reform. Educational Researcher, 25(9), 9–11.
124. Sorenson, A., & Hallinan, M. (1977). A reconceptualization of school effects. Sociology of Education, 50, 273–289.
125. Sparks, D., & Hirsh, S. (1999). A national plan for improving professional development (National Staff Development Council report). Oxford, OH: National Staff Development Council. (Available from http://www.nsdc.org/library/authors/NSDCPlan.cfm)
126. Stigler, J., & Hiebert, J. (1999) The teaching gap: Best ideas from the world’s teachers for improving education in the classroom. New York: Free Press.
127. Summers, A. A., & Wolfe, B. L. (1975). Equality of educational opportunity qualified: A production function approach (Research Paper No. 6). Philadelphia: Federal Reserve Bank of Philadelphia, Department of Research.
128. Summers, A. A., & Wolfe, B. L (1977). Do schools make a difference? American Economic Review, 67, 639–652.
129. Veenman, S. (1995). Cognitive and noncognitive effects of multigrade and multi-age classes: A best evidence synthesis. Review of Educational Research, 65, 319–381.
130. Wayne, A. J., & Youngs, P. (2003). Teacher characteristics and student achievement gains: Areview. Review of Educational Research, 73, 89–122.
131. Webster, W. J., Mendro, R. L., Orsak, T. H., & Weerasinghe, D. (1996, April). The applicability of selected regression and hierarchical linear models to the estimation of school and teacher effects. Paper presented at the annual meeting of the National Council on Measurement in Education, New York.
132. Webster, W. J., Mendro, R. L., Orsak, T. H., & Weerasinghe, D. (1998, April). An application of hierarchical linear modeling to the estimation of school and teacher effect. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
133. Wright, P. S., Horn, S. P., & Sanders, W. L. (1997). Teacher and classroom context effects on student achievement: Implications for teacher evaluation. Journal of Personnel Evaluation in Education, 11, 57–67.