Classroom Composition and Measured Teacher Performance: What Do Teacher Observation Scores Really Measure?

Educational Evaluation and Policy Analysis

Volumn 38, Issue 2, 2015, Pages 293-317

  Steinberg, Matthew P ^a   Garrett, Rachel ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b AMERICAN INSTITUTES FOR RESEARCH   (United States)

Author keywords

classroom composition; classroom observation scores; teacher effectiveness; teacher evaluation

Indexed keywords

EID: 84967139398     PISSN: 01623737     EISSN: 19351062     Source Type: Journal    
DOI: 10.3102/0162373715616249     Document Type: Article

References (34)

1. D.AaronsonL.BarrowW.Sander (2007). Teachers and student achievement in the Chicago public high schools. Journal of Labor Economics, 25, 95–135.
2. D.ChaplinB.GillA.ThompkinsH.Miller (2014). Professional practice, student surveys, and value-added: Multiple measures of teacher effectiveness in the Pittsburgh Public Schools (REL 2014–024). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Mid-Atlantic. Retrieved from http://ies.ed.gov/ncee/edlabs
3. C.ClotfelterH.LaddJ.Vigdor (2006). Teacher-student matching and the assessment of teacher effectiveness. The Journal of Human Resources, 41, 778–820.
4. T.DeeJ.Wyckoff (2013). Incentives, selection, and teacher performance: Evidence from IMPACT. Journal of Policy Analysis and Management, 34, 267–297.
5. R.GarrettM.Steinberg (2015). Examining teacher effectiveness using classroom observation scores: Evidence from the randomization of teachers to students. Educational Evaluation and Policy Analysis, 37, 224–242.
6. S.GlazermanS.LoebD.GoldhaberD.StaigerS.RaudenbushG.Whitehurst (2010). Evaluating teachers: The important role of value-added. Washington, DC: The Brookings Institution.
7. D.D.Goldhaber (2002). The mystery of good teaching. Education Next, 2(1), 50–55.
8. D.D.GoldhaberM.Hansen (2010). Is it just a bad class? Assessing the stability of measured teacher performance (CEDR Working Paper No. 2010-3). Seattle: University of Washington.
9. E.GoldringJ.A.GrissomM.RubinC.M.NeumerskiM.CannataT.DrakeP.Schuermann (2015). Make room value added: Principals’ human capital decisions and the emergence of teacher observation data. Educational Researcher, 44(2), 96–104.
10. C.K.JacksonE.Bruegmann (2009). Teaching students and teaching each other: The importance of peer learning for teachers. American Economic Journal: Applied Economics, 1(4), 85–108.
11. D.KalogridesS.Loeb (2013). Different teachers, different peers: The magnitude of student sorting within schools. Educational Researcher, 42, 304–316.
12. D.KalogridesS.LoebT.Beteille (2013). Systemic sorting: Teacher characteristics and class assignments. Sociology of Education, 86, 103–123.
13. T.KaneD.McCaffreyT.MillerD.Staiger (2013). Have we identified effective teachers? Validating measures of effective teaching using random assignment (Bill & Melinda Gates Foundation MET Project research paper). Seattle, WA: Bill & Melinda Gates Foundation.
14. M.A.KraftJ.P.Papay (2014). Can professional environments in schools promote teacher development? Explaining heterogeneity in returns to teaching experience. Educational Evaluation and Policy Analysis, 36, 476–500.
15. S.LoebT.BeteilleD.Kalogrides (2012). Effective schools: Teacher hiring, assignment, development and retention. Education Finance and Policy, 7, 269–304.
16. D.F.McCaffreyT.R.SassJ.R.LockwoodK.Mihaly (2009). The intertemporal variability of teacher effect estimates. Education Finance and Policy, 4, 572–606.
17. K.MihalyD.F.McCaffreyD.StaigerJ.R.Lockwood (2013). A composite estimator of effective teaching (Technical report for the Measures of Effective Teaching project). Seattle, WA: Bill & Melinda Gates Foundation.
18. D.H.Monk (1987). Assigning elementary pupils to their teachers. The Elementary School Journal, 88, 166–187.
19. National Governors Association Center for Best Practices & Council of Chief State School Officers. (2010). Common Core State Standards (Mathematics). Washington, DC: Author.
20. J.Papay (2011). Different tests, different answers: The stability of teacher value-added estimates across outcome measures. American Education Research Journal, 48, 163–193.
21. S.G.RivkinE.A.HanushekJ.F.Kain (2005). Teachers, schools and academic achievement. Econometrica, 73, 417–458.
22. J.E.Rockoff (2004). The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review, 94, 247–252.
23. J.Rothstein (2009). Student sorting and bias in value-added estimation: Selection on observables and unobservables. Education Finance and Policy, 4, 537–571.
24. J.Rothstein (2010). Teacher quality in educational production: Tracking, decay, and student achievement. The Quarterly Journal of Economics, 125, 175–214.
25. L.SartainM.Steinberg (in press). Teachers’ labor market responses to performance evaluation reform: Experimental evidence from Chicago public schools. Journal of Human Resources.
26. T.SassJ.HannawayZ.XuD.FiglioL.Feng (2012). Value added of teachers in high-poverty schools and lower-poverty schools. Journal of Urban Economics, 72, 104–122.
27. M.SteinbergM.Donaldson (in press). The new educational accountability: Understanding the landscape of teacher evaluation in the post-NCLB era. Education Finance and Policy.
28. M.SteinbergR.Garrett (2015). Teacher effectiveness, peer quality and student achievement: Evidence from student sorting following teacher random assignment (Working paper).
29. M.SteinbergL.Sartain (2015). Does teacher evaluation improve school performance? Experimental evidence from Chicago’s Excellence in Teaching Project. Education Finance and Policy, 10, 535–572.
30. E.S.TaylorJ.H.Tyler (2012). The effect of evaluation on teacher performance. American Economic Review, 102, 3628–3651.
31. J.G.WatsonS.B.KraemerC.A.Thorn (2009). The other 69 percent. Washington, DC: Center for Educator Compensation Reform, U.S. Department of Education, Office of Elementary and Secondary Education.
32. D.WeisbergS.SextonJ.MulhernD.Keeling (2009). The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness. Brooklyn, NY: The New Teacher Project.
33. M.WhiteB.Rowan (2012). A user guide to the “core study” data files available to MET early career grantees. Ann Arbor: Inter-University Consortium for Political and Social Research, The University of Michigan.
34. G.WhitehurstM.ChingosK.Lindquist (2014). Evaluating teachers with classroom observations: Lessons learned in four districts. Washington, DC: Brown Center on Education Policy at Brookings.