What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?

Journal of Educational and Behavioral Statistics

Volumn 38, Issue 2, 2013, Pages 142-171

  Schochet, Peter Z ^a   Chiang, Hanley S ^a  

^a MATHEMATICA POLICY RESEARCH   (United States)

Author keywords

false positive and negative error rates; performance measurement systems; student learning gains; value added models

Indexed keywords

EID: 84875433615     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998611432174     Document Type: Article

References (43)

1. Aaronson D.,Barrow L.,Sander W.Teachers and student achievement in the Chicago public high schools.Journal of Labor Economics. 2007;25:95-135.
2. Amemiya T.Advanced econometrics. Cambridge, MA: Harvard University Press; 1985:.
3. Andrabi T.,Das J.,Khwaja A. I.,Zajonc T.Do value-added estimates add value? Accounting for learning dynamics.American Economic Journal: Applied Economics. 2011;3:29-54.
4. Ballou D.2005:.
5. Benjamini Y.,Hochberg Y.Controlling the false discovery rate. A new and powerful approach to multiple testing.Journal of the Royal Statistical Society, Series B. 1995;57:1289-1300.
6. Berger J.Statistical decision theory and Bayesian analysis. New York, NY: Springer-Verlag; 1985:.
7. Learning about teaching: Initial findings from the measures of effective teaching project. Seattle, WA:; 2010:.
8. Bloom H.,Hill C.,Black A.,Lipsey M.Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions. New York, NY: MDRC; 2008:.
9. Bloom H.,Richburg-Hayes L.,Black A.Using covariates to improve precision for studies that randomize schools to evaluate educational interventions.Educational Evaluation and Policy Analysis. 2007;29:30-59.
10. Gelman A.,Hill J.,Yajima M.Why we (usually) don't have to worry about multiple comparisons. Department of statistics working paper. New York, NY: Columbia University; 2009:.
11. Goldhaber D.,Hansen M.CRPE working paper 2008_5. Seattle, WA: Center on Reinventing Public Education; 2008:.
12. Hanushek E.,Kain J.,O'Brien D.,Rivkin S.NBER working paper 11154. Cambridge, MA: National Bureau of Economic Research; 2005:.
13. Hanushek E.,Rivkin S.Generalizations about using value-added measures of teacher quality.American Economic Review: Papers and Proceedings. 2010;100:267-271.
14. Harris D.,Sass T.Working paper. Tallahassee: Florida State University; 2006:.
15. Hedges L.,Hedberg E.Intraclass correlation values for planning group-randomized trials in education.Educational Evaluation and Policy Analysis. 2007;29:60-87.
16. Jacob B.,Lefgren L.Can principals identify effective teachers? Evidence on subjective performance evaluation in education.Journal of Labor Economics. 2008;26:101-136.
17. Kane T.Working paper. Los Angeles, CA: University of California; 2004:.
18. Kane T.,Rockoff J.,Staiger D.What does certification tell us about teacher effectiveness? Evidence from New York City.Economics of Education Review. 2008;27:615-631.
19. Kane T.,Staiger D.The promise and pitfalls of using imprecise school accountability measures.Journal of Economic Perspectives. 2002a;16:91-114.
20. Kane T.,Staiger D.Brookings papers on education policy: 2002. Ravitch D., ed. Washington, DC: Brookings Institution Press; 2002b:.
21. Kane T.,Staiger D.NBER working paper 14607. Cambridge, MA: National Bureau of Economic Research; 2008:.
22. Kish L.Survey sampling. New York, NY: John Wiley; 1965:.
23. Koedel C.,Betts J.Working paper. Columbia: University of Missouri; 2007:.
24. Koedel C.,Betts J.Working paper. Columbia: University of Missouri; 2009:.
25. Lindley D.V.,Smith A. F. M.Bayes estimates for the linear model.Journal of the Royal Statistics Society, Series B. 1972;34:1-41.
26. Lipscomb S.,Teh B.,Gill B.,Chiang H.,Owens A.Teacher and principal value-added: Research findings and implementation practices. Cambridge, MA: Mathematica Policy Research; 2010:.
27. McCaffrey D.,Lockwood J. R.,Koretz D.,Hamilton L.Evaluating value-added models for teacher accountability. Santa Monica, CA: RAND; 2003:.
28. McCaffrey D.,Lockwood J. R.,Koretz D.,Louis T.,Hamilton L.Models for value-added modeling of teacher effects.Journal of Educational and Behavioral Statistics. 2004;29:67-101.
29. McCaffrey D.,Sass T.,Lockwood J. R.,Mihaly K.The intertemporal stability of teacher effects.Education Finance and Policy. 2009;4:572-606.
30. National Institute for Excellence in Teaching. (2009). TAP: The system for teacher and student advancement. Retrieved October13, 2009, fromhttp://www.tapsystem.org/.
31. Nye B.,Konstantopoulos S.,Hedges L.How large are teacher effects?.Educational Evaluation and Policy Analysis. 2004;26:237-257.
32. Raudenbush S.,Bryk A.Hierarchical linear models: Applications and data analysis methods. 2002). Hierarchical linear models: Applications and data analysis methods. (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2002:.
33. Rivkin S.,Hanushek E.,Kain J.Teachers, schools, and academic achievement.Econometrica. 2005;73:417-458.
34. Rockoff J.The impact of individual teachers on student achievement: Evidence from panel data.American Economic Review (AEA Papers and Proceedings). 2004;94:247-252.
35. Rothstein J.Teacher quality in educational production: Tracking, decay, and student achievement.Quarterly Journal of Economics. 2010;125:175-214.
36. Sanders W. L.,Saxton A. M.,Horn S. P.Grading teachers, grading schools: Is student achievement a valid evaluation measure?. Millman J., ed. Thousand Oaks, CA: Corwin Press; 1997:137-162.
37. Schochet P. Z.Statistical power for random assignment evaluations of education programs.Journal of Educational and Behavioral Statistics. 2008;33:62-87.
38. Schochet P. Z.,Chiang H. S.Error rates in measuring teacher and school performance based on student test score gains. Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education; 2010:.
39. Solmon L.,White J. T.,Cohen D.,Woo D.The effectiveness of the teacher advancement program. Santa Monica, CA: National Institute for Excellence in Teaching; 2007:.
40. Springer M.,Ballou D.,Peng A.Working paper 2008-19. Nashville, TN: National Center on Performance Incentives; 2008:.
41. Todd P.,Wolpin K.On the specification and estimation of the production function for cognitive achievement.The Economic Journal. 2003;113:F3-F33.
42. U.S. Department of Education. (2010). Race to the top application for initial funding: Tennessee. Retrieved May 21, 2010, fromhttp://www2.ed.gov/programs/racetothetop/phase1-applications/tenness ee.pdf.
43. Wooldridge J.Econometric analysis of cross section and panel data. Cambridge: MIT Press; 2002:.