Value-added modeling: A review

Economics of Education Review

Volumn 47, Issue , 2015, Pages 180-195

  Koedel, Cory ^a   Mihaly, Kata ^b   Rockoff, Jonah E ^c  

^a UNIVERSITY OF MISSOURI   (United States)

^b RAND CORPORATION   (United States)

^c The Sanford C Bernstein Co Center for Leadership and Ethics   (United States)

Author keywords

Education production; Teacher evaluation; Value added models; VAM

Indexed keywords

DESIGN; MODELING; RESEARCH; TEACHING;

EID: 84938212566     PISSN: 02727757     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.econedurev.2015.01.006     Document Type: Review

References (109)

1. Aaronson D., Barrow L., Sander W. Teachers and student achievement in the Chicago public high schools. Journal of Labor Economics 2007, 25(1):95-135.
2. Andrabi T., Das J., Khwaja A.I., Zajonc T. Do value-added estimates add value? Accounting for learning dynamics. American Economic Journal: Applied Economics 2011, 3(3):29-54.
3. Bacher-Hicks, A., Kane, T. J., & Staiger, D. O. (2014). Validating teacher effect estimates using changes in teacher assignments in Los Angeles (NBER Working Paper No. 20657).
4. Baker, E. L., Barton, P. E., Darling-Hammond, L., Haertel, E., Ladd, H. F., Linn, R. L., etal. (2010). Problems with the use of student test scores to evaluate teachers (Economic Policy Institute Briefing Paper No. 278).
5. Barlevy G., Neal D. Pay for percentile. American Economic Review 2012, 102(5):1805-1831.
6. Ben-Porath Y. The production of human capital and the life-cycle of earnings. Journal of Political Economy 1967, 75(4):352-365.
7. Betts J.R., Tang Y.E. Value-added and experimental studies of the effect of charter schools on student achievement: A literature review 2008, National Charter School Research Project, Center on Reinventing Public Education, Bothell, WA.
8. Betts J.R., Zau A.C., King K. From blueprint to reality: San Diego's education reforms 2005, Public Policy Institute of California, San Francisco, CA.
9. Biancarosa G., Byrk A.S., Dexter E. Assessing the value-added effects of literacy collaborative professional development on student learning. Elementary School Journal 2010, 111(1):7-34.
10. Boyd D., Lankford H., Loeb S., Wyckoff J. Teacher layoffs: An empirical illustration of seniority v. measures of effectiveness. Education Finance and Policy 2011, 6(3):439-454.
11. Boyd D., Lankford H., Loeb S., Wyckoff J. Measuring test measurement error: A general approach. Journal of Educational and Behavioral Statistics 2013, 38(6):629-663.
12. Campbell, D.T. (1976). Assessing the impact of planned social change (Occasional Paper Series #8). Hanover, NH: The Public Affairs Center, Dartmouth College.
13. Castellano K.E., Ho A.D. Practical differences among aggregate-level conditional status metrics: From median student growth percentiles to value-added models. Journal of Educational and Behavioral Statistics 2015, 40(1):35-68.
14. Chetty R., Friedman J., Hilger N., Saez E., Schanzenbach D.W., Yagan D. How does your kindergarten classroom affect your earnings? Evidence from project star. Quarterly Journal of Economics 2011, 126(4):1593-1660.
15. Chetty R., Friedman J.N., Rockoff J.E. Measuring the impacts of teachers I: Evaluating bias in teacher value-added estimates. American Economic Review 2014, 104(9):2593-2632.
16. Chetty R., Friedman J.N., Rockoff J.E. Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood. American Economic Review 2014, 104(9):2633-2679.
17. Chetty, R., Friedman, J. N., & Rockoff, J. E. (2014c). Response to Rothstein (2014) on 'Revisiting the impacts of teachers.' Unpublished manuscript, Harvard University.
18. Clotfelter C.T., Ladd H.F., Vigdor J.L. Teacher-student matching and the assessment of teacher effectiveness. Journal of Human Resources 2006, 41(4):778-820.
19. Condie S., Lefgren L., Sims D. Teacher heterogeneity, value-added and education policy. Economics of Education Review 2014, 40(1):76-92.
20. Corcoran, S., Jennings, J. L., & Beveridge, A. A. (2011). Teacher effectiveness on high- and low-stakes tests. Unpublished manuscript, New York University.
21. Currie J., Thomas D. School quality and the longer-term effects of head start. Journal of Human Resources 2000, 35(4):755-774.
22. Dee, T., & Wyckoff, J. (2013). Incentives, selection and teacher performance. Evidence from IMPACT (NBER Working Paper No. 19529).
23. Deming D.J. Early childhood intervention and life-cycle skill development: Evidence from head start. American Economic Journal: Applied Economics 2009, 1(3):111-134.
24. Deming D.J. Using school choice lotteries to test measures of school effectiveness. American Economic Review 2014, 104(5):406-411.
25. Ehlert M., Koedel C., Parsons E., Podgursky M. The sensitivity of value-added estimates to specification adjustments: Evidence from school- and teacher-level models in Missouri. Statistics and Public Policy 2013, 1(1):19-27.
26. Ehlert M., Koedel C., Parsons E., Podgursky M. Choosing the right growth measure: Methods should compare similar schools and teachers. Education Next 2014, 14(2):66-71.
27. Ehlert, M., Koedel, C., Parsons, E., & Podgursky, M. (in press). Selecting growth measures for use in school evaluation systems: Should proportionality matter? Educational Policy.
28. Glazerman, S., Loeb, S., Goldhaber, D., Staiger, D., Raudenbush, S., & Whitehurst, G. (2010). Evaluating teachers: The important role of value-added. Policy Report, Brown Center on Education Policy at Brookings.
29. Glazerman S., Protik A., Teh B.-r., Bruch J., Max J., Warner E. Transfer incentives for high-performing teachers: Final results from a multisite randomized experiment. United States Department of Education 2013.
30. Goldhaber D., Chaplin D. Assessing the "Rothstein falsification test." Does it really show teacher value-added models are biased?. Journal of Research on Educational Effectiveness 2015, 8(1):8-34.
31. Goldhaber D., Cowan J., Walch J. Is a good elementary teacher always good? Assessing teacher performance estimates across subjects. Economics of Education Review 2013, 36(1):216-228.
32. Goldhaber D., Hansen M. Is it just a bad class? Assessing the stability of measured teacher performance. Economica 2013, 80(319):589-612.
33. Goldhaber D., Liddle S., Theobald R. The gateway to the profession: Evaluating teacher preparation programs based on student achievement. Economics of Education Review 2013, 34(1):29-44.
34. Goldhaber D., Theobald R. Managing the teacher workforce in austere times: The determinants and implications of teacher layoffs. Education Finance and Policy 2013, 8(4):494-527.
35. Goldhaber D., Walch J., Gabele B. Does the model matter? Exploring the relationship between different student achievement-based teacher assessments. Statistics and Public Policy 2013, 1(1):28-39.
36. Guarino C.M., Reckase M.D., Stacey B.W., Wooldridge J.W. Evaluating specification tests in the context of value-added estimation. Journal of Research on Educational Effectiveness 2015, 8(1):35-59.
37. Guarino, C., Maxfield, M., Reckase, M. D., Thompson, P., & Wooldridge, J. M. (2014). An evaluation of empirical Bayes' estimation of value-added teacher performance measures. Unpublished manuscript.
38. Guarino C.M., Reckase M.D., Wooldridge J.W. Can value-added measures of teacher performance be trusted?. Education Finance and Policy 2015, 10(1):117-156.
39. Hanushek E.A. Teacher deselection. Creating a new teaching profession 2009, Urban Institute, Washington, DC. D. Goldhaber, J. Hannaway (Eds.).
40. Hanushek E.A. The economic value of higher teacher quality. Economics of Education Review 2011, 30(3):266-479.
41. Hansen, M. (2014). Right-sizing the classroom: Making the most of great teachers (CALDER Working Paper No. 110).
42. Hanushek E.A. Conceptual and empirical issues in the estimation of educational production functions. The Journal of Human Resources 1979, 14(3):351-388.
43. Hanushek E.A., Rivkin S.G. Generalizations about using value-added measures of teacher quality. American Economic Review 2010, 100(2):267-271.
44. Hanushek E.A., Woessmann L. The role of cognitive skills in economic development. Journal of Economic Literature 2008, 46(3):607-668.
45. Harris D.N., Sass T.R. Teacher training, teacher quality, and student achievement. Journal of Public Economics 2011, 95:798-812.
46. Harris D.N., Sass T.R. Skills, productivity and the evaluation of teacher performance. Economics of Education Review 2014, 40:183-204.
47. Herrmann, M., Walsh, E., Isenberg, E., & Resch, A. (2013). Shrinkage of value-added estimates and characteristics of students with hard-to-predict achievement levels. Policy Report, Mathematica Policy Research.
48. Isenberg, E., & Walsh, E. (2014). Measuring school and teacher value added in DC, 2012-2013 school year: Final report. Policy Report, Mathematica Policy Research (01.17.2014).
49. Ishii J., Rivkin S.G. Impediments to the estimation of teacher value added. Education Finance and Policy 2009, 4(4):520-536.
50. Jackson K. Match quality, worker productivity, and worker mobility: Direct evidence from teachers. Review of Economics and Statistics 2013, 95(4):1096-1116.
51. Jackson K. Teacher quality at the high-school level: The importance of accounting for tracks. Journal of Labor Economics 2014, 23(4):645-684.
52. Jacob B.A., Lefgren L. Can principals identify effective teachers? Evidence on subjective performance evaluations in education. Journal of Labor Economics 2008, 26(1):101-136.
53. Jacob B.A., Lefgren L., Sims D.P. The persistence of teacher-induced learning gains. Journal of Human Resources 2010, 45(4):915-943.
54. Jepsen C., Rivkin S.G. Class reduction and student achievement: The potential tradeoff between teacher quality and class size. Journal of Human Resources 2009, 44(1):223-250.
55. Johnson, M., Lipscomb, S., Gill, B., Booker, K., & Bruch, J. (2012). Value-added model for Pittsburgh public schools. Unpublished report, Mathematica Policy Research.
56. Kane T.J., McCaffrey D.F., Miller T., Staiger D.O. Have we identified effective teachers? Validating measures of effective teaching using random assignment 2013, Bill and Melinda Gates Foundation, Seattle, WA.
57. Kane T.J., Rockoff J.E., Staiger D.O. What does certification tell us about teacher effectiveness? Evidence from New York City. Economics of Education Review 2008, 27(6):615-631.
58. Kane T.J., Staiger D.O. The promise and pitfalls of using imprecise school accountability measures. Journal of Economic Perspectives 2002, 16(4):91-114.
59. Kane, T. J., & Staiger, D. O. (2008). Estimating teacher impacts on student achievement: An experimental evaluation (NBER Working Paper No. 14607).
60. Kane T.J., Staiger D.O. Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains 2012, Bill and Melinda Gates Foundation, Seattle, WA.
61. Kane T.J., Taylor E.S., Tyler J.H., Wooten A.L. Identifying effective classroom practices using student achievement data. Journal of Human Resources 2011, 46(3):587-613.
62. Kinsler J. Assessing Rothstein's critique of teacher value-added models. Quantitative Economics 2012, 3(2):333-362.
63. Koedel C. Teacher quality and dropout outcomes in a large, urban school district. Journal of Urban Economics 2008, 64(3):560-572.
64. Koedel C. An empirical analysis of teacher spillover effects in secondary school. Economics of Education Review 2009, 28(6):682-692.
65. Koedel C., Betts J.R. Does student sorting invalidate value-added models of teacher effectiveness? An extended analysis of the Rothstein critique. Education Finance and Policy 2011, 6(1):18-42.
66. Koedel C., Leatherman R., Parsons E. Test measurement error and inference from value-added models. B. E. Journal of Economic Analysis & Policy 2012, 12(1). (Topics).
67. Koedel, C., E. Parsons, M. Podgursky and M. Ehlert (in press). Teacher preparation programs and teacher quality: Are there real differences across programs? Education Finance and Policy.
68. Konstantopoulos S., Chung V. The persistence of teacher effects in elementary grades. American Educational Research Journal 2011, 48:361-386.
69. Krueger A.B., Whitmore D.M. The effect of attending a small class in the early grades on college test taking and middle school test results: Evidence from project STAR. Economic Journal 2001, 111(468):1-28.
70. Lazear E.P. Teacher incentives. Swedish Economic Policy Review 2003, 10(3):179-214.
71. Lefgren L., Sims D.P. Using subject test scores efficiently to predict teacher value-added. Educational Evaluation and Policy Analysis 2012, 34(1):109-121.
72. Lockwood J.R., McCaffrey DanielF. Correcting for test score measurement error in ANCOVA models for estimating treatment effects. Journal of Educational and Behavioral Statistics 2014, 39(1):22-52.
73. Lockwood J.R., McCaffrey D.F., Hamilton L.S., Stecher B., Le V.-N., Martinez J.F. The sensitivity of value-added teacher effect estimates to different mathematics achievement measures. Journal of Educational Measurement 2007, 44(1):47-67.
74. Mansfield, R.K. (in press). Teacher quality and student inequality. Journal of Labor Economics.
75. McCaffrey D.F., Lockwood J.R., Koretz D.M., Louis T.A., Hamilton L. Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics 2004, 29(1):67-101.
76. McCaffrey D.F., Sass T.R., Lockwood J.R., Mihaly K. The intertemporal variability of teacher effect estimates. Education Finance and Policy 2009, 4(4):572-606.
77. Meghir C., Rivkin S.G. Econometric methods for research in education. Handbook of the economics of education 2011, Vol. 3. Elsevier, Waltham, MA. E.A. Hanushek, S. Machin, L. Woessmann (Eds.).
78. Mihaly K., McCaffrey D.F., Sass T.R., Lockwood J.R. Centering and reference groups for estimates of fixed effects: Modifications to felsdvreg. The Stata Journal 2010, 10(1):82-103.
79. Mihaly K., McCaffrey D., Sass T.R., Lockwood J.R. Where you come from or where you go? Distinguishing between school quality and the effectiveness of teacher preparation program graduates. Education Finance and Policy 2013, 8(4):459-493.
80. Mihaly K., McCaffrey D.F., Staiger D.O., Lockwood J.R. A composite estimator of effective teaching. RAND External Publication 2013, EP-50155.
81. Morris C.N. Parametric empirical Bayes inference: Theory and applications. Journal of the American Statistical Association 1983, 78(381):47-55.
82. Murnane R.J., Willett J.B., Duhaldeborde Y., Tyler J.H. How important are the cognitive skills of teenagers in predicting subsequent earnings?. Journal of Policy Analysis and Management 2000, 19(4):547-568.
83. Newton X.A., Darling-Hammond L., Haertel E., Thomas E. Value-added modeling of teacher effectiveness: An exploration of stability across models and contexts. Education Policy Analysis Archives 2010, 18(23):1-27.
84. Nye B., Konstantopoulos S., Hedges L.V. How large are teacher effects?. Educational Evaluation and Policy Analysis 2004, 26(3):237-257.
85. Papay J.P. Different tests, different answers: The stability of teacher value-added estimates across outcome measures. American Educational Research Journal 2011, 48(1):163-193.
86. Paufler N.A., Amrein-Beardsley A. The random assignment of students into elementary classrooms: Implications for value-added analyses and interpretations. American Educational Research Journal 2014, 51(2):328-362.
87. Polikoff M.S. Does the test matter? Evaluating teachers when tests differ in their sensitivity to instruction. Designing teacher evaluation systems: New guidance from the measures of effective teaching project 2014, 278-302. Jossey-Bass, San Francisco, CA. T.J. Kane, K.A. Kerr, R.C. Pianta (Eds.).
88. Rivkin S.G., Hanushek E.A., Kain J.F. Teachers, schools and academic achievement. Econometrica 2005, 73(2):417-458.
89. Rockoff J.E., Speroni C. Subjective and objective evaluations of teacher effectiveness: Evidence from New York City. Labour Economics 2011, 18(5):687-696.
90. Rockoff J.E., Staiger D.O., Kane T.J., Taylor E.S. Information and employee evaluation: Evidence from a randomized intervention in public schools. American Economic Review 2012, 102(7):3184-3213.
91. Rothstein J. Student sorting and bias in value-added estimation: Selection on observables and unobservables. Education Finance and Policy 2009, 4(4):537-571.
92. Rothstein J. Teacher quality in educational production: Tracking, decay, and student achievement. Quarterly Journal of Economics 2010, 125(1):175-214.
93. Rothstein, J. (2014). Revising the impacts of teachers. Unpublished manuscript, University of California-Berkeley.
94. Rothstein J. Teacher quality policy when supply matters. American Economic Review 2015, 105(1):100-130.
95. Rothstein, J., & Mathis, W. J. (2013). Review of two culminating reports from the MET project. National Education Policy Center Report.
96. Sass T.R., Hannaway J., Xu Z., Figlio D.N., Feng L. Value added of teachers in high-poverty schools and lower poverty schools. Journal of Urban Economics 2012, 72:104-122.
97. Sass T.R., Semykina A., Harris D.N. Value-added models and the measurement of teacher productivity. Economics of Education Review 2014, 38(1):9-23.
98. Schochet P.Z., Chiang H.S. What are error rates for classifying teacher and school performance measures using value-added models?. Journal of Educational and Behavioral Statistics 2013, 38(3):142-171.
99. Scott, A. & Correnti, R. (2013). Pittsburgh's new teacher improvement system: Helping teachers help students learn. Policy Report, A+ Schools, Pittsburgh, PA.
100. Staiger D.O., Kane T.J. Making decisions with imprecise performance measures: The relationship between annual student achievement gains and a teacher's career value-added. Designing teacher evaluation systems: New guidance from the measures of effective teaching project 2014, 144-169. Jossey-Bass, San Francisco, CA. T.J. Kane, K.A. Kerr, R.C. Pianta (Eds.).
101. Strunk K.O., Weinstein T.L., Makkonnen R. Sorting out the signal: Do multiple measures of teachers' effectiveness provide consistent information to teachers and principals?. Education Policy Analysis Archives 2014, 22(100):1-41.
102. Taylor E.S., Tyler J.H. The effect of evaluation on teacher performance. American Economic Review 2012, 102(7):3628-3651.
103. Todd P.E., Wolpin K.I. On the specification and estimation of the production function for cognitive achievement. The Economic Journal 2003, 113:F3-F33.
104. United States Department of Education. (2009). Growth models: Non-regulatory guidance. Unpublished.
105. Value Added Research Center. (2010). NYC teacher data initiative: Technical report on the NYC value-added model. Unpublished report, Wisconsin Center for Education Research, University of Wisconsin-Madison.
106. Weisberg D., Sexton S., Mulhern J., Keeling D. The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness 2009, The New Teacher Project, New York.
107. White, T. (2014). Evaluating teachers more strategically. Using performance results to streamline evaluation systems. Policy Report, Carnegie Foundation for the Advancement of Teaching.
108. Winters M.A., Cowen J.M. Would a value-added system of retention improve the distribution of teacher quality? A simulation of alternative policies. Journal of Policy Analysis and Management 2013, 32(3):634-654.
109. Xu, Z., Ozek, U., & Corritore, M. (2012). Portability of teacher effectiveness across school settings (CALDER Working Paper No. 77).