Teacher Effect Estimates and Decision Rules for Establishing Student-Teacher Linkages: What are the Implications for High-Stakes Personnel Policies in an Urban School District?

Statistics, Politics and Policy

Volumn 3, Issue 2, 2012, Pages

  Han, Bing ^a   McCaffrey, Daniel ^a   Springer, Matthew G ^b   Gottfried, Michael ^a,c  

^a RAND CORPORATION   (United States)

^b VANDERBILT UNIVERSITY   (United States)

^c LOYOLA MARYMOUNT UNIVERSITY   (United States)

Author keywords

sensitivity; student teacher linkage; value added model

Indexed keywords

EID: 84924813287     PISSN: 21946299     EISSN: 21517509     Source Type: Journal    
DOI: 10.1515/2151-7509.1035     Document Type: Article

References (46)

1. Aranson, D., Barrow, L., and Sanders, W. (2003). Teachers and student achievement in Chicago public high schools. Chicago, IL: Federal Research Bank of Chicago.
2. Ballou, D., (2005). Value-added assessment: Lessons from Tennessee. In R. Lissetz (Ed), Value Added Models in Education: Theory and Applications. Maple Grove, MN: JAM Press.
3. Ballou, D., Sanders, W., and Wright, P. (2004). Controlling for student background in value-added assessment of teachers. Journal of Educational and Behavioral Statistics 29(1), 37-66.
4. Battelle for Kids. (2009). The Importance of Accurately Linking Instruction to Students to Determine Teacher Effectiveness, Columbus, OH: Battelle for Kids. Retrieved July 22, 2010, from http://portal.battelleforkids.org/BFK/images/Link_whitepagesApril2010web.pdf
5. Battelle for Kids (2010). Link Before you Leap: The Importance of Accurate Teacher-Student Linkages, Columbus, OH: Battelle for Kids.
6. Betebenner, D. W. (2008). A Primer on Student Growth Percentiles, Dover, NH: National Center for the Improvement of Educational Assessment. Downloaded July 17, 2011 at http://www.cde.state.co.us/cdedocs/Research/PDF/Aprimeronstudentgrowthpercentiles.pdf
7. Bloom, H.S. (2005). Randomizing groups to evaluate place-based programs. In H.S. Bloom (Ed.), Learning More from Social Experiments: Evolving Analytic Approaches. New York: Russell Sage Foundation.
8. Bloom, H.S., Bos, J.M., & Lee, S.W. (1999). Using cluster random assignment to measure program impacts: Statistical implications for the evaluation of educational programs. Evaluation Review, 23, 445-469.
9. Bock, R. Darrell; Richard Wolfe and Thomas H. Fisher (1996). A Review and Analysis of the Tennessee Value-Added Assessment System. Nashville, TN: Comptroller of the Treasury, Office of Education Accountability.
10. Boyd, D., Grossman, P., Lankford, H., and Loeb, S. (2006). How changes in entry requirements alter the teacher workforce and affect student achievement. Education Finance and Policy, 1(2), 176-216.
11. Braun, H. (2005). Using Student Progress to Evaluate Teachers: A Primer on Value-Added Models, Princeton, NJ: Technical report, Educational Testing Service, Policy Information Center.
12. Buddin, R., McCaffrey, D., Nataraj Kirby, S., and Xia, N. (2007). Merit Pay for Florida Teachers: Design and Implementation Issues, Working Paper, WR-508-FEA. Santa Monica, CA: The RAND Corporation.
13. Donner, A. & Klar, N. (2000). Design and Analysis of Cluster Randomization Trials in Health Research. London: Arnold.
14. Engec, N. (2006). Relationship between Mobility and Student Performance and Behavior. Journal of Educational Research, 99, 167-178.
15. Ewing, J. (2011). Mathematical Intimidation: Driven by the Data. Notices of the AMS,58(5), 667-673.
16. th Edition. Upper Saddle River, NJ: Prentice Hall.
17. Harris, D. and Sass, T. (2006). Value-added models and the measurement of teacher quality. Unpublished manuscript.
18. Imbens, G.W. (2003). Nonparametric Estimation of Average Treatment Effects under Exogeneity: A Review, Technical Working Paper 294. Cambridge, MA: National Bureau of Economic Research.
19. Jacob, B. and Lefgren, L. (2005). Principals as Agents: Subject Performance Measurement in Education, Cambridge, MA: National Bureau for Economic Research Working Paper 11463.
20. Kane, T.J., Rockoff, J.E., and Staiger, D.O. (2005). Identifying Effective Teachers in New York City, Cambridge, MA: NBER Working Paper.
21. Kerbow, D. (1996). Patterns of Urban Student Mobility and Local School Reform (CRESPAR-TR-5), Baltimore: MD, Center for Research on the Education of Students Placed At Risk.
22. Koedel, C. and Betts, J. (2005). Re-examining the role of teacher quality in the education production function. University of California – San Diego Working Paper.
23. Koedel, Cory and Julian R. Betts (2008). Test-Score Ceiling Effects and Value-Added Measures of School Quality. JSM Proceedings, Social Statistics Section. Alexandria, VA: American Statistical Association.
24. Lissitz, R. (2005). Value-Added Models in Education: Theory and Applications. (Ed.) Maple Grove, MN: JAM Press.
25. Lissitz, R., Doran, H., Schafer, W. and Willhoft, J. (2006). Growth modeling, value added modeling and linking: An introduction. In Longitudinal and Value Added Models of Student Performance (R. Lissitz, Ed). Maple Grove, MN: JAM Press.
26. Lockwood, J.R., Louis, T and McCaffrey, D. F. (2002). Uncertainty in rank estimation: Implications for value-added modeling accountability systems. Journal of Educational and Behavioral Statistics, 27(3), 255- 270.
27. Lockwood J.R., McCaffrey DF, Mariano LT and Setodji C. (2007). Bayesian methods for scalable multivariate value-added assessment. Journal of Educational and Behavioral Statistics, 32(2), 125-150.
28. Mao, M. X., Whitsett, M., & Mellor, L. T. (1998). Student Mobility, Academic Performance, and School Accountability. ERS Spectrum, 16(1), 3-15.
29. McCaffrey, D., Han, B., & Lockwood, J. (2008). From Data to Bonuses: A Case Study of the Issues Related to Awarding Teachers Pay on the Basis of their Students’ Progress. Nashville, TN: National Center on Performance Incentives, Vanderbilt University, Working Paper No. 2008-4.
30. McCaffrey, D. F., Lockwood, J.R., Koretz, D. M., and Hamilton, L. S. (2003). Evaluating Value-Added Models for Teacher Accountability, MG- 158. Santa Monica, CA: The RAND Corporation.
31. McCaffrey, D.F., Lockwood, J.R., Koretz, D. M., Louis, T., and Hamilton, L.S. (2004). Models for Value-Added Modeling of Teacher Effects. Journal of Educational and Behavioral Statistics, 29(1), 67- 101.
32. McCaffrey, D. F., Sass, T. R., Lockwood, J., & Mihaly, K. (2009). The intertemporal variability of teacher effect estimates. Education Finance and Policy, 4(4), 572-606.
33. Mehana, M., & Reynolds, A. J. (1995, August). The effects of school mobility on scholastic achievement. Paper presented at the sixth biennial meeting of the Society for Research in Child Development, Indianapolis, IN.
34. Murray, D.M. (1998). Design and Analysis of Group-Randomized trials. New York: Oxford University Press.
35. R Development Core Team (2011). R: A Language and Environment for Statistical Computing, http://www.R-project.org.
36. Rivkin, S., Hanushek, E.A., and Kain, J.F. (2005). Teachers, schools, and academic achievement. Econometrica, 73(2), 417-458.
37. Rothstein, J. (2010). Teacher quality in educational production: tracking, decay, and student achievement, Quarterly Journal of Economics 125(1), February 2010, p.p. 175-214
38. Rumberger, R. W. (2003). The Causes and Consequences of Student Mobility. Journal of Negro Education, 72(1), 6-21.
39. Sanders, W., Saxton, A., and Horn, B. (1997). The Tennessee Value- Added Assessment System: A quantitative outcomes-based approach to educational assessment. In J. Millman (Ed.), Grading Teachers, Grading Schools: Is Student Achievement a Valid Evaluation Measure? Thousand Oaks, CA: Corwin Press, Inc., 137-162.
40. Schochet, P. Z., & Chiang, H. S. (2010). Error Rates in Measuring Teacher and School Performance Based on Student Test Score Gains. NCEE 2010-4004. National Center for Education Evaluation and Regional Assistance, 64.
41. Sim, J. and Wright, C. C. (2005) The Kappa Statistic in Reliability Studies: Use, Interpretation, and Sample Size Requirements. Physical Therapy. 85, 257–268.
42. Springer, M.G., Ballou, D., Hamilton, L., Le, V.N., Lockwood, J.R., McCaffrey, D.F., Pepper, M., Stecher, B.M. (2010). Teacher Pay for Performance: Experimental Evidence from the Project on Incentives on Teaching, Nashville, TN: National Center on Performance Incentives, Vanderbilt University.
43. Staiger, D.O., and Rockoff, J. E. (2010) Searching for effective teachers with imperfect information. Journal of Economic Perspectives, 24(3), 97-118.
44. Thomas, SM, Peng, W-J and Gray, J. Modelling patterns of improvement over time: value added trends in English secondary school performance across ten cohorts. Oxford Review of Education, 33 (3), 261-295.
45. U.S. General Accounting Office. (1994). Elementary School Children: Many Change Schools Frequently, Harming Their Education (GAO/HEHS-94-45). Washington, D.C.
46. Wright, S.P., Horn, S.P., and Sanders, W.L. (1997). Teachers and classroom context effects on student achievement. Journal of Personnel Evaluation in Education, 11, 57-67.