Evaluating value-added models: A validity argument approach

Journal of Policy Analysis and Management

Volumn 28, Issue 4, 2009, Pages 700-709

  Hill, Heather C ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77049102612     PISSN: 02768739     EISSN: 15206688     Source Type: Journal    
DOI: 10.1002/pam.20463     Document Type: Article

References (49)

1. American Educational Research Association/American Psychological Association/National Council on Measurement in Education (AERA/APA/NCME) (1999). Standards for educational and psychological testing. Washington, DC: Author.
2. Amrein-Beardsley, A. (2008). Methodological concerns about the education value-added assessment system. Educational Researcher, 37, 65-75.
3. Ballou, D., Sanders, W., & Wright, P. (2004). Controlling for student background in valueadded assessment of teachers. Journal of Educational and Behavioral Statistics, 29, 37-65.
4. Brophy, J. (1973). Stability of teacher effectiveness. American Educational Research Journal, 10, 245-252.
5. Carpenter, T.P., Fennema, E., Peterson, P.L., Chiang, C.-P., & Loef, M. (1989). Using knowledge of children's mathematics thinking in classroom teaching: An experimental study. American Educational Research Journal, 26, 499-531.
6. Cohen, D., Raudenbush, S., & Ball, D. (2003). Resources, instruction, and research. Educational Evaluation and Policy Analysis, 25, 1-24.
7. Clotfelter, C., Ladd, H.F., & Vigdor, J. (2004). Teacher quality and minority achievement gaps. Durham, NC: Terry Sanford Institute of Public Policy.
8. Fessenden, F. (2007, September 9). Schools under scrutiny over cheating. New York Times. Acesssed January 31, 2009, at http://www.nytimes.com/2007/09/09/nyregion/nyregionspecial2/09Rcheating.html?_r=1&scp=1&sq=no%20child%20left%20behind%20cheating&st=cse.
9. Good, T.L., & Grouws, D. (1975). Process-product relationship in fourth-grade mathematics classrooms. Columbia, MO: University of Missouri.
10. Gordon, R., Kane, T.J., & Staiger, D.O. (2006). Identifying effective teachers using performance on the Job. Washington, DC: The Brookings Institution. Accessed January 23, 2009, at http://www3.brookings.edu/views/papers/200604hamilton_1.pdf.
11. Grubb, M.N. (2008). Multiple resources, multiple outcomes: Testing the "improved" school finance with NELS88. American Educational Research Journal 45, 104-146.
12. Hanushek, E.A. (2007). The single salary schedule and other issues of teacher pay. Peabody Journal of Education, 82, 574-586.
13. Hanushek, E.A., Kain, J.F., O'Brien, D.M., & Rivkin, S.G. (2005). The market for teacher quality. NBER Working Paper w11154. Accessed January 23, 2009, at http://edpro.stanford.edu/Hanushek/files_det.asp?FileId=136.
14. Harris, D.N. (2009). The policy uses and policy validity of value-added and other teacher quality measures. In D. Gitomer (Ed.), Measurement issues and assessment for teaching quality (pp. 99-130). Thousand Oaks, CA: Sage Publications.
15. Jacob, B .A., & Lefgren, L. (2005, June). Principals as agents: Subjective performance measurement in education. Faculty Research Working Paper Series, RWP05-040. Harvard University, John F. Kennedy School of Government.
16. Kane, M. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38, 319-342.
17. Kane, M. (2004). Certification testing as an illustration of argument-based approach validation. Measurement: Interdisciplinary Research and Perspectives, 2, 135-170.
18. Kane, T.J. (2007). Personal communication, August 7, 2007.
19. Kane, T.J. Rockoff, J.E., & Staiger, D.O. (2006). What does certification tell us about teacher effectiveness? Evidence from New York City. Cambridge, MA: Harvard University.
20. Kimball, S.M., White, B., Milanowski, A.T., & Borman, G. (2004). Examining the relationship between teacher evaluation and student assessment results in Washoe County. Peabody Journal of Education, 79, 54-78.
21. Koedel, C., & Betts, J. (2005). Re-examining the role of teacher quality in the educational production function. San Diego: UCSD.
22. Koretz, D. (2008). Limitations in the use of achievement tests. Journal of Human Resources 27, 752-777.
23. Koretz, D., Linn, R.L., Dunbar, S.B., & Shepard, L.A. (1991). The effects of high-stakes testing on achievement: Preliminary findings about generalization across tests. Paper presented at the annual meeting of the American Educational Research Association and the National Council on Measurement in Education, Chicago, April 5, 1991.
24. Kupermintz, H. (2003) Teacher effects and teacher effectiveness: A validity investigation of the Tennessee value added assessment system. Educational Evaluation and Policy Analysis, 25, 287-298.
25. Linn, R.L. (2000). Assessments and accountability. Educational Researcher, 29, 4-16.
26. Linn, R.L. (2008). Methodological issues in achieving school accountability. Journal of Curriculum Studies, 40, 699-711.
27. Lockwood, J.R., Louis, T.A., & McCaffrey, D.F. (2002). Uncertainty in rank estimation: implications for value-added modeling accountability systems. Journal of Educational and Behavioral Statistics, 27, 255-70.
28. Lockwood, J.R., McCaffrey, D.F., Hamilton, L.S., Stecher, B., Le, V., & Martinez, J.F. (2007). The sensitivity of value-added teacher effect estimates to different mathematics achievement measures. Journal of Educational Measurement, 44, 47-67.
29. McCaffrey, D.F., Lockwood, J.R., Koretz, D.M., & Hamilton, L.S. (2003) Evaluating valueadded models for teacher accountability. Santa Monica: RAND.
30. McCaffrey, D.F., Lockwood, J.R., Koretz, D., Louis, T.A., & Hamilton, L. (2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics 29, 76-101.
31. McCaffrey, D., Sass, T., Lockwood, J.R., & Mihaly, K. (forthcoming). The intertemporal stability of teacher effects. Education Finance and Policy.
32. Medley, D.M., & Coker, H. (1987). The accuracy of principals' judgment of teachers' performance. Journal of Educational Research, 80, 242-247.
33. Milanowski, A.T. (2004). The relationship between teacher performance evaluation scores and student achievement: Evidence from Cincinnati. Peabody Journal of Education, 79, 33-53.
34. Nye, B., Konstantopoulos, S., & Hedges, L.V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26, 237-257.
35. Papay, J.P. (2009) Different tests, different answers: The stability of teacher value-added estimates across outcome measures. Cambridge, MA: Harvard Graduate School of Education.
36. Pianta, R.C., Belsky, J., Vandergrift, N., Houts, R., & Morrison, F.J. (2008). Classroom effects on children's achievement trajectories in elementary school. American Educational Research Journal, 45, 365-97.
37. Raudenbush, S.W. (2004). What are value-added models estimating and what does this imply for statistical practice? Journal of Educational and Behavioral Statistics, 29, 121-129.
38. Reys, R., Reys, B., Lapan, R., Holliday, G., & Wasman, D. (2003). Assessing the impact of standards-based middle grades mathematics curriculum materials on student achievement. Journal for Research in Mathematic Education, 34, 74-95.
39. Rockoff, J.E. (2004). The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review, 94, 247-252.
40. Rowan, B., Correnti, R., & Miller, R.J. (2002). What large-scale survey research tells us about teacher effects on student achievement: Insights from the prospects study of elementary schools. Teachers College Record, 104, 1525-1567.
41. Rubin, D.B., Stuart, E.A., & Zanutto, E.L. (2004). A potential outcomes view of value-added assessment in education. Journal of Educational and Behavioral Statistics, 29, 103-116.
42. Sanders, W., & Horn, P. (1994). The Tennessee Value-Added Assessment System (TVAAS): Mixed methodology in educational assessment. Journal of Personnel Evaluation in Education, 8, 299-311.
43. Sanders, W.L., & Horn, S.P. (1998). Research findings from the Tennessee Value-Added Assessment System (TVAAS) database: Implications for educational evaluation and research. Journal of Personnel Evaluation in Education, 12, 247-256.
44. Saxe, G., Gearhardt, M., & Nasir, N.S. (2001). Enhancing students' understanding of mathematics: A study of three contrasting approaches to professional support. Journal of Mathematics Teacher Education, 4, 55-79.
45. Schacter, J., & Thum, Y.M. (2004). Paying for high- and low-quality teaching. Economics of Education Review, 23, 411-430.
46. Schilling, S.G., & Hill, H.C. (2007). Assessing measures of mathematical knowledge for teaching: A validity argument approach. Measurement: Interdisciplinary Research and Perspectives, 5, 70-80.
47. Tekwe, C.D., Carter, R.L., Ma, C., Algina, J., Lucas, M.E., Roth, J., et al. (2004). An empirical comparison of statistical models for value-added assessment of school performance. Journal of Educational and Behavioral Statistics, 29, 11-35.
48. Weingarten, R. (2007, October 14). How to fix No Child Left Behind. New York Times, WK7.
49. Wright, S.P. Sanders, W.L., & Horn, S.P. (1997). Teacher and classroom content effects on student achievement: Implications for teacher evaluation. Journal of Personnel Evaluation 11, 57-67.