Measuring teaching using Value-Added modeling: The imperfect panacea

NASSP Bulletin

Volumn 95, Issue 2, 2011, Pages 122-140

  Scherrer, Jimmy ^a  

^a UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

accountability; high stakes assessment; measurement; measuring teaching; teacher effects; value added modeling; VAM

Indexed keywords

EID: 80052497063     PISSN: 01926365     EISSN: 19301405     Source Type: Journal    
DOI: 10.1177/0192636511410052     Document Type: Article

References (74)

1. Aaronson D.,Barrow L.,Sander W.Teachers and student achievement in the Chicago public high schools.Journal of Labor Economics. 2007;25:95-135.
2. Adams S. J.,Heywood J. S.,Rothstein R.Teachers, performance pay, and accountability: What education should learn from other sectors. Washington, DC: Economic Policy Institute; 2009:.
3. Alexander K. L.,Entwisle D. R.,Olson L. S.Lasting consequences of the summer learning gap.American Sociological Review. 2007;72:167-180.
4. Anyon J.Ghetto schooling: A political economy of urban educational reform. New York, NY: Teachers College Press; 1997:.
5. Anyon J.Radical possibilities: Public policy, urban education, and a new social movement. New York, NY: Routledge; 2005:.
6. Baker E.,Barton P.,Darling-Hammond L.,Haertel E.,Ladd H.,Linn R.,Shepard L. A.Problems with the use of student test scores to evaluate teachers. Washington, DC: Economic Policy Institute; 2010:.
7. Baldi S.,Jin Y.,Skemer M.,Green P.,Herget D.,Xie H.Highlights from PISA 2006: Performance of U.S. 15-year-old students in science and mathematics literacy in an international context. Washington, DC: National Center for Education Statistics; 2007:.
8. Bowles S.,Gintis H.,Groves M.Unequal chances: Family background and economic success. Princeton, NJ: Princeton University Press; 2005:.
9. Getting value out of value-added: Report of a workshop. Braun H.Chudowsky N.Koenig J., ed. Washington, DC: National Academies Press; 2010:.
10. Bryk A. S.,Schneider B.Trust in schools: A core resource for school reform.Educational Leadership. 2003;60 (6): 40-45.
11. Center for K-12 Assessment & Performance Management at ETS. (2010). Developing an internationally comparable balanced assessment system that supports high-quality learning. Education Testing Services. Retrieved from http://www.k12center.org/publications.html.
12. Coleman J.,Campbell E.,Hobson C.,McPartland J.,Mood A.,Weinfeld F.,York R.Equality and educational opportunity. Washington, DC: U.S. Government Printing Office; 1966:.
13. Cooper H.,Nye B.,Charlton K.,Lindsay J.,Greathouse S.Review of Educational Research. 1996:227-268.
14. Darling-HammondL. (2010, September7). Too unreliable. The New York Times. Retrieved from http://www.nytimes.com/roomfordebate/2010/09/06/assessing-a-teachers-value/value-added-assessment-is-too-unreliable-to-be-useful.
15. Dee T. S.Teachers, race, and student achievement in a randomized experiment.Review of Economics and Statistics. 2004;86:195-210.
16. Downey D. B.,von Hippel P. T.,Broh B. A.Are schools the great equalizer? Cognitive inequality during the summer months and the school year.American Sociological Review. 2004;69:613-635.
17. EastonJ. (2008, November). Goals and aims of value-added modeling: A Chicago perspective. Paper presented at the National Academies Committee on Value-Added Methodology for Instructional Improvement, Program Evaluation, and Accountability, Washington, DC. Retrieved from http://www7.nationalacademies.org/bota/VAM_Workshop_Agenda.html.
18. Elmore R. F.School reform from the inside out. Cambridge, MA: Harvard Education Press; 2004:.
19. Gick M. L.,Holyoak K. J.Schema induction and analogical transfer.Cognitive Psychology. 1983;15:1-38.
20. Goldenberg C. N.Successful school change: Creating settings to improve teaching and learning. New York, NY: Teachers College Press; 2004:.
21. Gordon R.,Kane T. J.,Staiger D. O.Identifying effective teachers using performance on the job. Washington, DC: Brookings Institution Press; 2006:.
22. HaneyW. (2000). The myth of the Texas miracle in education. Education Policy Analysis Archives, 8(41). Retrieved from http://epaa.asu.edu/epaa/v8n41/.
23. Hanushek E. A.,Kain J. F.,O'Brien D. M.,Rivkin S. G.The market for teacher quality. Cambridge, MA: National Bureau of Economic Research; 2005:.
24. Hanushek E. A.,Rivkin S. G.Handbook of the economics of education. Hanushek E.Welch F., ed. Amsterdam, Netherlands: North-Holland; 2006:1051-1078.
25. Hanushek E. A.,Rivkin S. G.Using value-added measures of teacher quality. Washington, DC: National Center for Analysis of Longitudinal Data in Education Research; 2010:.
26. Harris D. N.Would accountability based on teacher value added be smart policy? An examination of the statistical properties and policy alternatives.Education Finance and Policy. 2009;4:319-350.
27. Harris D. N.,Sass T. R.What makes for a good teacher and who can tell?. Washington, DC: National Center Analysis of Longitudinal Data in Education Research; 2009:.
28. Heyns B.Summer learning and the effects of schooling. San Diego, CA: Academic Press; 1978:.
29. Ishii J.,Rivkin S. G.Impediments to the estimation of teacher value added.Education Finance and Policy. 2009;4:520-536.
30. Jacob B.Test-based accountability and student achievement: An investigation of differential performance on NAEP and state assessments. Cambridge, MA: National Bureau of Economic Research; 2007:.
31. Jacob B. A.,Levitt S. D.Rotten apples: An investigation of the prevalence and predictors of teacher cheating.Quarterly Journal of Economics. 2003;118:843-877.
32. Kane T. J.,Staiger D. O.Brookings papers on education policy. Ravitch D., ed. Washington, DC: Brookings Institution; 2002:235-283.
33. Keiser D.Teacher education for democracy and social justice. Michelli N.Keiser D., ed. New York, NY: Routledge; 2005:31-55.
34. Koedel C.,Betts J. R.Re-examining the role of teacher quality in the educational production function. Columbia: University of Missouri Department of Economics; 2005:.
35. Koretz D. M.,Barron S. I.The validity of gains in scores on the Kentucky Instructional Results Information System (KIRIS). Santa Monica, CA: RAND; 1998:.
36. Koretz D. M.,Hamilton L. S.Educational measurement. Brennen R., ed. Westport, CT: American Council on Education; 2006:531-578.
37. Koretz D. M.,Linn R. L.,Dunbar S. B.,Shepard L. A.The effects of high-stakes testing on achievement: Preliminary findings about generalization across tests. Paper presented at the annual meeting of the American Educational Research Association; Chicago, IL.
38. LaddH. F. (2007). Holding schools accountable revisited. Spencer Foundation Lecture in Education Policy and Management. Retrieved from http://www.appam.org/awards/pdf/2007Spencer-Ladd.pdf.
39. Ladd H. F.,Walsh R. P.Economics of Education review. 2002:1-17.
40. Ladd H. F.,Zelli A.School-based accountability in North Carolina: The responses of school principals.Educational Administration Quarterly. 2002;38:494-529.
41. Leithwood K.,Jantzi D.Journal of Educational Administration. 2000:112-129.
42. Linn R. L.Assessments and accountability.Educational Researcher. 2000;29 (2): 4-16.
43. Lipman P.High stakes education: Inequality, globalization, and urban school reform. New York, NY: Routledge; 2004:.
44. Little J. W.American Educational Research Journal. 1982:325-340.
45. Lockwood J. R.,McCaffrey D.Exploring student-teacher interactions in longitudinal achievement data.Education Finance and Policy. 2009;4:439-467.
46. Lockwood J. R.,McCaffrey D. F.,Hamilton L. S.,Stecher B.,Le V. N.,Martinez J. F.Journal of Educational Measurement. 2007:47-67.
47. Loewenstein J.,Thompson L.,Gentner D.Analogical encoding facilitates knowledge transfer in negotiation.Psychonomic Bulletin and Review. 1999;6:586-597.
48. Marks H. M.,Printy S. M.Principal leadership and school performance: An integration of transformational and instructional leadership.Educational Administration Quarterly. 2003;39:370-397.
49. Marzano R.,Waters T.,McNulty B.School leadership that works: From research to results. Alexandria, VA: Association for Supervision and Curriculum Development; 2005:.
50. McCaffrey D.,Koretz D.,Lockwood J. R.,Hamilton L. S.The promise and peril of using value-added modeling to measure teacher effectiveness. Santa Monica, CA: RAND; 2004:.
51. McCaffrey D. F.,Sass T. R.,Lockwood J. R.,Mihaly K.The intertemporal variability of teacher effect estimates.Education Finance and Policy. 2009;4:572-606.
52. McNeil L.,Valenzuela A.The harmful impact of the TAAS system of testing in Texas: Beneath the accountability rhetoric. Cambridge, MA: Harvard Civil Rights Project; 2000:.
53. Meyer R. H.Economics of Education Review. 1997:283-301.
54. Rising above the gathering storm, revisited: Approaching category 5. Washington, DC: National Academies Press; 2010:.
55. Newmann F. M.,Rutter R. A.,Smith M. S.Sociology of Education. 1989:221-238.
56. Novick L. R.Analogical transfer, problem similarity, and expertise.Journal of Experimental Psychology: Learning, Memory, and Cognition. 1988;14:510-520.
57. Orfield G.,Lee C.Racial transformation and the changing nature of segregation. Cambridge, MA: Civil Rights Project, Harvard University; 2006:.
58. Raudenbush S. W.Journal of Educational and Behavioral Statistics. 2004:121-129.
59. RavitchD. (2010, September, 7). A big margin for error. The New York Times. Retrieved from http://www.nytimes.com/roomfordebate/2010/09/06/assessing-a-teachers-value/assessing-teachers-by-student-scores-is-too-error-riden-to-be-effective?scp=1&sq=a%20big%20margin%20of%20error&st=cse.
60. Resnick L. B.Making accountability really count.Educational Measurement: Issues and Practice. 2006;25:33-37.
61. Rothman R.,Slattery J. B.,Vranek J. L.,Resnick L. B.Benchmarking and alignment of standards and testing. Los Angeles: Center for the Study of Evaluation, University of California, Los Angeles; 2002:.
62. RothsteinJ. (2010a, September7). More harm than good. The New York Times. Retrieved from http://www.nytimes.com/roomfordebate/2010/09/06/assessing-a-teachers-value/dont-be-too-quick-to-embrace-value-added-assessments.
63. Rothstein J.Quarterly Journal of Economics. 2010b:175-214.
64. Rothstein R.Class and schools: Using social, economic, and educational reform to close the black-white achievement gap. New York, NY: Teachers College Press; 2004:.
65. Rothstein R.,Jacobsen R.,Wilder T.Grading education: Getting accountability right. New York, NY: Teachers College Press; 2008:.
66. Schmidt H.,Houang R.,McKnight C. C.Value added models in education: Theory and applications. Lissitz R., ed. Maple Grove, MN: JAM Press; 2005:272-297.
67. Schochet P. Z.,Chiang H. S.Error rates in measuring teacher and school performance based on student test score gains. Washington, DC: U.S. Department of Education; 2010:.
68. Stigler J. W.,Hiebert J.The teaching gap: Best ideas from the world's teachers for improving education in the classroom. New York, NY: Free Press; 1999:.
69. Before it's too late: A report to the nation from the National Commission on Mathematics and Science Teaching for the 21st Century. Washington, DC: Author; 2000:.
70. Race to the top fund executive summary: Notice of proposed priorities, requirements, definitions, and selection criteria. Washington, DC: Author; 2009:.
71. U.S. Department of Education. (2010a). The federal role in education. Retrieved from http://www2.ed.gov/about/overview/fed/role.html.
72. Interim report on the evaluation of the growth model pilot project. Washington, DC: Author; 2010b:.
73. WilkinsA. (2010, September7). Valuable feedback. The New York Times. Retrieved from http://www.nytimes.com/roomfordebate/2010/09/06/assessing-a-teachers-value/valuable-feedback-for-teachers.
74. WintersM. (2010, September7). Imperfect but useful. The New York Times. Retrieved September 17, 2010, from http://www.nytimes.com/roomfordebate/2010/09/06/assessing-a-teachers-value/value-added-assessments-are-imperfect-but-useful?scp=1&sq=imperfect%20but%20useful&st=cse.