Exploring the intended and unintended consequences of high-stakes teacher evaluation on schools, teachers, and students

Teachers College Record

Volumn 116, Issue 1, 2014, Pages

  Lavigne, Alyson Leah ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84893166281     PISSN: 01614681     EISSN: 14679620     Source Type: Journal    
DOI: None     Document Type: Article

References (113)

1. Abel, M. H., & Sewell, J. (1999). Stress and burnout in rural and urban secondary school teachers. The Journal of Educational Research, 92, 287-293.
2. Alliance for Excellent Education. (2004). Tapping the potential: Retaining and developing high-quality new teachers. Washington, DC: Alliance for Excellent Education.
3. Amrein, A. L., & Berliner, D. C. (2002). High-stakes testing, uncertainty, and student learning. Education Policy Analysis Archives, 10(18). Retrieved from http://epaa.asu.edu/epaa/v10n18/
4. Amrein-Beardsley, A., & Collins, C. (2012). The SAS Education Value-Added Assessment System (SAS® EVAAS®) in the Houston Independent School District (HISD): Intended and unintended consequences. Education Policy Analysis Archives, 20(12). Retrieved from http://epaa.asu.edu/ojs/article/view/1096
5. Banchero, S., Maher, K., Lee, C. E., & Yadron, D. (2012, September 11). Chicago teachers go on strike. Wall Street Journal (Eastern ed.), pp. A1-A2.
6. Banchero, S., Porter, C., & Belkin, D. (2012, September 19). Union vote ends strike by teachers in Chicago. Wall Street Journal (Eastern ed.), pp. A1-A2.
7. Berliner, D. (2013). Exogenous variables and value-added assessments: A fatal flaw. Teachers College Record.
8. Betoret, F. D. (2006). Stressors, self-efficacy, coping resources, and burnout among secondary school teachers in Spain. Educational Psychology, 26, 519-539.
9. Bill & Melinda Gates Foundation. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle, WA: Author. Retrieved from www.metproject.org/downloads/MET_Gathering_Feedback_Research_Paper.pdf
10. Bossidy, L., & Charan, R. (2002). Execution: The discipline of getting things done. New York, NY: Random House.
11. Boyd, D., Grossman, P., Lankford, H., Loeb, S., & Wyckoff, J. (2008). Teacher attrition and student achievement. NBER Working Paper 14022. Retrieved from http://www.nber.org/papers/w14022
12. Boyd, D., Lankford, H., Loeb, S., Ronfeldt, M., & Wyckoff, J. (2011). The role of teacher quality in retention and hiring: Using applications-to-transfer to uncover preferences of teachers and schools. Journal of Policy and Management, 30(1), 88-110
13. Boyle, M. (2001, May 28). Performance reviews: Perilous curves ahead. Fortune, 143, 187.
14. Breaugh, J. A., & Starke, M. (2000). Research on employee recruitment: So many studies, so many remaining questions. Journal of Management, 26, 405-434. doi:10.1177/014920630002600303.
15. Bretz, R. D. J., Milkovich, G. T., & Read, W. (1992). The current state of performance appraisal research and practice: Concerns, directions, and implications. Journal of Management, 18, 321-352.
16. Cable, D., & Judge, T. A. (1996). Person-organization fit, job choice decisions, and organizational entry. Organizational Behavior and Human Decision Processes, 67, 294-311.
17. Callahan, R. E. (1962). Education and the cult of efficiency: A study of the social forces that have shaped the administration of the public schools. Chicago, IL: The University of Chicago Press.
18. Campbell, D. T. (1976). Assessing the impact of social change (Technical report). Hanover, NH: Dartmouth College.
19. Chetty, R., Friedman, J. N., & Rockoff, J. E. (2011). The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood (NBER Working Paper No. 17669). Cambridge, MA: National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/w17699
20. Clark K. (2003, January 13). Judgment day. U.S. News and World Report, 134, 31-32.
21. Cloudt, C., & Stevens, N. (1995). Texas teacher retention, mobility, and attrition (Policy Research Report). Austin, TX: Texas Education Agency.
22. Cohen, S., Rothbart, M., & Phillips, S. (1976). Locus of control and the generality of learned helplessness in humans. Journal of Personality and Social Psychology, 34(6), 1049-1056. doi:10.1037/0022-3514.34.6.1049
23. Collins, C., & Amrein-Beardsley, A. (2013). Putting growth and value-added models on the map: A national overview. Teachers College Record.
24. Crothers, L. M., Kanyongo, G. Y., Kolbert, J. B., Lipinski, J., Kachmar, S. P., & Koch, G. (2011). Job stress and locus of control in teachers: Comparisons between samples from the USA and Zimbabwe. International Review of Education, 56, 651-669.
25. Davey, M. (2012, September 10). Teachers' strike in Chicago tests mayor and union. New York Times. Retrieved from http://www.nytimes.com/2012/09/11/education/teacher-strike-begins-in-chicago-amid-signs-that-deal-isnt-close.html?pagewanted=all&_r=0
26. Darling-Hammond, L. (1999). Teacher quality and student achievement: A review of state policy evidence. Seattle, WA: University of Washington, Center for the Study of Teaching and Policy.
27. Darling-Hammond, L., Amrein-Beardsley, A., Haertel, E., & Rothstein, J. (2012). Evaluating teacher evaluation. Phi Delta Kappan, 93(6), 8-15.
28. Darling-Hammond, L. & Haertel, E. (2012, November 5). A better way to grade teachers. Los Angeles Times. Retrieved from http://articles.latimes.com/2012/nov/05/opinion/la-oe-darling-teacher-evaluations-20121105
29. Dillion, S. (2010, December 7). Top test scores from Shanghai stun educators. New York Times. Retrieved from http://www.nytimes.com/2010/12/07/education/07education.html?pagewanted=all
30. District of Columbia Public Schools. (2011a). An overview of IMPACT [Web page]. Retrieved from http://www.dc.gov/DCPS/In+the+Classroom+Ensuring+Teacher+Success/IMPACT+(Performance+Assessment)/An+Overview+of+IMPACT
31. District of Columbia Public Schools. (2011b). IMPACTplus [Web page]. Retrieved from http://www.dc.gov/DCPS/In+the+Classroom/Ensuring+Teacher+Success/IMPACT+%28Performance+Assessment%29/IMPACTplus
32. District of Columbia Public Schools. (2011c). DCPS continues to strengthen workforce [Web page]. Retrieved from http://dc.gov/DCPS/About+DCPS/Press+Releases+and+Announcements/Press+Releases/DCPS+Continues+to+Strengthen+Workforce
33. District of Columbia Public Schools. (2012a). General education teachers with individual value-added student achievement data. Washington, DC: Author. Retrieved from http://www.dc.gov/DCPS/Files/downloads/In-the-Classroom/IMPACT%20Guidebooks/IMPACT-2012-Grp1%20Aug27.pdf
34. District of Columbia Public Schools. (2012b). IMPACT guidebooks 2012-2013. Retrieved from http://www.dc.gov/DCPS/Files/downloads/In-the-Classroom/IMPACT%20Guidebooks/IMPACT-2012-Grp2%20Aug27.pdf
35. District of Columbia Public Schools. (2012c). General education teachers without individual value-added student achievement data. Washington, DC: Author. Retrieved from http://www.dc.gov/DCPS/Files/downloads/In-the-Classroom/IMPACT%20Guidebooks/IMPACT-2012-Grp2 Aug27.pdf
36. Fang, Z. (1996). A review of teacher beliefs and practices. Educational Research, 38, 47-65.
37. Folger, R., & Konovsky, M. A. (1989). Effects of procedural and distributive justice on reactions to pay raise decisions. Academy of Management Journal, 32, 115-130. doi:10.2307/256422.
38. Folts, J. D. (1996). History of the University of the State of New York and the state education department, 1784-1996. Albany, NY: Author.
39. Foster, K. (2012, April 12). Report warns US educational failures pose national security threat. FoxNews.com. Retrieved from http://www.foxnews.com/us/2012/04/12/report-warns-us-educational-failures-pose-national-security-threat/
40. Goldhaber, D., Gross, B., & Player, D. (2007). Are public schools really losing their "best"? Assessing the career transitions of teachers and their implication for the quality of the teacher workforce (Working Paper 12). Washington, DC: Center for Analysis of Longitudinal Data in Education Research, Urban Institute.
41. Good, T. (2013). What do we know about how teachers influence student performance on standardized tests, and why do we know so little about other outcomes. Teachers College Record.
42. Good, T. L., Biddle, B. J., & Brophy, J. E. (1975). Teachers make a difference. New York, NY: Holt, Rinehart & Winston.
43. Grote, D. (2005). Forced ranking: Making performance management work. Boston, MA: Harvard Business School Press.
44. Guin, K. (2004). Chronic teacher turnover in urban elementary schools. Education Policy Analysis Archives, 12(42),. Retrieved from http://epaa.asu.edu/epaa/v12v42/
45. Hall, P. M. (1983). A social construction of reality. The Elementary School Journal, 84(2), 142-148.
46. Hanushek, E. A., Kain, J. F., O'Brien, D. M., & Rivkin, S. G. (2005, February). The market for teacher quality (Working Paper 11154). Cambridge, MA: National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/w11154
47. Hanushek, E. A., & Rivkin, S. G. (2010). Constrained job matching: Does teacher job search harm disadvantaged urban schools? (Working Paper 15816). Cambridge, MA: National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/w15816
48. Harris, D. N. (2011). Value-added measures in education: What every educator needs to know. Cambridge, MA: Harvard Education Press.
49. Herlihy, C., Karger, E., Pollard, C., Hill, H. C., Kraft, M. A., Williams, M., & Howard, S. (2013). State and local efforts to investigate the validity and reliability of scores form teacher evaluation systems. Teachers College Record.
50. Huston, J. (1989). Teacher burnout and effectiveness: A case study. Education, 110, 70-78.
51. Ingersoll, R. (2001). Teacher turnover and teacher shortages: An organizational analysis. American Educational Research Journal, 38(3), 499-534.
52. Ingersoll, R. M. (2003). Is there really a teacher shortage? Seattle, WA: University of Washington, Center for the Study of Teaching and Policy.
53. Ingersoll, R., Merrill, L., & Consortium for Policy Research in Education. (2012). Seven trends: The transformation of the teaching force. Paper presented at the annual meeting of the American Educational Research Association, Vancouver, Canada.
54. Ingersoll, R., & Perda, D. (2012). How high is teacher turnover and is it a problem? Philadelphia, PA: Consortium for Policy Research in Education, University of Pennsylvania.
55. Jenkins, H. W. (2001, July 18). How to execute 10%, nicely. Wall Street Journal, p. A19.
56. Johnson, S., Berg, J., & Donaldson, M. (2005). Who stays in teaching and why: A review of the literature on teacher retention. The Project on the Next Generation of Teachers. Cambridge, MA: Harvard Graduate School of Education.
57. Jones, M. G., Jones, B. D., & Hargrove, T. (2003). The unintended consequences of high-stakes testing. Lanham, MD: Rowman & Littlefield.
58. Judge, T. A., & Bretz, R. D. (1992). Effects of work values on job choice decisions. The Journal of Applied Psychology, 77, 261-271. doi:10.1037/0021-9010.77.3.261
59. Kenny, D. (2012, October 14). Want to ruin teaching? Give ratings [Editorial]. The New York Times: The Opinion Pages. Retrieved from http://www.nytimes.com/2012/10/15/opinion/want-to-ruin-teaching-give-ratings.html?_r=1&
60. Kersting, N. B., Chen, M., & Stigler, J. W. (2012). Value-added teacher estimates as part of teacher evaluations: Exploring the effects of data and model specifications on the stability of teacher value-added scores. Educational Policy Analysis Archives, 21(7). Retrieved from http://epaa.asu.edu/ojs/article/view/1167
61. Kokkinos, C. M. (2007). Job stressors, personality and burnout in primary school teachers. British Journal of Educational Psychology, 77, 229-243.
62. Kyriacou, C. (2001). Teacher stress: Directions for future research. Educational Review, 53, 27-35.
63. Kwoh, L. (2012, January 31). 'Rank and yank' retains vocal fans. The Wall Street Journal. Retrieved from http://online.wsj.com/article/SB10001424052970203363504577186970064375222.html?ru=yahoo&mod=yahoo_hs
64. Lavigne, A. L., & Good, T. L. (2013). Teacher and student evaluation: Moving beyond the failure of school reform. New York, NY: Routledge.
65. Lockwood, J. R., McCaffrey, D. F., Hamilton, L. S., Stecher, B., Le, V., & Martinez, J. F. (2007). The sensitivity of value-added teacher effect estimates to different mathematics achievement measures. Journal of Educational Measurement, 44(1), 47-67.
66. Lopez, R. (2010, September 15). Union stages protest against Times. Los Angeles Times. Retrieved from http://www.latimes.com/news/local/teachers-investigation/la-me-teachers-union-protest,0,4982349.story
67. Lunenberg, F., & Cadavid, V. (1992). Locus of control, pupil control ideology, and dimensions of teacher burnout. Journal of Instructional Psychology, 19, 13-22.
68. McBriarty, M. A. (1988). Performance appraisal: Some unintended consequences. Public Personnel Management, 17, 421-434.
69. McCaffrey, D. F., Lockwood, J. R., Koretz, D., Louis, T. A., & Hamilton, L. (2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29(1), 67-101.
70. Meisler, A. (2003). Dead man's curve. Workforce, 82, 44-49.
71. MetLife, Inc. (2012). The MetLife Survey of the American Teacher: Teachers, parents, and the economy. New York, NY: Author. Retrieved from https://www.metlife.com/assets/cao/contributions/foundation/american-teacher/MetLifeTeacher-Survey-2011.pdf
72. Murnane, R. J. (1984). Selection and survival in the teacher labor market. The Review of Economics and Statistics, 66(3), 513-518.
73. Murphy, K. R., & Cleveland, J. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: Sage.
74. National Council on Teacher Quality. (2011). State of the states: Trends and early lessons on teacher evaluation and effectiveness policies. Washington, DC: Author. Retrieved from http://www.nctq.org/p/publications/docs/nctq_stateOfTheStates.pdf
75. National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. Washington, DC: U.S. Department of Education.
76. National Commission on Teaching and America's Future (NCTAF). (2007). The high cost of teacher turnover. Washington, DC: Author.
77. Nichols, S. & Berliner, D. C. (2007) Collateral damage: How high-stakes testing corrupts America's schools. Cambridge, MA: Harvard Education Press.
78. Orfield, G., & Kornhaber, M. L. Eds.. (2001). Raising standards or raising barriers? Inequality and high-stakes testing in public education. New York, NY: The Century Foundation Press.
79. Patten, S. (1911). An economic measure of school efficiency. Educational Review, 41, 467-469.
80. Payne, C. M. (2008). So much reform, so little change: The persistence of failure in urban schools. Boston, MA: Harvard Education Press.
81. Pigge, F. L., & Marso, R. N. (1997). A seven year longitudinal multi-factor assessment of teaching concerns development through preparation and early years of teaching. Teaching and Teacher Education, 13(2), 225-235. doi:10.1016/S0742-051X(96)00014-5
82. Pfeffer, J., & Sutton, R. I. (2006). Evidence-based management. Harvard Business Review, 84, 62-74.
83. Ravitch, D. (2010). The death and life of the great American school system: How testing and choice are undermining education. New York, NY: Basic Books.
84. Rice, J. M. (1893). The public-school system of the United States. New York, NY: The Century Co.
85. Rice, J. M. (1913). Scientific management in education. New York, NY: Hinds, Noble, & Eldredge.
86. Roch, S. G., Sternburgh, A. M., & Caputo, P. M. (2007). Absolute vs. relative performance rating formats: Implications for fairness and organizational justice. International Journal of Selection and Assessment, 15, 302-316. doi:10.1111/j.1468-2389.2007.00390.x.
87. Ronfeldt, M., Lankford, H., Loeb, S., & Wyckoff, J. (2011, June). How teacher turnover harms student achievement (Working Paper 17176). Cambridge, MA: National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/w17176
88. Rynes, S., Gerhart, B., & Parks, L. (2005). Personnel psychology: Performance evaluation and pay for performance. Annual Review of Psychology, 56, 571-600.
89. Sadowski, C., & Blackwell, M. (1985). Locus of control and perceived stress among student-teachers. Psychological Reports, 56, 723-726.
90. Sadowski, C., & Blackwell, M. (1987). The relationship of locus of control to anxiety among student teachers. College Student Journal, 21, 187-189.
91. Sanders, W. L., & Horn, S. (1998). Research findings from the Tennessee Value-Added Assessment System (TVAAS) database: Implications for educational evaluation and research. Journal of Personnel Evaluation in Education, 12(3), 247-256.
92. Sawchuk, S. (2013, February 5). Teachers' ratings still high despite new measures. Education Week. Advance online publication. Retrieved from http://www.edweek.org/ew/articles/2013/02/06/20evaluate_ep.h32.html?tkn=ZSTF0t1L9D3DuLKhRwCfNuY2HyYg2z2zSJUw&cmp=ENL-EU-NEWS1
93. Schwarzer, R., & Hallum, S. (2008). Perceived teacher self-efficacy as a predictor of job stress and burnout: Mediation analysis. Applied Psychology: An International Review, 57, 152-171.
94. Scullen, S. E., Bergey, P. K., & Aiman-Smith, L. (2005). Forced distribution rating systems and the improvement of workforce potential: A baseline simulation. Personnel Psychology 58, 1-32.
95. Shen, J. (1991). Teacher retention and attrition in public schools: Evidence from SASS91. The Journal of Educational Research, 91(2), 81-89.
96. Skaalvik, E. M., & Skaalvik, S. (2007). Dimensions of teacher self-efficacy and relations with strain factors, perceived collective teacher efficacy, and teacher burnout. Journal of Educational Psychology, 99, 611-625.
97. Stossel. J. (2006, January 13). John Stossel's 'stupid in America' [Online article]. Retrieved from http://abcnews.go.com/2020/Stossel/story?id=1500338#.UHYATERqpMo
98. Strauss, V. (2012, April 20). Education reform protests pick up stream [Web log post]. The Washington Post. Retrieved from http://www.washingtonpost.com/blogs/answer-sheet/post/education-reform-protests-pick-up-steam/2012/04/19/gIQA8KiXUT_blog.html
99. Tennessee Department of Education. (n.d.a). Calculating the effectiveness rating. Retrieved from http://team-tn.org/assets/educator-resources/Calculating_the_Effectiveness_Rating.pdf
100. Tennessee Department of Education. (n.d.b). Tenure Q & A [Web page]. Retrieved from http://team-tn.org/assets/educator-resources/Tenure_QandA.pdf
101. Tennessee Department of Education. (2012a). Teacher evaluation in Tennessee: A report on Year 1 implementation. Nashville, TN: Author. Retrieved from http://team-tn.org/assets/misc/Year 1 Evaluation Report TNDOE.pdf
102. Tennessee Department of Education. (2012b). Acceptable range of results. Nashville, TN: Author. Retrieved from http://www.team-tn.org/assets/misc/E-Acceptable Range_FINAL.pdf
103. Tennessee Department of Education. (2012c). Number of observations. Nashville, TN: Author. Retrieved from http://team-tn.org/assets/misc/A%20-%20Number%20of%20Observations_12_13_updated.pdf
104. Theobald, N., & Michael, R. (2001). Teacher turnover in the Midwest: Who stays, leaves, and moves? Policy Issues. Naperville, IL: North Central Regional Educational Lab.
105. The New Teacher Project. (2012). The irreplaceables: Understanding the real retention crisis in urban schools. Washington, DC: Author.
106. Tichy, N. M., & Sherman, S. (2001). Control your destiny or someone else will: Lessons in mastering change-from the principles Jack Welch is using to revolutionize GE. New York, NY: HarperCollins.
107. U.S. Department of Education. (2010). Race to the Top: Phase 2 application guidelines [Web page]. Retrieved from http://www2.ed.gov/programs/racetothetop/applicant.html
108. U.S. Department of Education. (2012). Race to the Top Fund [Web page]. Retrieved from http://www2.ed.gov/programs/racetothetop/index.html
109. Valenzuela, A. (Ed.). (2005). Leaving children behind: How "Texas-style" accountability fails Latino youth. Albany, NY: State University of New York Press.
110. Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557-574.
111. Watt, H. M. G., & Richardson, P. W. (2008). Motivations, perceptions, and aspirations concerning teaching as a career for different types of beginning teachers. Learning and Instruction, 18, 408-428.
112. Weiner, B. (1985). An attributional theory of achievement motivation and emotion. Psychological Review, 92, 548-573.
113. Welch, J. (2001). Jack: Straight from the gut. New York: Warner Business Books.