Sorting out the signal: Do multiple measures of teachers’ effectiveness provide consistent information to teachers and principals?;Entendiendo las señales: ¿Son relevantes los sistemas de múltiples medidas de efectividad docente para brindar información coherente a docentes y directores?

Education Policy Analysis Archives

Volumn 22, Issue , 2014, Pages 1-42

  Strunk, Katharine O ^a   Weinstein, Tracey L ^b   Makkonen, Reino ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b NONE

Author keywords

Measuring teacher practice; Teacher effectiveness; Teacher evaluation; Teacher quality; Value added

Indexed keywords

EID: 84912083404     PISSN: None     EISSN: 10682341     Source Type: Journal    
DOI: 10.14507/epaa.v22.1590     Document Type: Article

References (41)

1. Aaronson, D., Barrow, L., & Sander, W. (2007). Teachers and Student Achievement in the Chicago Public High Schools. Journal of Labor Economics, 25(1), 95-135. http://dx.doi.org/10.1086/508733
2. Anderson, J. (2012, February 20). States try to fix quirks in teacher evaluations. New York Times, p. A1.
3. Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17(2-3), 62-87. http://dx.doi.org/10.1080/10627197.2012.715014
4. Brandt, C., Mathers, C., Oliva, M., Brown-Simms, M., & Hess, J. (2007). Examining district guidance to schools on teacher evaluation policies in the Midwest Region (Issues and Answers Report, REL 2007 –No. 030). Washington DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, REL Midwest.
5. Chetty, R., Friedman, J. N., & Rockoff, J. E. (2011). The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood. Cambridge, MA: National Bureau of Economic Research Working Paper No. 17699.
6. Corcoran, S. (2010). Can teachers be evaluated by their students’ test scores? Should they be? (Report for the Education Policy for Action Series). Providence, RI: Annenberg Institute for School Reform at Brown University.
7. Donaldson, M. L. (2009). So long, Lake Wobegon? Using teacher evaluation to raise teacher quality. Center for American Progress.
8. Fleisher, L. (2012, September 10). Teacher grading off to uneven start. Wall Street Journal, p. A21.
9. Goldhaber, D., Brewer, D. & Anderson, D. (1999). A three-way error components analysis of educational productivity. Education Economics, 7, 199-208. http://dx.doi.org/10.1080/09645299900000018
10. Grossman, P., Loeb, S., Cohen, J., & Wyckoff, J. (2013). Measure for measure: The relationship between measures of instructional practice in middle school English language arts and teachers’ value-added. American Journal of Education, 119(3), 445-470. http://dx.doi.org/10.1086/669901
11. Heneman, H. G. III, & Milanowski, A. T. (2003). Continuing assessment of teacher reactions to a standards-based teacher evaluation system. Journal of Personnel Evaluation in Education, 17(2), 171-195.
12. Hill, H. C., Kapitula, L., & Umland, K. (2011). A validity argument approach to evaluating teacher value-added scores. American Educational Research Journal, 48(3), 794–831. http://dx.doi.org/10.3102/0002831210387916
13. Hill, H. C., Umland, K. U., Litke, E., & Kapitula, L. (2012). Teacher quality and quality teaching: Examining the relationship of a teacher assessment to practice. American Journal of Education, 118(4), 489-519. http://dx.doi.org/10.1086/666380
14. Ho, A. D., & Kane, T. J. (2013). The reliability of classroom observations by school personnel (research paper). Measures of Effective Teaching (MET) project, Bill and Melinda Gates Foundation.
15. Holtzapple, E. (2003). Criterion-related validity evidence for a standards-based teacher evaluation system. Journal of Personnel Evaluation in Education, 17(3), 207-219. http://dx.doi.org/10.1007/s11092-005-2980-z
16. Jerald, C. (2012). Movin’ it and improvin’ it! Using both education strategies to increase teaching effectiveness. Washington, DC: Center for American Progress.
17. Kane, T. J., McCaffrey, D. F., Miller, T., & Staiger, D. O. (2013). Have we identified effective teachers? Validating measures of effective teaching using random assignment (research paper). Measures of Effective Teaching (MET) project, Bill and Melinda Gates Foundation.
18. Kane, T. J. & Staiger, D. O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains (research paper). Measures of Effective Teaching (MET) project, Bill and Melinda Gates Foundation.
19. Kane, T. J., Taylor, E. S., Tyler, J. H., & Wooten, A. L. (2011). Identifying effective classroom practices using student achievement data. Journal of Human Resources, 46(3), 587-613. http://dx.doi.org/10.1353/jhr.2011.0010
20. Kauchak, D., Peterson, K., & Driscoll, A. (1985). An interview study of teachers' attitudes toward teacher evaluation practices. Journal of Research and Development in Education, 19, 32-37.
21. Koedel, C., & Betts, J. (2007). Re-Examining the Role of Teacher Quality in the Educational Production Function. Working Paper, University of Missouri.
22. McCaffrey, D. F., Sass, T. R., Lockwood, J. R., & Mihaly, K. (2009). The intertemporal variability of teacher effect estimates. Education Finance and Policy, 4(4), 572–606. http://dx.doi.org/10.1162/edfp.2009.4.4.572
23. Mihaly, K., McCaffrey, D. F., Staiger, D. O., & Lockwood, J. R. (2013). A composite estimator of effective teaching (research paper). Measures of Effective Teaching (MET) project, Bill and Melinda Gates Foundation.
24. Milanowski, A. (2004a). The relationship between teacher performance evaluation scores and student achievement: Evidence from Cincinnati. Peabody Journal of Education, 79(4), 33–53. http://dx.doi.org/10.1207/s15327930pje7904_3
25. Milanowski, A. (2004b). Relationships among dimension scores of standards-based teacher evaluation systems, and the stability of evaluation score-student achievement relationships over time. Consortium for Policy Research in Education, University of Wisconsin Working Paper Series TC-04–02.
26. Newton, X. A., Darling-Hammond, L., Haertel, E., & Thomas, E. (2010). Value-added modeling of teacher effectiveness: An exploration of stability across models and contexts. Educational Policy Analysis Archives, 18(23).
27. Odden, A. (2004). Lessons Learned About Standards-Based Teacher Evaluation Systems. Peabody Journal of Education, 79(4), 126-137. http://dx.doi.org/10.1207/s15327930pje7904_7
28. Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73(2), 417-458. http://dx.doi.org/10.1111/j.1468-0262.2005.00584.x
29. Rockoff, J. E. (2004). The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review, 94(2), 247-252. http://dx.doi.org/10.1257/0002828041302244
30. Rockoff, J. E., & Speroni, C. (2011). Subjective and objective evaluations of teacher effectiveness: Evidence from New York City. Labour Economics, 18(5), 687–696. http://dx.doi.org/10.1016/j.labeco.2011.02.004
31. Rothstein, J. (2010). Teacher quality in educational production: Tracking, decay and student achievement. Quarterly Journal of Economics, 25(1), 175–214. http://dx.doi.org/10.1162/qjec.2010.125.1.175
32. Rowan, B., Schilling, S. G., Spain, A., Bhandari, P., Berger, D., & Graves, J. (2013). Promoting high quality teacher evaluations in Michigan: Lessons from a pilot of educator effectiveness tools. Institute for Social Research, University of Michigan.
33. Sartain, L., Stoelinga, S. R., & Brown, E. R. (2011). Rethinking teacher evaluation in Chicago: Lessons learned from classroom observations, principal-teacher conferences, and district implementation. Consortium on Chicago School Research.
34. Sawchuk, S. (2013). Teachers’ ratings still high despite new measures: Changes to evaluation systems yield only subtle differences. Education Week, 32(20), 1,18-19.
35. Strunk, K. O., Weinstein, T., & Makkonen, R. (2013). Understanding the Implementation of a Standards-Based Multiple Measure Teacher Evaluation Reform. Paper presented at March 2013 Association for Education Finance and Policy annual conference.
36. Taylor, E. S. & Tyler, J. H. (2012). The effect of evaluation on teacher performance. American Economic Review 102(7), 3628-3651. http://dx.doi.org/10.1257/aer.102.7.3628
37. Tennessee Department of Education. (TDOE 2012). Teacher evaluation in Tennessee: A report on year 1 implementation. Nashville, TN: Author.
38. The New Teacher Project (TNTP). (2009). Teacher hiring, transfer, and evaluation in Los Angeles Unified School District. Final Report.
39. Tyler, J. H., Taylor, E. S., Kane, T. J., & Wooten, A. L. (2010). Using Student Performance Data to Identify Effective Classroom Practices. American Economic Review: Papers & Proceedings, 100(2), 256-260. http://dx.doi.org/10.1257/aer.100.2.256
40. Value-Added Research Center (VARC). (2011). Academic Growth over Time: Technical report on the LAUSD teacher-level model academic year 2010-2011. Los Angeles, CA: Los Angeles Unified School District.
41. Weisberg, D., Sexton, S., Mulhern, J., & Keeling, D. (2009). The Widget Effect: Our National Failure to Acknowledge and Act on Differences in Teacher Effectiveness. The New Teacher Project.