The stability of observational and student survey measures of teaching effectiveness

American Journal of Education

Volumn 121, Issue 2, 2015, Pages 183-212

  Polikoff, Morgan S ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84921445798     PISSN: 01956744     EISSN: None     Source Type: Journal    
DOI: 10.1086/679390     Document Type: Article

References (48)

1. Aaronson, Daniel, Lisa Barrow, and William Sander. 2007. “Teachers and Student Achievement in the Chicago Public High Schools.” Journal of Labor Economics 25 (1): 95–135.
2. Baker, Bruce D., Joseph O. Oluwole, and Preston C. Green III. 2013. “The Legal Consequences of Mandating High Stakes Decisions Based on Low Quality Information: Teacher Evaluation in the Race-to-the-Top Era.” Education Policy Analysis Archives 21 (5): 1–71.
3. Ballou, Dale. 2005. “Value-Added Assessment: Lessons from Tennessee.” In Value- Added Models in Education: Theory and Application, ed. Robert W. Lissitz. Maple Grove, MN: JAM.
4. Bill and Melinda Gates Foundation. 2010. “Learning about Teaching: Initial Findings from the Measures of Effective Teaching Project.” Bill and Melinda Gates Foundation, Seattle.
5. Bill and Melinda Gates Foundation. 2012. “Gathering Feedback for Teaching: Combining High-Quality Observations with Student Surveys and Achievement Gains.” Bill and Melinda Gates Foundation, Seattle.
6. Brophy, Jere, Cynthia L. Coulter, W. John Crawford, Carolyn M. Evertson, and Carol E. King. 1975. “Classroom Observation Scales: Stability across Time and Context and Relationships with Student Learning Gains.” Journal of Educational Psychology 67 (6): 873–81.
7. Clifford, Richard M. 2005. “Structure and Stability of the Early Childhood Environment Rating Scale.” In Questions of Quality, ed. Heino Schonfeld, Sharon O’Brien, and Thomas Walsh. Dublin: Centre for Early Childhood Development and Education.
8. Danielson, Charlotte. 2007. Enhancing Professional Practice: A Framework for Teaching. Alexandria, VA: Association for Supervision and Curriculum Development.
9. Darling-Hammond, Linda. 2013. Getting Teacher Evaluation Right: What Really Matters for Effectiveness and Improvement. New York: Teachers College Press.
10. Darling-Hammond, Linda, Audrey Amrein-Beardsley, Edward Haertel, and Jesse Rothstein. 2012. “Evaluating Teacher Evaluation.” Phi Delta Kappan 93 (6): 8–15.
11. Economic Policy Institute. 2010. “Problems with the Use of Student Test Scores to Evaluate Teachers.” Economic Policy Institute, Washington, DC.
12. Ferguson, Ronald. F. 2008. The Tripod Project Framework. Cambridge, MA: Harvard University.
13. Ferguson, Ronald F., and Charlotte Danielson. 2014. “How Framework for Teaching and Tripod 7Cs Evidence Distinguish Key Components of Effective Teaching.” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
14. Follman, John. 1995. “Elementary Public School Pupil Rating of Teacher Effectiveness.” Child Study Journal 25 (1): 57–78.
15. Gill, Brian, Julie Bruch, and Kevin Booker. 2013. “Using Alternative Student Growth Measures for Evaluating Teacher Performance: What the Literature Says.” National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Mid-Atlantic, Institute of Education Sciences, US Department of Education, Washington, DC.
16. Goldhaber, Dan, and Michael Hansen. 2013. “Is It Just a Bad Class? Assessing the Long-Term Stability of Estimated Teacher Performance.” Economica 80 (319): 589–612.
17. Grossman, Pam, Julie Cohen, and Lindsay Brown. 2014. “Understanding Instructional Quality in English Language Arts: Variations in PLATO Scores by Content and Context.” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
18. Grossman, Pam, Susanna Loeb, Julie Cohen, and James Wyckoff. 2013. “Measure for Measure: The Relationship between Measures of Instructional Practice in Middle School English Language Arts and Teachers’ Value-Added Scores.” American Journal of Education 119 (3): 445–70.
19. Guarino, Cassandra M., Mark D. Reckase, and Jeffrey M. Wooldridge. 2011. “Can Value-Added Measures of Teacher Performance Be Trusted?” Working Paper 18, Education Policy Center, Michigan State University, East Lansing.
20. Hanushek, Eric A. 2011. “Valuing Teachers.” Education Next 11 (3): 41–45.
21. Hiebert, James, and Anne K. Morris. 2012. “Teaching, Rather than Teachers, as a Path toward Improving Classroom Instruction.” Journal of Teacher Education 63 (2): 92–102.
22. Hill, Heather C., Merrie L. Blunk, Charalambos Y. Charalambous, Jennifer M. Lewis, Geoffrey C. Phelps, Laurie Sleep, and Deborah Loewenberg Ball. 2008. “Mathematical Knowledge for Teaching and the Mathematical Quality of Instruction: An Exploratory Study.” Cognition and Instruction 26 (4): 430–511.
23. Hill, Heather C., Charalambos Y. Charalambous, and Matthew A. Kraft. 2012. “When Rater Reliability is Not Enough: Teacher Observation Systems and a Case for the Generalizability Study.” Educational Researcher 41 (2): 56–64.
24. Ho, Andrew D., and Thomas J. Kane. 2013. “The Reliability of Classroom Observations by School Personnel.” Bill and Melinda Gates Foundation, Seattle.
25. Joe, Jillian M., Catherine A. McClellan, and Steven L. Holtzman. 2014. “Scoring Design Decisions: Reliability and the Length and Focus of Classroom Observations.” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
26. Koedel, Cory, and Julian R. Betts. 2007. “Re-examining the Role of Teacher Quality in the Educational Production Function.” Working Paper 0708, Department of Economics, University of Missouri, Columbia.
27. Lohman, David F., and Katrina A. Korb. 2006. “Gifted Today but Not Tomorrow? Longitudinal Changes in Ability and Achievement during Elementary School.” Journal for the Education of the Gifted 29 (4): 451–84.
28. Marsh, Herbert W. 2007. “Do University Teachers Become More Effective with Experience? A Multilevel Growth Model of Students’ Evaluations of Teaching across 13 Years.” Journal of Educational Psychology 99 (4): 775–90.
29. Marsh, Herbert W., and Dennis Hocevar. 1991. “Students’ Evaluation of Teaching Effectiveness: The Stability of Mean Ratings of the Same Teachers over a 13-Year Period.” Teaching and Teacher Education 7 (4): 303–14.
30. McCaffrey, Daniel F., Tim R. Sass, J. R. Lockwood, and Kata Mihaly. 2009. “The Intertemporal Variability of Teacher Effect Estimates.” Education Finance and Policy 4 (4): 572–606.
31. Mihaly, Kata, Daniel F. McCaffrey, Douglas O. Staiger, and J. R. Lockwood. 2013. “A Composite Estimator of Effective Teaching.” Bill and Melinda Gates Foundation, Seattle.
32. National Research Council. 2009. “Letter Report to the U.S. Department of Education on the Race to the Top Fund.” National Academies Press, Washington, DC.
33. National Research Council. 2010. “Getting Value Out of Value-Added: Report of a Workshop.” National Academies Press, Washington, DC.
34. Paternoster, Raymond, Robert Brame, Paul Mazerolle, and Alex Piquero. 1998. “Using the Correct Statistical Test for the Equality of Regression Coefficients.” Criminology 36 (4): 859–66.
35. Peterson, Kenneth D., Christine Wahlquist, and Kathie Bone. 2000. “Student Surveys for School Teacher Evaluation.” Journal of Personnel Evaluation in Education 14 (2): 135–53.
36. Pianta, Robert C. 2003. “Standardized Observations from Pre-K to 3rd Grade: A Mechanism for Improving Access to High Quality Classroom Experiences and Practices during the P–3 Years.” Unnumbered working paper, Foundation for Child Development, New York, http://fcd-us.org/resources/standardized-classroom-observations-pre-k-third-grade-mechanism-improving-quality-classroo
37. Pianta, Robert C., Karen M. La Paro, and Bridget K. Hamre. 2008. Classroom Assessment Scoring System. Baltimore: Paul H. Brookes.
38. Polikoff, Morgan S. 2014. “Does the Test Matter? Evaluating Teachers When Tests Differ in Their Sensitivity to Instruction.” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
39. Raudenbush, Stephen W., and Marshall Jean. 2014. “To What Extent Do Student Perceptions of Classroom Quality Predict Teacher Value Added?” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
40. Rogosa, David, Robert Floden, and John B. Willett. 1984. “Assessing the Stability of Teacher Behavior.” Journal of Educational Psychology 76 (8): 1000–1027.
41. Rothstein, Jesse. 2009. “Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables.” Education Finance and Policy 4 (4): 537–71.
42. Rothstein, Jesse. 2010. “Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement.” Quarterly Journal of Economics 125 (1): 175–214.
43. Ruzek, Erik A., Christopher A. Hafen, Bridget K. Hamre, and Robert C. Pianta. 2014. “Combining Classroom Observations and Value Added for the Evaluation and Professional Development of Teachers.” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
44. Schochet, Peter Z., and Hanley S. Chiang. 2010. “Error Rates in Measuring Teacher and School Performance Based on Student Test Score Gains.” Publication NCEE 1-4004, National Center for Education Evaluation and Regional Assistance, Institute for Education Sciences, US Department of Education, Washington, DC.
45. Schultz, Susan R., and Raymond L. Pecheone. 2014. “Assessing Quality Teaching in Science.” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
46. Smolkowski, Keith, and Barbara Gunn. 2012. “Reliability and Validity of the Classroom Observations of Student–Teacher Interactions (COSTI) for Kindergarten Reading Instruction.” Early Childhood Research Quarterly 27 (2): 316–28.
47. Staiger, Douglas O., and Thomas J. Kane. 2014. “Making Decisions with Imprecise Performance Measures: The Relationship between Annual Student Achievement Gains and a Teacher’s Career Value Added.” In Designing Teacher Evaluation Systems: New Guidance from the Measures of Effective Teaching Project, ed. Thomas J. Kane, Kerri A. Kerr, and Robert C. Pianta. San Francisco: Jossey-Bass.
48. Whitehurst, Grover J., Matthew M. Chingos, and Katherine M. Lindquist. 2014. “Evaluating Teachers with Classroom Observations: Lessons Learned in Four Districts.” Report published by the Brown Center on Education Policy at the Brookings Institute, Washington, DC.