The Test Matters: The Relationship Between Classroom Observation Scores and Teacher Value Added on Multiple Types of Assessment

Educational Researcher

Volumn 43, Issue 6, 2014, Pages 293-303

  Grossman, Pam ^a   Cohen, Julie ^b   Ronfeldt, Matthew ^c   Brown, Lindsay ^a  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF VIRGINIA   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

econometric analysis; educational policy; instructional practices; observational research; teacher assessment

Indexed keywords

EID: 84906775146     PISSN: 0013189X     EISSN: 1935102X     Source Type: Journal    
DOI: 10.3102/0013189X14544542     Document Type: Article

References (36)

1. Bell C. A.,Gitomer D. H.,McCaffrey D. F.,Hamre B. K.,Pianta R. C.,Qi Y.An argument approach to observation protocol validity.Educational Assessment. 2012;17 (2/3): 62-87.
2. Chetty R.,Friedman J. N.,Rockoff J. E.The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood. Cambridge, MA: National Bureau of Economic Research; 2011:.
3. Danielson C.Enhancing professional practice: A framework for teaching. Alexandria, VA: Association for Supervision and Curriculum Development; 2007:.
4. Glazerman S.,Loeb S.,Goldhaber D.,Staiger D.,Raudenbush S.,Whitehurst G.Evaluating teachers: The important role of value-added. Washington, DC: Brookings Institution; 2010:.
5. Grossman P.,Cohen J.,Chambers Schuldt L.,Brown L. Paper presented at the annual meeting of the American Educational Research Association; 2014Philadelphia, PA; 2014.
6. Grossman P.,Loeb S.,Cohen J.,Wyckoff J.Measure for measure: The relationship between measures of instructional practice in middle school English language arts and teachers' value-added scores.American Journal of Education. 2013;119 (3): 445-470.
7. Hamre B. K.,Pianta R. C.,Burchinal M.,Field S.,LoCasale-Crouch J.,Downer J. T.,Scott-Little C.A course on effective teacher-child interactions effects on teacher beliefs, knowledge, and observed practice.American Educational Research Journal. 2012;49 (1): 88-123.
8. Harris D. N.Teacher value-added: Don't end the search before it starts.Journal of Policy and Management. 2009;28 (4): 693-699.
9. Harris D. N.,Sass T. R.The effects of NBPTS-certified teachers on student achievement.Journal of Policy Analysis and Management. 2009;28 (1): 55-80.
10. Hill H. C.Evaluating value-added models: A measurement perspective.Journal of Policy and Management. 2009;28 (4): 700-709.
11. Hill H. C.,Blunk M. L.,Charalambous C. Y.,Lewis J. M.,Phelps G. C.,Sleep L.,Ball D. L.Mathematical knowledge for teaching and the mathematical quality of instruction.Cognition and Instruction. 2008;26 (4): 430-511.
12. Hill H. C.,Kapitula L.,Umland K.A validity argument approach to evaluating teacher value-added scores.American Educational Research Journal. 2011;49 (3): 794-831.
13. Kane T. J.,Staiger D. O.Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle, WA: Bill and Melinda Gates Foundation; 2012:.
14. Kane T. J.,Taylor E. S.,Tyler J. H.,Wooten A. L.Identifying effective classroom practices using student achievement data.Journal of Human Resources. 2010;46 (3): 587-613.
15. Koretz D. M.Limitations in the use of achievement tests as measures of educators' productivity.Journal of Human Resources. 2008;37 (4): 752-777.
16. Lockwood J. R.,McCaffrey D. F.,Hamilton L. S.,Stecher B.,Le V.,Martinez J. F.The sensitivity of value-added teacher effect estimates to different mathematics achievement measures.Journal of Educational Measurement. 2007;44 (1): 47-67.
17. McCaffrey D.,Sass T.,Lockwood J.,Mihaly K.The intertemporal variability of teacher effect estimates.Education Finance and Policy. 2009;4 (4): 572-606.
18. Meng X. L.,Rosenthal R.,Rubin D. B.Comparing correlated correlation coefficients.Psychological Bulletin. 1992;111 (1): 172-175.
19. Nystrand M.Opening dialogue: Understanding the dynamics of language and learning in the English classroom. New York, NY: Teachers College Press; 1997:.
20. Nystrand M.,Gamoran A.Instructional discourse, student engagement, and literature achievement.Research in the Teaching of English. 1991;25:261-290.
21. O'Connor M. C.,Michaels S.Discourse, learning, and schooling. Hicks D., ed. Cambridge, UK: Cambridge University Press; 1996:63-103.
22. Papay J.Different tests, different answers: The stability of teacher value-added estimates across outcomes measures.American Educational Research Journal. 2011;48 (1): 163-193.
23. Pianta R. C.,Belsky J.,Vandergrift N.,Houts R.,Morrison F.Classroom effects on children's achievement trajectories in elementary school.American Educational Research Journal. 2008;49:365-397.
24. Polikoff M. S.Instructional sensitivity as a psychometric property of assessments.Educational Measurement: Issues and Practice. 2010;29 (4): 3-14.
25. Polikoff M. S.Designing teacher evaluation systems: New guidance from the Measures of Effective Teaching Project. Kane T. J.Kerr K. A.Pianta R. C., ed. San Francisco, CA: Jossey-Bass; in press:.
26. Polikoff M. S.,Porter A. C.Surveys of Enacted Curriculum substudy of the Measures of Effective Teaching Project: Final report. Seattle, WA: Bill and Melinda Gates Foundation; 2012:.
27. Popham J. W.Instructional insensitivity of tests: Accountability's dire drawback.Phi Delta Kappan. 2007;89 (2): 146-155.
28. Reardon S.,Raudenbush S.Assumptions of value-added models for estimating school effects.Education Finance and Policy. 2009;4 (4): 492-519.
29. Rockoff J. E.The impact of individual teachers on student achievement: Evidence from panel data.American Economic Review. 2004;94 (2): 247-252.
30. Rothstein J.Student sorting and bias in value-added estimation: Selection on observables and unobservables.Education Finance and Policy. 2009;4 (4): 537-571.
31. Seidel T. S.,Shavelson R.Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results.Review of Educational Research. 2007;77 (4): 454-499.
32. Strong M.,Gargani J.,Hacifazlioǧlu Ö.Do we know a successful teacher when we see one? Experiments in the identification of effective teachers.Journal of Teacher Education. 2011;62 (4): 1-16.
33. Taylor B. M.,Pearson P. D.,Peterson D. S.,Rodriguez M. C.Reading growth in high-poverty classrooms: The influence of teacher practices that encourage cognitive engagement in literacy learning.Elementary School Journal. 2003;104 (1): 3-28.
34. Taylor E. S.,Tyler J. H.The effect of evaluation on performance: Evidence from longitudinal student achievement data of mid-career teachers. Cambridge, MA: National Bureau of Economic Research; 2011:.
35. Tharp R. G.,Gallimore R.The instructional conversation: Teaching and learning in social activity. Berkeley, CA: National Center for Research on Cultural Diversity and Second Language Learning; 1991:.
36. Yoon B.,Resnick L. B.Instructional validity, opportunity to learn and equity: New standards examinations for the California mathematics renaissance. Los Angeles: Center for the Study of Evaluation, National Center for Research on Evaluation, Standards, and Student Testing, Graduate School of Education and Information Studies, University of California, Los Angeles; 1998:.