An Argument Approach to Observation Protocol Validity

Educational Assessment

Volumn 17, Issue 2-3, 2012, Pages 62-87

  Bell, Courtney A ^a   Gitomer, Drew H ^b   McCaffrey, Daniel F ^c   Hamre, Bridget K ^d   Pianta, Robert C ^d   Qi, Y ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c RAND   (United States)

^d UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84866643810     PISSN: 10627197     EISSN: None     Source Type: Journal    
DOI: 10.1080/10627197.2012.715014     Document Type: Article

References (42)

1. Allen, J. P., Gregory, A., Mikami, A. Y., Lun, J., Hamre, B. K. and Pianta, R. C. 2012. Observations of effective teaching in secondary school classroom: Predicting student achievement with CLASS-S Unpublished manuscript
2. Allen, J. P., Pianta, R. C., Gregory, A., Mikami, A. Y. and Lun, J. 2011. An interaction-based approach to enhancing secondary school instruction and student achievement. Science, 333: 1034-1037. doi:10.1126/science.1207998
3. Ball, D. L., Thames, M. H. and Phelps, G. 2008. Content knowledge for teaching: What makes it special?. Journal of Teacher Education, 59: 389-407. doi:10.1177/0022487108324554
4. Bell, C. A., Gitomer, D. H., McCaffrey, D., Hamre, B. K., Pianta, R. and Qi, Y. 2012. Final report on the toward an understanding of classroom context study Unpublished manuscript
5. Bill and Melinda Gates Foundation. 2012. Gathering feedback for teaching: Combining high quality observations with student surveys and achievement gains Seattle, WA: Author.
6. Blackwell, L. S., Trzesniewski, K. H. and Dweck, C. 2007. Implicit theories of intelligence predict achievement across an adolescent transition: A longitudinal study and an intervention. Society for Research in Child Development, 78: 246-263. doi:10.1111/j.1467-8624.2007.00995.x
7. Brennan, R. L. 2001. Generalizability theory New York, NY: Springer-Verlag.
8. Casabianca, J., McCaffrey, D. F., Gitomer, D. H., Bell, C. A. and Hamre, B. 2012. Effect of observation mode on measures of secondary mathematics teaching Unpublished manuscript
9. Cicchetti, D. V. and Sparrow, S. A. 1981. Developing criteria for establishing interobserver reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86: 127-137.
10. Cronbach, L. J. 1971. "Test validation.". In Education measurement, 2nd ed. Edited by: Thorndike, R. L. 443-507. Washington, DC: American Council on Education.
11. Cronbach, L. J., Gleser, G. C., Nanda, H. and Rajaratnam, N. 1972. The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York, NY: Wiley.
12. Goe, L. 2007. The link between teacher quality and student outcomes: A research synthesis Washington, DC: National Comprehensive Center for Teacher Quality.
13. Goe, L., Bell, C. and Little, O. 2008. Approaches to evaluating teacher effectiveness: A research synthesis Washington, DC: National Comprehensive Center for Teacher Quality.
14. Hamre, B. K., Hafen, C., Pianta, R., Bell, C., Gitomer, D. H. and McCaffrey, D. 2012. Teaching through Interactions in middle and high school classrooms: Validating the factor structure of the Classroom Assessment Scoring System-Secondary Unpublished manuscript
15. Hamre, B. K. and Pianta, R. C. 2005. Can instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure?. Child Development, 76: 949-967. doi:10.1111/j.1467-8624.2005.00889.x
16. Hamre, B. K., Pianta, R. C., Downer, J. T., Hakigami, A., Mashburn, A. J., Jones, S. and Brackett, M. 2011. Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms Unpublished manuscript
17. Hill, H. C., Ball, D. L., Blunk, M., Goffney, I. M. and Rowan, B. 2007. Validating the ecological assumption: The relationship of measure scores to classroom teaching and student learning. Measurement: Interdisciplinary Research and Perspective, 5: 107-118. doi:10.1080/15366360701487138
18. Hill, H. C., Blunk, M. L., Charalambous, C. Y., Lewis, J. M., Phelps, G. C., Sleep, L. and Ball, D. L. 2008. Mathematical knowledge for teaching and the mathematical quality of instruction: An exploratory study. Cognition & Instruction, 26: 430-511. doi:10.1080/07370000802177235
19. Hill, H. C., Kapitula, L. and Umland, K. 2011. A validity argument approach to evaluating teacher value-added scores. American Educational Research Journal, 48: 794-831. doi:10.3102/0002831210387916
20. Howes, C., Burchinal, M., Pianta, R., Bryant, D., Early, D., Clifford, R. and Barbarin, O. 2008. Ready to learn? Children's pre-academic achievement in pre-Kindergarten programs. Early Childhood Research Quarterly, 23: 27-50. doi:10.1016/j.ecresq.2007.05.002
21. Jaeger, R. M. 1993. Live vs. Memorex: Psychometric and practical issues in the collection of data on teachers' performances in the classroom Retrieved fromERIC database. (ED360325)
22. Kane, M. T. 2006. "Validation.". In Educational measurement Edited by: Brennan, R. L. 17-64. New York, NY: Praeger.
23. La Paro, K. M., Pianta, R. C. and Stuhlman, M. 2004. The classroom assessment scoring system: Findings from the prekindergarten year. The Elementary School Journal, 104: 409-426. doi:10.1086/499760
24. Lockwood, J. R., McCaffrey, D. F., Hamilton, L. S., Stecher, B. M., Le, V.-N. and Martinez, J. F. 2007. The sensitivity of value-added teacher effect estimates to different mathematics achievement measures. Journal of Educational Measurement, 44: 47-67. doi:10.1111/j.1745-3984.2007.00026.x
25. Medina, J. 2010. Agreement will alter teacher evaluations. The New York Times, May 10: A17 Retrieved fromhttp://www.nytimes.com/2010/05/11/nyregion/11teacher.html
26. Messick, S. 1989. "Validity.". In Educational measurement, 3rd ed. Edited by: Linn, R. L. 13-103. New York, NY: American Council of Education and Macmillan.
27. New Jersey Educator Effectiveness Task Force. 2011. Interim report: New Jersey Educator Effectiveness Task Force Retrieved fromhttp://www.state.nj.us/education/educators/effectiveness.pdf
28. Nunnally, J. and Bernstein, I. 1994. Psychometirc theory, 3rd ed. New York, NY: McGraw-Hill.
29. Pajares, M. F. 1992. Teachers' beliefs and educational research: Cleaning up a messy construct. Review of Educational Research, 62: 307-332.
30. Pianta, R. C., Hamre, B. K., Haynes, N. J., Mintz, S. L. and La Paro, K. M. 2007. Classroom assessment scoring system manual, middle/secondary version Charlottesville: University of Virginia.
31. Pianta, R., Howes, C., Burchinal, M., Bryant, D., Clifford, R., Early, D. and Barbarin, O. 2005. Features of prekindergarten programs, classrooms, and teachers: Do they predict observed classroom quality and child-teacher interactions?. Applied Developmental Science, 9: 144-159. doi:10.1207/s1532480xads0903_2
32. Rimm-Kaufman, S. E., Curby, T. W., Grimm, K. J., Nathanson, L. and Brock, L. L. 2009. The contribution of children's self-regulation and classroom quality to children's adaptive behaviors in the kindergarten classroom. Developmental Psychology, 45: 958-972. doi:101037/a0015861
33. Rimm-Kaufman, S. E., La Paro, K. M., Downer, J. T. and Pianta, R. C. 2005. The contribution of classroom setting and quality of instruction to children. The Elementary School Journal, 105: 377-394. doi:10.1086/429948
34. Shavelson, R. J. and Webb, N. M. 1991. Generalizability theory: A primer Newbury Park, CA: Sage.
35. Shavelson, R. J., Webb, N. M. and Burstein, L. 1986. "Measurement of teaching.". In Handbook of research on teaching, 3rd ed. Edited by: Wittrock, M. C. 50-91. New York, NY: Macmillan.
36. Spillane, J. P. and Zeuli, J. S. 1999. Reform and teaching: Exploring patterns of practice in the context of national and state mathematics reforms. Educational Evaluation and Policy Analysis, 21: 1-27.
37. Stecher, B., Le, V.-N., Hamilton, L., Ryan, G., Robyn, A. and Lockwood, J. R. 2006. Using structured classroom vignettes to measure instructional practices in mathematics. Educational Evaluation and Policy Analysis, 28: 101-130. doi:10.3102/01623737028002101
38. United States Department of Education. October 6 2009. U.S. Secretary of Education announces national competition to invest in innovation October 6, [Press release]Retrieved fromhttp://www2.ed.gov/news/pressreleases/2009/10/10062009a.html
39. United States Department of Education Office of Planning Evaluation and Policy Development. March 2010. ESEA a blueprint for reform: The reeditorization of the Elementary and Secondary Education Act March, Retrieved fromhttp://www2.ed.gov/policy/elsec/leg/blueprint/blueprint.pdf
40. Valentine, J. C., DuBois, D. L. and Cooper, H. 2004. The relation between self-beliefs and academic achievement: A meta-analytic review. Educational Psychologist, 39: 111-133.
41. Wayne, A. J. and Youngs, P. 2003. Teacher characteristics and student achievement gains: A review. Review of Educational Research, 73: 89-122. doi:10.3102/00346543073001089
42. Weisberg, D., Sexton, S., Mulhern, J. and Keeling, D. 2009. The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness New York, NY: The New Teacher Project.