Occasions and the Reliability of Classroom Observations: Alternative Conceptualizations and Methods of Analysis

Educational Assessment

Volumn 16, Issue 4, 2011, Pages 227-243

  Meyer, J Patrick ^a   Cash, Anne H ^a   Mashburn, Andrew ^a  

^a UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84859059454     PISSN: 10627197     EISSN: None     Source Type: Journal    
DOI: 10.1080/10627197.2011.638884     Document Type: Article

References (38)

1. Barnett, W. S., Epstein, D. J., Friedman, A. H., Boyd, J. S. and Hustedt, J. T. 2008. The state of preschool 2008: State preschool yearbook New Brunswick, NJ: National Institute for Early Education Research, Rutgers University.
2. Boyd, D., Goldhaber, D., Lankford, H. and Wyckoff, J. 2007. The effect of certification and preparation on teacher quality. Future of Children, 17: 45-68.
3. Brennan, R. L. 2001a. Generalizability theory New York: Springer-Verlag.
4. Brennan, R. L. 2001b. Manual for mGENOVA, version 2.1 Iowa City: University of Iowa.
5. Burchinal, M., Howes, C., Pianta, R. C., Bryant, D., Early, D. M.Clifford, R. M. 2008. Predicting child outcomes at the end of kindergarten from the quality of pre-kindergarten teacher-child interactions and instruction. Applied Developmental Science, 12: 140-153.
6. Clotfelter, C. T., Ladd, H. F. and Vigdor, J. L. 2007. Teacher credentials and student achievement: Longitudinal analysis with student fixed effects. Economics of Education Review, 26: 673-682.
7. Connor, C. M., Son, S. H., Hindman, A. H. and Morrison, F. J. 2005. Teacher qualifications, classroom practices, family characteristics, and preschool experience: Complex effects on first graders' vocabulary and early reading outcomes. Journal of School Psychology, 43: 343-375.
8. Cronbach, L. J., Glesser, G. C., Nanda, H. and Rajaratnam, N. 1972. The dependability of behavioral measurements: Theory of generalizability for scores and profiles New York: Wiley & Sons.
9. Danielson, C. 1996. Enhancing professional practice: A framework for teaching Alexandria, VA: Association for Supervision and Curriculum Development.
10. Darling-Hammond, L. 1986. A proposal for evaluation in the teaching profession. The Elementary School Journal, 86: 531-551.
11. Early, D. M., Maxwell, K. L., Burchinal, M., Alva, S., Bender, R. H.Bryant, D. 2007. Teachers' education, classroom quality, and young children's academic skills: Results from seven studies of preschool programs. Child Development, 78: 558-580.
12. Greenberg, M. T. 2004. Current and future challenges in school-based prevention: The researcher perspective. Prevention Science, 5(1): 5-13.
13. Hamre, B. K., Pianta, R. C., Mashburn, A. J. and Downer, J. T. 2008. Building a science of classrooms: Application of the CLASS framework in over 4,000 US early childhood and elementary classrooms Retrieved December 1, 2008, fromhttp://www.fcd-us.org/resources/resources_show.htm?doc_id=507559
14. Harms, T., Clifford, R. M. and Cryer, D. 1998. The Early Childhood Environment Rating Scale: Revised edition New York: Teachers College Press.
15. Howes, C., Burchinal, M., Pianta, R., Bryant, D., Early, D.Clifford, R. 2008. Ready to learn? Children's pre-academic achievement in pre-Kindergarten programs. Early Childhood Research Quarterly, 23(1): 27-50.
16. Hsieh, W. Y., Hemmeter, M. L., McCollum, J. A. and Ostrosky, M. M. 2009. Using coaching to increase preschool teachers' use of emergent literacy teaching strategies. Early Childhood Research Quarterly, 24: 229-247.
17. Jacob, B. A. and Lefgren, L. 2008. Can principals identify effective teachers? Evidence on subjective performance evaluation in education. Journal of Labor Economics, 26(1): 101-136.
18. Jepsen, C. 2005. Teacher characteristics and student achievement: Evidence from teacher surveys. Journal of Urban Economics, 57: 302-319.
19. Kane, M. 2006. "Validation.". In Educational measurement, 4th edition Edited by: Brennan, R. L. 17-64. Westport, CT: Praeger.
20. Kane, M. 2011. The errors of our ways. Journal of Educational Measurement, 48: 12-30.
21. Kane, T. J., Rockoff, J. E. and Staiger, D. O. 2008. What does certification tell us about teacher effectiveness? Evidence from New York City. Economics of Education Review, 27: 613-631.
22. Kirk, R. E. 1995. Experimental design: Procedures for the behavioral sciences Pacific Grove, CA: Brooks/Cole.
23. Lord, F. M. and Novick, M. R. 1968. Statistical theories of mental test scores Reading, MA: Addison-Wesley.
24. Mashburn, A. J., Pianta, R. C., Hamre, B. K., Downer, J. T., Barbarin, O.Bryant, D. 2008. Measures of classroom quality in prekindergarten and children's development of academic, language, and social skills. Child Development, 79: 732-749.
25. Matsumura, L. C., Garnier, H. E., Slater, S. C. and Boston, M. D. 2008. Toward measuring instructional interactions "at-scale.". Educational Assessment, 13: 267-300.
26. MET Project. 2011. Learning about teaching: Initial findings from the Measures of Effective Teaching project Retrieved from http://www.metproject.org/downloads/Preliminary_Findings-Research_Paper.pdf
27. Neuman, S. B. and Cunningham, L. 2009. The impact of professional development and coaching on early language and literacy instructional practices. American Educational Research Journal, 46: 532
28. Neuman, S. B., Koh, S. and Dwyer, J. 2008. CHELLO: The Child/Home Environmental Language and Literacy Observation. Early Childhood Research Quarterly, 23: 159-172.
29. NICHD Early Child Care Research Network. 2002. The relation of global first-grade classroom environment to structural classroom features and teacher and student behaviors. Elementary School Journal, 102: 367-387.
30. Pianta, R. C., La Paro, K. M. and Hamre, B. K. 2008. Classroom Assessment Scoring System Baltimore: Brookes.
31. Pianta, R. C., La Paro, K. M., Payne, C., Cox, M. J. and Bradley, R. 2002. The relation of kindergarten classroom environment to teacher, family, and school characteristics and child outcomes. The Elementary School Journal, 102: 225-238.
32. Pianta, R. C., Mashburn, A. J., Downer, J. T., Hamre, B. K. and Justice, L. 2008. Effects of web-mediated professional development resources on teacher-child interactions in pre-kindergarten classrooms. Early Childhood Research Quarterly, 23: 431-451.
33. Raudenbush, S. W. and Sadoff, S. 2008. Statistical inference when classroom quality is measured with error. Journal of Research on Educational Effectiveness, 1: 138-154.
34. Raudenbush, S. W. and Sampson, R. J. 1999. Ecometrics: Toward a science of assessing ecological settings, with application to the systematic social observation of neighborhoods. Sociological Methodology, 29: 1-41.
35. Rivkin, S. G., Hanushek, E. A. and Kain, J. F. 2005. Teachers, schools, and academic achievement. Econometrica, 73: 417-458.
36. Rockoff, J. E. 2004. The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review, 94: 247-252.
37. Smith, M., Dickinson, D. K., Sangeorge, A. and Anastasopoulos, L. 2002. Early language and literacy classroom observation (ELLCO) toolkit Baltimore: Brookes.
38. Williams, R. H. and Zimmerman, D. W. 1977. The reliability of difference scores when errors are correlated. Educational and Psychological Measurement, 37: 679-689.