Assessing teachers’ skills in detecting and identifying effective interactions in the classroom: Theory and measurement

Elementary School Journal

Volumn 115, Issue 3, 2015, Pages 407-432

  Jamil, Faiza M ^a   Sabol, Terri J ^b   Hamre, Bridget K ^c   Pianta, Robert C ^c  

^a CLEMSON UNIVERSITY   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84925954977     PISSN: 00135984     EISSN: 15548279     Source Type: Journal    
DOI: 10.1086/680353     Document Type: Article

References (82)

1. Baecher, L., Rorimer, S., & Smith, L. (2012). Video-mediated teacher collaborative inquiry: Focus on English language learners. High School Journal, 95(3), 49-61.doi: 10.1353/hsj.2012.0007
2. Bandalos, D. L. (2002). The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling, 9(1), 78-102.doi: 10.1207/S15328007SEM0901_5
3. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Upper Saddle River, NJ: Prentice Hall.
4. Barnett, W. S., Jung, K., Yarosz, D. J., Thomas, J., Hornbeck, A., Stechuk, R., & Burns, S. (2008). Educational effects of the Tools of the Mind curriculum: A randomized trial. Early Childhood Research Quarterly, 23(3), 299-313.doi: 10.1016/j.ecresq.2008.03.001
5. Bierman, K. L., Domitrovich, C. E., Nix, R. L., Gest, S. D., Welsh, J. A., Greenberg, M. T., & Gill, S. (2008). Promoting academic and social-emotional school readiness: The Head Start REDI program. Child Development, 79(6), 1802-1817.doi: 10.1111/j.1467-8624.2008.01227.x
6. Blomberg, G., Stürmer, K., & Seidel, T. (2011). How pre-service teachers observe teaching on video: Effects of viewers’ teaching subjects and the subject of the video. Teaching and Teacher Education, 27(7), 1131-1140.doi: 10.1016/j.tate.2011.04.008
7. Bollen, K. A. (1989a). Structural equations with latent variables. New York: Wiley.
8. Bollen, K. A. (1989b). A new incremental fit index for general structural models. Sociological Methods & Research, 17(3), 303-316.doi: 10.1177/0049124189017003004
9. Borko, H., Jacobs, J., Eiteljorg, E., & Pittman, M. E. (2008). Video as a tool for fostering productive discussions in mathematics professional development. Teaching and Teacher Education, 24(2), 417-436.doi: 10.1016/j.tate.2006.11.012
10. Bransford, J. D., Brown, A. L., & Cocking, R. R. (2000). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy Press.
11. Bryne, B. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
12. Burchinal, M., Vandergrift, N., Pianta, R., & Mashburn, A. (2010). Threshold analysis of association between child care quality and child outcomes for low-income children in prekindergarten programs. Early Childhood Research Quarterly, 25(2), 166-176.doi: 10.1016/j.ecresq.2009.10.004
13. Cameron, C. E., Connor, C. M., & Morrison, F. J. (2005). Effects of variation in teacher organization on classroom functioning. Journal of School Psychology, 43(1), 61-85.doi: 10.1016/j.jsp.2004.12.002
14. Cohen, J. (1960). A coefficient for agreement for nominal scales. Education and Psychological Measurement, 20, 37-46.doi: 10.1177/001316446002000104
15. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied regression/correlation analysis for the behavioral sciences. Mahwah, NJ: Erlbaum.
16. Cole, D. A., Ciesla, J. A., & Steiger, J. H. (2007). The insidious effects of failing to include designdriven correlated residuals in latent-variable covariance structure analysis. Psychological Methods, 12(4), 381-398.doi: 10.1037/1082-989X.12.4.381
17. Copple, C., & Bredekamp, S. (2009). Developmentally appropriate practice. Washington, DC: National Association for the Education of Young Children.
18. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-335.doi: 10.1007/BF02310555
19. Darling-Hammond, L. (2010). Teacher education and the American future. Journal of Teacher Education, 61(1-2), 35-47.doi: 10.1177/0022487109348024
20. Dewey, J. (1904). The relation of theory to practice in education. The third NSSE yearbook (part 1). Chicago: University of Chicago Press.
21. Downer, J., Jamil, F., Maier, M., & Pianta, R. (2011). Using video-based coursework and coaching to improve teacher-child interactions: The role of basic psychological processes. In C. Howes, R. Pianta, & B. Hamre (Eds.), Effective professional development in early childhood education. Baltimore: Brookes.
22. Feldon, D. F. (2007). Cognitive load and classroom teaching: The double-edged sword of automaticity. Educational Psychologist, 42(3), 123-137.doi: 10.1080/00461520701416173
23. Glazerman, S., Goldhaber, D., Loeb, S., Raudenbush, S., Staiger, D. O., Whitehurst, G. J., & Croft, M. (2011). Passing muster: Evaluating teacher evaluation systems. Brown Center on Education Policy at Brookings (No. 6971), Mathematica Policy Research, Washington, DC.
24. Goe, L. (2007). The link between teacher quality and student outcomes: A research synthesis. Washington, DC: National Comprehensive Center for Teacher Quality.
25. Guskey, T. R., & Yoon, K. S. (2009). What works in professional development. Phi Delta Kappan, 90, 495-500.
26. Hamre, B., & Pianta, R. C. (2005). Can instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure? Child Development, 76(5), 949-967.doi: 10.1111/j.1467-8624.2005.00889.x
27. Hamre, B. K., & Pianta, R. C. (2010). Classroom environments and developmental processes: Conceptualization and measurement. In J. Meece & J. Eccles (Eds.). Handbook of research on schools, schooling, and human development (pp. 25-41). New York: Routledge.
28. Hamre, B. K., Pianta, R. C., Burchinal, M., Field, S., LoCasale-Crouch, J., Downer, J. T., & Scott-Little, C. (2012). A course on effective teacher-child interaction effects on teacher beliefs, knowledge, and observed practice. American Educational Research Journal, 49(1), 88-123.doi: 10.3102/0002831211434596
29. Hamre, B. K., Pianta, R. C., Downer, J. T., DeCoster, J., Mashburn, A. J., Jones, S. M., & Hamagami, A. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. Elementary School Journal, 113, 461-487.doi: 10.1086/669616
30. Hanushek, E. A. (2009). Teacher deselection. In D. Goldhaber & J. Hannaway (Eds.), Creating a new teaching profession (pp. 165-80). Washington, DC: Urban Institute.
31. Hatch, T., & Grossman, P. (2009). Learning to look beyond the boundaries of representation. Journal of Teacher Education, 60(1), 70-85.doi: 10.1177/0022487108328533
32. Howes, C., Burchinal, M., Pianta, R., Bryant, D., Early, D., Clifford, R., & Barbarin, O. (2008). Ready to learn? Children’s pre-academic achievement in pre-kindergarten programs. Early Childhood Research Quarterly, 23(1), 27-50.doi: 10.1016/j.ecresq.2007.05.002
33. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling:AMultidisciplinary Journal, 6, 1-55.doi: 10.1080/10705519909540118
34. Justice, L. M., Mashburn, A. J., Hamre, B. K., & Pianta, R. C. (2008). Quality of language and literacy instruction in preschool classrooms serving at-risk pupils. Early Childhood Research Quarterly, 23(1), 51-68.doi: /10.1016/j.ecresq.2007.09.004
35. Justice, L. M., Mashburn, A., Pence, K. L., & Wiggins, A. (2008). Experimental evaluation of a preschool language curriculum: Influence on children’s expressive language skills. Journal of Speech, Language, and Hearing Research, 51(4), 983-1001.
36. Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (pp. 17-64). New York: Praeger.
37. Kerrins, J. A., & Cushing, K. S. (2001). Taking a second look: Expert and novice differences when observing the same classroom teaching segment a second time. Journal of Personnel Evaluation in Education, 14, 5-24.doi: 10.1023/A:1008152928725
38. Kersting, N., Givvin, K. B., Sotelo, F. L., & Stigler, J. W. (2010). Teachers’ analyses of classroom video predict student learning of mathematics: Further explorations of a novel measure of teacher knowledge. Journal of Teacher Education, 61(1-2), 172-181.doi: 10.1177/0022487109347875
39. Koran, M. L., Snow, R. E., & McDonald, F. J. (1971). Teacher aptitude and observational learning of a teaching skill. Journal of Education Psychology, 62(3), 219-228.doi: 10.1037/h0031142
40. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174.
41. Loeb, S., Kalogrides, D., & Béteille, T. (2012). Effective schools: Teacher hiring, assignment, development, and retention. Education Finance and Policy, 7(3), 269-304.doi: 10.1162/EDFP_a_00068
42. Marsh, H. W., & Bailey, M. (1991). Confirmatory factor analyses of multitrait-multimethod data: A comparison of alternative models. Applied Psychological Measurement, 15(1), 47-70.doi: 10.1177/014662169101500106
43. Mashburn, A. J., Downer, J. T., Hamre, B. K., Justice, L. M., & Pianta, R. C. (2010). Consultation for teachers and children’s language and literacy development during pre-kindergarten. Applied Developmental Science, 14(4), 179-196.doi: 10.1080/10888691.2010.516187
44. Mashburn, A. J., Downer, J. T., Rivers, S. E., Brackett, M. A., & Martinez, A. (2014). Improving the power of an efficacy study of a social and emotional learning program: Application of generalizability theory to the measurement of classroom-level outcomes. Prevention Science, 15(2), 146-155.
45. Mashburn, A. J., Pianta, R. C., Hamre, B. K., Downer, J. T., Barbarin, O., Bryant, D., Howes, C. (2008). Measures of classroom quality in prekindergarten and children’s development of academic, language, and social skills. Child Development, 79(3), 732-749.doi: 10.1111/j.1467-8624.2008.01154.x
46. Matheson, A. S., & Shriver, M. D. (2005). Training teachers to give effective commands: Effects on student compliance and academic behaviors. School Psychology Review, 34(2), 202-219.
47. McCartney, K., Dearing, E., Taylor, B. A., & Bub, K. L. (2007). Quality child care supports the achievement of low-income children: Direct and indirect pathways through caregiving and the home environment. Journal of Applied Developmental Psychology, 28(5-6), 411-426.doi: 10.1016/j.appdev.2007.06.010
48. McClelland, M. M., Cameron, C. E., Wanless, S., & Murray, A. (2007). Executive function, behavioral self-regulation, and social-emotional competence: Links to school readiness. In O. N. Saracho & B. Spodek (Eds.), Contemporary perspectives on research in social learning in early childhood education (pp. 83-107). Charlotte, NC: Information Age.
49. METProject. (2010). Learning about teaching: Initial findings from the Measures of Effective Teaching project. Seattle: Bill & Melinda Gates Foundation.
50. Metzger, S. A., & Wu, M. (2008). Commercial teacher selection instruments: The validity of selecting teachers through beliefs, attitudes, and values. Review of Educational Research, 78(4), 921-940.
51. Miller, K. F. (2011). Situation awareness in teaching: What educators can learn from video-based research in other fields. In M. G. Sherin, V. R. Jacobs, R. A. Phillipp, (Eds.), Mathematics teacher noticing: Seeing through teachers’ eyes (pp. 51-65). New York: Taylor & Francis.
52. Moskowitz, G. B. (2005). Social cognition: Understanding self and others. New York: Guilford.
53. Muthén, L. K., & Muthén, B. O. (2012). Mplus user’s guide (6th ed.). Los Angeles: Authors.
54. Neitzel, C., Alexander, J. M., & Johnson, K. E. (2008). Children’s early interest-based activities in the home and subsequent information contributions and pursuits in kindergarten. Journal of Educational Psychology, 100(4), 782-797.doi: 10.1037/0022-0663.100.4.782
55. Nicholson-Crotty, S., & Staley, T. (2012). Competitive federalism and race to the top applicationdecisions in the American states. Educational Policy, 26(1), 160-184.doi: 10.1177/0895904811428974
56. Penuel, W. R., Bates, L., Gallagher, L. P., Pasnik, S., Llorente, C., Townsend, E., Vander Borght, M. (2012). Supplementing literacy instruction with a media-rich intervention: Results of a randomized controlled trial. Early Childhood Research Quarterly, 27(1), 115-127.doi: 10.1016/j.ecresq.2011.07.002
57. Pianta R. C., Barnett W. S., Burchinal M. R., & Thornburg K. R. (2009). The effects of preschool education: What we know, how public policy is or is not aligned with the evidence base, and what we need to know. Psychological Science in the Public Interest, 10(2), 49-88.doi: 10.1177/1529100610381908
58. Pianta, R. C., Belsky, J., Houts, R., & Morrison, F. (2007). Opportunities to learn in America’s elementary classrooms. Science, 315(5820), 1795-1796.doi: 10.1126/science.1139719
59. Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109-119.doi: 10.3102/0013189X09332374
60. Pianta, R. C., La Paro, K., & Hamre, B. K. (2008). Classroom Assessment Scoring System (CLASS). Baltimore: Brookes.
61. Raab, M., Dunst, C. J., Wilson, L. L., & Parkey, C. (2009). Early contingency learning and child and teacher concomitant social-emotional behavior. International Journal of Early Childhood Special Education, 1(1), 1-14.
62. Rockoff, J. E., Jacob, B. A., Kane, T. J., & Staiger, D. O. (2011). Can you recognize an effective teacher when you recruit one? Education, 6(1), 43-74.doi: 10.1162/EDFP_a_00022
63. Sabers, D. S., Cushing, K. S., & Berliner, D. C. (1991). Differences among teachers in a task characterized by simultaneity, multidimensionality, and immediacy. American Educational Research Journal, 28(1), 63-88.doi: 10.3102/00028312028001063
64. Santagata, R., Zannoni, C., & Stigler, J. W. (2007). The role of lesson analysis in pre-service teacher education: An empirical investigation of teacher learning from a virtual video-based field experience. Journal of Mathematics Teacher Education, 10(2), 123-140.doi: 10.1007/s10857-007-9029-9
65. Schank, R. (1997). Virtual learning. New York: McGraw-Hill.
66. Seidel, T., Sturmer, K., Blomberg, G., Kobarg, M., & Schwindt, K. (2011). Teacher learning from analysis of videotaped classroom situations: Does it make a difference whether teachers observe their own teaching or that of others? Teachers and Teaching, 27(2), 259-267.doi: 10.1016/j.tate.2010.08.009
67. Sherin, M. G., Jacobs, V. R., & Philipp, R. A. (Eds.). (2011). Mathematics teacher noticing: Seeing through teachers’ eyes. New York: Taylor & Francis.
68. Sherin, M., & van Es, E. (2005). Using video to support teachers’ ability to notice classroom interactions. Journal of Technology and Teacher Education, 13(3), 475-491.
69. Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4-14.
70. Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1-23.
71. Staiger, D. O., & Rockoff, J. E. (2010). Searching for effective teachers with imperfect information. Journal of Economic Perspectives, 24(3), 97-117.
72. Star, J. R., Lynch, K. H., & Perova, N. (2011). Using video to improve mathematics’ teachers’ abilities to attend to classroom features: A replication study. In M. G. Sherin, V. R. Jacobs, & R. A. Philipp (eds.), Mathematics teachers’ noticing: Seeing through teachers’ eyes (pp. 117-133). New York: Routledge.
73. Stephenson, J., Carter, M., & Arthur-Kelly, M. (2011). Professional learning for teachers without special education qualifications working with students with severe disabilities. Teacher Education and Special Education: Journal of the Teacher Education Division of the Council for Exceptional Children, 34(1), 7-20.doi: 10.1177/0888406410384407
74. Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 19-30). Cambridge, MA: Cambridge University Press.
75. Van Es, E. A., & Sherin, M. G. (2002). Learning to notice: Scaffolding new teachers’ interpretations of classroom interactions. Journal of Technology and Teacher Education, 10(4), 571-596.
76. Van Es, E. A., & Sherin, M. G. (2006). How different video club designs support teachers in “learning to notice.” Journal of Computing in Teacher Education, 22(4), 125.
77. van Kleeck, A., Vander Woude, J., & Hammett, L. (2006). Fostering literal and inferential language skills in Head Start preschoolers with language impairment using scripted book-sharing discussions. American Journal of Speech-Language Pathology, 15(1), 85-95.doi: 10.1044/1058-0360(2006/009)
78. Veenman, M. V., Kok, R., & Blöte, A. W. (2005). The relation between intellectual and metacognitive skills in early adolescence. Instructional Science, 33(3), 193-211.doi: 10.1007/s11251-004-2274-8
79. Walsh, B. A., & Blewitt, P. (2006). The effect of questioning style during storybook reading on novel vocabulary acquisition of preschoolers. Early Childhood Education Journal, 33(4), 273-278.doi: 10.1007/s10643-005-0052-0
80. Wasik, B. A., & Hindman, A. H. (2011). Improving vocabulary and pre-literacy skills of at-risk preschoolers through teacher professional development. Journal of Educational Psychology, 103(2), 455-469.doi: 10.1037/a0023067
81. Wiens, P. D., Hessberg, K., LoCasale-Crouch, J., & DeCoster, J. (2013). Using a standardized videobased assessment in a university teacher education program to examine preservice teachers knowledge related to effective teaching. Teaching and Teacher Education, 33, 24-33.doi: 10.1016/j.tate.2013.01.010
82. Zhang, M., Lundeberg, M., Koehler, M. J., & Eberhardt, J. (2011). Understanding affordances and challenges of three types of video for teacher professional development. Teaching and Teacher Education, 27(2), 454-462.doi: 10.1016/j.tate.2010.09.015