Development and Construct Validity of the Classroom Strategies Scale-Observer Form

School Psychology Quarterly

Volumn 28, Issue 4, 2013, Pages 317-341

  Reddy, Linda A ^a   Fabiano, Gregory ^b   Dudek, Christopher M ^a   Hsu, Louis ^a  

^a RUTGERS UNIVERSITY   (United States)

^b UNIVERSITY AT BUFFALO   (United States)

Author keywords

Assessment; Classroom practices; Teacher behavior

Indexed keywords

ADULT; CHECKLIST; CHILD; DEVICES; FEMALE; HUMAN; MALE; MIDDLE AGED; OBSERVATION; PROCEDURES; PROFESSIONAL COMPETENCE; PSYCHOMETRY; STANDARDS; UNIVERSITY;

ADULT; CHECKLIST; CHILD; FACULTY; FEMALE; HUMANS; MALE; MIDDLE AGED; OBSERVATION; PROFESSIONAL COMPETENCE; PSYCHOMETRICS;

EID: 84888352661     PISSN: 10453830     EISSN: None     Source Type: Journal    
DOI: 10.1037/spq0000043     Document Type: Article

References (118)

1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of crossinformant correlations for situational specificity. Psychological Bulletin, 101, 213-232. doi: 10.1037/0033-2909.101.2.213
2. Alberto, P. A., & Troutman, A. C. (2003). Applied behavior analysis for teachers (6th ed.). Upper Saddle River, NJ: Merrill Prentice Hall.
3. Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall, Inc.
4. Arbuckle, J. L. (2010). IBM SPSS Amos 19 user's guide, 587-590. Crawfordville, FL: Amos Development Corporation.
5. Ausubel, D. P. (1964). Interaction between reception and discovery learning: A reply to professor Anthony. Educational Theory, 14, 90-98. doi: 10.1111/j.1741-5446.1964.tb00160.x
6. Bender, W. N. (2008). Differentiating instruction for students with learning disabilities: Best teaching practices for general and special educators (2nd ed.). Newbury Park, CA: Corwin Press.
7. Bennett, N. (1988). The effective primary school teacher: The search for a theory of pedagogy. Teaching and Teacher Education, 4, 19-30. doi: 10.1016/0742-051X(88)90021-2
8. Benson, J. (1998). Developing a strong program of construct validation: A test anxiety example. Educational Measurement: Issues and Practice, 17, 10-17.
9. Bentler, P. M., & Mooijaart, A. (1989). Choice of structural model via parsimony: A rationale based precision. Psychological Bulletin, 106, 315-317.
10. Black, P. J., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21, 5-31. doi:10.1007/s11092-008-9068-5
11. Bowen, N. K., & Guo, S. (2012). Structural equation modeling. New York, NY: Oxford University Press.
12. Brophy, J. E. (1981). Teacher praise: A functional analysis. Review of Educational Research, 51, 5-32. doi:10.3102/00346543051001005
13. Brophy, J. E., & Good, T. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research in teaching (3rd ed., pp. 328-375). New York, NY: Macmillian.
14. Burnham, K. P., & Anderson, D. R. (1998). Model selection and inference: A practical informationtheoretic approach. New York, NY: Springer- Verlag. doi:10.1007/978-1-4757-2917-7
15. Calderhead, J. (1986). Teachers: Beliefs and knowledge. In D. C. Berliner & R. C. Calfee (Eds.), Handbook of educational psychology (pp. 709-725). New York, NY: Macmillan.
16. Cantrell, S. (2013). Ensuring fair and reliable measures of effective teaching. Washington, DC: Bill & Melinda Gates Foundation.
17. Chall, J. S. (2000). The academic achievement challenge. New York, NY: Guilford Press.
18. Clark, C. M., & Peterson, P. L. (1986). Teachers' thought processes. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 255-296). New York, NY: Macmillan.
19. Clements, D. H., & Battista, M. T. (1990). Constructivist learning and teaching: Arithmetic Teacher, 38, 34-35.
20. Connor, C. M., Son, S. H., Hindman, A., & Morrison, F. J. (2005). Teacher qualifications, classroom practices, and family characteristics: Complex effects on first graders' language and early reading. Journal of School Psychology, 43, 343-375. doi: 10.1016/j.jsp.2005.06.001
21. Council of Chief State School Officers. (2011, April). Interstate Teacher Assessment and Support Consortium (InTASC Model Core Teaching Standards: A resource for state dialogue. Washington, DC: Council of Chief State School Officers.
22. Craig, R. C. (1956). Directed versus independent discovery of established relations. Journal of Educational Psychology, 47, 223-234.
23. Crawford, A. D., Zucker, T. A., Williams, J. M., Bhavsar, V., & Landry, S. H. (2013). Initial validation of the pre-kindergarten classroom observational tool and goal setting system for data-based coaching. School Psychology Quarterly, 28, 277-300.
24. Creemers, B. P. M. (1994). The effective classroom. London, UK: Cassell.
25. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart, and Winston.
26. Cronbach, L., & Snow, R. (1977). Aptitudes and Instructional Methods: A Handbook for Research on Interactions. New York, NY: Irvington.
27. Danielson, C. (2013). The framework for teaching evaluation instrument. Princeton, NJ: The Danielson Group.
28. Danielson, C., & McGreal, T. L. (2000). Teacher evaluation to enhance professional learning. Princeton, NJ: Educational Testing Service.
29. Darling-Hammond, L. (2000). Teacher quality and student achievement: A review of state policy evidence. Educational Policy Analysis and Archives, 8.
30. Ding, L., Velicer, W. F., & Harlow, L. L. (1995). Effects of estimation methods, number of indicators per factor, and improper solutions on SEM fit indices. Structural Equation Modeling, 2, 119-143. doi:10.1080/10705519509540000
31. Doyle, C. (1987). Explorations in psychology. Monterey, CA: Brooks/Cole Pub. Co.
32. Gable, R. A., Hester, P. H., Rock, M. L., & Hughes, K. G. (2009). Back to basics: Rules, praise, ignoring and reprimands revisited. Intervention in School and Clinic, 44, 195-205. doi:10.1177/ 1053451208328831
33. Gage, N. L. (1978). The scientific basis of the art of teaching. New York, NY: Teachers College Press.
34. Gersten, R., Chard, D. J., & Baker, S. (2000). Factors enhancing sustained use of research-based instructional practices. Journal of Learning Disabilities, 33, 445-456. doi:10.1177/002221940003300505
35. Good, T. L., & Brophy, J. (1980). Educational psychology: A realistic approach (2nd ed.). New York, NY: Holt, Rinehart, & Winston.
36. Goodwin, L. D., & Goodwin, W. L. (1999). Measurement myths and misconceptions. School Psychology Quarterly, 14, 408-427. doi:10.1037/ h0089017
37. Griffiths, A., Parson, L. B., Burns, M. K., VanDerHeyden, A., & Tilly, W. D. (2007). Formative Assessment. Response to Intervention: Research for Practice (pp. 63-74). Alexandria, VA: National Association of State Directors of Special Education, Inc. Retrieved from http://www.rti4success.org/ resourcetype/response-intervention-research-practice
38. Harris, A. (1998). Effective teaching: A review of the literature. School Leadership & Management, 18, 169-183. doi:10.1080/13632439869628
39. Harris, K. R., & Graham, S. (1994a). Constructivism: Principles, paradigms, and integration. Journal of Special Education, 28, 233-247. doi:10.1177/ 002246699402800301
40. Harris, K. R., & Graham, S. (1994b). Implications of constructivism for students with disabilities and students at risk: Issues and directions [Special Issue]. Journal of Special Education, 28.
41. Harris, K. R., & Graham, S. (1996). Memo to constructivists: Skills count, too. Educational Leadership, 53, 26-29.
42. Hattie, J. A. (1992). Measuring the effects of schooling. Australian Journal of Education, 36, 5-13.
43. Hattie, J., Biggs, J., & Purdie, N. (1996). Effects of learning skills interventions on students learning: A meta-analysis. Review of Educational Research, 66, 99-136. doi:10.3102/00346543066002099
44. Hayduk, L. (1987). Structural equation modeling with LISREL. Baltimore, MD: Johns Hopkins University Press.
45. Heneman, H. G., III, & Milanowski, A. (2004). Alignment of human resource practices and teacher performance competency. Peabody Journal of Education, 79, 108-125. doi:10.1207/ s15327930pje7904_6
46. Hopkins, D., Ainscow, M., & West, M. (1994). School improvement in an era of change. London, UK: Cassell.
47. Hopkins, D., Ainscow, M., West, M., Harris, A., & Beresford, J. (1997). Creating the conditions for classroom improvement. London, UK: Cassell.
48. Horner, R. H., Sugai, G., Todd, A. W., & Lewis- Palmer, T. (2000). Elements of Behavioral Support Plans: A Technical Brief. Exceptionality, 8, 205-215. doi:10.1207/S15327035EX0803_6
49. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. doi:10.1080/ 10705519909540118
50. Jackson, D. L., Gillapsy, J. A., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14, 6-23. doi: 10.1037/a0014694
51. Jackson, S. L. (2009). Research methods and statistics: A critical thinking approach (3rd ed.). Belmont, CA: Wadsworth Cengage Learning.
52. Johnson, S. M. (1990). Teachers at work: Achieving success in our schools. New York, NY: Basic Books.
53. Jöreskog, K. G., & Sörbom, D. (1986). LISREL VI: Analysis of linear structural relationships by maximum likelihood, instrumental variables, and least squares methods (4th ed.). Uppsula, Sweden: University of Uppsula Department of Statistics.
54. Joyce, B., & Weil, M. (1996). Models of Teaching (4th ed.). Englewood Cliffs, NJ: Prentice Hall.
55. Kalis, T. M., Vannest, K. J., & Parker, R. (2007). Praise counts: Using self-monitoring to increase effective teaching practices. Preventing School Failure, 51, 20-27. doi:10.3200/PSFL.51.3.20-27
56. Kane, M. (2002). Validating high-stakes testing programs. Educational Measurement: Issues and Practice, 21, 31-41. doi:10.1111/j.1745-3992.2002.tb00083.x
57. Kane, M. (2008). Terminology, emphasis, and utility in validation. Educational Researcher, 37, 76-82. doi:10.3102/0013189X08315390
58. Kane, T. J., & Staiger, D. O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. MET Research Paper. Seattle, WA: Bill & Melinda Gates Foundation. Retrieved July 16, 2012, from http://www.metproject.org/downloads/ MET_Gathering_Feedback_Research_Paper.pdf
59. Kass, R., & Raferty, A. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795. doi:10.1080/01621459.1995.10476572
60. Kern, L., & Clemmens, N. H. (2007). Antecedent strategies to promote appropriate classroom behavior. Psychology in the Schools, 44, 65-75. doi: 10.1002/pits.20206
61. Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry- based teaching. Educational Psychologist, 41, 75-86. doi:10.1207/s15326985ep4102_1
62. Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effects of direct instruction and discovery learning. Psychological Science, 15, 661-667. doi:10.1111/j .0956-7976.2004.00737.x
63. Knapp, T. R., & Brown, J. K. (1995). Ten measurement commandments that often should be broken. Research in Nursing & Health, 18, 465-469. doi: 10.1002/nur.4770180511
64. Kounin, J. S. (1970). Discipline and group management in classrooms. New York, NY: Holt, Rinehart, and Winston.
65. Kozioff, M. A., LaNunziata, L., Cowardin, J., & Bessellieu, F. B. (2000). Direct instruction: Its contributions to high school achievement. The High School Journal, 84, 54-71.
66. Kyriacou, C. (1986). Effective teaching in schools. Oxford, UK: Basil Blackwell.
67. Leff, S. S., Thomas, D. E., Shapiro, E. S., Paskewich, B., Wilson, K., Necowitz-Hoffman, B., & Jawad, A. F. (2011). Developing and validating a new classroom climate observation assessment tool. Journal of School Violence, 10, 165-184. doi: 10.1080/15388220.2010.539167
68. Leigh, A. (2010). Estimating teacher effectiveness from two-year changes in students' test scores. Economics of Education Review, 29, 480-488. doi:10.1016/j.econedurev.2009.10.010
69. Marzano, R. J. (1998). A theory-based meta-analysis of research on instruction. Aurora, CO: Mid- Continent Research for Education and Learning.
70. Marzano, R. J., Frontier, T., & Livingston, D. (2011). Effective supervision: Supporting the art and science of teaching. Alexandria VA: ASCD.
71. Marzano, R. J., Pickering, D. J., & Pollock, J. E. (2001). Classroom instruction that works: Research- based strategies for increasing student achievement. Alexandria, VA: Association for Supervision and Curriculum Development.
72. Mayer, R. (2004). Should there be a three-strikes rule against pure discovery learning? The case for guided methods of instruction. American Psychologist, 59, 14-19. doi:10.1037/0003-066X.59.1.14
73. Medley, D. M., & Coker, H. (1987). The accuracy of principals' judgments of teacher performance. Journal of Educational Research, 80, 242-247.
74. Moore, K. D. (2009). Effective instructional strategies. From theory to practice. (2nd ed.). Thousand Oaks, CA: Sage.
75. Moreno, R. (2004). Decreasing cognitive load in novice students: Effects of explanatory versus corrective feedback in discovery-based multimedia. Instructional Science, 32, 99-113. doi:10.1023/B: TRUC.0000021811.66966.1d
76. Muñoz, M. A., & Chang, F. C. (2007). The Elusive Relationship Between Teacher Characteristics and Student Academic Growth: A Longitudinal Multilevel Model for Change. Journal of Personnel Evaluation in Education, 20, 147-164. doi: 10.1007/s11092-008-9054-y
77. NICHD Early Child Care Research Network. (2002). Child care and children's development prior to school entry. American Education Research Journal, 39, 133-164. doi:10.3102/ 00028312039001133
78. Nye, B., Konstantopoulos, S., & Hedges, L. V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26, 237-257. doi: 10.3102/01623737026003237
79. O'Leary, K. D., Kaufman, K. F., Kass, R. F., & Drabman, R. S. (1970). The effects of loud and soft reprimands on behavior of disruptive students. Exceptional Children, 37, 145-155.
80. O'Leary, K. D., & O'Leary, S. G. (1972). Classroom management: The successful use of behavior modification. New York, NY: Pergamon Press.
81. Pianta, R. C., Hamre, B. K., & Downer, J. (2011). Aligning measures of quality with professional development goals and goals for children's devel- opment. In M. Zaslow, I. Martinez-Beck, K. Tout, & T. Halle (Eds.), Quality measurement in early childhood settings (pp. 297-315). Baltimore, MD: Brookes.
82. Pianta, R. C., La Paro, K. M., & Hamre, B. K. (2008). Classroom Assessment Scoring System [CLASS] manual: Pre-K. Baltimore, MD: Brookes Publishing.
83. Pianta, R. C., La Paro, K. M., Payne, C., Cox, M. J., & Bradley, R. (2002). The relation of Kindergarten classroom environment to teacher, family, and school characteristics and child outcomes. The Elementary School Journal, 102, 225-238. doi: 10.1086/499701
84. Reddy, L. A., & Dudek, C. (in press). Teacher progress monitoring of instructional and behavioral management practices: An evidence-based approach to improving classroom practices. International Journal of School and Educational Psychology.
85. Reddy, L. A., Fabiano, G., Barbarasch, B., & Dudek, C. (2012). Behavior management of students with attention-deficit/hyperactivity disorders using teacher and student progress monitoring. In L. M. Crothers & J. B. Kolbert (Eds.), Understanding and managing behaviors of children with psychological disorders: A reference for classroom teachers (pp. 17-47). New York, NY: Continuum International Publishing Group, Inc.
86. Reddy, L. A., Fabiano, G., & Dudek, C. M. (2013). Concurrent validity of the Classroom Strategies Scale-Observer Form. Journal of Psychoeducational Assessment, 31, 258-270. doi:10.1177/ 0734282912462829
87. Reddy, L. A., Fabiano, G., Dudek, C. M., & Hsu, L. (2013a). Instructional and behavioral management practices implemented by elementary general education teachers. Journal of School Psychology.
88. Reddy, L. A., Fabiano, G., Dudek, C. M., & Hsu, L. (2013b). Predictive validity of the Classroom Strategies Scale-Observer Form on statewide testing. School Psychology Quarterly, 28, 301-316.
89. Reddy, L. A., Fabiano, G., & Jimerson, S. (2013). Assessment of general education teachers' tier 1 classroom practices: Current science and practice, School Psychology Quarterly.
90. Reddy, L. A., Kettler, R. J., & Kurz, A. (2013). School-wide educator evaluation for improving school capacity and student achievement in high poverty schools: Year 1 of the school system improvement project. Manuscript under review.
91. Reynolds, C. R., & Carson, D. (2005). Methods for assessing cultural bias in tests. In C. L. Frisby & C. R. Reynolds (Eds.), Comprehensive handbook of multicultural school psychology (pp. 795-823). New York, NY: Wiley.
92. Reynolds, C. R., Willson, V. L., & Chatman, S. P. (1984). Item bias on the 1981 revisions of the Peabody Picture Vocabulary Test using a new method of detecting bias. Journal of Psychoeducational Assessment, 2, 219-224. doi:10.1177/ 073428298400200306
93. Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73, 417-458. doi:10.1111/j.1468- 0262.2005.00584.x
94. Rockoff, J. E. (2004). The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review, 94, 247-252. doi:10.1257/0002828041302244
95. Sanders, W. L. (2000). Value-added assessment from student achievement data: Opportunities and hurdles. Journal of Personnel Evaluation in Education, 14, 329-339. doi:10.1023/A:1013008006096
96. Scheerens, J. (1992). Effective Schooling: Research, theory, and practice. London, UK: Cassell.
97. Schloss, P. J., & Smith, M. A. (1998). Applied behavior analysis in the classroom. Boston, MA: Allyn & Bacon.
98. Simonsen, B., Fairbanks, S., Briesch, A., Myers, D., & Sugai, G. (2008). Evidence-based practices in classroom management: Considerations for research to practice. Education & Treatment of Children, 31, 351-380. doi:10.1353/etc.0.0007
99. Stage, S. A., & Quiroz, D. R. (1997). A meta-analysis of interventions to decrease disruptive classroom behavior in public education settings. School Psychology Review, 26, 333-368.
100. Standards for Educational and Psychological Testing (SEPT). (1999). Washington, DC: American Educational Research Association, American Psychological Association, National Council on Measurement in Education.
101. Sugai, G., & Horner, R. H. (2007). Is school-wide Positive behavioral support an evidence-based practice? Retrieved from http://pbis.org/files/ 101007evidencebase4pbs.pdf
102. Sutherland, K. S., Wehby, J. H., & Yoder, P. J. (2002). Examination of the relationship between teacher praise and opportunities for students with EBD to respond to academic requests. Journal of Emotional and Behavioral Disorders, 10, 5-13. doi:10.1177/106342660201000102
103. Sweller, J. (2003). Evolution of human cognitive architecture. In B. Ross (Ed.), The psychology of learning and motivation (pp. 215-266). San Diego, CA: Academic.
104. Toch, T., & Rothman, R. (2008). Rush to judgment: Teacher evaluation in public education. Washington, DC: Education Sector.
105. Tomlinson, C. A., & Edison, C. C. (2003). Differentiation in practice: A resource guide for differentiating curriculum, grades K-5. Alexandria, VA: Association for Supervision and Curriculum Development.
106. Tomlinson, C. A., & McTighe, C. A. (2006). Integrating differentiated instruction (DI) and understanding by design (UbD). Alexandria, VA: Association for Supervision and Curriculum Development.
107. Walberg, H. J. (1986). Synthesis of research on teaching. In M. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 214-229). New York, NY: Macmillan.
108. Walberg, H. J. (1990). Productive teaching and instruction: Assessing the knowledge base. Phi Delta Kappan, 71, 470-478.
109. Walker, H. M., Colvin, G., & Ramsey, E. (1995). Antisocial behavior in school: Strategies and best practices. Pacific Grove, CA: Brooks/Cole.
110. Walker, H. M., Ramsey, E., & Gresham, F. M. (2003). Heading off disruptive behavior: How early intervention can reduce defiant behavior- and win back teaching time. American Educator, 6-21.
111. Wang, M. C. (1991). Productive teaching and instruction: Assessing the knowledge base. Phi Delta Kappan, 71, 470-478.
112. Wang, M. C., Haertel, G. D., Walberg, H. J. (1993). Toward a knowledge base for school learning. Review of Educational Research, 63, 249-294.
113. Wang, M. C., Haertel, G. D., & Walhberg, H. J. (1990). What influences learning? A content analysis of review literature. The Journal of Educational Research, 84, 30-43.
114. Weisberg, D., Sexton, S., Mulhern, J., & Keeling, D. (2009). The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness. Brooklyn, NY: The New Teacher Project. Retrieved from http://widgeteffect.org/ downloads/TheWidgetEffect.pdf
115. Wenglinsky, H. (2002). How schools matter: The link between teacher classroom practices and student academic performance. Education Policy Analysis Archives, 10. Retrieved from http://epaa .asu.edu/epaa/v10n12/
116. What Works Clearinghouse. (2012). What works clearinghouse. Retrieved from http://ies.Ed.gov/ ncee/wwc/
117. Wittrock, M. C. (1986). Handbook of research on teaching (3rd ed.). New York, NY: Macmillan.
118. Wragg, E. C. (1984). Classroom teaching skills: The research findings of the Teacher Education Project. London, UK: Croom Helm. doi:10.4324/ 9780203325445