Development and evaluation of a questionnaire measuring pre-service teachers’ teaching behaviour: A Rasch modelling approach

School Effectiveness and School Improvement

Volumn 26, Issue 2, 2015, Pages 169-194

  Maulana, Ridwan ^a   Helms Lorenz, Michelle ^a   van de Grift, Wim ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Rasch analysis; secondary education; students perceptions; teachers behaviour

Indexed keywords

EID: 84929030906     PISSN: 09243453     EISSN: 17445124     Source Type: Journal    
DOI: 10.1080/09243453.2014.939198     Document Type: Article

References (90)

1. Alton-Lee, A. (2003). Quality teaching for diverse students in schooling: Best evidence synthesis. Wellington: Ministry of Education, Medium Terms Strategy Policy Division.
2. Andersen, E. B. (1977). Sufficient statistics and latent trait models. Psychometrika, 42, 69–81.
3. Anderson, L. M., Evertson, C. M., & Brophy, J. E. (1979). An experimental study of effective teaching in first-grade reading groups. The Elementary School Journal, 79, 193–223.
4. Beishuizen, J. J., Hof, E., Van Putten, C. M., Bouwmeester, S., & Asscher, J. J. (2001). Students and teachers’ cognitions about good teachers. British Journal of Educational Psychology, 71, 185–201.
5. Bell, R. L., Maeng, J. L., & Binns, I. C. (2013). Learning in context: Technology integration in a teacher preparation program informed by situated learning theory. Journal of Research in Science Teaching, 50, 348–379.
6. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick. (Eds.), Statistical theories of mental test scores (pp. 397–479). Reading, MA: Addison-Wesley.
7. Cai, L., Thissen, D., & Du Toit, S. (2005–2013). IRTPRO (Version 2.1) [Computer software]. Lincolnwood, IL: Scientific Software International.
8. Carnine, D. W., Dixon, R. C., & Silbert, J. (1998). Effective strategies for teaching Mathematics. In E. J. Kame’enui & D. W. Carnine (Eds.), Effective teaching strategies that accommodate divers learners. Upper Saddle River, NJ: Prentice Hall.
9. Cattell, R. B. (1966). The data box: Its ordering of total resources in terms of possible relational systems. In R. B. Cattell (Ed.), Handbook of multivariate experimental psychology (pp. 67–128). Chicago, IL: Rand-McNally.
10. Chen, W.-H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265–289.
11. Cornelius-White, J. (2007). Learner-centered teacher-student relationships are effective: A meta-analysis. Review of Educational Research, 77, 113–143.
12. Creemers, B. P. M. (1994). The effective classroom. London: Cassell.
13. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York, NY: Wiley.
14. Danielson, C. (2013). The framework for teaching: Evaluation instrument. Princeton, NJ: The Danielson Group.
15. De Jong. R., & Westerhof, K. (2001). The quality of student ratings of teacher behaviour. Learning Environments Research, 4, 51–85.
16. DeMars, C. (2010). Items response theory: Understanding statistics measurement. New York, NY: Oxford University Press.
17. Den Brok, P., Bergen, T., Stahl, R. J., & Brekelmans, M. (2004). Students’ perceptions of teacher control behaviours. Learning and Instruction, 14, 425–443.
18. Denham, C., & Lieberman, A. (Eds.). (1980). Time to learn. Washington, DC: National Institute of Education.
19. Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modelling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(1S), 5–18.
20. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
21. Ferguson, R. F. (2012). Can student surveys measure teaching quality? Phi Delta Kappan, 94(3), 24–28.
22. Fisher, C. W., Berliner, D. C., Filby, N. N., Marliave, R. S., Cahen, L. S., & Dishaw, M. M. (1980). Teaching behaviours, academic learning times, and student achievement: An overview. In C. Denham & A. Lieberman (Eds.), Time to learn (pp. 7–32). Washington, DC: National Institute of Education.
23. Fraser, B. (1991). Two decades of classroom environment research. In H. J. Walberg (Ed.), Educational environments: Evaluations, antecedents and consequences (pp. 3–27). Elmsford, NY: Pergamon.
24. Fuller, F. (1970). Personalized education for teachers: One application of the teacher concerns model. Austin, TX: R & D Center for Teacher Education.
25. Good, T. L., & Brophy, J. (1989). Teaching the lesson. In R. E. Slavin (Ed.), School and classroom organization (pp. 25–68). Hillsdale, NJ: Lawrence Erlbaum Associates.
26. Hampton, S. E., & Reiser, R. A. (2004). Effects of a theory-based feedback and consultation process on instruction and learning in college classrooms. Research in Higher Education, 45, 497–527.
27. Hattie, J. A. C. (2012). Visible learning for teachers: Maximizing impact on learning. Abingdon: Routledge.
28. Hattie, J. A. C., & Clinton, J. (2008). Identifying accomplished teachers: A validation study. In L. Ingvarson & J. A. C. Hattie (Eds.), Assessing teachers for professional certification: The first decade of the National Board for Professional Teaching Standards (pp. 313–344). Oxford: Elsevier.
29. Hildebrand, K. E. (2009). Using curriculum-based measures to assess special education teacher candidates’ application of defining and measuring behaviour skills. Dissertation Abstracts International Section A: Humanities and Social Sciences, 69, 4290.
30. Houtveen, A. A. M., Booij, N., De Jong, R., & Van de Grift, W. J. C. M. (1999). Adaptive instruction and pupil achievement. School Effectiveness and School Improvement, 10, 172–192.
31. Houtveen, A. A. M., & Van de Grift, W. J. C. M. (2007). Effects of metacognitive strategy instruction and instruction time on reading comprehension. School Effectiveness and School Improvement, 18, 173–190.
32. Hoyt, W. T., & Melby, J. N. (1999). Dependability of measurement in counseling psychology: An introduction to generalizability theory. The Counseling Psychologist, 27, 325–352.
33. Lang, J. W. B., & Kersting, M. (2007). Regular feedback from student ratings of instruction: Do college teachers improve their ratings in the long run? Instructional Science, 35, 187–205.
34. Locke, E. A., & Latham, G. P. (1990). A theory of goal setting and task performance. Englewood Cliffs, NJ: Prentice Hall.
35. Kame’enui, E. J., & Carnine, D. W. (Eds.). (1998). Effective teaching strategies that accommodate divers learners. Upper Saddle River, NJ: Prentice Hall.
36. Kindsvatter, R., Wilen, W., & Ishler, M. (1988). Dynamics of effective teaching. New York, NY: Longman.
37. Koeze, P. A. (2007). Differentiated instruction: The effect on student achievement in an elementary school (Unpublished doctoral dissertation). Eastern Michigan University, Ypsilanti.
38. Kyriakides, L., Creemers, B. P. M., & Antoniou, P. (2009). Teacher behaviour and student outcomes: Suggestions for research on teacher training and professional development. Teaching and Teacher Education, 25, 12–23.
39. Lasagabaster, D., & Sierrra, J. M. (2011). Classroom observation: Desirable conditions established by teachers. European Journal of Teacher Education, 34, 449–463.
40. Lundberg, I., & Linnakylä, P. (1992). Teaching reading around the world. The Hague: IEA.
41. Mair, P., Hatzinger, R., & Maier, M. J. (2013). Extended Rasch modeling: The R Package eRm. Retrieved from http://cran.r-project.org/web/packages/eRm/vignettes/eRm.pdf
42. Marzano, R. J. (2003). What works in schools. Translating research into action. Alexandria, VA: ASCD.
43. Maulana, R., Opdenakker, M.-C., Den Brok, P., & Bosker, R. (2011). Teacher-student interpersonal relationships in Indonesia: Profiles and importance to student motivation. Asia Pacific Journal of Education, 31, 33–49. doi:10.1080/ 02188791.2011.544061
44. Maulana, R., Opdenakker, M.-C., Stroet, K., & Bosker, R. (2012). Observed lesson structure during the first year of secondary education: Exploration of change and link with academic engagement. Teaching and Teacher Education, 28, 835–850.
45. Maulana, R., Opdenakker, M.-C., Stroet, K., & Bosker, R. (2013). Changes in teachers’ involvement versus rejection and links with academic motivation during the first year of secondary education: A multilevel growth curve analysis. Journal of Youth and Adolescence, 42, 1348–1371.
46. n contingency tables: A unified framework. Journal of the American Statistical Association, 100, 1009–1020.
47. Meeuwisse, M., Severiens, S. E., & Born, M. P. (2010). Learning environment, interaction, sense of belonging and study success in ethnically diverse student groups. Research in Higher Education, 51, 528–545.
48. Mortimore, P., Sammons, P., Stoll, L., Lewis, D., & Ecob, R. (1988). School matters. The junior years. Somerset: Open books.
49. Muijs, D., & Reynolds, D. (2001). Effective teaching: Evidence and practice. London: Sage.
50. Muthén, L. K., & Muthén, B. O. (1998–2012). Mplus user’s guide seventh edition. Los Angeles, CA: Authors.
51. Nunes, T., & Bryant, P. (1996). Children doing mathematics. Oxford: Blackwell.
52. Opdenakker, M.-C., Maulana, R., & Den Brok, P. (2012). Teacher-student interpersonal relationships and academic motivation within one school year: Developmental changes and linkage. School Effectiveness and School Improvement, 23, 95–119. doi:10.1080/09243453.2011.619198
53. Opdenakker, M.-C., & Minnaert, A. (2011). Relationship between learning environment characteristics and academic engagement. Psychological Reports, 109, 259–284. doi:10.2466/09.10.11.PRO.109.4.259-284
54. 2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27, 289–298.
55. Pearson, P. D., & Fielding, L. (1991). Comprehension instruction. In R. Barr, M. L. Kamil, P. B. Mosenthal, & P. D. Pearson (Eds.), Handbook of reading research (Vol. 2, pp. 815–860). White Plains, NY: Longman.
56. Pearson, P. D., & Gallagher, M. C. (1983). The instruction of reading comprehension. Contemporary Educational Psychology, 8, 317–344.
57. Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38, 109–119.
58. Pressley, M., Wood, E., Woloshyn, V. E., Martin, V., King, A., & Menke, D. (1992). Encouraging mindful use of prior knowledge. Attempting to construct explanatory answers facilitates learning. Educational Psychologist, 27, 91–109.
59. Rasbash, J., Charlton, C., Browne, W. J., Healy, M., & Cameron, B. (2005). MLwiN (Version 2.0) [Computer software]. Bristol: University of Bristol.
60. Reis, S. M., McCoach, D. B., Little, C. A., Muller, L. M., & Kaniskan, R. B. (2011). The effects of differentiated instruction and enrichment pedagogy on reading achievement in five elementary schools. American Educational Research Journal, 48, 462–501.
61. Rosenshine, B. (1980). How time is spent in elementary classrooms. In C. Denham & A. Lieberman (Eds.), Time to learn (pp. 107–126). Washington, DC: National Institute of Education.
62. Rosenshine, B., & Berliner, D. (1978). Academic engaged time. British Journal of Teacher Education, 4, 3–16.
63. Rosenshine, B. V., & Meister, C. (1997). Cognitive strategy instruction in reading. In S. Stahl & D. A. Hayes (Eds.), Instructional models in reading (pp. 85–107). Mahwah, NJ: Erlbaum.
64. Rosenshine, B. V., & Stevens, R. (1986). Teaching functions. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 376–390). New York, NY: Macmillan.
65. Rost, J., & von Davier, M. (1994). A conditional item fit index for Rasch models. Applied Psychological Measurement, 18, 171–182.
66. Sammons, P. Hillman, J., & Mortimore, P. (1995). Key characteristics of effective schools: A review of school effectiveness research. London: Office for Standards in Education.
67. Scantlebury, K., Boone, W., Kahle, J. B., & Fraser, B. J. (2001). Design, validation, and use of an evaluation instrument for monitoring systemic reform. Journal of Research in Science Teaching, 38, 646–662.
68. Scheerens, J. (1992). Effective schooling: Research, theory and practice. London: Cassell.
69. Scheerens, J., & Bosker, R. (1997). The foundations of educational effectiveness. Oxford: Pergamon.
70. Schreiber, J. B., Nora, A., Stage, F. K., Barlow. E. A., & King, J. (2006). Reporting structural equation modelling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99, 323–338.
71. Scientific Software International. (2011). IRTPRO users’ guide. Lincolnwood, IL: Author.
72. Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77, 454–499.
73. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory, a primer. London: Sage.
74. Sijtstra, J. (1997). Balans van het taalonderwijs aan het einde van de basisschool: Uitkomsten van de tweede taalpeiling einde basisonderwijs [Achievements in mother tongue at the end of primary education]. Arnhem: Cito.
75. Slavin, R. (1996). Education for all. Exton, PA: Swets & Zeitlinger.
76. Smith, T. W., Baker, W. K., Hattie, J. A. C., & Bond, L. (2008). A validity study of the certification system of the National Board for Professional Teaching Standards. In L. Ingvarson & J. A. C. Hattie (Eds.), Assessing teachers for professional certification: The first decade of the National Board for Professional Teaching Standards (pp. 345–378). Oxford: Elsevier.
77. Stieger, L. E. W. (2013). Beginning teachers: Issues of the impact of preparation and context on practice. Dissertation Abstracts International Section A: Humanities and Social Sciences, 74, 2013.
78. Teodorović, J. (2011). Classroom and school factors related to student achievement: What works for students? School Effectiveness and School Improvement, 22, 215–236.
79. Tomlinson, C. (2003). Fulfilling the promise of the differentiated classroom: Tools and strategies for responsive teaching. Alexandria, VA: Association for Supervision and Curriculum Development.
80. Tomlinson, C. A. (2005). Grading and differentiation: Paradox or good practice? Theory into Practice, 44, 262–269.
81. Van de Grift, W. J. C. M. (2007). Quality of teaching in four European countries: A review of the literature and application of an assessment instrument. Educational Research, 49, 127–152.
82. Van de Grift, W. J. C. M. (2013). Measuring teaching quality in several European countries. School Effectiveness and School Improvement. Advance online publication. doi:10.1080/09243453.2013.794845
83. Van de Grift, W. J. C. M., & Helms-Lorenz, M. (2012). Vaardigheid en ervaring van leraren [Teaching skills and teacher experience]. Manuscript submitted for publication.
84. Van de Grift, W. J. C. M., Helms-Lorenz, M., & Maulana, R. (2013). Observeren van leraren in opleiding [Observing student teachers]. Manuscript submitted for publication.
85. Van de Grift, W. J. C. M., Van der Wal, M., & Torenbeek, M. (2011). Ontwikkeling in de pedagogisch didactische vaardigheid van leraren in het basisonderwijs [Development of teachers’ teaching skills in primary education]. Pedagogische Studiën, 88, 416–432.
86. von Davier, M. (1994). WINMIRA 2001 [Computer software]. Kiel, Germany: IPN.
87. Wang, M. C., Reynolds, M. C., & Walberg, H. J. (1995). Serving students at the margins. Educational Leadership, 52(4), 12–17.
88. Willms, J. D., & Somer, M.-A. (2001). Family, classroom, and school effects on children’s educational outcomes in Latin America. School Effectiveness and School Improvement, 12, 409–445.
89. Worthen, B. R., Sanders, J. R., & Fitzpatrick, J. L. (1997). Program evaluation: Alternative approaches and practical guidelines. White Plains, NY: Longman.
90. Yair, G. (2000). Educational battlefields in America: The tug-of-war over students’ engagement with instruction. Sociology of Education, 73, 247–269.