Observations and student perceptions of the quality of preservice teachers’ teaching behaviour: construct representation and predictive quality

Learning Environments Research

Volumn 19, Issue 3, 2016, Pages 335-357

  Maulana, Ridwan ^a   Helms Lorenz, Michelle ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Construct representation; Peer teacher ratings; Predictive quality; Student perceptions; Teaching behaviour

Indexed keywords

EID: 84979279871     PISSN: 13871579     EISSN: 15731855     Source Type: Journal    
DOI: 10.1007/s10984-016-9215-8     Document Type: Article

References (66)

1. Aleamoni, L. M. (1981). Student ratings of instruction. In J. Millman (Ed.), Handbook of teacher evaluation (pp. 110–145). London: Sage.
2. Allen, J., Gregory, A., Mikami, A., Lun, J., Hamre, B., & Pianta, R. (2013). Observations of effective teacher-student interactions in secondary school classrooms: Predicting student achievement with the classroom assessment scoring system—Secondary. School Psychology Review, 42, 76–79.
3. Anderson, A., Hamilton, R., & Hattie, J. (2004). Classroom climate and motivated behaviour in secondary schools. Learning Environments Research, 7, 211–225.
4. Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the student engagement instrument. Journal of School Psychology, 44, 427–445.
5. Berliner, D. C. (1988). The development of expertise in pedagogy. New Orleans: American Association of Colleges for Teacher Education.
6. Bozdogan, H. (1987). Model selection and Akaikes information criteria (AIC): The general theory and its analytical extensions. Psychometrika, 52(3), 345–370.
7. Cavanagh, R. F., & Romanoski, J. T. (2006). Rating scale instruments and measurement. Learning Environment Research, 9, 273–289.
8. Cavanagh, R. F., & Waugh, R. F. (2011). Application of Rasch measurement in learning environments research. Rotterdam: Sense Publishers.
9. Cornelius-White, J. (2007). Learner-centred teacher-student relationships are effective: A meta-analysis. Review of Educational Research, 77, 113–143.
10. Creemers, B. P. M. (1994). The effective classroom. London: Cassell.
11. De Jong, R., & Westerhof, K. (2001). The quality of student ratings of teacher behaviour. Learning Environments Research, 4, 51–85.
12. Demars, C. (2010). Items response theory: Understanding statistics measurement. New York: Oxford University Press.
13. Denzin, N. K. (1997). Triangulation in educational research. In J. P. Keeves (Ed.), Educational research methodology and measurement: An international handbook (pp. 318–322). New York: Pergamon.
14. Embretson, S. E. (2007). Mixed Rasch models for measurement in cognitive psychology. In M. T. von Davier & C. H. Carstensen (Eds.), Multivariate and mixture distribution Rasch model: Extensions and applications (pp. 235–253). New York: Springer.
15. Finn, J. D. (1989). Withdrawing from school. Review of Educational Research, 59, 117–142.
16. Fraser, B. (1991). Two decades of classroom environment research. In H. J. Walberg (Ed.), Educational environments: Evaluation, antecedents and consequences (pp. 3–27). Elmsford: Pergamon.
17. Fraser, B. (2007). Classroom learning environments. In S. K. Abell & N. G. Lederman (Eds.), Handbook of research on science education (pp. 103–124). Mahwah: Lawrence Erlbaum.
18. Fraser, B. (2012). Classroom learning environments: Retrospect, context, and prospect. In B. J. Fraser, K. Tobin, & C. J. McRobbie (Eds.), Second international handbook of science education (pp. 1191–1239). New York: Springer.
19. Furrer, C., & Skinner, E. (2003). Sense of relatedness as a factor in children’s academic engagement and performance. Journal of Educational Psychology, 95, 148–162.
20. Klem, A. M., & Connell, J. P. (2004). Relationships matter: Linking teacher support to student engagement and achievement. Journal of School Health, 74, 262–273.
21. Ko, J., & Sammons, P. (2013). Effective teaching: A review of research and evidence. CfBT Education Trust. http://cdn.cfbt.com/~/media/cfbtcorporate/files/research/2013/r-effective-teaching-2013.pdf.
22. Kunter, M., & Baumert, J. (2006). Who is the expert? Construct and criteria validity of student and teacher ratings of instruction. Learning Environments Research, 9, 231–251.
23. Kyriakides, L., Creemers, B. P. M., & Antoniou, P. (2009). Teacher behavior and student outcomes: Suggestions for research on teacher training and professional development. Teaching and Teacher Education, 25, 12–23.
24. Lasagabaster, D., & Sierrra, J. M. (2011). Classroom observation: Desirable conditions established by teachers. European Journal of Teacher Education, 34(4), 449–463.
25. Lawrenz, F., Huffman, D., & Robey, J. (2003). Relationships among student, teacher and observer perceptions of science classrooms and student achievement. International Journal of Science Education, 25(3), 409–420.
26. Lynch, R., McNamara, P. M., & Seery, N. (2012). Promoting deep learning in a teacher education program through self- and peer-assessment and feedback. European Journal of Teacher Education, 35(2), 179–197.
27. Marsh, H. W. (1984). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology, 76, 707–754.
28. Maulana, R. (2012). Teacher-student relationships during the first year of secondary education. Groningen: University of Groningen.
29. Maulana, R., Helms-Lorenz, M., & Van de Grift, W. (2015). Development and evaluation of a questionnaire measuring pre-service teaching behavior: A Rasch modelling approach. School Effectiveness and School Improvement, 26, 169–194.
30. Maulana, R., Opdenakker, M.-C., den Brok, P., & Bosker, R. (2011). Teacher-student interpersonal relationships in Indonesian secondary education: Profiles and importance to student motivation. Asia Pacific Journal of Education, 31(1), 33–49.
31. Maulana, R., Opdenakker, M.-C., den Brok, P., & Bosker, R. (2012a). Teacher–student interpersonal relationships in Indonesian lower secondary education: Teacher and student perceptions. Learning Environments Research, 15, 251–271.
32. Maulana, R., Opdenakker, M.-C., Stroet, K., & Bosker, R. (2012b). Observed lesson structure during the first year of secondary education: Exploration of change and link with academic engagement. Teaching and Teacher Education, 28(6), 835–850.
33. Ministerie van Onderwijs, Cultuur en Wetenschap. (2012). Nota werken in het onderwijs 2012. http://www.rijksoverheid.nl/documenten-en-publicaties/brochures/2011/09/23/nota-werken-in-het-onderwijs.html. Accessed 5 March 2013.
34. Muthen, L. K., & Muthen, B. O. (1999). Mplus users’ guide: The comprehensive modeling program for applied researchers. Los Angeles: Muthen & Muthen.
35. OECD. (2010). PISA 2009 results: What students know and can do. Student performance in reading, mathematics and science. Paris: OECD.
36. Opdenakker, M.-C., Maulana, R., & den Brok, P. (2012). Teacher–student interpersonal relationships and academic motivation within one school year: Developmental changes and linkage. School Effectiveness and School Improvement, 23, 95–119.
37. Patrick, H., & Ryan, M. (2007). Early adolescents’ perceptions of the classroom social environment, motivational beliefs, and engagement. Journal of Educational Psychology, 99, 83–98.
38. Patton, M. Q. (1980). Qualitative evaluation methods. Beverly Hills: Sage.
39. Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38, 109–119.
40. Rasbash, J., Charlton, C., Browne, W. J., Healy, M., & Cameron, B. (2005). MLwiN Version 2.0. Bristol: Centre for Multilevel Modelling, University of Bristol.
41. Riggin, L. J. (1997). Advances in mixed-method evaluation: A synthesis and comment. New Directions for Evaluation, 74, 87–94.
42. Roorda, D. L., Koomen, H. M. Y., Spilt, J. L., & Oort, F. J. (2011). The influence of affective teacher-student relationships on students’ school engagement and achievement: A meta-analytic approach. Review of Educational Research, 81, 493–529.
43. Sabers, D., Cushing, K., & Berliner, D. C. (1991). Differences among expert, novice, and postulant teachers in a task characterized by simultaneity, multidimensionality and immediacy. American Educational Research Journal, 28, 63–88.
44. Saljo, R. (1997). Self-report in educational research. In J. P. Keeves (Ed.), Educational research methodology and measurement: An international handbook (pp. 101–105). New York: Pergamon.
45. Sammons, P., Hillman, J., & Mortimore, P. (1995). Key characteristics of effective schools: A review of school effectiveness research. London: Office for Standards in Education.
46. Sammons, P. M., & Ko, J. (2008). Using systematic classroom observation schedules to investigate effective teaching: Overview of quantitative findings, Effective Classroom Practice (ECP), ESRC Project Report. Nottingham: School of Education, University of Nottingham.
47. Scantlebury, K., Boone, W. J., Kahle, J. B., & Fraser, B. J. (2001). Design, validation, and use of an evaluation instrument for monitoring systematic reform. Journal of Research in Science Teaching, 38, 646–662.
48. Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499.
49. Shuell, T. J. (1996). Teaching and learning in a classroom context. In D. C. Berliner & R. C. Calfee (Eds.), Handbook of educational psychology (pp. 726–764). New York: Macmillan.
50. Smith, R. M. (1996). A comparison of methods for determining dimensionality in Rasch measurement. Structural Equation Modelling, 3, 25–40.
51. Spooren, P., Mortelmans, D., & Thijssen, P. (2012). ‘Content’ versus ‘style’: Acquiescence in student evaluation of teaching. British Journal of Educational Research, 38(1), 3–21.
52. Tu, S., & Xu, L. (2012). A theoretical investigation of several model selection criteria for dimensionality reduction. Pattern Recognition Letters, 33, 1117–1126.
53. Van de Grift, W. (2007). Quality of teaching in four European countries: A review of the literature and application of an assessment instrument. Educational Research, 49(2), 127–152.
54. Van de Grift, W., & Van der Wal. (2010). The measurement of teaching skills with the Rasch model. Paper presented at the International Congress on School Effectiveness and Improvement, Malaysia.
55. Van de Grift, W., & Helms-Lorenz, M. (2012). Vaardigheid en ervaring van leraren [Skills and experience of teachers]. Groningen: Department of Teacher Education, University of Groningen.
56. Van de Grift, W., Helms-Lorenz, M., & Maulana, R. (2013). Observeren van leraren in opleiding [Observed teaching skills of pre-service teachers]. Groningen: Department of Teacher Education, University of Groningen.
57. Van de Grift, W., Helms-Lorenz, M., & Maulana, R. (2014). Teaching skills of student teachers: Calibration of an evaluation instrument and its value in predicting student academic engagement. Studies in Educational Evaluation, 43, 150–159.
58. Van de Grift, W., Houtveen, T., & Vermeulen, C. (1997). Instructional climate in Dutch secondary education. School Effectiveness and School Improvement, 8(4), 449–462.
59. Van de Grift, W. J. C. M., Van der Wal, M., & Torenbeek, M. (2011). Ontwikkeling in de pedagogische didactische vaardigheid van leraren in het basisonderwijs. Pedagogische Studiën, 88, 416–432.
60. Virtanen, T. E., Lerkkanen, M.-J., Poikkeus, A.-M., & Kuorelahti, M. (2013). The relationship between classroom quality and students’ engagement in secondary school. Educational Psychology,. doi:10.1080/01443410.2013.822961.
61. Von Davier, M. (1994). WINMIRA: A program system for analyses with the Rasch model, with the latent class analysis and with the mixed Rasch model. Kiel: Institute for Science Education (IPN).
62. Von Davier, M., & Rost, J. (1994). Self-monitoring—A class variable? In J. Rost, & R. Langeheine (Eds.), Applications of latent trait and latent class models. Proceedings of the IPN Symposium in Sankelmark 1994.
63. Woolley, M. E., & Bowen, G. (2007). In the context of risk: Supportive adults and the school engagement of middle school students. Family Relations, 56, 92–104.
64. Worthen, B. R., Sanders, J. R., & Fitzpatrick, J. L. (1997). Program evaluation: An alternative approaches and practical guidelines. White Plains: Longman.
65. Wubbels, T., & Brekelmans, M. (2005). Two decades of research on teacher-student relationships in class. International Journal of Educational Research, 43(1–2), 6–24.
66. Wubbels, T., & Brekelmans, M. (2012). Teacher-student relationships in the classroom. In B. J. Fraser, K. Tobin, & C. J. McRobbie (Eds.), Second international handbook of science education (pp. 1241–1256). New York: Springer.