Developing an Instrument for Teacher Feedback: Using the Rasch Model to Explore Teachers' Development of Effective Teaching Strategies and Behaviors

Journal of Experimental Education

Volumn 86, Issue 2, 2018, Pages 247-264

  van der Lans, Rikkert M ^a   van de Grift, Wim J C M ^a   van Veen, K ^a  

^a University of Griningen   (Netherlands)

Author keywords

Rasch model; teacher development; teacher effectiveness; teacher evaluation; teaching quality

Indexed keywords

EID: 85008311839     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.1080/00220973.2016.1268086     Document Type: Article

References (52)

1. Andersen, E. B., (1973). A goodness of fit test for the Rasch model. Psychometrika, 38, 123–140.
2. Berliner, D., (2001). Learning about learning from expert teachers. International Journal of Educational Research, 35, 463–483.
3. Bates, D., Maechler, M., Bolker, B., & Walker, S., (2014). lme4: Linear mixed-effects models using S4 classes. R package version 1.1–7. Retrieved from http://CRAN.R-project.org/package=lme4
4. Berliner, D. C., (2004). Expert teachers: Their characteristics, development and accomplishments. R., Batllori i Obiols, A. E., Gomez Martinez, M., Oller i Freixa & J., Pages i. Blanch (Eds.), De la teoria…. a l’aula: Formacio del professorat ensenyament de las ciències socials, 13–28.
5. Bond, T. G., & Fox, C. M., (2007). Applying the Rasch model: Fundamental measurement in the human sciences. London, UK: Lawrence Erlbaum.
6. Cai, L., Thissen, D., & Du Toit, S., (2005–2013). IRTPRO (Version 2.1) [Computer software]. Lincolnwood, IL: Scientific Software.
7. Chen, W. H., & Thissen, D., (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265–289.
8. Cheung, W. M., & Wong, W. M., (2013). Does lesson study work? A systematic review on the effects of lesson study and learning study on teachers and students. International Journal for Lesson and Learning Studies, 3(2), 137–149. doi.org/10.1108/IJLLS-05-2013-0024.
9. Conway, P. F., & Clark, C. M., (2003). The journey inward and outward: A re-examination of Fuller's concerns-based model of teacher development. Teaching and Teacher Education, 19, 465–482.
10. Cromley, J. G., Perez, T. C., Fitzhugh, S. L., Newcombe, N. S., Wills, T. W., & Tanaka, J. C., (2013). Improving students' diagram comprehension with classroom instruction. Journal of Experimental Education, 81, 511–537. doi:10.1080/00220973.2012.745465
11. Danielson, C., (2013). The framework for teaching: Evaluation instrument. Princeton, NJ: The Danielson Group.
12. Darling-Hammond, L., Amrein-Beardsley, A., Heartel, E., & Rothstein J., (2012). Evaluation teacher evaluation. Phi Delta Kappan, 93, 8–15.
13. Day, C., Sammons, P., Stobart, G., Kingston, A., & Gu, Q., (2007). Teachers matter: Connecting lives, work and effectiveness. Maidenhead, UK: Open University Press.
14. De Boeck, P., Bakker, M., Zwitser, R., Nivard, M., Abe, H., Tuerlinckx, F., & Partchev, I., (2011). The estimation of item response models with the lmer function from the lme4 package in R. Journal of Statistical Software, 39, 1–25.
15. DeMars, C., (2010). Item response theory: Understanding statistics measurement. New York: Oxford University Press.
16. Doran, H., Bates, D., Blies, P., & Dowling, M., (2007). Estimating the multilevel Rasch model with the lme4 package. Journal of Statistical Software, 20, 1–18.
17. Fuller, F., (1969). Concerns of teachers: A developmental conceptualization. American Educational Research Journal, 6, 207–226.
18. Hill, H. C., Besiegel, M., & Jacob, R., (2013). Professional development research: Consensus, crossroads and challenges. Educational Researcher, 42, 476–487. doi:10.3102/0013189X13512674
19. Haberman, S. J., (2008). When can subscores have value? Journal of Educational and Behavioral Statistics, 33(2), 204–229. doi:10.3102/1076998607302636
20. Hattie, J., (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Abingdon, UK: Routledge.
21. Hu, L., & Bentler, M., (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. doi:10.1080/10705519909540118
22. Huberman, M., (1993). The lives of teachers. New York, NY: Teachers College Press.
23. Kagan, D. M., (1992). Professional growth among pre-service and beginning teachers. Review of Educational Research, 62, 129–169.
24. Kane, T. J., Staiger, D. O., McCaffrey, D., Cantrell, S., Archer, J., Buhayar, S., Kerr, K., Kawakita, T., & Parker, D., (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle, WA: Bill and Melinda Gates Foundation.
25. Kline, R. B., (2011). Principles and practice of structural equation modeling (3rd edition). New York, NY: Guilford Press.
26. Koller, I., & Hatzinger R., (2013). Nonparametric tests for the Rasch model: Explanation, development, and application of quasi-exact tests for small samples. Interstat, 11, 1–16.
27. Kyriakides, L., (2013). What matters for student learning outcomes: A meta-analysis of studies exploring factors of effective teaching. Teaching and Teacher Education, 36, 143–152.
28. Kyriakides, L., Creemers, B. P. M., & Antaniou, P., (2009). Teacher behavior and student outcomes: Suggestions for research on teacher training and professional development. Teaching and Teacher Education, 25, 12–23.
29. Mair, P., & Hatzinger, R., (2007). Extended Rasch modelling: The eRm package for the application of IRT models in R. Journal of Statistical Software, 20, 1–20.
30. Marzano, R. J., (2003). What works in schools: Translating research into action. Alexandria, VA: Association for Supervision and Curriculum Development.
31. Maulana, R., Helms-Lorenz, M., & Van de Grift, W., (2015). Development and evaluation of a questionnaire measuring pre-service teachers’ teaching behaviour: A Rasch modelling approach. School Effectiveness and School Improvement, 26(2), 169–194.
32. Mourshed, M., Chijioke C., & Barber, M., (2010). How the world's most improved school systems keep getting better. London: McKinsey Company.
33. Muthén, L. K., & Muthén, B. O., (1998–2012). Mplus user's guide (7th ed.). Los Angeles, CA: Muthén and Muthén.
34. NCTQ. (2013). Connect the dots: Using evaluations of teaching effectiveness to inform policy and practice. Washington, DC: National Council on Teacher Quality.
35. Patrick, H., & Mantzicopolous, P., (2016). Is effective teaching stable? Journal of Experimental Education, 84, 23–47. doi:10.1080/00220973.2014.952398
36. Pianta, R. C., & Hamre, B. K., (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109–119. doi:10.3102/0013189X09332374
37. Ponocny, I., (2001). Non-parametric goodness-of-fit tests for the Rasch model. Psychometrika, 66, 437–460.
38. Rasch, G., (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Nielsen and Lydiche.
39. Richardson, V., & Placier, A., (2001). Teacher change. In V., Richardson (Ed.), Handbook of research on teaching (4th ed.). Washington, DC: American Educational Research Association.
40. Rizopoulos, D., (2006). ltm: An R package for latent variable modeling and item response theory analyses. Journal of Statistical Software, 17, 1–25.
41. Sternberg, R. J., & Horvath, J. A., (1995). A prototype view of expert teaching. Educational Researcher, 24, 9–17.
42. Steiger, J. H., (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Difference, 42, 893–898.
43. Stout, W. F., (1990). A new item response theory modeling approach with applications to unidimensionality assessment and ability estimation. Psychometrika, 55(2), 293–325.
44. Timmerman, M. E., Lorenzo-Seva, U., & Ceulemans, E., (in press). The number of factors problem. In P., Irwing, T., Booth, & D. J., Hughes (eds.), The Wiley-Blackwell Handbook of Psychometric Testing. Chinchester, UK: John Wiley & Sons.
45. van de Grift, W. J. C. M., (2014). Measuring teaching quality in several European countries. School effectiveness and school improvement, 25(3), 295–311. doi:10.1080/09243453.2013.794845
46. van de Grift, W. J. C. M., Helms-Lorenz, M., & Maulana, R., (2014). Teaching skills of student teachers: Calibration of an evaluation instrument and its value in predicting student academic engagement. Studies in Educational Evaluation, 43, 150–159 doi: 10.1016/j.stueduc.2014.09.003
47. van de Grift, W. J. C. M. & Lam, J.F. (1998). Het didactisch handelen in het basisonderwijs. [Teachers’ instructions in primary education.] Tijdschrift voor Onderwijsresearch 23(3), 224–241.
48. van de Grift, W. J. C. M., van der Wal, M., & Torenbeek, M., (2011). Ontwikkeling in de pedagogische didactische vaardigheid van leraren in het basisonderwijs. [Primary teachers’ development of pedagogical didactical skill.] Pedagogische Studiën, 88, 416–432.
49. van der Lans, R. M., van de Grift, W. J., & van Veen, K., (2015). Developing a Teacher Evaluation Instrument to Provide Formative Feedback Using Student Ratings of Teaching Acts. Educational Measurement: Issues and Practice, 34(3), 18–27. doi: 10.1111/emip.12078
50. van der Lans, R. M., van de Grift, W. J. C. M., van Veen, K., & Fokkens-Bruinsma, M., (2016). Once is not enough: Establishing reliability criteria for feedback and evaluative decisions using classroom observation. Studies in Educational Evaluation, 50, 88–95. doi:10.1016/j.stueduc.2016.08.001
51. Winters, M. A., & Cowen, J. M., (2014). Who would stay, who would be dismissed? An empirical consideration of value-added teacher retention policies. Educational Researcher, 42, 330–337. DOI: 10.3102/0013189X13496145
52. Wubbels, T., & Brekelmans, M., (2005). Two decades of research on teacher-student relationships in class. International Journal of Educational Research, 43, 6–24. doi:10.1016/j.ijer.2006.03.003