Measuring teacher effectiveness: Some methodological reflections

Educational Research and Evaluation

Volumn 12, Issue 1, 2006, Pages 53-74

  Muijs, Daniel ^a  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 32944477496     PISSN: 13803611     EISSN: None     Source Type: Journal    
DOI: 10.1080/13803610500392236     Document Type: Article

References (84)

1. Alliger, G. M., & William, K. J. (1992). Relating the internal consistency of scales to rater response tendencies. Educational and Psychological Measurement, 52, 337-343.
2. Bennett, R. E., & Ward, W. C. (1993). Construction versus choice in cognitive measurement. Hillsdale, NJ: Lawrence Erlbaum.
3. Billiet, J. B., & McClendon, M. J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling, 7, 608-628.
4. Borich, G. (1996) Effective teaching methods (3rd ed.). New York: Macmillan.
5. Brophy, J. E., & Good, T. L. (1986). Teacher behaviour and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (pp. 328-375). New York: Macmillan.
6. Calkins, D., Borich, G. D., Pascone, M., Kugle, C. L., & Marston, P. T. (1997). Generalizability of teacher behaviors across classroom observation systems. Journal of Classroom Interaction, 13(1), 9-22.
7. Campbell, R. J., Kyriakides, L., Muijs, D., & Robinson, W. (2003). Differential teacher effectiveness: Towards a model for research and teacher appraisal. Oxford Review of Education, 29(3), 347-362.
8. Campbell, R. J., Kyriakides, L., Muijs, D., & Robinson, W. (2004). Effective teaching and values: Some implications for research and teacher appraisal. Oxford Review of Education, 30(4), 451-465.
9. Chambers, W. V. (1991). Inferring formal causation from corresponding regressions. Journal of Mind and Behavior, 12(1), 49-70.
10. Charlesworth, R., Hart, C., Burts, D., Thomasson, R., Mosleu, J., & Fleege, P. (1993). Measuring the developmental appropriateness of kindergarten teachers' belief and practices. Early Childhood Research Quarterly, 8, 255-276.
11. Darling-Hammond, L. (2001). Does teacher certification matter? Educational Policy Analysis Archives, 9(2), 57-77.
12. Dickson, G. E. (1983, July). The competency assessment of teachers using high and low inference measurement procedures: A review of research. Paper presented at the World Assembly of the International Council on Education for Teaching, Washington, DC.
13. Embretson, S. E., & Reise, S. P. (Eds.) (2000). Item Response Theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
14. Evertson, C. M., Brophy, J., & Anderson, L. (1978, March). Process-outcome relationships in the Texas Junior High School Study: Compendium. Paper presented at the Annual Meeting of the American Educational Research Association, Toronto, Canada.
15. Fisicaro, S. A., & Vance, R. J. (1994). Comments on the measurement of halo. Educational and Psychological Measurement, 54(2), 366-371.
16. Fox, J. P. (2003). Stochastic EM for estimating the parameters of a multilevel IRT model. British Journal of Mathematics and Statistics in Psychology, 56(1), 65-81.
17. Glas, C. A. W., & Verhelst, N. D. (1995). Testing the Rasch Model. In G. H. Fischer & I. W. Molenaars (Eds.), Rasch models: Foundations, recent developments and applications (pp. 69-96). New York: Springer Verlag.
18. Goldstein, H. (1995). Multilevel statistical models (2nd ed.). London: Arnold.
19. Goldstein, H. (1997). Methods in school effectiveness research. School Effectiveness and School Improvement, 8, 369-395.
20. Goldstein, M. D., Hopkins, J. R., & Strube, M. J. (1994). "The eye of the beholder": A classroom demonstration of observer bias. Teaching of Psychology, 21(3), 154-156.
21. Good, T. L., Grouws, D. A., & Ebmeier, W. (1983). Active mathematics teaching. New York: Longman.
22. Gordon, R. A. (1987). Social desirability bias: A demonstration and technique for its reduction. Teaching of Psychology, 14(1), 40-42.
23. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory. Newbury Park, CA: Sage.
24. Hammersley, M., & Atkinson, P. (1995). Ethnography. London: Taylor & Francis.
25. Harrop, L. A. (1979). An examination of observer bias in a classroom behaviour modification experiment. Educational Studies, 5(2), 97-107.
26. Harter, S. (1985). Manual for the self-perception profile for children. Denver, CO: University of Denver.
27. Hartman, B. W., Fuqua, D. R., & Jenkins, S. J. (1998). The problems of and remedies for nonresponse bias in educational surveys. Journal of Experimental Education, 54(2), 85-90.
28. Hattie, J. (1999, August). Influences on student learning. Inaugural lecture: Professor of Education, Auckland, University of Auckland, New Zealand.
29. Hautamäki, J. (2001). Learning-to-learn. A framework. Helsinki: National Board of Education.
30. Hautamäki, J. (2001). Assessing leaming-to-leam: A framework. Helsinki, Finland: National Board of Education.
31. Hayduk, L. A. (1996). LISREL issues, debates, and strategies. Baltimore: John Hopkins University Press.
32. Hays, R. D., & Ware, J. E. J. (1996). My medical care is better than yours. Social desirability and patient satisfaction ratings. Medical Care, 24(6), 519-525.
33. Heinen, T. (1996). Latent class and discrete latent trait models. Thousand Oaks,CA: Sage.
34. Hook, C. M., & Rosenshine, B. V. (1979). Accuracy of teacher reports of their classroom behavior. Review of Educational Research, 49(1), 1-12.
35. Hox, J., & Maas C. (2001). The accuracy of multilevel Structural Equation Modelling with pseudobalanced groups and small samples. Structural Equation Modeling, 8, 157-174.
36. Johanson, G. A., Gips, G. J., & Rich, C. E. (1993). If you can't say something nice. A variation on the social desirability response set. Evaluation Review, 17, 116-122.
37. Jöreskog, K., & Sörborn, D. (1996). LISREL 8: User's reference guide. Chicago: Scientific Software International.
38. Kaplan, R. M. (1975, April). Is beauty talent? Sex interaction in the attractiveness halo effect. Paper presented at the Annual Meeting of the Western Psychological Association, Los Angeles.
39. Kreft, I., & De Leeuw, J. (1998). Introducing multilevel modeling. London: Sage.
40. Kyriakides, L., Campbell, R. J., & Christofidou, E. (2002). Generating criteria for measuring teacher effectiveness through a self-evaluation approach: A complementary way of measuring teacher effectiveness. School Effectiveness and School Improvement, 13, 291-325.
41. Kyriakides, L., & Charlambous, C. (2004). Extending the scope of analysing data of IEA studies: Applying multilevel modelling techniques to analyse TIMSS data. Proceedings of the IRC 2004, TIMSS, 68-86. Nicosia, Cyprus: University of Cyprus.
42. Lance, C. E., Fisicaro, S. A., & LaPointe, J. A. (1990). An examination of negative halo error in ratings. Educational and Psychological Measurement, 50, 545-553.
43. Levacic, R., Malmberg, L., Steele, F., & Smees, R. (2004, January). The relationship between school climate and head teacher leadership, and pupil attainment: Evidence from a sample of English secondary schools. Paper presented at the International Congress for School Effectiveness and Improvement, Rotterdam, The Netherlands.
44. Marcoulides, G. A., & Schumacker, R. E. (2001). New developments and techniques in Structural Equation Modelling. Mahwah, NJ: Lawrence Erlbaum.
45. Marsh, H. W. (1988). Self-Description-Questionnaire I. SDQ-I manual and research monograph. San Antonio, Texas: The Psychological Corporation.
46. Marston, P. T., & Zimmerer, L. K. (1979). The effect of using more than one type of teacher observation system in the same study. (ERIC Document Reproduction Service No. ED206712). Austin, Texas: Texas University Research and Development Center for Teacher Education.
47. McConnell, J. W., & Bowers, N. D. (1979, April). A comparison of high inference and low inference measures of teacher behaviours. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco.
48. McDowell, L. (1995). The impact of innovative assessment on student learning. Innovations in Education and Training International, 32, 302-313.
49. Medwell, J., & Wray, D. (1997). The effective teaching of literacy. Coventry, UK: University of Warwick Institute of Education.
50. Moorman, R., & Podsakoff, M. (1992). A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behaviour research. Journal of Occupational and Organisational Psychology, 35(4), 218-234.
51. Mortimore, P., Sammons, P., Stoll, L., Lewis, D., & Ecob, R. (1988). School matters. Somerset Wells, UK: Open Books.
52. Muijs, D. (1997). Predictors of academic achievement and academic self-concept: A longitudinal perspective. British Journal of Educational Psychology, 67, 263-277.
53. Muijs, D. (2004). Leading learning: First technical report. Coventry, UK: Warwick Institute of Education.
54. Muijs, R. D., & Reynolds, D. (2000a, January). Effective mathematics teaching: Year 2 of a research project. Paper presented at the International Congress for School Effectiveness and Improvement, Hong Kong.
55. Muijs, R. D., & Reynolds, D. (2000b). School effectiveness and teacher effectiveness: Some preliminary findings from the evaluation of the Mathematics Enhancement Programme. School Effectiveness and School Improvement, 11, 325-337.
56. Muijs, D., & Reynolds, D. (2001a). Effective teaching. Evidence and practice. London: Paul Chapman.
57. Muijs, R. D., & Reynolds, D. (2001b, January). Student background and teacher effects on achievement and attainment in mathematics: A longitudinal study. Paper presented at the International Congress for School Effectiveness and Improvement, Toronto, Canada.
58. Muijs, D., & Reynolds, D. (2002). Teacher beliefs and behaviors: What matters. Journal of Classroom Interaction, 57(2), 3-15.
59. Muthén, B. (1994). Multilevel covariance structure analysis. Sociological Methods and Research, 22(3), 376-398.
60. Nelson, E. A., & Ray, W. J. (1983, August). Observational ratings of teacher performance: Dimensionality and stability. Paper presented at the Annual Meeting of the American Psychological Association, Los Angeles.
61. O'Leary, K. D. (1973). The effects of observer bias infield experimental settings. Final report. (ERIC Document Reproduction Service No. ED078086). Washington, DC: National Center for Educational Research and Development.
62. Opdenakker, M.-C., & Van Damme, J. (2000). The importance of identifying levels in multilevel analysis: An illustration of the effects of ignoring the top or intermediate levels in school effectiveness research. School Effectiveness and School Improvement, 11, 103-130.
63. Opdenakker, M.-C., & Van Damme, J. (2001). Relationship between school composition and characteristics of school process and their effect on mathematic achievement. British Educational Research Journal, 27, 407-432.
64. Owen, S. A. (1976, April). The validity of student ratings: A critique. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco.
65. Padron, Y. N., & Waxman, H. C. (1999). Classroom observations of the five standards of effective teaching in urban classrooms with English language learners. Teaching and Change, 7(1), 79-100.
66. Pearl, J. (2000). Causality. Cambridge: Cambridge University Press.
67. Phelps, L., Schmilz, C. D., & Boatright, B. (1986). The effects of halo and leniency on cooperating teacher reports using Likert-type rating scales. Journal of Educational Research, 79(3), 151-154.
68. Plewis, I. (1997). Statistics in education. London: Arnold.
69. Ritter, J. M., & Langlois, J. H. (1986, April). The role of physical attractiveness in the observation of adult-child interactions: Eye of the beholder or behavioral reality? Paper presented at the Biennial International Conference on Infant Studies, Los Angeles.
70. Rudner, L. M. (1992). Reducing errors due to the use of judges. (ERIC Document Reproduction Service Digest No. ED355254). Washington, DC: ERIC Clearinghouse on Tests, Measurement, and Evaluation.
71. Sanders, W. L., & Horn, S. P. (1994). The Tennessee Value-Added System: Mixed model methodology in educational assessment. Journal of Personnel Evaluation in Education, 8, 299-311.
72. Sanders, W. L., & Horn, S. P. (1995). Educational assessment reassessed: The usefulness of standardised and alternative measures of student achievement as indicators for the assessment of educational outcomes. Educational Policy Analysis Archives, 3(6). Retrieved November 23, 2002, from http://epaa.asu.edu/epaa/v3n6.html
73. Solomon, D., Watson, M., & Deer, J. (1988). Measurement of aspects of classroom environments considered likely to influence children's prosocial development. Moral Education Forum, 13(4), 10-17.
74. Suter, W. N., & Roberts, W. L. (1987). An experimental investigation of the beliefs-of-relatedness source of halo. Contemporary Educational Psychology, 12, 77-85.
75. Tamir, P. (1983). Teachers' self-reports as an alternative strategy for the study of classroom transactions. Journal of Research in Science Teaching, 20(9), 815-823.
76. Tashakkori, A., & Teddlie, C. (1998). Mixed methodology. Thousand Oaks, CA: Sage.
77. Teddlie, C., & Reynolds, D. (2000). International handbook of school effectiveness research. London: Falmer Press.
78. Thompson, B. (1998). Statistical significance testing and effect size reporting: Portrait of a possible future. Research in the Schools, 5(2), 33-38.
79. Veenman, S., Bakermans, J., Franzen, Y., & Van Hoof, M. (1996). Implementation effects of a pre-service course for secondary education teachers. Educational Studies, 22(2), 225-243.
80. Ward, M. D., Clark, C. C., & Harrison, G. V. (1981, April). The observer effect in classroom visitation. Paper presented at the Annual Meeting of the American Educational Research Association, Los Angeles.
81. Widmeyer, W. N., & Loy, J. W. (1988). When you're hot, you're hot! Warm-cold effects in first impressions of persons and teaching effectiveness. Journal of Educational Psychology, 80(1), 118-121.
82. Wiersma, W. (1983, April). Assessment of teacher performance: Constructs of teacher competencies based on factor analysis of observation data. Paper presented at the Annual Meeting of the American Educational Research Association, Montreal, Quebec, Canada.
83. Wiersma, W. (1988). The Alabama Career Incentive Program: A statewide effort in teacher evaluation. (ERIC Document Reproduction Service Digest No. ED298128). Auburn, Alabama: Auburn University College of Education.
84. Woolfolk, A. (1990). Educational psychology. New York: Allyn & Bacon.