Teachers’ judgements of students’ foreign-language achievement

European Journal of Psychology of Education

Volumn 30, Issue 1, 2015, Pages 21-39

  Zhu, Mingjing ^a   Urhahne, Detlef ^b  

^a UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF PASSAU   (Germany)

Author keywords

Judgement accuracy; Misjudged students; Multilevel modelling; Teacher judgement

Indexed keywords

EID: 84904525670     PISSN: 02562928     EISSN: 18785174     Source Type: Journal    
DOI: 10.1007/s10212-014-0225-6     Document Type: Article

References (64)

1. Alvidrez, J., & Weinstein, R. S. (1999). Early teacher perceptions and later student academic achievement. Journal of Educational Psychology. doi:10.1037/0022-0663.91.4.731.
2. Auger, R. W. (2004). The accuracy of teacher reports in the identification of middle school students with depressive symptomatology. Psychology in the Schools. doi:10.1002/pits.10164.
3. Babad, E., Avni-Babad, D., & Rosenthal, R. (2003). Teachers’ brief nonverbal behaviors in defined instructional situations can predict students’ evaluations. Journal of Educational Psychology. doi:10.1037/0022-0663.95.3.553.
4. Bates, C., & Nettelbeck, T. (2001). Primary school teachers’ judgements of reading achievement. Educational Psychology. doi:10.1080/01443410020043878.
5. Begeny, J. C., Eckert, T. L., Montarello, S. A., & Storie, M. S. (2008). Teachers’ perceptions of students’ reading abilities: an examination of the relationship between teachers’ judgments and students’ performance across a continuum of rating methods. School Psychology Quarterly. doi:10.1037/1045-3830.23.1.43.
6. Begeny, J. C., Krouse, H. E., Brown, K. G., & Mann, C. M. (2011). Teacher judgments of students’ reading abilities across a continuum of rating methods and achievement measures. School Psychology Review, 40, 23–38.
7. Bong, M., & Skaalvik, E. M. (2003). Academic self-concept and self-efficacy: how different are they really? Educational Psychology Review. doi:10.1023/A:1021302408382.
8. Brophy, J. E. (1983). Research on the self-fulfilling prophecy and teacher expectations. Journal of Educational Psychology. doi:10.1037/0022-0663.75.5.631.
9. Chen, C. S., & Stevenson, H. W. (1995). Motivation and mathematics achievement: a comparative study of Asian-American, Caucasian-American, and East Asian high school students. Child Development. doi:10.1111/j.1467-8624.1995.tb00932.x.
10. Coladarci, T. (1986). Accuracy of teacher judgments of student responses to standardized test items. Journal of Educational Psychology. doi:10.1037/0022-0663.78.2.141.
11. Cooley, C. H. (1902). Human nature and the social order. New York: Charles Scribner’s Sons.
12. Cronbach, L. J. (1955). Processes affecting scores on “understanding others” and “assumed similarity”. Psychological Bulletin. doi:10.1037/h0044919.
13. Demaray, M. K., & Elliott, S. N. (1998). Teachers’ judgments of students’ academic functioning: a comparison of actual and predicted performances. School Psychology Quarterly. doi:10.1037/h0088969.
14. Dicke, A.-L., Lüdtke, O., Trautwein, U., Nagy, G., & Nagy, N. (2012). Judging students’ achievement goal orientations: are teacher ratings accurate? Learning and Individual Differences. doi:10.1016/j.lindif.2012.04.004.
15. Doherty, J., & Conolly, M. (1985). How accurately can primary school teachers predict the scores of their pupils in standardised tests of attainment? A study of some non-cognitive factors that influence specific judgments. Educational Studies. doi:10.1080/0305569850110105.
16. Doyé, P., & Lüttge, D. (1977). Diagnostischer Leistungstest Englisch 5–6. Braunschweig: Westermann.
17. Enders, C., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: a new look at an old issue. Psychological Methods. doi:10.1037/1082-989X.12.2.121.
18. Feinberg, A. B., & Shapiro, E. S. (2003). Accuracy of teacher judgments in predicting oral reading fluency. School Psychology Quarterly. doi:10.1521/scpq.18.1.52.20876.
19. Feinberg, A. B., & Shapiro, E. S. (2009). Teacher accuracy: an examination of teacher-based judgments of students’ reading with differing achievement levels. The Journal of Educational Research. doi:10.3200/JOER.102.6.453-462.
20. Feng, D. (2006). China’s recent curriculum reform: progress and problems. Planning and Changing, 27, 131–144.
21. Funder, D. C. (1995). On the accuracy of personality judgment: a realistic approach. Psychological Review. doi:10.1037/0033-295X.102.4.652.
22. Funder, D. C. (2012). Accuracy of personality judgment. Current Directions in Psychological Science. doi:10.1177/0963721412445309.
23. Gao, L., & Watkins, D. A. (2002). Conceptions of teaching held by school science teachers in P.R. China: identification and cross-cultural comparisons. Science Education. doi:10.1080/09500690110066926.
24. Gao, X., Barkhuizen, G., & Chow, A. W. K. (2011). ‘Nowadays, teachers are relatively obedient’: understanding primary school English teachers’ conception of and drives for research in China. Language Teaching Research. doi:10.1177/1362168810383344.
25. Givvin, K. B., Stipek, D. J., Salmon, J. M., & MacGyvers, V. L. (2001). In the eyes of the beholder: students’ and teachers’ judgments of students’ motivation. Teaching and Teacher Education. doi:10.1016/S0742-051X(00)00060-3.
26. Havenstein, N. M., & Alexander, R. A. (1991). Rating ability in performance judgments: the joint influence of implicit theories and intelligence. Organizational Behavior and Human Decision Processes. doi:10.1016/0749-5978(91)90024-N.
27. Heck, R. H., Thomas, S. L., & Tabata, L. N. (2010). Multilevel and longitudinal modeling with SPSS. New York: Routledge.
28. Helmke, A., & Schrader, F.-W. (1987). Interactional effects of instructional quality and teacher judgment accuracy on achievement. Teaching and Teacher Education. doi:10.1016/0742-051X(87)90010-2.
29. Hoge, R. D., & Butcher, R. (1984). Analysis of teacher judgments of pupil achievement levels. Journal of Educational Psychology. doi:10.1037/0022-0663.76.5.777.
30. Hoge, R. D., & Coladarci, T. (1989). Teacher-based judgments of academic achievement: a review of literature. Review of Educational Research. doi:10.3102/00346543059003297.
31. Hoge, R. D., & Cudmore, L. (1986). The use of teacher-judgment measures in the identification of gifted pupils. Teaching and Teacher Education. doi:10.1016/0742-051X(86)90016-8.
32. Hox, J. J., & Maas, C. J. M. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling. doi:10.1207/S15328007SEM0802_1.
33. Jin, L. X., & Cortazzi, M. (2002). English language teaching in China: a bridge to the future. Asia Pacific Journal of Education. doi:10.1080/0218879020220206.
34. Jussim, L. (1989). Teacher expectations: self-fulfilling prophecies, perceptual biases, and accuracy. Journal of Personality and Social Psychology. doi:10.1037/0022-3514.57.3.469.
35. Kaiser, J., Helm, F., Retelsdorf, J., Südkamp, A., & Möller, J. (2012). Zum Zusammenhang von Intelligenz und Urteilsgenauigkeit bei der Beurteilung von Schülerleistungen im Simulierten Klassenraum [On the relation of intelligence and judgment accuracy in the process of assessing student achievement in the simulated classroom]. Zeitschrift für Pädagogische Psychologie. doi:10.1024/1010-0652/a000076.
36. Leucht, M., Tiffin-Richards, S., Vock, M., Pant, H. A., & Köller, O. (2012). Diagnostische Kompetenz von Englischlehrkräften. Diagnostische Kompetenz von Englischlehrkräften bei der Bewertung von Schülerleistungen mit Hilfe des Gemeinsamen Europäischen Referenzrahmens für Sprachen [English teachers’ diagnostic skills in judging their students’ competences on the basis of the Common European Framework of Reference]. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie. doi:10.1026/0049-8637/a000071.
37. Maas, C. J. M., & Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica. doi:10.1046/j.0039-0402.2003.00252.x.
38. Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology. doi:10.1027/1614-1881.1.3.86.
39. Pekrun, R. (2006). The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review. doi:10.1007/s10648-006-9029-9.
40. Pekrun, R., Frenzel, A. C., Goetz, T., & He, S. (2005). Achievement Emotions Questionnaire-Mathematics (AEQ-M). Chinese version. User’s manual. Munich: University of Munich.
41. Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: a program of quantitative and qualitative research. Educational Psychologist. doi:10.1207/S15326985EP3702_4.
42. Pekrun, R., Goetz, T., Perry, R. P., Kramer, K., & Hochstadt, M. (2004). Beyond test anxiety: development and validation of the Test Emotions Questionnaire (TEQ). Anxiety, Stress and Coping. doi:10.1080/10615800412331303847.
43. Phelps, L. (2005). Academic achievement of children in China: the 2002 Fulbright experience. Psychology in the Schools. doi:10.1002/pits.20074.
44. PISA-Konsortium Deutschland (Ed.). (2006). PISA 2003. Dokumentation der Erhebungsinstrumente [PISA 2003. Documentation of measuring instruments]. Münster: Waxmann.
45. Ready, D. D., & Wright, D. L. (2011). Accuracy and inaccuracy in teachers’ perceptions of young children’s cognitive abilities: the role of child background and classroom context. American Educational Research Journal. doi:10.3102/0002831210374874.
46. Schrader, F.-W., & Helmke, A. (1987). Diagnostische Kompetenz von Lehrern: Komponenten und Wirkungen [Diagnostic competence of teachers: Components and effects]. Empirische Pädagogik, 1, 27–52.
47. Schunk, D. H., Pintrich, P. R., & Meece, J. L. (2008). Motivation in education. Theory, research, and applications. Upper Saddle River: Pearson Education.
48. Sharpley, C. F., & Edgar, E. (1986). Teachers’ rating vs. standardized test: an empirical investigation of agreement between two indices of achievement. Psychology in the Schools. doi:10.1002/1520-6807(198601)23:1<106::AID-PITS2310230117>3.0.CO;2-C.
49. Shavelson, R. J. (1983). Review of research on teachers’ pedagogical judgment, plans, and decisions. The Elementary School Journal, 83, 392–413.
50. Shavelson, R. J., & Stern, P. (1981). Research on teachers’ pedagogical thoughts, judgments, decisions, and behavior. Review of Educational Research. doi:10.3102/00346543051004455.
51. Shulman, L. (1986). Those who understand: knowledge growth in teaching. Educational Researcher. doi:10.3102/0013189X015002004.
52. Snijders, T. A. B., & Bosker, R. J. (1994). Modeled variance in two-level models. Sociological Methods & Research. doi:10.1177/0049124194022003004.
53. Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: an introduction to basic and advanced multilevel modeling. Thousand Oaks: Sage.
54. Stevenson, H. W., Lee, S., Chen, C., Lummis, M., Stigler, J., Liu, F., & Fang, G. (1990). Mathematics achievement of children in China and the United States. Child Development. doi:10.2307/1130875.
55. Stevenson, H. W., Lee, S., & Stigler, J. W. (1986). Mathematics achievement of Chinese, Japanese, and American children. Science. doi:10.1126/science.3945803.
56. Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers’ judgments of students’ academic achievement: a meta-analysis. Journal of Educational Psychology. doi:10.1037/a0027627.
57. Südkamp, A., Möller, J., & Pohlmann, B. (2008). Der Simulierte Klassenraum: Eine experimentelle Untersuchung zur diagnostischen Kompetenz [The simulated classroom: an experimental study on diagnostic competence]. Zeitschrift für Pädagogische Psychologie. doi:10.1024/1010-0652.22.34.261.
58. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics. Boston: Allyn and Bacon.
59. Urhahne, D., Chao, S.-H., Florineth, M. L., Luttenberger, S., & Paechter, M. (2011). Academic self-concept, learning motivation, and test anxiety of the underestimated student. British Journal of Educational Psychology. doi:10.1348/000709910X504500.
60. Urhahne, D., Zhou, J., Stobbe, M., Chao, S.-H., Zhu, M., & Shi, J. (2010). Motivationale und affektive Merkmale unterschätzter Schüler. Ein Beitrag zur diagnostischen Kompetenz von Lehrkräften [Motivational and affective characteristics of underestimated students: a contribution to the diagnostic competence of teachers]. Zeitschrift für Pädagogische Psychologie. doi:10.1024/1010-0652/a000021.
61. Wang, W., & Gao, X. (2008). English language education in China: a review of selected research. Journal of Multilingual and Multicultural Development. doi:10.1080/01434630802147908.
62. Zaunbauer, A. C. M., Retelsdorf, J., & Möller, J. (2009). Die Vorhersage von Englischleistungen am Anfang der Sekundarstufe [Prediction of English achievement in early secondary school]. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie. doi:10.1026/0049-8637.41.3.153.
63. Zhou, J., & Urhahne, D. (2013). Teacher judgment, student motivation, and the mediating effect of attributions. European Journal of Psychology of Education. doi:10.1007/s10212-012-0114-9.
64. Ziegler, A., Dresel, M., Schober, B., & Stöger, H. (2005). Ulm Motivational Test Battery (UMTB): Documentation of items and scales (Ulm Educational Research Report, No. 15). Ulm: Ulm University, Department of Educational Psychology.