The effects of student characteristics on teachers' judgment accuracy: Disentangling ethnicity, minority status, and achievement

Journal of Educational Psychology

Volumn 109, Issue 6, 2017, Pages 871-888

  Kaiser, Johanna ^a   Südkamp, Anna ^b   Möller, Jens ^a  

^a UNIVERSITY OF KIEL   (Germany)

^b TU DORTMUND UNIVERSITY   (Germany)

Author keywords

Academic achievement; Judgment accuracy; Minority students; Teacher judgment

Indexed keywords

EID: 85003846666     PISSN: 00220663     EISSN: 19392176     Source Type: Journal    
DOI: 10.1037/edu0000156     Document Type: Article

References (74)

1. Alvidrez, J., & Weinstein, R. S. (1999). Early teacher perceptions and later student academic achievement. Journal of Educational Psychology, 91, 731-746. http://dx.doi.org/10.1037/0022-0663.91.4.731
2. American Federation of Teachers, National Council on Measurement in Education, & National Education Association. (1990). Standards for teacher competence in educational assessment of students. Retrieved from http://buros.org/standards-teacher-competence-educationalassessment- students
3. Bailey, A. L., & Drummond, K. V. (2006). Who is at risk and why? Teachers' reasons for concern and their understanding and assessment of early literacy. Educational Assessment, 11, 149-178. http://dx.doi.org/ 10.1080/10627197.2006.9652988
4. Baker, C. N., Tichovolsky, M. H., Kupersmidt, J. B., Voegler-Lee, M. E., & Arnold, D. H. (2015). Teacher (mis)perceptions of preschoolers' academic skills: Predictors and associations with longitudinal outcomes. Journal of Educational Psychology, 107, 805-820. http://dx.doi.org/10 .1037/edu0000008
5. Baron, R. M., Tom, D. Y. H., & Cooper, H. M. (1985). Social class, race, and teacher expectations. In J. B. Dusek (Ed.), Teacher expectancies (pp. 251-269). Hillsdale, NJ: Erlbaum.
6. Begeny, J. C., Eckert, T. L., Montarello, S. A., & Storie, M. S. (2008). Teachers' perceptions of students' reading abilities: An examination of the relationship between teachers' judgments and students' performance across a continuum of rating methods. School Psychology Quarterly, 23, 43-55. http://dx.doi.org/10.1037/1045-3830.23.1.43
7. Bennett, R. E., Gottesman, R. L., Rock, D. A., & Cerullo, F. (1993). Influence of behavior perceptions and gender on teachers' judgments of students' academic skill. Journal of Educational Psychology, 85, 347-356. http://dx.doi.org/10.1037/0022-0663.85.2.347
8. Chang, D. F., & Sue, S. (2003). The effects of race and problem type on teachers' assessments of student behavior. Journal of Consulting and Clinical Psychology, 71, 235-242. http://dx.doi.org/10.1037/0022-006X .71.2.235
9. Clark, C. M., & Peterson, P. L. (1986). Teachers' thought processes. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 255-296). New York, NY: Macmillan.
10. Dusek, J. B., & Joseph, G. (1983). The bases of teacher expectancies: A meta-analysis. Journal of Educational Psychology, 75, 327-346. http:// dx.doi.org/10.1037/0022-0663.75.3.327
11. Eisen, S. V., & McArthur, L. Z. (1979). Evaluating and sentencing a defendant as a function of his salience and the perceiver's set. Personality and Social Psychology Bulletin, 5, 48-52. http://dx.doi.org/10 .1177/014616727900500110
12. Elliott, J., Lee, S. W., & Tollefson, N. (2001). A reliability and validity study of the dynamic indicators of basic early literacy skills-modified. School Psychology Review, 30, 33-49.
13. Feinberg, A. B., & Shapiro, E. S. (2009). Teacher accuracy: An examination of teacher-based judgments of students' reading with differing achievement levels. The Journal of Educational Research, 102, 453-462. http://dx.doi.org/10.3200/JOER.102.6.453-462
14. Ferreira, M. B., Garcia-Marques, L., Sherman, S. J., & Sherman, J. W. (2006). Automatic and controlled components of judgment and decision making. Journal of Personality and Social Psychology, 91, 797-813. http://dx.doi.org/10.1037/0022-3514.91.5.797
15. Fiedler, K., Freytag, P., & Unkelbach, C. (2007). Pseudocontingencies in a simulated classroom. Journal of Personality and Social Psychology, 92, 665-677. http://dx.doi.org/10.1037/0022-3514.92.4.665
16. Fiedler, K., Walther, E., Freytag, P., & Plessner, H. (2002). Judgment biases in a simulated classroom-A cognitive-environmental approach. Organizational Behavior and Human Decision Processes, 88, 527-561. http://dx.doi.org/10.1006/obhd.2001.2981
17. Fiske, S. T., & Taylor, S. E. (1991). Social cognition (2nd ed.). New York, NY: McGraw-Hill.
18. Friedrich, R. J. (1982). In defense of multiplicative terms in multiple regression equations. American Journal of Political Science, 26, 797-833. http://dx.doi.org/10.2307/2110973
19. Glock, S., & Krolak-Schwerdt, S. (2014). Stereotype activation versus application: How teachers process and judge information about students from ethnic minorities and with low socioeconomic background. Social Psychology of Education, 17, 589 -607. http://dx.doi.org/10.1007/ s11218-014-9266-6
20. Hachfeld, A., Anders, Y., Schroeder, S., Stanat, P., & Kunter, M. (2010). Does immigration background matter? How teachers' predictions of students' performance relate to student background. International Journal of Educational Research, 49, 78-91. http://dx.doi.org/10.1016/j.ijer .2010.09.002
21. Harlen, W. (2005). Trusting teachers' judgement: Research evidence of the reliability and validity of teachers' assessment used for summative purposes. Research Papers in Education, 20, 245-270. http://dx.doi.org/ 10.1080/02671520500193744
22. Hattie, J. A. C. (2002). Classroom composition and peer effects. International Journal of Educational Research, 37, 449-481. http://dx.doi.org/ 10.1016/S0883-0355(03)00015-6
23. Heilman, M. E. (1980). The impact of situational factors on personnel decisions concerning women: Varying the sex composition of the applicant pool. Organizational Behavior and Human Performance, 26, 386-395. http://dx.doi.org/10.1016/0030-5073(80)90074-4
24. Helwig, R., Anderson, L., & Tindal, G. (2001). Influence of elementary student gender on teachers' perceptions of mathematics achievement. The Journal of Educational Research, 95, 93-102. http://dx.doi.org/10 .1080/00220670109596577
25. Higgins, E. T. (1989). Knowledge accessibility and activation: Subjectivity and suffering from unconscious sources. In J. S. Uleman & J. A. Bargh (Eds.), Unintended thought (pp. 75-123). New York, NY: Guilford Press.
26. Hoge, R. D. (1983). Psychometric properties of teacher-judgment measures of pupil aptitudes, classroom behaviors, and achievement levels. The Journal of Special Education, 17, 401-429. http://dx.doi.org/10.1177/ 002246698301700404
27. Hoge, R. D., & Coladarci, T. (1989). Teacher-based judgments of academic achievement: A review of literature. Review of Educational Research, 59, 297-313. http://dx.doi.org/10.3102/00346543059003297
28. Hox, J. J. (2002). Multilevel analysis techniques and applications. Mahwah, NJ: Erlbaum.
29. Hurwitz, J. T., Elliott, S. N., & Braden, J. P. (2007). The influence of test familiarity and student disability status upon teachers' judgments of students' test performance. School Psychology Quarterly, 22, 115-144. http://dx.doi.org/10.1037/1045-3830.22.2.115
30. Jussim, L., & Eccles, J. (1995). Are teacher expectations biased by students' gender, social class, or ethnicity? In Y.-T. Lee, L. J. Jussim, & C. R. McCauley (Eds.), Stereotype accuracy: Toward appreciating group differences (pp. 245-271). Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10495-010
31. Jussim, L., & Harber, K. D. (2005). Teacher expectations and self-fulfilling prophecies: Knowns and unknowns, resolved and unresolved controversies. Personality and Social Psychology Review, 9, 131-155. http://dx .doi.org/10.1207/s15327957pspr0902_3
32. Kaiser, J., Helm, F., Retelsdorf, J., Südkamp, A., & Möller, J. (2012). Zum Zusammenhang von Intelligenz und Urteilsgenauigkeit bei der Beurteilung von Schülerleistungen im Simulierten Klassenraum [On the relation of intelligence and judgment accuracy in the process of assessing student achievement in the simulated classroom]. Zeitschrift für Pädagogische Psychologie/German Journal of Educational Psychology, 26, 251-261.
33. Kaiser, J., Retelsdorf, J., Südkamp, A., & Möller, J. (2013). Achievement and engagement: How student characteristics influence teacher judgments. Learning and Instruction, 28, 73-84. http://dx.doi.org/10.1016/ j.learninstruc.2013.06.001
34. Kanter, R. M. (1977). Some effects of proportions on group life: Skewed sex-ratios and responses to token women. American Journal of Sociology, 82, 965-990. http://dx.doi.org/10.1086/226425
35. Leonesio, R. J., & Nelson, T. O. (1990). Do different metamemory judgments tap the same underlying aspects of memory? Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 464-467. http://dx.doi.org/10.1037/0278-7393.16.3.464
36. Leucht, M., Tiffin-Richards, S., Vock, M., Pant, H. A., & Köller, O. (2012). Diagnostische Kompetenz von Englischlehrkräften bei der Bewertung von Schülerleistungen mit Hilfe des Gemeinsamen Europäischen Referenzrahmens für Sprachen [English teachers' diagnostic skills in judging their students' competencies on the basis of the Common European Framework of Reference]. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 44, 163-177. http://dx.doi.org/ 10.1026/0049-8637/a000071
37. Luciak, M. (2003). The educational situation of migrants and ethnic minorities in 15 EU member states in comparative perspective. Retrieved from http://www.inst.at/trans/15Nr/08_1/luciak15.htm
38. Luciak, M. (2006). Minority schooling and intercultural education: A comparison of recent developments in the old and new EU member states. Intercultural Education, 17, 73-80. http://dx.doi.org/10.1080/ 14675980500502370
39. Madon, S., Jussim, L., Keiper, S., Eccles, J., Smith, A., & Palumbo, P. (1998). The accuracy and power of sex, social class, and ethnic stereotypes: A naturalistic study in person perception. Personality and Social Psychology Bulletin, 24, 1304-1318. http://dx.doi.org/10.1177/ 01461672982412005
40. Marsh, H. W. (1987). The big-fish-little-pond effect on academic selfconcept. Journal of Educational Psychology, 79, 280-295. http://dx.doi .org/10.1037/0022-0663.79.3.280
41. McArthur, L. Z., & Solomon, L. K. (1978). Perceptions of an aggressive encounter as a function of the victim's salience and the perceiver's arousal. Journal of Personality and Social Psychology, 36, 1278-1290. http://dx.doi.org/10.1037/0022-3514.36.11.1278
42. McKown, C., & Weinstein, R. S. (2008). Teacher expectations, classroom context, and the achievement gap. Journal of School Psychology, 46, 235-261. http://dx.doi.org/10.1016/j.jsp.2007.05.001
43. Mitman, A. L. (1985). Teachers' differential behavior toward higher and lower achieving students and its relation to selected teacher characteristics. Journal of Educational Psychology, 77, 149-161. http://dx.doi .org/10.1037/0022-0663.77.2.149
44. Möller, J., Pohlmann, B., Köller, O.,&Marsh, H. W. (2009). A meta-analytic path analysis of the internal/external frame of reference model of academic achievement and academic self-concept. Review of Educational Research, 79, 1129-1167. http://dx.doi.org/10.3102/0034654309337522
45. Muthén, B. O., & Satorra, A. (1995). Complex sample data in structural equation modeling. In P. V. Marsden (Ed.), Sociological methodology (pp. 267-316). Washington, DC: American Sociological Association. http://dx.doi.org/10.2307/271070
46. Muthén, L. K., & Muthén, B. O. (2010). Mplus (Version 6) [Computer software]. Los Angeles, CA: Author.
47. National Board for Professional Teaching Standards. (2002). What teachers should know and be able to do. Arlington, VA: Author. Retrieved from http://www.nbpts.org/UserFiles/File/what_teachers.pdf
48. Peterson, E. R., Rubie-Davies, C., Osborne, D., & Sibley, C. (2016). Teachers' explicit expectations and implicit prejudiced attitudes to educational achievement: Relations with student achievement and the ethnic achievement gap. Learning and Instruction, 42, 123-140. http:// dx.doi.org/10.1016/j.learninstruc.2016.01.010
49. Prenzel, M., Artelt, C., Baumert, J., Blum, W., Hammann, M., Klieme, E., & Pekrun, R. (2008). PISA 2006 in Deutschland. Die Kompetenzen der Jugendlichen im dritten Ländervergleich [PISA 2006 in Germany]. Münster, Germany: Waxmann.
50. Ready, D. D., & Wright, D. L. (2011). Accuracy and inaccuracy in teachers' perceptions of young children's cognitive abilities: The role of child background and classroom context. American Educational Research Journal, 48, 335-360. http://dx.doi.org/10.3102/0002831210374874
51. Roick, T., Gölitz, D., & Hasselhorn, M. (2004). DEMAT 3. Deutscher Mathematiktest für dritte Klassen [DEMAT 3. German mathematics test for third grades]. Göttingen, Germany: Beltz.
52. Rosenthal, R., & Jacobson, L. (1968). Pygmalion in the classroom: Teacher expectation and pupils' intellectual development. New York, NY: Holt, Rinehart & Winston.
53. Rubie-Davies, C., Hattie, J., & Hamilton, R. (2006). Expecting the best for students: Teacher expectations and academic outcomes. The British Journal of Educational Psychology, 76, 429-444. http://dx.doi.org/10 .1348/000709905X53589
54. Schneider, B., & Lee, Y. (1990). A model for academic success: The school and home environment of East Asian students. Anthropology & Education Quarterly, 21, 358-377. http://dx.doi.org/10.1525/aeq.1990 .21.4.04x0596x
55. Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57, 1-22. http://dx.doi.org/10 .17763/haer.57.1.j463w79r56455411
56. Spinath, B. (2005). Akkuratheit der Einschätzung von Schülermerkmalen durch Lehrer und das Konstrukt der diagnostischen Kompetenz [Accuracy of teacher judgments on student characteristics and the construct of diagnostic competence]. Zeitschrift für Pädagogische Psychologie/ German Journal of Educational Psychology, 19, 85-95.
57. Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers' judgments of students' academic achievement: A meta-analysis. Journal of Educational Psychology, 104, 743-762. http://dx.doi.org/10.1037/ a0027627
58. Südkamp, A., & Möller, J. (2009). Referenzgruppeneffekte im Simulierten Klassenraum: Direkte und indirekte Einschätzungen von Schülerleistungen [Reference-group effects in a simulated classroom: Direct and indirect judgments]. Zeitschrift für Pädagogische Psychologie/German Journal of Educational Psychology, 23, 161-174.
59. Südkamp, A., Möller, J., & Pohlmann, B. (2008). Der Simulierte Klassenraum: Eine experimentelle Untersuchung zur diagnostischen Kompetenz [The simulated classroom: An experimental study on diagnostic competence]. Zeitschrift für Pädagogische Psychologie/German Journal of Educational Psychology, 22, 261-276.
60. Taylor, S. E., & Fiske, S. T. (1978). Salience, attention, and attribution: Top of the head phenomena. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 11, pp. 249-288). New York, NY: Academic Press. http://dx.doi.org/10.1016/S0065-2601(08)60009-X
61. Taylor, S. E., & Thompson, S. C. (1982). Stalking the elusive "vividness" effect. Psychological Review, 89, 155-181. http://dx.doi.org/10.1037/ 0033-295X.89.2.155
62. Tenenbaum, H. R., & Ruck, M. D. (2007). Are teachers' expectations different for racial minority than for European American students? A meta-analysis. Journal of Educational Psychology, 99, 253-273. http:// dx.doi.org/10.1037/0022-0663.99.2.253
63. Thiede, K. W., Brendefur, J. L., Osguthorpe, R. D., Carney, M. B., Bremner, A., Strother, S.,. Jesse, D. (2015). Can teachers accurately predict student performance? Teaching and Teacher Education, 49, 36-44. http://dx.doi.org/10.1016/j.tate.2015.01.012
64. Trautwein, U., & Baeriswyl, F. (2007). Wenn leistungsstarke Klassenkameraden ein Nachteil sind: Referenzgruppeneffekte bei Übertrittsentscheidungen [When high-achieving classmates put students at a disadvantage: Reference group effects at the transition to secondary school]. Zeitschrift für Pädagogische Psychologie/German Journal of Educational Psychology, 21, 119-133.
65. Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2006). Self-esteem, academic self-concept, and achievement: How the learning environment moderates the dynamics of self-concept. Journal of Personality and Social Psychology, 90, 334-349. http://dx.doi.org/10.1037/0022-3514 .90.2.334
66. van den Bergh, L., Denessen, E., Hornstra, L., Voeten, M., & Holland, R. W. (2010). The implicit prejudiced attitudes of teachers: Relations to teacher expectations and the ethnic achievement gap. American Educational Research Journal, 47, 497-527. http://dx.doi.org/10.3102/ 0002831209353594
67. van Ewijk, R., & Sleegers, P. (2010). Peer ethnicity and achievement: A meta-analysis into the compositional effect. School Effectiveness and School Improvement, 21, 237-265. http://dx.doi.org/10.1080/ 09243451003612671
68. Voss, T., Kunter, M., & Baumert, J. (2011). Assessing teacher candidates' general pedagogical/psychological knowledge: Test construction and validation. Journal of Educational Psychology, 103, 952-969. http://dx .doi.org/10.1037/a0025125
69. Wang, S. S., Treat, T. A., & Brownell, K. D. (2008). Cognitive processing about classroom-relevant contexts: Teachers' attention to and utilization of girls' body size, ethnicity, attractiveness, and facial affect. Journal of Educational Psychology, 100, 473-489. http://dx.doi.org/10.1037/0022- 0663.100.2.473
70. Weiss, H. (2000). Alte und neue Minderheiten. Zum Einstellungswandel in österreich [Old and new minorities. On the change in attitude in Austria]. SWS-Rundschau, 1/2000, 25-42.
71. Weiss, K. (2007). Zwischen Vietnam und Deutschland-Die Vietnamesen in Ostdeutschland. [Between Vietnam and Germany-The Vietnamese in East Germany] In K. Weiss & H. Kindelberger (Eds.), Zuwanderung und Integration in den neuen Bundesländern. Zwischen Transferexistenz und Bildungserfolg (pp. 72-95). Freiburg, Germany: Lambertus.
72. Westphal, A., Becker, M., Vock, M., Maaz, K., Neumann, M., & McElvany, N. (in press). The link between teacher-assigned grades and classroom socioeconomic composition: The role of classroom behavior, motivation, and teacher characteristics. Contemporary Educational Psychology. Advance online publication.
73. Wild, K.-P., & Rost, D. H. (1995). Klassengröße und Genauigkeit von Schülerbeurteilungen [Class size and the accuracy of teachers' assessments]. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 27, 78-90.
74. Woodworth, W. D., & Salzer, R. T. (1971). Black children's speech and teachers' evaluations. Urban Education, 6, 167-173. http://dx.doi.org/ 10.1177/004208597100600205