Teacher judgments as measures of children's cognitive ability: A multilevel analysis

Learning and Individual Differences

Volumn 52, Issue , 2016, Pages 148-156

  Baudson, Tanja Gabriele ^a   Fischbach, Antoine ^b   Preckel, Franzis ^a  

^a UNIVERSITY OF TRIER   (Germany)

^b UNIVERSITY OF LUXEMBOURG   (Luxembourg)

Author keywords

Cognitive ability ratings; Intelligence; Multilevel analysis; Teacher judgment; Teachers' diagnostic abilities

Indexed keywords

EID: 85003338214     PISSN: 10416080     EISSN: 18733425     Source Type: Journal    
DOI: 10.1016/j.lindif.2014.06.001     Document Type: Article

References (80)

1. Alvidrez, J., Weinstein, R.S., Early teacher perceptions and later student achievement. Journal of Educational Psychology 91 (1999), 731–746, 10.1037/0022-0663.91.4.731.
2. Asbury, K., Wachs, T.D., Plomin, R., Environmental moderators of genetic influence on verbal and nonverbal abilities in early childhood. Intelligence 33 (2005), 643–661, 10.1016/j.intell.2005.03.008.
3. Babad, E.Y., Some correlates of teachers' expectancy bias. American Educational Research Journal 22 (1985), 175–183, 10.3102/00028312022002175.
4. Baeriswyl, F., Wandeler, C., Trautwein, U., Auf einer anderen Schule oder bei einer anderen Lehrkraft hätte es für's Gymnasium gereicht!” Eine Untersuchung zur Bedeutung von Schulen und Lehrkräften für die Übertrittsempfehlung (Trans.) Another school or another teacher would have recommended a higher track”: The meaning of schools and teachers for secondary tracking recommendations Zeitschrift für Pädagogische Psychologie 25 (2011), 39–47, 10.1024/1010-0652/a00028.
5. Ball, S., Reay, D., David, M., “Ethnic choosing”: Minority ethnic students, social class and higher educational choice. Race Ethnicity and Education 5 (2002), 333–357, 10.1080/1361332022000030879.
6. Ballenger, J., Parental involvement: Low socioeconomic status (SES) and ethnic minority parents' struggle for recognition and identity. Jenlink, P.M., Townes, F.H., (eds.) The struggle for identity in today's schools: Cultural recognition in a time of increasing diversity, 2009, Rowman & Littlefield Education, Lanham, Maryland, 156–168.
7. Baudson, T.G., Preckel, F., Development and validation of the German Test for (Highly) Intelligent Kids — T(H)INK. European Journal of Psychological Assessment 29 (2013), 171–181, 10.1027/1015-5759/a000142.
8. Baumert, J., Trautwein, U., Artelt, C., Schulumwelten – Institutionelle Bedingungen des Lehrens und Lernens (Trans.) School environments—institutional conditions for learning and instruction Baumert, J., Artelt, C., Klieme, E., Neubrand, M., Prenzel, M., Schiefele, U., et al. (eds.) PISA 2000 – ein differenzierter Blick auf die Länder der Bundesrepublik Deutschland [PISA 2000], 2003, Leske & Budrich, Opladen, Germany, 259–330.
9. Borkenau, P., Liebler, A., Convergence of stranger ratings of personality and intelligence with self-ratings, partner ratings, and measured intelligence. Journal of Personality and Social Psychology 65 (1993), 546–553, 10.1037/0022-3514.65.3.546.
10. Bornstein, R.F., Exposure and affect: Overview and meta-analysis of research, 1968–1987. Psychological Bulletin 106 (1989), 265–289, 10.1037//0033-2909.106.2.265.
11. Bos, W., Hornberg, S., Arnold, K.-H., Faust, G., Fried, L., Lankes, E.-M., et al. (eds.) IGLU 2006. Lesekompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (Trans.) IGLU 2006. Primary school children's reading abilities in Germany and in the international comparison, 2007, Waxmann, Münster, Germany.
12. Bos, W., Tarelli, I., Bremerich-Vos, A., Schwippert, K., (eds.) IGLU 2011. Lesekompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (Trans.) IGLU 2006. Primary school children's reading abilities in Germany and in the international comparison, 2012, Waxmann, Münster, Germany.
13. Bos, W., Wendt, H., Köller, O., Selter, C., (eds.) TIMSS 2011. Mathematische und naturwissenschaftliche Kompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich (Trans.) TIMSS 2011. Mathematical and scientific competencies of primary school students in Germany in the international comparison, 2012, Waxmann, Münster, Germany.
14. Caro, D.H., Cortés, D., Measuring family socioeconomic status: An illustration using data from PIRLS 2006. IERI Monograph Series: Issues and Methodologies in Large-Scale Assessments, Vol. 5, 2012, IEA, Hamburg, Germany, 9–33.
15. Chamorro-Premuzic, T., Arteche, A., Furnham, A., Trickot, N., Assessing pupils' intelligence through self, parental, and teacher estimates. Educational Psychology 29 (2009), 83–97, 10.1080/01443410802520662.
16. Cohen, J., Cohen, P., West, S.G., Aiken, L.S., Applied multiple regression/correlation analysis for the behavioral sciences. 3rd ed., 2003, Lawrence Erlbaum Associates, Inc., Mahwah, NJ.
17. Collins, L.M., Schafer, J.L., Kam, C.-M., A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods 6:4 (2001), 330–351, 10.1037/1082-989X.6.4.330.
18. de Boer, H., Bosker, R.J., van der Werf, M.P.C., Sustainability of teacher expectation bias effects on long-term student performance. Journal of Educational Psychology 102 (2010), 168–179, 10.1037/a0017289.
19. Demaray, M.K., Elliott, S.N., Teachers' judgments of students' academic functioning: A comparison of actual and predicted performances. School Psychology Quarterly 13 (1998), 8–24, 10.1037/h0088969.
20. DeYoung, C.G., Intelligence and personality. Sternberg, R.J., Kaufman, S.B., (eds.) The Cambridge handbook of intelligence, 2009, Cambridge University Press, New York, NY, 711–737.
21. Dubow, E.F., Boxer, P., Huesmann, L.R., Long-term effects of parents' education on children's educational and occupational success: Mediation by family interactions, child aggression, and teenage aspirations. Merrill-Palmer Quarterly 55:3 (2009), 224–249.
22. Duckworth, A., Seligman, M.E., Self-discipline gives the edge: Gender in self-discipline, grades, and achievement test scores. Journal of Educational Psychology 98 (2006), 198–208, 10.1037/0022-0663.98.1.198.
23. Eaves, R., Williams, P., Winchester, K., Darch, E., Using teacher judgment and IQ to estimate reading and mathematics achievement in a remedial reading programme. Psychology in the Schools 31 (1994), 261–272, 10.1002/1520-6807(199410)31:4<261::AID-PITS2310310403>3.0CO;2-K.
24. Ehmke, T., Baumert, J., Soziale Herkunft und Kompetenzerwerb: Vergleiche zwischen PISA 2000, 2003 und 2006 (Trans.) Social background and competence acquisition: Comparisons between PISA 2000, 2003, and 2006 Prenzel, M., Artelt, C., Baumert, J., Blum, W., Hammann, M., Klieme, E., Pekrun, R., (eds.) PISA 2006: Die Ergebnisse der dritten internationalen Vergleichsstudie, 2007, Waxmann, Münster, 309–335.
25. Ehrenberg, R.G., Brewer, D.J., Gamoran, A., Willms, J.D., Class size and student achievement. Psychological Science in the Public Interest 2 (2001), 1–30, 10.1111/1529-1006.003.
26. Federal Statistical Office, Bevölkerung und Erwerbstätigkeit. Bevölkerung mit Migrationshintergrund – Ergebnisse des Mikrozensus 2009 (Trans.) Population and employment. Population with migration background — Results of the 2009 sample census, 2010, Statistisches Bundesamt, Wiesbaden, Germany (Available for download at http://www.destatis.de/jetspeed/portal/cms/Sites/destatis/Internet/DE/Content/Publikationen/Fachveroeffentlichungen/Bevoelkerung/MigrationIntegration/Migrationshintergrund2010220097004,property=file.pdf).
27. Felson, R.B., Reed, M.D., Reference groups and self-appraisals of academic ability and performance. Social Psychology Quarterly 49 (1986), 103–109, 10.2307/2786722.
28. Fennema, E., Peterson, P.L., Carpenter, T.P., Lubinski, C.A., Teachers' attributions and beliefs about girls, boys, and mathematics. Educational Studies in Mathematics 21 (1990), 55–69, 10.1007/BF00311015 et al.
29. Fischbach, A., Baudson, T.G., Preckel, F., Martin, R., Brunner, M., Do teacher judgments predict life outcomes?. Learning and Individual Differences 27 (2013), 109–119, 10.1016/j.lindif.2013.07.004.
30. Freund, P.A., Kasten, N., How smart do you think you are? A meta-analysis on the validity of self-estimates of cognitive ability. Psychological Bulletin 138 (2012), 296–321, 10.1037/a0026556.
31. Gebhardt, M., Rauch, D., Mang, J., Sälzer, C., Stanat, P., Mathematische Kompetenz von Schülerinnen und Schülern mit Zuwanderungshintergrund (Trans.) Mathematical competency in students with migration backgrounds Prenzel, M., Sälzer, C., Klieme, E., Köller, O., (eds.) PISA 2012: Fortschritte und Herausforderungen in Deutschland, 2013, Waxmann, Münster, Germany, 275–308.
32. Glock, S., Krolak-Schwerdt, S., Does nationality matter? The impact of stereotypical expectations on student teachers' judgments. Social Psychology of Education 16 (2013), 111–127, 10.1007/s11218-012-9197-z.
33. Graham, J.W., Adding missing-data relevant variables to FIML-based structural equation models. Structural Equation Modeling: A Multidisciplinary Journal 10 (2003), 80–100, 10.1207/S15328007SEM1001_4.
34. Graham, J.W., Missing data analysis: Making it work in the real world. Annual Review of Psychology 60:1 (2009), 549–576, 10.1146/annurev.psych.58.110405.085530.
35. Hanses, P., Rost, D.H., Das “Drama” der hochbegabten Underachiever – “gewöhnliche” oder “außergewöhnliche” Underachiever? (Trans.) The “drama” of gifted underachievers—”ordinary” or “extraordinary” underachievers? Zeitschrift für Pädagogische Psychologie 12 (1998), 53–71.
36. Hedges, L.V., Nowell, A., Sex differences in mental test scores, variability, and numbers of high-scoring individuals. Science 269:5220 (1995), 41–45, 10.1126/science/7604277.
37. Hinnant, J.B., O'Brien, M., Ghazarian, S.R., The longitudinal relations of teacher expectations to achievement in the early school years. Journal of Educational Psychology 101 (2009), 662–670, 10.1037/a0014306.
38. Hox, J.J., Multilevel analysis. 2nd ed., 2010, Routledge, New York, NY.
39. IBM, SPSS statistics for Mac OS X, Version 22.0.0.0. 2013, IBM Corp, Armonk, NY.
40. Impara, J.C., Plake, B.S., Teachers' ability to estimate item difficulty: A test of the assumptions in the Angoff standard setting method. Journal of Educational Measurement 35 (1998), 69–81, 10.1111/j.1745-3984.1998.tb00528.x.
41. Jensen, A.J., The g factor: The science of mental ability. 1998, Praeger, Westport, CT.
42. Johnson, W., Bouchard, T.J. Jr., Sex differences in mental abilities: g masks the dimensions on which they lie. Intelligence 35 (2007), 23–39, 10.1016/j.intell.2006.03.012.
43. Jussim, L., Harber, K.D., Teacher expectations and self-fulfilling prophecies: Knowns and unknowns, resolved and unresolved controversies. Personality and Social Psychology Review 9 (2005), 131–155, 10.1207/s15327957pspr0902_3.
44. Krolak-Schwerdt, S., Böhmer, M., Gräsel, C., Leistungsbeurteilungen von Schulkindern. Welche Rolle spielen Ziele und Expertise der Lehrkraft? (Trans.) Assessing achievement in students: the role of teachers' goals and expertise Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie 44 (2012), 111–122, 10.1026/0049-8637/a000062.
45. Li, Q., Teachers' beliefs and gender differences in mathematics. A review. Educational Research 41 (1999), 63–76.
46. Loehlin, J.C., Group differences in intelligence. Sternberg, R.J., (eds.) Handbook of intelligence, 2000, Cambridge University Press, Cambridge, MA, 176–193.
47. Maaz, K., Nagy, G., Der Übergang von der Grundschule in die weiterführenden Schulen des Sekundarschulsystems: Definition, Spezifikation und Quantifizierung primärer und sekundärer Herkunftseffekte (Trans.) The Transition from Elementary to Secondary Education in Germany: Definition, Specification, and Quantification of the Primary and Secondary Effects of Social Background Zeitschrift für Erziehungswissenschaft, Special Issue 12-09 (2009), 153–182.
48. Marsh, H.W., The big-fish-little-pond effect on academic self-concept. Journal of Educational Psychology 79 (1987), 280–295, 10.1037//0022-0663.79.3.280.
49. Marsh, H.W., Martin, A.J., Academic self-concept and academic achievement: Relations and causal ordering. British Journal of Educational Psychology 81 (2011), 59–77, 10.1348/000709910X503501.
50. Muthén, L.K., Muthén, B.O., Mplus user's guide. Seventh ed., 1998–2012, Muthén & Muthén, Los Angeles, CA.
51. Neisser, U., Boodoo, G., Bouchard, T.J. Jr., Boykin, A.W., Brody, N., Ceci, S.J., et al. Intelligence: Knowns and unknowns. American Psychologist 51 (1996), 77–101, 10.1037//0003-066X.51.2.77.
52. NICHD Early Child Care Research Network, Does class size in first grade relate to children's academic and social performance or observed classroom processes?. Developmental Psychology 40 (2004), 651–664, 10.1037/0012-1649.40.5.651.
53. OECD, PISA 2009 Ergebnisse: Potenziale nutzen und Chancengleichheit sichern – Sozialer Hintergrund und Schülerleistungen (Band II) (Trans.) PISA 2009 results: Using potential and ensuring equity—social background and student achievement (Volume II), 2011, 10.1787/9789264095359.de.
54. Organ, D.W., Greene, C.N., The perceived purposefulness of job behavior: Antecedents and consequences. Academy of Management Journal 17 (1974), 69–78, 10.2307/254772.
55. Peterson, J., Gender differences in the identification of gifted youth and in gifted program participation: A meta-analysis. Contemporary Educational Psychology 38 (2013), 342–348, 10.1016/j.cedpsych.2013.07.002.
56. Pfeiffer, S.I., Jarosewich, T., The gifted rating scales. 2003, Pearson Assessment, San Antonio, TX.
57. Prenzel, M., Sälzer, C., Klieme, E., Köller, O., PISA 2012 — Fortschritte und Herausforderungen in Deutschland (Trans.) PISA 2013 — progress and challenges in Germany, 2013, Waxmann, Münster, Germany.
58. Raudenbush, S.W., Magnitude of teacher expectancy effects on pupil IQ as a function of the credibility of expectancy induction: A synthesis of findings from 18 experiments. Journal of Educational Psychology 76 (1984), 85–97, 10.1037//0022-0663.76.1.85.
59. Raudenbush, S.W., Bryk, A.S., Hierarchical linear models. 2nd ed., 2002, Sage, Thousand Oaks, CA.
60. Ready, D.D., Wright, D.L., Accuracy and inaccuracy in teachers' perceptions of young children's cognitive abilities: The role of child background and classroom context. American Educational Research Journal 48 (2011), 335–360, 10.3102/0002831210374874.
61. Rieske, T.V., Bildung von Geschlecht (Trans.) The making and education of gender, 2011, Gewerkschaft Erziehung und Wissenschaft, Frankfurt/Main, Germany.
62. Rosenthal, R., Jacobson, L., Pygmalion in the classroom: Teacher expectation and pupils' intellectual development. 1968, Holt, Rinehart & Winston, New York, NY.
63. Sadowski, C.J., Cumulative evidence of the relationship between work tenure and generalized locus of control among teachers. Education 114 (1993), 27–31.
64. Satorra, A., Scaled and adjusted restricted tests in multi-sample analysis of moment structures. Heijmans, R.D.H., Pollock, D.S.G., Satorra, A., (eds.) Innovations in multivariate statistical analysis. A Festschrift for Heinz Neudecker, 2000, Kluwer Academic Publishers, London, UK, 233–247 (See also http://www.statmodel.com/chidiff.shtml).
65. Schrader, F.-W., Anmerkungen zum Themenschwerpunkt Diagnostische Kompetenz von Lehrkräften (Trans.) Comments on the special issue's focus: Teachers' diagnostic competencies Zeitschrift für Pädagogische Psychologie 23 (2009), 237–245, 10.1024/1010-0652.23.34.237.
66. Schrader, F.-W., Helmke, A., Diagnostische Kompetenz von Lehrern: Komponenten und Wirkungen (Trans.) Teachers' diagnostic ability: Components and effects Empirische Pädagogik 1 (1987), 27–52.
67. Schrader, F.-W., Helmke, A., Hosenfeld, I., Ridder, A., Klassengröße und Mathematikleistung (Trans.) Class size and math achievement Empirische Pädagogik 15 (2001), 601–625.
68. Schweizer, K., Koch, W., A revision of Cattell's investment theory: Cognitive properties influencing learning. Learning and Individual Differences 13 (2001), 57–82, 10.1016/S1041-6080(02)00062-6.
69. Sirin, S.R., Socioeconomic status and academic achievement: A meta-analytic review of research. Review of Educational Research 75 (2005), 417–453, 10.3102/00346543075003417.
70. Smith, A.E., Jussim, L., Eccles, J., Van Noy, M., Self-fulfilling prophecies, perceptual biases, and accuracy at the individual and group levels. Journal of Experimental Social Psychology 34 (1998), 530–561, 10.1006/jesp.1998.1363.
71. Spinath, B., Akkuratheit der Einschätzung von Schülermerkmalen durch Lehrer und das Konstrukt der diagnostischen Kompetenz (Trans.) Accuracy of teacher judgments on [sic] student characteristics and the construct of diagnostic competence Zeitschrift für Pädagogische Psychologie 19 (2005), 85–95, 10.1024/1010-0652.19.1.85.
72. Stamm, M., Underachievement von Jungen: Perspektiven eines internationalen Diskurses (Trans.) Underachievement in boys: Perspectives of an international discourse Zeitschrift für Erziehungswissenschaft 11 (2008), 106–124, 10.1007/s11618-008-0006-6.
73. Südkamp, A., Kaiser, J., Möller, J., Accuracy of teachers' judgments of students' academic achievement: A meta-analysis. Journal of Educational Psychology 104 (2012), 743–762, 10.1037/a0027627.
74. Tenenbaum, H.R., Ruck, M.D., Are teachers' expectations different for racial minority than for European American students? A meta-analysis. Journal of Educational Psychology 99 (2007), 253–273, 10.1037/0022-0663.99.2.253.
75. Trautwein, U., Baeriswyl, F., Wenn leistungsstarke Klassenkameraden ein Nachteil sind: Referenzgruppeneffekte bei Übertrittsentscheidungen (Trans.) When high-achieving classmates put students at a disadvantage: Reference group effects at the transition to secondary schooling Zeitschrift für Pädagogische Psychologie 21 (2007), 119–133, 10.1024/1010-0652.21.2.119.
76. Trouilloud, D., Sarrazin, P., Bressoux, P., Bois, J., Relation between teachers' early expectations and students' later perceived competence in physical education classes: Autonomy-supportive climate as a moderator. Journal of Educational Psychology 98 (2006), 75–86, 10.1037/0022-0663.98.1.75.
77. Wilberg, S., Rost, D.H., Große Klassen – kleine Leistung? Klassenstärke und Geschichtskenntnisse in fünfzehn Ländern (Trans.) Large classrooms—low achievement? Class sizes and historical knowledge in fifteen countries Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie 31 (1999), 138–143, 10.1026//0049-8637.31.3.138.
78. Wild, K.-P., Rost, D.H., Klassengröße und Genauigkeit von Schülerbeurteilungen (Trans.) Class size and accuracy of student assessment Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie 27 (1995), 78–90.
79. Wößmann, L., West, M., Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS. European Economic Review 50 (2006), 695–736, 10.2139/ssrn.308559.
80. Zajonc, R., Attitudinal effects of mere exposure. Journal of Personality and Social Psychology 9 (1968), 1–27, 10.1037/h0025848.