Judgment confidence and judgment accuracy of teachers in judging self-concepts of students

Journal of Educational Research

Volumn 106, Issue 1, 2013, Pages 64-76

  Praetorius, Anna Katharina ^a   Berner, Valérie Danielle ^a   Zeinz, Horst ^b   Scheunpflug, Annette ^c   Dresel, Markus ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b UNIVERSITY OF MÜNSTER   (Germany)

^c UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

Diagnostic competence; Judgment accuracy; Judgment confidence; Self concept; Teacher

Indexed keywords

EID: 84872857267     PISSN: 00220671     EISSN: 19400675     Source Type: Journal    
DOI: 10.1080/00220671.2012.667010     Document Type: Article

References (43)

1. Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
2. Ames, D. R., Kammrath, L. K., Suppes, A.,&Bolger,N. (2010).Not so fast: The (not-quite-complete) dissociation between accuracy and confidence in thin-slice impressions. Personality and Social Psychology Bulletin, 36, 264-277. doi:10.1177/0146167209354519
3. Anders, Y., Kunter, M., Brunner, M., Krauss, S., & Baumert, J. (2010). Diagnostische Fähigkeiten von Mathematiklehrkräften und ihre Auswirkungen auf die Leistungen ihrer Schülerinnen und Schüler [Mathematics teachers' diagnostic skills and their impact on students' achievements]. Psychologie in Erziehung und Unterricht, 57, 175-193. doi:10.2378/peu2010.art13d
4. Artelt, C., Baumert, J., Julius-McElvany, N., & Peschar, J. (2003). Learners for life. Student approaches to learning. Results from PISA 2000. Paris, France: OECD.
5. Baker, S. F. (2010). Calibration analysis within the cognitive and personality domain: Individual differences in confidence, accuracy, and bias (Doctoral dissertation). University of Southern Queensland, Australia. Retrieved from http://eprints.usq.edu.au/8856/2/Baker 2010whole.pdf
6. Begeny, J. C., Eckert, T. L., Montarello, S. A., & Storie, M. S. (2008). Teachers' perceptions of students' reading abilities: An examination of the relationship between teachers' judgments and students' performance across a continuum of rating methods. School Psychology Quarterly, 23, 43-55. doi:10.1037/1045-3830.23.1.43
7. Bergkvist, L., & Rossiter, J. R. (2007). The predictive validity of multipleitem versus single-item measures of the same constructs. Journal of Marketing Research, 44, 175-184. doi:10.1509/jmkr.44.2.175
8. Boehnke, K., Silbereisen, R. K., Reynolds, C. R., & Richmond, B. O. (1986). What I think and feel - German experience with the revised form of the children's manifest anxiety scale. Personality and Individual Differences, 7, 553-560. doi:10.1016/0191-8869(86)90132-7
9. Brunswik, E. (1952). The conceptual framework of psychology. In International encyclopedia of unified science (Vol. 1). Chicago, IL: University of Chicago Press.
10. Chaplin, W. F. (1991). The next generation in moderation research in personality psychology. Journal of Personality, 59, 143-178. doi:10.1111/j.1467-6494.1991.tb00772.x
11. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159. doi:10.1037/0033-2909.112.1.155
12. Corno, L., & Snow, R. E. (1986). Adapting teaching to individual differences among learners. In M. C. Wittrock (Ed.), Third handbook of research on teaching (pp. 605-629).Washington, DC: American Educational Research Association.
13. Cronbach, L. J. (1955). Processes affecting scores on "understanding of others" and "assumed similarity." Psychological Bulletin, 52, 177-193.
14. DePaulo, B. M., Charlton, K., Cooper, H., Lindsay, J. M., & Muhlenbruck, L. (1997). The accuracy-confidence correlation in the detection of deception. Personality and Social Psychology Review, 1, 346-357. doi:10.1207/s15327957pspr0104 5
15. Edelenbos, P., & Kubanek-German, A. (2004). Teacher assessment: the concept of "diagnostic competence." Language Testing, 21, 259-283. doi:10.1191/0265532204lt284oa
16. Fox, S., Bizman, A., Hoffman, M., & Oren, L. (1995). The impact of variability in candidate profiles on rater confidence and judgments regarding stability and job suitability. Journal of Occupational and Organizational Psychology, 68, 13-23.
17. Funder, D. C. (1999). Personality judgment: A realistic approach to person perception. San Diego, CA: Academic Press.
18. Griffin, D., & Tversky, A. (1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24, 411-435.
19. Helmke,A.,&Schrader, F.-W. (1987). Interactional effects of instructional quality and teacher judgment accuracy on achievement. Teaching and Teacher Education, 3, 91-98. doi:10.1016/0742-051X(87)90010-2
20. Hoge, R. D.,&Coladarci, T. (1989). Teacher based judgments of academic achievement: A review of the literature. Review of Educational Research, 59, 297-313. doi:10.2307/1170184
21. Ickes, W. (1993). Empathic accuracy. Journal of Personality, 61, 587-610. doi:10.1111/j.1467-6494.1993.tb00783.x
22. Klayman, J., Soll, J. B., Juslin, P., & Winman, A. (2006). Subjective confidence and the sampling of knowledge. In K. Fiedler & P. Juslin (Eds.), Information sampling and adaptive cognition (pp. 153-182). Cambridge, UK: Cambridge University Press.
23. Kunter,M., Schümer,G., Artelt, C., Baumert, J., Klieme, E., Neubrand, M., &Weiß,M. (2003). PISA 2000: Dokumentation der Erhebungsinstrumente [PISA 2000: Documentation of the survey instruments] (Vol. 72). Berlin, Germany: Max-Planck-Institut für Bildungsforschung.
24. Lichtenstein, S., Fischhoff, B.,&Philips, L. D. (1982). Calibration of probabilities: The state of the art to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgments under uncertainty: Heuristics and biases (pp. 306-334). New York, NY: Cambridge University Press.
25. Loo, R. (2002). A caveat on using single-item versus multiple-item scales. Journal of Managerial Psychology, 17, 68-75. doi:10.1108/026839- 40210415933
26. Marsh, H.W. (1986). Verbal and math self-concepts: An internal/external frame of reference model. American Educational Research Journal, 23, 129-149. doi:10.3102/00028312023001129
27. Marsh, H. W., & Craven, R. G. (2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1, 133-162. doi:10.1111/j.1745-6916.2006.00010.x
28. Marsh, H. W., Craven, R. G., & McInerney, D. M. (2003). International advances in self research: Speaking to the future. In H. W. Marsh, R. G. Craven, & D. M. McInerney (Eds.), International advances in self research (Vol. 1, pp. 3-14). Greenwich, CT: Information Age.
29. Metcalfe, J. (1998). Cognitive optimism: Self-deception or memory-based processing heuristics? Personality and Social Psychology Review, 2, 100-110. doi:10.1207/s15327957pspr02023
30. Möller, J., Pohlmann, B., Köller, O., & Marsh, H. W. (2009). A metaanalytic path analysis of the internal/external Frame of reference model of academic achievement and academic self-concept. Review of Educational Research, 79, 1129-1167. doi:10.3102/0034654309337522
31. Muthén, L. K., & Muthén, B. O. (2007). Mplus user's guide (5th ed.). Los Angeles, CA: Muthén & Muthén.
32. Myford, C. M., & Wolfe, E. W. (2003). Detecting and measuring rater effects using many-facet Rasch measurement: Part I. Journal of Applied Measurement, 4, 386-422.
33. Patterson, M. L., Foster, J. L., & Bellmer, C. G. (2001). Another look at accuracy and confidence in social judgments. Journal of Nonverbal Behavior, 25, 207-219.
34. Praetorius, A.-K., Karst, K., Dickhäuser, O., & Lipowsky, F. (2011). Wie gut schätzen Lehrer die Fähigkeitsselbstkonzepte ihrer Schüler ein? Zur diagnostischen Kompetenz von Lehrkräften [How teachers rate their students: On teachers' diagnostic competence regarding the academic self-concept]. Psychologie in Erziehung und Unterricht, 58, 81-91. doi:10.2378/peu2011.art30d
35. Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77, 454-499. doi:10.3102/0034654307310317
36. Shavelson, R. J., Hubner, J. J., & Stanton, G. C. (1976). Self-concept: Validation of construct interpretations. Review of Educational Research, 46, 407-441. doi:10.3102/00346543046003407
37. Smith, H. J., Archer, D., & Costanzo, M. (1991). "Just a hunch": Accuracy and awareness in person perception. Journal of Nonverbal Behavior, 15, 3-18.
38. Spinath, B. (2005). Akkuratheit der Einschätzung von Schülermerkmalen durch Lehrer und das Konstrukt der diagnostischen Kompetenz [Accuracy of teacher judgments on student characteristics and the construct of diagnostic competence]. Zeitschrift für Pädagogische Psychologie, 19, 85-95. doi:10.1024/1010-0652.19.12.85
39. Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245-251.
40. Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers' judgments of students' academic achievement: A meta-analysis. Journal of Educational Psychology, 104, 743-762.
41. Vallone, R. P., Griffin, D. W., Lind, S. L.,&Ross, L. (1990).Overconfident prediction of futures actions and outcomes by self and others. Journal of Personality and Social Psychology, 58, 582-592.
42. Wanous, J. P., Reichers, A. E., & Hudy, M. J. (1997). Overall job satisfaction: How good are single-item measures? Journal of Applied Psychology, 82, 247-252.
43. West, R. F., & Stanovich, K. E. (1996). The domain specificity and generality of overconfidence: Individual differences in performance estimation bias. Psychonomic Bulletin and Review, 4, 387-392.