Students’ confidence in their performance judgements: a comparison of different response scales

Educational Psychology

Volumn 35, Issue 3, 2015, Pages 377-395

  Händel, Marion ^a   Fritzsche, Eva Susanne ^a  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

metacognitive accuracy; response scales; second order judgements; undergraduates

Indexed keywords

EID: 84926519068     PISSN: 01443410     EISSN: 14695820     Source Type: Journal    
DOI: 10.1080/01443410.2014.895295     Document Type: Article

References (50)

1. Allwood, C. M., Granhag, P. A., & Jonsson, A. C. (2006). Child witnesses’ metamemory realism. Scandinavian Journal of Psychology, 47, 461–470. doi:10.1111/j.1467-9450.2006.00530.x10.1111/sjop.2006.47.issue-6
2. Bechler, O., & Thielsch, M. T. (2012). Schwierigkeiten bei der Vorbereitung auf schriftliche Prüfungen [Problems in preparing for written exams]. Zeitschrift für Hochschulentwicklung, 7, 137–156.
3. Bol, L., & Hacker, D. J. (2001). A comparison of the effects of practice tests and traditional review on performance and calibration. The Journal of Experimental Education, 69, 133–151. doi:10.1080/0022097010960065310.1080/00220970109600653
4. Bol, L., Hacker, D. J., O’Shea, P., & Allen, D. (2005). The influence of overt practice, achievement level, and explanatory style on calibration accuracy and performance. The Journal of Experimental Education, 73, 269–290.10.3200/JEXE.73.4.269-290
5. Buratti, S., & Allwood, C. M. (2012). The accuracy of meta-metacognitive judgments: Regulating the realism of confidence. Cognitive Processing, 13, 243–253. doi:10.1007/s10339-012-0440-510.1007/s10339-012-0440-5
6. Buratti, S., Allwood, C. M., & Kleitman, S. (2013). First- and second-order metacognitive judgments of semantic memory reports: The influence of personality traits and cognitive styles. Metacognition and Learning, 8, 79–102. doi:10.1007/s11409-013-9096-510.1007/s11409-013-9096-5
7. Cesarini, D., Sandewall, Ö., & Johannesson, M. (2006). Confidence interval estimation tasks and the economics of overconfidence. Journal of Economic Behavior & Organization, 61, 453–470. doi:10.1016/j.jebo.2004.10.010
8. Chen, P. P. (2003). Exploring the accuracy and predictability of the self-efficacy beliefs of seventh-grade mathematics students. Learning and Individual Differences, 14, 79–92. doi:10.1016/j.lindif.2003.08.003
9. Chiang, E. S., Therriault, D. J., & Franks, B. A. (2010). Individual differences in relative metacomprehension accuracy: Variation within and across task manipulations. Metacognition and Learning, 5, 121–135. doi:10.1007/s11409-009-9052-610.1007/s11409-009-9052-6
10. Crawford, J. D., & Stankov, L. (1996). Age differences in the realism of confidence judgements: A calibration study using tests of fluid and crystallized intelligence. Learning and Individual Differences, 8, 83–103.10.1016/S1041-6080(96)90027-8
11. Dunlosky, J., & Hertzog, C. (2000). Updating knowledge about encoding strategies: A componential analysis of learning about strategy effectiveness from task experience. Psychology and Aging, 15, 462–474. doi:10.1037//0882-7974.15.3.46210.1037/0882-7974.15.3.462
12. Dunlosky, J., & Metcalfe, J. (2009). Metacognition. Los Angeles, CA: Sage.
13. Dunlosky, J., Serra, M. J., Matvey, G., & Rawson, K. A. (2005). Second-order judgments about judgments of learning. The Journal of General Psychology, 132, 335–346.10.3200/GENP.132.4.335-346
14. Dutke, S., Barenberg, J., & Leopold, C. (2010). Learning from text: Knowing the test format enhanced metacognitive monitoring. Metacognition and Learning, 5, 195–206. doi:10.1007/s11409-010-9057-110.1007/s11409-010-9057-1
15. Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review, 98, 506–528.10.1037/0033-295X.98.4.506
16. Gillström, A, & Rönnberg, J. (1995). Comprehension calibration and recall prediction accuracy of texts: Reading skill, reading strategies, and effort. Journal of Educational Psychology, 87, 545–558.10.1037/0022-0663.87.4.545
17. Glenberg, A. M., & Epstein, W. (1985). Calibration of comprehension. Journal of Experimental Psychology, 11, 702–718.
18. Griffin, T. D., Jee, B. D., & Wiley, J. (2009). The effects of domain knowledge on metacomprehension accuracy. Memory & Cognition, 37, 1001–1013. doi:10.3758/MC.37.7.1001
19. Hacker, D. J., Bol, L., & Bahbahani, K. (2008). Explaining calibration accuracy in classroom contexts: The effects of incentives, reflection, and explanatory style. Metacognition and Learning, 3, 101–121. doi:10.1007/s11409-008-9021-510.1007/s11409-008-9021-5
20. Hacker, D. J., Bol, L., Horgan, D. D., & Rakow, E. A. (2000). Test prediction and performance in a classroom context. Journal of Educational Psychology, 92, 160–170. doi:10.1037//0022-0663.92.1.16010.1037/0022-0663.92.1.160
21. Hacker, D. J., Bol, L., & Keener, M. C. (2008). Metacognition in education: A focus on calibration. In J. Dunlosky, & R. A. Bjork (Eds.), Handbook of metamemory and memory (pp. 429–455). New York, NY: Routledge.
22. Hartley, J., & Betts, L. R. (2010). Four layouts and a finding: The effects of changes in the order of the verbal labels and numerical values on Likert‐type scales. International Journal of Social Research Methodology, 13, 17–27. doi:10.1080/1364557080264807710.1080/13645570802648077
23. Jäger, R. (2004). Konstruktion einer Ratingskala mit Smilies als symbolische Marken [Development of a rating scale with smileys as anchors]. Diagnostica, 50, 31–38. doi:10.1026/0012-1924.50.1.3110.1026/0012-1924.50.1.31
24. Juslin, P. (1994). The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items. Organizational Behavior and Human Decision Processes, 57, 226–246.10.1006/obhd.1994.1013
25. Juslin, P., & Olsson, H. (1997). Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination. Psychological Review, 104, 344–366.10.1037/0033-295X.104.2.344
26. Juslin, P., Winman, A., & Olsson, H. (2000). Naive empiricism and dogmatism in confidence research: A critical examination of the hard-easy effect. Psychological Review, 107, 384–396. doi:10.1037//0033-295x.107.2.38410.1037/0033-295X.107.2.384
27. Kröner, S., & Biermann, A. (2007). The relationship between confidence and self-concept – Towards a model of response confidence. Intelligence, 35, 580–590. doi:10.1016/j.intell.2006.09.00910.1016/j.intell.2006.09.009
28. Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77, 1121–1134. doi:10.1037/0022-3514.77.6.112110.1037/0022-3514.77.6.1121
29. Labuhn, A. S., Zimmerman, B. J., & Hasselhorn, M. (2010). Enhancing students’ self-regulation and mathematics performance: The influence of feedback and self-evaluative standards. Metacognition and Learning, 5, 173–194. doi:10.1007/s11409-010-9056-210.1007/s11409-010-9056-2
30. Lin, L. M., & Zabrucky, K. M. (1998). Calibration of comprehension: Research and implications for education and instruction. Contemporary Educational Psychology, 23, 345–391.10.1006/ceps.1998.0972
31. Maki, R. H., Shields, M., Wheeler, A. E., & Zacchilli, T. L. (2005). Individual differences in absolute and relative metacomprehension accuracy. Journal of Educational Psychology, 97, 723–731. doi:10.1037/0022-0663.97.4.72310.1037/0022-0663.97.4.723
32. Mengelkamp, C., & Bannert, M. (2009). Judgements about knowledge. Electronic Journal of Research in Educational Psychology, 7, 163–190.
33. Mengelkamp, C., & Bannert, M. (2010). Accuracy of confidence judgments: Stability and generality in the learning process and predictive validity for learning outcome. Memory & Cognition, 38, 441–451. doi:10.3758/MC.38.4.441
34. Miller, T. M., & Geraci, L. (2011). Unskilled but aware: Reinterpreting overconfidence in low-performing students. Journal of Experimental Psychology, 37, 502–506. doi:10.1037/a0021802
35. Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. The Psychology of Learning and Motivation, 26, 125–173.10.1016/S0079-7421(08)60053-5
36. Nietfeld, J. L., Cao, L., & Osborne, J. W. (2005). Metacognitive monitoring accuracy and student performance in the postsecondary classroom. The Journal of Experimental Education, 74, 7–28.
37. Nietfeld, J. L., Cao, L., & Osborne, J. W. (2006). The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy. Metacognition and Learning, 1, 159–179. doi:10.1007/s10409-006-9595-610.1007/s10409-006-9595-6
38. Nietfeld, J. L., & Schraw, G. (2002). The effect of knowledge and strategy training on monitoring accuracy. The Journal of Educational Research, 95, 131–142.10.1080/00220670209596583
39. Pallier, G., Wilkinson, R., Danthiir, V., Kleitman, S., Knezevic, G., Stankov, L., & Roberts, R. D. (2002). The role of individual differences in the accuracy of confidence judgments. The Journal of General Psychology, 129, 257–299.10.1080/00221300209602099
40. Pressley, M., Levin, J. R., Ghatala, E. S., & Ahmad, M. (1987). Test monitoring in young grade school children. Journal of Experimental Child Psychology, 43, 96–111.10.1016/0022-0965(87)90053-1
41. Roebers, C. M. (2002). Confidence judgments in children’s and adult’s event recall and suggestibility. Developmental Psychology, 38, 1052–1067. doi:10.1037//0012-1649.38.6.105210.1037/0012-1649.38.6.1052
42. Roebers, C. M., Schmid, C., & Roderer, T. (2009). Metacognitive monitoring and control processes involved in primary school children’s test performance. British Journal of Educational Psychology, 79, 749–767. doi:10.1348/978185409X42984210.1348/978185409X429842
43. Schraw, G., Dunkle, M. E., Bendixen, L. D., & Roedel, T. (1995). Does a general monitoring skill exist? Journal of Educational Psychology, 87, 433–444.10.1037/0022-0663.87.3.433
44. Schraw, G., Kuch, F., & Gutierrez, A. P. (2013). Measure for measure: Calibrating ten commonly used calibration scores. Learning and Instruction, 24, 48–57. doi:10.1016/j.learninstruc.2012.08.00710.1016/j.learninstruc.2012.08.007
45. Schwarz, N., Knäuper, B., Hippler, H.-J., Noelle-Neumann, E., & Clark, L. (1991). Rating scales: Numeric values may change the meaning of scale labels. Public Opinion Quarterly, 55, 570–582.10.1086/269282
46. Stankov, L., Lee, J., Luo, W., & Hogan, D. J. (2012). Confidence: A better predictor of academic achievement than self-efficacy, self-concept and anxiety? Learning and Individual Differences, 22, 747–758. doi:10.1016/j.lindif.2012.05.01310.1016/j.lindif.2012.05.013
47. Tourangeau, R., Couper, M. P., & Conrad, F. (2007). Color, labels, and interpretive heuristics for response scales. Public Opinion Quarterly, 71, 91–112. doi:10.1093/poq/nfl04610.1093/poq/nfl046
48. Van Vaerenbergh, Y., & Thomas, T. D. (2012). Response styles in survey research: A literature review of antecedents, consequences, and remedies. International Journal of Public Opinion Research, 25, 1–23. doi:10.1093/ijpor/eds021
49. Washburn, D. A., Smith, J. D., & Taglialatela, L. A. (2005). Individual differences in metacognitive responsiveness: Cognitive and personality correlates. The Journal of General Psychology, 132, 446–461.10.3200/GENP.132.4.446-461
50. Zimmerman, B. J. (1989). A social cognitive view of self-regulated academic learning. Journal of Educational Psychology, 81, 329–339.10.1037/0022-0663.81.3.329