Accuracy of confidence judgments: Stability and generality in the learning process and predictive validity for learning outcome

Memory and Cognition

Volumn 38, Issue 4, 2010, Pages 441-451

  Mengelkamp, Christoph ^a   Bannert, Maria ^b  

^a Rheinland Pfälzische Technische Universität Kaiserslautern Landau   (Germany)

^b CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; AWARENESS; COMPREHENSION; CONCEPT FORMATION; DECISION MAKING; FEMALE; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; LONG TERM MEMORY; MALE; PSYCHOLOGICAL ASPECT; RECALL; STUDENT;

ADOLESCENT; ADULT; AWARENESS; COMPREHENSION; CONCEPT FORMATION; CONDITIONING, OPERANT; FEMALE; GENERALIZATION (PSYCHOLOGY); HUMANS; JUDGMENT; MALE; MENTAL RECALL; RETENTION (PSYCHOLOGY); STUDENTS; TRANSFER (PSYCHOLOGY); YOUNG ADULT;

EID: 77956455050     PISSN: 0090502X     EISSN: None     Source Type: Journal    
DOI: 10.3758/MC.38.4.441     Document Type: Article

References (61)

1. BANNERT, M. (2006). Effects of reflection prompts when learning with hypermedia. Journal of Educational Computing Research, 35, 359- 375. doi:10.2190/94V6-R58H-3367-G388.
2. BENJAMIN, A. S., & DIAZ, M. (2008). Measurement of relative metamnemonic accuracy. In J. Dunlosky & R. A. Bjork (Eds.), Handbook of metamemory and memory (pp. 73-94). New York: Psychology Press.
3. BLOOM, B. S., ENGELHART, M. D., FURST, E. J., HILL, W. H., & KRATHWOHL, D. R. (1973). Taxonomie von Lernzielen im kognitiven Bereich [Taxonomy of educational objectives] (E. Füner & R. Horn, Trans., 3rd ed.). Weinheim, Germany: Beltz.
4. BREWER, W. F., SAMPAIO, C., & BARLOW, M. R. (2005). Confidence and accuracy in the recall of deceptive and nondeceptive sentences. Journal of Memory & Language, 52, 618-627. doi:10.1016/j .jml.2005.01.017.
5. BYRNE, B. M. (1986). Self-concept/academic achievement relations: An investigation of dimensionality, stability, and causality. Canadian Journal of Behavioural Science, 18, 173-186.
6. COHEN, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
7. DUNLOSKY, J., & HERTZOG, C. (1998). Training programs to improve learning in later adulthood: Helping older adults educate themselves. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 249-275). Mahwah, NJ: Erlbaum.
8. DUNLOSKY, J., HERTZOG, C., KENNEDY, M. R. T., & THIEDE, K. W. (2005). The self-monitoring approach for effective learning. Cognitive Technology, 10, 4-11.
9. DUNLOSKY, J., & LIPKO, A. R. (2007). Metacomprehension: A brief history and how to improve its accuracy. Current Directions in Psychological Science, 16, 228-232. doi:10.1111/j.1467-8721.2007 .00509.x.
10. DUNLOSKY, J., RAWSON, K. A., & MCDONALD, S. L. (2002). Influence of practice tests on the accuracy of predicting memory performance for paired associates, sentences, and text material. In T. J. Perfect & B. L. Schwartz (Eds.), Applied metacognition (pp. 68-92). Cambridge: Cambridge University Press.
11. DUNLOSKY, J., RAWSON, K. A., & MIDDLETON, E. L. (2005). What constrains the accuracy of metacomprehension judgments? Testing the transfer-appropriate-monitoring and accessibility hypotheses. Journal of Memory & Language, 52, 551-565. doi:10.1016/j .jml.2005.01.011.
12. EHRLINGER, J., & DUNNING, D. (2003). How chronic self-views influence (and potentially mislead) estimates of performance. Journal of Personality & Social Psychology, 84, 5-17. doi:10.1037/0022 -3514.84.1.5.
13. GLENBERG, A. M., & EPSTEIN, W. (1987). Inexpert calibration of comprehension. Memory & Cognition, 15, 84-93.
14. GLENBERG, A. M., SANOCKI, T., EPSTEIN, W., & MORRIS, C. (1987). Enotherhancing calibration of comprehension. Journal of Experimental Psychology: General, 116, 119-136. doi:10.1037/0096-3445.116.2.119.
15. GONZALEZ, R., & NELSON, T. O. (1996). Measuring ordinal association in situations that contain tied scores. Psychological Bulletin, 119, 159-165. doi:10.1037/0033-2909.119.1.159.
16. GRAESSER, A. C., MILLIS, K. K., & ZWAAN, R. A. (1997). Discourse comprehension. Annual Review of Psychology, 48, 163-189. doi:10.1146/annurev. psych.48.1.163. (Pubitemid 127064589)
17. HACKER, D. J., BOL, L., & BAHBAHANI, K. (2008). Explaining calibration accuracy in classroom contexts: The effects of incentives, reflection, and explanatory style. Metacognition & Learning, 3, 101-121. doi:10.1007/s11409-008-9021-5.
18. HASSELHORN, M., & HAGER, W. (1989). Prediction accuracy and memory performance: Correlational and experimental tests of a metamemory hypothesis. Psychological Research, 51, 147-152. doi:10.1007/BF00309310.
19. JONSSON, A.-C., & ALLWOOD, C. M. (2003). Stability and variability in the realism of confidence judgments over time, content domain, and gender. Personality & Individual Differences, 34, 559-574. doi:10.1016/S0191- 8869(02)00028-4. (Pubitemid 36136193)
20. KELEMEN, W. L., FROST, P. J., & WEAVER, C. A. III (2000). Individual differences in metacognition: Evidence against a general metacognitive ability. Memory & Cognition, 28, 92-107.
21. KELLEY, C. M., & LINDSAY, D. S. (1993). Remembering mistaken for knowing: Ease of retrieval as a basis for confidence in answers to general knowledge questions. Journal of Memory & Language, 32, 1-24. doi:10.1006/jmla.1993.1001.
22. KLEITMAN, S., & STANKOV, L. (2001). Ecological and person-oriented aspects of metacognitive processes in test-taking. Applied Cognitive Psychology, 15, 321-341. doi:10.1002/acp.705. (Pubitemid 33676534)
23. KLEITMAN, S., & STANKOV, L. (2007). Self-confidence and metacognitive processes. Learning & Individual Differences, 17, 161-173. doi:10.1016/j.lindif.2007.03.004.
24. KORIAT, A. (2007). Metacognition and consciousness. In P. D. Zelazo, M. Moscovitch, & E. Thompson (Eds.), The Cambridge handbook of consciousness (pp. 289-325). Cambridge: Cambridge University Press.
25. KORIAT, A., NUSSINSON, R., BLESS, H., & SHAKED, N. (2008). Information-based and experience-based metacognitive judgments: Evidence from subjective confidence. In J. Dunlosky & R. A. Bjork (Eds.), Handbook of metamemory and memory (pp. 117-135). New York: Psychology Press.
26. LANE, J., & LANE, A. [M.] (2001). Self-efficacy and academic performance. Social Behavior & Personality, 29, 687-693. doi:10.2224/sbp.2001.29.7.687.
27. LANE, J., LANE, A. M., & KYPRIANOU, A. (2004). Self-efficacy, selfesteem and their impact on academic performance. Social Behavior & Personality, 32, 247-256. doi:10.2224/sbp.2004.32.3.247.
28. LEONESIO, R. J., & NELSON, T. O. (1990). Do different metamemory judgments tap the same underlying aspects of memory? Journal of Experimental Psychology: Learning, Memory, & Cognition, 16, 464- 470. doi:10.1037/0278-7393.16.3.464.
29. LITTLE, T. D., BOVAIRD, J. A., & SLEGERS, D. W. (2006). Methods for the analysis of change. In D. K. Mroczek & T. D. Little (Eds.), Handbook of personality development (pp. 181-211). Mahwah, NJ: Erlbaum.
30. MAKI, R. H. (1995). Accuracy of metacomprehension judgments for questions of varying importance levels. American Journal of Psychology, 108, 327-344. doi:10.2307/1422893.
31. MAKI, R. H. (1998). Metacomprehension of text: Influence of absolute confidence level on bias and accuracy. In D. L. Medin (Ed.), The psychology of learning and motivation (Vol. 38, pp. 223-248). San Diego: Academic Press.
32. MAKI, R. H., JONAS, D., & KALLOD, M. (1994). The relationship between comprehension and metacomprehension ability. Psychonomic Bulletin & Review, 1, 126-129.
33. MENGELKAMP, C., & BANNERT, M. (2009). Judgements about knowledge: Searching for factors that influence their validity. Electronic Journal of Research in Educational Psychology, 7, 163-190.
34. METCALFE, J. (2002). Is study time allocated selectively to a region of proximal learning? Journal of Experimental Psychology: General, 131, 349-363. doi:10.1037/0096-3445.131.3.349.
35. MOORE, D., LIN-AGLER, L. M., & ZABRUCKY, K. M. (2005). A source of metacomprehension inaccuracy. Reading Psychology, 26, 251-265. doi:10.1080/02702710590962578. (Pubitemid 41053354)
36. NELSON, T. O. (1984). A comparison of current measures of the accuracy of feeling-of-knowing predictions. Psychological Bulletin, 95, 109- 133. doi:10.1037/0033-2909.95.1.109.
37. NELSON, T. O. (1996). Gamma is a measure of the accuracy of predicting performance on one item relative to another item, not of the absolute performance on an individual item. Applied Cognitive Psychology, 10, 257-260.
38. NELSON, T. O., & Dunlosky, J. (1991). When people's judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The "delayed-JOL effect." Psychological Science, 2, 267-270. doi:10.1111/j.1467-9280.1991.tb00147.x.
39. NELSON, T. O., & NARENS, L. (1990). Metamemory: A theoretical framework and new findings. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 26, pp. 125-173). New York: Academic Press.
40. NELSON, T. O., & NARENS, L. (1992). Metamemory: A theoretical framework and new findings. In T. O. Nelson (Ed.), Metacognition: Core readings (pp. 117-130). Needham Heights, MA: Allyn and Bacon.
41. NIETFELD, J. L., CAO, L., & OSBORNE, J. W. (2005). Metacognitive monitoring accuracy and student performance in the postsecondary classroom. Journal of Experimental Education, 74, 7-28.
42. NIETFELD, J. L., CAO, L., & OSBORNE, J. W. (2006). The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy. Metacognition & Learning, 1, 159-179.
43. NIETFELD, J. L., & SCHRAW, G. (2002). The effect of knowledge and strategy training on monitoring accuracy. Journal of Educational Research, 95, 131-142.
44. PALLIER, G., WILKINSON, R., DANTHIIR, V., KLEITMAN, S., KNEZEVIC, G., STANKOV, L., & ROBERTS, R. D. (2002). The role of individual differences in the accuracy of confidence judgments. Journal of General Psychology, 129, 257-299.
45. PRESSLEY, M., & GHATALA, E. S. (1988). Delusions about performance on multiple-choice comprehension tests. Reading Research Quarterly, 23, 454-464. doi:10.2307/747643.
46. ROST, D. H. (2005). Interpretation und Bewertung pädagogisch- psychologischer Studien. Eine Einführung [Interpretation and evaluation of studies in educational psychology. An introduction]. Weinheim, Germany: Beltz.
47. ROST, J. (2004). Lehrbuch Testtheorie-Testkonstruktion [Test theory and test construction textbook]. Bern, Switzerland: Huber.
48. SAMPAIO, C., & BREWER, W. F. (2009). The role of unconscious memory errors in judgments of confidence for sentence recognition. Memory & Cognition, 37, 158-163. doi:10.3758/MC.37.2.158.
49. SCHILLING, O. (2005). Strukturgleichungsmodelle zur Analyse von Simplex-Strukturen [Structural equation models for the analysis of simplex structures]. In J. Werner (Ed.), Zeitreihenanalysen mit Beispielen aus der Psychologie (pp. 37-72). Berlin: Logos.
50. SCHRAW, G. (2009). A conceptual analysis of five measures of metacognitive monitoring. Metacognition & Learning, 4, 33-45. doi:10.1007/s11409-008-9031-3.
51. SCHRAW, G., DUNKLE, M. E., BENDIXEN, L. D., & DEBACKER ROEDEL, T. (1995). Does a general monitoring skill exist? Journal of Educational Psychology, 87, 433-444. doi:10.1037/0022- 0663.87.3.433.
52. SCHRAW, G., & NIETFELD, J. [L.] (1998). A further test of the general monitoring skill hypothesis. Journal of Educational Psychology, 90, 236-248. doi:10.1037/0022-0663.90.2.236.
53. SON, L. K., & METCALFE, J. (2000). Metacognitive and control strategies in study-time allocation. Journal of Experimental Psychology: Learning, Memory, & Cognition, 26, 204-221. doi:10.1037/0278 -7393.26.1.204.
54. STANKOV, L. (1998). Calibration curves, scatterplots and the distinction between general knowledge and perceptual tasks. Learning & Individual Differences, 10, 29-50. doi:10.1016/S1041-6080(99)80141-1.
55. THIEDE, K. W., ANDERSON, M. C. M., & THERRIAULT, D. (2003). Accuracy of metacognitive monitoring affects learning of texts. Journal of Educational Psychology, 95, 66-73. doi:10.1037/0022-0663.95.1.66.
56. THIEDE, K. W., & DUNLOSKY, J. (1999). Toward a general model of self-regulated study: An analysis of selection of items for study and self-paced study time. Journal of Experimental Psychology: Learning, Memory, & Cognition, 25, 1024-1037. doi:10.1037/0278 -7393.25.4.1024.
57. THOMPSON, W. B., & MASON, S. E. (1996). Instability of individual differences in the association between confidence judgments and memory performance. Memory & Cognition, 24, 226-234.
58. TOBIAS, S., & EVERSON, H. (2000). Assessing metacognitive knowledge monitoring. In G. Schraw & J. C. Impara (Eds.), Issues in the measurement of metacognition (pp. 147-222). Lincoln, NE: Buros Institute of Mental Measurements.
59. WEAVER, C. A. III (1990). Constraining factors in calibration of comprehension. Journal of Experimental Psychology: Learning, Memory, & Cognition, 16, 214-222. doi:10.1037/0278-7393.16.2.214.
60. WEAVER, C. A. III, & KELEMEN, W. L. (1997). Judgments of learning at delays: Shifts in response patterns or increased metamemory accuracy? Psychological Science, 8, 318-321. doi:10.1111/j.1467-9280.1997 .tb00445.x.
61. YATES, J. F. (1990). Judgment and decision making. Englewood Cliffs, NJ: Prentice Hall.