Comparing objective and subjective learning curves: Judgments of learning exhibit increased underconfidence with practice

Journal of Experimental Psychology: General

Volumn 131, Issue 2, 2002, Pages 147-162

  Koriat, Asher ^a   Sheffer, Limor ^a   Ma'ayan, Hilit ^a  

^a UNIVERSITY OF HAIFA   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; COMPARATIVE STUDY; DECISION MAKING; FEEDBACK SYSTEM; HUMAN; LEARNING; MEMORY; RANDOMIZATION; RECALL; SELF CONCEPT;

ADULT; FEEDBACK; HUMANS; JUDGMENT; LEARNING; MEMORY; MENTAL RECALL; RANDOM ALLOCATION; SELF CONCEPT;

EID: 85047673972     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-3445.131.2.147     Document Type: Article

References (68)

1. Arbuckle, T. Y., & Cuddy, L. L. (1969). Discrimination of item strength at time of presentation. Journal of Experimental Psychology, 81, 126-131.
2. Ayton, P., & McClelland, A. G. R. (1997). How real is overconfidence? Journal of Behavioral Decision Processes, 10, 153-285.
3. Barnes, A. E., Nelson, T. O., Dunlosky, J., Mazzoni, G., & Narens, L. (1999). An integrative system of metamemory components involved in retrieval. In D. Gopher & A. Koriat (Eds.), Attention and performance XVII - Cognitive regulation of performance: Interaction of theory and application (pp. 287-313). Cambridge, MA: MIT Press.
4. Begg, I., Duft, S., Lalonde, P., Melnick, R., & Sanvito, J. (1989). Memory predictions are based on ease of processing. Journal of Memory and Language, 28, 610-632.
5. Begg, I., Vinski, E., Frankovich, L., & Holgate, B. (1991). Generating makes words memorable, but so does effective reading. Memory & Cognition, 19, 487-497.
6. Benjamin, A. S., & Bjork, R. A. (1996). Retrieval fluency as a metacognitive index. In L. Reder (Ed.), Implicit memory and metacognition (pp. 309-338). Hillsdale, NJ: Erlbaum.
7. Benjamin, A. S., Bjork, R. A., & Schwanz, B. L. (1998). The mismeasure of memory: When retrieval fluency is misleading as a metamemory index. Journal of Experimental Psychology: General, 127, 55-68.
8. Bjork, R. A. (1999). Assessing our own competence: Heuristics and illusions. In D. Gopher & A. Koriat (Eds.), Attention and performance XVII - Cognitive regulation of performance: Interaction of theory and application (pp. 435-459). Cambridge, MA: MIT Press
9. Bjork, R. A., & Bjork, E. L. (1992). A new theory of disuse and an old theory of stimulus fluctuation. In A. F. Healy & S. M. Kosslyn (Eds.), Essays in honor of William K. Estes (Vol. 1, pp. 35-67). Hillsdale, NJ: Erlbaum.
10. Carroll, M., Nelson, T. O., & Kirwan, A. (1997). Tradeoff of semantic relatedness and degree of overlearning: Differential effects on metamemory and on long-term retention. Acta Psychologica, 95, 239-253.
11. Cohen, R. L., Sandler, S. P., & Keglevich, L. (1991). The failure of memory monitoring in a free recall task. Canadian Journal of Psychology, 45, 523-538.
12. Connor, L. T., Dunlosky, J., & Hertzog, C. (1997). Age-related differences in absolute but not relative metamemory accuracy. Psychology and Aging, 12, 50-71.
13. Cutting, J. E. (1975). Orienting tasks affect recall performance more than subjective impressions of ability to recall. Psychological Reports, 36, 155-158.
14. Dunlosky, J. T., & Hertzog, C. (1998). Training programs to improve learning in later adulthood: Helping older adults educate themselves. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 249-275). Hillsdale, NJ: Erlbaum.
15. Dunlosky, J., & Nelson, T. O. (1992). Importance of the kind of cue for judgments of learning (JOL) and the delayed-JOL effect. Memory & Cognition, 20, 374-380.
16. Dunlosky, J., & Nelson, T. O. (1994). Does the sensitivity of judgments of learning (JOLs) to the effects of various study activities depend on when the JOLs occur? Journal of Memory and Language, 33, 545-565.
17. Dunlosky, J., & Thiede, K. W. (1998). What makes people study more? An evaluation of factors that affect self-paced study. Acta Psychologica, 98, 37-56.
18. Ebbinghaus, H. (1964). Memory: A contribution to experimental psychology (Rev. ed.). New York: Dover. (Original work published 1885)
19. Engelkamp, J. (1998). Memory for actions. East Sussex, England: Psychology Press.
20. Erev, I., Wallsten, T. S., & Budescu, D. V. (1994). Simultaneous over- and underconfidence: The role of error in judgment processes. Psychological Review, 101, 519-527.
21. Gigerenzer, G., Hoffrage, U., & Kleinbolting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review, 98, 506-528.
22. Granhag, P. A. (1997). Realism in eyewitness confidence as a function of type of event witnessed and repeated recall. Journal of Applied Psychology, 82, 599-613.
23. Griffin, D. W., & Tversky, A. (1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24, 411-435.
24. Juslin, P. (1993). An explanation of the hard-easy effect in studies of realism of confidence in one's general knowledge. European Journal of Cognitive Psychology, 5, 55-71.
25. Juslin, P., Winman, A., & Olsson, H. (2000). Naive empiricism and dogmatism in confidence research: A critical examination of the hard-easy effect. Psychological Review, 107, 384-396.
26. Keren, G. (1991). Calibration and probability judgments: Conceptual and methodological issues. Acta Psychologica, 77, 217-273.
27. King, J. F., Zechmeister, E. B., & Shaughnessy, J. J. (1980). Judgments of knowing: The influence of retrieval practice. American Journal of Psychology, 93(2), 329-343.
28. Klayman, J., Soil, J. B., Gonzáles-Vallejo, C., & Barlas, S. (1999). Overconfidence: It depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes, 79, 216-247.
29. Koriat, A. (1997). Monitoring one's own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126, 349-370.
30. Koriat, A. (2000). The feeling of knowing: Some metatheoretical implications for consciousness and control. Consciousness and Cognition, 9, 149-171.
31. Koriat, A., Ben-Zur, H., & Druch, A. (1991). The contextualization of memory for input and output events. Psychological Research, 53, 260-270.
32. Koriat, A., & Bjork, R. A. (2001). Illusions of competence in monitoring one's knowledge during study: The foresight bias. Manuscript submitted for publication.
33. Koriat, A., & Bjork, R. A. (2002). Can illusions of competence be remedied? Effects of study and test experience on the foresight bias. Manuscript in preparation.
34. Koriat, A., & Goldsmith, M. (1996). Monitoring and control processes in the strategic regulation of memory accuracy. Psychological Review, 103, 490-517.
35. Koriat, A., & Levy-Sadot, R. (1999). Processes underlying metacognitive judgments: Information-based and experience-based monitoring of one's own knowledge. In S. Chaiken & Y. Trope (Eds.), Dual process theories in social psychology (pp. 483-502). New York: Guilford Press.
36. Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Cognition, 6, 107-118.
37. Koriat, A., Ma'ayan, H., & Levy-Sadot, R. (2002). The intricate relationships between monitoring and control in metacognition. Manuscript in preparation.
38. Koriat, A., Pearlman-Avnion, S., & Ben-Zur, H. (1998). The subjective organization of input and output events in memory. Psychological Research, 61, 295-307.
39. Leonesio, R. J., & Nelson, T. O. (1990). Do different metamemory judgments tap the same underlying aspects of memory? Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 464-470.
40. Lichtenstein, S., & Fischhoff, B. (1977). Do those who know more also know more about how much they know?: The calibration of probability judgments. Organizational Behavior and Human Performance, 20, 159-183.
41. Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982). Calibration of probabilities: The state of the art to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty. Heuristics and biases (pp. 306-334). Cambridge, England: Cambridge University Press.
42. Lovelace, E. A. (1984). Metamemory: Monitoring future recallability during study. Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 756-766.
43. Mazzoni, G., & Cornoldi, C. (1993). Strategies in study time allocation: Why is study time sometimes not effective? Journal of Experimental Psychology: General, 122, 47-60.
44. Mazzoni, G., Cornoldi, C., & Marchitelli, G. (1990). Do memorability ratings affect study-time allocation? Memory and Cognition, 18, 196-204.
45. Mazzoni, G., & Nelson, T. (1995). Judgments of learning are affected by the kind of encoding in ways that cannot be attributed to the level of recall. Journal of Experimental Psychology: Learning, Memory & Cognition, 21, 1263-1274.
46. McClelland, A. G. R., & Bolger, F. (1994). The calibration of subjective probability: Theories and models 1980-94. In G. Wright & P. Ayton (Eds.), Subjective probability (pp. 453-482). Chichester, UK: Wiley.
47. Nelson, D. L., McKinney, V. M., Gee, N. R., & Janczura, G. A. (1998). Interpreting the influence of implicitly activated memories on recall and recognition. Psychological Review, 105, 299-324.
48. Nelson, T. O. (1984). A comparison of current measures of the accuracy of feeling-of-knowing predictions. Psychological Bulletin, 95, 109-133.
49. Nelson, T. O. (1996). Consciousness and metacognition. American Psychologist, 51, 102-116.
50. Nelson, T. O., & Dunlosky, J. (1991). When people's judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The "delayed-JOL effect." Psychological Science, 2, 267-270.
51. Nelson, T. O., Dunlosky, J., Graf, A., & Narens, L. (1994). Utilization of metacognitive judgments in the allocation of study during multitrial learning. Psychological Science, 5, 207-213.
52. Nelson, T. O., & Leonesio, R. J. (1988). Allocation of self-paced study time and the "labor-in-vain effect." Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 676-686.
53. Palermo, D. S., & Jenkins, J. J. (1964). Word association norms: Grade school through college. Minneapolis: University of Minnesota Press.
54. Rabinowitz, J. C., Ackerman, B. P., Craik, F. I. M., & Hinchley, J. L. (1982). Aging and metamemory: The roles of relatedness and imagery. Journal of Gerontology, 37, 688-695.
55. Rawson, K. A., Dunlosky, J., & Thiede, K. W. (2000). The rereading effect: Metacomprehension accuracy improves across reading trials. Memory & Cognition, 28, 1004-1010.
56. Runeson, S., Juslin, P., & Olsson, H. (2000). Visual perception of dynamic properties: Cue heuristics versus direct-perceptual competence. Psychological Review, 107, 525-555.
57. Schneider, S. L. (1995). Item difficulty, discrimination, and the confidence-frequency effect in a categorical judgment task. Organizational Behavior and Human Decision Processes, 61, 148-167.
58. Schneider, W., Vise, M., Lockl, K., & Nelson, T. O. (2000). Developmental trends in children's memory monitoring: Evidence from a judgment-of-learning (JOL) task. Cognitive Development, 15, 115-134.
59. Shaughnessy, J. J. (1981). Memory monitoring accuracy and modification of rehearsal strategies. Journal of Verbal Learning and Verbal Behavior, 20, 216-230.
60. Shaw, R. J., & Craik, F. I. (1989). Age differences in predictions and performance on a cued recall task. Psychology and Aging, 4, 131-135.
61. Slovic, P., Monahan, J., & MacGregor, D. G. (2000). Violence risk assessment and risk communication: The effects of using actual cases, providing instruction, and employing probability versus frequency formats. Law and Human Behavior, 24, 271-296.
62. Son, L. K., & Metcalfe, J. (2000). Metacognitive and control strategies in study-time allocation. Journal of Experimental Psychology: Learning, Memory & Cognition, 26, 204-221.
63. Suantak, L., Bolger, F., & Ferrell, W. R. (1996). The hard-easy effect in subjective probability calibration. Organizational Behavior and Human Decision Processes, 67, 201-221.
64. Thiede, K. W., & Dunlosky, J. (1999). Toward a general model of self-regulated study: An analysis of selection of items for study and self-paced learning. Journal of Experimental Psychology: Learning, Memory & Cognition, 25, 1024-1037.
65. Thorndike, E. L. (1911). Animal intelligence: Experimental studies. New York: Macmillan.
66. Treadwell, J. R., & Nelson, T. O. (1996). Availability of information and the aggregation of confidence in prior decisions. Organizational Behavior and Human Decision Processes, 68, 13-27.
67. Yates, J. F. (1990). Judgment and decision making. Englewood Cliffs, NJ: Prentice Hall.
68. Zechmeister, E. B., & Shaughnessy, J. J. (1980). When you know that you know and when you think that you know but you don't. Bulletin of the Psychonomic Society, 15, 41-44.