Subjective Confidence in Perceptual Judgments: A Test of the Self-Consistency Model

Journal of Experimental Psychology: General

Volumn 140, Issue 1, 2011, Pages 117-139

  Koriat, Asher ^a  

^a UNIVERSITY OF HAIFA   (Israel)

Author keywords

Confidence accuracy relationship; Metacognition; Perceptual comparisons; Self consistency; Subjective confidence

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; COGNITION; DECISION MAKING; FEMALE; HUMAN; MALE; PHYSIOLOGY; PSYCHOLOGICAL ASPECT; PSYCHOLOGICAL MODEL; SELF CONCEPT; STUDENT; VISION;

ANALYSIS OF VARIANCE; CHOICE BEHAVIOR; COGNITION; DECISION MAKING; FEMALE; HUMANS; JUDGMENT; MALE; MODELS, PSYCHOLOGICAL; SELF CONCEPT; STUDENTS; VISUAL PERCEPTION;

EID: 79951534013     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0022171     Document Type: Article

References (95)

1. Audley R.J. A stochastic model for individual choice behavior. Psychological Review 1960, 67:1-15. doi: 10.1037/h0046438.
2. Baranski J.V., Petrusic W.M. The calibration and resolution of confidence in perceptual judgments. Perception & Psychophysics 1994, 55:412-428.
3. Baranski J.V., Petrusic W.M. On the calibration of knowledge and perception. Canadian Journal of Experimental Psychology 1995, 49:397-407. doi: 10.1037/1196-1961.49.3.397.
4. Baranski J.V., Petrusic W.M. Probing the locus of confidence judgments: Experiments on the time to determine confidence. Journal of Experimental Psychology: Human Perception and Performance 1998, 24:929-945. doi: 10.1037/0096-1523.24.3.929.
5. Baranski J.V., Petrusic W.M. Realism of confidence in sensory discrimination. Perception & Psychophysics 1999, 61:1369-1383.
6. Barnes A.E., Nelson T.O., Dunlosky J., Mazzoni G., Narens L. An integrative system of metamemory components involved in retrieval. Attention and performance XVII: Cognitive regulation of performance. Interaction of theory and application 1999, 287-313. MIT Press, Cambridge, MA. D. Gopher, A. Koriat (Eds.).
7. Bassili J.N. Meta-judgmental versus operative indexes of psychological attributes: The case of measures of attitude strength. Journal of Personality and Social Psychology 1996, 71:637-653. doi: 10.1037/0022-3514.71.4.637.
8. Björkman M., Juslin P., Winman A. Realism of confidence in sensory discrimination: The underconfidence phenomenon. Perception & Psychophysics 1993, 54:75-81.
9. Bothwell R.K., Deffenbacher K.A., Brigham J.C. Correlation of eyewitness accuracy and confidence: Optimality hypothesis revisited. Journal of Applied Psychology 1987, 72:691-695. doi: 10.1037/0021-9010.72.4.691.
10. Bower G.H. Stimulus-sampling theory of encoding variability. Coding processes in human memory 1972, 85-123. Winston, Washington, DC. A.W. Melton, E. Martin (Eds.).
11. Brenner L.A., Koehler D.J., Liberman V., Tversky A. Overconfidence in probability and frequency judgments: A critical examination. Organizational Behavior and Human Decision Processes 1996, 65:212-219. doi: 10.1006/obhd.1996.0021.
12. Brewer W.F., Sampaio C. Processes leading to confidence and accuracy in sentence recognition: A metamemory approach. Memory 2006, 14:540-552. doi: 10.1080/09658210600590302.
13. Crocker L., Algina J. Introduction to classical and modern test theory 1986, Holt, Rinehart, & Winston, New York, NY.
14. Dawes R.M. Confidence in intellectual judgments vs. confidence in perceptual judgments. Similarity and choice: Papers in honour of Clyde Coombs 1980, 327-345. Huber, Bern, Switzerland. E.D. Lanterman, H. Feger (Eds.).
15. Dhami M.K., Hertwig R., Hoffrage U. The role of representative design in an ecological approach to cognition. Psychological Bulletin 2004, 130:959-988. doi: 10.1037/0033-2909.130.6.959.
16. Dougherty M.R.P. Integration of the ecological and error models of overconfidence using a multiple-trace memory model. Journal of Experimental Psychology: General 2001, 130:579-599. doi: 10.1037/0096-3445.130.4.579.
17. Dunlosky J., Metcalfe J. Metacognition 2009, Sage, Thousand Oaks, CA.
18. Dunning D., Heath C., Suls J.M. Flawed self-assessment. Psychological Science 2004, 5:69-106.
19. Estes W.K. Toward a statistical theory of learning. Psychological Review 1950, 57:94-107. doi: 10.1037/h0058559.
20. Finn B., Metcalfe J. The role of memory for past test in the underconfidence with practice effect. Journal of Experimental Psychology: Learning, Memory, and Cognition 2007, 33:238-244. doi: 10.1037/0278-7393.33.1.238.
21. Fischhoff B., Slovic P., Lichtenstein S. Knowing with certainty: The appropriateness of extreme confidence. Journal of Experimental Psychology: Human Perception and Performance 1977, 3:552-564. doi: 10.1037/0096-1523.3.4.552.
22. Fullerton G.S., Cattell J.M. On the perception of small differences. Publications of the University of Pennsylvania: Philosophical Monograph Series, No. 2 1892, University of Pennsylvania Press, Philadelphia, PA.
23. Gigerenzer G., Hoffrage U., Kleinbölting H. Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review 1991, 98:506-528. doi: 10.1037/0033-295X.98.4.506.
24. Gill M.J., Swann W.B., Silvera D.H. On the genesis of confidence. Journal of Personality and Social Psychology 1998, 75:1101-1114. doi: 10.1037/0022-3514.75.5.1101.
25. Goldsmith M., Koriat A. The strategic regulation of memory accuracy and informativeness. Psychology of learning and motivation: Vol. 48. Memory use as skilled cognition 2008, 1-60. Elsevier, San Diego, CA. A. Benjamin, B. Ross (Eds.).
26. Griffin, D., & Brenner, L. (2004). Perspectives on probability judgment calibration. In D. J. Koehler, & N. Harvey (Eds.), Blackwell handbook of judgment and decision making (pp. 177-198). Malden, MA: Blackwell. doi: 10.1002/9780470752937.ch9.
27. Griffin D., Tversky A. The weighing of evidence and the determinants of confidence. Cognitive Psychology 1992, 24:411-435. doi: 10.1016/0010-0285(92)90013-R.
28. Haddock G., Rothman A.J., Reber R., Schwarz N. Forming judgments of attitude certainty, importance, and intensity: The role of subjective experiences. Personality and Social Psychology Bulletin 1999, 25:771-782. doi: 10.1177/0146167299025007001.
29. Hasher L., Goldstein D., Toppino T. Frequency and the conference of referential validity. Journal of Verbal Learning and Verbal Behavior 1977, 16:107-112. doi: 10.1016/S0022-5371(77)80012-1.
30. Hertwig R., Herzog S.M., Schooler L.J., Reimer T. Fluency heuristic: A model of how the mind exploits a by-product of information retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition 2008, 34:1191-1206. doi: 10.1037/a0013025.
31. Hoffrage U. Overconfidence. Cognitive illusions: A handbook on fallacies and biases in thinking, judgment, and memory 2004, 235-254. Psychology Press, Hove, England. R.F. Pohl (Ed.).
32. Holland R.W., Verplanken B., van Knippenberg A. From repetition to conviction: Attitude accessibility as a determinant of attitude certainty. Journal of Experimental Social Psychology 2003, 39:594-601. doi: 10.1016/S0022-1031(03)00038-6.
33. Jacoby L.L., Kelley C.M., Dywan J. Memory attributions. Varieties of memory and consciousness: Essays in honour of Endel Tulving 1989, 391-422. Erlbaum, Hillsdale, NJ. H.L. Roediger, F.I.M. Craik (Eds.).
34. Juslin P. The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items. Organizational Behavior and Human Decision Processes 1994, 57:226-246. doi: 10.1006/obhd.1994.1013.
35. Juslin P., Olsson H. Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination. Psychological Review 1997, 104:344-366. doi: 10.1037/0033-295X.104.2.344.
36. Juslin P., Winman A., Olsson H. Calibration, additivity, and source independence of probability judgments in general knowledge and sensory discrimination tasks. Organizational Behavior and Human Decision Processes 2003, 92:34-51. doi: 10.1016/S0749-5978(03)00063-3.
37. Kelley C.M., Lindsay D.S. Remembering mistaken for knowing: Ease of retrieval as a basis for confidence in answers to general knowledge questions. Journal of Memory and Language 1993, 32:1-24. doi: 10.1006/jmla.1993.1001.
38. Keren G. On the ability of monitoring non-veridical perceptions and uncertain knowledge: Some calibration studies. Acta Psychologica 1988, 67:95-119. doi: 10.1016/0001-6918(88)90007-8.
39. Kleitman S., Stankov L. Ecological and person-oriented aspects of metacognitive processes in test-taking. Applied Cognitive Psychology 2001, 15:321-341. doi: 10.1002/acp.705.
40. Koriat A. Another look at the relationship between phonetic symbolism and the feeling of knowing. Memory & Cognition 1976, 4:244-248.
41. Koriat A. How do we know that we know? The accessibility model of the feeling of knowing. Psychological Review 1993, 100:609-639. doi: 10.1037/0033-295X.100.4.609.
42. Koriat A. Dissociating knowing and the feeling of knowing: Further evidence for the accessibility model. Journal of Experimental Psychology: General 1995, 124:311-333. doi: 10.1037/0096-3445.124.3.311.
43. Koriat A. The feeling of knowing: Some metatheoretical implications for consciousness and control. Consciousness and Cognition 2000, 9:149-171. doi: 10.1006/ccog.2000.0433.
44. Koriat A. Metacognition and consciousness. The Cambridge handbook of consciousness 2007, 289-325. Cambridge University Press, New York, NY. P.D. Zelazo, M. Moscovitch, E. Thompson (Eds.).
45. Koriat A. Subjective confidence in one's answers: The consensuality principle. Journal of Experimental Psychology: Learning, Memory, and Cognition 2008, 34:945-959. doi: 10.1037/0278-7393.34.4.945.
46. Koriat A. When confidence in a choice is independent of which choice is made. Psychonomic Bulletin & Review 2008, 15:997-1001. doi: 10.3758/PBR.15.5.997.
47. Koriat, A. (2010). The self-consistency model of subjective confidence. Manuscript submitted for publication.
48. Koriat A., Ackerman R. Choice latency as a cue for children's subjective confidence in the correctness of their answers. Developmental Science 2010, 13:441-453. doi: 10.1111/j.1467-7687.2009.00907.x.
49. Koriat, A., & Adiv, S. (2010). The construction of attitudinal judgments: Evidence from attitude certainty and response latency. Manuscript submitted for publication.
50. Koriat A., Goldsmith M. Monitoring and control processes in the strategic regulation of memory accuracy. Psychological Review 1996, 103:490-517. doi: 10.1037/0033-295X.103.3.490.
51. Koriat A., Lichtenstein S., Fischhoff B. Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory 1980, 6:107-118. doi: 10.1037/0278-7393.6.2.107.
52. Koriat A., Ma'ayan H. The effects of encoding fluency and retrieval fluency on judgments of learning. Journal of Memory and Language 2005, 52:478-492. doi: 10.1016/j.jml.2005.01.001.
53. Koriat A., Ma'ayan H., Nussinson R. The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior. Journal of Experimental Psychology: General 2006, 135:36-69. doi: 10.1037/0096-3445.135.1.36.
54. Koriat A., Nussinson R., Bless H., Shaked N. Information-based and experience-based metacognitive judgments: Evidence from subjective confidence. Handbook of memory and metamemory: Essays in honor of Thomas O. Nelson 2008, 117-135. Psychology Press, New York, NY. J. Dunlosky, R.A. Bjork (Eds.).
55. Koriat A., Pansky A., Goldsmith M. An output-bound perspective on false memories: The case of the Deese-Roediger-McDermott (DRM) paradigm. Successful remembering and successful forgetting: A Festschrift in Honor of Robert A. Bjork 2010, 301-332. Psychology Press, London, England. A. Benjamin (Ed.).
56. Kornell N. Metacognition in humans and animals. Current Directions in Psychological Science 2009, 18:11-15. doi: 10.1111/j.1467-8721.2009.01597.x.
57. Lichtenstein S., Fischhoff B., Phillips L.D. Calibration of probabilities: The state of the art to 1980. Judgment under uncertainty: Heuristics and biases 1982, 306-334. Cambridge University Press, New York, NY. D. Kahneman, P. Slovic, A. Tversky (Eds.).
58. Lieberman M.D. Intuition: A social cognitive neuroscience approach. Psychological Bulletin 2000, 126:109-137. doi: 10.1037/0033-2909.126.1.109.
59. McKenzie C.R.M. Underweighting alternatives and overconfidence. Organizational Behavior and Human Decision Processes 1997, 71:141-160. doi: 10.1006/obhd.1997.2716.
60. McKenzie C.R.M. Taking into account the strength of an alternative hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition 1998, 24:771-792. doi: 10.1037/0278-7393.24.3.771.
61. Merkle E.C., Van Zandt T. An application of the Poisson race model to confidence calibration. Journal of Experimental Psychology: General 2006, 135:391-408. doi: 10.1037/0096-3445.135.3.391.
62. Modirrousta M., Fellows L.K. Medial prefrontal cortex plays a critical and selective role in " feeling of knowing" meta-memory judgments. Neuropsychologia 2008, 46:2958-2965. doi: 10.1016/j.neuropsychologia.2008.06.011.
63. Nelson T.O. A comparison of current measures of the accuracy of feeling-of-knowing predictions. Psychological Bulletin 1984, 95:109-133. doi: 10.1037/0033-2909.95.1.109.
64. Nelson T.O. Consciousness and metacognition. American Psychologist 1996, 51:102-116. doi: 10.1037/0003-066X.51.2.102.
65. Nelson T.O., Narens L. Metamemory: A theoretical framework and new findings. The psychology of learning and motivation: Advances in research and theory 1990, 125-173. Academic Press, San Diego, CA. G. Bower (Ed.).
66. Olsson H. A sampling model of confidence in sensory discrimination. Acta Universitatis Upsaliensis: Comprehensive summaries of Uppsala Dissertations from the Faculty of Social Sciences 1999, 87.
67. Palmer S. Vision science: From photons to phenomenology 1999, MIT Press, Cambridge, MA.
68. Peirce C.S., Jastrow J. On small differences of sensation. Memoirs of the National Academy of Science 1884, 3:73-83.
69. Persaud N., McLeod P., Cowey A. Post-decision wagering objectively measures awareness. Nature Neuroscience 2007, 10:257-261. doi: 10.1038/nn1840.
70. Petrusic W.M., Baranski J.V. Context, feedback, and the calibration and resolution of confidence in perceptual judgments. American Journal of Psychology 1997, 110:543-572. doi: 10.2307/1423410.
71. Petrusic W.M., Baranski J.V. Probability assessment with response times and confidence. Acta Psychologica 2009, 130:103-114. doi: 10.1016/j.actpsy.2008.10.008.
72. Read J.D., Lindsay D.S., Nicholls T. The relation between confidence and accuracy in eyewitness identification studies: Is the conclusion changing?. Eyewitness memory: Theoretical and applied perspectives 1998, 107-130. Erlbaum, Mahwah, NJ. C.P. Thompson, D.J. Herrmann, J.D. Read, D. Bruce, D.G. Payne, M.P. Toglia (Eds.).
73. Robinson M.D., Johnson J.T., Herndon F. Reaction time and assessments of cognitive effort as predictors of eyewitness memory accuracy and confidence. Journal of Applied Psychology 1997, 82:416-425. doi: 10.1037/0021-9010.82.3.416.
74. Ross M. Validating memories. Memory for everyday and emotional events 1997, 49-81. Erlbaum, Mahwah, NJ. N.L. Stein, P.A. Ornstein, B. Tversky, C. Brainerd (Eds.).
75. Sampaio C., Brewer W.F. The role of unconscious memory errors in judgments of confidence for sentence recognition. Memory & Cognition 2009, 37:158-163. doi: 10.3758/MC.37.2.158.
76. Schwartz B.L. Sources of information in metamemory: Judgments of learning and feeling of knowing. Psychonomic Bulletin & Review 1994, 1:357-375.
77. Schwartz B.L., Metcalfe J. Methodological problems and pitfalls in the study of human metacognition. Metacognition: Knowing about knowing 1994, 93-113. MIT Press, Cambridge, MA. J. Metcalfe, A.P. Shimamura (Eds.).
78. Shaw J.S. Increases in eyewitness confidence resulting from postevent questioning. Journal of Experimental Psychology: Applied 1996, 2:126-146. doi: 10.1037/1076-898X.2.2.126.
79. Smith J.D., Beran M.J., Couchman J.J., Coutinho M.V.C. The comparative study of metacognition: Sharper paradigms, safer inferences. Psychonomic Bulletin & Review 2008, 15:679-691. doi: 10.3758/PBR.15.4.679.
80. Son, L. K., & Schwartz, B. L. (2002). The relation between metacognitive monitoring and control. In T. J. Perfect & B. S. Schwartz (Eds.), Applied metacognition (pp. 15-38). Cambridge, England: Cambridge University Press. doi: 10.1017/CBO9780511489976.003.
81. Sporer S.L., Penrod S., Read D., Cutler B. Choosing, confidence, and accuracy: A meta-analysis of the confidence-accuracy relation in eyewitness identification studies. Psychological Bulletin 1995, 118:315-327. doi: 10.1037/0033-2909.118.3.315.
82. Stankov L., Crawford J.D. Self-confidence and performance on tests of cognitive abilities. Intelligence 1997, 25:93-109. doi: 10.1016/S0160-2896(97)90047-7.
83. Stephen A.T., Pham M.T. On feelings as a heuristic for making offers in ultimatum negotiations. Psychological Science 2008, 19:1051-1058. doi: 10.1111/j.1467-9280.2008.02198.x.
84. Tormala Z.L., Rucker D.D. Attitude certainty: A review of past findings and emerging perspectives. Social and Personality Psychology Compass 2007, 1:469-492. doi: 10.1111/j.1751-9004.2007.00025.x.
85. Van Zandt T. ROC curves and confidence judgments in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2000, 26:582-600. doi: 10.1037/0278-7393.26.3.582.
86. Vickers D. Decision processes in visual perception 1979, Academic Press, New York, NY.
87. Vickers D., Pietsch A. Decision-making and memory: A critique of Juslin and Olsson's (1997) sampling model of sensory discrimination. Psychological Review 2001, 108:789-804. doi: 10.1037/0033-295X.108.4.789.
88. Vickers D., Smith P., Burt J., Brown M. Experimental paradigms emphasizing state or process limitations: II. Effects on confidence. Acta Psychologica 1985, 59:163-193. doi: 10.1016/0001-6918(85)90018-6.
89. Waters H.S., Schneider W. Metacognition, strategy use, and instruction 2010, Guilford, New York, NY.
90. Winman A., Juslin P. Calibration of sensory and cognitive judgments: Two different accounts. Scandinavian Journal of Psychology 1993, 34:135-148. doi: 10.1111/j.1467-9450.1993.tb01109.x.
91. Wright G., Ayton P. Decision time, subjective probability, and task difficulty. Memory & Cognition 1988, 16:176-185.
92. Yaniv I., Yates J.F., Smith J.E.K. Measures of discrimination skill in probabilistic judgment. Psychological Bulletin 1991, 110:611-617. doi: 10.1037/0033-2909.110.3.611.
93. Yates J.F. Judgment and decision making 1990, Prentice-Hall, Englewood Cliffs, NJ.
94. Yzerbyt V.Y., Lories G., Dardenne B. Metacognition: Cognitive and social dimensions 1998, Sage, Thousand Oaks, CA.
95. Zakay D., Tuvia R. Choice latency times as determinants of post-decisional confidence. Acta Psychologica 1998, 98:103-115. doi: 10.1016/S0001-6918(97)00037-1.