The self-consistency model of subjective confidence

Psychological Review

Volumn 119, Issue 1, 2012, Pages 80-113

  Koriat, Asher ^a  

^a UNIVERSITY OF HAIFA   (Israel)

Author keywords

Calibration; Confidence accuracy relationship; Metacognition; Self consistency; Subjective confidence

Indexed keywords

ARTICLE; ASSOCIATION; ATTITUDE; CALIBRATION; CONSENSUS; DECISION MAKING; HUMAN; KNOWLEDGE; LEARNING; LITERATURE; PHYSIOLOGY; PSYCHOLOGIC TEST; PSYCHOLOGICAL MODEL; PSYCHOLOGICAL THEORY; REACTION TIME; RECALL; REPRODUCIBILITY; SELF CONCEPT; STATISTICAL ANALYSIS; STATISTICS;

ATTITUDE; CALIBRATION; CHOICE BEHAVIOR; CONSENSUS; CUES; DATA INTERPRETATION, STATISTICAL; HUMANS; JUDGMENT; KNOWLEDGE; LEARNING; MENTAL RECALL; MODELS, PSYCHOLOGICAL; PSYCHOLOGICAL TESTS; PSYCHOLOGICAL THEORY; REACTION TIME; REPRODUCIBILITY OF RESULTS; REVIEW LITERATURE AS TOPIC; SELF CONCEPT;

EID: 84859784664     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0025648     Document Type: Article

References (176)

1. Ackerman, R., & Koriat, A. (2011). Response latency as a predictor of the accuracy of children's reports. Journal of Experimental Psychology: Applied. Advance online publication. doi:10.1037/a0025129
2. Adams, J. K., & Adams, P. A. (1961). Realism of confidence judgments. Psychological Review, 68, 33-45. doi:10.1037/h0040274
3. Alba, J. W., & Marmorstein, H. (1987). The effects of frequency knowledge on consumer decision making. Journal of Consumer Research, 14, 14-25. doi:10.1086/209089
4. Allwood, C. M., & Montgomery, H. (1987). Response selection strategies and realism of confidence judgments. Organizational Behavior and Human Decision Processes, 39, 365-383. doi:10.1016/07495978(87)90029-X
5. Alter, A. L., & Oppenheimer, D. M. (2009). Uniting the tribes of fluency to form a metacognitive nation. Personality and Social Psychology Review, 13, 219-235. doi:10.1177/1088868309341564
6. Alter, A. L., Oppenheimer, D. M., Epley, N., & Eyre, R. N. (2007). Overcoming intuition: Metacognitive difficulty activates analytic reasoning. Journal of Experimental Psychology: General, 136, 569-576. doi:10.1037/0096-3445.136.4.569
7. Arkes, H. R., Christensen, C., Lai, C., & Blumer, C. (1987). Two methods of reducing overconfidence. Organizational Behavior and Human Decision Processes, 39, 133-144. doi:10.1016/0749-5978(87)90049-5
8. Arkes, H. R., Hackett, C., & Boehm, L. (1989). The generality of the relation between familiarity and judged validity. Journal of Behavioral Decision Making, 2, 81-94. doi:10.1002/bdm.3960020203
9. Audley, R. J. (1960). A stochastic model for individual choice behavior. Psychological Review, 67, 1-15. doi:10.1037/h0046438
10. Bacon, F. T. (1979). Credibility of repeated statements: Memory for trivia. Journal of Experimental Psychology: Human Learning and Memory, 5, 241-252. doi:10.1037/0278-7393.5.3.241
11. Baranski, J. V., & Petrusic, W. M. (1994). The calibration and resolution of confidence in perceptual judgments. Perception & Psychophysics, 55, 412-428. doi:10.3758/BF03205299
12. Baranski, J. V., & Petrusic, W. M. (1998). Probing the locus of confidence judgments: Experiments on the time to determine confidence. Journal of Experimental Psychology: Human Perception and Performance, 24, 929-945. doi:10.1037/0096-1523.24.3.929
13. Bar-Hillel, M. (1979). The role of sample size in sample evaluation. Organizational Behavior & Human Performance, 24, 245-257. doi: 10.1016/0030-5073(79)90028-X
14. Barnes, A. E., Nelson, T. O., Dunlosky, J., Mazzoni, G., & Narens, L. (1999). An integrative system of metamemory components involved in retrieval. In D. Gopher & A. Koriat (Eds.), Attention and performance XVII: Cognitive regulation of performance: Interaction of theory and application (pp. 287-313). Cambridge, MA: MIT Press.
15. Bassili, J. N. (2003). The minority slowness effect: Subtle inhibitions in the expression of views not shared by others. Journal of Personality and Social Psychology, 84, 261-276. doi:10.1037/0022-3514.84.2.261
16. Benjamin, A. S., & Bjork, R. A. (1996). Retrieval fluency as a metacognitive index. In L. M. Reder (Ed.), Implicit memory and metacognition (pp. 309-338). Mahwah, NJ: Erlbaum.
17. Benjamin, A. S., Bjork, R. A., & Schwartz, B. L. (1998). The mismeasure of memory: When retrieval fluency is misleading as a metamnemonic index. Journal of Experimental Psychology: General, 127, 55-68. doi: 10.1037/0096-3445.127.1.55
18. Björkman, M. (1994). Internal cue theory: Calibration and resolution of confidence in general knowledge. Organizational Behavior and Human Decision Processes, 58, 386-405. doi:10.1006/obhd.1994.1043
19. Björkman, M., Juslin, P., & Winman, A. (1993). Realism of confidence in sensory discrimination: The under confidence phenomenon. Perception & Psychophysics, 54, 75-81. doi:10.3758/BF03206939
20. Bless, H., & Schwarz, N. (2010). Mental construal and the emergence of assimilation and contrast effects: The inclusion/exclusion model. Advances in Experimental Social Psychology, 42, 319-373. doi:10.1016/ S0065-2601(10)42006-7
21. Bower, G. H. (1972). Stimulus-sampling theory of encoding variability. In A. W. Melton & E. Martin (Eds.), Coding processes in human memory (pp. 85-123). Washington, DC: Winston.
22. Braun, P. A., & Yaniv, I. (1992). A case study of expert judgment: Economists' probabilities versus base-rate model forecasts. Journal of Behavioral Decision Making, 5, 217-231. doi:10.1002/ bdm.3960050306
23. Brenner, L. A., Koehler, D. J., Liberman, V., & Tversky, A. (1996). Overconfidence in probability and frequency judgments: A critical examination. Organizational Behavior and Human Decision Processes, 65, 212-219. doi:10.1006/obhd.1996.0021
24. Brewer, W. F., & Sampaio, C. (2006). Processes leading to confidence and accuracy in sentence recognition: A metamemory approach. Memory, 14, 540-552. doi:10.1080/09658210600590302
25. Brown, R., & McNeill, D. (1966). The "tip of the tongue" phenomenon. Journal of Verbal Learning & Verbal Behavior, 5, 325-337. doi: 10.1016/S0022-5371(66)80040-3
26. Brunswik, E. (1956). Perception and representative design in psychological experiments. Berkeley, CA: University of California Press.
27. Busey, T. A., Tunnicliff, J., Loftus, G. R., & Loftus, E. (2000). Accounts of the confidence-accuracy relation in recognition memory. Psychonomic Bulletin & Review, 7, 26-48. doi:10.3758/BF03210724
28. Chandler, C. C. (1994). Studying related pictures can reduce accuracy, but increase confidence, in a modified recognition test. Memory & Cognition, 22, 273-280. doi:10.3758/BF03200854
29. Clark, J. K., Wegener, D. T., Briñol, P., & Petty, R. E. (2009). Discovering that the shoe fits: The self-validating role of stereotypes. Psychological Science, 20, 846-852. doi:10.1111/j.1467-9280.2009.02375.x
30. Cohen, R. L., Sandler, S. P., & Keglevich, L. (1991). The failure of memory monitoring in a free recall task. Canadian Journal of Psychology/Revue canadienne de psychologie, 45, 523-538. doi:10.1037/ h0084303
31. Costermans, J., Lories, G., & Ansay, C. (1992). Confidence level and feeling of knowing in question answering: The weight of inferential processes. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 142-150. doi:10.1037/0278-7393.18.1.142
32. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart, & Winston.
33. Dawes, R. M. (1980). Confidence in intellectual judgments vs. confidence in perceptual judgments. In E. D. Lanterman & H. Feger (Eds.), Similarity and choice: Papers in honour of Clyde Coombs (pp. 327-345). Bern, Switzerland: Huber.
34. Dawes, R. M., & Mulford, M. (1996). The false consensus effect and overconfidence: Flaws in judgment or flaws in how we study judgment? Organizational Behavior and Human Decision Processes, 65, 201-211. doi:10.1006/obhd.1996.0020
35. Denes-Raj, V., & Epstein, S. (1994). Conflict between intuitive and rational processing: When people behave against their better judgment. Journal of Personality and Social Psychology, 66, 819-829. doi: 10.1037/0022-3514.66.5.819
36. Dhami, M. K., Hertwig, R., & Hoffrage, U. (2004). The role of representative design in an ecological approach to cognition. Psychological Bulletin, 130, 959-988. doi:10.1037/0033-2909.130.6.959
37. Dienes, Z. (2011). Bayesian versus orthodox statistics: Which side are you on? Perspectives on Psychological Science, 6, 274-290. doi:10.1177/ 1745691611406920
38. Dougherty, M. R. P. (2001). Integration of the ecological and error models of overconfidence using a multiple-trace memory model. Journal of Experimental Psychology: General, 130, 579-599. doi:10.1037/00963445.130.4.579
39. Dunlosky, J., & Metcalfe, J. (2009). Metacognition. Thousand Oaks, CA: Sage.
40. Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12, 83-87. doi:10.1111/1467-8721.01235
41. Epstein, S., & Pacini, R. (1999). Some basic issues regarding dual-process theories from the perspective of cognitive-experiential self-theory. In S. Chaiken & Y. Trope (Eds.), Dual process theories in social psychology (pp. 462-482). New York, NY: Guilford Press.
42. Erev, I., Wallsten, T. S., & Budescu, D. V. (1994). Simultaneous overand underconfidence: The role of error in judgment processes. Psychological Review, 101, 519-527. doi:10.1037/0033-295X.101.3.519
43. Estes, W. K. (1950). Toward a statistical theory of learning. Psychological Review, 57, 94-107. doi:10.1037/h0058559
44. Evans, J. St. B. T. (2008). Dual-processing accounts of reasoning, judgment and social cognition. Annual Review of Psychology, 59, 255-278. doi:10.1146/annurev.psych.59.103006.093629
45. Fiedler, K. (2007). Information ecology and the explanation of social cognition and behavior. In A. W. Kruglanski & E. T. Higgins (Eds.), Social psychology: Handbook of basic principles (pp. 176-200). New York, NY: Guilford Press.
46. Fiedler, K., & Juslin, P. (2006). Taking the interface between mind and environment seriously. In K. Fiedler & P. Juslin (Eds.), Information sampling and adaptive cognition (pp. 3-29). New York, NY: Cambridge University Press.
47. Finn, B., & Metcalfe, J. (2007). The role of memory for past test in the underconfidence with practice effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 238-244. doi:10.1037/ 0278-7393.33.1.238
48. Fischhoff, B., Slovic, P., & Lichtenstein, S. (1977). Knowing with certainty: The appropriateness of extreme confidence. Journal of Experimental Psychology: Human Perception and Performance, 3, 552-564. doi:10.1037/0096-1523.3.4.552
49. Galton, F. (1907). Vox populi. Nature, 75, 450-451. doi:10.1038/ 075450a0
50. Garry, M., Manning, C. G., Loftus, E. F., & Sherman, S. J. (1996). Imagination inflation: Imagining a childhood event inflates confidence that it occurred. Psychonomic Bulletin & Review, 3, 208-214. doi: 10.3758/BF03212420
51. Gigerenzer, G. (2008). Why heuristics work. Perspectives on Psychological Science, 3, 20-29. doi:10.1111/j.1745-6916.2008.00058.x
52. Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review, 98, 506-528. doi:10.1037/0033-295X.98.4.506
53. Gill, M. J., Swann, W. B., Jr., & Silvera, D. H. (1998). On the genesis of confidence. Journal of Personality and Social Psychology, 75, 1101- 1114. doi:10.1037/0022-3514.75.5.1101
54. Granhag, P. A., & Strömwall, L. A. (2000). Deception detection: Examining the consistency heuristic. In C. M. Breur, M. M. Kommer, J. F. Nijboer, & J. M. Reintjes (Eds.), New trends in criminal investigation and evidence (Vol. 2, pp. 309-321). Antwerp, Belgium: Intersentia.
55. Griffin, D., & Brenner, L. (2004). Perspectives on probability judgment calibration. In D. J. Koehler & N. Harvey (Eds.), Blackwell handbook of judgment and decision making (pp. 177-198). Malden, MA: Blackwell. doi:10.1002/9780470752937.ch9
56. Griffin, D., & Tversky, A. (1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24, 411-435. doi: 10.1016/0010-0285(92)90013-R
57. Haddock, G., Rothman, A. J., Reber, R., & Schwarz, N. (1999). Forming judgments of attitude certainty, importance, and intensity: The role of subjective experiences. Personality and Social Psychology Bulletin, 25, 771-782. doi:10.1177/0146167299025007001
58. Hall, C. C., Ariss, L., & Todorov, A. (2007). The illusion of knowledge: When more information reduces accuracy and increases confidence. Organizational Behavior and Human Decision Processes, 103, 277- 290. doi:10.1016/j.obhdp.2007.01.003
59. Hart, J. T. (1965). Memory and the feeling-of-knowing experience. Journal of Educational Psychology, 56, 208-216. doi:10.1037/h0022263
60. Hasher, L., Goldstein, D., & Toppino, T. (1977). Frequency and the conference of referential validity. Journal of Verbal Learning & Verbal Behavior, 16, 107-112. doi:10.1016/S0022-5371(77)80012-1
61. Hertwig, R., Herzog, S. M., Schooler, L. J., & Reimer, T. (2008). Fluency heuristic: A model of how the mind exploits a by-product of information retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1191-1206. doi:10.1037/a0013025
62. Herzog, S. M., & Hertwig, R. (2009). The wisdom of many in one mind: Improving individual judgments with dialectical bootstrapping. Psychological Science, 20, 231-237. doi:10.1111/j.1467-9280.2009.02271.x
63. Hoffrage, U. (2004). Overconfidence. In R. F. Pohl (Ed.), Cognitive illusions: Fallacies and biases in thinking, judgement, and memory (pp. 235-254). Hove, England: Psychology Press.
64. Hourihan, K. L., & Benjamin, A. S. (2010). Smaller is better (when sampling from the crowd within): Low memory span individuals benefit more from multiple opportunities for estimation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 1068-1074. doi:10.1037/a0019694
65. Jacoby, L. L., & Brooks, L. R. (1984). Nonanalytic cognition: Memory, perception, and concept learning. In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (pp. 1-47). New York, NY: Academic Press.
66. Jacoby, L. L., Kelley, C. M., Brown, J., & Jasechko, J. (1989). Becoming famous overnight: Limits on the ability to avoid unconscious influences of the past. Journal of Personality and Social Psychology, 56, 326-338. doi:10.1037/0022-3514.56.3.326
67. Jacoby, L. L., Kelley, C. M., & Dywan, J. (1989). Memory attributions. In H. L. Roediger & F. I. M. Craik (Eds.), Varieties of memory and consciousness: Essays in honour of Endel Tulving (pp. 391-422). Hillsdale, NJ: Erlbaum.
68. Jacoby, L. L., Kelley, C. M., & McElree, B. D. (1999). The role of cognitive control: Early selection vs. late correction. In S. Chaiken & Y. Trope (Eds.), Dual-process theories in social psychology (pp. 383-400). New York, NY: Guilford Press.
69. Juslin, P. (1993). An explanation of the hard-easy effect in studies of realism of confidence in one's general knowledge. European Journal of Cognitive Psychology, 5, 55-71. doi:10.1080/09541449308406514
70. Juslin, P. (1994). The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items. Organizational Behavior and Human Decision Processes, 57, 226-246. doi: 10.1006/obhd.1994.1013
71. Juslin, P., & Olsson, H. (1997). Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination. Psychological Review, 104, 344-366. doi:10.1037/0033295X.104.2.344
72. Juslin, P., Winman, A., & Olsson, H. (2003). Calibration, additivity, and source independence of probability judgments in general knowledge and sensory discrimination tasks. Organizational Behavior and Human Decision Processes, 92, 34-51. doi:10.1016/S0749-5978(03)00063-3
73. Kahneman, D. (2003). A perspective on judgment and choice: Mapping bounded rationality. American Psychologist, 58, 697-720. doi:10.1037/ 0003-066X.58.9.697
74. Kelley, C. M., & Jacoby, L. L. (1996). Adult egocentrism: Subjective experience versus analytic bases for judgment. Journal of Memory and Language, 35, 157-175. doi:10.1006/jmla.1996.0009
75. Kelley, C. M., & Lindsay, D. S. (1993). Remembering mistaken for knowing: Ease of retrieval as a basis for confidence in answers to general knowledge questions. Journal of Memory and Language, 32, 1-24. doi:10.1006/jmla.1993.1001
76. Keren, G. (1988). On the ability of monitoring non-veridical perceptions and uncertain knowledge: Some calibration studies. Acta Psychologica, 67, 95-119. doi:10.1016/0001-6918(88)90007-8
77. Klayman, J., Soll, J. B., González-Vallejo, C., & Barlas, S. (1999). Overconfidence: It depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes, 79, 216-247. doi: 10.1006/obhd.1999.2847
78. Kleitman, S., & Stankov, L. (2001). Ecological and person-oriented aspects of metacognitive processes in test-taking. Applied Cognitive Psychology, 15, 321-341. doi:10.1002/acp.705
79. Koriat, A. (1975). Phonetic symbolism and the feeling of knowing. Memory & Cognition, 3, 545-548. doi:10.3758/BF03197529
80. Koriat, A. (1976). Another look at the relationship between phonetic symbolism and the feeling of knowing. Memory & Cognition, 4, 244- 248. doi:10.3758/BF03213170
81. Koriat, A. (1981). [Confidence and self-consistency: Evidence from within-person analyses]. Unpublished raw data.
82. Koriat, A. (1993). How do we know that we know? The accessibility model of the feeling of knowing. Psychological Review, 100, 609-639. doi: 10.1037/0033-295X.100.4.609
83. Koriat, A. (1995). Dissociating knowing and the feeling of knowing: Further evidence for the accessibility model. Journal of Experimental Psychology: General, 124, 311-333. doi:10.1037/0096-3445.124.3.311
84. Koriat, A. (1997). Monitoring one's own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126, 349-370. doi:10.1037/00963445.126.4.349
85. Koriat, A. (2000). The feeling of knowing: Some metatheoretical implications for consciousness and control. Consciousness and Cognition, 9, 149-171. doi:10.1006/ccog.2000.0433
86. Koriat, A. (2007). Metacognition and consciousness. In P. D. Zelazo, M. Moscovitch, & E. Thompson (Eds.), The Cambridge handbook of consciousness (pp. 289-325). New York, NY: Cambridge University Press.
87. Koriat, A. (2008a). Easy comes, easy goes? The link between learning and remembering and its exploitation in metacognition. Memory & Cognition, 36, 416-428. doi:10.3758/MC.36.2.416
88. Koriat, A. (2008b). Subjective confidence in one's answers: The consensuality principle. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 945-959. doi:10.1037/0278-7393.34.4.945
89. Koriat, A. (2008c). When confidence in a choice is independent of which choice is made. Psychonomic Bulletin & Review, 15, 997-1001. doi: 10.3758/PBR.15.5.997
90. Koriat, A. (2011). Subjective confidence in perceptual judgments: A test of the self-consistency model. Journal of Experimental Psychology: General, 140, 117-139. doi:10.1037/a0022171
91. Koriat, A., & Ackerman, R. (2010). Choice latency as a cue for children's subjective confidence in the correctness of their answers. Developmental Science, 13, 441-453. doi:10.1111/j.1467-7687.2009.00907.x
92. Koriat, A., Ackerman, R., Lockl, K., & Schneider, W. (2009). The easily learned, easily remembered heuristic in children. Cognitive Development, 24, 169-182. doi:10.1016/j.cogdev.2009.01.001
93. Koriat, A., & Adiv, S. (2011a). Confidence in one's social beliefs: Implications for belief justification. Manuscript submitted for publication.
94. Koriat, A., & Adiv, S. (2011b). The construction of attitudinal judgments: Evidence from attitude certainty and response latency. Social Cognition, 29, 578-611.
95. Koriat, A., Bjork, R. A., Sheffer, L., & Bar, S. K. (2004). Predicting one's own forgetting: The role of experience-based and theory-based processes. Journal of Experimental Psychology: General, 133, 643-656. doi:10.1037/0096-3445.133.4.643
96. Koriat, A., & Goldsmith, M. (1996). Monitoring and control processes in the strategic regulation of memory accuracy. Psychological Review, 103, 490-517. doi:10.1037/0033-295X.103.3.490
97. Koriat, A., & Levy-Sadot, R. (1999). Processes underlying metacognitive judgments: Information-based and experience-based monitoring of one's own knowledge. In S. Chaiken & Y. Trope (Eds.), Dual process theories in social psychology (pp. 483-502). New York, NY: Guilford Press.
98. Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107-118. doi:10.1037/0278-7393.6.2.107
99. Koriat, A., & Lieblich, I. (1977). A study of memory pointers. Acta Psychologica, 41, 151-164. doi:10.1016/0001-6918(77)90032-4
100. Koriat, A., Ma'ayan, H., & Nussinson, R. (2006). The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior. Journal of Experimental Psychology: General, 135, 36-69. doi: 10.1037/0096-3445.135.1.36
101. Koriat, A., Nussinson, R., Bless, H., & Shaked, N. (2008). Informationbased and experience-based metacognitive judgments: Evidence from subjective confidence. In J. Dunlosky & R. A. Bjork (Eds.), Handbook of memory and metamemory (pp. 117-135). New York, NY: Psychology Press.
102. Koriat, A., Pansky, A., & Goldsmith, M. (2011). An output-bound perspective on false memories: The case of the Deese-Roediger- McDermott (DRM) paradigm. In A. Benjamin (Ed.), Successful remembering and successful forgetting: A Festschrift in Honor of Robert A. Bjork (pp. 301-332). London, England: Psychology Press.
103. Koriat, A., Sheffer, L., & Ma'ayan, H. (2002). Comparing objective and subjective learning curves: Judgments of learning exhibit increased underconfidence with practice. Journal of Experimental Psychology: General, 131, 147-162. doi:10.1037/0096-3445.131.2.147
104. Kornell, N. (2011). Failing to predict future changes in memory: A stability bias yields long-term overconfidence. In A. S. Benjamin (Ed.), Successful remembering and successful forgetting: A Festschrift in honor of Robert A. Bjork (pp. 365-386). London, England: Psychology Press.
105. Kornell, N., & Bjork, R. A. (2009). A stability bias in human memory: Overestimating remembering and underestimating learning. Journal of Experimental Psychology: General, 138, 449-468. doi:10.1037/ a0017350
106. Kornell, N., Rhodes, M. G., Castel, A. D., & Tauber, S. K. (2011). The ease-of-processing heuristic and the stability bias: Dissociating memory, memory beliefs, and memory judgments. Psychological Science, 22, 787-794. doi:10.1177/0956797611407929
107. Krosnick, J. A., Boninger, D. S., Chuang, Y. C., Berent, M. K., & Carnot, C. G. (1993). Attitude strength: One construct or many related constructs? Journal of Personality and Social Psychology, 65, 1132-1151. doi:10.1037/0022-3514.65.6.1132
108. Liberman, V., & Tversky, A. (1993). On the evaluation of probability judgments: Calibration, resolution, and monotonicity. Psychological Bulletin, 114, 162-173. doi:10.1037/0033-2909.114.1.162
109. Lichtenstein, S., & Fischhoff, B. (1977). Do those who know more also know more about how much they know? Organizational Behavior & Human Performance, 20, 159-183. doi:10.1016/0030-5073(77)90001-0
110. Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982). Calibration of probabilities: The state of the art to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 306-334). New York, NY: Cambridge University Press.
111. Lichtenstein, S., & Slovic, P. (2006). The construction of preference. London, England: Cambridge University Press.
112. Lockhart, R. S., & Murdock, B. B. (1970). Memory and the theory of signal detection. Psychological Bulletin, 74, 100-109. doi:10.1037/ h0029536
113. Luus, C. A. E., & Wells, G. L. (1994). The malleability of eyewitness confidence: Co-witness and perseverance effects. Journal of Applied Psychology, 79, 714-723. doi:10.1037/0021-9010.79.5.714
114. McKenzie, C. R. M. (1997). Underweighting alternatives and overconfidence. Organizational Behavior and Human Decision Processes, 71, 141-160. doi:10.1006/obhd.1997.2716
115. McKenzie, C. R. M. (2005). Judgment and decision making. In K. Lamberts & R. L. Goldstone (Eds.), Handbook of cognition (pp. 321-338). London, England: Sage.
116. Merkle, E. C., & Van Zandt, T. (2006). An application of the Poisson race model to confidence calibration. Journal of Experimental Psychology: General, 135, 391-408. doi:10.1037/0096-3445.135.3.391
117. Metcalfe, J. (1998). Cognitive optimism: Self-deception or memory-based processing heuristics? Personality and Social Psychology Review, 2, 100-110. doi:10.1207/s15327957pspr0202_3
118. Metcalfe, J. (2000). Feelings and judgments of knowing: Is there a special noetic state? Consciousness and Cognition, 9, 178-186. doi:10.1006/ ccog.2000.0451
119. Metcalfe, J., & Dunlosky, J. (2008). Metamemory. In H. L. Roediger III (Ed.), Cognitive psychology of memory [Vol. 2 of Learning and memory: A comprehensive reference (J. Byrne, Ed.)] (pp. 349-362). Oxford, England: Elsevier
120. Miller, B., Hemmer, P., Steyvers, M., & Lee, M. D. (2009). The wisdom of crowds in rank ordering tasks. In A. Howes, D. Peebles, & R. Cooper (Eds.), 9th International Conference on Cognitive Modeling-ICCM 2009. Manchester, United Kingdom.
121. Mozer, M. C., Pashler, H., & Homaei, H. (2008). Optimal predictions in everyday cognition: The wisdom of individuals or crowds? Cognitive Science, 32, 1133-1147. doi:10.1080/03640210802353016
122. Nelson, T. O. (1984). A comparison of current measures of the accuracy of feeling-of-knowing predictions. Psychological Bulletin, 95, 109-133. doi:10.1037/0033-2909.95.1.109
123. Nelson, T. O., & Dunlosky, J. (1991). When people's judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The "delayed-JOL effect." Psychological Science, 2, 267-270. doi: 10.1111/j.1467-9280.1991.tb00147.x
124. Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2, 175-220. doi:10.1037/ 1089-2680.2.2.175
125. Orive, R. (1988). Group consensus, action immediacy, and opinion confidence. Personality and Social Psychology Bulletin, 14, 573-577. doi: 10.1177/0146167288143016
126. Parks, T. E. (1966). Signal detectability theory of recognition-memory performance. Psychological Review, 73, 44-58. doi:10.1037/h0022662
127. Peterson, C. R., & Beach, L. R. (1967). Man as an intuitive statistician. Psychological Bulletin, 68, 29-46. doi:10.1037/h0024722
128. Ramachandran, V. S., & Hubbard, E. M. (2001). Synaesthesia-A window into perception, thought, and language, Journal of Consciousness Studies, 8, 3-34.
129. Reagan, R. T. (1989). Variations on a seminal demonstration of people's insensitivity to sample size. Organizational Behavior and Human Decision Processes, 43, 52-57. doi:10.1016/0749-5978(89)90057-5
130. Rhodes, M. G., & Castel, A. D. (2008). Memory predictions are influenced by perceptual information: Evidence for metacognitive illusions. Journal of Experimental Psychology: General, 137, 615-625. doi:10.1037/ a0013684
131. Robinson, M. D., Johnson, J. T., & Herndon, F. (1997). Reaction time and assessments of cognitive effort as predictors of eyewitness memory accuracy and confidence. Journal of Applied Psychology, 82, 416-425. doi:10.1037/0021-9010.82.3.416
132. Romney, A. K., Batchelder, W. H., & Weller, S. C. (1987). Recent applications of cultural consensus theory. American Behavioral Scientist, 31, 163-177. doi:10.1177/000276487031002003
133. Ronis, D. L., & Yates, J. F. (1987). Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method. Organizational Behavior and Human Decision Processes, 40, 193-218. doi:10.1016/0749-5978(87)90012-4
134. Ross, M. (1997). Validating memories. In N. L. Stein, P. A. Ornstein, B. Tversky, & C. Brainerd (Eds.), Memory for everyday and emotional events (pp. 49-81). Mahwah, NJ: Erlbaum.
135. Saad, G., & Russo, J. E. (1996). Stopping criteria in sequential choice. Organizational Behavior and Human Decision Processes, 67, 258-270. doi:10.1006/obhd.1996.0078
136. Saito, M. (1998). Fluctuations of answer and confidence rating in a general-knowledge problem task: Is confidence rating a result of direct memory-relevant output monitoring? Japanese Psychological Research, 40, 92-103. doi:10.1111/1468-5884.00079
137. Sampaio, C., & Brewer, W. F. (2009). The role of unconscious memory errors in judgments of confidence for sentence recognition. Memory & Cognition, 37, 158-163. doi:10.3758/MC.37.2.158
138. Schervish, M. J. (1996). P values: What they are and what they are not. The American Statistician, 50, 203-206. doi:10.2307/2684655
139. Schneider, S. L. (1995). Item difficulty, discrimination, and the confidence-frequency effect in a categorical judgment task. Organizational Behavior and Human Decision Processes, 61, 148-167. doi: 10.1006/obhd.1995.1012
140. Schwartz, B. L. (1994). Sources of information in metamemory: Judgments of learning and feeling of knowing. Psychonomic Bulletin & Review, 1, 357-375. doi:10.3758/BF03213977
141. Schwarz, N. (2004). Metacognitive experiences in consumer judgment and decision making. Journal of Consumer Psychology, 14, 332-348. doi: 10.1207/s15327663jcp1404_2
142. Sedlmeier, P. (2007). Intuitive judgments about sample size. In K. Fiedler & P. Juslin (Eds.), Information sampling and adaptive cognition (pp. 53-70). New York, NY: Cambridge University Press.
143. Sedlmeier, P., & Gigerenzer, G. (1997). Intuition about sample size: The empirical law of large numbers. Journal of Behavioral Decision Making, 10, 33-51. doi:10.1002/(SICI)1099-0771(199703)10:1<133::AIDBDM244>3.0.CO;2-6
144. Shafir, E., Simonson, I., & Tversky, A. (1993). Reason-based choice. Cognition, 49, 11-36. doi:10.1016/0010-0277(93)90034-S
145. Shaw, J. S., III. (1996). Increases in eyewitness confidence resulting from postevent questioning. Journal of Experimental Psychology: Applied, 2, 126-146. doi:10.1037/1076-898X.2.2.126
146. Sloman, S. A. (1996). The empirical case for two systems of reasoning. Psychological Bulletin, 119, 3-22. doi:10.1037/0033-2909.119.1.3
147. Sniezek, J. A., Paese, P. W., & Switzer, F. S. (1990). The effect of choosing on confidence in choice. Organizational Behavior and Human Decision Processes, 46, 264-282. doi:10.1016/0749-5978(90)90032-5
148. Soll, J. B. (1996). Determinants of overconfidence and miscalibration: The roles of random error and ecological structure. Organizational Behavior and Human Decision Processes, 65, 117-137. doi:10.1006/ obhd.1996.0011
149. Stankov, L., & Crawford, J. D. (1997). Self-confidence and performance on tests of cognitive abilities. Intelligence, 25, 93-109. doi:10.1016/ S0160-2896(97)90047-7
150. Stephen, A. T., & Pham, M. T. (2008). On feelings as a heuristic for making offers in ultimatum negotiations. Psychological Science, 19, 1051-1058. doi:10.1111/j.1467-9280.2008.02198.x
151. Strack, F. (1992). The different routes to social judgments: Experiential versus informational strategies. In L. L. Martin & A. Tesser (Eds.), The construction of social judgments (pp. 249-275). Hillsdale NJ: Erlbaum.
152. Suantak, L., Bolger, F., & Ferrell, W. R. (1996). The hard-easy effect in subjective probability calibration. Organizational Behavior and Human Decision Processes, 67, 201-221. doi:10.1006/obhd.1996.0074
153. Surowiecki, J. (2005). The wisdom of crowds. New York, NY: Anchor Books.
154. Taylor, S. E., & Brown, J. D. (1988). Illusion and well-being: A social psychological perspective on mental health. Psychological Bulletin, 103, 193-210. doi:10.1037/0033-2909.103.2.193
155. Tormala, Z. L., & Rucker, D. D. (2007). Attitude certainty: A review of past findings and emerging perspectives. Social and Personality Psychology Compass, 1, 469-492. doi:10.1111/j.1751-9004.2007.00025.x
156. Tsai, C. I., Klayman, J., & Hastie, R. (2008). Effects of amount of information on judgment accuracy and confidence. Organizational Behavior and Human Decision Processes, 107, 97-105. doi:10.1016/ j.obhdp.2008.01.005
157. Tulving, E., & Madigan, S. A. (1970). Memory and verbal learning. Annual Review of Psychology, 21, 437-484. doi:10.1146/annurev.ps.21.020170.002253
158. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105-110. doi:10.1037/h0031322
159. Tversky, A., & Kahneman, D. (1973). Availability: A heuristic for judging frequency and probability. Cognitive Psychology, 5, 207-232. doi: 10.1016/0010-0285(73)90033-9
160. Tversky, A., & Kahneman, D. (1981, January 30). The framing of decisions and the psychology of choice. Science, 211, 453-458. doi: 10.1126/science.7455683
161. Unkelbach, C. (2006). The learned interpretation of cognitive fluency. Psychological Science, 17, 339-345. doi:10.1111/j.14679280.2006.01708.x
162. Unkelbach, C. (2007). Reversing the truth effect: Learning the interpretation of processing fluency in judgments of truth. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 219-230. doi: 10.1037/0278-7393.33.1.219
163. Unkelbach, C., & Stahl, C. (2009). A multinomial modeling approach to dissociate different components of the truth effect. Consciousness and Cognition, 18, 22-38. doi:10.1016/j.concog.2008.09.006
164. Van Zandt, T. (2000). ROC curves and confidence judgments in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 582-600. doi:10.1037/0278-7393.26.3.582
165. Vickers, D. (1970). Evidence for an accumulator model of psychophysical discrimination. Ergonomics, 13, 37-58. doi:10.1080/ 00140137008931117
166. Vickers, D. (2001). Where does the balance of evidence lie with respect to confidence? In E. Sommerfeld, R. Kompass, & T. Lachmann (Eds.), Proceedings of the seventeenth annual meeting of the international society for psychophysics (pp. 148-153). Lengerich, Germany: Pabst Science.
167. Vickers, D., & Pietsch, A. (2001). Decision making and memory: A critique of Juslin and Olsson's (1997) sampling model of sensory discrimination. Psychological Review, 108, 789-804. doi:10.1037/0033295X.108.4.789
168. Vul, E., & Pashler, H. (2008). Measuring the crowd within: Probabilistic representations within individuals. Psychological Science, 19, 645-647. doi:10.1111/j.1467-9280.2008.02136.x
169. Wallsten, T. S., Budescu, D. V., Erev, I., & Diederich, A. (1997). Evaluating and combining subjective probability estimates. Journal of Behavioral Decision Making, 10, 243-268. doi:10.1002/(SICI)10990771(199709)10:3<243::AID-BDM268>3.0.CO;2-M
170. Webster, D. M., & Kruglanski, A. W. (1994). Individual differences in need for cognitive closure. Journal of Personality and Social Psychology, 67, 1049-1062. doi:10.1037/0022-3514.67.6.1049
171. Weller, S. C. (2007). Cultural consensus theory: Applications and frequently asked questions. Field Methods, 19, 339-368. doi:10.1177/ 1525822X07303502
172. Winman, A., & Juslin, P. (1993). Calibration of sensory and cognitive judgments: Two different accounts. Scandinavian Journal of Psychology, 34, 135-148. doi:10.1111/j.1467-9450.1993.tb01109.x
173. Yaniv, I., Yates, J. F., & Smith, J. E. K. (1991). Measures of discrimination skill in probabilistic judgment. Psychological Bulletin, 110, 611-617. doi:10.1037/0033-2909.110.3.611
174. Yates, J. F. (1990). Judgment and decision making. Englewood Cliffs, NJ: Prentice-Hall.
175. Yonelinas, A. P. (2001). Consciousness, control, and confidence: The 3 Cs of recognition memory. Journal of Experimental Psychology: General, 130, 361-379. doi:10.1037/0096-3445.130.3.361
176. Zakay, D., & Tuvia, R. (1998). Choice latency times as determinants of post-decisional confidence. Acta Psychologica, 98, 103-115. doi: 10.1016/S0001-6918(97)00037-1