The role of individual differences in the accuracy of confidence judgments

Journal of General Psychology

Volumn 129, Issue 3, 2002, Pages 257-299

  Pallier, Gerry ^a   Wilkinson, Rebecca ^a   Danthiir, Vanessa ^a   Kleitman, Sabina ^a   Knezevic, Goran ^b   Stankov, Lazar ^a   Roberts, Richard D ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

^b UNIVERSITY OF BELGRADE   (Serbia)

Author keywords

Calibration; Cognitive ability; Confidence judgments; Metacognition; Self assessment

Indexed keywords

ADULT; ARTICLE; AUSTRALIA; COGNITION; DECISION MAKING; EPIDEMIOLOGY; FACTORIAL ANALYSIS; FEMALE; HUMAN; INTELLIGENCE; MALE; PERCEPTION; PERSONALITY; REPRODUCIBILITY; SELF EVALUATION; UNITED STATES;

ADULT; BIAS (EPIDEMIOLOGY); COGNITION; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; INTELLIGENCE; JUDGMENT; MALE; NEW SOUTH WALES; PERCEPTION; PERSONALITY; REPRODUCIBILITY OF RESULTS; SELF ASSESSMENT (PSYCHOLOGY); TEXAS;

EID: 0036651733     PISSN: 00221309     EISSN: None     Source Type: Journal    
DOI: 10.1080/00221300209602099     Document Type: Article

References (80)

1. Annett, J. M. (1996). Olfactory memory: A case study in cognitive psychology. Journal of Psychology, 130, 309-319.
2. Arbuckle, J. L., & Wothke, W. (1999). AMOS 4.0 user's guide. Chicago, IL: SPSS Inc.
3. Baranski, J. V., & Petrusic, W. M. (1994). The calibration and resolution of confidence in perceptual judgments. Perception and Psychophysics, 55, 412-428.
4. Baranski, J. V., & Petrusic, W. M. (1999). Realism of confidence in sensory discrimination. Perception and Psychophysics, 61, 1369-1383.
5. Björkman, M., Juslin, P., & Winman, A. (1993). Realism of confidence in sensory discrimination: The underconfidence phenomenon. Perception and Psychophysics, 54, 75-81.
6. Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78, 1-3.
7. Carpenter, P. A., Just, M. A., & Shell, P. (1990). What one intelligence test measures: A theoretical account of processing in the Raven's Progressive Matrices Test. Psychological Review, 97, 404-431.
8. Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. Cambridge, UK: Cambridge University Press.
9. Cattell, R. B. (1943). The measurement of adult intelligence. Psychological Bulletin, 40, 153-193.
10. Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 161-179.
11. Costa, P. T., & McCrae, R. R. (1992). NEO PI-R manual. Odessa, FL: Psychological Assessment Resources.
12. Crawford, J., & Stankov, L. (1996a). Age differences in the realism of confidence judgments: A calibration study using tests of fluid and crystallized intelligence. Learning and Individual Differences, 6, 84-103.
13. Crawford, J., & Stankov, L. (1996b). Confidence judgments in studies of individual differences. Personality and Individual Differences, 6, 971-986.
14. Cutler, B., & Wolfe, R. (1989). Self-monitoring and the association between confidence and accuracy. Journal of Research in Personality, 23, 410-420.
15. Danthiir, V., Roberts, R. D., Pallier, G., & Stankov, L. (2001). What the nose knows: Olfaction and cognitive abilities. Intelligence, 29, 337-361.
16. Davies, M., Stankov, L., & Roberts, R. D. (1998). Emotional intelligence: In search of an elusive construct. Journal of Personality and Social Psychology, 75, 989-1015.
17. Doty, R. L. (1995). The Smell Identification Test administration manual. Haddon Heights, NJ: Sensonics, Inc.
18. Erev, I., Wallsten, T. S., & Budescu, D. V. (1994). Simultaneous over-and underconfidence: The role of error in judgment processes. Psychological Review, 83, 37-64.
19. French, J. W., Ekstrom, R. B., & Price, L. A. (1963). Manual for reference tests for cognitive factors. Princeton, NJ: Educational Testing Service.
20. Fullerton, G. S., & Cattell, J. M. (1892). On the perception of small differences. Philadelphia, PA: University of Pennsylvania Philosophy Series, No. 2.
21. Gigerenzer, G. (1991). How to make cognitive illusion disappear: Beyond heuristics and biases. In W. Stroebe & M. Hewstone (Eds.), European review of social psychology (Vol. 2, pp. 83-115). Chichester, UK: Wiley.
22. Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review, 98, 506-528.
23. Gregory, R. J. (1996). Psychological testing: History, principles, and applications. Boston MA: Allyn and Bacon.
24. Griffin, D., & Tversky, A. (1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24, 411-435.
25. Griffing, J. H. (1895). On sensations from pressure and impact. Psychological Review Monographs, 1, 1-88.
26. Guilford, J. P., & Fruchter, B. (1978). Fundamental statistics in psychology and education. New York: McGraw-Hill.
27. Gustafsson, J-E. (1992). The relevance of factor analysis for the study of group differences. Multivariate Behavioral Research, 27, 239-248.
28. Harvey, N. (1997). Confidence in judgment. Trends in Cognitive Science, 1, 78-82.
29. Herz, R. S., & Engen, T. (1996). Odor memory: Review and analysis. Psychonomic Bulletin and Review, 3, 300-313.
30. Horn, J. L. (1998). A basis for research on age differences in cognitive capabilities. In J. R. McArdle & R. W. Woodcock (Eds.), Human cognitive abilities in theory and practice, (pp. 57-91). London: Erlbaum.
31. Horn, J. L., & Cattell, R. B. (1966). Refinement of the theory of fluid and crystallized intelligence. Journal of Educational Psychology, 57, 253-270.
32. Horn, J. L., & Noll, J. (1994). A system for understanding cognitive capabilities: A theory and the evidence on which it is based. In D. K. Detterman (Ed.), Current topics in human intelligence: Vol. IV: Theories of intelligence (pp. 151-204). Norwood NJ: Ablex.
33. Horn, J. L., & Stankov, L. (1982). Auditory and visual factors of intelligence. Intelligence, 62(6), 165-185.
34. Irvine, S. H. (1999, May 27). The True Self-Report Inventory. Workshop presented at The University of Sydney, Australia.
35. Jensen, A. R. (1993). Why is reaction time correlated with psychometric g? Current Directions in Psychological Science, 2, 53-56.
36. Judd, C. M., Smith, E. R., & Kidder, L. H. (1991). Research methods in social relations. Fort Worth, TX: Harcourt Brace Jovanovich.
37. Juslin, P. (1993). An explanation of the hard-easy effect in studies of realism of confidence in one's general knowledge. European Journal of Cognitive Psychology, 5, 55-71.
38. Juslin, P. (1994). The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items. Organizational Behavior and Human Decision Processes, 57, 226-246.
39. Juslin, P., & Olsson, H. (1997). Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination. Psychological Review, 104, 344-366.
40. Juslin, P., Olsson, H., & Winman, A. (1998). The calibration issue: Theoretical comments on Suantak, Bolger, and Ferrell. Organizational Behavior and Human Decision Processes, 73, 3-26.
41. Kahneman, D., Slovic, P., & Tversky, A. (1982). Judgments under uncertainty: Heuristics and biases. Cambridge, UK: Cambridge University Press.
42. Kahneman, D., & Tversky, A. (1996). On the reality of cognitive illusions. Psychological Review, 103, 582-591.
43. Kleitman, S., & Stankov, L. (2001). Ecological and person-oriented aspects of metacognitive processes in test-taking. Journal of Applied Cognitive Psychology, 15, 321-341.
44. Koehler, D. (1994). Hypothesis generation and confidence in judgment. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 461-469.
45. Kyllonen, P. C., & Christal, R. E. (1990). Reasoning ability is (little more than) working-memory capacity?! Intelligence, 14, 389-433.
46. Larsson, M. (1997). Semantic factors in episodic recognition of common odors in early and late adulthood. Chemical Senses, 22, 623-633.
47. Lennox, R. D., & Wolfe, R. N. (1984). Revision of the self-monitoring scale. Journal of Personality and Social Psychology, 46, 1349-1364.
48. Lichtenstein, S., & Fischhoff, B. (1977). Do those who know more also know more about how much they know? Organizational Behavior and Human Performance, 20, 159-183.
49. Murphy, A. H. (1973). A new vector partition of the probability score. Journal of Applied Meteorology, 11, 595-600.
50. Newstead, S. E., & Collis, J. M. (1987). Context and the interpretation of quantifiers of frequency. Ergonomics, 30, 1447-1462.
51. Pallier, G., Roberts, R. D., & Stankov, L. (2000). Biological vs. psychometric intelligence: Halstead's (1947) distinction re-visited. Archives of Clinical Neuropsychology, 15, 205-226.
52. Phillips, L. D. (1973). Bayesian statistics for social sciences. London: Nelson.
53. Psychological Corporation. (1997). WAIS-III technical manual. San Antonio, TX: Harcourt Brace.
54. Raven, J. C., Court, J. H., & Raven, J. (1979). Manual for Raven's Progressive Matrices and vocabulary scales. London: H. K. Lewis & Co.
55. Roberts, R. D., Pallier, G., & Stankov, L. (1996). The basic information processing (BIP) unit, mental speed and human cognitive abilities: Should the BIP RIP? Intelligence, 23, 133-155.
56. Roberts, R. D., & Stankov, L. (1999). Individual differences in speed of mental processing and human cognitive abilities: Towards a taxonomic model. Learning and Individual Differences, 11, 1-120.
57. Roberts, R. D., Stankov, L., Pallier, G., & Dolph, B. (1997). Charting the cognitive sphere: Tactile-kinesthetic performance within the structure of intelligence. Intelligence, 23, 133-155.
58. Schraw, G. (1994). The effect of metacognitive knowledge on local and global monitoring. Contemporary Educational Psychology, 19, 143-154.
59. Schraw, G. (1997). The effect of generalized metacognitive knowledge on test performance and confidence judgments. The Journal of Experimental Education, 65, 135-146.
60. Schraw, G., & Dennison, R. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19, 460-475.
61. Schraw, G., & Roedel, T. D. (1994). Test difficulty and judgment bias. Memory and Cognition, 22, 63-69.
62. Seashore, C. B., Lewis, C., & Saetveit, J. G. (1960). Seashore's measures of musical talent: Manual. New York: Psychological Corporation.
63. Soil, J. B. (1996). Determinants of overconfidence and miscalibration: The roles of random error and ecological structure. Organizational Behavior and Human Decision Processes, 65, 117-137.
64. Stankov, L. (1997). The Gf/Gc Quickie Test Battery. Sydney, Australia: The University of Sydney, School of Psychology. Unpublished test battery.
65. Stankov, L. (1998). Calibration curves, scatterplots and the distinction between general knowledge and perceptual tests. Learning and Individual Differences, 8, 28-51.
66. Stankov, L. (1999). Mining on the "no man's land" between intelligence and personality. In P. L. Ackerman, P. C. Kyllonen, & R. D. Roberts (Eds.), Learning and individual differences: Process, trait, and content determinants (pp. 314-337). Washington, DC: American Psychological Association.
67. Stankov, L. (2000). Complexity, metacognition, and fluid intelligence. Intelligence, 28, 121-143.
68. Stankov, L., & Crawford, J. (1996a). Confidence judgments in studies of individual differences. Personality and Individual Differences, 21, 971-986.
69. Stankov, L., & Crawford, J. (1996b). Confidence judgments in studies of individual differences support the 'confidence/frequency effect.' In C. Latimer & J. Michell (Eds.), At once scientific and philosophic: A festschrift in honour of J. P. Sutcliffe (pp. 215-239). Sydney, Australia: The University of Sydney Press.
70. Stankov, L., & Crawford, J. (1997). Self-confidence and performance on cognitive tests. Intelligence, 25, 93-109.
71. Stankov, L., & Dolph, B. (2000). Metacognitive aspects of test-taking and intelligence. Psychologische Beiträge, Band 42, 213-227.
72. Stankov, L., & Horn, J. L. (1980). Human cognitive abilities revealed through auditory tests. Journal of Educational Psychology, 72, 19-42.
73. Stankov, L., & Pallier, G. (2002). Accuracy, confidence, and speed in perceptual tasks: Calibration effects and individual differences. Manuscript submitted for publication.
74. Stanovich, K. E., & West, R. F. (1998). Individual differences in rational thought. Journal of Experimental Psychology: General, 127, 161-188.
75. Vickers, D. (1979). Decision processes in visual perception. New York: Academic Press.
76. Wechsler, D. (1981). Manual for the Wechsler Adult Intelligence Scale-Revised. New York: The Psychological Corporation.
77. White, T. L. (1998). Olfactory memory: The long and the short of it. Chemical Senses, 23, 433-441.
78. Winman, A., & Juslin, P. (1993). Calibration of sensory and cognitive judgments: Two different accounts. Scandinavian Journal of Psychology, 34, 135-148.
79. Yates, J. F. (1990). Judgment and decision making. Englewood Cliffs, NJ: Prentice-Hall.
80. Zakay, D., & Glicksohn, J. (1992). Overconfidence in a multiple-choice test and its relationship to achievement. Psychological Record, 42, 519-524.