Confidence and Cognitive Test Performance

Journal of Educational Psychology

Volumn 100, Issue 4, 2008, Pages 961-976

  Stankov, Lazar ^a   Lee, Jihyun ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

confidence; metacognition; overconfidence bias; self monitoring

Indexed keywords

EID: 56349097166     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0012546     Document Type: Article

References (56)

1. Angelis J.C., Swinton S.S., and Cowell W.R. The performance of non-native speakers of English on TOEFL and verbal aptitude tests (TOEFL Report No. RR-03) (1979), Educational Testing Service, Princeton, NJ
2. Angoff W.H., and Sharon A.T. A comparison of scores earned on the Test of English as a Foreign Language by Native American college students and foreign applicants to U.S. colleges. TESOL Quarterly 5 (1971) 129-136
3. Baranski J.V., and Petrusic W.M. Realism of confidence in sensory discrimination. Perception and Psychophysics 61 (1999) 1369-1383
4. Baron J. Thinking and deciding. 3rd ed. (2000), Cambridge University Press, Cambridge, England
5. Blais A.R., Thompson M.M., and Baranski J.V. Individual differences in decision processing and confidence judgments in comparative tasks: The role of cognitive styles. Personality and Individual Differences 38 (2005) 1701-1713
6. Carroll J.B. Human cognitive abilities: A survey of factor-analytic studies (1993), Cambridge University Press, New York
7. Crawford J., and Stankov L. Age differences in the realism of confidence judgments: A calibration study using tests of fluid and crystallized intelligence. Learning and Individual Differences 6 (1996) 84-103
8. Dougherty M.R. Integration of the ecological and error models of overconfidence using a multiple-trace memory model. Journal of Experimental Psychology: General 130 (2001) 579-599
9. Festinger L. Studies in decision: I. Decision-time, relative frequency of judgment and subjective confidence as related to physical stimulus difference. Journal of Experimental Psychology 32 (1943) 291-306
10. Festinger L. Studies in decision: II. An empirical test of a quantitative theory of decision. Journal of Experimental Psychology 32 (1943) 411-432
11. Fullerton G.S., and Cattell J.M. On the perception of small differences (University of Pennsylvania Philosophy Series No. 2) (1892), University of Pennsylvania Press, Philadelphia
12. Gigerenzer G., Hoffrage U., and Kleinbolting H. Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review 98 (1991) 506-528
13. Guay F., Marsh H.W., and Boivin M. Academic self-concept and academic achievement: Developmental perspectives on their causal ordering. Journal of Educational Psychology 95 (2003) 124-136
14. Harvey N. Confidence in judgment. Trends in Cognitive Sciences 1 (1997) 78-82
15. Hintzman D.L. Judgments of frequency and recognition memory in a multiple-trace memory model. Psychological Review 95 (1988) 528-551
16. International Personality Item Pool: A scientific collaboratory for the development of advanced measures of personality traits and other individual differences. (n.d.). Retrieved June 28, 2005, from http://ipip.ori.org/
17. Johnson D.C. The TOEFL and domestic students: Conclusively inappropriate. TESOL Quarterly 11 (1977) 79-86
18. Juslin P., and Olsson H. Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination. Psychological Review 10 (1997) 344-366
19. Kahneman D., Slovic P., and Tversky A. Judgments under uncertainty: Heuristics and biases (1982), Cambridge University Press, Cambridge, England
20. Keren G. Calibration and probability judgments: Conceptual and methodological issues. Acta Psychologica 77 (1991) 217-273
21. Kirsch I., Yamamoto K., Norris N., Rock D., Jungleblut A., and O'Reilly P. Technical report and data file user's manual for the 1992 National Adult Literacy Survey (NCES-2001-457) (2001), National Center for Education Statistics, Washington, DC
22. Klayman J., Soll J.B., Gonzalez-Vallejo C., and Barlas S. Overconfidence: It depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes 79 (1999) 216-247
23. Kleitman, S. (2003). Self-confidence and self-monitoring aspects of metacognition, their nature and their place within rationality debates: An individual differences perspective. Unpublished doctoral dissertation, University of Sydney, Sydney, Australia.
24. Kleitman S., and Stankov L. Ecological and person-oriented aspects of metacognitive processes in test-taking. Applied Cognitive Psychology 15 (2001) 321-341
25. Kleitman S., and Stankov L. Self-confidence and metacognitive processes. Learning and Individual Differences 17 (2007) 161-173
26. Kuncel N.R., and Hezlett S.A. Standardized tests predict graduate students' success. Science 315 (2007, February 23) 1080-1081
27. Lichtenstein S., and Fischoff B. Do those who know more also know more about how much they know?. Organizational Behavior and Human Performance 20 (1977) 159-183
28. Lichtenstein S., Fischoff B., and Phillips L.D. Calibration of probabilities: The state of the art to 1980. In: Kahneman D., Slovic P., and Tversky A. (Eds). Judgments under uncertainty: Heuristics and biases (1982), Erlbaum, Hillsdale, NJ 306-334
29. Marsh H.W. Verbal and math self-concepts: An internal/external frame of reference model. American Educational Research Journal 23 1 (1986) 129-149
30. Marsh H.W., and Shavelson R. Self-concept: Its multifaceted, hierarchical structure. Educational Psychologist 20 3 (1985) 107-123
31. Nelson T.O., and Narens L. Metamemory: A theoretical framework and new findings. In: Nelson T.O. (Ed). Metacognition: Core readings (1992), Allyn & Bacon, Boston 117-170
32. Nelson T.O., and Narens L. Why investigate metacognition?. In: Metcalfe J., and Shimamura A.P. (Eds). Metacognition: Knowing about knowing (1994), MIT Press, Cambridge, MA 1-25
33. Olsson H., and Winman A. Underconfidence in sensory discrimination: The interaction between experimental setting and response strategies. Perception and Psychophysics 58 (1996) 374-383
34. Pallier G. Gender differences in the self-assessment of accuracy on cognitive tasks. Sex Roles 48 (2003) 265-276
35. Pallier G., Wilkinson R., Danthiir V., Kleitman S., Knezevic G., Stankov L., et al. Individual differences in the realism of confidence judgments. Journal of General Psychology 129 (2002) 257-300
36. Paulhus D.L., and Harms P.D. Measuring cognitive ability with the overclaiming technique. Intelligence 32 (2004) 297-314
37. Saucier G., and Goldberg L.R. Assessing the Big Five: Applications of 10 psychometric criteria to the development of marker scales. In: de Raad B., and Perugini M. (Eds). Big Five assessment (2002), Hogrefe & Huber, Ashland, OH 29-58
38. Sawaki, Y., Stricker, L., & Oranje, A. (2005). Factor structure of the TOEFL Internet-based test (iBT). Unpublished manuscript.
39. Schmidt F., and Hunter J. The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin 124 (1998) 262-274
40. Schraw G., and Dennison R.S. Assessing metacognitive awareness. Contemporary Educational Psychology 19 (1994) 460-475
41. Soll J.B. Determinants of overconfidence and miscalibration: The roles of random error and ecological structure. Organizational Behavior and Human Decision Processes 65 (1996) 117-137
42. Stankov L. Calibration curves, scatterplots and the distinction between general knowledge and perceptual tasks. Learning and Individual Differences 10 (1998) 29-50
43. Stankov L. Mining on the "no man's land" between intelligence and personality. In: Ackerman P.L., Kyllonen P.C., and Roberts R.D. (Eds). Learning and individual differences: Process, trait, and content determinants (1999), American Psychological Association, Washington, DC 315-337
44. Stankov L. Complexity, metacognition, and fluid intelligence. Intelligence 28 (2000) 121-143
45. Stankov L., and Crawford J.D. Confidence judgments in studies of individual differences. Personality and Individual Differences 21 (1996) 971-986
46. Stankov L., and Crawford J.D. Self-confidence and performance on tests of cognitive abilities. Intelligence 25 (1997) 93-109
47. Stankov, L., & Kim, S. (2006). Dimensions of cultural differences: Personality, social attitudes, values and social norms. Unpublished manuscript.
48. Stankov, L., Lee, J., & Paek, I. (in press). Realism of confidence judgments. European Journal of Psychological Assessment
49. Stanovich K.E. Who is rational? Studies of individual differences in reasoning (1999), Erlbaum, London
50. Stricker L.J. The performance of native speakers of English and ESL speakers on the computer-based TOEFL and GRE General Test. Language Testing 21 (2002) 146-173
51. Suantak L., Bolger F., and Ferrell W.R. The hard-easy effect in subjective probability calibration. Organizational Behavior and Human Decision Processes 67 (1996) 201-221
52. Tobias S., and Everson H.T. Assessing metacognitive knowledge monitoring. In: Schraw G., and Impara J.C. (Eds). Issues in the measurement of metacognition (2000), Buros Institute of Mental Measurements, Lincoln, NE 147-222
53. Tobias S., and Everson H.T. Knowing what you know and what you don't: Further research on metacognitive knowledge monitoring. (College Board Research Report No. 2002-3) (2002). http://iume.tc.columbia.edu/downloads/tobias/CBR2001-3.pdf Retrieved June 29, 2006, from http://iume.tc.columbia.edu/downloads/tobias/CBR2001-3.pdf
54. Trow W.C. The psychology of confidence. Archives of Psychology 67 (1923) 47-71
55. Vickers D. Decision processes in visual perception (1979), Academic Press, New York
56. Want J., and Kleitman S. Feeling "phony": Adult achievement behaviour, parental rearing style and self-confidence. Journal of Personality and Individual Differences 40 5 (2006) 961-971