The dunning-kruger effect. On being ignorant of one's own ignorance

Advances in Experimental Social Psychology

Volumn 44, Issue , 2011, Pages 247-296

  Dunning, David ^a  

^a Department of Obstetrics Gynecology   (United States)

Author keywords

Ignorance; Incompetence; Known knowns; Known unknowns; Overconfidence; Self assessment; Self enhancement bias; Self evaluation; Unknown unknowns

Indexed keywords

EID: 79957985520     PISSN: 00652601     EISSN: None     Source Type: Book Series    
DOI: 10.1016/B978-0-12-385522-0.00005-6     Document Type: Book

References (126)

1. Alicke M.D., Govorun O. The better-than-average effect. The self in social judgment 2005, 85-106. Psychology Press, New York. M.D. Alicke, D.A. Dunning, J.I. Krueger (Eds.).
2. Alter A.L., Oppenheimer D.M., Zemla J.C. Missing the trees for the forest: A construal level account of the illusion of explanatory depth. Journal of Personality and Social Psychology 2010, 99:436-451.
3. Ames D.R., Kammrath L.K. Mind-reading and metacognition: Narcissism, not actual competence, predicts self-estimated ability. Journal of Nonverbal Behavior 2004, 28:187-209.
4. Ariely D., Norton M.I. Psychology and experimental economics: A gap in abstraction. Current Directions in Psychological Science 2007, 16:336-339.
5. Arkes H.R., Boehm L.E., Xu G. Determinants of judged validity. Journal of Experimental Social Psychology 1991, 27:576-605.
6. Austin Z., Gregory P.A.M., Galli M. "I just don't know what I'm supposed to know": Evaluating self-assessment skills of international pharmacy graduates in Canada. Administrative Pharmacy 2008, 4:115-124.
7. Barnsley L., Lyon P., Ralson S., Hibbert E., Cunningham I., Gordon F., et al. Clinical skills in junior medical officers: A comparison of self-reported confidence and observed competence. Medical Education 2004, 38:358-367.
8. Ben-Zeev T. The nature and origin of rational errors in arithmetic thinking: Induction from examples and prior knowledge. Cognitive Science 1995, 19:341-376.
9. Ben-Zeev T. Rational errors and the mathematical mind. Review of General Psychology 1998, 2:366-383.
10. Bishop G.F., Oldendick R.W., Tuchbarber A.J., Bennett S.E. Pseudo-opinions on public affairs. Public Opinion Quarterly 1980, 44:198-209.
11. Bishop G.F., Tuchfarber A.J., Oldendick R.W. Opinions on fictitious issues: The pressure to answer survey questions. Public Opinion Quarterly 1986, 50:240-250.
12. Burson K.A., Larrick R.P., Klayman J. Skilled or unskilled, but still unaware of it: How perceptions of difficulty drive miscalibration in relative comparisons. Journal of Personality and Social Psychology 2006, 90:60-77.
13. Camerer C., Hogarth R. The effects of financial incentives in experiments: A review and capital-labor production framework. Journal of Risk and Uncertainty 1999, 19:7-42.
14. Caputo D.D., Dunning D. What you don't know: The role played by errors of omission in imperfect self-assessments. Journal of Experimental Social Psychology 2005, 41:488-505.
15. Carter T.J., Dunning D. Faulty self-assessment: Why evaluating one's own competence is an intrinsically difficult task. Personality and Social Psychology Compass 2008, 2:346-360.
16. Ceci S.J., Liker J. A day at the races: IQ, expertise, and cognitive complexity. Journal of Experimental Psychology: General 1986, 115:255-266.
17. Chi M.T.H., Glaser R., Rees E. Expertise in problem solving. Advances in the psychological of human intelligence 1982, Vol. 1:17-76. Erlbaum, Hillsdale, NJ.
18. Chiu M.M., Klassen R.M. Relations of mathematics self-concept and its calibration with mathematics achievement: Cultural differences among fifteen-year-olds in 34 countries. Learning and Instruction 2010, 20:2-17.
19. Colvin C.R., Block J. Do positive illusions foster mental health? An examination of the Taylor and Brown formulation. Psychological Bulletin 1994, 116:3-20.
20. Critcher C.R., Dunning D. How chronic self-views influence (and mislead) self-evaluations of performance: Self-views shape bottom-up experiences with the task. Journal of Personality and Social Psychology 2009, 97:931-945.
21. Davis D.A., Mazmanian P.E., Fordis M., Harrison R.V., Thorpe K.E., Perrier L. Accuracy of physician self-assessment compared with observed measures of competence. JAMA 2006, 296:1094-1102.
22. Downs A. An economic theory of democracy 1957, Harper & Brothers, New York.
23. Dunning D. Self-insight: Roadblocks and detours on the path to knowing thyself 2005, Psychology Press, New York.
24. Dunning D., Heath C., Suls J. Flawed self-assessment: Implications for health, education, and the workplace. Psychological Science in the Public Interest 2004, 5:69-106.
25. Dunning D., Johnson K., Ehrlinger J., Kruger J. Why people fail to recognize their own competence. Current Directions in Psychological Science 2003, 12:83-87.
26. Dunning D., Meyerowitz J.A., Holzberg A.D. Ambiguity and self-evaluation: The role of idiosyncratic trait definitions in self-serving assessments of ability. Journal of Personality and Social Psychology 1989, 57:1082-1090.
27. Dunning D., Perretta S.F. Automaticity and eyewitness accuracy: A 10- to 12-second rule for distinguishing accurate from erroneous positive identifications. The Journal of Applied Psychology 2002, 87:951-962.
28. Dunning D., Stern L.B. Distinguishing accurate from inaccurate eyewitness identifications via inquiries about decision processes. Journal of Personality and Social Psychology 1994, 67:818-835.
29. Eccles J.S. Gender roles and women's achievement-related decisions. Psychology of Women Quarterly 1987, 18:585-609.
30. Edwards R.K., Kellner K.R., Sistrom C.L., Magyari E.J. Medical student self-assessment of performance on an obstetrics and gynecology clerkship. American Journal of Obstetrics and Gynecology 2003, 188:1078-1082.
31. Ehrlinger J., Dunning D. How chronic self-views influence (and potentially mislead) assessments of performance. Journal of Personality and Social Psychology 2003, 84:5-17.
32. Ehrlinger J., Johnson K., Banner M., Dunning D., Kruger J. Why the unskilled are unaware? Further explorations of (lack of) self-insight among the incompetent. Organizational Behavior and Human Decision Processes 2008, 105:98-121.
33. Epstein W., Glenberg A.M., Bradley M. Coactivation and comprehension: Contribution of text variables to the illusion of knowing. Memory & Cognition 1984, 12:355-360.
34. Everson H.T., Tobias S. The ability to estimate knowledge and performance in college: A metacognitive analysis. Instructional Science 1998, 26:65-79.
35. Felson R.B. Ambiguity and bias in the self-concept. Social Psychology Quarterly 1981, 44:64-69.
36. Ferraro P.J. Know thyself: Competence and self-awareness. Atlantic Economic Journal 2010, 38:183-196.
37. Fischhoff B. Hindsight ≠ foresight: The effect of outcome knowledge on judgment under uncertainty. Journal of Experimental Psychology. Human Perception and Performance 1975, 1:288-299.
38. Fischhoff B. Perceived informativeness of facts. Journal of Experimental Psychology. Human Perception and Performance 1977, 3:349-358.
39. Fussell S.R., Krauss R.M. Accuracy and bias in estimates of others' knowledge. European Journal of Social Psychology 1991, 21:445-454.
40. Fussell S.R., Krauss R.M. Coordination of knowledge in communication: Effects of speakers' assumptions about what others know. Journal of Personality and Social Psychology 1992, 62:378-391.
41. Garb H.N. Clinical judgment, clinical training, and professional experience. Psychological Bulletin 1989, 105:387-396.
42. Glenberg A.M., Epstein W. Inexpert calibration of comprehension. Memory & Cognition 1987, 15:84-93.
43. Glenberg A.M., Wilkinson A., Epstein W. The illusion of knowing: Failure in the self-assessment of comprehension. Memory & Cognition 1982, 10:597-602.
44. Graeff T.R. Exploring consumers' answers to survey questions: Are uninformed responses truly uninformed?. Psychology & Marketing 2003, 20:643-667.
45. Griffin T.D., Jee B.D., Wiley J. The effects of domain knowledge on metacomprehension accuracy. Memory & Cognition 2009, 37:1001-1013.
46. Hacker D.J., Bol L., Horgan D.D., Rakow E.A. Test prediction and performance in a classroom context. Journal of Educational Psychology 2000, 92:160-170.
47. Halpern J.Y., Rego L.C. Extensive games with possibly unaware players. Proceedings of the fifth international joint conference on autonomous agents and multiagent systems 2006, 744-751. Association for Computing Machinery, New York.
48. Hansford B.C., Hattie J.A. The relationship between self and achievement/performance measures. Review of Educational Research 1982, 52:123-142.
49. Harris M.M., Schaubroeck J. A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology 1988, 41:43-62.
50. Haun D.E., Zeringue A., Leach A., Foley A. Assessing the competence of specimen-processing personnel. Laboratory Medicine 2000, 31:633-637.
51. Heath C., Larrick R.P., Klayman J. Cognitive repairs: How organizational practices can compensate for individual shortcomings. Research in Organizational Behavior 1998, Vol. 20:1-37. B.M. Staw, L.L. Cummings (Eds.).
52. Hecht H., Bertamini M., Gamer M. Naive optics: Acting upon mirror reflections. Journal of Experimental Psychology: Human Perception and Performance 2005, 31:1023-1038.
53. Hertwig R., Ortmann A. Experimental practices in economics: A methodological challenge for psychologists?. The Behavioral and Brain Sciences 2001, 25:383-403.
54. Hodges B., Regehr G., Martin D. Difficulties in recognizing one's own incompetence: Novice physicians who are unskilled and unaware of it. Academic Medicine 2001, 76:S87-S89.
55. The diverging influences of the college degree & civic learning on American beliefs 2008, Intercollegiate Studies Institute, Intercollegiate Studies Institute, Wilmington, DE.
56. Kaiser M.K., Jonides J., Alexander J. Intuitive reasoning about abstract and familiar physics problems. Memory and Cognition 1986, 14:308-312.
57. Kamen A. Tent rent: $10 a day. Washington Post 2002, A25.
58. Kelley C.M., Lindsay D.S. Remembering mistaken for knowing-Ease of retrieval as a basis for confidence in answers to general knowledge questions. Journal of Memory and Language 1993, 32:1-24.
59. Keren G.B. Facing uncertainty in the game of bridge: A calibration study. Organizational Behavior and Human Decision Processes 1987, 139:98-114.
60. Koriat A. Subjective confidence in one's answers: The consensuality principle. Journal of Experimental Psychology. Learning, Memory, and Cognition 2008, 34:945-959.
61. Koriat A. When confidence in a choice is independent of which choice is made. Psychonomic Bulletin & Review 2008, 15:997-1001.
62. Koriat A., Ma'ayan H., Nussinson R. The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior. Journal of Experimental Psychology: General 2006, 135:36-69.
63. Kossiakoff A., Sweet W.N. Systems engineering: Principles and practice 2003, Wiley, New York.
64. Krueger J., Mueller R.A. Unskilled, unaware, or both? The contribution of social-perceptual skills and statistical regression to self-enhancement biases. Journal of Personality and Social Psychology 2002, 82:180-188.
65. Kruger J.M., Dunning D. Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology 1999, 77:1121-1134.
66. Kruger J., Dunning D. Unskilled and unaware-But why? A reply to Krueger and Mueller. Journal of Personality and Social Psychology 2002, 82:189-192.
67. Kuklinski J.H., Quirk P.J., Jerit J., Schwieder D., Rich R.F. Misinformation and the currency of democratic citizenship. Journal of Politics 2000, 62:79-816.
68. Kunda Z. The case for motivated reasoning. Psychological Bulletin 1990, 108:480-498.
69. Kurt A., Paulhus D.L. Moderators of the adaptiveness of self-enhancement: Operationalization, motivational domain, adjustment facet, and evaluator. Journal of Research in Personality 2008, 42:839-853.
70. Lawson R. The science of cycology: Failures to understand how everyday objects work. Memory and Cognition 2006, 34:1667-1675.
71. Leamy E., Weber V. Homeowners beware of DIY repair dangers: Do-it-yourself home projects often lead to injuries and increased costs (accessed February 2, 2011). http://abcnews.go.com/GMA/story?id=8373975.
72. Lerner J.S., Tetlock P.E. Accounting for the effects of accountability. Psychological Bulletin 1999, 125:255-275.
73. Levenberg S.B. Professional training, psychodiagnostic skill, and kinetic family drawings. Journal of Personality Assessment 1975, 39:389-393.
74. Levin D.T., Banaji M.R. Distortions in the perceived lightness of faces: The role of race categories. Journal of Experimental Psychology: General 2006, 135:501-512.
75. Lusardi A., Mitchell O.S. How ordinary consumers make complex economic decisions: Financial literacy and retirement reactions 2009, Unpublished manuscript, Dartmouth College,.
76. Mabe P.A., West S.G. Validity of self-evaluation of ability: A review and meta-analysis. The Journal of Applied Psychology 1982, 67:280-286.
77. Maki R.H., Berry S.L. Metacomprehension of text material. Journal of Experimental Psychology. Learning, Memory, and Cognition 1984, 10:663-679.
78. Maki R.H., Jonas D., Kallod M. The relationship between comprehension and metacomprehension ability. Psychonomic Bulletin & Review 1994, 1:126-129.
79. McPherson S.L., Thomas J.R. Relation of knowledge and performance in boys' tennis: Age and expertise. Journal of Experimental Child Psychology 1989, 48:190-211.
80. Mele A.R. Real self-deception. The Behavioral and Brain Sciences 1997, 20:91-136.
81. Miller J.D. The measurement of civic scientific literacy. Public Understanding of Science 1998, 7:203-223.
82. Mynttinsen S., Sundstrom A., Vissers J., Koivukoski M., Hakuli K., Keskinen E. Self-assessed driver competence among novice drivers: A comparison of driving test candidate assessments and examiner assessments in a Dutch and Finnish sample. Journal of Safety Research 2009, 40:301-309.
83. Science and engineering indicators 2010 2010, National Science Board, National Science Foundation, Washington, DC.
84. Women, minorities, and persons with disabilities in science and engineering 2000, National Science Foundation, National Science Foundation, Arlington, VA.
85. Nickerson R.S., Baddeley A., Freeman B. Are people's estimates of what other people know influenced by what they themselves know?. Acta Psychologica 1987, 64:245-259.
86. Nielsen-Bohlman L., Panzer A.M., Kindig D.A. Health literacy: A prescription to end confusion 2004, Institute of Medicine, Washington, DC.
87. Nyhan B., Reifler J. Opening the partisan mind: Self-affirmation and information processing about the surge in Iraq 2009, Unpublished manuscript, University of Michigan.
88. Nyhan B., Reifler J. When corrections fail: The persistence of political misconceptions. Political Behavior 2010, 32:303-330.
89. Park Y.-J., Santos-Pinto L. Overconfidence in tournaments: Evidence from the field. Theory and Decision 2010, 69:143-166.
90. Paulhus D.L., Harms P.D., Bruce M.N., Lysy D.C. The over-claiming technique: Measuring self-enhancement independent of ability. Journal of Personality and Social Psychology 2003, 84:890-904.
91. Plassman H., O'Doherty J., Shiv B., Rangel A. Marketing actions can modulate neural representations of experienced pleasantness. Proceedings of the National Academy of Science United States of America 2008, 105:1050-1054.
92. Prasad M., Perrin A., Bezila K., Hoffman S., Kindleberger K., Manturuk K., et al. There must be a reason: Osama, Saddam, and inferred justification. Sociological Inquiry 2009, 79:142-162.
93. Proffitt D.R. Naive physics. The MIT encyclopedia of the cognitive sciences 1999, 577-579. MIT Press, Cambridge, MA. R. Wilson, F. Keil (Eds.).
94. Reyna V.F., Nelson W.L., Han P.K., Dieckmann N.F. How numeracy influences risk comprehension and medical decision making. Psychological Bulletin 2009, 135:943-973.
95. Ross L.D., Greene D., House P. The "false consensus effect": An egocentric bias in social perception and attribution processes. Journal of Experimental Social Psychology 1977, 13:279-301.
96. Rozenblit L., Keil F.C. The misunderstood limits of folk science: An illusion of explanatory depth. Cognitive Science 2002, 26:521-562.
97. Schipper B.C. The unawareness bibliography (accessed November 30, 2010). http://www.econ.ucdavis.edu/faculty/schipper/unaw.htm.
98. Schuman H., Presser S. Public opinion and public ignorance: The fine line between attitudes and nonattitudes. The American Journal of Sociology 1980, 85:1214-1225.
99. Schwartz B.L., Metcalfe J. Cue familiarity but not target retrievability enhances feeling-of-knowing judgments. Journal of Experimental Psychology. Learning, Memory, and Cognition 1992, 18:1074-1083.
100. Schwarz N. Metacognitive experiences in consumer judgment and decision making. Journal of Consumer Psychology 2004, 14:332-348.
101. Seymour E. Undergraduate problems with teaching and advising in SME majors: Explaining gender differences in attribution rates. Journal of College Science Teaching 1992, 21:284-292.
102. Shaughnessy J.J. Confidence judgment accuracy as a predictor of test performance. Journal of Research in Personality 1979, 13:505-514.
103. Sheldon O., Ames D., Dunning D. Self-assessments of emotional intelligence 2010, Unpublished data, Rutgers University.
104. Sinkavich F.J. Performance and metamemory: Do students know what they don't know?. Instructional Psychology 1995, 22:77-87.
105. Song H., Schwarz N. If it's hard to read, it's hard to do: Processing fluency affects effort prediction and motivation. Psychological Science 2008, 19:986-988.
106. Stajkovic A.D., Luchins F. Self-efficacy and work-related performance: A meta-analysis. Psychological Bulletin 1998, 124:240-261.
107. Tabor C.S., Cann D., Kucsova S. The motivated processing of political arguments. Political Behavior 2009, 31:137-155.
108. Taylor S.E., Brown J.D. Illusion and well-being: A social psychological perspective on mental health. Psychological Bulletin 1988, 103:193-210.
109. Tetlock P.E. Expert political judgment 2005, Princeton University Press, Princeton, NJ.
110. Tetlock P.E., Kim J.I. Accountability and judgment processes in a personality prediction task. Journal of Personality and Social Psychology 1987, 52:700-709.
111. UNESCO Education for all: Is the world on track? EFA global monitoring report 2002, UNESCO, Paris.
112. Vnuk A., Owen H., Plummer J. Assessing proficiency in adult basic life support: Student and expert assessment and the impact of video recording. Medical Teacher 2006, 28:429-434.
113. Wagenaar W.A., Keren G.B. Calibration of probability assessments by professional blackjack dealers, statistical experts, and lay people. Organizational Behavior and Human Decision Processes 1985, 36:406-416.
114. Wardle J., Solomons W. Naughty but nice: A laboratory study of health information and food preferences in a community sample. Health Psychology 1994, 13:180-183.
115. Wason P.C. Reasoning. New horizons in psychology 1966, 135-151. Penguin Press, Baltimore. B.M. Foss (Ed.).
116. Watts W.E., Rush K., Wright M. Evaluating first-year nursing students' ability to self-assess psychomotor skills using video. Nursing Education Perspectives 2009, 30:214-219.
117. Weinstein N.D. Unrealistic optimism about future life events. Journal of Personality and Social Psychology 1980, 58:806-820.
118. Williams N.V., Baker D.W., Honig E.G., Lee T.M., Nowlan A. Inadequate literacy is a barrier to asthma knowledge and self-care. Chest 1998, 114:1008-1015.
119. Williams E., Dunning D. From formulae to faith: A consistency heuristic underlies mistaken confidence in self-performance 2010, University of Florida under review.
120. Wilson T.D., Gilbert D.T. Affective forecasting. Advances in experimental social psychology 2003, Vol. 35:345-411. Academic Press, San Diego.
121. Winship C., Korenman S. Does staying in school make you smarter? The effect of education on IQ. Intelligence and success: Is it all in the genes? Scientists respond to the bell curve 1997, 215-234. Springer-Verlag, New York. B. Devlin, S.E. Fienberg, D. Resnick, K. Roeder (Eds.).
122. Winship C., Morgan S.L. The estimation of causal effects from observational data. Annual Review of Sociology 2000, 25:659-706.
123. Woodzicka J.A., LaFrance M. Real versus imagined gender harassment. Journal of Social Issues 2001, 57:15-30.
124. Woollett K., Maguire E. The effect of navigational expertise on wayfinding in new environments. Journal of Environmental Psychology 2010, 30:565-573.
125. Zenger T.R. Why do employers only reward extreme performance? Examining the relationships among performance, pay, and turnover. Administrative Science Quarterly 1992, 37:198-219.
126. Zizek S. Iraq's false promise. Foreign Affairs 2004, 42-49. January/February.