Bias blind spot: Structure, measurement, and consequences

Management Science

Volumn 61, Issue 10, 2015, Pages 2468-2486

  Scopelliti, Irene ^a   Morewedge, Carey K ^b   McCormick, Erin ^c   Min, H Lauren ^d   Lebrecht, Sophie ^c   Kassam, Karim S ^c  

^a CITY UNIVERSITY   (United Kingdom)

^b BOSTON UNIVERSITY   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

^d UNIVERSITY OF COLORADO   (United States)

Author keywords

Advice taking; Bias blind spot; Debiasing; Judgment and decision making; Metacognition; Self awareness

Indexed keywords

BEHAVIORAL RESEARCH;

ADVICE TAKING; BLIND SPOTS; DE-BIASING; JUDGMENT AND DECISION MAKINGS; METACOGNITION; SELF AWARENESS;

DECISION MAKING;

EID: 84943576394     PISSN: 00251909     EISSN: 15265501     Source Type: Journal    
DOI: 10.1287/mnsc.2014.2096     Document Type: Article

References (89)

1. Aiken LS, West S.G. (1991) Multiple Regression: Testing and Interpreting Interactions (Sage, Newbury Park).
2. Ames DR, Rose P, Anderson C.P. (2006) The NPI-16 as a short measure of narcissism. J. Res. Personality 40:440-450.
3. Baron J, Brown R.V. (1991) Teaching Decision Making to Adolescents (Erlbaum, Hillsdale, NJ).
4. Berinsky AJ, Huber GA, Lenz G.S. (2012) Evaluating online labor markets for experimental research: Amazon.com's mechanical Turk. Political Anal. 20:351-368.
5. Blais AR, Thompson MM, Baranski J.V. (2005) Individual differences in decision processing and confidence judgments in comparative judgment tasks: The role of cognitive styles. Personality and Individual Differences 38:1701-1713.
6. Bollen K, Lennox R. (1991) Conventional wisdom on measurement: A structural equation perspective. Psych. Bull. 110:305-314.
7. Bonaccio S, Dalal R.S. (2006) Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organ. Behav. Human Decision Processes 101: 127-151.
8. Bornstein BH, Zickafoose D.J. (1999) "I know I know it, I know I saw it": The stability of the confidence-accuracy relationship across domains. J. Experiment. Psych.: Appl. 5:76-88.
9. Brodnick RJ, Ree M.J. (1995) A structural model of academic performance, socio-economic status, and Spearman's g. Educational Psych. Measurement 55:594-605.
10. Bruine de Bruin W, Parker AM, Fischhoff B (2007) Individual differences in Adult Decision-Making Competence. J. Personality Soc. Psych. 92:938-956.
11. Budescu DV, Rantilla A.K. (2000) Confidence in aggregation of expert opinions. Acta Psychologica 104:371-398.
12. Cacioppo JT, Petty R.E. (1982) The need for cognition. J. Personality Soc. Psych. 42:116-131.
13. Cacioppo JT, Petty RE, Kao C.E. (1984) The efficient assessment of need for cognition. J. Personality Assessment 48:306-307.
14. Cacioppo JT, Petty RE, Feinstein J.A., Jarvis WBG (1996) Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psych. Bull. 119: 197-253.
15. Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd ed. (Lawrence Erlbaum Associates, Hillsdale, NJ).
16. Crowne DP, Marlowe D. (1960) A new scale of social desirability independent of psychopathology. J. Consulting Psych. 24: 349-354.
17. Cronbach LJ, Meehl P.E. (1955) Construct validity in psychological tests. Psych. Bull. 52:281-302.
18. Dunning D, Johnson K, Ehrlinger J., Kruger J. (2003) Why people fail to recognize their own incompetence. Current Directions Psych. Sci. 12:83-87.
19. Edwards JR, Bagozzi R.P. (2000) On the nature and direction of the relationship between constructs and measures. Psych. Methods 5:155-174.
20. Epley N, Dunning D. (2000) Feeling "holier than thou": Are self-serving assessments produced by errors in self- or social prediction? J. Personality Soc. Psych. 79:861-875.
21. Feingstein A, Scheier M, Buss A. (1975) The self-consciousness scale. J. Consulting and Clinical Psych. 43:522-527.
22. Fischhoff B (1982) Debiasing. Kahneman D, Slovic P, Tversky A, eds. Judgment Under Uncertainty: Heuristics and Biases (Cambridge University Press, Cambridge), 422-444.
23. Frederick S (2005) Cognitive reflection and decision making. J. Econom. Perspect. 19:24-42.
24. Frey MC, Detterman D.K. (2004) Scholastic assessment or g? The relationship between the scholastic assessment test and general cognitive ability. Psych. Sci. 15:373-378.
25. Gino F (2008) Do we listen to advice just because we paid for it? The impact of advice cost on its use. Organ. Behav. Human Decision Processes 107:234-245.
26. Gino F, Moore D.A. (2007) Effects of task difficulty on use of advice. J. Behav. Decision Making 20:21-35.
27. Harvey N, Fischer I. (1997) Taking advice: Accepting help, improving judgment and sharing responsibility. Organ. Behav. Human Decision Processes 70:117-133.
28. Horn JL (1965) A rationale and test for the number of factors in factor analysis. Psychometrika 32:179-185.
29. Horton JJ, Rand DG, Zeckhauser R.J. (2011) The online laboratory: Conducting experiments in a real labor market. Experiment. Econom. 14:399-425.
30. John OP, Srivastava S. (1999) The Big Five trait taxonomy: History, measurement and theoretical perspectives. Pervin LA, John OP, eds. Handbook of Personality: Theory and Research (Guilford, New York), 102-138.
31. Johnson TR, Budescu DV, Wallsten T.S. (2001) Averaging probability judgments: Monte Carlo analyses of asymptotic diagnostic value. J. Behavioral Decision Making 14:123-140.
32. Jones EE, Harris V.A. (1967) The attribution of attitudes. J. Experiment. Soc. Psych. 3:1-24.
33. Kahneman D, Slovic P, Tversky A. (1982) Judgment Under Uncertainty: Heuristics and Biases (Cambridge University Press, New York).
34. Klayman J, Soll JB, Gonzalez-Vallejo C, Barlas S. (1999) Overconfidence: It depends on how, what and whom you ask. Organ. Behav. Human Decision Processes 79:216-247.
35. Kruger J (1999) Lake Wobegon be gone! The "below-average effect" and the egocentric nature of comparative ability judgments. J. Personality Soc. Psych. 77:221-232.
36. Kruger J (2003) Return of the ego-Self-referent information as a filter for social prediction: Comment on Karniol (2003). Psych. Rev. 110:585-590.
37. Kruger J, Dunning D. (1999) Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. J. Personality Soc. Psych. 77:1121-1134.
38. Larrick RP (2004) Debiasing. Koehler DJ, Harvey N, eds. Blackwell Handbook of Judgment and Decision Making (Blackwell Publishers, Oxford, UK), 316-337.
39. Larrick RP, Soll J.B. (2006) Intuitions about combining opinions: Misappreciation of the averaging principle. Management Sci. 52:111-127.
40. Larrick RP, Nisbett RE, Morgan J.N. (1993) Who uses the cost-benefit rules of choice? Implications for the normative status of microeconomic theory. Organ. Behav. Human Decision Processes 56:331-347.
41. Levin IP, Gaeth GJ, Schreiber J, Lauriola M. (2002) A new look at framing effects: Distribution of effect sizes, individual differences, and independence of types of effects. Organ. Behav. Human Decision Processes 88:411-429.
42. Liberman V, Minson JA, Bryan C.J., Ross L. (2012) Naïve realism and capturing the "wisdom of dyads." J. Experiment. Soc. Psych. 48:507-512.
43. Macmillan NA, Creelman C.D. (1991) Detection Theory: A User's Guide (Cambridge, New York).
44. Mardia KV (1980) 9 Tests of unvariate and multivariate normality. Rao CR, ed. Handbook of Statistics, Vol. 1 (Elsevier B.V., Amsterdam), 279-320.
45. McCrae RR, Costa P.T. (1987) Validation of the five-factor model of personality across instruments and observers. J. Personality Soc. Psych. 52:81-90.
46. Morewedge CK, Kahneman D. (2010) Associative processes in intuitive judgment. Trends in Cognitive Sci. 14:435-440.
47. Morf CC, Rhodewalt F. (2001) Unraveling the paradoxes of narcissism: A dynamic self-regulatory processing model. Psych. Inquiry 12:177-196.
48. Nisbett RE, Ross L. (1980) Human Inference: Strategies and Shortcomings of Social Judgment (Prentice-Hall, Englewood Cliffs, NJ).
49. Nisbett RE, Wilson T.D. (1977) Telling more than we can know: Verbal reports on mental processes. Psych. Rev. 84:231-259.
50. Nunnally JC (1978) Psychometric Theory, 2nd ed. (McGraw-Hill, New York).
51. Paolacci G, Chandler J, Ipeirotis P.G. (2010) Running experiments using Amazon mechanical Turk. Judgment and Decision Making 5:411-419.
52. Paulhus DL (1998) Interpersonal and intrapsychic adaptiveness of trait self-enhancement: A mixed blessing? J. Personality Soc. Psych. 74:1197-1208.
53. Paulhus DL, Harms PD, Bruce M.N., Lysy D.C. (2003) The over-claiming technique: Measuring self-enhancement independent of ability. J. Personality Soc. Psych. 84:890-904.
54. Pronin E (2007) Perception and misperception of bias in human judgment. Trends in Cognitive Sci. 11:37-43.
55. Pronin E (2008) How we see ourselves and how we see others. Science 320:1177-1180.
56. Pronin E, Kugler M.B. (2007) Valuing thoughts, ignoring behavior: The introspection illusion as a source of the bias blind spot. J. Experiment. Soc. Psych. 43:565-578.
57. Pronin E, Lin DY, Ross L. (2002) The bias blind spot: Perceptions of bias in self versus others. Personality Soc. Psych. Bull. 28: 369-381.
58. Pronin E, Gilovich TD, Ross L. (2004) Objectivity in the eye of the beholder: Divergent perceptions of bias in self versus others. Psych. Rev. 111:781-799.
59. Pronin E, Kennedy K, Butsch S. (2006) Bombing versus negotiating: How preferences for combating terrorism are affected by perceived terrorist rationality. Basic Appl. Social Psych. 28:385-392.
60. Robbins SB, Patton M.J. (1985) Self-psychology and career development: Construction of the superiority and goal instability scales. J. Counseling Psych. 32:221-231.
61. Robinson RJ, Keltner D, Ward A., Ross L. (1995) Actual versus assumed differences in construal: "Naive realism" in inter-group perception and conflict. J. Personality Soc. Psych. 68: 404-417.
62. Rosenberg M (1965) Society and the Adolescent Self-Image (Princeton University Press, Princeton, NJ).
63. Ross L, Ward A. (1995) Psychological barriers to dispute resolution. Adv. Experiment. Soc. Psych. 27:255-304.
64. Ross L, Ward A. (1996) Naiïve realism In everyday life: Implications for social conflict and misunderstanding. Reed ES, Turiel E, Brown T, eds. Values and Knowledge. The Jean Piaget Symposium Series (Lawrence Erlbaum Associates, Hillsdale, NJ), 103-135.
65. Scopelliti I, Morewedge CK, Min H.L., McCormick E., Kassam K.S. (2015) Neglect of external demands (NED) scale: Measuring the coherence, consequences, and correction of correspondent inference making. Working paper, City Univeristy London, London.
66. Symborski C, Barton M, Quinn M., Morewedge CK, Kassam K, Korris J. (2014) Missing: A serious game for the mitigation of cognitive bias. Interservice/Industry Training, Simulation Ed. Conf., Orlando, FL, December.
67. Snyder M (1974) Self-monitoring of expressive behavior. J. Personality Soc. Psych. 30:526-537.
68. Snyder ML, Frankel A. (1976) Observer bias: A stringent test of behavior engulfing the field. J. Personality Soc. Psych. 34: 857-864.
69. Snyder CR, Fromkin H.L. (1977) Abnormality as a positive characteristic: Development and validation of a scale measuring need for uniqueness. J. Abnormal Psych. 86:518-527.
70. Snyder CR, Fromkin H.L. (1980) Uniqueness (Plenum, New York).
71. Spiller SA, Fitzsimons GJ, Lynch JG Jr, McClelland G.H. (2013) Spotlights, floodlights, and the magic number zero: Simple effects tests in moderated regression. J. Marketing Res. 50: 277-288.
72. Stankov L, Crawford J.D. (1996) Confidence judgments in studies of individual differences. Personality and Individual Differences 21:971-986.
73. Stankov L, Crawford J.D. (1997) Self-confidence and performance on tests of cognitive abilities. Intelligence 25:93-109.
74. Stanovich KE (1999) Who Is Rational? Studies of Individual Differences in Reasoning (Psychology Press, Mahwah, NJ).
75. Stanovich KE, West R.F. (2000) Individual differences in reasoning: Implications for the rationality debate? Behavioral Brain Sci. 23:645-665.
76. Stanovich KE, West R.F. (2007) Natural myside bias is independent of cognitive ability. Thinking and Reasoning 13:225-247.
77. Stanovich KE, West R.F. (2008) On the relative independence of thinking biases and cognitive ability. J. Personality Soc. Psych. 94:672-695.
78. Taylor SE, Brown J.D. (1988) Illusion and well-being: A social psychological perspective on mental health. Psych. Bull. 103: 193-210.
79. Tversky A, Kahneman D. (1974) Judgment under uncertainty: Heuristics and biases. Science 185:1124-1130.
80. Unsworth N, Engle R.W. (2007) The nature of individual differences in working memory capacity: Active maintenance in primary memory and controlled search from secondary memory. Psych. Rev. 114:104-132.
81. Van Boven L., Dunning D, Loewenstein G. (2000) Egocentric empathy gaps between owners and buyers: Misperceptions of the endowment effect. J. Personality Soc. Psych. 79:66-76.
82. West RF, Stanovich K.E. (1997) The domain specificity and generality of overconfidence: Individual differences in performance estimation bias. Psychonomic Bull. Rev. 4:387-392.
83. West RF, Toplak ME, Stanovich K.E. (2008) Heuristics and biases as measures of critical thinking: Associations with cognitive ability and thinking dispositions. J. Educational Psych. 100: 930-941.
84. West RF, Meserve RJ, Stanovich K.E. (2012) Cognitive sophistication does not attenuate the bias blind spot. J. Personality Soc. Psych. 103:506-513.
85. Wilson TD, Brekke N. (1994) Mental contamination and mental correction: Unwanted influences on judgments and evaluations. Psych. Bull. 116(1):117-142.
86. Wilson TD, Dunn E.W. (2004) Self-knowledge: Its limits, value, and potential for improvement. Ann. Rev. Psych. 55:493-518.
87. Wilson TD, Houston CE, Etling K.M., Brekke N. (1996) A new look at anchoring effects: Basic anchoring and its antecedents. J. Experiment. Psych.: General 125:387-402.
88. Yaniv I (2004) Receiving other people's advice: Influence and benefit. Organ. Behav. Human Decision Processes 93:1-13.
89. Yaniv I, Kleinberger E. (2000) Advice taking in decision making: Egocentric discounting and reputation formation. Organ. Behav. Human Decision Processes 83:260-281.