Debiasing Decisions: Improved Decision Making With a Single Training Intervention

Policy Insights from the Behavioral and Brain Sciences

Volumn 2, Issue 1, 2015, Pages 129-140

  Morewedge, Carey K ^a   Yoon, Haewon ^a   Scopelliti, Irene ^b   Symborski, Carl W ^c   Korris, James H ^d   Kassam, Karim S ^e  

^a BOSTON UNIVERSITY   (United States)

^b CITY UNIVERSITY   (United Kingdom)

^c FREDERICK NATIONAL LABORATORY FOR CANCER RESEARCH   (United States)

^d Creative Technologies Inc   (United States)

^e CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

cognitive bias; debiasing; decisions; feedback; incentives; judgment and decision making; nudges; training

Indexed keywords

EID: 85054533825     PISSN: 23727322     EISSN: 23727330     Source Type: Journal    
DOI: 10.1177/2372732215600886     Document Type: Article

References (94)

1. Acquisti A., Brandimarte L., Loewenstein G., (2015). Privacy and human behavior in the age of information. Science, 347, 509-514
2. Ariely D., Gneezy U., Loewenstein G., Mazar N., (2009). Large stakes and big mistakes. The Review of Economic Studies, 76, 451-469
3. Arkes H. R., (1991). Costs and benefits of judgment errors: Implications for debiasing. Psychological Bulletin, 110, 486-498
4. Arkes H. R., Blumer C., (1985). The psychology of sunk cost. Organizational Behavior and Human Decision Processes, 35, 124-140
5. Barnett S. M., Ceci S. J., (2002). When and where do we apply what we learn? A taxonomy for far transfer. Psychological Bulletin, 128, 612-637
6. Barton M., Symborski C., Quinn M., Morewedge C. K., Kassam K. S., Korris J. H., (2015, May). The use of theory in designing a serious game for the reduction of cognitive biases. Digital Games Research Association Conference, Lüneberg, Germany
7. Bhargava S., Loewenstein G., (2015). Behavioral economics and public policy 102: Beyond nudging. American Economic Review, 105, 396-401
8. Bhargava S., Manoli D., (in press). Psychological frictions and incomplete take-up of social benefits: Evidence from an IRS field experiment. American Economic Review
9. Bruine de Bruin W., Parker A. M., Fischhoff B., (2007). Individual differences in adult decision-making competence. Journal of Personality and Social Psychology, 92, 938-956
10. Camerer C., Issacharoff S., Loewenstein G., O’donoghue T., Rabin M., (2003). Regulation for conservatives: Behavioral economics and the case “for asymmetric paternalism.” University of Pennsylvania Law Review, 151, 1211-1254
11. Chapman G. B., Li M., Colby H., Yoon H., (2010). Opting in vs opting out of influenza vaccination. Journal of the American Medical Association, 304, 43-44
12. Charness G., Gneezy U., (2009). Incentives to exercise. Econometrica, 77, 909-931
13. Cialdini R. B., (2003). Crafting normative messages to protect the environment. Current Directions in Psychological Science, 12, 105-109
14. Cialdini R. B., Martin S. J., Goldstein N. J., (2015). Small behavioral science-informed changes can produce large policy-relevant effects. Behavioral Science & Policy, 1, 21-27
15. Cooper J. R., (2005). Curing analytic pathologies: Pathways to improved intelligence analysis. Washington, DC: Center for the Study of Intelligence, Central Intelligence Agency
16. Dawes R. M., Faust D., Meehl P. E., (1989). Clinical versus actuarial judgment. Science, 243, 1668-1674
17. Dhami M. K., Schlottmann A., Waldmann M. R., (2011). Judgment and decision making as a skill: Learning, development and evolution. Cambridge, UK: Cambridge University Press
18. Downs J. S., (2014). Prescriptive scientific narratives for communicating usable science. Proceedings of the National Academy of Sciences, 111, 13627-13633
19. Downs J. S., Loewenstein G., Wisdom J., (2009). Strategies for promoting healthier food choices. The American Economic Review, 99, 159-164
20. Downs J. S., Shafir E., (1999). Why some are perceived as more confident and more insecure, more reckless and more cautious, more trusting and more suspicious, than others: Enriched and impoverished options in social judgment. Psychonomic Bulletin & Review, 6, 598-610
21. Epley N., Mak D., Idson L. C., (2006). Bonus of rebate? The impact of income framing on spending and saving. Journal of Behavioral Decision Making, 19, 213-227
22. Epley N., Morewedge C. K., Keysar B., (2004). Perspective taking in children and adults: Equivalent egocentrism but differential correction. Journal of Experimental Social Psychology, 40, 760-768
23. Evans J. S. B., (2003). In two minds: Dual-process accounts of reasoning. Trends in Cognitive Sciences, 7, 454-459
24. Fischhoff B., (1982). Debiasing. In Kahneman D., Slovic P., Tversky A., (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 422-444). Cambridge, UK: Cambridge University Press
25. Fox C. R., Sitkin S. B., (2015). Bridging the divide between behavioral science and policy. Behavioral Science & Policy, 1, 1-12
26. French S. A., (2003). Pricing effects on food choices. The Journal of Nutrition, 133, 841S-843S
27. Garcia-Retamero R., Dhami M. K., (2011). Pictures speak louder than numbers: On communicating medical risks to immigrants with limited non-native language proficiency. Health Expectations, 14, 46-57
28. Garcia-Retamero R., Dhami M. K., (2013). On avoiding framing effects in experienced decision makers. The Quarterly Journal of Experimental Psychology, 66, 829-842
29. Gerber A. S., Rogers T., (2009). Descriptive social norms and motivation to vote: Everybody’s voting and so should you. The Journal of Politics, 71, 178-191
30. Gilbert D. T., (1998). Ordinary personology. In Gilbert D. T., Fiske S. T., Lindsey G., (Eds.), The handbook of social psychology (Vol. 2, pp. 89-150). Hoboken, NJ: John Wiley & Sons, Inc
31. Gneezy U., Meier S., Rey-Biel P., (2011). When and why incentives (don’t) work to modify behavior. The Journal of Economic Perspectives, 25, 191-209
32. Gneezy U., Rustichini A., (2000). A fine is a price. Journal of Legal Studies, 29, 1-17
33. Goldstein D. G., Johnson E. J., Herrmann A., Heitmann M., (2008). Nudge your customers toward better choices. Harvard Business Review, 86, 99-105
34. Haferkamp N., Kraemer N. C., Linehan C., Schembri M., (2011). Training disaster communication by means of serious games in virtual environments. Entertainment Computing, 2, 81-88
35. Harvey N., (2011). Learning judgment and decision making from feedback. In Dhami M. K., Schlottmann A., Waldmann M. R., (Eds.), Judgment and decision making as a skill: Learning, development, and evolution (pp. 199-226). Cambridge, UK: Cambridge University Press
36. Haynes L., Service O., Goldacre B., Torgerson D., (2012). Test, learn, adapt: Developing public policy with randomized controlled trials. London: Cabinet Office Behavioural Insights Team
37. Heuer R. J., (1999). Psychology of intelligence analysis. Washington, DC: Center for the Study of Intelligence, Central Intelligence Agency
38. Hirt E. R., Markman K. D., (1995). Multiple explanation: A consider-an-alternative strategy for debiasing judgments. Journal of Personality and Social Psychology, 69, 1069-1086
39. Huh Y. E., Vosgerau J., Morewedge C. K., (2014). Social defaults: Observed choices become choice defaults. Journal of Consumer Research, 41, 746-760
40. Intelligence Advanced Research Projects Activity. (2011). Sirius Broad Agency Announcement, IARPA-BAA-11-03. Retrieved from http://www.iarpa.gov/index.php/research-programs/sirius/baa
41. Intelligence Advanced Research Projects Activity. (2012). Unbiasing your biases I. Alexandria, VA: 522 Productions
42. Intelligence Advanced Research Projects Activity. (2013). Unbiasing your biases II. Alexandria, VA: 522 Productions
43. John L. K., Loewenstein G., Troxel A. B., Norton L., Fassbender J. E., Volpp K. G., (2011). Financial incentives for extended weight loss: A randomized, controlled trial. Journal of General Internal Medicine, 26, 621-626
44. Johnson E. J., Goldstein D. G., (2003). Do defaults save lives? Science, 302, 1338-1339
45. Jones E. E., Harris V. A., (1967). The attribution of attitudes. Journal of Experimental Social Psychology, 3, 1-24
46. Kahneman D., Krueger A. B., Schkade D. A., Schwarz N., Stone A. A., (2004). A survey method for characterizing daily life experience: The day reconstruction method. Science, 306, 1776-1780
47. Kahneman D., Tversky A., (1972). Subjective probability: A judgement of representativeness. Cognitive Psychology, 3, 430-454
48. Kohler D. J., Brenner L., Griffin D., (2002). The calibration of expert judgment: Heuristics and biases beyond the laboratory. In Gilovich T., Griffin D., Kahneman D., (Eds.), Heuristics and biases: The psychology of intuitive judgment (pp. 686-715). New York, NY: Cambridge University Press
49. Krieger L. H., Fiske S. T., (2006). Behavioral realism in employment discrimination law: Implicit bias and disparate treatment. California Law Review, 94, 997-1062
50. Larrick R. P., Morgan J. N., Nisbett R. E., (1990). Teaching the use of cost-benefit reasoning in everyday life. Psychological Science, 1, 362-370
51. Larrick R. P., Soll J. B., (2008). The MPG illusion. Science, 320, 1593-1594
52. Lerner J. S., Tetlock P. E., (1999). Accounting for the effects of accountability. Psychological Bulletin, 125, 255-275
53. Levin I. P., Gaeth G. J., (1988). How consumers are affected by the framing of attribute information before and after consuming the product. Journal of Consumer Research, 15, 374-378
54. Lewandowsky S., Ecker U. K., Seifert C. M., Schwarz N., Cook J., (2012). Misinformation and its correction continued influence and successful debiasing. Psychological Science in the Public Interest, 13, 106-131
55. Lilienfeld S. O., Ammirati R., Landfield K., (2009). Giving debiasing away: Can psychological research on correcting cognitive errors promote human welfare? Perspectives on Psychological Science, 4, 390-398
56. McNeil B. J., Pauker S. G., Sox H. C., Jr. Tversky A., (1982). On the elicitation of preferences for alternative therapies. New England Journal of Medicine, 306, 1259-1262
57. Mellers B., Ungar L., Baron J., Ramos J., Gurcay B., Fincher K... Tetlock P. E., (2014). Psychological strategies for winning a geopolitical forecasting tournament. Psychological Science, 25, 1106-1115
58. Milkman K. L., Chugh D., Bazerman M. H., (2009). How can decision making be improved? Perspectives on Psychological Science, 4, 379-383
59. Morewedge C. K., Kahneman D., (2010). Associative processes in intuitive judgment. Trends in Cognitive Sciences, 14, 435-440
60. Morewedge C. K., Kassam K. S., Hsee C. K., Caruso E. M., (2009). Duration sensitivity depends on stimulus familiarity. Journal of Experimental Psychology: General, 138, 177-186
61. Murphy A. H., Winkler R. L., (1974). Subjective probability forecasting experiments in meteorology: Some preliminary results. Bulletin of the American Meteorological Society, 55, 1206-1216
62. Nickerson R. S., (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2, 175-220
63. Nisbett R. E., Fong G. T., Lehman D. R., Cheng P. W., (1987). Teaching reasoning. Science, 238, 625-631
64. Nisbett R. E., Ross L., (1980). Human inference: Strategies and shortcomings of social judgment. Englewood Cliffs, NJ: Prentice Hall
65. Parker A. M., Fischhoff B., (2005). Decision-making competence: External validation through an individual-differences approach. Journal of Behavioral Decision Making, 18, 1-27
66. Payne J. W., Bettman J. R., Johnson E. J., (1993). The adaptive decision maker. Cambridge, UK: Cambridge University Press
67. Peters E., de Bruin W. B., (2011). Aging and decision skills. In Dhami M. K., Schlottmann A., Waldmann M. R., (Eds.), Judgment and decision making as a skill: Learning, development, and evolution (pp. 113-140). Cambridge, UK: Cambridge University Press
68. Phillips J. K., Klein G., Sieck W. R., (2004). Expertise in judgment and decision making: A case for training intuitive decision skills. In Koehler D. J., Harvey N., (Eds.), Blackwell handbook of judgment and decision making (pp. 297-315). Malden, MA: Blackwell Publishing, Ltd
69. Reeves L., Weisberg R. W., (1994). The role of content and abstract information in analogical transfer. Psychological Bulletin, 115, 381-400
70. Robbins J. M., Krueger J. I., (2005). Social projection to ingroups and outgroups: A review and meta-analysis. Personality and Social Psychology Review, 9, 32-47
71. Rosenthal R., Rosnow R. L., (1991). Essentials of behavioral research: Methods and data analysis. New York, NY: McGraw-Hill
72. Schultz P. W., Nolan J. M., Cialdini R. B., Goldstein N. J., Griskevicius V., (2007). The constructive, destructive, and reconstructive power of social norms. Psychological Science, 18, 429-434
73. Schwartz J., Mochon D., Wyper L., Maroba J., Patel D., Ariely D., (2014). Healthier by precommitment. Psychological Science, 25, 538-546
74. Schwitzgebel E., Cushman F., (2012). Expertise in moral reasoning? Order effects on moral judgment in professional philosophers and non-philosophers. Mind & Language, 27, 135-153
75. Scopelliti I., Morewedge C. K., McCormick E., Min H. L., Lebrecht S., Kassam K. S., (2015). Bias blind spot: Structure, measurement, and consequences. Management Science. doi:10.1287/mnsc.2014.2096
76. Shefrin H., Statman M., (1985). The disposition to sell winners too early and ride losers too long: Theory and evidence. Journal of Finance, 40, 777-790
77. Silberman L. H., Robb C. S., Levin R. C., McCain J., Rowan H. S., Slocombe W. B... Cutler L., (2005, March 31). Report to the President of the United States. Washington, DC: Commision on Intelligence Capabilities of the United States Regarding Weapons of Mass Destruction
78. Sliney A., Murphy D., (2008, February). JDoc: A serious game for medical learning. Proceedings of the First International Conference on Advances in Computer-Human Interaction (ACHI-2008), Sainte Luce, Martinique. doi:10.1109/ACHI.2008.50
79. Sloman S. A., (1996). The empirical case for two systems of reasoning. Psychological Bulletin, 119, 3-22
80. Snyder M., Swann W. B., (1978). Hypothesis-testing processes in social interaction. Journal of Personality and Social Psychology, 36, 1202-1212
81. Soll J., Milkman K., Payne J., (in press). A user’s guide to debiasing. In Keren G., Wu G., (Eds.), Wiley-Blackwell handbook of judgment and decision making. New York, NY: Blackwell
82. Symborski C., Barton M., Quinn M., Morewedge C. K., Kassam K., Korris J., (2014, December). Missing: A serious game for the mitigation of cognitive bias. Interservice/Industry Training, Simulation and Education Conference, Orlando, FL
83. Thaler R. H., Benartzi S., (2004). Save more tomorrow™: Using behavioral economics to increase employee saving. Journal of Political Economy, 112, S164-S187
84. Thaler R. H., Sunstein C. R., (2003). Libertarian paternalism. American Economic Review, 93, 175-179
85. Thaler R. H., Sunstein C. R., (2008). Nudge. New Haven, CT: Yale University Press
86. Tschirgi J. E., (1980). Sensible reasoning: A hypothesis about hypotheses. Child Development, 51, 1-10
87. Tversky A., Kahneman D., (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131
88. Volpp K. G., Loewenstein G., Troxel A. B., Doshi J., Price M., Laskin M., Kimmel S. E., (2008). A test of financial incentives to improve warfarin adherence. BMC Health Services Research, 8, Article 272
89. Volpp K. G., Troxel A. B., Pauly M. V., Glick H. A., Puig A., Asch D. A... Audrain-McGovern J., (2009). A randomized, controlled trial of financial incentives for smoking cessation. New England Journal of Medicine, 360, 699-709
90. Wagenaar W. A., Keren G. B., (1986). Does the expert know? The reliability of predictions and confidence ratings of experts. In Hollnagel E., Mancini G., Woods D. D., (eds.) Intelligent decision support in process environments (pp. 87-103). Berlin, Germany: Springer
91. Wason P. C., (1960). On the failure to eliminate hypotheses in a conceptual task. Quarterly Journal of Experimental Psychology, 12, 129-140
92. Wason P. C., (1968). Reasoning about a rule. The Quarterly Journal of Experimental Psychology, 20, 273-281
93. Willingham D. T., (2008). Critical thinking: Why is it so hard to teach? Arts Education Policy Review, 109, 21-32
94. Wilson T. D., Brekke N., (1994). Mental contamination and mental correction: Unwanted influences on judgments and evaluations. Psychological Bulletin, 116, 117-142