Judgmental aggregation strategies depend on whether the self is involved

International Journal of Forecasting

Volumn 27, Issue 1, 2011, Pages 81-102

  Soll, Jack B ^a   Mannes, Albert E ^b  

^a DUKE UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Advice taking; Averaging judgments; Combining opinions; Information integration; Judgmental forecasting

Indexed keywords

EID: 78149495348     PISSN: 01692070     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijforecast.2010.05.003     Document Type: Article

References (71)

1. Abelson R.P., Prentice D.A. Beliefs as possessions: a functional perspective. Attitude structure and function 1989, Lawrence Erlbaum Associates, Hillsdale, NJ. A.R. Pratkanis, S.J. Breckler, A.G. Greenwald (Eds.).
2. Alter A.L., Oppenheimer D.M. Uniting the tribes of fluency to form a metacognitive nation. Personality and Social Psychology Review 2009, 13:219-235.
3. Armstrong J.S. Combining forecasts. Principles of forecasting: a handbook for researchers and practitioners 2001, 417-439. Kluwer, New York. J.S. Armstrong (Ed.).
4. Asch S. Forming impressions of personality. Journal of Abnormal and Social Psychology 1946, 41:258-290.
5. Baron J., Ritov I. Reference points and omission bias. Organizational Behavior and Human Decision Processes 1994, 59:475-498.
6. Baumann M.R., Bonner B.L. The effects of variability and expectations on utilization of member expertise and group performance. Organizational Behavior and Human Decision Processes 2004, 93(2):89-101.
7. Beggan J.K. On the social nature of nonsocial perception: the mere ownership effect. Journal of Personality and Social Psychology 1992, 62(2):229-237.
8. Birnbaum M.H., Stegner S.E. Source credibility in social judgment: bias, expertise, and the judge's point of view. Journal of Personality and Social Psychology 1979, 37(1):48-74.
9. Bonaccio S., Dalal R.S. Advice taking and decision-making: an integrative literature review, and implications for the organizational sciences. Organizational Behavior and Human Decision Processes 2006, 101(2):127-151.
10. Budescu D.V. Confidence in aggregation of opinions from multiple sources. Information sampling and adaptive cognition 2006, Cambridge University Press, Cambridge, UK. K. Fiedler, P. Juslin (Eds.).
11. Budescu D.V., Rantilla A.K. Confidence in aggregation of expert opinions. Acta Psychologica 2000, 104:371-398.
12. Budescu D.V., Rantilla A.K., Yu H.-T., Karelitz T.M. The effects of asymmetry among advisors on the aggregation of their opinions. Organizational Behavior and Human Decision Processes 2003, 90(1):178-194.
13. Budescu D.V., Yu H.-T. Aggregation of opinions based on correlated cues and advisors. Journal of Behavioral Decision Making 2007, 20:153-177.
14. Burson K.A., Larrick R.P., Klayman J. Skilled or unskilled, but still unaware of it: how perceptions of difficulty drive miscalibration in relative comparisons. Journal of Personality and Social Psychology 2006, 90(1):60-77.
15. Chapman G.B., Johnson E.J. Incorporating the irrelevant: anchors in judgments of belief and value. Heuristics and biases: the psychology of intuitive judgment 2002, Cambridge University Press, Cambridge, UK. T. Gilovich, D. Griffin, D. Kahneman (Eds.).
16. Clemen R.T. Combining forecasts: a review and annotated bibliography. International Journal of Forecasting 1989, 5(4):559-583.
17. Clemen R.T., Winkler R.L. Combining probability distributions from experts in risk analysis. Risk Analysis 1999, 19:187-203.
18. Dawes R.M. The robust beauty of improper linear models in decision making. American Psychologist 1979, 34(7):571-582.
19. Dawes R.M., Corrigan B. Linear models in decision making. Psychological Bulletin 1974, 81(2):95-105.
20. Dunning D., Meyerowitz J.A., Holzberg A. Ambiguity and self-evaluation: the role of idiosyncratic trait definitions in self-serving assessments of ability. Journal of Personality and Social Psychology 1989, 57:1082-1090.
21. Edwards W. Conservatism in human information processing. Formal representations of human judgment 1968, Wiley, New York. B. Kleinmuntz (Ed.).
22. Einhorn H.J., Hogarth R.M. Unit weighting schemes for decision making. Organizational Behavior and Human Performance 1975, 13:171-192.
23. Epley N., Gilovich T. A tale of tuned decks? Anchoring as adjustment and anchoring as activation. The Blackwell handbook of judgment and decision making 2004, 240-256. Blackwell, Oxford, England. D.J. Koehler, N. Harvey (Eds.).
24. Fischer I., Harvey N. Combining forecasts: what information do judges need to outperform the simple average?. International Journal of Forecasting 1999, 15(3):227-246.
25. Gigerenzer G., Goldstein D.G. Reasoning the fast and frugal way: models of bounded rationality. Psychological Review 1996, 103(4):650-669.
26. Goodwin P., Wright G. Decision analysis for management judgment 1998, John Wiley & Sons, Chichester, England.
27. Griffin D., Tversky A. The weighing of evidence and the determinants of confidence. Cognitive Psychology 1992, 24(3):411-435.
28. Harvey N. Why are judgments less consistent in less predictable task situations?. Organizational Behavior and Human Decision Processes 1995, 63:247-263.
29. Harvey N., Fischer I. Taking advice: accepting help, improving judgment, and sharing responsibility. Organizational Behavior and Human Decision Processes 1997, 70(2):117-133.
30. Harvey N., Harries C. Effects of judges' forecasting on their later combination of forecasts for the same outcomes. International Journal of Forecasting 2004, 20(3):391-409.
31. Harvey N., Harries C., Fischer I. Using advice and assessing its quality. Organizational Behavior and Human Decision Processes 2000, 81(2):252-273.
32. Heider F. The psychology of interpersonal relations 1958, Wiley, New York.
33. Hogarth R.M. A note on aggregating opinions. Organizational Behavior and Human Performance 1978, 21(1):40-46.
34. Kelley H.H. The warm-cold variable in first impressions of persons. Journal of Personality 1950, 18:431-439.
35. Klayman J. Varieties of confirmation bias. Decision making from a cognitive perspective 1995, 365-418. Academic Press, New York. R. Busemeyer, R. Hastie, D.L. Medin (Eds.).
36. Klayman J., Soll J.B., González-Vallejo C., Barlas S. Overconfidence: it depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes 1999, 79(3):216-247.
37. Koehler D.J., Beauregard T.A. Illusion of confirmation from exposure to another's hypothesis. Journal of Behavioral Decision Making 2006, 19(1):61-78.
38. Krueger J., Mueller R.A. Unskilled, unaware, or both? The better-than-average heuristic and statistical regression predict errors in estimates of own performance. Journal of Personality and Social Psychology 2002, 82(2):180-188.
39. Kunda Z. The case for motivated reasoning. Psychological Bulletin 1990, 108(3):480-498.
40. Larrick R.P., Boles T.L. Avoiding regret in decisions with feedback: a negotiation example. Organizational Behavior and Human Decision Processes 1995, 63(1):87-97.
41. Larrick R.P., Soll J.B. Intuitions about combining opinions: misappreciation of the averaging principle. Management Science 2006, 52(1):111-127.
42. Lees C.D., Triggs T.J. Intuitive prediction: response strategies underlying cue weights in the relative-weight averaging model. American Journal of Psychology 1997, 110(3):317-356.
43. Lim J.S., O'Connor M. Judgmental adjustment of initial forecasts: its effectiveness and biases. Journal of Behavioral Decision Making 1995, 8:149-168.
44. Littlepage G.E., Robison W., Reddington K. Effects of task experience and group experience on group performance, member ability, and recognition of expertise. Organizational Behavior and Human Decision Processes 1997, 69(2):133-147.
45. Littlepage G.E., Schmidt G.W., Whisler E.W., Frost A.G. An input-process-output analysis of influence and performance in problem-solving groups. Journal of Personality and Social Psychology 1995, 69(5):877-889.
46. Mannes A.E. Are we wise about the wisdom of crowds? The use of group judgments in belief revision. Management Science 2009, 55:1267-1279.
47. Mannes, A. E., Soll, J. B., & Larrick, R. P. (2010). The wisdom of small crowds (unpublished manuscript).
48. Mojzisch, A., Grouneva, L., & Schulz-Hardt, S. Biased evaluation of information during discussion: disentangling the effects of preference consistency, social validation, and ownership of information. European Journal of Social Psychology, in press. doi:10.1002/ejsp.60.
49. Moore D.A., Small D.A. Error and bias in comparative judgment: on being both better and worse than we think we are. Journal of Personality and Social Psychology 2007, 92:972-989.
50. Mussweiler T., Strack F. Hypothesis-consistent testing and semantic priming in the anchoring paradigm: a selective accessibility model. Journal of Experimental Social Psychology 1999, 35:136-164.
51. Nisbett R., Ross L. Human inference: strategies and shortcomings of social judgment 1980, Prentice-Hall, Englewood Cliffs, NJ.
52. Nuttin J.M. Affective consequences of mere ownership: the name letter effect in twelve European languages. European Journal of Social Psychology 1987, 17:381-402.
53. Page S.E. The difference: how the power of diversity creates better groups, firms, schools, and societies 2007, Princeton University Press, Princeton, NJ.
54. Payne J.W., Bettman J.R., Johnson E.J. The adaptive decision maker 1993, Cambridge University Press, New York.
55. Sanitioso R., Kunda Z. Ducking the collection of costly evidence: motivated use of statistical heuristics. Journal of Behavioral Decision Making 1991, 4(3):161-231.
56. Schkade D.A., Sunstein C.R., Kahneman D. Deliberating about dollars: the severity shift. Punitive damages: how juries decide 2002, The University of Chicago Press, Chicago. C.R. Sunstein, R. Hastie, J.W. Payne, D.A. Schkade, W.K. Viscusi (Eds.).
57. Shanks D.R., Tunney R.J., McCarthy J.D. A re-examination of probability matching and rational choice. Journal of Behavioral Decision Making 2002, 15:233-250.
58. Sniezek J.A., Buckley T. Cueing and cognitive conflict in judge-advisor decision making. Organizational Behavior and Human Decision Processes 1995, 62(2):159-174.
59. Sniezek J.A., Henry R.A. Accuracy and confidence in group judgment. Organizational Behavior and Human Decision Processes 1989, 43(1):1-28.
60. Soll J.B. Intuitive theories of information: beliefs about the value of redundancy. Cognitive Psychology 1999, 38(2):317-346.
61. Soll J.B., Larrick R.P. Strategies for revising judgment: how (and how well) people use others' opinions. Journal of Experimental Psychology: Learning, Memory and Cognition 2009, 35:780-805.
62. Steele C.M. The psychology of self-affirmation: sustaining the integrity of the self. Advances in experimental social psychology 1988, Vol. 21:261-302. Academic Press, San Diego, CA. L. Berkowitz (Ed.).
63. Stigler S.M. Statistics on the table 1999, Harvard University Press, Cambridge, MA.
64. Surowiecki J. The wisdom of crowds: why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations 2004, Doubleday, New York.
65. Tversky A., Koehler D.J. Support theory: a nonextensional representation of subjective probability. Psychological Review 1994, 101(4):547-567.
66. Van Swol L.M., Savadori L., Sniezek J.A. Factors that may affect the difficulty of uncovering hidden profiles. Group Processes and Intergroup Relations 2003, 6:285-304.
67. Yaniv I. Weighting and trimming: heuristics for aggregating judgments under uncertainty. Organizational Behavior and Human Decision Processes 1997, 69(3):237-249.
68. Yaniv I. The benefit of additional opinions. Current Directions in Psychological Science 2004, 13(2):75-78.
69. Yaniv I. Receiving other people's advice: influence and benefit. Organizational Behavior and Human Decision Processes 2004, 93(1):1-13.
70. Yaniv I., Kleinberger E. Advice taking in decision making: egocentric discounting and reputation formation. Organizational Behavior and Human Decision Processes 2000, 83(2):260-281.
71. Yaniv I., Milyavsky M. Using advice from multiple sources to revise and improve judgments. Organizational Behavior and Human Decision Processes 2007, 103:104-120.