Proper analysis of the accuracy of group judgments

Psychological Bulletin

Volumn 121, Issue 1, 1997, Pages 149-167

  Gigone, Daniel ^a,b   Hastie, Reid ^a  

^a UNIVERSITY OF COLORADO   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 21444432031     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-2909.121.1.149     Document Type: Article

References (51)

1. Ashton, H. A. (1985). Does consensus imply accuracy in accounting studies of decision making? Accounting Review, 60, 173-185.
2. Brehmer, B., & Joyce, C. R. B. (Eds.). (1988). Advances in psychology. Vol. 54. Human judgment: The SJT view. Amsterdam: Elsevier.
3. Brown, R. (1986). Social psychology: The second edition. New York: Free Press.
4. Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997-1003.
5. Cooksey, R. W., & Freebody, P. (1985). Generalized multivariate lens model analysis for complex human inference tasks. Organizational Behavior and Human Performance, 35, 46-72.
6. Edwards, W. (1968). Conservatism in human information processing. In B. Kleinmuntz (Ed.), Formal representation of human judgment (pp. 17-52). New York: Wiley.
7. Einhorn, H. J., Hogarth, R. M., & Klempner, E. (1977). Quality of group judgment. Psychological Bulletin, 84, 158-172.
8. Gigone, D., & Hastie, R. (1993). The common knowledge effect: Information sharing and group judgment. Journal of Personality and Social Psychology, 65, 959-974.
9. Gigone, D., & Hastie, R. (1996). The impact of information on group judgment: A model and computer simulation. In E. Witte & J. H. Davis (Eds.), Understanding group behavior. Vol. 1: Consensual action by small groups (pp. 221-251). Hillsdale, NJ: Erlbaum.
10. Hammond, K. R. (1996). Human judgment and social policy: Irreducible uncertainty, inevitable error, and unavoidable injustice. New York: Oxford University Press.
11. Hammond, K. R., Stewart, T. R., Brehmer, B., & Steinmann, D. O. (1986). Social judgment theory. In H. R. Arkes & K. R. Hammond (Eds.), Judgment and decision making: An interdisciplinary reader. New York: Academic Press.
12. Harmon, J., & Rohrbaugh, J. (1990). Social judgment analysis and small group decision making: Cognitive feedback effects on individual and collective performance. Organizational Behavior and Human Decision Processes, 46, 34-54.
13. Hastie, R. (1986). Experimental evidence on group accuracy. In B. Grofman & G. Owen (Eds.), Decision research (Vol. 2, pp. 129-157). Greenwich, CT: JAI Press.
14. Hastie, R., & Rasinski, K. A. (1987). The concept of accuracy in social judgment. In D. Bar-Tal & A. Kruglanski (Eds.), The social psychology of knowledge (pp. 193-208). Cambridge, England: Cambridge University Press.
15. Henry, R. A. (1993). Group judgment accuracy: Reliability and validity of postdiscussion confidence judgments. Organizational Behavior and Human Decision Processes, 56, 11-27.
16. Henry, R. A. (1995). Improving group judgment accuracy: Information sharing and determining the best member. Organizational Behavior and Human Decision Processes, 62, 190-197.
17. Hill, G. W. (1982). Group versus individual performance: Are N + 1 heads better than one? Psychological Bulletin, 91, 517-539.
18. Hogarth, R. M. (1977). Methods for aggregating opinions. In H. Jungermann & G. de Zeeuw (Eds.), Decision making and change in human affairs (pp. 231-255). Dordrecht, The Netherlands: Kluwer Academic.
19. Hursch, C., Hammond, K. R., & Hursch, J. (1964). Some methodological considerations in multiple-cue probability studies. Psychological Review, 71, 42-60.
20. Judd, C. M., & McClelland, G. H. (1989). Data analysis: A model comparison approach. San Diego, CA: Harcourt, Brace, Jovanovich.
21. Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80, 237-251.
22. Kerr, N. L., MacCoun, R. J., & Kramer, G. P. (1996). When are N heads better than one? Bias in individuals versus groups. In E. Witte & J. H. Davis (Eds.), Understanding group behavior. Vol. 1: Consensual action by small groups (pp. 105-136). Hillsdale, NJ: Erlbaum.
23. Laughlin, P. R., VanderStoep, S. W., & Hollingshead, A. B. (1991). Collective versus individual induction: Recognition of truth, rejection of error, and collective information processing. Journal of Personality and Social Psychology, 61, 50-67.
24. Lee, J.-W., & Yates, J. F. (1992). How quantity judgment changes as the number of cues increases: An analytical framework and review. Psychological Bulletin, 112, 363-377.
25. Libby, R., Trotman, K. T., & Zimmer, I. (1987). Member variation, recognition of expertise, and group performance. Journal of Applied Psychology, 72, 81-87.
26. Lim, R. G. (1994). Eliciting confidence intervals within the context of the revision and weighting model of group consensus judgment. Organizational Psychology and Human Decision Processes, 59, 348-370.
27. Michaelsen, L. K., Watson, W. E., & Black, R. H. (1989). A realistic test of individual versus group consensus decision making. Journal of Applied Psychology, 74, 834-839.
28. Michaelsen, L. K., Watson, W. E., Schwartzkopf, A., & Black, R. H. (1992). Group decision making: How you frame the question determines what you find. Journal of Applied Psychology, 77, 106-108.
29. Miner, F. C., Jr. (1984). Group versus individual decision making: An investigation of performance measures, decision strategies, and process losses/gains. Organizational Behavior and Human Performance, 33, 112-124.
30. Murphy, A. H. (1988). Skill scores based on the mean square error and their relationships to the correlation coefficient. Monthly Weather Review, 116, 2417-2424.
31. Myers, D. G., & Lamm, H. (1976). The group polarization phenomenon. Psychological Bulletin, 83, 602-627.
32. Nisbett, R. E., Zukier, H., & Lemley, R. E. (1981). The dilution effect: Nondiagnostic information weakens the implications of diagnostic information. Cognitive Psychology, 13, 248-277.
33. Reagan-Cirincione, P. (1994). Improving the accuracy of group judgment: A process intervention combining group facilitation, social judgment analysis, and information technology. Organizational Behavior and Human Decision Processes, 58, 246-270.
34. Reagan-Cirincione, P., & Rohrbaugh, J. (1992). Task bias and the accuracy of judgment: Setting a baseline for expected performance. Journal of Behavioral Decision Making, 5, 233-252.
35. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
36. Sniezek, J. A. (1989). An examination of group process in judgmental forecasting. International Journal of Forecasting, 5, 171-178.
37. Sniezek, J. A. (1990). A comparison of techniques for judgmental forecasting by groups with common information. Group and Organizational Studies, 15, 5-19.
38. Sniezek, J. A., & Henry, R. A. (1989). Accuracy and confidence in group judgment. Organizational Behavior and Human Decision Processes, 43, 1-28.
39. Sniezek, J. A., & Henry, R. A. (1990). Revision, weighting, and commitment in consensus group judgment. Organizational Behavior and Human Decision Processes, 45, 66-84.
40. Stasser, G. (1988). Computer simulation as a research tool: The DISCUSS model of group decision making. Journal of Experimental Social Psychology, 24, 393-422.
41. Stasson, M. F., & Bradshaw, S. D. (1995). Explanations of individual-group performance differences: What sort of "bonus" can be gained through group interaction? Small Group Research, 26, 296-308.
42. Steiner, I. D. (1972). Group process and productivity. New York: Academic Press.
43. Stewart, T. R. (1976). Components of correlations and extensions of the lens model equation. Psychometrika, 41, 101-120.
44. Stewart, T. R. (1988). Judgment analysis: Procedures. In B. Brehmer & C. R. B. Joyce (Eds.), Human judgment: The SJT view (pp. 41-74). Amsterdam: North Holland.
45. Stewart, T. R. (1990). A decomposition of the correlation coefficient and its use in analyzing forecasting skill. Weather and Forecasting, 5, 661-666.
46. Tindale, R. S. (1993). Decision errors made by individuals and groups. In N. J. Castellan (Ed.), Individual and group decision making: Current issues (pp. 109-124). Hillsdale, NJ: Erlbaum.
47. Tindale, R. S., & Larson, J. R., Jr. (1992a). Assembly bonus effect or typical group performance? A comment on Michaelsen, Watson, and Black (1989). Journal of Applied Psychology, 77, 102-105.
48. Tindale, R. S., & Larson, J. R., Jr. (1992b). It's not how you frame the question, it's how you interpret the result. Journal of Applied Psychology, 77, 109-110.
49. Troutman, C. M., & Shanteau, J. (1977). Inferences based on nondiagnostic information. Organizational Behavior and Human Performance, 19, 43-55.
50. Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131.
51. Watson, W., Michaelsen, L. K., & Sharp, W. (1991). Member competence, group interaction, and group decision making: A longitudinal study. Journal of Applied Psychology, 76, 803-809.