The Group Matters: A Review of Processes and Outcomes in Intelligence Analysis

Group Dynamics

Volumn 15, Issue 2, 2011, Pages 128-146

  Straus, Susan G ^a   Parker, Andrew M ^a   Bruce, James B ^a  

^a RAND CORPORATION   (United States)

Author keywords

Group judgment; Intelligence analysis; Process losses

Indexed keywords

EID: 79958716870     PISSN: 10892699     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0022734     Document Type: Article

References (136)

1. Asch S. Effects of group pressure upon the modification and distortion of judgment. Groups, leadership and men 1951, Carnegie Press, Pittsburgh. H. Guetzkow (Ed.).
2. Bales R.E., Strodtbeck F.L., Mills T.M., Roseborough M.E. Channels of communication in small groups. American Sociological Review 1951, 16:416-468.
3. Barger D.G. Toward a revolution in intelligence affairs. (RAND TR-242-CMS) 2005, Santa Monica: RAND.
4. Baron R.S. So right it's wrong: Groupthink and the ubiquitous nature of polarized group decision making. Advances in experimental social psychology 2005, 37:219-253. Elsevier Academic Press, San Diego. M.P. Zanna (Ed.).
5. Bazerman M.H., Giuliano T., Appelman A. Escalation of commitment in individual and group decision making. Organizational Behavior and Human Performance 1984, 33:141-152.
6. Betsch T., Haberstroh S., Glockner A., Haar T., Fiedler K. The effects of routine strength on adaptation and information search in recurrent decision making. Organizational Behavior and Human Decision Processes 2001, 84:23-53.
7. Bigley G.A., Roberts K.H. High-reliability organizing for complex and volatile task environments. The Academy of Management Journal 2001, 44:1281-1299.
8. Bouchard T.J., Hare M. Size, performance, and potential in brainstorming groups. Journal of Applied Psychology 1970, 54:51-55.
9. Brauer M., Judd C.M., Gliner M.D. The effects of repeated expressions on attitude polarization during group discussions. Journal of Personality and Social Psychology 1995, 68:1014-1029.
10. Brockner J., Rubin J.Z. Entrapment in escalating conflicts 1985, Springer, New York.
11. Bruce J.B. Dynamic adaptation: A twenty-first century intelligence paradigm 2004, Central Intelligence Agency.
12. Bruce J.B. The missing link: The analyst-collector relationship. Analyzing intelligence: Origins, obstacles, and innovations 2008, 191-212. Georgetown University Press, Washington, DC. R.Z. George, J.B. Bruce (Eds.).
13. Bruce J.B. Making analysis more reliable: Why epistemology matters to intelligence. Analyzing intelligence: Origins, obstacles, and innovations 2008, 171-190. Georgetown University Press, Washington, DC. R.Z. George, J.B. Bruce (Eds.).
14. Cannon-Bowers J.A., Salas E. Reflections on shared cognition. Journal of Organizational Behavior 2001, 22(2):195-202.
15. Chirumbolo A., Livi S., Mannetti L., Pierro A., Kruglanski A. Effects of need for closure on creativity in small group interactions. European Journal of Personality 2004, 18:265-278.
16. Choi H.-S., Thompson L. Old wine in a new bottle: Impact of membership change on group creativity. Organizational Behavior and Human Decision Processes 2005, 98:121-132.
17. Convertino G., Billman D., Pirolli P., Massar J.P., Shrager J. The CACHE study: Group effects in computer-supported collaborative analysis. Computer-Supported Cooperative Work 2008, 17:353-393.
18. Dalkey N., Helmer O. An experimental application of the Delphi method to the use of experts. Management Science 1963, 9:458-467.
19. Davis J. Why bad things happen to good analysts. Analyzing intelligence: Origins, obstacles, and innovations 2008, 157-170. Georgetown University Press, Washington, DC. R.Z. George, J.B. Bruce (Eds.).
20. De Dreu C.I.W., Weingart L. Task versus relationship conflict, team performance, and team member satisfaction: A meta-analysis. Journal of Applied Psychology 2003, 88:741-749.
21. Delbecq A.L., Van de Ven A.H. A group process model for problem identification and program planning. Journal of Applied Behavioral Science 1971, 7:466-492.
22. Dennis A.R., Valacich J.S. Computer brainstorms: More heads are better than one. Journal of Applied Psychology 1993, 78:531-537.
23. DeRosa D., Smith C., Hantula D. The medium matters: Mining the long-promised merit of group interaction in creative idea generation tasks in a meta-analysis of the electronic group brainstorming literature. Computers in Human Behavior 2007, 23:1549-1581.
24. Diehl M., Stroebe W. Productivity loss in brainstorming groups: Toward the solution of a riddle. Journal of Personality and Social Psychology 1987, 53:497-509.
25. Dugosh K.L., Paulus P.B., Roland E.J., Yang H.-C. Cognitive stimulation in brainstorming. Journal of Personality and Social Psychology 2000, 79:722-735.
26. Ellsberg D. Risk, ambiguity, and the Savage axioms. Quarterly Journal of Economics 1961, 75:643-669.
27. Festinger L., Schachter S., Back K.W. Social pressures in informal groups: A study of human factors in housing 1950, Harper Bros, New York.
28. Fischhoff B. Hindsight ≠ foresight: Effect of outcome knowledge on judgment under uncertainty. Human Perception and Performance 1975, 1:288-299.
29. Flowers M.L. A laboratory test of some implications of Janis's groupthink hypothesis. Journal of Personality and Social Psychology 1977, 35:888-896.
30. Fuller S.R., Aldag R.J. Organizational tonypandy: Lessons from a quarter century of groupthink phenomenon. Organizational Behavior and Human Decision Processes 1998, 73:163-184.
31. George R.Z., Bruce J.B. Analyzing intelligence: Origins, obstacles, and innovations 2008, Georgetown University Press, Washington, DC.
32. Gigone D., Hastie R. The common knowledge effect: Information sharing and group judgment. Journal of Personality and Social Psychology 1993, 65:959-974.
33. Gino F., Argote L., Miron-Spektor E., Todorova G. First, get your feet wet: The effects of learning from direct and indirect experience on team creativity. Organizational Behavior and Human Decision Processes 2010, 111:102-115.
34. Greitemeyer T., Schulz-Hardt S. Preference-consistent evaluation of information in the hidden profile paradigm: Beyond group-level explanations for the dominance of shared information in group decisions. Journal of Personality and Social Psychology 2003, 84:322-339.
35. Greitemeyer T., Schulz-Hardt S., Brodbeck F.C., Frey D. Information sampling and group decision making: The effects of an advocacy decision procedure and task experience. Journal of Experimental Psychology: Applied 2006, 12:31-42.
36. Gruenfeld D.H., Mannix E.A., Williams K.Y., Neale M.A. Group composition and decision making: How member familiarity and information distribution affect process and performance. Organizational Behavior and Human Decision Processes 1996, 67:1-15.
37. Hackman J.R. The design of work teams. Handbook of organizational behavior 1987, 315-342. Prentice Hall, New York. J.W. Lorsch (Ed.).
38. Hackman J.R. Leading teams: Setting the stage for great performances 2002, Harvard Business School Press, Boston.
39. Hackman J.R., O'Connor M. What makes for a great analytic team? Individual vs. Team approaches to intelligence analysis 2004, Intelligence Science Board, Office of the Director of Central Intelligence, Washington, DC.
40. Hackman, J. R., & Woolley, A. W. (in press). Creating and leading analytic teams. In R. L. Rees & J. W. Harris (Eds.), Handbook of the psychology of intelligence analysis: The human factor. Burlington, MA: Centra.
41. Hastie R. Experimental evidence on group accuracy. Information pooling and group decision making. Proceedings of the second University of California, Irvine conference on political economy 1986, 129-158. JAI Press, Greenwich. B. Grofman, G. Owen (Eds.).
42. Heuer R.J. Psychology of intelligence analysis 1999, Center for the Study of Intelligence, Washington, DC.
43. Heuer, R. J., Jr. (2007). Small group processes for intelligence analysis. Washington, DC: Sherman Kent School of Intelligence Analysis, Central Intelligence Agency, unpublished manuscript.
44. Hinsz V.B., Tindale R.S., Vollrath D.A. The emerging conceptualization of groups as information processors. Psychological Bulletin 1997, 121:43-64.
45. Hoffman L.R., Maier N.R.F. Valence in the adoption of solutions by problem-solving groups: Concept, method, and results. Journal of Abnormal and Social Psychology 1964, 69:264-271.
46. Hogarth R.M., Einhorn H.J. Order effects in belief updating: The belief-adjustment model. Cognitive Psychology 1992, 24:1-55.
47. Isenberg D.J. Group polarization: A critical review and meta-analysis. Journal of Personality and Social Psychology 1986, 50:1141-1151.
48. Janis I., Mann L. Decision making: A psychological analysis of conflict, choice, and commitment 1977, The Free Press, New York.
49. Janis I.L. Victims of groupthink 1972, Houghton Mifflin, Boston.
50. Janis I.L. Groupthink: Psychological studies of policy decisions and fiascoes 1982, Houghton Mifflin, Boston. 2 ed.
51. Johnston R. Analytic culture in the U.S. intelligence community: An ethnographic study 2005, U.S. Government Printing Office, Washington, DC.
52. Jonas E., Schulz-Hardt S., Frey D., Thelen N. Confirmation bias in sequential information search after preliminary decisions: An expansion of dissonance theoretical research on selective exposure to information. Journal of Personality and Social Psychology 2001, 80:557-571.
53. Karau S.J., Kelly J.R. The effects of time scarcity and time abundance on group performance quality and interaction process. Journal of Experimental Social Psychology 1992, 28:542-571.
54. Katz R. The effects of group longevity on communication and performance. Administrative Science Quarterly 1982, 27:81-104.
55. Kelly J.R., Jackson J.W., Hutson-Comeaux S.L. The effects of time pressure and task differences on influence modes and accuracy in decision-making groups. Personality and Social Psychology Bulletin 1997, 23:10-22.
56. Kelly J.R., Karau S.J. Group decision making: The effects of initial preferences and time pressure. Personality and Social Psychology Bulletin 1999, 25:1342-1354.
57. Kerr N.L., Tindale R.S. Group performance and decision making. Annual Review of Psychology 2004, 55:623-655.
58. Klayman J., Ha Y.-W. Confirmation, disconfirmation, and information in hypothesis testing. Psychological Review 1987, 94:211-228.
59. Koriat A., Lichtenstein S., Fischhoff B. Reasons for confidence. Journal of Experimental Psychology 1980, 6:107-118.
60. Kramer T.J., Fleming G.P., Mannis S.M. Improving face-to-face brainstorming through modeling and facilitation. Small Group Research 2001, 32:533-557.
61. Larson J.R., Foster-Fishman P.G., Keys C.B. Discussion of shared and unshared information in decision-making groups. Journal of Personality and Social Psychology 1994, 67:446-461.
62. Larson J.R., Sargis E.S., Elstein A.S., Schwartz A. Holding shared versus unshared information: Its impact on perceived member influence in decision-making groups. Basic and Applied Social Psychology 2002, 24:145-155.
63. Laughlin P., Bonner B. Collective induction: Effects of multiple hypotheses and multiple evidence in two problem domains. Journal of Personality and Social Psychology 1999, 77:1163-1172.
64. Laughlin P.R. Social combination processes of cooperative, problem-solving groups at verbal, intellective tasks. Progress in social psychology 1980, 1:127-155. Lawrence-Erlbaum, Hillsdale, NJ. M. Fishbein (Ed.).
65. Laughlin P.R. Collective induction: Twelve postulates. Organizational Behavior and Human Decision Processes 1999, 80:50-69.
66. Lewin K. Resolving social conflicts: Selected papers on group dynamics 1948, Harper, Oxford.
67. Lichtenstein S., Slovic P., Fischhoff B., Layman M., Combs B. Judged frequency of lethal events. Journal of Experimental Psychology: Human Learning and Memory 1978, 4:551-578.
68. Littlepage G., Schmidt G., Whisler E., Frost A. An input-process-output analysis of influence and performance in problem-solving groups. Journal of Personality and Social Psychology 1995, 69:877-889.
69. Maier N.R.F., Solem A.R. Improving solutions by turning choice situations into problems. Personnel Psychology 1962, 15:151-157.
70. Mathieu J., Heffner T., Goodwin G., Salas E., Cannon-Bowers J. The influence of shared mental models on team process and performance. Journal of Applied Psychology 2000, 85:273-283.
71. McGrath J.E. Groups: Interaction and performance 1984, Prentice Hall, Inc., Englewood Cliffs.
72. Medina C. The new analysis. Analyzing intelligence: Origins, obstacles, and innovations 2008, 238-250. Georgetown University Press, Washington, DC. R.Z. George, J.B. Bruce (Eds.).
73. Mesmer-Magnus J.R., DeChurch L.A. Information sharing and team performance: A meta-analysis. Journal of Applied Psychology 2009, 94:535-546.
74. Moreland R., Argote L., Krishnan R. Socially shared cognition at work: Transactive memory and group performance. What's social about social cognition? Research on socially shared cognition in small groups 1996, 57-84. Sage, Thousand Oaks, CA.
75. Moreland R.L., Levine J.M. Socialization in small groups: Temporal changes in individual-group relations. Advances in experimental social psychology 1982, 15:137-192. Academic Press, New York. L. Berkowitz (Ed.).
76. Moreland R.L., Myaskovsky L. Exploring the performance benefits of group training: Transactive memory or improved communication?. Organizational Behavior and Human Decision Processes 2000, 82:117-133.
77. Mullen B., Anthony T., Salas E., Driskell J.E. Group cohesiveness and quality of decision making: An integration of tests of the groupthink hypothesis. Small Group Research 1994, 25:189-204.
78. Mullen B., Copper C. The relation between group cohesiveness and performance: An integration. Psychological Bulletin 1994, 115:210-227.
79. Mullen B., Johnson C., Salas E. Productivity loss in brainstorming groups: A meta-analytic integration. Basic and Applied Social Psychology 1991, 12:3-23.
80. Myers D.G., Lamm H. The group polarization phenomenon. Psychological Bulletin 1976, 83:602-627.
81. Nijstad B.A., Stroebe W., Lodewijkx H.F.M. Persistence of brainstorming groups: How do people know when to stop?. Journal of Experimental Social Psychology 1999, 35:165-185.
82. Nijstad B.A., Stroebe W., Lodewijkx H.F.M. Production blocking and idea generation: Does blocking interfere with cognitive processes?. Journal of Experimental Social Psychology 2003, 39:531-548.
83. Intelligence community directive, number 203: Analytic standards (Effective July 21, 2007) 2007, Office of the Director of National Intelligence, Retrieved from http://www.fas.org/irp/dni/icd/index.html.
84. Offner A., Kramer T., Winter J. The effects of facilitation, recording, and pauses on group brainstorming. Small Group Research 1996, 27:283-298.
85. Oxley N.L., Dzindolet M.T., Paulus P.B. The effects of facilitators on the performance of brainstorming groups. Journal of Social Behavior & Personality 1996, 11:633-646.
86. Paulus P., Nakui T., Putman V., Brown V. Effects of task instructions and brief breaks on brainstorming. Group Dynamics: Theory, Research, and Practice 2006, 10:206-219.
87. Paulus P.B., Dzindolet M.T., Poletes G., Camacho L.M. Perception of performance in group brainstorming: The illusion of group productivity. Personality and Social Psychology Bulletin 1993, 19:78-89.
88. Paulus P.B., Yang H.-C. Idea generation in groups: A basis for creativity in organizations. Organizational Behavior and Human Decision Processes 2000, 82:76-87.
89. Peterson R.S. A directive leadership style in group decision making can be both virtue and vice: Evidence from elite and experimental groups. Journal of Personality and Social Psychology 1997, 72:1107-1121.
90. Peterson R.S., Owens P.D., Tetlock P.E., Fan E.T., Martorana P. Group dynamics in top management teams: Groupthink, vigilance, and alternative models of organizational failure and success. Organizational Behavior and Human Decision Processes 1998, 73:272-305.
91. Pherson R.H. Handbook of analytic tools and techniques 2008, Pherson Associates, Reston, VA.
92. Pierro A., Mannetti L., De Grada E., Livi S., Kruglanski A. Autocracy bias in informal groups under need for closure. Personality and Social Psychology Bulletin 2003, 29:405-417.
93. Puncochar J.M., Fox P.W. Confidence in individual and group decision making: When " two heads" are worse than one. Journal of Educational Psychology 2004, 96:582-591.
94. Rohrbaugh J. Improving the quality of group judgment: Social judgment analysis and the Delphi technique. Organizational Behavior and Human Performance 1979, 24:73-92.
95. Rohrbaugh J. Improving the quality of group judgment: Social judgment analysis and the nominal group technique. Organizational Behavior and Human Performance 1981, 28:272-288.
96. Ronis D.L., Yates J.F. Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method. Organizational Behavior and Human Decision Processes 1987, 40:193-218.
97. Schachter S. Deviation, rejection and communication. Journal of Abnormal and Social Psychology 1951, 46:190-207.
98. Schulz-Hardt S., Frey D., Luthgens C., Moscovici S. Biased information search in group decision making. Journal of Personality and Social Psychology 2000, 78:655-669.
99. Schulz-Hardt S., Jochims M., Frey D. Productive conflict in group decision making: Genuine and contrived dissent as strategies to counteract biased information seeking. Organizational Behavior and Human Decision Processes 2002, 88:563-586.
100. Schweiger D.M., Sandberg W.R., Ragan J.W. Group approaches for improving strategic decision making: A comparative analysis of dialectical inquiry, devil's advocacy, and consensus. Academy of Management Journal 1986, 29(1):51-71.
101. Shaw M.E. Comparison of individuals and small groups in the rational solution of complex problems. American Journal of Psychology 1932, 44:491-504.
102. Sherif M. The psychology of social norms 1936, Harper, New York.
103. Sieck W.R., Arkes H.R. The recalcitrance of overconfidence and its contribution to decision aid neglect. Journal of Behavioral Decision Making 2005, 18:29-53.
104. Slovic P. Perception of risk. Science 1987, 236:280-285.
105. Smith T.J. Predictive warning: Teams, networks, and scientific method. Analyzing intelligence: Origins, obstacles, and innovations 2008, 266-280. Georgetown University Press, Washington, DC. R.Z. George, J.B. Bruce (Eds.).
106. Sniezek J.A. Groups under uncertainty: An examination of confidence in group decision making. Organizational Behavior and Human Decision Processes 1992, 52:124-155.
107. Sniezek J.A., Henry R.A. Accuracy and confidence in group judgment. Organizational Behavior and Human Decision Processes 1989, 43:1-28.
108. Stasser G., Stewart D. Discovery of hidden profiles by decision-making groups: Solving a problem versus making a judgment. Journal of Personality and Social Psychology 1992, 63:426-434.
109. Stasser G., Taylor L., Hanna C. Information sampling in structured and unstructured discussions of three- and six-person groups. Journal of Personality and Social Psychology 1989, 57:67-78.
110. Stasser G., Titus W. Pooling of unshared information in group decision making: Biased information sampling during discussion. Journal of Personality and Social Psychology 1985, 48:1467-1478.
111. Stasser G., Titus W. Effects of information load and percentage of shared information on the dissemination of unshared information during group discussion. Journal of Personality and Social Psychology 1987, 53:81-93.
112. Staw B.M., Ross J. Commitment to a policy decision: A multi-theoretical perspective. Administrative Science Quarterly 1978, 23:40-64.
113. Steiner I.D. Group process and productivity 1972, Academic Press, New York.
114. Stephan F.F., Mishler E.G. The distribution of participation in small groups: An exponential approximation. American Sociological Review 1952, 17:598-608.
115. Stewart D.D., Stasser G. Expert role assignment and information sampling during collective recall and decision making. Journal of Personality and Social Psychology 1995, 69:619-628.
116. Straus S.G., Olivera F. Knowledge acquisition in virtual teams. Research on managing groups and teams 2000, 257-282. JAI Press, Stamford, CT. T. Griffith (Ed.).
117. Straus S.G., Parker A.M., Bruce J.B., Dembosky J.W. The group matters: A review of the effects of group interaction on processes and outcomes in analytic teams 2009, RAND WR-580. Available at: http://www.rand.org/pubs/working_papers/WR580/.
118. Stroebe W., Diehl M., Abakoumkin G. The illusion of group effectivity. Personality and Social Psychology Bulletin 1992, 18:643-650.
119. Sunstein C.R., Schkade D., Ellman L.M. Ideological voting on federal courts of appeals: A preliminary investigation. Virginia Law Review 2004, 90:301-354.
120. Tetlock P.E. Expert political judgment - how good is it? How can we know? 2005, Princeton University Press, Princeton.
121. Turner M.E., Pratkanis A.R. Twenty-five years of groupthink theory and research: Lessons from the evaluation of a theory. Organizational Behavior and Human Decision Processes 1998, 73:105-115.
122. National incident management system 2008, November, United States Department of Homeland Security, U.S. Government Printing Office, Washington, DC.
123. A tradecraft primer: Structured analytical techniques for improving intelligence analysis 2009, March, United States Government, Retrieved from: https://www.cia.gov/library/center-for-the-study-of-intelligence/csi-publications/books-and-monographs/Tradecraft%20Primer-apr09.pdf.
124. Report on the U.S. intelligence community's prewar intelligence assessments on Iraq: Conclusions 2004, United States Senate Select Committee on Intelligence, Retrieved from http://www.globalsecurity.org/intell/library/congress/2004_rpt/iraq-wmd_intell_09jul2004_conclusions.pdf.
125. Van Swol L.M. Factors affecting decision makers' preference for unshared information. Group Dynamics: Theory, Research, and Practice 2009, 13:31-45.
126. Wageman R. Critical success factors for creating superb self-managing teams. Organizational Dynamics 1997, 26:49-61.
127. Wageman R. How leaders foster self-managing team effectiveness: Design choice versus hands-on coaching. Organization Science 2001, 12:559-577.
128. Wason P.C. On the failure to eliminate hypotheses in a conceptual task. The Quarterly Journal of Experimental Psychology 1960, 12:129-140.
129. Williams K.D. Ostracism. Annual Review of Psychology 2007, 58:425-452.
130. Winquist J.R., Larson J.R. Information pooling: When it impacts group decision making. Journal of Personality and Social Psychology 1998, 74:371-377.
131. Wittenbaum G.M., Hubbell A.P., Zuckerman C. Mutual enhancement: Toward an understanding of the collective preference for shared information. Journal of Personality and Social Psychology 1999, 77:967-978.
132. Commission on the intelligence capabilities of the United States regarding weapons of mass destruction 2005, WMD Commission, U.S. Government Printing Office, Washington, DC.
133. Woolley A.W., Gerbasi M., Chabris C.F., Kosslyn S.M., Hackman J.R. Bringing in the experts: How team composition and work strategy jointly shape analytic effectiveness. Small Group Research 2008, 39:352-371.
134. Yates J.F. Judgment and decision making 1990, Prentice Hall, Englewood Cliffs, NJ.
135. Yates J.F. Decision management: How to assure better decisions in your company 2003, Jossey-Bass, San Francisco.
136. Zarnoth P., Sniezek J.A. The social influence of confidence in group decision making. Journal of Experimental Social Psychology 1997, 33:345-366.