An assessment of group support systems experimental research: Methodology and results

Journal of Management Information Systems

Volumn 15, Issue 3, 1998, Pages 7-149

  Fjermestad, Jerry ^a,b,c,d   Hiltz, Starr Roxanne ^a,e  

^a NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

^b PACIFIC LUTHERAN UNIVERSITY   (United States)

^c Polytechnic University   (United States)

^d RUTGERS UNIVERSITY   (United States)

^e Systems Laboratory   (United Kingdom)

Author keywords

Experimental research; Group support systems (GSS); Research methodology

Indexed keywords

EID: 0032223737     PISSN: 07421222     EISSN: None     Source Type: Journal    
DOI: 10.1080/07421222.1998.11518216     Document Type: Article

References (98)

1. Aiken, M.; Krosp, J.; Shirani, A.; and Martin, J. Electronic brainstorming in small and large groups. Information & Management, 27(1994), 141-148.
2. Anson, R.; Bostrom, R.; and Wynne, B. An experiment assessing group support systems and facilitator effects on meeting outcomes. Management Science, 41, 2 (1995), 189-208.
3. Benbasat, I., and Lim, L.H. The effects of group, task, context, and technology variables on the usefulness of group support systems: a meta-analysis of experimental studies. Small Group Research, 24, 4 (1993), 430-462.
4. Briggs, R.O.; Balthazard, P.A.; and Dennis, A.R. Graduate business students as surrogates for executives in the evaluation of technology. Journal of End User Computing, 8, 4 (1995), 11-17.
5. Briggs, R.O; Nunamaker, J.F.; Sprague, R.H. 1001 unanswered research questions in GSS. Journal of Management Information Systems, 14, 3 (1998), 3-21.
6. Broudl, J.L., and Orlikowski, W.J. The problem of statistical power in MIS research. MIS Quarterly (March 1989), 87-106.
7. Bui, T., and Sivasankaran, T.R. Relation between GDSS use and group task complexity: an experimental study. Proceedings of the Twenty-Third Hawaii International Conference on System Sciences, 3 (1990), 69-78.
8. Bui, T.; Sivasankaran, T.R.; Fijol, Y.; and Woodbury, M.A. Identifying organizational opportunities for GDSS use: some experimental evidence. Transactions of the Seventh International Conference on Decision Support Systems (June 1987), 68-75.
9. Burke, K.; Chidambaram, L.; and Lock, J. Evolution of relational factors over time: a study of distributed and non-distributed meetings. Proceedings of the Twenty-Eighth Hawaii International Conference on System Sciences, 4 (1995), 14-23.
10. Chidambaram, L.; Bostrom, R.P.; and Wynne, B.E. A longitudinal study of the impact of group decision support systems on group development. Journal of Management Information Systems, 7, 3 (1990), 7-25.
11. Chidambaram, L., and Jones, B. Impact on communication medium and computer support on group perceptions and performance: a comparison of face-to-face and dispersed meetings. MIS Quarterly, 17, 4 (1993), 465-491.
12. Connolly, T.; Jessup, L.; and Valacich, J.S. Effects of anonymity and evaluative tone on idea generation in computer-mediated groups. Management Science, 36, 6 (1990), 689-703.
13. Daily, B.; Whatley, A.; Ash, S.R.; and Steiner, R.L. The effects of a group decision support system on culturally diverse and culturally homogeneous group decision making. Information & Management, 30 (1996), 281-289.
14. Dennis, A.R. Electronic support for large groups. Journal of Organizational Computing, 4, 2 (1994) 177-197.
15. Dennis, A.R.; George, J.F.; Jessup, L.M.; Nunamaker, J.F.; and Vogel, D.R. Information technology to support electronic meetings. MIS Quarterly (December 1988), 591-618.
16. Dennis, A.R.; Haley, B.J.; and Vandenberg, R.J. A meta-analysis of effectiveness, efficiency, and participant satisfaction in group support systems research. Proceedings of the 17th International Conference on Information Systems (1996), 278-289.
17. Dennis, A.R.; Nunamaker, J.F.; and Paranka, D. Supporting the search for competitive advantage. Journal of Management Information Systems, 8, 1 (1991), 5-36.
18. Dennis, A.R., and Valacich, J.S. Computer brainstorms: more heads are better than one. Journal of Applied Psychology, 78, 4 (1993), 531-537.
19. Dennis, A.R., and Valacich, J.S. Group, sub-group, and nominal group idea generation: new rules for a new media? Journal of Management, 20, 4 (1994), 723-736.
20. Dennis, A.R.; Valacich, J.S.; and Nunamaker, J.F. An experimental investigation of small medium and large groups in an electronic meeting system environment. IEEE Transactions Systems Man Cybernetics, 20, 5 (1990), 1049-1057.
21. DeSanctis, G., and Gallupe, R.B. A foundation for the study of group decision support systems. Management Science, 33, 5 (1987), 589-609.
22. DeSanctis, G., and Poole, S. Understanding the differences in collaborative systems use through appropriation analysis. Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences, 3 (1991), 750-757.
23. DeSanctis, G., and Poole, S. Capturing the complexity in advanced technology use: adaptive structuration theory. Organizational Science, 5, 2 (1994), 121-147.
24. DeSanctis, G.; Poole, M.S.; Dickson, G.; and Jackson, M. Interpretive analysis of team use of group technologies. Journal of Organizational Computing, 3, 1 (1993), 1-30.
25. Dickson, G.W.; Poole, M.S.; and DeSanctis, G. An overview of the GDSS research project and the SAMM system. In R.P. Bostrom, R.T. Watson, and S.T. Kinney (eds.), Computer Augmented Teamwork: A Guided Tour. New York: Van Nostrand Reinhold, 1992.
26. Easton, G.K.; George, J.F.; Nunamaker, J.F; and Pendergast, M.O. Using two different electronic meeting system tools for the same task: an experimental comparison. Journal of Management Information Systems, 7, 1 (1990), 85-99.
27. Ellis, C.A.; Gibbs, S.J.; and Rein, G.L. Groupware: some issues and experiences. Communications of the ACM, 34, 1 (1991), 38-58.
28. Eveland, J.D., and Bikson, T.K. Work group structures and computer support: a field experiment. ACM Transactions on Office Information Systems, 6, 4 (1988), 354-379.
29. Fjermestad, J. An integrated framework for group support systems. Journal of Organizational Computing and Electronic Commerce, 8, 2 (1998), 83-107.
30. Fjermestad, J. In GSS research how many groups per treatment condition are enough? Proceedings of the Fourth Americas Conference (1998), 477-480.
31. Fjermestad, J., and Hiltz, S.R. Experimental studies of group decision support systems: an assessment of variables studied and methodology. Proceedings of the Thirtieth Annual Hawaii International Conference on System Sciences, 2 (1997), 45-66.
32. Fjermestad, J., and Hiltz, S.R. An analysis of the effects of mode of communication on group decision making. Proceedings of the Thirtieth Annual Hawaii International Conference on System Sciences, 1 (1998), 17-26.
33. Fjermestad, J.; Hiltz, S.R.; Turoff, M.; Ford, C.; Johnson, K.; Czech, R.M.; Ocker, R.; Ferrant, F.; and Worrell, M. Distributed computer supported cooperative strategic decision making using structured conflict and consensus approaches. Proceedings of the Twenty-Eighth Hawaii International Conference on System Sciences, 3 (1995), 222-231.
34. Fjermestad, J.L.; Hiltz, S.R.; and Turoff, M. An integrative framework for the study of group decision support systems. Proceedings of the Twenty-Sixth Hawaii International Conference on System Sciences, 4 (1993), 179-188.
35. Fjermestad, J., and Seah, T.S. Using an executive information system to analyze group support systems: a preliminary implementation. Proceedings of the Third Americas Conference on Information Systems (1997), 563-565.
36. Gallupe, R.B.; Dennis, A.R.; Cooper, W.H.; Valacich, J.S.; Bastianutti, L.M.; and Nunamaker, J.F. Electronic brainstorming and group size. Academy of Management Journal, 35, 2 (1992), 350-369.
37. Gallupe, R.B.; DeSanctis, G.; and Dickson, G.W. Computer-based support for group problem-finding: an experimental investigation. MIS Quarterly (June 1988), 277-296.
38. Gray, P.; Vogel, D.; and Beauclair, R. Assessing GDSS empirical research. European Journal of Operational Research, 46 (1990), 162-178.
39. Griffith, T.L., and Northcraft, G.B. Distinguish between die forest and trees: media, features, and methodology in electronic communication research. Organizational Science, 5, 2 (1994), 272-285.
40. Hare, A.P. Handbook of Small Group Research. New York: Free Press, 1st ed., 1962, rev. ed., 1976.
41. Hightower, R., and Sayeed, L. The impact of computer-mediated communication systems on biased group discussion. Computers in Human Behavior, 11, 1 (1995), 33-44.
42. Hiltz, S.R.; Dufner, D.K.; Holmes, M.E.; and Poole, S.M. Distributed group support systems: social dynamics and design dilemmas. Journal of Organizational Computing, 2, 1 (1991), 135-159.
43. Hiltz, S.R., and Turoff, M. Virtual meetings: computer conferencing and distributed group support. In R.P. Bostrom, R.T. Watson, and S.T. Kinney (eds.), Computer Augmented Teamwork: A Guided Tour. New York: Van Nostrand Reinhold, 1992.
44. Hollingshead, A.B., and McGrath, J.E. Computer-assisted groups: a critical review of the empirical research. In R.A. Guzzo, E. Salas, and Associates (eds.), Team Effectiveness and Decision Making in Organizations. San Francisco: Jossey-Bass, 1995.
45. Hollingshead, A.B.; McGrath, J.E.; and O'Connor, K.M. Group task performance and communication technology: a longitudinal study of computer-mediated versus face-to-face groups. Small Group Research, 24, 3 (1993), 307-333.
46. Hwang, H.G., and Guynes, J. The effects of group size on group performance in computer-mediated decision making. Information & Management, 26 (1994), 189-198.
47. Jelassi, M.T., and Beauclair, R.A. An integrated framework for group decision support system design. Information & Management, 13 (1987), 143-155.
48. Jessup, L.M.; Connolly, T.; and Galegher, J. The effects of anonymity on GDSS group process with an idea-generating task. MIS Quarterly (September 1990), 313-321.
49. Jessup, L.M.; Egbert, J.L; and Connolly, T. Understanding computer-supported group work: the effects of interaction frequency on group process and outcome. Journal of Research on Computing in Education, 28, 2 (1996), 190-208.
50. Jessup, L.M., and Tansik, D.A. Decision making in an automated environment: the effects of anonymity and proximity with a group decision support system. Decision Sciences, 22 (1991), 266-279.
51. Johansen, R. Computer Support for Business Teams. New York: Free Press, 1988.
52. Johansen, R. Leading Business Teams. Reading, MA: Addison-Wesley, 1991.
53. Kiesler, S.; Zubrow, D.; Moses, A.M.; and Geller, V. Affect in computer-mediated communications: an experiment in synchronous terminal-to-terminal discussion. Human Computer Interaction, 1 (1985), 77-104.
54. Lewe, H. Computer support and facilitated structure in meetings - an empirical comparison of their impact. Proceedings of the Twenty-Ninth Annual Hawaii International Conference on System Sciences, 3 (1996), 24-33.
55. McGrath, J.E. Groups: Interaction and Performance. Englewood Cliffs, NJ: Prentice-Hall, 1984.
56. McGrath, J.E., and Hollingshead, A.B. Groups Interacting with Technology. Thousand Oaks, CA: Sage Publications, 1994.
57. McLeod, P. An assessment of the experimental literature on the electronic support of group work: results of a meta-analysis. Human Computer Interaction, 7, 3 (1992), 257-280.
58. McLeod, P.L. A comprehensive model of anonymity in computer-supported group decision-making. Proceedings of the Eighteenth Annual International Conference on Information Systems (1997), 223-234.
59. McLeod, P.L., and Elston, S.E. Persuasive linguistic devices in anonymous versus identified computer supported groups: an exploratory study. Proceedings of the Twenty-Eighth Hawaii International Conference on System Sciences, 4 (1995), 163-170.
60. Mejias, R.; Shephard, M.M.; Vogel, D.R.; and Lazaneo, L. Consensus and perceived satisfaction levels: GSS and non-GSS outcomes within and between the United States and Mexico. Journal of Management Information Systems, 13, 3 (1997) 137-161.
61. Mejias, R.J.; Vogel, D.R.; and Shepherd, M.M. GSS meeting productivity and participation equity: a U.S. and Mexico cross-cultural field study. Proceedings of the Thirtieth Hawaii International Conference on System Sciences, 2 (1997), 469-478.
62. Nunamaker, J.F. Future research in group support systems: needs, some questions and possible directions. International Journal of Human-Computer Studies, 47 (1997), 357-385.
63. Nunamaker, J.F.; Dennis, A.R.; George, J.F.; Martz, W.B.; Valacich, J S.; and Vogel, D.R. GroupSystems. In R.P. Bostrom, R.T. Watson, and S.T. Kinney (eds.), Computer Augmented Teamwork: A Guided Tour. New York: Van Nostrand Reinhold, 1992.
64. Nunamaker, J.F.; Dennis, A.R.; Valaccich, J.S.; and Vogel, D.R. Information technology for negotiating groups: generating options for mutual gain. Management Science, 37, 10 (1991), 1325-1346.
65. Nunamaker, J.F.; Dennis, A.R.; Valacich, J.S.; Vogel, D.R.; and George, J.F. Electronic meeting systems to support group work. Communications of the ACM, 34, 7 (1991), 41-61.
66. Ocker, R.; Fjermestad, J.; Hiltz, S.R.; and Johnson, K. Effects of four modes of group communication on the outcomes of software requirements determination. Journal of Management Information Systems, 15, 1 (1998), 99-118.
67. Ocker, R.; Hiltz, S.R.; Turoff, M.; and Fjermestad, J. The effects of distributed group support and process structuring on requirements development teams: results on creativity and quality. Journal of Management Information Systems, 12, 3 (1996), 127-153.
68. Osborn, A.F. Applied Imagination, rev. ed. New York: Scribner's, 1957.
69. Pinsonneault, A., and Kraemer, K.L. The effects of electronic meetings on group processes and outcomes: an assessment of the empirical research. European Journal of Operational Research. 46 (1990), 143-161.
70. Poole, M.S., and DeSanctis, G. Understanding the use of group decision support systems: the theory of adaptive structuration. In C. Steinfield and J. Fulk (eds.), Organizations and Communication Technology. Beverly Hills: Sage Publications, 1990.
71. Poole, M.S., and DeSanctis, G. Use of group decision support systems as an appropriation process. Proceedings of the Twenty-First Annual Hawaii International Conference on System Sciences, 2 (1989), 149-157.
72. Poole, M.S.; Siebold, D.R.; and McPhee, R.D. Group decision-making as a structurational process. Quarterly Journal of Speech, 71 (1985), 74-102.
73. Post, B.Q. A business case framework for group support technology. Journal of Management Information Systems, 9, 3 (1993), 7-26.
74. Remus, W. Using students as subjects in experiments on decision support systems. Proceedings of the Twenty-Second Hawaii International Conference on System Sciences, 4 (1989), 176-180.
75. Sambamurthy, V., and DeSanctis, G. An experimental evaluation of GDSS effects on group performance during stakeholder analysis. Proceedings of the Twenty-Third Annual Hawaii International Conference on Systems Science, 3 (1989), 79-88.
76. Sia, C.; Tan, B.C.Y.; and Wei, K.K. Exploring the effects of some display and task factors on GSS user groups. Information & Management, 30 (1996), 35-41.
77. Shaw, M.E. Group Dynamics: The Psychology of Small Group Behavior. New York: McGraw-Hill, 1971, 1976.
78. Short, J.; Williams, E.; and Christie, B. The Social Psychology of Telecommunications. London: John Wiley & Sons, 1976.
79. Simmel, G. Soziologie. Untersuchungen über die Formen der Vergesell Schaftung. Leipzig: Duncker and Humblot, 1892, 1907.
80. Simmel, G. The Sociology of Georg Simmel, trans. and ed. by K.H. Wolff. New York: Free Press, 1950.
81. Steiner, I.D. Group Process and Productivity. New York: Academic Press, 1972.
82. Tan, B.C.Y.; Raman, K.S.; and Wei, K.K. An empirical study of task dimension of group support systems. IEEE Transactions on Systems, Man, and Cybernetics, 24, 7 (1994), 1054-1060.
83. Tan, B.C.Y.; Wei, K.K.; and Watson, R.T. Dampening status influence using a group support system: an empirical study. Transactions of the Thirteenth International Conference on Decision Support Systems (1993), 77-89.
84. Tung, L.L., and Heminger, A.R. The effects of dialectical inquiry, devil's advocacy, and consensus inquiry methods in a GSS environment. Information & Management, 25 (1993), 33-41.
85. Turoff, M., and Hiltz, S.R. Computer support for group versus individual decisions. IEEE Transactions on Communications COM-20, 1 (1982), 82-91.
86. Valacich, J.S.; Dennis, A.R.; and Connolly, T. Idea generation in computer-based groups: a new ending to an old story. Organizational Behavior and Human Decision Processes, 57 (1994), 488-467.
87. Valacich, J.S.; Dennis, A.R.; and Nunamaker, J.F. Anonymity and group size effects in an electronic meeting systems environment. Small Group Research, 23, 1 (1992), 49-73.
88. Valacich, J.S.; Dennis, A.R.; and Nunamaker, J.F. A conceptual framework of anonymity in group support systems. Group Decision & Negotiation, 1, 3 (1992), 219-241.
89. Valacich, J.S.; George, J.F.; Nunamaker, J.F.; and Vogel, D.R. Physical proximity effects on computer-mediated group idea generation. Small Group Research, 25, 1 (1994), 83-104.
90. Valacich, J.S., and Schwenk, C. Devil's advocacy and dialectical inquiry effects on group decision making using computer-mediated versus verbal communication. Organizational Behavior and Human Decision Processes, 63, 2 (1995), 158-173.
91. Valacich, J.S.; Wheeler, B.C.; Mennecke, B.E.; and Wachter, R. The effects of numerical and logical group size on computer-mediated idea generation. Organizational Behavior and Human Decision Processes, 62, 3 (1995), 318-329.
92. Van de Ven, A.H., and Delbecq, A.L. Nominal versus interacting group processes for committee decision-making effectiveness. Academy of Management Journal, 14, 2 (1971), 203-212.
93. Watson, R.T.; Ho, T.H.; and Raman, K.S. Culture: a fourth dimension of group support systems. Communications of the ACM, 37, 10 (1994), 44-55.
94. Wheeler, B.C., and Valacich, J.S. Facilitation, GSS, and training as sources of process restrictiveness and guidance for structured decision making an empirical assessment. Information Systems Research, 7, 4 (1996), 429-450.
95. Wilson, J., and Jessup, L.M. A field experiment on GSS anonymity and group member status. Proceedings of the Twenty-Eighth Hawaii International Conference on System Sciences, 4 (1995), 212-221.
96. Winniford, M. Issues in automated voting. Proceedings of the Twenty-Fourth Hawaii International Conference on System Sciences, 4 (1991), 621-630.
97. Wood, J.G., and Nosek, J.T. Discrimination of structure and technology in a group support system: the role of process complexity. Proceedings of the International Conference on Information Systems, 3 (1994), 187-199.
98. Zigurs, I., and Kozar, K.A. An exploratory study of roles in computer-supported groups. MIS Quarterly, 18, 3 (1994), 277-297.