Assessing the incremental validity of team consensus ratings over aggregation of individual-level data in predicting team effectiveness

Personnel Psychology

Volumn 54, Issue 3, 2001, Pages 645-667

  Kirkman, Bradley L ^a   Tesluk, Paul E ^c   Rosen, Benson ^b  

^a UNIVERSITY OF NORTH CAROLINA AT GREENSBORO   (United States)

^b UNIVERSITY OF NORTH CAROLINA   (United States)

^c Univ of N Carolina at Greensboro ^*

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0035457754     PISSN: 00315826     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2001.tb00226.x     Document Type: Article

References (94)

1. Alper S, Tjosvold A, Law KS. (2000). Conflict management, efficacy, and performance in organizational teams. PERSONNEL PSYCHOLOGY, 53, 625-642.
2. Anderson CM, Martin MM. (1999). The relationship of argumentativeness and verbal aggressiveness to cohesion, consensus, and satisfaction in small groups. Communication Reports, 12, 21-31.
3. Bandura A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
4. Bandura A, Cervone D. (1986). Differential engagement of self-reactive influences in cognitive motivation. Organizational Behavior and Human Decision Processes, 38, 92-113.
5. Barrick MR, Stewart GL, Neubert MJ, Mount MK. (1998). Relating member ability and personality to work-team processes and team effectiveness. Journal of Applied Psychology, 55, 377-391.
6. Bar-Tal D. (1990). Group beliefs. New York: Springer-Verlag.
7. Bartel CA, Saavedra R. (2000). The collective construction of work group moods. Administrative Science Quarterly, 45, 197-231.
8. Bateman TS, Crant JM. (1993). The proactive component of organizational behavior: A measure and correlates. Journal of Organizational Behavior, 14, 103-118.
9. Bettenhausen KL. (1991). Five years of groups research: What have we learned and what needs to be addressed. Journal of Management, 17, 345-381.
10. Bliese PD. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In Klein KJ, Kozlowski SWJ (Eds.), Multilevel theory, research, and methods in organizations (pp. 349-381). San Francisco: Jossey-Bass.
11. Brannick MT, Roach RM, Salas E. (1993). Understanding team performance: A multimethod study. Human Performance, 6, 287-308.
12. Burke MJ, Finkelstein LM, Dusig MS. (1999). On average deviation indexes for estimating interrater agreement. Organizational Research Methods, 2, 49-68.
13. Campion MA, Medsker GJ, Higgs AC. (1993). Relations between work group characteristics and effectiveness: Implications for designing effective work groups. PERSONNEL PSYCHOLOGY, 46, 823-850.
14. Campion MA, Papper EM, Medsker GJ. (1996). Relations between work team characteristics and effectiveness: A replication and extension. PERSONNEL PSYCHOLOGY, 49, 429-452.
15. Cervone D, Jiwani N, Wood R. (1991). Goal setting and the differential influence of self-regulatory processes on complex decision-making performance. Journal of Personality and Social Psychology, 61, 257-266.
16. Chan D. (1998a). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246.
17. Chan D. (1998b). The conceptualization and analysis of change over time: An integrative approach incorporating longitudinal mean and covariance structures analysis (LMACS) and multiple indicator latent growth modeling (MLGM). Organizational Research Methods, 1, 421-483.
18. Chaney L, Lyden J. (2000). Making U.S. teams work. Supervision, 61, 6-8.
19. Cohen SG, Ledford GE Jr. (1994). The effectiveness of self-managing teams: A quasi-experiment. Human Relations, 47, 13-43.
20. Cohen SG, Ledford GE Jr, Spreitzer GM. (1996). A predictive model of self-managing work team effectiveness. Human Relations, 49, 643-676.
21. Collins EG, Guetzkow H. (1964). A social psychology of group processes for decision-making. New York: Wiley.
22. Dansereau F, Alutto JA, Yammarino FJ. (1984). Theory testing in organizational behavior: The variant approach. Englewood Cliffs, NJ: Prentice-Hall.
23. DeSanctis G, Gallupe RB. (1987). A foundation for the study of group decision support systems. Management Science, 33, 589-609.
24. Devine DJ, Clayton LD, Philips JL, Dunford BB, Melner SB. (1999). Teams in organizations: Prevalence, characteristics, and effectiveness. Small Group Research, 30, 678-711.
25. Earley PC. (1999). Playing follow the leader: Status-determining traits in relation to collective efficacy across cultures. Organizational Behavior and Human Decision Processes, 80, 192-212.
26. Erffmeyer RC, Lane IM. (1984). Quality and acceptance of an evaluative task: The effects of four decision-making formats. Group and Organization Studies, 9, 509-529.
27. Feltz DL, Lirgg CD. (1998). Perceived team and player efficacy in hockey. Journal of Applied Psychology, 83, 557-564.
28. Fleenor JW, Fleenor JB, Grossnickle WF. (1996). Interrater reliability and agreement of performance ratings: A methodological comparison. Journal of Business and Psychology, 10, 367-380.
29. Gallupe RB, Bastianutti L, Cooper WH. (1991). Unblocking brainstorms. Journal of Applied Psychology, 76, 137-142.
30. Gallupe RB, Dennis AR, Cooper WH, Valacich JS, Bastianutti LM, Nunamaker JF Jr. (1993). Electronic brainstorming and group size. Academy of Management Journal, 35, 350-369.
31. Ganzach Y, Kluger AN, Klayman N. (2000). Making decisions from an interview: Expert measurement and mechanical combination. PERSONNEL PSYCHOLOGY, 53, 1-20.
32. George JM, James LR. (1993). Personality, affect, and behavior in groups revisited: Comment on aggregation, levels of analysis, and a recent application of within and between analysis. Journal of Applied Psychology, 78, 798-804.
33. George JM, James LR. (1994). Levels issues in theory development. Academy of Management Review, 19, 636-640.
34. Gerstner CR. (1998). Leadership relationships and work group effectiveness: A multilevel empirical examination. Unpublished doctoral dissertation, The Pennsylvania State University, University Park
35. Gibson CB. (1999). Do they do what they believe they can? Group efficacy and group effectiveness across tasks and cultures. Academy of Management Journal, 42, 138-152.
36. Gibson CB, Randel AE, Earley AE. (2000). Understanding group efficacy: An empirical test of multiple assessment methods. Group and Organization Management 25, 67-97.
37. Gist ME. (1987). Self-efficacy: Implications for organizational behavior and human resource management. Academy of Management Review, 12, 472-485.
38. Gladstein D. (1984). Groups in context: A model of task group effectiveness. Administrative Science Quarterly, 29, 499-517.
39. Golembieski RT, Billingsely K, Yeager S. (1976). Measuring change and persistence in human affairs: Types of change generated by OD designs. Journal of Applied Behavioral Science, 12, 133-157.
40. Goodman PS, Ravlin EC, Schminke M. (1987). Understanding groups in organizations. In Staw B, Cummings L (Eds.), Research in organizational behavior (Vol. 9, pp. 121-173). Greenwich, CT: JAI Press.
41. Guzzo RA, Yost PR, Campbell RJ, Shea GP. (1993). Potency in groups: Articulating a construct. British Journal of Social Psychology, 32, 87-106.
42. Hackman JR, Oldham GR. (1980). Work redesign. Reading, MA: Addison-Wesley.
43. Hall J, Williams MS. (1970). Group dynamics training and improved decision making. Journal of Applied Behavioral Science, 6, 27-32.
44. Hinsz VB, Tindale RS, Vollrath DA. (1997). The emerging conceptualization of groups as information processors. Psychological Bulletin, 121, 43-64.
45. Hofmann DA, Stetzer A. (1996). A cross-level investigation of factors influencing unsafe behaviors and accidents. PERSONNEL PSYCHOLOGY, 49, 307-339.
46. Hollingshead AB, McGrath JE, O'Connor KM. (1993). Group task performance and communication technology. Small Group Research, 24, 307-333.
47. Hulin CL, Rousseau DM. (1980). Analyzing infrequent events: Once you find them your troubles begin. In Roberts RH, Burstein L (Eds.), Issues in aggregation: New directions for methodology of social and behavioral science (Vol. 6). San Francisco: Jossey-Bass.
48. Hyatt DE, Ruddy TM. (1997). An examination of the relationship between work group characteristics and performance: Once more into the breech. PERSONNEL PSYCHOLOGY, 50, 553-585.
49. Isenherg DJ. (1986). Group polarization: A critical review and meta-analysis. Journal of Personality and Social Psychology, 50, 1141-1151.
50. James LR. (1982). Aggregation bias in estimates of perceptual agreement. Journal of Applied Psychology, 67, 219-229.
51. James LR, Demaree RG, Wolf G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98.
52. wg: An assessment of within-group interrater agreement. Journal of Applied Psychology, 78, 306-309.
53. Janis IL. (1982). Victims of groupthink, 2nd ed. Boston: Houghton-Mifflin.
54. Jarobe S. (1996). Procedures for enhancing group decision making. In Hirokawa RY, Poole MS (Eds.), Communication and group decision making (pp. 345-383). Thousand Oaks, CA: Sage.
55. Kiesler CA, Kiesler SB. (1969). Conformity. Reading, MA: Addison-Wesley.
56. Kirchler EA, Davis JH. (1986). The influence of member status differences and task type on group consensus and member position change. Journal of Personality and Social Psychology, 51, 83-91.
57. Kirkman BL, Rosen B. (1997). A model of work team empowerment. In Woodman RW, Pasmore WA (Eds.), Research in organizational change and development (Vol. 10, pp. 131-167). Greenwich, CT: JAI Press.
58. Kirkman BL, Rosen B. (1999). Beyond self-management: The antecedents and consequences of team empowerment. Academy of Management Journal, 42, 59-75.
59. Kirkman BL, Rosen B. (2000). Powering up teams. Organizational Dynamics 28, 48-66.
60. Klein KJ, Conn AL, Smith DB, Sorra JS. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. Journal of Applied Psychology, 86, 3-16.
61. Klein KJ, Dansereau F, Hall RJ. (1994). Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19, 195-229
62. Kozlowski SWJ, Hattrup K. (1992). A disagreement about within-group agreement: Disentangling issues of consistency versus consensus. Journal of Applied Psychology, 77, 161-167.
63. Lam SK Schaubroeck J. (2000). Improving group decisions by better pooling information: A comparative advantage of group decision support systems. Journal of Applied Psychology, 85, 565-573.
64. Lindell MK, Brandt CJ. (1997). Measuring interrater agreement for ratings of a single target. Applied Psychological Measurement, 21, 271-278.
65. Lindsley DH, Brass DJ, Thomas JB. (1995). Efficacy-performance spirals: A multilevel perspective. Academy of Management Review, 20, 645-678.
66. Mathieu JE. (1991). A cross-level nonrecursive model of the antecedents of organizational commitment and satisfaction. Journal of Applied Psychology, 76, 607-618.
67. McLeod PL. (1996). New communication technologies for group decision making: Toward in integrate framework. In Hirokawa RY, Poole MS (Eds.), Communication and group decision making (pp. 426-461). Thousand Oaks, CA: Sage.
68. Michaelson LK, Watson WE, Black RH. (1989). A realistic test of individual versus group consensus decision making. Journal of Applied Psychology, 74, 834-839.
69. Moorman RH, Blakely GL. (1995). Individualism - collectivism as an individual difference predictor or organizational citizenship behavior. Journal of Organizational Behavior, 16, 127-142.
70. Myers DG, Lamm H. (1976). The group polarization phenonmenon. Psychological Bulletin, 83, 602-627.
71. Nemeroff PM, King DC. (1975). Group decision-making performance as influenced by consensus and self-orientation. Human Relations, 28, 1-21.
72. Nemeroff PM, Pasmore WA, Ford DL. (1976). The effects of two normative structural interventions on established and ad hoc groups: Implications for improving decision-making effectiveness. Decision Sciences, 7, 841-855.
73. Ostroff C. (1993) Comparing correlations based on individual-level and aggregated data. Journal of Applied Psychology, 78, 569-582.
74. Pynes J, Bernardin HJ. (1992). Mechanical versus consensus-derived assessment center ratings: A comparison of job performance validities. Public Personnel Management, 21, 17-28.
75. Roberts KH, Hulin CL, Rousseau DM. (1978). Developing an interdisciplinary science of organizations. San Francisco: Jossey-Bass
76. Robinson SL, O'Leary-Kelly AM. (1998). Monkey see, monkey do: The influence of work groups on the antisocial behavior of employees. Academy of Management Journal, 41, 658-672.
77. Rousseau DM. (1985). Issues of level in organizational research: Multilevel and cross-level perspectives. In Cummings LL, Staw B (Eds.), Research in organizational behavior (Vol. 7, pp. 1-38). Greenwich, CT: JAI Press.
78. Salancik GR, Pfeffer J. (1978). A social information processing approach to job attitudes and task design. Administrative Science Quarterly, 23, 224-253.
79. Shea GP. Guzzo RA. (1987). Groups as human resources. In Ferris G, Rowland K (Eds.), Research in personnel and human resources management (Vol. 5, pp. 323-356). Greenwich, CT: JAI Press.
80. Sirotnik KA. (1980). Psychometric implications of the unit of analysis problem (with examples from the measurement of organizational climate). Journal of Educational Measurement, 17, 245-282.
81. Spreitzer GM. (1995). Psychological empowerment in the workplace: Dimensions, measurement, and validation. Academy of Management Journal, 38, 1442-1465.
82. Spychalski AC, Quinones MA, Gaugler BB, Pohley K. (1997). A survey of assessment center practices in organizations in the United States. PERSONNEL PSYCHOLOGY, 50, 71-90.
83. Stewart GL, Barrick MR. (2000). Team structure and performance: Assessing the mediating role of intrateam process and the moderating role of task type. Academy of Management Journal, 43, 135-148.
84. Susskind L, McKearnan S, Thomas-Larmer J. (1999). The consensus building handbook: A comprehensive guide to reaching agreement. Thousand Oaks, CA: Sage.
85. Tesluk PE, Mathieu JE. (1999). Overcoming road blocks to effectiveness: Incorporating management of performance barriers into models of work group effectiveness. Journal of Applied Psychology, 84, 200-217.
86. Tesluk P, Zaccaro SJ, Marks M, Mathieu J. (1997). Task and aggregation issues in the analysis and assessment of team performance. In Brannick M, Salas E (Eds.), Assessment and measurement of team performance: Theory, research, and applications (pp. 197-224). Greenwich, CT: JAI Press.
87. Thomas KW, Tymon WG Jr. (1993). Empowerment inventory. Tuxedo, NY: Xicom.
88. Townsend AM, DeMarie SM, Hendrickson AR. (1998). Virtual teams: Technology and the workplace of the future. Academy of Management Executive, 12, 17-29.
89. Van der Vegt GS, Emans BJM, Van de Vliert E. (2001). Patterns of interdependence in work teams: A two-level investigation of the relations with job and team satisfaction. PERSONNEL PSYCHOLOGY, 54, 51-69.
90. Van de Ven AH, Ferry DL. (1980). Measuring and assessing organizations. New York: Wiley.
91. Watson WE, Michaelson LK, Sharp W. (1991). Member competence, group interaction, and group decision making: A longitudinal study. Journal of Applied Psychology, 76, 803-809.
92. Yammarino FJ, Markham SE. (1992). On the application of within and between analysis: Are absence and affect really group-based phenomena? Journal of Applied Psychology, 77, 168-176.
93. Zander AW, Medow H. (1963). Individual and group aspiration. Human Relations, 16, 89-105.
94. Zalesny MD, Ford JK. (1990). Extending the social information processing perspective: New links to attitudes, behaviors, and perceptions. Organizational Behavior and Human Decision Processes, 47, 205-246.