The Team Role Test: Development and Validation of a Team Role Knowledge Situational Judgment Test

Journal of Applied Psychology

Volumn 93, Issue 2, 2008, Pages 250-267

  Mumford, Troy V ^a   Van Iddekinge, Chad H ^b   Morgeson, Frederick P ^c   Campion, Michael A ^d  

^a UTAH STATE UNIVERSITY   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

^c MICHIGAN STATE UNIVERSITY   (United States)

^d PURDUE UNIVERSITY   (United States)

Author keywords

group processes; group roles; situational judgment test; team leadership

Indexed keywords

ADULT; ARTICLE; COOPERATION; DECISION MAKING; FEMALE; HUMAN; LEADERSHIP; MALE; PSYCHOLOGIC TEST; SOCIAL ENVIRONMENT; VALIDATION STUDY;

ADULT; COOPERATIVE BEHAVIOR; FEMALE; HUMANS; JUDGMENT; LEADERSHIP; MALE; PSYCHOLOGICAL TESTS; SOCIAL ENVIRONMENT;

EID: 41549140004     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.93.2.250     Document Type: Article

References (108)

1. Ancona D.G. Outward bound: Strategies for team survival in an organization. Academy of Management Journal 33 (1990) 334-365
2. Ancona D.G., and Caldwell D.F. Beyond task and maintenance: Defining external functions in groups. Group and Organization Studies 13 (1988) 468-494
3. Ancona D.G., and Caldwell D.F. Bridging the boundary: External activity and performance in organizational teams. Administrative Science Quarterly 37 (1992) 634-665
4. Arthur, W., Jr., & Villado, A. J. (in press). The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. Journal of Applied Psychology
5. Bales R.F. Interaction process analysis: A method for the study of small groups (1950), Addison-Wesley, Cambridge, MA
6. Bales R.F., and Slater P.E. Role differentiation in small decision-making groups. In: Parsons T., and Bales R.F. (Eds). Family, socialization, and interaction process issues (1955), Free Press, Glencoe, IL 259-306
7. Barker J.R. The discipline of teamwork: Participation and concertive control (1999), Sage, Thousand Oaks, CA
8. Barrick M.R., and Mount M.K. Autonomy as a moderator of the relationships between the Big Five personality dimensions and job performance. Journal of Applied Psychology 78 (1993) 111-118
9. Barrick M.R., Stewart G.L., Neubert M.J., and Mount M.K. Relating member ability and personality to work-team processes and team effectiveness. Journal of Applied Psychology 83 (1998) 377-391
10. Barry B., and Stewart G.L. Composition, process, and performance in self-managed groups: The role of personality. Journal of Applied Psychology 82 (1997) 62-78
11. Barry D. Managing the bossless team: Lessons in distributed leadership. Organizational Dynamics 20 (1991) 31-47
12. Bauer T.N., and Truxillo D.M. Applicant reactions to situational judgment tests: Research and related practical issues. In: Weekley J.A., and Ployhart R.E. (Eds). Situational judgment tests: Theory, measurement, and application (2006), Erlbaum, Mahwah, NJ 233-251
13. Belbin R.M. Management teams: Why they succeed or fail (1981), Butterworth-Heinemann, Oxford, England
14. Belbin R.M. Team roles at work (1993), Butterworth-Heinemann, Oxford, England
15. Belbin R.M., Aston B.R., and Mottram R.D. Building effective management teams. Journal of General Management 3 (1976) 23-29
16. Benne K.D., and Sheats P. Functional roles of group members. Journal of Social Issues 4 (1948) 41-49
17. Bettenhausen K., and Murnighan J.K. The emergence of norms in competitive decision-making groups. Administrative Science Quarterly 30 (1985) 350-372
18. Bliese P.D. Group size, ICC values, and group-level correlations: A simulation. Organizational Research Methods 1 (1998) 355-373
19. Borman W.C., White L.A., Pulakos E.D., and Oppler S.H. Models evaluating the effects of ratee ability, knowledge, proficiency, temperament, awards, and problem behavior on supervisory ratings. Journal of Applied Psychology 76 (1991) 863-872
20. Bridges W. JobShift (1994), Addison-Wesley, Reading, MA
21. Cameron N. Role concepts in behavior pathology. American Journal of Sociology 55 (1950) 464-467
22. Campbell J.P. Modeling the performance prediction problem in industrial organizational psychology. In: Dunnette M.D., and Hough L.M. (Eds). Handbook of industrial and organizational psychology. 2nd ed. 1 (1990), Consulting Psychologists Press, Palo Alto, CA 687-732
23. Campbell J.P., McCloy R.A., Oppler S.H., and Sager C.E. A theory of performance. In: Schmitt N., and Borman W.C. (Eds). Personnel selection in organizations (1993), Jossey-Bass, San Francisco 35-70
24. Cohen S.G., Ledford Jr. G.E., and Spreitzer G.M. A predictive model of self-managing work team effectiveness. Human Relations 49 (1996) 643-676
25. Devine D.J., Clayton L.D., Philips J.L., Dunford B.B., and Melner S.B. Teams in organizations: Prevalence, characteristics, and effectiveness. Small Group Research 30 (1999) 678-711
26. Downing S.M., and Haladyna T.M. Handbook of test development (2006), Erlbaum, Mahwah, NJ
27. DuBrin A.J. The breakthrough team player (1995), American Management Association, New York
28. Dudley N.M., Orvis K.A., Lebiecki J.A., and Cortina J.M. A meta-analytic investigation of conscientiousness in the prediction of job performance: Examining the intercorrelations and the incremental validity of narrow traits. Journal of Applied Psychology 91 (2006) 40-57
29. Dye D.A., Reck M., and McDaniel M.A. The validity of job knowledge measures. International Journal of Selection and Assessment 1 (1993) 153-157
30. Gersick C.J. Time and transition in work teams: Toward a new model of group development. Academy of Management Journal 31 (1988) 9-41
31. Gersick C.J. Marking time: Predictable transitions in task groups. Academy of Management Journal 32 (1989) 274-309
32. Gersick C.J., and Hackman J.R. Habitual routines in task-performing groups. Organizational Behavior and Human Decision Processes 47 (1990) 65-97
33. Ginnett R.C. Airline cockpit crew. In: Hackman J.R. (Ed). Groups that work (and those that don't): Creating conditions for effective teamwork (1990), Jossey-Bass, San Francisco 427-448
34. Gladstein D.L. Groups in context: A model of task group effectiveness. Administrative Science Quarterly 29 (1984) 499-517
35. Goldberg L.R. International personality item pool: A scientific collaboratory for the development of advanced measures of personality and other individual differences (1999). http://ipip.ori.org/ipip/ Retrieved from http://ipip.ori.org/ipip/
36. Goldberg L.R., Johnson J.A., Eber H.W., Hogan R., Ashton M.C., Cloninger C.R., and Gough H.G. The international personality item pool and the future of public- domain personality measures. Journal of Research in Personality 40 (2006) 84-96
37. Grandori A. An organizational assessment of interfirm coordination modes. Organization Studies 18 (1997) 897-925
38. Green S., McComb S.A., and Compton D. Promoting effective linkages between cross-functional teams and the organization. In: Fedor D., and Ghosh S. (Eds). Advances in the management of organizational quality 5 (2000), JAI, Greenwich, CT 29-70
39. Guzzo R.A., and Dickson M.W. Teams in organizations: Recent research on performance and effectiveness. Annual Review of Psychology 47 (1996) 307-338
40. Hackman J.R. The design of work teams. In: Lorsch J.W. (Ed). Handbook of organizational behavior (1987), Prentice-Hall, Englewood Cliffs, NJ 315-342
41. Hackman J.R. Groups that work (and those that don't): Creating conditions for effective teamwork (1990), Jossey-Bass, San Francisco
42. Hackman J.R., and Morris C.G. Group tasks, group interaction process, and group performance effectiveness: A review and proposed integration. In: Berkowitz L. (Ed). Advances in experimental social psychology (1975), Academic Press, New York 45-99
43. Hackman J.R., and Walton R.E. Leading groups in organizations. In: Goodman P.S. (Ed). Designing effective work groups (1986), Jossey-Bass, San Francisco 88-105
44. Hare A.P., and Blumberg H.H. Dramaturgical analysis of social interaction (1988), Praeger, New York
45. Herold D.M. Improving the performance effectiveness of groups through a task-contingent selection of intervention strategies. Academy of Management Review 3 (1978) 315-325
46. Herold D.M. The effectiveness of work groups. In: Kerr S. (Ed). Organizational behavior (1980), Grid, Columbus, OH 95-118
47. Hough L.M., Oswald F.L., and Ployhart R.E. Determinants, detection, and amelioration of adverse impact in personnel selection procedures: Issues, evidence, and lessons learned. International Journal of Selection and Assessment 9 (2001) 152-194
48. Hunter J.E. A causal analysis of cognitive ability, job knowledge, job performance, and supervisory ratings. In: Landy F., Zedeck S., and Cleveland J. (Eds). Performance measurement and theory (1983), Erlbaum, Hillsdale, NJ 257-266
49. Hunter J.E., Schmidt F.L., and Le H. Implications for direct and indirect range restriction for meta-analysis methods and findings. Journal of Applied Psychology 91 (2006) 594-612
50. Ilgen D.R., and Pulakos E.D. The changing nature of work performance: Implications for staffing, motivation, and development (1999), Jossey-Bass, San Francisco
51. Jackson S.E., May K.E., and Whitney K. Understanding the dynamics of diversity in decision-making teams. In: Guzzo R.A., and Salas E. (Eds). Team effectiveness and decision making in organizations (1995), Jossey-Bass, San Francisco 204-261
52. James L.R., Demaree R.G., and Wolf G. Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology 69 (1984) 85-98
53. Janis I.L. Victims of groupthink: A psychological study of foreign-policy decisions and fiascos (1972), Houghton Mifflin, Boston
54. Janz B.D., Colquitt J.A., and Noe R.A. Knowledge worker team effectiveness: The role of autonomy, interdependence, team development, and contextual support variables. Personnel Psychology 50 (1997) 877-904
55. Jehn K.A. A multimethod examination of the benefits and detriments of intragroup conflict. Administrative Science Quarterly 40 (1995) 256-282
56. Jehn K.A. A qualitative analysis of conflict types and dimensions in organizational groups. Administrative Science Quarterly 42 (1997) 530-557
57. Katz D., and Kahn R.L. The social psychology of organizations. 2nd ed. (1978), Wiley, New York
58. Klimoski R., and Jones R.G. Staffing for effective group decision making: Key issues in matching people and teams. In: Guzzo R.A., and Salas E. (Eds). Team effectiveness and decision making in organizations (1995), Jossey-Bass, San Francisco 291-332
59. Kozlowski S.W.J., Gully S.M., Salas E., and Cannon-Bowers J.A. Team leadership and development: Theory, principles, and guidelines for training leaders and teams. In: Beyerlein M., Johnson D.A., and Beyerlein S.T. (Eds). Advances in interdisciplinary studies of work teams 3 (1996), JAI, Greenwich, CT 253-291
60. Larson C.E., and LaFasto F.M.J. Teamwork: What must go right/what can go wrong (1989), Sage, Newbury Park, CA
61. Lawler E.E. From job-based to competency-based organizations. Journal of Organizational Behavior 15 (1994) 3-15
62. Lawler E.E., Morhrman S.A., and Ledford G.E. Employee involvement and total quality management: Practices and results in Fortune 1000 companies (1992), Jossey-Bass, San Francisco
63. Lawrence P.R., and Lorsch J.W. Organization and environment: Managing differentiation and integration (1969), Irwin, Homewood, IL
64. LeBreton J.M., Burgess J.R.D., Kaiser R.B., Atchley E.K., and James L.R. The restriction of variance hypothesis and interrater reliability and agreement: Are ratings from multiple sources really dissimilar?. Organizational Research Methods 6 (2003) 80-128
65. Libby R., Trotman K.T., and Zimmer I. Member variation, recognition of expertise, and group performance. Journal of Applied Psychology 72 (1987) 81-87
66. Lievens F., and Coetsier P. Situational tests in student selection: An examination of predictive validity, adverse impact, and construct validity. International Journal of Selection and Assessment 10 (2002) 245-257
67. Lievens F., and Sackett P.R. Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of Applied Psychology 91 (2006) 1181-1188
68. Longley J., and Pruitt D.G. Groupthink: A critique of Janis' theory. In: Wheeler L. (Ed). Review of personality and social psychology 1 (1980), Sage, Beverly Hills, CA 74-93
69. McCann D., and Margerison C. Managing high-performance teams. Training and Development Journal 43 (1989) 52-60
70. McCann D., and Margerison C. Team management: Practical new approaches (1995), Management Books 2000, Chalford, England
71. McCloy R.A., Campbell J.P., and Cudeck R. A confirmatory test of a model of performance determinants. Journal of Applied Psychology 79 (1994) 493-505
72. McDaniel M.A., Hartman N.S., Whetzel D.L., and Grubb W.L.I. Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology 60 (2007) 63-91
73. McDaniel M.A., Morgeson F.P., Finnegan E.B., Campion M.A., and Braverman E.P. Predicting job performance from common sense. Journal of Applied Psychology 86 (2001) 730-740
74. McGrath J.E. Groups: Interaction and performance (1984), Prentice-Hall, Englewood Cliffs, NJ
75. McIntyre R.M., and Salas E. Measuring and managing for team performance: Emerging principles from complex environments. In: Guzzo R.A., and Salas E. (Eds). Team effectiveness and decision making in organizations (1995), Jossey-Bass, San Francisco 9-45
76. Moreland R.L., and Levine J.M. Socialization in small groups: Temporal changes in individual-group relations. Advances in Experimental Social Psychology 15 (1982) 137-192
77. Morgan B.B., and Bowers C.A. Teamwork stress: Implications for team decision making. In: Guzzo R.A., and Salas E. (Eds). Team effectiveness and decision making in organizations (1995), Jossey-Bass, San Francisco 262-290
78. Morgeson F.P., Johnson M.D., Campion M.A., Medsker G.J., and Mumford T.V. Understanding reactions to job redesign: A quasi-experimental investigation of the moderating effects of organizational context on perceptions of performance behavior. Personnel Psychology 59 (2006) 333-363
79. Morgeson F.P., Reider M.H., and Campion M.A. Selecting individuals in team settings: The importance of social skills, personality characteristics, and teamwork knowledge. Personnel Psychology 58 (2005) 583-611
80. Mosier C.I. On the reliability of a weighted composite. Psychometrika 8 (1943) 161-168
81. Motowidlo S.J., Borman W.C., and Schmit M.J. A theory of individual differences in task and contextual performance. Human Performance 10 (1997) 71-83
82. Motowidlo S.J., Hanson M.A., and Crafts J.L. Low-fidelity simulations. In: Whetzel D.L., and Wheaton G.R. (Eds). Applied measurement methods in industrial psychology (1997), Davies-Black, Palo Alto, CA 241-260
83. Mount M.K., Barrick M.R., and Stewart G.L. Five-factor model of personality and performance in jobs involving interpersonal interactions. Human Performance 11 (1998) 145-165
84. Mumford T.V., Campion M.A., and Morgeson F.P. Situational judgment in work teams: A team role typology. In: Weekley J.A., and Ployhart R.E. (Eds). Situational judgment tests: Theory, measurement, and application (2006), Erlbaum, Mahwah, NJ 319-343
85. Neuman G.A., and Wright J. Team effectiveness: Beyond skills and cognitive ability. Journal of Applied Psychology 84 (1999) 376-389
86. Parker G.M. Cross-functional teams (1994), Jossey-Bass, San Francisco
87. Parker G.M. Team players and teamwork (1996), Jossey-Bass, San Francisco
88. Ployhart R.E., and Ehrhart M.G. Be careful what you ask for: Effects of response instructions on the cognitive validity and reliability of situational judgment tests. International Journal of Selection and Assessment 11 (2003) 1-16
89. Sarbin T.R., and Allen V.L. Role theory. In: Lindzey G., and Aronson E. (Eds). Handbook of social psychology 1 (1968), Random House, New York 488-567
90. Schmidt F.L., and Hunter J.E. The validity and utility of selection methods in personnel selection: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin 124 (1998) 262-274
91. Schmidt F.L., Hunter J.E., and Outerbridge A.N. The impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance. Journal of Applied Psychology 71 (1986) 432-439
92. Schmitt N., and Chan D. Situational judgment tests: Method or construct. In: Weekley J.A., and Ployhart R.E. (Eds). Situational judgment tests: Theory, measurement, and application (2006), Erlbaum, Mahwah, NJ 135-154
93. Steiner I.D. Group processes and productivity (1972), Academic Press, New York
94. Stevens M.J., and Campion M.A. The knowledge, skill, and ability requirements for teamwork: Implications for human resource management. Journal of Management 20 (1994) 503-530
95. Stevens M.J., and Campion M.A. Staffing work teams: Development and validation of a selection test for teamwork settings. Journal of Management 25 (1999) 207-228
96. Stewart G.L., Fulmer I.S., and Barrick M.R. An exploration of member roles as a multilevel linking mechanism for individual traits and team outcomes. Personnel Psychology 58 (2005) 343-365
97. Stewart G.L., Manz C.C., and Sims Jr. H.P. Team work and group dynamics (1999), Wiley, New York
98. Sundstrom E., De Meuse K.P., and Futrell D. Work teams. American Psychologist 45 (1990) 120-133
99. Thompson J.D. Organizations in action (1967), McGraw-Hill, New York
100. Van Dyne L., and Ang S. Organizational citizenship behavior of contingent workers in Singapore. Academy of Management Journal 41 (1998) 692-703
101. Van Vianen A.E.M., and De Dreu C.K.W. Personality in teams: Its relationship to social cohesion, task cohesion, and performance. European Journal of Work and Organizational Psychology 10 (2001) 97-120
102. Vecchio R.P. Situational leadership theory: An examination of a prescriptive theory. Journal of Applied Psychology 72 (1987) 444-451
103. Viswesvaran C., Ones D.S., and Schmidt F.L. Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology 81 (1996) 557-574
104. Weekley J.A., and Jones C. Further studies of situational tests. Personnel Psychology 52 (1999) 679-700
105. Weekley J.A., Ployhart R.E., and Holtz B.C. On the development of situational judgment tests: Issues in item development, scaling, and scoring. In: Weekley J.A., and Ployhart R.E. (Eds). Situational judgment tests: Theory, measurement, and application (2006), Erlbaum, Mahwah, NJ 157-182
106. Wonderlic. Wonderlic personnel test and scholastic level exam user's manual (1999), Author, Libertyville, IL
107. Wonderlic. Wonderlic personnel test and scholastic level exam (2000), Author, Libertyville, IL
108. Yeatts D.E., and Hyten C. High-performing self-managed work teams: A comparison of theory to practice (1998), Sage, Thousand Oaks, CA