The Knowledge, Skill, and Ability Requirements for Teamwork: Revisiting the Teamwork-KSA Test's validity

International Journal of Selection and Assessment

Volumn 20, Issue 1, 2012, Pages 36-52

  O'Neill, Thomas A ^a   Goffin, Richard D ^b   Gellatly, Ian R ^c  

^a UNIVERSITY OF CALGARY   (Canada)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

^c UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84857333709     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2012.00578.x     Document Type: Article

References (80)

1. Aguinis, H., Henle, C. A., & Ostroff, C. (2001). Measurement in work and organizational psychology. In N. Anderson, D. S. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.), Handbook of industrial, work, and organizational psychology 1, (pp. 27-50). London: Sage.
2. Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Belmont, CA.: Wadsworth Inc.
3. Allen, N. J., & West, M. A. (2005). Selection for teams. In A. Evers, N. Anderson, & O. Voskuijl (Eds.), Handbook of personnel selection (pp. 476-494). Oxford: Blackwell Publishing.
4. Arvey, R. D., Strickland, W., Drauden, G., & Martin, C. (1990). Motivational components of test taking. Personnel Psychology, 43, 695-716.
5. Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238-246.
6. Bentler, P. M. (2003). EQS 6.1 for Windows. [Computer Software]. Encino, CA: Multivariate Software.
7. Bobko, P. (2001). Correlation and regression (2nd ed.) Thousand Oaks, CA: Sage.
8. Chen, G., Donahue, L. M., & Klimoski, R. J. (2004). Training undergraduates to work in organizational teams. Academy of Management Learning and Education, 3, 27-40.
9. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 115-159.
10. Creative Organizational Design. (2009). Teamwork - knowledge, skills, attitudes. Available at (accessed December 4, 2009).
11. Cronbach, L. J., & Meehl, P. E. (1978). Construct validity in psychological tests. In D. N. Jackson & S. Messick (Eds.), Problems in human assessment (pp. 57-77). Huntington, NY: Robert E. Krieger Publishing Company.
12. Ellis, A. P. J., Bell, B. S., Ployhart, R. E., Hollenbeck, J. R., & Ilgen, D. R. (2005). An evaluation of generic teamwork skills training with action teams: Effects on cognitive and skill-based outcomes. Personnel Psychology, 58, 641-672.
13. Furr, R. M., & Bacharach, V. R. (2008). Psychometrics: An introduction. Los Angeles, CA: Sage.
14. Goffin, R. D. (1993). A comparison of two new indices for the assessment of fit of structural equation models. Multivariate Behavioral Research, 28, 205-214.
15. Goffin, R. D., Gellatly, I. R., Paunonen, S. V., Jackson, D. N., & Meyer, J. P. (1996). Criterion validation of two approaches to performance appraisal: The behavioral observation scale and the relative percentile method. Journal of Business and Psychology, 11, 23-33.
16. Goffin, R. D., Jelley, R. B., Powell, D. M., & Johnston, N. G. (2009). Taking advantage of social comparisons in performance appraisal: The Relative Percentile Method. Human Resource Management, 48, 261-268.
17. Graen, G. B. (2009). Educating new management specialists from an evidence-based perspective: A proposal. Academy of Management Learning and Education, 8, 255-258.
18. Guion, R. M. (1998). Assessment, measurement, and prediction for personnel decisions. Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.
19. Harvey, R. J. (1993). Research monograph: The development of the CMQ. Monograph describing the development and field-testing of the Common Metric Questionnaire (CMQ).
20. Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191-205.
21. Hinkin, T. R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21, 967-988.
22. Hirschfeld, R. R., Jordan, M. H., Feild, H. S., Giles, W. F., & Armenakis, A. A. (2006). Becoming team players: Team members' mastery of teamwork knowledge as a predictor of team task proficiency and observed teamwork effectiveness. Journal of Applied Psychology, 91, 467-474.
23. Hollenbeck, J. R., DeRue, D. S., & Guzzo, R. (2004). Bridging the gap between I/O research and HR practice: Improving team composition, team training, and team task design. Human Resource Management, 43, 353-366.
24. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus narrow alternatives. Structural Equation Modeling, 6, 1-55.
25. Jackson, D. N. (1999). Personality research form, form l. Port Huron, MI: Sigma Assessment Systems.
26. Jackson, D. N., Ashton, M. C., & Tomes, J. L. (1996). The six-factor model of personality: Facets from the big five. Personality and Individual Differences, 21, 391-402.
27. Jackson, D. N., Paunonen, S. V., Fraboni, M., & Goffin, R. D. (1996). A five-factor versus six factor model of personality structure. Personality and Individual Differences, 20, 33-45.
28. Jackson, D. N., Paunonen, S. V., & Tremblay, P. F. (2000). Six factor personality questionnaire manual. Port Huron, MI: Sigma Assessment Systems.
29. Joseph, D. L., & Newman, D. A. (2010). Emotional intelligence: An integrative meta-analysis and cascading model. Journal of Applied Psychology, 95, 54-78.
30. Kline, P. (1984). A handbook of test construction: Introduction to psychometric design. New York: Methuen, Inc.
31. Kline, R. B. (2004). Principles and practices of structural equation modeling (2nd ed.) New York: Guildford.
32. Kottke, J. L. (2008, April). Able but not willing? Teamwork aptitude and interest meet head-on. Paper presented at the 23rd Annual Meeting of the Society for Industrial and Organizational Psychology, San Francisco.
33. Leach, D. J., Wall, T. D., Rogelberg, S. G., & Jackson, P. R. (2005). Team autonomy, performance, and member job strain: Uncovering the teamwork KSA link. Applied Psychology: An International Review, 54, 1-24.
34. LePine, J. A., Piccolo, R. F., Jackson, C. L., Mathieu, J. E., & Saul, J. R. (2008). A meta-analysis of teamwork processes: Tests of a multidimensional model and relationships with team effectiveness criteria. Personnel Psychology, 61, 273-307.
35. Liebert, R. M., & Morris, L. W. (1967). Cognitive and emotional components of test anxiety: A distinction and some initial data. Psychological Reports, 20, 975-978.
36. Loevinger, J. (1967). Objective tests as instruments of psychological theory. In D. N. Jackson & S. Messick (Eds.), Problems in human assessment (pp. 78-123). New York: McGraw-Hill.Reprinted from Psychological Reports, 1957, Monograph Supplement).
37. Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001). A temporally based framework and taxonomy of team processes. Academy of Management Review, 26, 356-376.
38. Martín-Pérez, V., Martín-Cruz, N., Pérez-Santana, P., Hernangómez-Barahona, J., & Martín-Sierra, C. (2010). 'Virtual learning-by-doing' teamwork KSA: Strategic management simulation as an effective tool. Communications in Computer and Information Science, 73, 324-330.
39. McCarthy, J. M., & Goffin, R. D. (2003). Is the Test Attitude Survey psychometrically sound? Educational and Psychological Measurement, 63, 446-464.
40. McCarthy, J. M., & Goffin, R. D. (2004). Measuring job interview anxiety: Beyond weak knees and sweaty palms. Personnel Psychology, 57, 607-637.
41. McCarthy, J. M., & Goffin, R. D. (2005). Selection test anxiety: Exploring tension and fear of failure across the sexes in simulated selection scenarios. International Journal of Selection and Assessment, 13, 282-295.
42. McClough, A. C., & Rogelberg, S. G. (2003). Selection in teams: An exploration of the teamwork knowledge, skills, and ability test. International Journal of Selection and Assessment, 11, 56-66.
43. McDonald, R. P., & Marsh, H. W. (1990). Choosing a multivariate model: Noncentrality and goodness of fit. Psychological Bulletin, 107, 242-255.
44. McFarland, L. A., & Ryan, A. M. (2006). Toward an integrated model of applicant faking behavior. Journal of Applied Social Psychology, 36, 979-1016.
45. Messick, S. (1991). Validity of test interpretation and use. Princeton, NJ: Research Report for the Educational Testing Service.
46. Miller, D. L. (2001). Reexamining the teamwork ksas and team performance. Small Group Research, 32, 745-766.
47. Morgeson, F. P., Reider, M. H., & Campion, M. A. (2005). Selecting individuals in team settings: The importance of social skills, personality characteristics, and teamwork knowledge. Personnel Psychology, 58, 583-611.
48. Mount, M. K., Barrick, M. R., & Stewart, G. L. (1998). Five-Factor Model of personality and performance in jobs involving interpersonal interactions. Human Performance, 11, 145-165.
49. Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: Principles and applications (6th ed.). Upper Saddle River, NJ: Prentice Hall.
50. Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
51. Nunnally, J. C., & Burnstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
52. O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instrumentation, and Computers, 32, 396-402.
53. O'Neill, T. A., Goffin, R. D., & Gellatly, I. R. (2010). Test-taking motivation and personality test validity. Journal of Personnel Psychology, 9, 117-125.
54. O'Neill, T. A., & Hastings, S. E. (2010). Explaining workplace deviance behavior with more than just the 'Big Five'. Personality and Individual Differences, 50, 268-273.
55. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (2003). Personality and absenteeism: A meta-analysis of integrity tests. European Journal of Personality, 17, S19-S38.
56. Osburn, H. G., Callender, J. C., Greener, J. M., & Ashworth, S. (1983). Statistical power of tests of situational specificity hypothesis in validity generalization studies: A cautionary note. Journal of Applied Psychology, 68, 115-122.
57. Oswald, F. L., & Johnson, J. W. (1998). On the robustness, bias, and stability of statistics from meta-analysis of correlation coefficients: Some initial Monte Carlo findings. Journal of Applied Psychology, 83, 164-178.
58. Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychology attitudes (pp. 17-59). New York: Academic Press.
59. Pfeffer, J., & Sutton, R. I. (2006). Evidence-based management. Harvard Business Review, 84, 62-74.
60. Ramsay Corp. (2009). Teamwork KSA. Available at (accessed December 4, 2009)
61. Rapp, T. L., & Mathieu, J. E. (2007). Evaluating an individually self-administered generic teamwork skills training program across time and levels. Small Group Research, 38, 532-555.
62. Rousseau, D. (2006). Is there such a thing as evidence-based management? Academy of Management Review, 31, 256-269.
63. Salgado, J. F., Anderson, N., Moscoso, S., Bertua, C., & De Fruyt, F. (2003). International validity generalization of GMA and cognitive abilities: A European community meta-analysis. Personnel Psychology, 56, 573-605.
64. Schmit, M. J., & Ryan, A. M. (1992). Test-taking dispositions: A missing link? Journal of Applied Psychology, 77, 629-637.
65. Schulte, M. J., Ree, M. J., & Carretta, T. R. (2004). Emotional intelligence: Not much more than g and personality. Personality and Individual Differences, 37, 1059-1068.
66. Spielberger, C. D. (1980). Test attitude inventory. Palo Alto, CA: Consulting Psychologists Press.
67. Spielberger, C. D., & Vagg, P. R. (1995). Test anxiety: Theory, assessment, and treatment. Washington, DC: Taylor and Francis.
68. Stevens, M. J., & Campion, M. A. (1993). The Teamwork KSA test. Minneapolis, MN: NCS Pearson, Inc.
69. Stevens, M. J., & Campion, M. A. (1994). The knowledge, skill, and ability requirements for teamwork: Implications for human resource management. Journal of Management, 20, 503-530.
70. Stevens, M. J., & Campion, M. A. (1999). Staffing work teams: Development and validation of a selection test for teamwork settings. Journal of Management, 25, 207-228.
71. Stevens, M. J., Jones, R. G., & Fisher, D. L. (2002, April). What's past is prologue: Exploring a biodata approach to team selection. In F. P. Morgeson (chair), Selection for Teams: A tale of five approaches. Symposium presented at the 17th Annual Meeting of the Society for Organizational and Industrial Psychology, Toronto, Ontario, Canada.
72. Stewart, G. L., Fulmer, I. S., & Barrick, M. R. (2005). An exploration of member roles as a multilevel linking mechanism for individual traits and team outcomes. Personnel Psychology, 58, 343-365.
73. Taggar, S., & Brown, T. C. (2001). Problem-solving team behaviors: Development and validation of BOS and a hierarchical factor structure. Small Groups Research, 32, 698-726.
74. Velicer, W. F., Eaton, C. A., & Fava, J. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In R. D. Goffin & E. Helmes (Eds.), Problems and solutions in human assessment: Honoring Douglas N. Jackson at Seventy (pp. 42-72). Boston, MA: Kluwer Academic Publishers.
75. Viswesvaran, C., & Ones, D. S. (2000). Measurement error in 'Big Five Factors' personality assessment: Reliability generalization across studies and measures. Educational and Psychological Measurement, 60, 224-235.
76. Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 5, 557-574.
77. Wagner, S. H., & Goffin, R. D. (1997). Differences in accuracy of absolute and comparative performance appraisal methods. Organizational Behavior and Human Decision Processes, 70, 95-103.
78. Walsh, W. B., & Betz, N. E. (2001). Tests and assessment (4th ed.). Upper Saddle River, NJ: Prentice Hall.
79. West, M. A., & Allen, N. A. (1997). Selecting for teamwork. In N. Anderson & P. Herriot (Eds.), International Handbook of Selection and Assessment (pp. 493-506). New York: John Wiley.
80. Williams, H. M., & Allen, N. J. (2008). Teams at work. In J. Barling & G. L. Cooper (Eds.), The Sage handbook of organizational behavior. (Vol.1, pp. 124-140). Los Angeles, CA: Sage.