Incremental validity of assessment center ratings over cognitive ability tests: A study at the executive management level

International Journal of Selection and Assessment

Volumn 14, Issue 4, 2006, Pages 360-371

  Krause, Diana E ^a   Kersting, Martin ^b   Heggestad, Eric D ^c   Thornton III, George C ^d  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b RWTH AACHEN UNIVERSITY   (Germany)

^c UNIVERSITY OF NORTH CAROLINA   (United States)

^d Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34247890048     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2006.00357.x     Document Type: Article

References (50)

1. Aamodt, M.G. (2004) Research in law enforcement selection. Boca Raton, FL : BrownWalker.
2. Ackerman, P.L. Heggestad, E.D. (1997) Intelligence, personality, and interests: Evidence for overlapping traits. Psychological Bulletin, 121, 219 245.
3. Ackerman, P.L., Beier, M.E. Boyle, M.O. (2005) Working memory and intelligence: The same or different constructs? Psychological Bulletin, 131, 30 60.
4. Arthur, W.A. Jr., Day, E.A., McNelly, T.L. Edens, P.S. (2003) A meta-analysis of the criterion-related validity of assessment center dimensions. Personnel Psychology, 56, 125 149.
5. Arthur, W.A. Jr., Woehr, D.J. Maldegen, R. (2000) Convergent and discriminant validity of assessment center dimensions: A conceptual and empirical re-examination of the assessment center construct-related validity paradox. Journal of Management, 26, 813 835.
6. Beauducel, A. Kersting, M. (2002) Fluid and crystallized intelligence and the Berlin model of intelligence structure (BIS). European Journal of Psychological Assessment, 18, 97 112.
7. Borman, W.C. Brush, D.H. (1993) More progress toward a taxonomy of managerial performance requirements. Human Performance, 6, 1 21.
8. Campbell, J.P., McCloy, R.A., Oppler, S.H. Sager, C.E. (1993) A theory of performance. In N. Schmitt W.C. Borman (Eds), Personnel selection in organizations (pp. 35 70). San Francisco : Jossey-Bass.
9. Cattell, R.B. (1987) Intelligence: Its structure, growth, and action. Amsterdam : Elsevier Science Publishers.
10. Chan, D. (1996) Criterion and construct validation of an assessment centre. Journal of Occupational and Organizational Psychology, 69, 167 181.
11. Clapham, M.M. (1998) A comparison of assessor and self dimension ratings in an advanced management assessment centre. Journal of Occupational Psychology, 71, 193 203.
12. Collins, J.M., Schmidt, F.L., Sanchez-Ku, M., Thomas, L., McDaniel, M.A. Le, H. (2003) Can basic individual differences shed light on the construct meaning of assessment center evaluations? International Journal of Selection and Assessment, 11, 17 29.
13. Dayan, K., Kasten, R. Fox, S. (2002) Entry-level police candidate assessment center: An efficient tool or a hammer to kill a fly? Personnel Psychology, 55, 827 849.
14. Eurich, T., Krause, D.E., Cigularov, K. Thornton, G.C. III. (2006). Assessment centers in the U.S. Paper presented at the annual conference of The Society of Industrial and Organizational Psychology (SIOP), Dallas, U.S., May.
15. Funke, J. (1991) Solving complex problems: Exploration and control of complex systems. In R.J. Sternberg P.A. Frensch (Eds). Complex problem solving: Principles and mechanisms (pp. 185 222). Hillsdale, NJ : Erlbaum.
16. Gaugler, B.B., Rosenthal, D.B., Thornton, G.C. III. Bentson, C. (1987) Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493 511.
17. Gibbons, A.M., Rupp, D.E., Baldwin, A. Holub, S.A. (2005). Developmental assessment center validation: Evidence for DACs as effective training interventions. Paper presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles, U.S., April.
18. Haaland, S. Christiansen, N.D. (2002) Implications of trait-activation theory for evaluating the construct validity of assessment center ratings. Personnel Psychology, 55, 137 163.
19. Hardison, C.M. Sackett, P.R. (2004) Assessment center criterion related validity: A meta-analytic update. Paper presented at the 18th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, U.S., April.
20. Hunter, J.E. Hunter, R.F. (1984) Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72 98.
21. International Task Force on Assessment Center Guidelines (2000) Guidelines and ethical considerations for assessment center operations. Public Personnel Management, 29, 315 331.
22. Jensen, A.R. (1984) Test bias: Concepts and criticisms. In C.R. Reynolds R.T. Brown (Eds), Perspectives on bias in mental testing (pp. 507 586). New York : Plenum Press.
23. Jones, R.G. Whitmore, M.D. (1995) Evaluating developmental assessment centers as interventions. Personnel Psychology, 48, 377 388.
24. Kersting, M. (1998) Differentielle Aspekte der sozialen Akzeptanz von Intelligenztests und Problemlöseszenarien als Personalauswahlverfahren [Differential aspects of social acceptance of intelligence tests and problem-solving scenarios as methods for personnel selection]. Zeitschrift für Arbeits- und Organisationspsychologie, 42, 61 75.
25. Kersting, M. (1999) Diagnostik und Personalauswahl mit computergestützten Problemlöseszenarien? Eine Erörterung und ein empirischer Vergleich der Kriteriumsvalidität von Problemlöseszenarien und Intelligenztests [Assessment and personnel selection through computer-aided problem solving scenarios? A debate and empirical comparison of criterion validity of problem solving scenarios and intelligence tests]. Göttingen : Hogrefe.
26. Kersting, M. (2003a) Assessment Center: Erfolgsmessung und Qualitätskontrolle [Assessment center: Success measurement and quality control]. In S. Höft B. Wolf (Eds), Qualitätsstandards für Personalentwicklung in Wirtschaft und Verwaltung (pp. 72 93). Hamburg : Windmühle.
27. Kersting, M. (2003b) Problem solving. In R. Fernández-Ballesteros (Ed.), Encyclopedia of psychological assessment (pp. 757 761). London : Sage.
28. Klimoski, R.J. Brickner, M. (1987) Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243 260.
29. Krause, D.E. Gebert, D. (2003) A comparison of assessment center practices in organizations in German-speaking regions and the United States. International Journal of Selection and Assessment, 11, 297 312.
30. Krause, D.E. Thornton, G.C. III. (2004) Cultural values and assessment center practices in the Americas, Europe and Asian countries. Presented at the 32nd International Congress on Assessment Center Methods, Las Vegas, U.S., October.
31. Lievens, F. Conway, J.M. (2001) Dimension and exercise variance in assessment center scores: A large-scale evaluation of multitrait-multimethod studies. Journal of Applied Psychology, 86, 1202 1222.
32. Lievens, F., Harris, M.M., Van Keer, E. Bisqueret, C. (2003) Predicting cross-cultural training performance: The validity of personality, cognitive ability, and dimensions measured by an assessment center and a behavioral description interview. Journal of Applied Psychology, 88, 476 489.
33. Lievens, F. Thornton, G.C. III. (2005) Assessment centers: Recent developments in practice and research. In A. Evers, O. Voskuijl N. Anderson (Eds), Handbook of personnel selection. London : Blackwell.
34. Motowidlo, S.J. Van Scotter, J.R. (1994) Evidence that task performance should be distinguished from contextual performance. Journal of Applied Psychology, 79, 475 480.
35. Pynes, J.E. Bernadin, H.J. (1989) Predictive validity of an entry-level police officer assessment center. Journal of Applied Psychology, 74, 831 833.
36. Rupp, D.E., Gibbons, A.M., Baldwin, A.M., Snyder, L.A., Spain, S.M., Woo, S.E., Brummel, B.J., Sims, C.S. Kim, M. (2006). An initial validation of developmental assessment centers as accurate assessments and effective training interventions. The Psychologist-Manager Journal, 9, 171 200.
37. Rupp, D.E., Snyder, L.A., Gibbons, A.M. Thornton, G.C. III. (2006) What should developmental assessment centers be developing? The Psychologist-Manager Journal, 9, 75 98.
38. Schmidt, F.L. Hunter, J.E. (1998) The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research finding. Psychological Bulletin, 124, 262 274.
39. Schmitt, N., Gooding, R.Z., Noe, R.A. Kirsch, M. (1984) Meta-analysis of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407 422.
40. Scholz, G. Schuler, H. (1993) Das nomologische Netzwerk des Assessment Centers: Eine Meta-Analyse [Construct validity of assessment centers. A meta-analysis]. Zeitschrift für Arbeits- und Organisationspsychologie, 37, 73 85.
41. Tett, R.P, Guterman, H.A., Bleir, A. Murphy, P.J. (2000) Development and content validation of a "hyperdimensional" taxonomy of managerial competence. Human Performance, 13, 205 251.
42. Thornton, G.C. III. Byham, W.C. (1982) Assessment centers and managerial performance. New York : Academic Press.
43. Thornton, G.C. III. Mueller-Hansen, R.A. (2004) Developing organizational simulations. Mahwah, NJ : Lawrence Erlbaum.
44. Thornton, G.C. III. Rupp, D.E. (2003) Simulations and assessment centers. In J. Thomas (Ed.), Industrial and organizational assessment (pp. 319 344). Hoboken, NJ : Wiley.
45. Thornton, G.C. III. Rupp, D.E. (2006) Assessment centers and human resource management. Mahwah, NJ : Lawrence Erlbaum.
46. Thornton, G.C. III., Tziner, A., Dahan, M., Clevenger, J.P. Meir, E. (1997) Construct validity of assessment center judgments. Journal of Social Behavior and Personality, 12, 109 128.
47. Thurstone, L.L. Thurstone, T.G. (1946) Primary mental abilities. Chicago : Science Research Associates.
48. Tziner, A., Meir, E.I., Dahan, M. Birati, A. (1994) An investigation of the predictive validity and economic utility of the assessment center for the high-management level. Canadian Journal of Behavioural Science, 26, 228 245.
49. Viswesvaran, C., Ones, D.S. Schmidt, F.L. (1996) Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557 574.
50. Washington v. Davis (1976) 426 U.S. 229.