Assessment center for pilot selection: Construct and criterion validity and the impact of assessor type

Applied Psychology

Volumn 52, Issue 2, 2003, Pages 193-212

  Damitz, Marc ^a,b   Manzey, Dietrich ^c   Kleinmann, Martin ^d   Severin, Karsten ^e  

^a GERMAN AEROSPACE CENTER DLR   (Germany)

^b EUROCONTROL   (Belgium)

^c UNIVERSITY OF APPLIED SCIENCES   (Germany)

^d PHILIPPS UNIVERSITY MARBURG   (Germany)

^e Deutsche Lufthansa AG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0042976081     PISSN: 0269994X     EISSN: None     Source Type: Journal    
DOI: 10.1111/1464-0597.00131     Document Type: Review

References (44)

1. Bartram, D., & Baxter, P. (1996). Validation of the Cathay Pacific Airways pilot selection program. The International Journal of Aviation Psychology, 6, 149-169.
2. Besco, R.O. (1995). The potential contributions and scientific responsibilities of aviation psychologists. In N. Johnston, R. Fuller, & N. McDonald (Eds.), Aviation psychology: Training and selection (pp. 141-148). Aldershot: Ashgate Publishing.
3. Boeing Commercial Airplane Group (1994). Statistical summary of commercial jet aircraft accidents, worldwide operations, 1959-1993. Seattle, WA: Airplane Safety Engineering, Boeing Commercial Airplane Group.
4. Borman, W.C., Hanson, M.A., & Hedge, J.W. (1997). Personnel selection. Annual Review of Psychology, 48, 299-337.
5. Campbell, D.T., & Fiske, D.W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
6. Chidester, T.R., Helmreich, R.L., Gregorich, S.E., & Geis, C.E. (1991). Pilot personality and crew coordination: Implications for training and selection. The International Journal of Aviation Psychology, 1, 25-44.
7. Damos, D. (1995). Pilot selection batteries: A critical examination. In N. Johnston, R. Fuller, & N. McDonald (Eds.), Aviation psychology: Training and selection proceedings of the 21st conference of the European Association for Aviation Psychology (EAAP) (pp. 165-169). Aldershot: Ashgate Publishing.
8. Dolgin, D.L., & Gibb, G.D. (1989). Personality assessment in aviator selection. In R.S. Jensen (Ed.), Aviation psychology (pp. 288-320). Brookfield, VT: Gower Publishing.
9. Dunlap, J.H., & Pettit, M.A. (1995). A comparison of personality characteristics for freshmen entering a university professional pilot program with third-year students and airline pilots. In N. McDonald, N. Johnston, & R. Fuller (Eds.), Applications of psychology to the aviation system (pp. 315-320). Aldershot: Ashgate Publishing.
10. Fleishman, E.A. (1992). The Fleishman Job Analysis Survey (F-JAS). Palo Alto, CA: Consulting Psychologists Press.
11. Foushee, H.C. (1984). Dyads and triads at 35,000 feet: Factors affecting group process and aircrew performance. American Psychologist, 39, 885-893.
12. Foushee, H.C., & Helmreich, R.L. (1988). Group interaction and flight crew performance. In E.L. Wiener, & D.C. Nagel (Eds.), Human factors in aviation (pp. 189-227). San Diego, CA: Academic Press.
13. Gaugler, B.B., Rosenthal, D.B., Thornton, G.C., & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493-511.
14. Gaugler, B.B., & Thornton, G.C. (1989). Number of assessment center dimensions as a determinant of assessor accuracy. Journal of Applied Psychology, 72, 493-511.
15. Goeters, K.M., Maschke, P., & Klamm, A. (1998). An extended job analysis technique, the professional demands of airline pilots and implications for selection. Paper presented at the 23rd Conference of the European Association for Aviation Psychology, Vienna, Austria.
16. Helmreich, R.L., & Foushee, H.C. (1993). Why crew resource management? Empirical and theoretical bases of human factors training in aviation. In E.L. Wiener, B.G. Kanki, & R.L. Helmreich (Eds.), Cockpit resource management (pp. 3-45). San Diego, CA: Academic Press.
17. Helmreich, R.L., Merritt, A.C., & Wilhelm, J.A. (1999). The evolution of crew resource management training in commercial aviation. The International Journal of Aviation Psychology, 9, 19-32.
18. Hörmann, H.-J. (1998). Selection of civil aviation pilots. In K.-M. Goeters (Ed.), Aviation psychology: A science and a profession (pp. 55-62). Aldershot: Ashgate Publishing.
19. Hörmann, H.-J., Manzey, D., & Finell, G. (1989). TOM - test of multiple task performance: User manual (Rep. No. DLR-FB 89-60). Hamburg, Germany: German Aerospace Establishment (DLR), Department of Aviation and Space Psychology.
20. Hörmann, H.-J., Manzey, D., Maschke, P., & Pecena, Y. (1997). Behavior-oriented assessment of interpersonal skills in pilot selection. In R.S. Jensen (Ed.), Proceedings of the ninth international symposium on aviation psychology: Vol. 2 (pp. 1110-1115). Columbus, OH: The Ohio State University.
21. Hörmann, H.-J., & Maschke, P. (1993). Personality scales as predictors for job success of airline pilots. In R.S. Jensen (Ed.), Proceedings of the sixth international symposium on aviation psychology (pp. 384-390). Columbus, OH: The Ohio State University.
22. Hörmann, H.-J., & Maschke, P. (1996). On the relationship between personality and job performance of airline pilots. The International Journal of Aviation Psychology, 171-178.
23. Jennrich, R.I., & Sampson, P.F. (1966). Rotation for simple loadings. Psychometrika, 31, 313-323.
24. Jensen, A.R., & Weng, L.-J. (1994). What is a good g? Intelligence, 18, 231-258.
25. Kleinmann, M. (1997). Assessment-Center: Stand der Forschung-Konsequenzen für die Praxis [Assessment centers: State of research-consequences for practice]. Göttingen, Germany: Verlag für Angewandte Psychologie.
26. Klimoski, R.J., & Brickner, M. (1987). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243-260.
27. Lawley, D.N. (1943). A note on Karl Pearson's selection formulas. Proceedings of the Royal Society of Edinburgh, Section A, 62, Part I, 20-30.
28. Martinussen, M. (1996). Psychological measures as predictors of pilot performance: A meta-analysis. The International Journal of Aviation Psychology, 6, 1-20.
29. Norton, S.M. (1992). Peer assessments of performance and ability: An exploratory meta-analysis of statistical artefacts and contextual moderators. Journal of Business and Psychology, 6, 387-399.
30. Olea, M.M., & Ree, M.J. (1994). Predicting pilot and navigator criteria: Not much more than g. Journal of Applied Psychology, 79, 845-851.
31. Ree, M.J., & Carretta, T.R. (1996). Central role of g in military pilot selection. The International Journal of Aviation Psychology, 6, 111-123.
32. Ree, M.J., & Earles, J.A. (1991). The stability of convergent estimates of g. Intelligence, 15, 271-278.
33. Robertson, I., Gratton, L., & Sharpley, D. (1987). The psychometric properties and design of managerial assessment centres: Dimensions into exercises won't go. Journal of Occupational Psychology, 60, 187-195.
34. Sackett, P.R., & Dreher, G.F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401-410.
35. Sagie, A., & Magnezy, R. (1997). Assessor type, number of distinguishable dimension categories, and assessment center construct validity. Journal of Occupational and Organizational Psychology, 70, 103-108.
36. Schmitt, N.E., Gooding, R.Z., Noe, R.D., & Kirsch, M. (1984). Metaanalyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407-422.
37. Sears, R.L. (1985). A new look at accident contributors and the implications of operational and training procedures. Paper presented at the 38th International Flight Safety Foundation Symposium, Boston, MA.
38. Shore, T.H., Thornton, G.C., & McFarlane Shore, L.M. (1990). Construct validity of two assessment center dimension ratings. Personnel Psychology, 43, 101-116.
39. Steiger, J.H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245-252.
40. Stelling, D. (1999). Teamarbeit in Mensch-Maschine-Systemen [Teamwork in man-machine systems]. Göttingen: Hogrefe.
41. Thomson, H.A. (1970). Comparison of predictor and criterion judgments of managerial performance using the multitrait-multimethod approach. Journal of Applied Psychology, 54, 496-502.
42. Thornton, G.C., & Byham, W.C. (1982). Assessment centers and managerial performance. New York: Academic Press.
43. Tziner, A., Ronen, S., & Hacohen, D. (1993). A four-year validation study of an assessment center in a financial corporation. Journal of Organizational Behavior, 14, 225-237.
44. Zedeck, S. (1986). A process analysis of the assessment center method. In B. Staw & L. Cummings (Eds.), Research in organizational behavior Vol. 8 (pp. 259-296). Greenwich, CT: JAI Press.