Situational judgment tests: A review of recent research

Personnel Review

Volumn 37, Issue 4, 2008, Pages 426-441

  Lievens, Filip ^a   Peeters, Helga ^a   Schollaert, Eveline ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Aptitude tests; Competences; Human resourcing; Interpersonal skills; Selection

Indexed keywords

EID: 45349103630     PISSN: 00483486     EISSN: None     Source Type: Journal    
DOI: 10.1108/00483480810877598     Document Type: Review

References (58)

1. Becker, T.E. (2005), "Development and validation of a situational judgment test of employee integrity", International Journal of Selection and Assessment, Vol. 13 No. 3, pp. 225-32.
2. Bergman, M.E., Drasgow, F., Donovan, M.A. and Henning, J.B. (2006), "Scoring situational judgment tests: once you get the data, your troubles begin", International Journal of Selection and Assessment, Vol. 14 No. 3, pp. 223-35.
3. Bruce, M.M. and Learner, D.B. (1958), "A supervisory practices test", Personnel Psychology, Vol. 11, pp. 207-16.
4. Chan, D. and Schmitt, N. (1997), "Video-based versus paper-and-pencil method of assessment is situational judgment tests: subgroup differences in test performance and face validity perceptions", Journal of Applied Psychology, Vol. 82 No. 1, pp. 143-59.
5. Chan, D. and Schmitt, N. (2002), "Situational judgment and job performance", Human Performance, Vol. 15 No. 3, pp. 233-54.
6. Clause, C.C., Mullins, M.E., Nee, M.T., Pulakos, E.D. and Schmitt, N. (1998), "Parallel test form development: a procedure for alternative predictors and an example", Personnel Psychology, Vol. 51 No. 1, pp. 193-208.
7. Clevenger, J., Pereira, G.M., Wiechmann, D., Schmitt, N. and Schmidt-Harvey, V.S. (2001), "Incremental validity of situational judgment tests", Journal of Applied Psychology, Vol. 86 No. 3, pp. 410-7.
8. Cook, M. (2003), Personnel Selection: Adding Value through People, Wiley, Chichester.
9. Costa, P.T., Terracciano, A. and McCrae, R.R. (2001), "Gender differences in personality traits across cultures: robust and surprising findings", Journal of Personality and Social Psychology, Vol. 81 No. 2, pp. 322-31.
10. Cronbach, L.J. and Gleser, G.C. (1965), Psychological Tests and Personnel Decisions, University of Illinois Press, Urbana, IL.
11. Cullen, M.J., Sackett, P.R. and Lievens, F. (2006), "Threats to the operational use of situational judgment tests in the college admission process", International Journal of Selection and Assessment, Vol. 14 No. 2, pp. 142-55.
12. Dalessio, A.T. (1994), "Predicting insurance agent turnover using a video-based situational judgment test", Journal of Business and Psychology, Vol. 9 No. 1, pp. 23-32.
13. Funke, U. and Schuler, H. (1998), "Validity of stimulus and response components in a video test of social competence", International Journal of Selection and Assessment, Vol. 6, pp. 115-23.
14. Hausknecht, J.P., Day, D.V. and Thomas, S.C. (2004), "Applicant reactions to selection procedures: an updated model and meta-analysis", Personnel Psychology, Vol. 57 No. 3, pp. 639-83.
15. Hooper, A.C., Cullen, M.J. and Sackett, P.R. (2006), "Operational threats to the use of SJTs: faking, coaching, and retesting issues", in Weekley, J.A. and Ployhart, R.E. (Eds), Situational Judgment Tests: Theory, Measurement and Application, Lawrence Erlbaum Associates, Mahwah, NJ, pp. 205-32.
16. Hunter, D.R. (2003), "Measuring general aviation pilot judgment using a situational judgment technique", International Journal of Aviation Psychology, Vol. 13 No. 4, pp. 373-86.
17. Jensen, A.R. (1998), The G Factor: The Science of Mental Ability, Praeger, Westport, CT.
18. Kanning, U.P., Grewe, K., Hollenberg, S. and Hadouch, M. (2006), "From the subjects' point of view - reactions to different types of situational judgment items", European Journal of Psychological Assessment, Vol. 22 No. 3, pp. 168-76.
19. Konradt, U., Hertel, G. and Joder, K. (2003), "Web-based assessment of call center agents: development and validation of a computerized instrument", International Journal of Selection and Assessment, Vol. 11 Nos 2-3, pp. 184-93.
20. Lievens, F. (2006), "International situational judgment tests", in Weekley, J.A. and Ployhart, R.E. (Eds), Situational Judgment Tests: Theory, Measurement and Application, Laurence Erlbaum Associates, Mahwah, NJ, pp. 279-300.
21. Lievens, F., Buyse, T. and Sackett, P.R. (2005a), "The operational validity of a video-based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains", Journal of Applied Psychology, Vol. 90 No. 3, pp. 442-52.
22. Lievens, F., Buyse, T. and Sackett, P.R. (2005b), "Retest effects in operational selection settings: development and test of a framework", Personnel Psychology, Vol. 58 No. 4, pp. 981-1007.
23. Lievens, F. and Sackett, P.R. (2006a), "Video-based versus written situational judgment tests: a comparison in terms of predictive validity", Journal of Applied Psychology, Vol. 91 No. 5, pp. 1181-8.
24. Lievens, F. and Sackett, P.R. (2006b), "Situational judgment tests in high stakes settings: issues and strategies with generating alternate forms", Journal of Applied Psychology, Vol. 92 No. 4, pp. 1043-55.
25. McClough, A.C. and Rogelberg, S.G. (2003), "Selection in teams: an exploration of the teamwork knowledge, skills, and ability test", International Journal of Selection and Assessment, Vol. 11 No. 1, pp. 56-66.
26. McDaniel, M.A. and Nguyen, N.T. (2001), "Situational judgment tests: a review of practice and constructs assessed", International Journal of Selection and Assessment, Vol. 9 Nos 1-2, pp. 103-13.
27. McDaniel, M.A. and Whetzel, D.L. (2005), "Situational judgment test research: informing the debate on practical intelligence theory", Intelligence, Vol. 33 No. 5, pp. 515-25.
28. McDaniel, M.A., Hartman, N.S., Whetzel, D.L. and Grubb, W.L. (2007), "Situational judgment tests, response instructions, and validity: a meta-analysis", Personnel Psychology, Vol. 60 No. 1, pp. 63-91.
29. McDaniel, M.A., Morgeson, F.P., Finnegan, E.B., Campion, M.A. and Braverman, E.P. (2001), "Predicting job performance using situational judgment tests: a clarification of the literature", Journal of Applied Psychology, Vol. 86 No. 4, pp. 730-40.
30. McHenry, J.J. and Schmitt, N. (1994), "Multimedia testing", in Rumsey, M.G. and Walker, C.B. (Eds), Personnel Selection and Classification, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 193-232.
31. Morgeson, F.P., Reider, M.H. and Campion, M.A. (2005), "Selecting individuals in team settings: the importance of social skills, personality characteristics, and teamwork knowledge", Personnel Psychology, Vol. 58 No. 3, pp. 583-611.
32. Motowidlo, S., Dunnette, M.D. and Carter, G.W. (1990), "An alternative selection procedure: the low-fidelity simulation", Journal of Applied Psychology, Vol. 75 No. 6, pp. 640-7.
33. Motowidlo, S.J., Hooper, A.C. and Jackson, H.L. (2006), "Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items", Journal of Applied Psychology, Vol. 91 No. 4, pp. 749-61.
34. Nguyen, N.T., Biderman, M.D. and McDaniel, M.A. (2005b), "Effects of response instructions on faking a situational judgment test", International Journal of Selection and Assessment, Vol. 13 No. 4, pp. 250-60.
35. Nguyen, N.T., McDaniel, M.A. and Whetzel, D.L. (2005a), "Subgroup differences in situational judgment test performance: a meta-analysis", paper presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA, April.
36. O'Connell, M.S., Hartman, N.S., McDaniel, M.A., Grubb, W.L. and Lawrence, A. (2007), "Incremental validity of situational judgment tests for task and contextual job performance", International Journal of Selection and Assessment, Vol. 15 No. 1, pp. 19-29.
37. Olson-Buchanan, J.B., Drasgow, F., Moberg, P.J., Mead, A.D., Keenan, P.A. and Donovan, M.A. (1998), "Interactive video assessment of conflict resolution skills", Personnel Psychology, Vol. 51 No. 1, pp. 1-24.
38. Oswald, F.L., Friede, A.J., Schmitt, N., Kim, B.K. and Ramsay, L.J. (2005), "Extending a practical method for developing alternate test forms using independent sets of items", Organizational Research methods, Vol. 8 No. 2, pp. 149-64.
39. Oswald, F.L., Schmitt, N., Kim, B.H., Ramsay, L.J. and Gillespie, M.A. (2004), "Developing a biodata measure and situational judgment inventory as predictors of college student performance", Journal of Applied Psychology, Vol. 89 No. 2, pp. 187-208.
40. Peeters, H. and Lievens, F. (2005), "Situational judgment tests and their predictiveness of college students' success: the influence of faking", Educational and Psychological Measurement, Vol. 65 No. 1, pp. 70-89.
41. Ployhart, R.E. (2006), "Staffing in the 21st century: new challenges and strategic opportunities", Journal of Management, Vol. 32 No. 6, pp. 868-97.
42. Ployhart, R.E. and Ehrhart, M.G. (2003), "Be careful what you ask for: effects of response instructions on the construct validity and reliability of situational judgment tests", International Journal of Selection and Assessment, Vol. 11 No. 1, pp. 1-16.
43. Ployhart, R.E., Porr, W. and Ryan, A.M. (2004), "New development in SJTs: scoring, coaching and incremental validity", paper presented at the 19th annual convention of the Society for Industrial and Organizational Psychology, Chicago, IL, April.
44. Ployhart, R.E., Weekley, J.A., Holtz, B.C. and Kemp, C.F. (2003), "Web-based and paper-and-pencil testing of applicants in a proctored setting: are personality, biodata, and situational judgment tests comparable?", Personnel Psychology, Vol. 56 No. 3, pp. 733-52.
45. Potosky, D. and Bobko, P. (2004), "Selection testing via the internet: practical considerations and exploratory empirical findings", Personnel Psychology, Vol. 57 No. 4, pp. 1003-34.
46. Pulakos, E.D. and Schmitt, N. (1996), "An evaluation of two strategies for reducing adverse impact and their effects on criterion-related validity", Human Performance, Vol. 9 No. 3, pp. 241-58.
47. Richardson, Bellows, Henry & Co. (1981), Technical Reports Supervisory Profile Record, Richardson, Bellows, Henry & Co., Washington, DC.
48. Richman-Hirsch, W.L., Olson-Buchanan, J.B. and Drasgow, F. (2000), "Examining the impact of administration medium on examinee perceptions and attitudes", Journal of Applied Psychology, Vol. 85 No. 6, pp. 880-7.
49. Ryan, A.M., McFarland, L., Baron, H. and Page, R. (1999), "An international look at selection practices: nation and culture as explanations for variability in practice", Personnel Psychology, Vol. 52 No. 2, pp. 359-91.
50. Smiderle, D., Perry, B.A. and Cronshaw, S.F. (1994), "Evaluation of video-based assessment in transit operator selection", Journal of Business and Psychology, Vol. 9 No. 1, pp. 3-22.
51. Schmidt, F.L. and Hunter, J.E. (1998), "The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings", Psychological Bulletin, Vol. 124 No. 2, pp. 262-74.
52. Schmitt, N. and Chan, D. (2006), "Situational judgment tests: method or construct?", in Weekley, J. and Ployhart, R.E. (Eds), Situational Judgment Tests, Lawrence Erlbaum Associates, Mahwah, NJ, pp. 135-56.
53. Stevens, M.J. and Campion, M.A. (1999), "Staffing work teams: development and validation of a selection test for teamwork", Journal of Management, Vol. 25 No. 2, pp. 207-28.
54. Such, M.J. and Schmidt, D.B. (2004), "Examining the effectiveness of empirical keying: a cross-cultural perspective", paper presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, IL, April.
55. Wagner, R.K. and Sternberg, R.J. (1985), "Practical intelligence in real world pursuits: the role of tacit knowledge", Journal of Personality and Social Psychology, Vol. 49 No. 2, pp. 436-58.
56. Weekley, J.A. and Jones, C. (1997), "Video-based situational testing", Personnel Psychology, Vol. 50 No. 1, pp. 25-49.
57. Weekley, J.A. and Jones, C. (1999), "Further studies of situational tests", Personnel Psychology, Vol. 52 No. 3, pp. 679-700.
58. Weekley, J.A. and Ployhart, R.E. (2006), Situational Judgment Tests: Theory, Measurement and Application, Jossey-Bass, San Francisco, CA.