Situational Judgment Test

International Encyclopedia of the Social & Behavioral Sciences: Second Edition

Volumn , Issue , 2015, Pages 13-19

  Lievens, Filip ^a   De Soete, Britt ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Construct related validity; Criterion related validity; Diversity; Human resource management; Incremental validity; Personnel selection; Prediction; Procedural knowledge; Reliability; Response format; Response instruction; Simulations; Situational judgment tests; Stimulus format; Subgroup differences; Test taker perceptions

Indexed keywords

EID: 85043442940     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-08-097086-8.25092-7     Document Type: Chapter

References (60)

1. Arthur W., Villado A.J. The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. Journal of Applied Psychology 2008, 93:435-442. 10.1037/0021-9010.93.2.435.
2. Becker T.E. Development and validation of a situational judgment test of employee integrity. International Journal of Selection and Assessment 2005, 13:225-232. 10.1111/j.1468-2389.2005.00319.x.
3. Bledow R., Frese M. A situational judgment test of personal initiative and its relationship to performance. Personnel Psychology 2009, 62:229-258. 10.1111/j.1744-6570.2009.01137.x.
4. Bobko P., Roth P.L., Buster M.A. Work sample selection tests and expected reduction in adverse impact: a cautionary note. International Journal of Selection and Assessment 2005, 13:1-10. 10.1111/j.0965-075X.2005.00295.x.
5. Bruce M.M. Examiner's Manual: Supervisory Practices Test 1974, Author, Larchmont, NY. rev. ed.
6. Callinan M., Robertson I.T. Work sample testing. International Journal of Selection and Assessment 2000, 8:248-260. 10.1111/1468-2389.00154.
7. Catano V.M., Brochu A., Lamerson C.D. Assessing the reliability of situational judgment tests used in high-stakes situations. International Journal of Selection and Assessment 2012, 20:333-346. 10.1111/j.1468-2389.2012.00604.x.
8. Cardall A.J. Preliminary Manual for the Test of Practical Judgment 1942, Science Research, Chicago.
9. Chan D., Schmitt N. Video-based versus paper-and-pencil method of assessment in situational judgment tests: subgroup differences in test performance and face validity perceptions. Journal of Applied Psychology 1997, 82:143-159. 10.1037/0021-9010.82.1.143.
10. Chan D., Schmitt N. Situational judgment and job performance. Human Performance 2002, 15:233-254. 10.1207/S15327043HUP1503_01.
11. Christian M.S., Edwards B.D., Bradley J.C. Situational judgement tests: constructs assessed and a meta-analysis of their criterion-related validities. Personnel Psychology 2010, 63:83-117. 10.1111/j.1744-6570.2009.01163.x.
12. Clevenger J., Pereira G.M., Wiechmann D., Schmitt N., Harvey V.S. Incremental validity of situational judgment tests. Journal of Applied Psychology 2001, 86:410-417. 10.1037/0021-9010.86.3.410.
13. Crook A.E., Beier M.E., Cox C.B., Kell H.J., Hanks A.R., Motowidlo S.J. Measuring relationships between personality, knowledge, and performance using single-response situational judgment tests. International Journal of Selection and Assessment 2011, 19:363-373. 10.1111/j.1468-2389.2011.00565.x.
14. Dean M.A., Bobko P., Roth P.L. Ethnic and gender subgroup differences in assessment center ratings: a meta-analysis. Journal of Applied Psychology 2008, 93:685-691. 10.1037/0021-9010-93.3.685.
15. De Meijer L.A.L. Ethnicity Effects in Police Officer Selection: Applicant, Assessor, and Selection-method Factors 2008, (Unpublished doctoral dissertation), Erasmus University, Rotterdam.
16. De Meijer L.A.L., Born M.P., van Zielst J., van der Molen H.T. Construct-driven development of a video-based situational judgment test for integrity a study in a multi-ethnic police setting. European Psychologist 2010, 15:229-236. 10.1027/1016-9040/a000027.
17. Fetzer M.S. Current research in advanced assessment technologies. Symposium Presented at the 27th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA April 2012.
18. File Q.W. The measurement of supervisory quality in industry. Journal of Applied Psychology 1945, 29:323-337. 10.1037/h0057397.
19. Greenberg S.H. Supervisory Judgment Test Manual 1963, U.S. Civil Service Commission, Washington, DC.
20. Hausknecht J.P., Day D.V., Thomas S.C. Applicant reactions to selection procedures: an updated model and meta-analysis. Personnel Psychology 2004, 57:639-683. 10.1111/j.1744-6570.2004.00003.x.
21. Hunter D.R. Measuring general aviation pilot judgment using a situational judgment technique. International Journal of Aviation Psychology 2003, 13:373-386. 10.1207/S15327108IJAP1304_03.
22. Kanning U.P., Grewe K., Hollenberg S., Hadouch M. From the subjects' point of view: reactions to different types of situational judgment items. European Journal of Psychological Assessment 2006, 22:168-176. 10.1027/1015-5759.22.3.168.
23. Lane S., Stone C.A. Performance assessments. Educational Measurement 2006, 387-431. American Council on Education and Praeger, Westport, CT. B. Brennan (Ed.).
24. Libbrecht N., Lievens F. Validity evidence for the situational judgment test paradigm to emotional intelligence measurement. International Journal of Psychology 2012, 47:438-447. 10.1080/00207594.2012.682063.
25. Libbrecht N., Lievens F., Carette B., Côté S.C. Emotional intelligence predicts success in medical school. Emotion 2014, 14:64-73.
26. Lievens F. International situational judgment tests. Situational Judgment Tests 2006, 279-300. Jossey-Bass, San Francisco. J. Weekley, R. Ployhart (Eds.).
27. Lievens F. Adjusting medical admission: assessing interpersonal skills via situational judgment tests. Medical Education 2013, 47:182-189. 10.1111/medu.12089.
28. Lievens F., Buyse T., Sackett P.R. The operational validity of a video-based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains. Journal of Applied Psychology 2005, 90:442-452. 10.1037/0021-9010.90.3.442.
29. Lievens, F., De Corte, W., Westerveld, L. Understanding the building blocks of selection procedures: effects of response fidelity on performance and validity. Journal of Management. , in press. doi:10.1177/0149206312463941.
30. Lievens F., De Soete B. Simulations. Handbook of Assessment and Selection 2012, 383-410. Oxford University Press. N. Schmitt (Ed.).
31. Lievens F., Patterson F. The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. Journal of Applied Psychology 2011, 96:927-940. 10.1037/a0023496.
32. Lievens F., Peeters H., Schollaert E. Situational judgment tests: a review of recent research. Personnel Review 2008, 37:426-441. 10.1108/00483480810877598.
33. Lievens F., Sackett P.R. Video-based versus written situational judgment tests: a comparison in terms of predictive validity. Journal of Applied Psychology 2006, 91:1181-1188. 10.1037/0021-9010.91.5.1181.
34. Lievens F., Sackett P.R. The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance. Journal of Applied Psychology 2012, 97:460-468. 10.1037/a0025741.
35. McDaniel M.A., Hartman N.S., Whetzel D.L., Grubb W.L. Situational judgment tests, response instructions, and validity: a meta-analysis. Personnel Psychology 2007, 60:63-91. 10.1111/j.1744-6570.2007.00065.x.
36. McDaniel M.A., Morgeson F.P., Finnegan E.B., Campion M.A., Braverman E.P. Use of situational judgment tests to predict job performance: a clarification of the literature. Journal of Applied Psychology 2001, 86:730-740. 10.1037//0021-9010.86.4.730.
37. McDaniel M.A., Psotka J., Legree P.J., Yost A.P., Week J.A. Toward an understanding of situational judgment item validity and group differences. Journal of Applied Psychology 2011, 96:327-336. 10.1037/a0021983.
38. Motowidlo S.J., Beier M.E. Differentiating specific job knowledge from implicit trait policies in procedural knowledge measured by a situational judgment test. Journal of Applied Psychology 2010, 95:321-333. 10.1037/a0017975.
39. Motowidlo S.J., Crook A.E., Kell H.J., Naemi B. Measuring procedural knowledge more simply with a single-response situational judgment test. Journal of Business and Psychology 2009, 24:281-288. 10.1007/s10869-009-9106-4.
40. Motowidlo S.J., Dunnette M.D., Carter G.W. An alternative selection procedure: the low-fidelity simulation. Journal of Applied Psychology 1990, 75:640-647. 10.1037/0021-9010.75.6.640.
41. Motowidlo S.J., Hooper A.C., Jackson H.L. A theoretical basis for situational judgment tests. Situational Judgment Tests 2006, 57-81. Jossey-Bass, San Francisco. J. Weekley, R. Ployhart (Eds.).
42. Northrop L.C. The Psychometric History of Selected Ability Constructs 1989, US.S. Office of Personnel Management, Washington, DC.
43. O'Connell M.S., Hartman N.S., McDaniel M.A., Grubb W.L., Lawrence A. Incremental validity of situational judgment tests for task and contextual job performance. International Journal of Selection and Assessment 2007, 15:19-29. 10.1111/j.1468-2389.2007.00364.x.
44. Olson-Buchanan J.B., Drasgow F., Moberg P.J., Mead A.D., Keenan P.A., Donovan M.A. Interactive video assessment of conflict resolution skills. Personnel Psychology 1998, 51:1-24. 10.1111/j.1744-6570.1998.tb00714.x.
45. Oostrom J.K., Born M.P., Serlie A.W., van der Molen H.T. Effects of individual differences on the perceived job relatedness of a cognitive ability test and a multimedia situational judgment test. International Journal of Selection and Assessment 2010, 18:394-406. 10.1111/j.1468-2389.2010.00521.x.
46. Oostrom J.K., Born M.Ph, Serlie A.W., Van der Molen H.T. Implicit trait policies in multimedia situational judgment tests of leadership skills: can they predict leadership behavior?. Human Performance 2012, 25:335-353. 10.1080/08959285.2012.703732.
47. Oswald F.L., Schmit N., Kim B.H., Ramsay L.J., Gillespie M.A. Developing a biodata measure and situational judgment inventory as predictors of college student performance. Journal of Applied Psychology 2004, 89:187-207. 10.1037/0021-9010.89.2.187.
48. Ployhart R.E., Ehrhart M.G. Be careful what you ask for: effects of response instructions on the construct validity and reliability of situational judgment tests. International Journal of Selection and Assessment 2003, 11:1-16. 10.1111/1468-2389.00222.
49. Prewett M.S., Brannick M.T., Peckler B. Training teamwork in medicine: an active approach with role play and feedback. Journal of Applied Social Psychology 2013, 43:316-328. 10.1111/j.1559-1816.2012.01001.x.
50. Richman-Hirsch W.L., Olson-Buchanan J.B., Drasgow F. Examining the impact of administration medium on examinee perceptions and attitudes. Journal of Applied Psychology 2000, 85:880-887. 10.1037//0021-9010.85.6.880.
51. Roth P.L., Bobko P., Buster M. Situational judgment tests: the influence and importance of applicant status and targeted constructs on estimates of Black-White subgroup differences. Journal of Occupational and Organizational Psychology 2013, 86:394-409. 10.1111/joop.12013.
52. Roth P.L., Bobko P., McFarland L., Buster M. Work sample tests in personnel selection: a meta-analysis of Black-White differences in overall and exercise scores. Personnel Psychology 2008, 61:637-661. 10.1111/j.1744-6570.2008.00125.x.
53. Sackett P.R., Lievens F. Personnel selection. Annual Review of Psychology 2008, 59:419-445.
54. Sharma S., Gangopadhya M., Austin E., Mandal M.K. Development and validation of a situational judgment test of emotional intelligence. International Journal of Selection and Assessment 2013, 21:57-73. 10.1111/ijsa.12017.
55. Weekley J.A., Jones C. Video-based situational testing. Personnel Psychology 1997, 50:25-49. 10.1111/j.1744-6570.1997.tb00899.x.
56. Weekley J.A., Jones C. Further studies of situational tests. Personnel Psychology 1999, 52:679-700. 10.1111/j.1744-6570.1999.tb00176.x.
57. Weekley J.A., Ployhart R.E., Harold C.M. Personality and situational judgment tests across applicant and incumbent settings: an examination of validity, measurement, and subgroup differences. Human Performance 2004, 17:433-461. 10.1207/s15327043hup1704_5.
58. Weekley J., Ployhart R.E. Situational Judgment Tests 2006, Jossey-Bass, San Francisco.
59. Whetzel D.L., McDaniel M.A. Situational judgment tests: an overview of current research. Human Resource Management Review 2009, 19:188-202.
60. Whetzel D.L., McDaniel M.A., Nguyen N.T. Subgroup differences in situational judgment test performance: a meta-analysis. Human Performance 2008, 21:291-309. 10.1080/08959280802137820.