Situational judgment tests: Validity and an integrative model

Situational Judgment Tests: Theory, Measurement, and Application

Volumn , Issue , 2013, Pages 183-203

  McDaniel, Michael A ^a   Whetzel, Deborah L ^b   Hartman, Nathan S ^c   Nguyen, Nhung T ^d   Grubb, W Lee ^e  

^a VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

^b Work Skills First Inc   (United States)

^c JOHN CARROLL UNIVERSITY   (United States)

^d TOWSON UNIVERSITY   (United States)

^e EAST CAROLINA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84920809799     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203774878     Document Type: Chapter

References (46)

1. Alignmark. (2001). Accuvision customer service system validation Report. Maitland, FL: Author.
2. Becker, B. J. (In press). The failsafe N or file-drawer number. In H. Rothsetin, A. J. Sutton, & M. Borenstein, Publication bias in meta-analysis: Prevention, assessment and adjustments. New York: Wiley.
3. Berlin J. A., & Ghersi D. (In press). Preventing publication bias: Registries and prospective meta-analysis. In H. Rothsetin, A. J. Sutton, & M. Borenstein, Publication bias in metaanalysis: Prevention, assessment and adjustments. New York: Wiley.
4. Binning, J. F., & Barrett, G. V. (1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478–494.
5. Cardall, A. J. (1942). Preliminary manual for the Test of Practical Judgment. Chicago: Science Research Associates.
6. Carrington, D. H. (1949). Note on the Cardall Practical Judgment Test. Journal of Applied Psychology, 33, 29–30.
7. Chan, D., & Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions. Journal of Applied Psychology, 82, 143–159.
8. Chan, D., & Schmitt, N. (2002). Situational judgment and job performance. Human Performance, 15, 233–254.
9. Clevenger, J., Pereira, G. M., Wiechmann, D., Schmitt, N., & Schmidt Harvey, V. (2001). Incremental validity of situational judgment tests. Journal of Applied Psychology, 86, 410–417.
10. Dalessio, A. T. (1994). Predicting insurance agent turnover using a video-based situational judgment test. Journal of Business and Psychology, 9, 23–32.
11. Dickerson, K. (In press). Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm. In H. Rothsetin, A. J. Sutton, & M. Borenstein, Publication bias in meta analysis: Prevention, assessment and adjustments. New York: Wiley.
12. Duval, S. (In press). The "Trim and Fill" method. In H. Rothsetin, A. J. Sutton, & M. Borenstein, Publication bias in meta analysis: Prevention, assessment and adjustments. New York: Wiley.
13. Gottfredson, L. S. (1996). Racially gerrymandering the content of police tests to satisfy the U. S. Justice Department: A case study. Psychology, Public Policy, and Law, 2, 418–446.
14. Gottfredson, L. S. (2003). Dissecting practical intelligence theory: Its claims and evidence. Intelligence, 31, 343–397.
15. Halpern, S. D., & Berlin J. A. (In press). Beyond Conventional Publication Bias: Other Determinants of Data Suppression. In H. Rothsetin, A. J. Sutton, & M. Borenstein (Eds). Publication Bias in Meta Analysis: Prevention, Assessment and Adjustments. Wiley.
16. Hedges, L., & Vevea, J. (In press). The selection model approach to publication bias. In H. Rothsetin, A. J. Sutton, & M. Borenstein, Publication bias in meta analysis: Prevention, assessment and adjustments. New York: Wiley.
17. McDaniel, M. A., Hartman, N. S., & Grubb W. L. Iii. (2003, April). Situational judgment tests, knowledge, behavioral tendency, and validity: A meta-analysis. Paper presented at the 18th annual conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
18. McDaniel, M. A., Morgeson, F. R, Finnegan, E. B., Campion, M. A., & Braverman, E. P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, 730–740.
19. McDaniel, M. A., & Nguyen, N. T. (2001). Situational judgment tests: A review of practice and constructs assess International Journal of Selection and Assessment, 9, 103–113.
20. McDaniel, M. A., & Whetzel, D. L. (In press). Situational judgment research: Informing the debate on practical intelligence theory. Intelligence, 33, 515–525.
21. Moss, F. A. (1926). Do you know how to get along with people? Why some people get ahead in the world while others do not. Scientific American, 135, 26–27.
22. Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75, 640–647.
23. Nguyen, N. T., McDaniel, M. A., & Whetzel, D. L. (2005, April). Subgroup differences in situational judgment test performance: A meta-analysis. Paper presented at the 20th annual conference of the society, for Industrial and Organizational Psychology, Los Angeles.
24. Northrop, L. C. (1989). The psychometric history of selected ability constructs. Washington, DC: U. S. Office of Personnel Management.
25. O'Connell, M. S., McDaniel, M. A., Grubb, W. L., Hartman, N. S., & Lawrence, A. (2002, April). Incremental validity of situational judgment tests for task and contextual performance. Paper presented at the 17th annual conference of the Society of Industrial Organizational Psychology, Toronto, Canada.
26. Olson-Buchanan, J. B., Drasgow, F., Moberg, P. J., Mead, A. D., Keenan, P. A., & Donovan, M. A. (1998). Interactive video assessment of conflict resolution skills. Personnel Psychology, 52, 1–24.
27. Ployhart, R. E., & Ryan, A. M. (2000, April). Integrating personality tests with situational judgment tests for the prediction of customer service performance. Paper presented at the 15th annual conference of the Society for Industrial and Organizational Psychology, New Orleans, LA.
28. Porr, W. B., & Ployhart, R. E. (2004, April). The validity of empirically and construct-oriented situational judgment tests. Paper presented at the 19th annual conference of the Society for Industrial and Organizational Psychology, Chicago, IL.
29. Robie, C., Bom, M. P., & Schmit, M. J. (2001). Personal and situational determinants of personality responses: A partial reanalysis and reinterpretation of the Schmit et al. (1995) data. Journal of Business & Psychology, 16, 101–117.
30. Robie, C., Schmit, M. J., Ryan, A. M., & Zickar, M. J. (2000). Effects of item context specificity on the measurement equivalence of a personality inventory. Organizational Research Methods, 34, 348–365.
31. Roth, P. L., BeVier, C. A., Bobko, P., Switzer, F. S. Ill, & Tyler, P. (2001). Ethnic group differences in cognitive ability in employment and educational settings: A meta-analysis. Personnel Psychology, 54, 297–330.
32. Sacco, J. M., Scheu, C. R., Ryan, A. M., Schmitt, N., Schmidt, D. B., & Rogg, K. L. (2000, April). Reading level and verbal test scores as predictors of subgroup differences and validities of situational judgment tests. Paper presented at thel5th Annual Conference of the Society of Industrial and Organizational Psychology, New Orleans, LA.
33. Schmidt, F. L., & Hunter, J. E. (1993). Tacit knowledge, practical intelligence, general mental ability, and job knowledge. Current Directions in Psychological Science, 2, 8–9.
34. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262–274.
35. Schmit, M. J., Ryan, A. M., Stierwalt, S. L., & Powell, A. B. (1995). Frame-of-reference effects on personality scale scores and criterion-related validity. Journal of Applied Psychology, 80, 607–620.
36. Smith, K. C., & McDaniel, M. A. (1998, April). Criterion and construct validity evidence for a situational judgment measure. Paper presented at the 13th annual convention of the Society for Industrial and Organizational Psychology, Dallas, TX.
37. Sternberg, R. J., Forsythe, G. B., Hedlund, J., Horvath, J. A., Wagner, R. K., Williams, W. M., Snook, S. A., & Grigorenko, E. L. (2000). Practical intelligence in everyday life. New York: Cambridge University Press.
38. Sterne, J. A. C. & Egger, M., Regression methods to detect publication and other bias in meta-analysis. In H. Rothsetin, A. J. Sutton, & M. Borenstein, Publication bias in meta analysis: Prevention, assessment and adjustments. New York: Wiley.
39. Stevens, M. J., & Campion, M. A. (1999). Staffing work teams: Development and validation of a selection test for teamwork settings. Journal of Management, 25, 207–208.
40. Taylor, H. R. (1949). Test of practical judgment. In O. K. Buros, The third mental measurements yearbook (pp. 694–695). New Brunswick, NJ: Rutgers University Press.
41. Thorndike, R. L., & Stein, S. (1937). An evaluation of the attempts to measure social intelligence. Psychological Bulletin, 34, 275–285.
42. Wagner, R. K., & Sternberg, R. J. (1991). Tacit Knowledge Inventory for Managers: User manual. San Antonio, TX: The Psychological Corporation.
43. Weekley, J. A., & Jones, C. (1997). Video-based situational testing. Personnel Psychology, 50, 25–49.
44. Weekley, J. A., & Jones, C. (1999). Further studies of situational tests. Personnel Psychology, 52, 679–700.
45. Weekley, J. A. & Ployhart, R. E. (2005). Situational judgment: Antecedents and relationships with performance, Human performance, 18, 81–104.
46. Wernimont, P. F., & Campbell, J. P. (1968). Signs, samples, and criteria. Journal of Applied Psychology, 52, 372–376.