Construct-driven development of a video-based situational judgment test for integrity : A study in a multi-ethnic police setting

European Psychologist

Volumn 15, Issue 3, 2010, Pages 229-236

  De Meijer, Lonneke A L ^a   Born, Marise P ^a   Van Zielst, Jaap ^b   Van Der Molen, Henk T ^c  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^b Centre for Competence Assessment and Monitoring at the Police Academy   (Netherlands)

^c ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

Author keywords

Construct validity; Ethnicity; Integrity; Situational judgment test

Indexed keywords

EID: 77956285805     PISSN: 10169040     EISSN: None     Source Type: Journal    
DOI: 10.1027/1016-9040/a000027     Document Type: Article

References (39)

1. Arbuckle, J. L. (2005). Amos 6.0 [Computer software]. Chicago: Smallwaters.
2. Barriga, A. Q., & Gibbs, J. C. (1996). Measuring cognitive distortions in antisocial youth: Development and preliminary validation of the "How-I-Think" questionnaire. Aggressive Behavior, 22(3), 333-343.
3. Barriga, A. Q., Gibbs, J. C., Potter, G. B., & Liau, A. K. (2001).
4. Becker, T. E. (2005). Development and validation of a situational judgment test of employment integrity. International Journal of Selection and Assessment, 13(3), 225-232.
5. Chan, D., & Schmitt, N. (1997). Video-based versus paper-andpencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perception. Journal of Applied Psychology, 82(1), 143-159.
6. Chan, D., & Schmitt, N. (2005). Situational judgment tests. In A. Evers, N. Anderson, & O. Voskuijl (Eds.), Handbook of personnel selection (pp. 219-246). Oxford: Blackwell.
7. Clevenger, J., Pereira, G. M., Wiechmann, D., Schmitt, N., & Harvey, V. S. (2001). Incremental validity of situational judgment tests. Journal of Applied Psychology, 86(3), 410-417.
8. Cohen, J. (1988). Standard power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
9. Dalessio, A. T. (1994). Predicting insurance agent turnover using a video-based situational judgment test. Journal of Business and Psychology, 9(1), 23-32.
10. De Meijer, L. A. L., Born, M. Ph., Terlouw, G., & Van der Molen, H. T. (2006). Applicant and method factors related to ethnic score differences in personnel selection: A study at the Dutch police. Human Performance, 19(3), 219-251.
11. Fortmann, K., Leslie, C., & Cunningham, M. (2002). Crosscultural comparisons of the Reid Integrity Scale in Latin America and South Africa. International Journal of Selection and Assessment, 10(1/2), 98-108.
12. Jones, J. W., Brasher, E. E., & Huff, J. W. (2002). Innovations in integrity-based personnel selection: Building a technologyfriendly assessment. International Journal of Selection and Assessment, 10(1/2), 87-97.
13. Lee, K., & Ashton, M. C. (2004). Psychometric properties of the HEXACO personality inventory. Multivariate Behavioral Research, 39(2), 329-358.
14. Lee, K., Ashton, M. C., & De Vries, R. E. (2005). Predicting workplace delinquency and integrity with the HEXACO and five-factor models of personality structure. Human Performance, 18(2), 179-197.
15. Lee, K., Ashton, M. C., Morrison, D. L., Cordery, J., & Dunlop, P. D. (2008). Predicting integrity with the HEXACO personality model: Use of self- and observer reports. Journal of Occupational and Organizational Psychology, 81(1), 147-167.
16. Lem, J., & Van Doorn, E. (2000). Voortgangsrapportage.Onderzoek "kenmerkende voorspellers" politie [Progress report. Study "noticeable predictors" police]. Culemborg, The Netherlands: Meurs Personeelsadvies.
17. Lievens, F., & Sackett, P. R. (2006). Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of Applied Psychology, 91(5), 1181-1188.
18. Marcus, B., Lee, K., & Ashton, M. C. (2007). Personality dimensions explaining relationships between integrity tests and counterproductive behavior: Big Five, or one in addition? Personnel Psychology, 60(1), 1-34.
19. McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb, W. L. III (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1), 63-91.
20. McDaniel, M. A., Morgeson, F. P., Bruhn Finnegan, E., Campion, M. A., & Braverman, E. P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86(4), 730-740.
21. McDaniel, M. A., & Nguyen, N. T. (2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9(1/2), 103-113.
22. Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation.Journal of Applied Psychology, 75(6), 640-647.
23. Naeyé, J., Huberts, L., Van Zweden, C., Busato, V., & Berger, B.(2004). Integriteit in het dagelijkse politiework [Integrity during daily police work]. Amsterdam: Vrije Universiteit.
24. Nguyen, N. T., & McDaniel, M. A. (2003). Response instructions and racial differences in a situational judgment test.Applied H.R.M. Research, 8(1), 33-44.
25. Occupational Information Network (O*NET). (2009, May 6).OnLine developed for the US Department of Labor by the National O*NET Consortium. Retrieved May 6, 2009, from http://www.online.onetcenter.org.
26. O'Connell, M. S., Hartman, N. S., McDaniel, M. A., Grubb, W. L., & Lawrence, A. III (2007). Incremental validity of situational judgment tests for task and contextual performance.International Journal of Selection and Assessment, 15(1), 19-29.
27. Olson-Buchanan, J. B., Drasgow, F., Moberg, P. J., Mead, A. D., Keenan, P. A., & Donovan, M. A. (1998). An interactive video assessment of conflict resolution skills. Personnel Psychology, 51(1), 1-24.
28. Ones, D. S. (1993). The construct validity evidence for integrity tests. University of Iowa. Iowa City: Unpublished doctoral dissertation.
29. Ones, D. S., & Viswesvaran, C. (1998). Gender, age, and race differences on overt integrity tests: Results across four largescale job applicant data sets. Journal of Applied Psychology, 83(1), 35-42.
30. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance [Monograph]. Journal of Applied Psychology, 78(4), 679-703.
31. Richman-Hirsch, W. L., Olson-Buchanan, J. B., & Drasgow, F.(2000). Examining the impact of administration medium on examinee perceptions and attitudes. Journal of Applied Psychology, 85(6), 880-887.
32. Rijks Psychologische Dienst. (1975). Politie intelligentie test [Police intelligence test]. The Hague, The Netherlands: RPD.
33. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel selection: Practical and theoretical implications of 85 years of research findings.Psychological Bulletin, 124(2), 262-274.
34. Van der Maesen, P. E. A. M. (1992). Het rendement van personeelsselectie [The efficiency of personnel selection].The Netherlands: Rijksuniversiteit Groningen, Unpublished doctoral dissertation.
35. Van de Vijver, A. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage.
36. Van Iddekinge, C. H., Taylor, M. A., & Eidson, C. E., Jr. (2005).Broad versus narrow facets of integrity: Predictive validity and subgroup differences. Human Performance, 18(2), 151-177.
37. Wanek, J. E. (1999). Integrity and honesty testing: What do we know? How do we use it? International Journal of Selection and Assessment, 7(4), 183-195.
38. Weekley, J. A., & Jones, C. (1997). Video-based situational judgment testing. Personnel Psychology, 50(1), 25-49.
39. Weekley, J. A., & Jones, C. (1999). Further studies of situational tests. Personnel Psychology, 52(3), 679-700.