Webcam testing: Validation of an innovative open-ended multimedia test

European Journal of Work and Organizational Psychology

Volumn 19, Issue 5, 2010, Pages 532-550

  Oostrom, Janneke K ^a   Born, Marise Ph ^a   Serlie, Alec W ^b   van der Molen, Henk T ^a  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^b ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

Author keywords

Multimedia testing; Personnel selection; Video testing; Webcam testing

Indexed keywords

EID: 77956704528     PISSN: 1359432X     EISSN: 14640643     Source Type: Journal    
DOI: 10.1080/13594320903000005     Document Type: Article

References (40)

1. Anderson, N. (2003). Applicant and recruiter reactions to new technology in selection: A critical review and agenda for future research. International Journal of Selection and Assessment, 11(2-3), 121-136.
2. Bergman, M. E., Drasgow, F., Donovan, M. A., Henning, J. B., & Juraska, S. E. (2006). Scoring situational judgment tests: Once you get the data, your troubles begin. International Journal of Selection and Assessment, 14(3), 223-235.
3. Bernardin, H. J., & Buckley, M. R. (1981). Strategies in rater training. Academy of Management Review, 6(2), 205-212.
4. Borman, W. C., White, L. A., Pulakos, E. D., & Oppler, S. H. (1991). Models of supervisory job performance ratings. Journal of Applied Psychology, 76(6), 863-872.
5. Chan, D., & Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions. Journal of Applied Psychology, 82(1), 143-159.
6. Chan, D., & Schmitt, N. (2005). Situational judgment tests. In A. Evers, O. Smit-Voskuil, & N. Anderson (Eds.), Handbook of personnel selection (pp. 219-242). Oxford, UK: Blackwell.
7. Clevenger, J., Pereira, G. M., Wiechmann, D., Schmitt, N., & Harvey, V. S. (2001). Incremental validity of situational judgment tests. Journal of Applied Psychology, 86(3), 410-417.
8. Dalessio, A. T. (1994). Predicting insurance agent turnover using a video-based situational judgment test. Journal of Business and Psychology, 9, 23-32.
9. Funke, U., & Schuler, H. (1998). Validity of stimulus and response components in a video test of social competence. International Journal of Selection and Assessment, 6(2), 115-123.
10. Goldstein, H. W., Braverman, E. P., & Chung, B. (1992, May). Method versus content: The effects of different testing methodologies on subgroup differences. Paper presented at the 7th annual conference of the Society for Industrial and Organizational Psychology, Montreal, Quebec, Canada.
11. Lievens, F., & Coetsier, P. (2002). Situational tests in student selection: An examination of predictive validity, adverse impact, and construct validity. International Journal of Selection and Assessment, 10(4), 245-257.
12. Lievens, F., & Sackett, P. R. (2006). Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of Applied Psychology, 91(5), 1181-1188.
13. Lievens, F., & Thornton III, G. C., III. (2005). Assessment centers: Recent developments in practice and research. In A. Evers, O. Smit-Voskuijl, & N. Anderson (Eds.), Handbook of selection (pp. 243-264). London: Blackwell.
14. Lievens, F., van Dam, K., & Anderson, N. (2002). Recent trends and challenges in personnel selection. Personnel Review, 31(5), 580-601.
15. Maurer, T. J. (2001). Career-relevant learning and development, worker age, and beliefs about self-efficacy for development. Journal of Management, 27, 123-140.
16. McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb III, W. L., III. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1),63-91.
17. McDaniel, M. A., & Nguyen, N. T. (2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9(1&2), 103-113.
18. McHenry, J. J., & Schmitt, N. (1994). Multimedia testing. In M. G. Rumsey & C. B. Walker (Eds.), Personnel selection and classification (pp. 193-232). Hillsdale, NJ: Erlbaum.
19. Meltzer, P. H. (1995). Videotest voor communicatieve vaardigheden. In F. J. R. C. Dochy & T. R. de Rijke (Eds.), Assessment centers: Nieuwe toepassingen in opleiding, onderwijs en HRM (pp. 109-122). Utrecht, The Netherlands: Lemma.
20. Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75(6), 640-647.
21. Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006). Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items. Journal of Applied Psychology, 91(4), 749-761.
22. Murphy, K. R., & Shiarella, A. H. (1997). Implications of the multidimensional nature of job performance for the validity of selection tests: Multivariate frameworks for studying test validity. Personnel Psychology, 50(4), 823-854.
23. Nguyen, N. T., McDaniel, M. A., & Whetzel, D. L. (2005, April). Subgroup differences in situational judgment test performance: A meta-analysis. Paper presented at the 20th annual conference of the Society for Industrial and Organizational Psychology.
24. Olson-Buchanan, J. B., & Drasgow, F. (2006). Multimedia situational judgment tests: The medium creates the message. In J. A. Weekley & R. E. Ployhart (Eds.), Situational judgment tests: Theory, measurement, and application (pp. 253-278). Mahwah, NJ: Erlbaum.
25. Olson-Buchanan, J. B., Drasgow, F., Moberg, P. J., Mead, A. D., Keenan, P. A., & Donovan, M. A. (1998). Interactive video assessment of conflict resolution skills. Personnel Psychology, 51(1),1-24.
26. Ployhart, R. E., & Ehrhart, M. G. (2003). Be careful what you ask for: Effects of response instructions on the construct validity and reliability of situational judgment tests. International Journal of Selection and Assessment, 11(1), 1-16.
27. Richman-Hirsch, W. L., Olson-Buchanan, J. B., & Drasgow, F. (2000). Examining the impact of administration medium on examinee perceptions and attitudes. Journal of Applied Psychology, 85(6), 880-887.
28. Salgado, J. F., & Lado, M. (2000, April). Validity generalization of video tests for predicting job performance ratings. Paper presented at the 15th annual conference of the Society of Industrial and Organizational Psychology.
29. Schmidt, F. L. (1994). The future of personnel selection in the US Army. In M. G. Rumsey, C. B. Walker, & J. H. Harris (Eds.), Personnel selection and classification (pp. 333-350). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
30. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262-274.
31. Schmidt, F. L., Hunter, J. E., & Outerbridge, A. N. (1986). Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance. Journal of Applied Psychology, 71(3), 432-439.
32. Schmitt, N., & Chan, D. (1999). The status of research on applicant reactions to selection tests and its implications for managers. International Journal of Management Reviews, 1(1), 45-62.
33. Schmitt, N., & Ostroff, C. (1986). Operationalizing the "behavioral consistency" approach: Selection test development based on a content-oriented strategy. Personnel Psychology, 39(1),91-108.
34. Stricker, L. J. (1982). Interpersonal competence instrument: Development and preliminary findings. Applied Psychological Measurement, 6(1), 69-81.
35. Wagner, R. K. (1987). Tacit knowledge in everyday intelligent behavior. Journal of Personality and Social Psychology, 52(6), 1236-1247.
36. Wagner, R. K., & Sternberg, R. J. (1985). Practical intelligence in real-world pursuits: The role of tacit knowledge. Journal of Personality and Social Psychology, 49(2), 436-458.
37. Weekley, J. A., & Jones, C. (1997). Video-based situational testing. Personnel Psychology, 50(1), 25-49.
38. Weekley, J. A., & Jones, C. (1999). Further studies of situational tests. Personnel Psychology, 52(3),679-700.
39. Weekley, J. A., & Ployhart, R. E. (2005). Situational judgment: Antecedents and relationships with performance. Human Performance, 18(1), 81-104.
40. Weekley, J. A., & Ployhart, R. E. (2006). Situational judgment tests: Theory, measurement, and application. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.