Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions

Journal of Applied Psychology

Volumn 82, Issue 1, 1997, Pages 143-159

  Chan, David ^a   Schmitt, Neal ^b  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

AFRICAN AMERICAN; ARTICLE; CAUCASIAN; COMPARATIVE STUDY; DECISION MAKING; FACE; FEMALE; HUMAN; MALE; RACE; READING; TASK PERFORMANCE; VIDEORECORDING; VISION;

AFRICAN AMERICANS; CONTINENTAL POPULATION GROUPS; EUROPEAN CONTINENTAL ANCESTRY GROUP; FACE; FEMALE; HUMANS; JUDGMENT; MALE; READING; TASK PERFORMANCE AND ANALYSIS; VIDEOTAPE RECORDING; VISUAL PERCEPTION;

EID: 0031066209     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.82.1.143     Document Type: Article

References (57)

1. Alwin, D. F., & Jackson, D. J. (1981). Application of simultaneous factor analysis to issues of factor invariance. In D. J. Jackson & E. F. Borgatta (Eds.), Factor analysis and measurement in sociological research (pp. 249-279). Beverly Hills, CA: Sage.
2. Arvey, R. D., Strickland, W., Drauden, G., & Martin, C. (1990). Motivational components of test taking. Personnel Psychology, 43, 695-716.
3. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
4. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
5. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
6. Brown, J., Bennet, J., & Hanna, G. (1993). The Nelson-Denny Reading Test. Lombard, IL: Riverside.
7. Brown, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
8. Bruce, M. M., & Learner, D. B. (1958). A supervisory practices test. Personnel Psychology, 11, 207-216.
9. Cascio, W. F. (1987). Applied psychology in personnel management (3rd ed.). Englewood Cliffs, NJ: Prentice-Hall.
10. Chan, D., Schmitt, N., DeShon, R. P., Clause, S. C., Delbridge, K. (in press). Reactions to cognitive ability tests: The relationships between race, test performance, face validity, and test-taking motivation. Journal of Applied Psychology.
11. Cleary, T. A. (1968). Test bias: Prediction of grades of Negro and White students in integrated colleges. Journal of Educational Measurement, 5, 115-124.
12. Cohen, J. (1977). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
14. Cohen, J., & Cohen, P. (1983). Applied MRC analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
15. Costa, P. T., Jr., & McRae, R. R. (1992). NEO Personality Inventory - Revised Professional Manual. Revised NEO Personality Inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI). Odessa, FL: Psychological Assessment Resources.
16. Cronbach, L. J. (1947). Test "reliability": Its meaning and determination. Psychometrika, 12, 1-16.
17. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
18. Dalessio, A. T. (1994). Predicting insurance agent turnover using a video-based situational judgment test. Journal of Business and Psychology, 9, 23-32.
19. Dodd, W. E. (1977). Attitudes toward assessment center programs. In J. L. Moses & W. C. Byham (Eds.), Applying the assessment center method (pp. 161-183). New York: Pergamon Press.
20. Drasgow, F. (1984). Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are central issues. Psychological Bulletin, 95, 134-135.
21. Drasgow, F. (1987). Study of the measurement bias of two standardized psychological tests. Journal of Applied Psychology, 72, 19-29.
22. Dyer, P. J., Desmarais, L. B., & Midkiff, K. R. (1993, May). Multimedia employment testing in IBM: Preliminary results from employees. Paper presented at the 8th Annual Conference of the Society for Industrial and Organizational Psychology, San Francisco.
23. File, Q. W., & Remmer, H. H. (1971). How supervise? manual (rev. ed.). New York: Psychological Corp.
24. Gaugler, B. B., Rosenthal, D. B., Thornton, G. C., & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493-511.
25. Goldstein, H. W., Braverman, E. P., & Chung, B. (1992, May). Method versus content: The effects of different testing methodologies on subgroup differences. Paper presented at the 7th Annual Conference of the Society for Industrial and Organizational Psychology, Montreal, Quebec, Canada.
26. Helms, J. E. (1992). Why is there no study of cultural equivalence in standardized cognitive ability testing? American Psychologist, 47, 1083-1101.
27. Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
28. James, L. R., & James, L. A. (1989). Causal modeling in organizational research. In C. L. Copper & I. Robertson (Eds.), International review of industrial and organizational psychology (pp. 371-404). Chichester, England: Wiley.
29. Jensen, A. R. (1980). Bias in mental testing. New York: Free Press.
30. Jöreskog, K., & Sörbom, D. (1986). LISREL 6: Analysis of linear structural relationships by maximum likelihood and least square methods. Mooresville, IN: Scientific Software.
31. Jöreskog, K., & Sörbom, D. (1989). LISREL 7: A guide to the program and applications (2nd ed.). Chicago: SPSS.
32. Jöreskog, K., & Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language. Chicago: Scientific Software.
33. Kelloway, E. K. (1996). Common practices in structural equation modeling. In C. L. Copper & I. Robertson (Eds.), International review of industrial and organizational psychology (pp. 141-180). Chichester, England: Wiley.
34. Loehlin, J. C., Lindzey, G., & Spuhler, J. M. (1975). Race differences in intelligence. San Francisco: Freeman.
35. Macan, T. H., Avedon, M. J., Paese, M., & Smith, D. E. (1994). The effects of applicants' reactions to cognitive ability tests and an assessment center. Personnel Psychology, 47, 715-738.
36. Matthews, D. B. (1991). Learning styles research: Implications for increasing students in teacher education programs. Journal of Instructional Psychology, 18, 228-236.
37. McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616.
38. Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75, 640-647.
39. Motowidlo, S. J., & Tippins, N. (1993). Further studies of the low-fidelity simulation in the form of a situational inventory. Journal of Occupational and Organizational Psychology, 66, 337-344.
40. Pulakos, E. D., & Schmitt, N. (1996). An evaluation of two strategies for reducing adverse impact and their effects on criterion-related validity. Human Performance, 9, 241-258.
41. Reilly, R. R., & Chao, G. T. (1982). Validity and fairness of some alternative employee selection procedures. Personnel Psychology, 35, 1-62.
42. Robertson, I. T., & Kandola, R. S. (1982). Work sample test: Validity, adverse impact and applicant reaction. Journal of Occupational Psychology, 55, 171-183.
43. Schmidt, F. L., Greenthal, A. L., Hunter, J. E., Berner, J. G., & Seaton, F. W. (1977 ). Job samples vs. paper-and-pencil trade and technical tests: Adverse impact and examinee attitudes. Personnel Psychology, 30, 187-197.
44. Schmidt, F. L., & Hunter, J. E. (1981). Employment testing: Old theories and new research findings. American Psychologist, 36, 1128-1137.
45. Schmitt, N., Clause, C. S., & Pulakos, E. D. (1996). Subgroup differences associated with different measures of some common job relevant constructs. In C. L. Cooper & I. T. Robertson (Eds.), International review of industrial and organizational psychology (pp. 115-140). New York: Wiley.
46. Schmitt, N., Gooding, R. Z., Noe, R. A., & Kirsch, M. P. (1984). Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407-422.
47. Scott, R. (1987). Gender and race achievement profiles of Black and White third-grade students. Journal of Psychology, 121, 629-634.
48. Smiderle, D., Perry, B. A., & Cronshaw, S. F. (1994). Evaluation of video-based assessment in transit operator selection. Journal of Business and Psychology, 9, 3-22.
49. Smither, J. W., Reilly, R. R., Millsap, R. E., Pearlman, K., & Stoffey, R. W. (1993). Applicant reactions to selection procedures. Personnel Psychology, 46, 49-76.
50. Society for Industrial and Organizational Psychology (1987). Principles for the validation and use of personnel selection procedures (3rd ed.). College Park, MD: Author.
51. Sörbom, D. (1974). A general method for studying differences in factor means and factor structures between groups. British Journal of Mathematical and Statistical Psychology, 27, 229-239.
52. Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180.
53. Tenopyr, M. L. (1969). The comparative validity of selected leadership skills relative to success in production management. Personnel Psychology, 22, 77-85.
54. Thorndike, R. L. (1949). Personnel selection: Test and measurement technique. New York: Wiley.
55. Uniform Guidelines on Employee Selection. (1978). Federal Register, 43, 38290-38315.
56. Wilson Learning. (1990). Validation report for the Teller Assessment Program (TAP). Longwood, FL: Author
57. Wonderlic, E. F. (1984). Wonderlic Personnel Test manual. Northfield, IL: Wonderlic & Associates.