Assessment Center Exercise Factors Represent Cross-Situational Specificity, Not Method Bias

Human Performance

Volumn 13, Issue 4, 2000, Pages 323-353

  Lance, Charles E ^a   Newbolt, William H ^b   Gatewood, Robert D ^b   Foster, Mark R ^b   French, Nita R ^b   Smith, David E ^b  

^a University of Georgia ^*  (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034376812     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15327043HUP1304_1     Document Type: Article

References (80)

1. Archambeau, D. J. (1979). Relationships among skill ratings in an assessment center. Journal of Assessment Center Technology, 2, 7-20.
2. Bagozzi, R. P., & Yi, Y. (1990). Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. Journal of Applied Psychology, 75, 547-560.
3. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
4. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
5. Brannick, M. T., & Spector, P. E. (1990). Estimation problems in the block-diagonal model of the multitrait-multimethod matrix. Applied Psychological Measurement, 14, 325-339.
6. Browne, M. W., & Cudeck, R. (1993). Alternate ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
7. Burke, M. J., Rupinski, M. T., Dunlap, W. P., & Davison, H. K. (1996). Do situational variables act as substantive causes of relationships between individual difference variables? Two large-scale tests of "common cause" models. Personnel Psychology, 49, 573-598.
8. Bycio, P., Alvares, K. M., & Hahn, J. (1987). Situational specificity in assessment center ratings: A confirmatory factor analysis. Journal of Applied Psychology, 72, 463-474.
9. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
10. Cattell, R. B. (1966). The data box: It's ordering of total resources in terms of possible relational systems. In R. B. Cattell (Ed.), Handbook of multivariate experimental psychology (pp. 67-128). Chicago: Rand McNally.
11. Collins, J. (1998). Prediction of overall assessment center evaluations from ability, personality, and motivation measures: A meta-analysis. Unpublished manuscript, Texas A&M University, College Station, TX.
12. Conway, J. (1996). Analysis and design of multitrait-multirater performance appraisal studies. Journal of Management, 22, 139-162.
13. Crampton, S., & Wagner, J. (1994). Percept-percept inflation in microorganizational research: An investigation of prevalence and effect. Journal of Applied Psychology, 79, 67-76.
14. Donahue, L. M., Truxillo, D. M., Cornwell, J. M., & Gerrity, M. J. (1997). Assessment center validity and behavioral checklists: Some additional findings. Journal of Social Behavior and Personality, 12, 85-108.
15. Doty, D. H., & Glick, W. H. (1998). Common methods bias: Does common methods variance really bias results? Organizational Research Methods, 1, 374-406.
16. Dye, D. A., Reck, M., & McDaniel, M. (1993). The validity of job knowledge measures. International Journal of Selection and Assessment, 1, 153-162.
17. Epstein, S., & O'Brien, E. J. (1985). The person-situation debate in historical and current perspective. Psychological Bulletin, 98, 513-537.
18. Fisicaro, S. A., & Lance, C. E. (1990). Implications of three causal models for the measurment of halo error. Applied Psychological Measurement, 14, 419-429.
19. Fiske, D. W. (1987). Construct invalidity comes from method effects. Educational and Psychological Measurement, 47, 285-307.
20. Gatewood, R. D., & Feild, H. S. (1998). Human resource selection (4h ed.). Ft. Worth, TX: Dryden.
21. Gaugler, B. B., Rosenthal, D. B., Thornton, G. C., III, & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493-511.
22. Gaugler, B. B., & Thornton, G. C. (1989). Number of assessment center dimensions as a determinant of assessor accuracy. Journal of Applied Psychology, 74, 611-618.
23. Ghiselli, E. E. (1973). The validity of aptitude tests in personnel selection. Personnel Psychology, 26, 461-477.
24. Harris, M. M., Becker, A. S., & Smith, D. E. (1993). Does the assessment center scoring method affect the cross-situational consistency of ratings? Journal of Applied Psychology, 78, 675-678.
25. Hedge, J. W., & Teachout, M. S. (1986). Job performance measurement: A systematic program of research and development (Tech. Rep. No. AFHRL-TP-86-37). Brooks Air Force Base, TX: Air Force Human Resources Laboratory, Training Systems Division.
26. Hedge, J. W., & Teachout, M. S. (1992). An interview approach to work sample criterion measurement. Journal of Applied Psychology, 77, 453-461.
27. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterization model misspecification. Psychological Methods, 3, 424-453.
28. Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
29. James, L. A., & James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning. Journal of Applied Psychology, 74, 739-751.
30. James, L. R., Demaree, R. G., Mulaik, S. A., & Ladd, R. T. (1992). Validity generalization in the context of situational models. Journal of Applied Psychology, 77, 3-14.
31. Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8 user's reference guide. Chicago: Scientific Software.
32. Joyce, L. W. (1994, May). Alternative constructs for use in assessment centers. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Nashville, TN.
33. Joyce, L. W., Thayer, P. W., & Pond, S. B., III. (1994). Managerial functions: An alternative to traditional assessment center dimensions? Personnel Psychology, 47, 109-121.
34. Kleinmann, M., & Köller, O. (1997). Construct validity of assessment centers: Appropriate use of confirmatory factor analysis and suitable construction principles. Journal of Social Behavior and Personality, 12, 65-84.
35. Klimoski, R., & Brickner, M. (1987). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243-260.
36. Kudisch, J. D., Ladd, R. T., & Dobbins, G. H. (1997). New evidence on the construct validity of diagnostic assessment centers: The findings may not be so troubling after all. Journal of Social Behavior and Personality, 12, 129-144.
37. Lance, C. E., LaPointe, J. A., & Fisicaro, S. A. (1994). Tests of three causal models of halo rater error. Organizational Behavior and Human Decision Processes, 57, 83-96.
38. Lance, C. E., LaPointe, J. A., & Stewart, A. M. (1994). A test of the context dependency of three causal models of halo rater error. Journal of Applied Psychology, 79, 332-340.
39. Lance, C. E., & Sloan, C. E. (1993). Relationships between overall life and life facet satisfaction: A multitrait-multimethod (MTMM) study. Social Indicators Research, 30, 1-15.
40. Lance, C. E., & Stennett, R. B. (1993, April). On the interpretation of method effects in job performance measures. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, San Francisco, CA.
41. Lance, C. E., Teachout, M. S., & Donnelly, T. M. (1992). Specification of the criterion construct space: An application of hierarchical confirmatory factor analysis. Journal of Applied Psychology, 77, 437-452.
42. Marsh, H. W. (1989). Confirmatory factor analysis of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 13, 335-361.
43. Marsh, H. W. (1994). Confirmatory factor analysis models of factorial invariance: A multifaceted approach. Structural Equation Modeling, 1, 5-34.
44. Marsh, H. W., & Bailey, M. (1991). Confirmatory factor analyses of multitrait-multimethod data: A comparison of alternative models. Applied Psychological Measurement, 15, 47-70.
45. Marsh, H. W., Byrne, B. M., & Craven, R. (1992). Overcoming problems in confirmatory factor analyses of MTMM data: The correlated uniqueness model and factorial invariance. Multivariate Behavioral Research, 27, 489-507.
46. Marsh, H. W., & Hocevar, D. (1983). Confirmatory factor analysis of multitrait-multimethod matrices. Journal of Educational Measurement, 20, 231-248.
47. Marsh, H. W., & Hocevar, D. (1988). A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of Applied Psychology, 73, 107-117.
48. McHenry, J. J., Hough, L. M., Toquam, J. L., Hanson, M. A., & Ashworth, S. (1990). Project A validity results: The relationship between predictor and criterion domains. Personnel Psychology, 43, 335-354.
49. Moorman, R., & Podsakoff, P. (1992). A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behavior research. Journal of Occupational and Organizational Psychology, 65, 131-149.
50. Muchinsky, P. M. (1996). The correction for attenuation. Educational and Psychological Measurement, 56, 63-75.
51. Neidig, R. D., & Neidig, P. J. (1984). Multiple assessment center exercises and job relatedness. Journal of Applied Psychology, 69, 182-186.
52. Pervin, L. A. (1989). Persons, situations, interactions: The history of a controversy and a discussion of theoretical models. Academy of Mangement Review, 14, 350-360.
53. Ree, M. J., & Earles, J. A. (1991). The stability of g across different methods of estimation. Intelligence, 15, 271-278.
54. Ree, M. J., & Earles, J. A. (1992). Intelligence is the best predictor of job performance. Current Directions in Psychological Science, 1, 86-89.
55. Ree, M. J., & Earles, J. A. (1993). g is to psychology what carbon is to chemistry: A reply to Sternberg and Wagner, McClelland, and Calfee. Current Directions in Psychological Science, 2, 53-61.
56. Reilly, R. R., Henry, S., & Smither, J. W. (1990). An examination of the effects of using behavior checklists on the construct validity of assessment center dimensions. Personnel Psychology, 43, 71-84.
57. Robertson, I., Gratton, L., & Sharpley, D. (1987). The psychometric properties of managerial assessment centres: Dimensions into exercises won't go. Journal of Occupational Psychology, 60, 187-195.
58. Russell, C. J. (1987). Person characteristic versus role congruency explanations for assessment center ratings. Academy of Management Journal, 30, 817-826.
59. Russell, C. J. (1994, May). A model of assessment center construct space and an agenda for future research. Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Nashville, TN.
60. Russell, C. J., & Domm, D. R. (1995). Two field tests of an explanation of assessment centre validity. Journal of Occupational and Organizational Psychology, 68, 25-47.
61. Sackett, P. R. (1987). Assessment centers and content validity: Some neglected issues. Personnel Psychology, 40, 13-25.
62. Sackett, P. R., & Dreher, G. F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401-410.
63. Sackett, P. R., & Harris, M. (1988). A further examination of the constructs underlying assessment center ratings. Journal of Business and Psychology, 3, 214-229.
64. Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
65. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
66. Schneider, B. (1978). Person-situation selection: A review of some ability-situation interaction research. Personnel Psychology, 31, 281-297.
67. Schneider, B. (1983). Interactional psychology and organizational behavior. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (Vol. 5, pp. 1-31). Greenwich, CT: JAI.
68. Schneider, J., & Schmitt, N. (1992). An exercise design approach to understanding assessment center dimension and exercise constructs. Journal of Applied Psychology, 77, 32-41.
69. Silverman, W. H., Dalessio, A., Woods, S. B., & Johnson, R. L., Jr. (1986). Influence of assessment center methods on assessors' ratings. Personnel Psychology, 39, 565-578.
70. Smith, F. D. (1991). Work samples as measures of performance. In A. K. Wigdor & B. F. Green, Jr. (Eds.), Performance asessment for the workplace (Vol. 2, pp. 27-52). Washington, DC: National Academy Press.
71. Spector, P. E. (1987). Method variance as an artifact in self- reported affect and perceptions at work: Myth or significant problem? Journal of Applied Psychology, 72, 438-443.
72. Terborg, J. R. (1981). Interactional psychology and research on human behavior in organizations. Academy of Management Review, 6, 569-576.
73. Thornton, G. C. (1992). Assessment centers in human resource management. Reading, MA: Addison-Wesley.
74. Turnage, J. J., & Muchinsky, P. M. (1982). Transsituational variability in human performance within assessment centers. Organizational Behavior and Human Performance, 30, 174-200.
75. Wernimont, P., & Campbell, J. (1968). Signs, samples, and criteria. Journal of Applied Psychology, 52, 372-376.
76. Widaman, K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9, 1-26.
77. Williams, L. J., & Anderson, S. (1994). An alternative approach to method effects by using latent-variable models: Applications in organizational behavior research. Journal of Applied Psychology, 79, 323-331.
78. Williams, L. J., & Brown, B. (1994). Method variance in organizational behavior and human resources research: Effects on correlations, path coefficients, and hypothesis testing. Organizational Behavior and Human Decision Processes, 57, 185-209.
79. Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? Journal of Applied Psychology, 74, 462-468.
80. Williams, L. J., Gavin, M., & Williams, M. (1996). Measurement and non-measurement processes with negative affectivity and employee attitudes. Journal of Applied Psychology, 81, 88-101.