Estimating trait and situational variance in a situational judgment test

Human Performance

Volumn 22, Issue 1, 2009, Pages 44-63

  Westring, Alyssa J Friede ^a,c   Oswald, Frederick L ^a   Schmitt, Neal ^a   Drzakowski, Stephanie ^a   Imus, Anna ^a   Kim, Brian ^b   Shivpuri, Smriti ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b OCCIDENTAL COLLEGE   (United States)

^c DEPAUL UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 60849123779     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1080/08959280802540999     Document Type: Article

References (54)

1. Ames, C. (1992). Classrooms: Goals, structures, and student motivation. Journal of Educationa! Psychology, 84, 261-271.
2. Beaty, J., Cleveland, J., & Murphy, K. (2001). The relation between personality and contextual performance in "strong" versus "weak" situations. Human Performance, 14, 125-148.
3. Bell, B., & Kozlowski, S. (2002). Goal orientation and ability: Interactive effects on self-efficacy, performance, and knowledge. Journal of Applied Psychology, 87, 495-505.
4. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
5. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
6. Browne, M. (1984). The decomposition of multitrait-multimethod matrices. British Journal of Mathematical Psychology, 37, 1-21.
7. Button, S., Mathieu, J., & Zajac, D. (1996). Goal orientation in organizational research: A conceptual and empirical foundation. Organizational Behavior and Human Decision Processes, 67, 26-48.
8. Clevenger, J., Pereira, G., Wiechmann, D., Schmitt, N., & Harvey, V. (2001). Incremental validity of situational judgment tests. Journal of Applied Psychology, 86, 410-417.
9. Conroy, D. E., Elliot, A. J., & Hofer, S. M. (2003). A 2 × 2 achievement goals questionnaire for sport: Evidence for factorial invariance, temporal stability, and external validity. Journal of Sport & Exercise Psychology, 25, 456-476.
10. Cron, W., Slocum, J., Vandewalle, D., & Fu, Q. (2005). The role of goal orientation on negative emotions and goal setting when initial performance falls short of one's goal. Human Performance, 18, 55-80.
11. Cudeck, R. (1988). Multiplicative models and MTMM matrices. Journal of Educational Statistics, 13, 131-147.
12. DeShon, R., & Gillespie, J. (2005). A motivated action theory account of goal orientation. Journal of Applied Psychology, 90, 1096-1127.
13. Duda, J., & Nicholls, J. (1992). Dimensions of achievement motivation in schoolwork and sport. Journal of Educational Psychology, 84, 290-299.
14. Dweck, C., & Elliot, E. (1983). Achievement motivation. In P. H. Mussen (Gen. Ed.) & E. M. Hetherington (Vol. Ed.), Handbook of child psychology: Vol. IV Social and personality development (pp. 643-691). New York: Wiley
15. Dweck, C., & Leggett, E. (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95, 256-273.
16. Eid, M., Lischetzke, X., Nussbeck, F. W., & Trierweiler, L. (2003). Separating trait effects from trait-specific mediod effects in multitrait-multimethod analysis: A multiple indicator CTC(M-1) model. Psychological Methods, 8, 38-60.
17. Elliot, A. (1999). Approach and avoidance motivation and achievement goals. Educational Psychologist, 34, 169-189.
18. Elliot, A., & Church, M. (1997). A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology, 72, 218-232.
19. Elliot, A., & Harackiewicz, J. (1994). Goal setting, achievement orientation, and intrinsic motivation: A mediational analysis. Journal of Personality and Social Psychology, 66, 968-980.
20. Elliot, A., & Harackiewicz, J. (1996). Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. Journal of Personality and Social Psychology, 70, 461-475.
21. Elliott, E., & Dweck, C. (1988). Goals: An approach to motivation and achievement. Journal of Personality and Social Psychology, 54, 5-12.
22. Fiedler, F. E. (1967). A theory of leadership effectiveness. New York: McGraw-Hill.
23. Gessner, T. L., & Klimoski, R. J. (2006). Making sense of situations. In J. A. Weekley & R. E. Ployhart (Eds.), Situational judgment tests: Theory, measurement, and application (pp. 13-38). Mahwah, NJ: Erlbaum.
24. Harackiewicz, E., Barron K., Tauer, J., & Elliot, A. (2002). Predicting success in college: A longitudinal study of achievement goals and ability measures as predictors of interest and performance from freshman year through graduation. Journal of Educational Psychology, 94, 562-575.
25. Hersey, P., & Blanchard, K. H. (1977). The management of organizational behavior (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
26. House, R. J., & Mitchell, T. R. (1974). Path-goal theory of leadership. Contemporary Busiiness, 3, 81-98.
27. Lance, C. E., Foster, M. R., Gentry, W. A., & Thoresen, J. D. (2004). Assessor cognitive processes in an operational assessment center. Journal of Applied Psychology, 89, 22-35.
28. Lance, C. E., Lambert, T. A., Gewin, A. G., Lievens, F., & Conway, J. M. (2004). Revised estimates of dimension and exercise variance components in assessment center post-exercise dimension ratings. Journal of AppliedPsychology, 89, 377-385.
29. Lance, C. E., Newbolt, W. H., Gatewood, R. D., Foster, M. R., French, N., & Smith, D. E. (2000). Assessment center exercise factors represent cross-situational specificity, not method bias. Human Performance, 13, 323-353.
30. Lance, C. E., Noble, C. L., & Scullen, S. E. (2002). A critique of the correlated trait-correlated method (CTCM) and correlated uniqueness (CU) models for multitrait-multimethod (MTMM) data. Psychological Methods, 7, 228-244.
31. Lievens, F., Buyse, T., & Sackett, P. R. (2005). The operational validity of a video-based situational judgment test for medical college admissions: Illustrating the importance of matching predictor and criterion construct domains. Journal of Applied Psychology, 90, 442-452.
32. Marsh, H. W. (1983). Multitrait-multimethod analysis: Distinguishing between items and traits. Educational and Psychological Measurement, 43, 351-358.
33. McDaniel, M., Morgeson, F., Finnegan, E., Campion, M., & Braverman, E. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, 730-740.
34. Meece, J., & Holt, K. (1993). A pattern analysis of students' achievement goals. Journal of Educational Psychology, 85, 582-590.
35. Middleton, M., & Midgley, C. (1997). Avoiding the demonstration of lack of ability: An underexplored aspect of goal theory. Journal of Educational Psychology, 89, 710-718.
36. Mischel, W. & Peake, P. (1982). Beyond deja vu in the search for cross-situational consistency. Psychological Review, 89, 730-755.
37. Motowidlo, S. J., Dunnette, M., & Carter, G. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75, 640-647.
38. Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006a). Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items. Journal of Applied Psychology, 91, 57-81.
39. Motowidlo, S.J., Hooper, A. C., & Jackson, H. L. (2006b). A theoretical basis for situational judgment tests. In J. A. Weekley & R. E. Ployhart (Eds.), Situational judgment tests: Theory, measurement, and application (pp. 83-106). Mahwah, NJ: Erlbaum.
40. Oswald, F., Schmitt, N., Kim, B., Ramsay, L., & Gillespie, M. (2004). Developing a biodata measure and situational judgment inventory as predictors of college student performance. Journal of Applied Psychology, 89, 187-207.
41. Payne, S. C., Youngcourt, S. S., & Beaubien, J. M. (2007). A meta-analytic examination of the goal orientation nomological net. Journal of Applied Psychology, 92, 128-150.
42. Pintrich, P. (2000). An achievement goal theory perspective on issues in motivation terminology, theory, and research. Contemporary Educational Psychology, 25, 92-104.
43. Ployhart, R. E. (2006). The predictor response process model. In J. A. Weekley & R. E. Ployhart (Eds.), Situational judgment tests: Theory, measurement, and application (pp. 83-106). Mahwah, NJ: Erlbaum.
44. Schmidt, A., & Ford, J. K. (2003). Learning within a learner control training environment: The interactive effects of goal orientation and metacognitive instruction on learning outcomes. Personnel Psychology, 56, 405-429.
45. Schmitt, N., & Chan, D. (2006). Situational judgment tests: Moethod or construct? In J. A. Weekley & R. E. Ployhart (Eds.), Situational judgment tests: Theory, measurement, and application (pp. 135-156). Mahwah, NJ: Erlbaum.
46. Senko, C., & Harackiewicz, J. (2005). Achievement goals, task performance, and interest: Why perceived goal difficulty matters. Personality and Social Psychology Bulletin, 31, 1739-1753.
47. Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180.
48. Tett, R. P., & Burnett, D. D. (2003). A personality trait-based interactionist model of job performance. Journal of Applied Psychology, 88, 500-517.
49. Tucker, L. R., & Lewis, C. (1973). The reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.
50. Vandewalle, D. (1997). Development and validation of a work domain goal orientation instrument. Educational and Psychological Measurement, 57, 995-1015.
51. Vroom, V. H., & Yetton, P. W (1973). Leadership and decision-making. Pittsburgh, PA: University of Pittsburgh Press.
52. Weekley, J. A., & Ployhart, R. E. (Eds.). (2006). Situational judgment tests: Theory, measurement, and application. Mahwah, NJ: Erlbaum.
53. Widaman, K. F. (1985). Hierarchically nested covariance structures models for multitrait-multimethod data. Applied Psychological Methods, 9, 1-26.
54. Wothke, W (1996). Models for multitrait-multimethod matrix analysis. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 7-56). Mahwah, NJ: Erlbaum.