Validity of multiple ratings of business student performance in a management simulation

Human Resource Development Quarterly

Volumn 10, Issue 2, 1999, Pages 155-172

  McEnery, Jean M ^a   Blanchard, P Nick ^a  

^a EASTERN MICHIGAN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33645270793     PISSN: 10448004     EISSN: 15321096     Source Type: Journal    
DOI: 10.1002/hrdq.3920100206     Document Type: Article

References (61)

1. American Assembly of Collegiate Schools of Business (AACSB). (1987). Outcome measurement project, Phase III. St. Louis: AACSB.
2. Archambeau, D. J. (1979). Relationships among skill ratings assigned in an assessment center. Journal of Assessment Center Technology, 2, 7–20.
3. Baldwin, T. T. Padgett, M. Y. (1993). Management development: A review and commentary. In C. L. Cooper & I. T. Robertson (eds.), International review of industrial and organizational psychology, 1993. New York: Wiley.
4. Benson, G. L. (1983). On the campus: how well does business prepare graduates for the business world? Personnel, 60, 61–65.
5. Boehm, V. R. (1985). Using assessment centers for management development—Five applications. Journal of Management Development, 4, 40–51.
6. Borman, W. C. (1974). The rating of individuals in organizations: An alternative approach. Organizational Behavior and Human Performance, 12, 105–124.
7. Borman, W. C., White, L. A. Dorsey, D. W. (1995). Effects of ratee task performance and interpersonal factors on supervisor and peer performance ratings. Journal of Applied Psychology, 80, 168–177.
8. Bycio, P., Alvares, K. M. Hahn, J. (1987). Situational specificity in assessment center ratings: A confirmatory factor analysis. Journal of Applied Psychology, 72, 463–474.
9. Campbell, D. Fiske, D. (1959). Convergent and divergent discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
10. Devanna, M. A., Fombrun, C. Tichy, N. (1981). Human resources management: A strategic perspective. Organizational Dynamics, Winter, 51–67.
11. Dunnette, M. D. (1976). Aptitudes, abilities, and skills. In M. D. Dunnette (Ed.), The handbook of industrial and organizational psychology. Skokie, IL: Rand McNally.
12. Dunnette, M. D. (1993). My hammer or your hammer? Human Resource Management, 32, 373–384.
13. Engelbrecht, A. S. Fischer, A. H. (1995). The managerial performance implications of a developmental assessment center. Human Relations, 48, 387–404.
14. Fleenor, J. W. (1988). The utility of assessment centers for career development. Unpublished doctoral dissertation, North Carolina State University, Raleigh.
15. Furnham, A. Stringfield, P. (1994). Congruence of self and subordinate ratings of managerial practices as a correlate of superior evaluation. Journal of Occupational and Organizational Psychology, 67, 57–67.
16. Gordon, R. A. Howell, J. E. (1959). Higher education for business. New York: Garland.
17. Griffiths, P. Allen, B. (1987). Assessment centers: Breaking with tradition. Journal of Management Development, 6, 18–29.
18. Harris, M. Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41, 43–61.
19. Hegarty, H. H. (1974). Using subordinates ratings to elicit behavioral changes in supervisors. Journal of Applied Psychology, 59, 764–766.
20. Holzbach, R. (1978). Rater bias in performance rating: Supervisor, self, and peer ratings. Journal of Applied Psychology, 63, 579–588.
21. Jones, R. G. Whitmore, M. D. (1995). Evaluating developmental assessment centers as interventions. Personnel Psychology, 48, 377–388.
22. Joyce, L. W., Thayer, P. W. Pond, S. B. (1994). Managerial functions: An alternative to traditional assessment center dimensions? Personnel Psychology, 47, 109–121.
23. Kane, J. S. Lawler, E. E., III (1978). Methods of peer assessment. Psychological Bulletin, 85, 555–586.
24. Klimoski, R. Brickner, M. (1987). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243–260.
25. Kluger, A. N. De Nisi, A. (1996). The effects of feedback interventions on performance: A historical, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284.
26. Korman, A. K. (1968). The prediction of managerial performance: A review. Personnel Psychology, 21, 295–322.
27. Landy, F. J., Farr, J. L., Saal, F. E. Freytag, W. R. (1976). Behaviorally anchored scales for rating the performance of police officers. Journal of Applied Psychology, 61, 750–758.
28. Mandt, E. J. (1982). The failure of business education—and what to do about it. Management Review, 71, 47–52.
29. McCall, M. W., Jr. Lombardo, M. M. (1982). Using simulation for leadership and management research: Through the Looking Glass. Management Science, 28, 533–549.
30. McConnell, R. V. Seybolt, J. W. (1991). Assessment center technology: One approach for integrating and assessing management skills in the business school curriculum. In J. D. Bigelow (Ed.), Managerial skills: Explorations in practical knowledge (pp. 105–115). Thousand Oaks, CA: Sage.
31. McEnery, J. J. McEnery, J. M. (1987). Self-rating in management training needs assessment: A neglected opportunity? Journal of Occupational Psychology, 60, 49–60.
32. McLean, G. N. (1997). Multirater 360 feedback. In L. J. Bassi & D. Russ-Eft (Eds.), What works: Assessment, development, and measurement. Alexandria, VA: American Society for Training and Development.
33. McLean, G. N., Sytsma, M. Kerwin-Ryberg, K. (1995). Using 360-degree feedback to evaluate management development: New data, new insights. In E. F. Holton, III (Ed.), Academy of human resource development 1995 conference proceedings (Section 4–4). Austin, TX: Academy of Human Resource Development.
34. Meyer, H. (1980). Self-appraisal of job performance. Personnel Psychology, 33, 291–295.
35. Mintzberg, H. (1975). The manager's job: Folklore and fact. Harvard Business Review, 53, 49–71.
36. Mullin, R. F., Shaffer, P. L. Grelle, M. J. (1991). A study of the assessment center method of teaching basic management skills. In J. D. Bigelow (Ed.), Managerial skills: Explorations in practical knowledge (pp. 116–139). Thousand Oaks, CA: Sage.
37. Noe, R. A., Hollenbeck, J., Gerhart, B. Wright, P. (1997). Human resource management: Gaining a competitive advantage. Burr Ridge, IL: Irwin.
38. Porter, L. W. McKibbin, L. E. (1988). Management education and development: Drift or thrust into the twenty-first century. St. Louis: AACSB.
39. Proctor, R. W. Dutta, A. (1995). Skill acquisition and human performance. Thousand Oaks, CA: Sage.
40. Reilly, R. R. Chao, G. T. (1982). Validity and fairness of some alternative employee selection procedures. Personnel Psychology, 35, 1–62.
41. Reilly, R. R., Henry, S. Smither, J. W. (1990). An examination of the effects of using behavior checklists on the construct validity of assessment center dimensions. Personnel Psychology, 43, 71–84.
42. Robertson, I., Gratton, L. Sharpley, D. (1987). The psychological properties and design of assessment centers: Dimensions into exercises won't go. Journal of Occupational Psychology, 60, 187–195.
43. Rummel, R. J. (1970). Applied factor analysis. Evanston, IL: Northwestern University Press.
44. Russell, C. J. (1987). Person characteristics vs. role congruency explanations for assessment center ratings. Academy of Management Journal, 30, 817–826.
45. Sackett, P. R. Dreher, G. F. (1982). Constructs and assessment center dimensions: Some troubling empirical findings. Journal of Applied Psychology, 67, 401–410.
46. Sackett, P. R. Hakel, M. D. (1979). Temporal stability and individual differences in using assessment information to form overall ratings. Organizational Behavior and Human Performance, 23, 120–137.
47. Schein, E. H. (1984). Coming to a new awareness of organizational culture. Sloan Management Review, 25, 3–15.
48. Seltzer, J. (1988). Experiences with Looking Glass. Organizational Behavior Teaching Review, 13, 58–67.
49. Serey, K. T. Verderber, K. S. (1991). Beyond the wall: Resolving issues of educational philosophy and pedagogy in the teaching of managerial competencies. In J. D. Bigelow (Ed.), Managerial skills: Explorations in practical knowledge (pp. 105–115). Thousand Oaks, CA: Sage.
50. Shore, T. H., Shore, L. M. Thornton, G. C. III (1992). Construct validity of self and peer evaluations of performance dimensions in an assessment center. Journal of Applied Psychology, 77, 42–54.
51. Slivinski, L. W., McDonald, U. S. Gourgeous, R. P. (1979). Immediate and long-term reactions to an assessment center. Journal of Assessment Center Technology, 2, 13–18.
52. Smith, P. C. Kendall, L. M. (1963). Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology, 47, 149–155.
53. Somers, M. Birnbaum, D. (1991). Assessing self-appraisal of job performance as an evaluation device: Are the poor results a function of method or methodology? Human Relations, 44, 1081–1091.
54. Steel, R. P. Ovalle, N. K. (1984). Self-appraisal based upon supervisory feedback. Personnel Psychology, 37, 667–685.
55. Thornton, G. C. III. (1980). Psychometric properties of self-appraisals of job performance. Personnel Psychology, 33, 263–271.
56. Thornton, G. C., III Byham, W. C. (1982). Assessment centers and managerial performance. London: Academic Press.
57. Thornton, G. C., III Cleveland, J. N. (1990). Developing managerial talent through simulation. American Psychologist, 45, 190–199.
58. Tornow, W. T. (1993). Editor's note: Introduction to special issue on 360-degree feedback. Human Resource Management, 32, 211–219.
59. Turnage, J. Muchinsky, P. (1982). Trans-situational variability in human performance within assessment centers. Organizational Behavior and Human Performance, 30, 174–200.
60. Tziner, A. (1984). Prediction of peer rating in a military assessment center: A longitudinal follow-up. Canadian Journal of Administrative Sciences, 1, 146–160.
61. Whetten, D. A. Cameron, K. S. (1995). Developing managerial skills. New York: HarperCollins.