Dilemmatics in public sector assessment: A framework for developing and evaluating selection systems

Human Performance

Volumn 9, Issue 3, 1996, Pages 177-198

  Austin, James T ^a   Klimoski, Richard J ^b   Hunt, Steven T ^a  

^a OHIO STATE UNIVERSITY   (United States)

^b GEORGE MASON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0030541188     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327043hup0903_1     Document Type: Article

References (105)

1. Ackerman, P., & Humphreys, L. G. (1990). Individual differences theory in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 1, pp. 223-282). Palo Alto, CA: Consulting Psychologists Press.
2. Adams, J. S. (1965). Inequity in social exchange. Advances in Experimental Social Psychology, 2, 267-299.
3. Alexander, A., & Ruderman, M. (1987). The role of procedural and distributive justice in organizational behavior. Social Justice Research, 1, 177-198.
4. Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Belmont, CA: Brooks/Cole.
5. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (1985). Standards for educational and psychological tests. Washington, DC: American Psychological Association.
6. Anastasi, A. (1985). The use of personality assessment in industry: Methodological and interpretative problems. In H. J. Bernardin & D. A. Bownas (Eds.), Personality assessment in organizations (pp. 1-19). New York: Praeger.
7. Arvey, R. D., & Sackett, P. R. (1993). Fairness in selection: Current developments and perspectives. In N. Schmitt & W. C. Borman (Eds.), Personnel selection in organizations (pp. 171-202). San Francisco: Jossey-Bass.
8. Arvey, R. D., Strickland, W., Drauden, G., & Martin, C. (1990). Motivational components of test-taking. Personnel Psychology, 43, 695-716.
9. Austin, J. T., & Villanova, P. (1992). The criterion problem 1917-1992. Journal of Applied Psychology, 77, 836-874.
10. Baritz, L. (1960). The servants of power: A history of the uses of social science in American industry. Middletown, CT: Wesleyan University Press.
11. Barling, J. (1988). De rerum novarum: Industrial relations - a "blind spot" in the teaching, research, and practice of industrial psychology. Canadian Psychology, 29, 103-108.
12. Bennett, J. T., & Delaney, J. T. (1993). Research in unions: Some subjects in need of scholars. Journal of Labor Research, 14, 100-120.
13. Binning, J., & Barrett, G. V. (1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478-494.
14. Boudreau, J. W. (1991). Utility analysis for decisions in human resource management. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 621-745). Palo Alto, CA: Consulting Psychologists Press.
15. Brogden, H. (1949). When testing pays off. Personnel Psychology, 2, 171-183.
16. Burisch, M. (1984). Approaches to personality inventory construction: A comparison of merits. American Psychologist, 39, 214-227.
17. Camara, W. J., & Brown, D. C. (1995). Educational and employment testing: Changing concepts in measurement and policy. Educational Measurement: Issues and Practice, 14, 5-11.
18. Cascio, W. F., Alexander, R., & Barrett, G. V. (1988). Setting cutoff scores: Legal, psychometric, and professional issues and guidelines. Personnel Psychology, 41, 1-24.
19. Cascio, W. F., Outz, J., Zedeck, S., & Goldstein, I. L. (1991). Statistical implications of six methods of test score use in personnel selection. Human Performance, 4, 233-264.
20. Civil Service Reform Act, Pub. L. No. 95-454 (1978).
21. Cohen-Rosenthal, E. (Ed.). (1995). Unions, management, and quality: Opportunities for innovation and excellence. Chicago: Irwin Professional Publishing.
22. Cronbach, L. J. (1988). Five perspectives on validity argument. In H. Wainer & H. Braun (Eds.), Test validity (pp. 3-17). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
23. Cronbach, L. J. (1989). Construct validation after thirty years. In R. L. Linn (Ed.), Intelligence: Measurement, theory, and public policy (pp. 147-171). Urbana: University of Illinois Press.
24. Cronbach, L. J., & Gleser, G. (1965). Psychological tests and personnel decisions (2nd ed.). Urbana: University of Illinois Press.
25. Cropanzano, R. (Ed.). (1993). Justice in the workplace. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
26. Deutsch, M. (1975). Equality, equity, and need: What determines which value will be used as a basis of distributive justice? Journal of Social Issues, 31, 137-149.
27. Deutsch, M. (1985). Distributive justice: A psychological perspective. New Haven, CT: Yale University Press.
28. Dillman, D. L. (1987). Civil service reform: An annotated bibliography. New York: Garland.
29. Dilts, D. A. (1993). Labor-management cooperation in the public sector. Journal of Collective Negotiations, 22, 305-311.
30. Drasgow, R, Olson, J. B., Keenan, P. A., Moberg, P., & Mead, A. D. (1993). Computerized assessment. Research in Personnel and Human Resources Management, 11, 163-206.
31. Feuille, P. (1989). Unions and employers in government in the United States: More conflict than cooperation. In A. Gladstone (Ed.), Current issues in labour relations: An international perspective (pp. 277-293). Berlin: deGruyter.
32. Fields, M. W., & Thacker, J. W. (1991). Union influence on internal organizational decisions: An empirical analysis. Journal of Applied Social Psychology, 21, 747-753.
33. Finison, L. J. (1979). An aspect of the early history of the Society for the Psychological Study of Social Issues: Psychologists and labor. Journal of the History of the Behavioral Sciences, 15, 29-37.
34. Folger, R. M., & Greenberg, J. (1985). Procedural justice: An interpretive analysis of personnel systems. Research in Personnel and Human Resources Management, 3, 141-183.
35. Gilliland, S. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. Academy of Management Review, 18, 694-734.
36. Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection systems. Journal of Applied Psychology; 79, 691-701.
37. Goldsmith, R. F. (1990). Utility analysis and its application to the study of the cost effectiveness of the assessment center method. In K. R. Murphy & F. E. Saal (Eds.), Psychology in organizations: Integrating science and practice (pp. 95-110). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
38. Goldstein, I. L., Zedeck, S., & Schneider, B. (1993). An exploration of the job analysis-content validity process. In N. Schmitt, W. Borman, & Associates (Eds.), Personnel selection in organizations (pp. 3-34). San Francisco: Jossey-Bass.
39. Gompers, S. (1922). Cooperation of workers in study of industrial personnel matters. Journal of Personnel Research, 1, 53-55.
40. Gordon, M. E., & Burt, R. E. (1981). A history of industrial psychology's relationship with American unions: Lessons from the past and directions for the future. International Review of Applied Psychology, 30, 137-156.
41. Gordon, M. E., & Johnson, W. A. (1982). Seniority: A review of its legal and scientific standing. Personnel Psychology, 35, 255-280.
42. Greenberg, J. (1986). Determinants of perceived fairness of performance evaluation. Journal of Applied Psychology, 71, 340-342.
43. Greenberg, J. (1987). A taxonomy of organizational justice theories. Academy of Management Review, 12, 9-22.
44. Greer, O. L., & Cascio, W. F. (1987). Is cost accounting the answer? Comparison of two behaviorally-based methods for estimating the standard deviation of job performance in dollars with a cost-accounting-based approach. Journal of Applied Psychology, 72, 588-595.
45. Guion, R. M. (1980). On trinitarian doctrines of validity. Professional Psychology, 11, 385-398.
46. Guion, R. M. (1991). Personnel assessment, selection, and placement. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 327-397). Palo Alto, CA: Consulting Psychologists Press.
47. Henry, G. T., Dickey, K. C., & Areson, J. C. (1991). Stakeholder participation in educational performance monitoring systems. Educational Evaluation and Policy Analysis, 13, 177-188.
48. Hesketh, B., & Robertson, I. (1993). Validating personnel selection: A process model for research and practice. International Journal of Selection and Assessment, 1, 3-17.
49. Homans, G. C. (1961). Social behavior: Its elementary forms. New York: Harcourt Brace.
50. Howard, A. (Ed.). (1995). The changing nature of work. San Francisco: Jossey-Bass.
51. Hulin, C. L. (1991). Adaptation, persistence, and commitment in organizations. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 2, pp. 445-505). Palo Alto, CA: Consulting Psychologists Press.
52. Hunt, E. A. (1995). Will we be smart enough ? A cognitive analysis of the coming workforce. New York: Russell Sage Foundation.
53. Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98.
54. Ichniowski, C. (1992). Human resource practices and productive labor-management relations. In D. Lewin, O. S. Mitchell, & P. D. Sherer (Eds.), Research frontiers in industrial relations and human resources (pp. 239-271). Madison, WI: Industrial Relations Research Association.
55. Ingraham, P. (1984). The Civil Service Reform Act of 1978: Its design and legislative history. In P. Ingraham & C. Ban (Eds.), Legislating bureaucratic change: The Civil Service Reform Act of 1978. Albany: State University of New York Press.
56. Ingraham, P., & Ban, C. (Eds.). (1984). Legislating bureaucratic change: The Civil Service Reform Act of 1978. Albany: State University of New York Press.
57. Intergovernmental Personnel Act, Pub. L. No. 91-648 (1970).
58. Inwald, R. (1988). "Screen-out" vs "screen-in": Two models for pre-employment psychological testing. Paper presented at the International Personnel Management Association Assessment Council Annual Conference, Las Vegas, NV.
59. Johnston, W. B., & Packer, A. E. (Eds.). (1987). Workforce 2000: Work and workers for the 21st century. Indianapolis, IN: Hudson Institute.
60. Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112, 527-535.
61. Katz, D., & Kahn, R. L. (1978). The social psychology of organizations (2nd ed.). New York: Wiley.
62. Katzell, R. A., & Austin, J. T. (1992). From then to now: The development of industrial-organizational psychology in the United States. Journal of Applied Psychology, 77, 803-835.
63. Kaufman, B. E. (1993). The origin and evolution of the field of industrial relations in the United States. Ithaca, NY: ILR.
64. Klimoski, R. J. (1993). Predictor constructs and their measurement. In N. Schmitt, W. C. Borman, & Associates (Ed.), Personnel selection in organizations (pp. 99-134). San Francisco: Jossey-Bass.
65. Klimoski, R. K., & Brickner, M. (19787). Why do assessment centers work? The puzzle of assessment center validity. Personnel Psychology, 40, 243-260.
66. Kernhauser, A. W. (Ed.). (1949). Psychology of labor-management relations. Madison, WI: Industrial Relations Research Association.
67. Landy, F. J. (1993). Early influences on the development of industrial-organizational psychology. In T. K. Fagan & G. R. VandenBos (Eds.), Exploring applied psychology: Origins and critical analyses (pp. 80-118). Washington, DC: American Psychological Association.
68. Lawler, E. E., III, & Mohrman, S. A. (1987). Unions and the new management. Academy of Management Executive, 1, 293-300.
69. Leong, F. T. L., & Zahar, P. (1991). Development and validation of the scientist-practitioner inventory for psychology. Journal of Counseling Psychology, 38, 331-341.
70. Lerner, M. J. (1977). The justice motive: Some hypotheses as to its origins and forms. Journal of Personality, 45, 1-52.
71. Leventhal, G. S. (1980). What should be done with equity theory? New approaches to the study of fairness in social relationships. In K. S. Gergen, M. S. Greenberg, & R. H. Willis (Eds.), Social exchange: Advances in theory and research (pp. 27-55). New York: Plenum.
72. Leventhal, G. S., Karuza, J., & Fry, W. R. (1980). Beyond fairness: A theory of allocation preferences. In G. Mikula (Ed.), Justice and social interaction (pp. 167-218). New York: Springer-Verlag.
73. Lind, E. A., & Tyler, T. R. (1988). The social psychology of procedural justice. New York: Plenum.
74. London, M., & Bray, D. W. (1980). Ethical issues in testing and evaluation for personnel decisions. American Psychologist, 35, 890-900.
75. Lounsbury, J. W., Bobrow, W., & Jensen, J. B. (1989). Attitudes toward employment testing: Scale development, correlates, and "known-group" validation. Professional Psychology: Research and Practice, 20, 340-349.
76. Macan, T. H., Avedon, M. J., Paese, M., & Smith, D. E. (1994). The effects of applicants' reactions to cognitive ability tests and an assessment center. Personnel Psychology, 47, 715-738.
77. Maxwell, S. D., & Arvey, R. D. (1993). The search for predictors with high validity and low adverse impact: Compatible or incompatible goals? Journal of Applied Psychology, 78, 433-437.
78. McGrath, J. E. (1982). Dilemmatics: The study of research choices and dilemmas. In J. E. McGrath, J. Martin, & R. A. Kukla, (Eds.), Judgment calls in research (pp. 69-102). Beverly Hills: Sage.
79. Messick, S. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 33-45). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
80. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 3-103). New York: Macmillan/American Council on Education.
81. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
82. Mosier, C. I. (1947). A critical examination of the concepts of face validity. Educational and Psychological Measurement, 7, 191-200.
83. Nevo, B., & Jäger, R. S. (Eds.). (1993). Educational and psychological testing: The test taker's outlook. Toronto, Canada: Hogrefe & Huber.
84. Ng, I., & Maki, D. (1994). Trade union influence on human resource management practices. Industrial Relations, 33, 121-135.
85. Niehoff, B. P., & Moorman, R. H. (1993). Justice as a mediator of the relationship between methods of monitoring and organizational citizenship. Academy of Management Journal, 36, 527-536.
86. Pfeffer, J. (1981). Power in organizations. Marshfield, MA: Pitman.
87. Rosen, H., & Stagner, R. (1980). Industrial/organizational psychology and unions: A viable relationship? Professional Psychology, 11, 477-483.
88. Schmitt, N., & Gilliland, S. W. (1992). Beyond differential prediction: Fairness in selection. In D. M. Saunders (Ed.), New approaches to employee management: Fairness in employee selection (pp. 21-46). Greenwich, CT: JAI.
89. Schmitt, N., Gilliland, S. W., Landis, R. S., & Devine, D. (1993). Computer-based testing applied to selection of secretarial applicants. Personnel Psychology, 46, 149-165.
90. Schmitt, N., & Landy, F. J. (1993). The concept of validity. In N. Schmitt, W. C. Borman, & Associates (Eds.), Personnel selection in organizations (pp. 275-309). San Francisco: Jossey-Bass.
91. Schuler, H. (1993). Social validity of selection situations: A concept and some empirical results. In H. Schuler, J. L. Farr, & M. Smith (Eds.), Personnel selection and assessment: Individual and organizational perspectives (pp. 11-26). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
92. Shostak, A. B. (1964). Industrial psychology and the trade unions: A matter of mutual indifference. In G. Fisk (Ed.), The frontiers of management psychology (pp. 144-155). New York: Harper & Row.
93. Smith, M. (1994). A theory of the validity of predictors. Journal of Occupational and Organizational Psychology, 67, 13-31.
94. Smither, J. W., Reilly, R. R., Millsap, R. E., Pearlman, K., & Stoffey, R.W. (1993). Applicant reactions to selection procedures. Personnel Psychology, 46, 49-76.
95. Society for Industrial and Organizational Psychology. (1987). Principles for the validation and use of personnel selection procedures (3rd ed.). College Park, MD: Author.
96. Sproule, C. F. (1990). Recent innovations in public sector assessment (IPMAAC Personnel Assessment Monographs, No. 2). Alexandria, VA: International Personnel Management Association.
97. Stagner, R. (1956). Psychology of industrial conflict. New York: Wiley.
98. Stagner, R. (Ed.). (1981). Psychologists and unions [Special issue]. International Review of Applied Psychology, 30, 137-328.
99. Steffy, B. D., & Maurer, S. D. (1988). Conceptualizing and measuring the economic effectiveness of human resource activities. Academy of Management Review, 13, 271-296.
100. Tetrick, L., & Barling, J. (Eds.). (1995). Changing employment relations: Behavioral and social perspectives. Washington, DC: American Psychological Association.
101. Troy, L. (1993). The end of unionism? In B. Stein (Ed.), Proceedings of New York University 44th annual national conference on labor (pp. 175-195). Boston: Little, Brown.
102. Tyler, F. B., Pargament, K. I., & Gatz, M. (1983). The resource collaborator role: A model for interactions involving psychologists. American Psychologist, 38, 388-398.
103. Wiesen, J. P., Abrams, N., & McAttee, S. A. (1994). Employment testing: A public sector viewpoint. In L. C. Wing & B. R. Gifford (Eds.), Policy issues in employment testing (pp. 77-130). (Also published as IPMAAC Personnel Assessment Monograph, No. 2)
104. Wiesen, J. P., Abrams, N., & McAttee, S. A. (1994). Employment testing: A public sector viewpoint. In L. C. Wing & B. R. Gifford (Eds.), Policy issues in employment testing (pp. 77-130). (Also published as IPMAAC Personnel Assessment Monograph, No. 2)
105. Zammuto, R. F. (1984). A comparison of multiple constituency models of organizational effectiveness. Academy of Management Review, 9, 606-616.