Setting cutoff scores for personnel selection tests: Issues, illustrations, and recommendations

Human Performance

Volumn 9, Issue 3, 1996, Pages 275-295

  Truxillo, Donald M ^a   Donahue, Lisa M ^b   Sulzer, Jefferson L ^c  

^a PORTLAND STATE UNIVERSITY   (United States)

^b Civil Service Department   (United States)

^c Tulane University

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0030531004     PISSN: 08959285     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327043hup0903_6     Document Type: Article

References (38)

1. Abrams, N. E. (1995, May). Making the cut on physical ability tests. In M. R. Redmond (Chair), Making the cut: Professional and practical issues in setting cutoffs. Symposium conducted at the meeting of the Society for Industrial and Organizational Psychology, Orlando, FL.
2. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (1985). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
3. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508-600). Washington, DC: American Council on Education.
4. Arvey, R. D., Landon, T. E., Nutting, S. M., & Maxwell, S. E. (1992). Development of physical ability tests for police officers: A construct validation approach. Journal of Applied Psychology. 77, 996-1009.
5. Berk, R. A. (1986). A consumer's guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56, 137-172.
6. Biddle, R. E. (1993). How to set cutoff scores for knowledge tests used in promotion, training, certification, and licensing. Public Personnel Management, 22, 63-79.
7. Busch, J. C., & Jaeger, R. M. (1990). Influence of type of judge, normative information, and discussion on standards recommended for the National Teacher Examinations. Journal of Educational Measurement, 27, 145-163.
8. Camara, W. J. (1994). Progress and issues in the revision of the testing standards. The Industrial-Organizational Psychologist, 32, 17-21.
9. Cascio, W. F., Alexander, R. A., & Barrett, G. V. (1988). Setting cutoff scores: Legal, psychometric, and professional guidelines. Personnel Psychology, 41, 1-24.
10. Cascio, W. F., Outtz, J., Zedeck, S., & Goldstein, I. L. (1991). Statistical implications of six methods of test score use in personnel selection. Human Performance, 4, 233-264.
11. Cross, L. H., Imprara, J. C., Frary, R. B., & Jaeger, R. M. (1984). A comparison of three methods for establishing minimum standards on the National Teacher Examinations. Journal of Educational Measurement, 21, 113-129.
12. Ebel, R. L. (1972). Essentials of Educational Measurement. Englewood Cliffs, NJ: Prentice-Hall.
13. Fehrmann, M. L., Woehr, D. J., & Arthur, W. (1991). The Angoff cutoff score method: The impact of frame-of-reference rater training. Educational and Psychological Measurement, 51, 857-872.
14. Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691-701.
15. Hogan, J. C. (1991). Physical abilities. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., pp. 753-831). Palo Alto, CA: Consulting Psychologists Press.
16. Hudson, P. J., & Campion, J. E. (1994). Hindsight bias in an application of the Angoff method for setting cutoff scores. Journal of Applied Psychology, 79, 860-865.
17. Livingston, S. A., & Zieky, M. J. (1989). A comparative study of standard-setting methods. Applied Measurement in Education, 2, 121-141.
18. Maurer, T. J., & Alexander, R. A. (1992). Methods of improving employment test critical scores derived by judging test content: A review and critique. Personnel Psychology, 45, 727-762.
19. Maurer, T. J., Alexander, R. A., Callahan, C. M., Bailey, J. J., & Dambrot, F. (1991). Methodological and psychometric issues in setting cutoff scores using the Angoff method. Personnel Psychology, 44, 235-262.
20. Murphy, K. R. (1994). Potential effects of banding as a function of test reliability. Personnel Psychology, 47, 477-495.
21. Murphy, K. R., & Myors, B. (1995). Evaluating the logical critique of banding. Human Performance, 8, 191-201.
22. Murphy, K. R., Osten, K., & Myors, B. (1995). Modeling the effects of banding in personnel selection. Personnel Psychology, 48, 61-84.
23. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
24. Norcini, J. J., Lipner, R. S., Langdon, L. O., & Strecker, C. A. (1987). A comparison of three variations on a standard-setting method. Journal of Educational Measurement, 14, 56-64.
25. Norcini, J. J., Shea, J. A., & Kanya, D. T. (1988). The effects of various factors on standard setting. Journal of Educational Measurement, 25, 57-65.
26. Sackett, P. R., & Wilk, S. L. (1994). Within group norming and other forms of score adjustment in preemployment testing. American Psychologist, 49, 929-954.
27. Schmidt, F. L. (1991). Why all banding procedures in personnel selection are logically flawed. Human Performance, 4, 265-278.
28. Schmidt, F. L., & Hunter, J. E. (1995). The fatal internal contradiction in banding: Its statistical rationale is logically inconsistent with its operational procedures. Human Performance, 8, 203-214.
29. Schmidt, F. L., Mack, M. J., & Hunter, J. E. (1984). Selection utility in the occupation of U.S. park ranger for three modes of test use. Journal of Applied Psychology, 69, 490-497.
30. Schmitt, N. W., & Klimoski, R. J. (1991). Research methods in human resources management. Cincinnati, OH: South-Western Publishing.
31. S. 1745, 102d Cong., 2d Sess. (1991).
32. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
33. Sidick, J. T., Barrett, G. V., & Doverspike, D. (1994). Three-alternative multiple-choice tests: An attractive option. Personnel Psychology, 47, 829-835.
34. Smith, R. L., & Smith, J. K. (1988). Differential use of item information by judges using Angoff and Nedelsky procedures. Journal of Educational Measurement, 25, 259-274.
35. Society for Industrial and Organizational Psychology. (1987). Principles for the validation and use of personnel selection procedures (3rd ed.). College Park, MD: Author.
36. Tenopyr, M. L. (1977). Content-construct confusion. Personnel Psychology, 30, 47-54.
37. Uniform Guidelines on Employee Selection Procedures. (1978). Federal Register, 43, 38290-38309.
38. Varca, P. E., & Pattison, P. (1993). Evidentiary standards in employment discrimination: A view toward the future. Personnel Psychology, 46, 239-258.