Alternative Approaches to Standard Setting for Licensing and Certification Examinations

Applied Measurement in Education

Volumn 15, Issue 1, 2002, Pages 1-14

  Chinn, Roberta N ^a,b   Hertz, Norman R ^a  

^a California Dept of Consumer Affairs   (United States)

^b NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0036114174     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15324818AME1501_01     Document Type: Article

References (27)

1. Andrew, B. J., & Hecht, J. T. (1976). A preliminary investigation of two procedures for setting examinations standards. Educational and Psychological Measurement, 36, 45-50.
2. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 508-600). Washington, DC: American Council of Education.
3. Behuniak, P., Archambault, F. X., & Gable, R. K. (1982). Angoff and Nedelsky standard setting procedures: Implications for the validity of proficiency test score interpretation. Educational and Psychological Measurement, 42, 247-255.
4. Berk, R. A. (1996). Standard setting: The next generation (where few psychometricians have gone before!). Applied Measurement in Education, 9, 215-235.
5. Bernardin, H. J., & Buckley, M. R. (1981). Strategies in rater training. Academy of Management Review, 6, 205-212.
6. Brennan, R. L., & Lockwood, R. E. (1980). A comparison of Nedelsky and Angoff cutting score procedures using generalizability theory. Applied Psychological Measurement, 4, 219-240.
7. Cizek, G. J. (1996). Standard-setting guidelines. Educational Measurement: Issues and Practice, 15(1), 12, 13-21.
8. Fehrmann, M. L., Woehr, D. J., & Arthur W. (1991). The Angoff cutoff score method: The impact of frame-of-reference training. Educational and Psychological Measurement, 51, 857-872.
9. Fitzpatrick, A. R. (1989). Social influences in standard-setting: The effects of social interaction on group judgments. Review of Educational Research, 59, 315-328.
10. Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51, 327-358.
11. Goodwin, L. D. (1996). Focus on quantitative methods: Determining cut-off scores. Research in Nursing and Health, 19, 249-256.
12. Hambleton, R., & Plake, B. S. (1995). Using an extended Angoff procedure to set standards on complex performance assessments. Applied Educational Measurement in Education, 8, 41-55.
13. Harasym, P. H. (1981). A comparison of the Nedelsky and modified Angoff standard-setting procedure on evaluation outcome. Educational and Psychological Measurement, 41, 725-734.
14. Hauenstein, N. M. A., & Foti, R. J. (1989). From laboratory to practice: Neglected issues in implementing frame-of-reference training. Personnel Psychology, 42, 359-378.
15. Impara, J. C., & Plake, B. S. (1997). Standard setting: An alternative approach. Journal of Educational Measurement, 34, 353-366.
16. Jaeger, R. M. (1989). Certification of student competence. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 485-514). New York: Macmillan.
17. Kane, M. (1998). Criterion bias in examinee-centered standard setting: Some thought experiments. Educational Measurement: Issues and Practice, 17(1), 23-30.
18. Mauer, T. J., & Alexander, R. A. (1992). Methods of improving employment test critical scores derived by judging test content: A review and critique. Personnel Psychology, 45, 727-762.
19. Mills, C. N., Melican, G. J., & Ahluwalia, N. T. (1991). Defining minimal competence. Educational Measurement: Issues and Practice, 10(2), 7-10.
20. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
21. Norcini, J. J. (1994). Research on standards for professional licensure and certification examinations. Evaluation and the Health Professions, 17, 160-177.
22. Norcini, J. J., Shea, J. A., & Kanya, D. T. (1988). A note on the application of multiple matrix sampling to standard setting. Journal of Educational Measurement, 25, 57-65.
23. Plake, B. S., Melican, G. J., & Mills, C. N. (1991). Factors influencing intrajudge consistency during standard-setting. Educational Measurement: Issues and Practice, 10(2), 15-16, 22, 25-26.
24. Reid, J. B. (1991). Training judges to generate standard-setting data. Educational Measurement: Issues and Practice, 10(2), 11-14.
25. Schoon, C. G., & Smith, I. L. (1996). Standard setting. In A. H. Browning, A. C. Bugbee, & M. A. Mullins (Eds.), Certification: A NOCA handbook (pp. 149-189). Washington, DC: The National Organization for Competency Assurance (NOCA).
26. Sireci, S. G., & Biskin, B. H. (1992). Measurement practices in national licensing examination programs: A survey. CLEAR Exam Review, 3, 21-25.
27. Taube, K. T. (1997). The incorporation of empirical item difficulty data into the Angoff standard-setting procedure. Evaluation and the Health Professions, 20, 479-498.