Standard-setting techniques: An application for counseling programs

Measurement and Evaluation in Counseling and Development

Volumn 32, Issue 4, 2000, Pages 229-244

  Stephenson, Agnes S ^a   Elmore, Patricia B ^b   Evans, John Andrew ^b  

^a Psychological Corporation   (United States)

^b SOUTHERN ILLINOIS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034383834     PISSN: 07481756     EISSN: None     Source Type: Journal    
DOI: 10.1080/07481756.2000.12068989     Document Type: Article

References (27)

1. Andrew, B. J., & Hecht, J. T. (1976). A preliminary investigation of two procedures for setting examination standards. Educational and Psychological Measurement, 36, 45-50.
2. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (508-600). Washington, DC: American Council on Education.
3. Behuniak, P., Jr., Archambault, F. X., & Gable, R. K. (1982). Angoff and Nedelsky standard setting procedures: Implications for the validity of proficiency score interpretation. Educational and Psychological Measurement, 42, 247-255.
4. Berk, R. A. (1996). Standard setting: The next generation (where few psychometrices have gone before!). Applied Measurement in Education, 9, 215-235.
5. Brennan, R. L. (1983). Elements of generalizability theory. Iowa City, IA: The American College Testing Program.
6. Brennan, R. L., & Lockwood, R. E. (1980). A comparison of the Nedelsky and Angoff cutting score procedures using generalizability theory. Applied Psychological Measurement, 4, 219-240.
7. Carney, J. S., Cobia, D. C., & Shannon, D. M. (1998). An examination of final evaluation methods used in master's level counseling programs. Counselor Education and Supervision, 37, 154-165.
8. Cross, L. H., Impara, J. C., Frary, R. B., & Jaeger, R. M. (1984). A comparison of three methods for establishing minimum standards on the National Teacher Examinations. Journal of Educational Measurement, 21, 113-129.
9. Ebel, R. L. (1972). Essentials of educational measurement. Englewood Cliffs, NJ: Prentice-Hall.
10. Faggen, J. (1994). Setting standards for constructed response tests: An overview. Princeton, NJ: Educational Testing Service.
11. Halpin, G., Sigmon, G., & Halpin, G. (1983). Minimum competency standards set by three divergent groups of raters using three judgmental procedures: Implications for validity. Educational and Psychological Measurement, 43, 185-196.
12. Harasym, P. H. (1981). A comparison of the Nedelsky and modified Angoff standard-setting procedure on evaluation outcome. Educational and Psychological Measurement, 41, 725-734.
13. Jaeger, R. M. (1982). An iterative structured judgment process for establishing standards on competency tests: Theory and application. Educational Evaluation and Policy Analysis, 4, 461-475.
14. Koffler, S. L. (1980). A comparison of approaches for setting proficiency standards. Journal of Educational Measurement, 17, 167-178.
15. Livingston, S. A., & Zieky, M. J. (1982). Passing scores. Princeton, NJ: Educational Testing Service.
16. Livingston, S. A., & Zieky, M. J. (1989). A comparative study of standard-setting methods. Applied Measurement in Education, 2, 121-141.
17. Mills, C. N. (1983). A comparison of three methods of establishing cut-off scores on criterion-referenced tests. Journal of Educational Measurement, 20, 283-292.
18. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
19. Norcini, J. J., Lipner, R. S., Langdon, L. O., & Strecker, C. A. (1987). A comparison of three variations on a standard-setting method. Journal of Educational Measurement, 24, 56-64.
20. Norcini, J. J., & Shea, J. (1992). The reproducibillty of standards over groups and occasions. Applied Measurement in Education, 5, 63-72.
21. Olkin, R., & Gaughen, S. (1991). Evaluation and dismissal of students In master's level clinical programs: Legal parameters and survey results. Counselor Education and Supervision, 30, 276-288.
22. Plake, B. S. (1995). The performance domain and the structure of the decision space. Applied Measurement in Education, 8, 3-13.
23. Plake, B. S., & Impara, J. C. (1996, April). Intrajudge consistency using the Angoff standard setting method. Paper presented at the annual meeting of the National Council on Measurement in Education, New York.
24. Sanders, J. C., Ryan, J. P., & Huynh, H. (1981). A comparison of two approaches to setting passing scores based on the Nedelsky procedure. Applied Psychological Measurement, 5, 209-217.
25. Skakun, E. N., & Kling, S. (1980). Comparability of methods for setting standards. Journal of Educational Measurement, 17, 229-235.
26. Stephenson, A. S. (1998). Standard setting techniques: A comparison of methods based on judgments about test questions and methods based on test-takers. Unpublished doctoral dissertation, Southern Illinois University, Carbondale.
27. Zieky, M. J. (1994. October). A historical perspective on setting standards. Paper presented at the Joint Conference on Standard Setting for Large-Scale Assessments, Washington, DC.