Variations on a Theme: The Modified Angoff, Extended Angoff, and Yes/No Standard Setting Methods

Setting Performance Standards: Foundations, Methods, and Innovations

Volumn , Issue , 2012, Pages 181-199

  Plake, Barbara S ^a   Cizek, Gregory J ^b  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^b UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84871214174     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203848203-18     Document Type: Chapter

References (26)

1. Angoff, W. A. (1971). Scales, norms and equivalent scores. In R. L. Th orndike (Ed.), Educational Measurement (2nd ed., pp. 508-600). Washington, DC: American Council on Education.
2. Berk, R. A. (1986). A consumer’s guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56, 137-172.
3. Cizek, G. J. (Ed.). (2001). Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Erlbaum.
4. Cizek, G. J., & Bunch, M. (2007). Standard setting: A practitioner’s guide to establishing and evaluating performance standards on tests. Th ousand Oaks, CA: Sage.
5. Cizek, G. J., & Plake, B. S. (2009). Developing a plan for setting profi ciency standards for the DLPT5 examinations. Contract M67004-05-D-0009. Delivery Order 51. Washington, DC: Defense Language Offi ce.
6. Downing, S. M., Lieska, N. G., & Raible, M. D. (2003). Establishing passing standards for classroom achievement tests in medical education: A comparative study of four methods. Academic Medicine, 78(10), S85-S87.
7. Hambleton, R. K., Brennan, R. L., Brown, W., Dodd, B., Forsyth, R. A., Mehrens, W. A., . Zwick, R. (2000). A response to “Setting Reasonable and Useful Performance Standards” in the National Academy of Sciences’ Grading the Nation’s Report Card. Educational Measurement: Issues and Practice, 19(2), 5-14.
8. Hambleton, R. K., & Plake, B. S. (1995). Extended Angoff procedure to set standards on complex performance assessments. Applied Measurement in Education, 8, 41-56.
9. Impara, J. C. (1997, October). Setting standards using Angoff ‘s method: Does the method meet the standard? Invited address, Midwestern Educational Research Association, Chicago, IL.
10. Impara, J. C., & Plake, B. S. (1997). Standard setting: An alternative approach. Journal of Educational Measurement, 34, 353-366.
11. Impara, J. C., & Plake, B. S. (1998). Teachers’ ability to estimate item diffi culty: A test of the assumptions of the Angoff standard setting method. Journal of Educational Measurement, 35, 69-81.
12. Interagency Language Roundtable. (n.d.). Interagency Language Roundtable language skill level descriptions - reading. Retrieved July 20, 2009, from http://www.govtilr.org/Skills/ILRscale3.htm
13. Jaeger, R. M. (1989). Certifi cation of student competence. In R. L. Linn (Ed.), Educational measurement, third edition (pp. 485-514). New York, NY: Macmillan.
14. Loomis, S. C., & Bourque, M. L. (2001). From tradition to innovation: Standard setting on the National Assessment of Educational Progress. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 175-218). Mahwah, NJ: Erlbaum.
15. Meara, K. P., Hambleton, R. K., & Sireci, S. G.,. (2001). Setting and validating standards on professional licensure and certifi cation exams: A survey of current practices. CLEAR Exam Review, 12(2), 17-23.
16. Melican, G. J., & Plake, B. D. (1985). Are correction for guessing and Nedelsky’s standard setting method compatible? Journal of Psychoeducational Assessment, 3, 31-36.
17. Mills, C. N., & Melican, G. J. (1988). Estimating and adjusting cutoff scores: Features of selected methods. Applied Measurement in Education, 1, 261-275.
18. Pelligrino, J. W., Jones, L. R., & Mitchell, K. J. (Eds.). (1999). Grading the nation’s report card. Washington, DC: National Academy Press.
19. Plake, B. S. (1998). Setting performance standards for professional licensure and certifi cation. Applied Measurement in Education, 11, 65-80.
20. Plake, B. S., Impara, J. C., & Irwin, P. M. (2000). Consistency of Angoff -based predictions of item performance: Evidence of the technical quality of results from the Angoff standard setting method. Journal of Educational Measurement, 37, 347-356.
21. Reckase, M. D. (2001). Innovative methods for helping standard setting participants to perform their task: Th e role of feedback regarding consistency, accuracy, and impact. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 159-174). Mahwah, NJ: Erlbaum.
22. Reckase, M. D., & Bay, L. (1999, April). Comparing two methods for collecting test-based judgments. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.
23. Shepard, L. A. (1995). Implications for standard setting of the National Academy of Education evaluation of National Assessment of Educational Progress achievement levels. In Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments, Volume II (pp. 143-160). Washington, DC: US Government Printing Offi ce.
24. Sireci, S. A., & Biskin, B. H. (1992). Measurement practices in national licensing programs: A survey. CLEAR Exam Review, 3(1), 21-25.
25. Taube, K. T. (1997). Th e incorporation of empirical item diffi culty data into the Angoff standard-setting procedure. Evaluation & the Heath Professions, 20(4), 479-498.
26. Thorndike, R. L. (Ed.). (1971). Educational measurement, second edition. Washington, DC: American Council on Education.