Setting Performance Standards on Complex Assessments the Body of Work Method

Setting Performance Standards Foundations, Methods, and Innovations

Volumn , Issue , 2012, Pages 201-224

  Kingston, Neal M ^a   Tiemann, Gail C ^a  

^a UNIVERSITY OF KANSAS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84894385363     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203848203     Document Type: Chapter

References (23)

1. Advanced Systems in Measurement and Evaluation. (1993). KIRIS technical manual. Dover, NH: Author.
2. Advanced Systems in Measurement and Evaluation. (1996). KIRlS standards validation study. Dover, NH: Author.
3. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational Measurement (2nd ed., pp. 508–600). Washington DC: American Council on Education.
4. Bickel, P. J., & Doksum, K. A. (1977). Mathematical statistics: Basic ideas and selected topics. Oakland, CA: Holden-Day.
5. Bingham, W. V. D. (1937). Aptitudes and aptitude testing. New York, NY: Harper & Brothers.
6. Cizek, G. J., & Bunch, M. B. (2007). Standard setting: A guide to establishing and evaluating performance standards on tests. Thousand Oaks, CA: Sage.
7. Cohen, A. S., Kane, M. T., & Crooks, T. J. (1999). A generalized examinee-centered method for setting standards on achievement tests. Applied Measurement in Education, 12, 343–366. doi: 10.1207/s15324818ame1204_2
8. Finkelman, M., & Kim, W. (2007, April). Using person fit in a body of work standard setting. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.
9. Hambleton, R. K., Jaeger, R. M., Plake, B. S., & Mills, C. (2000). Setting performance standards on complex educational assessments. Applied Psychological Measurement, 24(4), 355–366. doi: 10.1177/01466210022031804
10. Jaeger, R. M. (1989). Certification of student competence. In R. L. Unn (Ed.), Educational measurement (3rd ed., pp. 485–514). New York, NY: American Council on Education and Macmillan.
11. Jaeger, R. M. (1995). Setting standards for complex performances: An iterative, judgmental policy-capturing strategy. Educational Measurement: Issues and Practice, 14(4), 16–20.
12. Jaeger, R. M., & Mills, C. N. (2001). An integrated judgment procedure for setting standards on complex large-scale assessments. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (pp. 313–338). Mahwah, NJ: Erlbaum.
13. Kahl, S. R., Crockett, T. J., DePascale, C. A., & Rindfleisch, S. L. (1994, June). Using actual stu dent work to determine cutscores for proficiency levels: New methods for new tests. Paper presented at the National Conference on Large- Scale Assessment, Albuquerque, NM.
14. Kahl, S. R., Crockett, T. J., DePascale, C. A., & Rindfleisch, S. L. (1995). Setting stan dards for performance levels using the occupational tests. Princeton, NJ: Educational Testing Service.
15. Kenyon, D., & Fidelman, C. (2009, April). Standard setting with the modified body of work method. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
16. Kingston, N. M., Kahl, S. R., Sweeney, K. P., & Bay, L. (2001). Setting performance standards using the body of work method. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 218–248). Mahwah, NJ: Erlbaum.
17. Mitzel, H. C., Lewis D. M., Patz, R. J., & Green, D. R. (2001). The Bookmark procedure: Psychological perspectives. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 249–281). Mahwah, NJ: Erlbaum.
18. Morgan, D. L., & Hardin, E. (2009). Setting cut scores with Writeplacer. New York, NY: The College Board.
19. Plake, B. S., Hambleton, R. K., & Jaeger, R. M. (1997). A new standard-setting method for performance assessments: The dominant profile judgment method and some field-test results. Educational and Psychological Measurement, 57(3), 400–411.
20. Plake, B. S., & Hambleton, R. K. (2001). The analytic judgment method for setting standards on complex performance assessments. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 283–312). Mahwah, NJ: Erlbaum.
21. Popp, S. E. O., Ryan, J. M., & Thompson, M. S. (2009). The critical role of anchor paper selection in writing assessment. Applied Measurement in Education, 22(3), 255–271. doi: 10.1080/08957340902984026
22. Shepard, L. A. (1994). Implications for standard setting of the National Academy of Education evaluation of the National Assessment of Educational Progress achievement levels. In Proceedings of Joint Conference on Standard Setting for Large-Scale Assessments. Washington, DC: National Assessment Governing Board and National Center for Educational Statistics.
23. Sweeney, K. P., & Ferdous, A. A. (2007, April). Variations of the “Body of work” Standard setting method. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL. Retrieved from http://www.measuredprogress.com/resources/psychometrics/framework/materials/07/AERA.NCME/VariationsBodyOfWork. pdf