Standard-setting methods as measurement processes

Educational Measurement: Issues and Practice

Volumn 29, Issue 1, 2010, Pages 14-24

  Nichols, Paul ^a   Twing, Jon ^a   Mueller, Canda D ^b   O'Malley, Kimberly ^a  

^a PEARSON   (United States)

^b Assessment Inc   (United States)

Author keywords

Reliability; Standard setting

Indexed keywords

EID: 77952538716     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2009.00166.x     Document Type: Article

References (36)

1. Angoff W A. Scales, norms, and equivalent scores. Educational measurement 1971, 508-600. Thorndike R L. Ed., 2nd ed., pp, Washington, DC, American Council on Education
2. Brennan R L. Generalizability theory 2001, 2nd ed., New York, Springer
3. Cardinet J, Tourneur Y, Allal L. The symmetry of generalizability theory: Applications to educational measurement. Journal of Educational Measurement 1976, 13:119-135.
4. Cizek G J. Reconsidering standards and criteria. Journal of Educational Measurement 1993, 30:93-106.
5. Cizek G J, Bunch M B, Koons H. Setting performance standards: Contemporary methods. Educational Measurement: Issues and Practice 2004, 23(4):31-50.
6. DeMauro G E. Developing a theory of performance: A two-stage structure for the psychology of standard setting. 2003, April, Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL
7. Feldt L S, Brennan R L. Reliability. Educational measurement 1989, 105-146. Linn R L, In, Ed., 3rd ed., pp, New York, American Council on Education and Macmillan
8. Glass G V. Standards and criteria. Journal of Educational Measurement 1978, 15:237-261.
9. Haertel E H. Reliability. Educational measurement 2006, 65-110. Brennan R L. In, Ed., 4th ed., pp, Westport, CT, American Council on Education and Praeger
10. Irtel H. Psychophysical scaling. Encyclopedia of statistics in behavioral science 2005, Vol. 3:1628-1632. Everitt Brian SHowell David C. In, Eds., pp, Chichester, UK, John Wiley & Sons
11. Jaeger R M. Certification of student competence. Educational measurement 1989, 485-514. Linn R L. In, Ed., 3rd ed., pp, New York, American Council on Education and Macmillan
12. Kane M. Validating the performance standards associated with passing scores. Review of Educational Research 1994, 64:425-261.
13. Katz I R, Bennett R E, Berger A E. Effects of response format on difficulty of SAT-mathematics items: It's not the strategy. Journal of Educational Measurement 2000, 37:39-57.
14. Koffler S L. A comparison of approached for setting proficiency standards. Journal of Educational Measurement 1980, 17:167-178.
15. Lee G, Lewis D M. A generalizability theory approach toward estimating standard errors of cutscores set using the Bookmark standard setting procedure 2001, Paper presented at the annual meeting of the National Council on Measurement in Education, Seattle, WA
16. Linn R L. Performance standards: Utility for different uses of assessments. Education Policy Analysis Archives 2003, September 1, 11(31). http://epaa.asu.edu/epaa/v11n31/, Accessed December 27, 2007 at
17. Loyd B H. Mathematics test performance: The effects of item type and calculator use. Applied Measurement in Education 1991, 4:11-22.
18. Messick S. Validity. Educational measurement 1989, 13-103. Linn R L. In, Ed., 3rd ed., pp, New York, American Council on Education and Macmillan
19. Messick S. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist 1995, 50:741-749.
20. Millman J, Greene J. The specification and development of tests of achievement and ability. Educational measurement 1989, 335-366. Linn RL, In, Ed., 3rd ed., pp, New York, American Council on Education and Macmillan
21. Mitzel H C, Lewis D M, Patz R J, Green D R. The bookmark procedure: Psychological perspectives. Setting performance standards: Concepts, methods, and perspectives 2001, 249-281. Cizek G J, In, Ed., pp, Mahwah, NJ, Lawrence Erlbaum Associates
22. Reading interrater reliability 2008, http://nces.ed.gov/nationsreportcard/tdw/scoring/2000_2001/read_inter.asp, National Assessment of Educational Progress, Accessed November 2, 2008 at
23. Assessing the role of K-12 academic standards in states: Workshop summary 2008, National Research Council, Alexandra Beatty, Rapporteur. Committee on State Standards in Education: A Workshop Series. Center for Education, Division of Behavioral and Social Sciences and Education, Washington, DC, The National Academies Press
24. 2001, No Child Left Behind Act of, Pub. L. No. 107-110, 115 Stat. 1425 (2002)
25. Nunnally J C. Psychometric theory 1978, 2nd ed., New York, McGraw-Hill
26. Perie M. A guide to understanding and developing performance-level descriptors. Educational Measurement: Issues and Practice 2008, 27:15-29.
27. Schmeiser C B, Welch C J. Test development. Educational measurement 2006, 307-353. Brennan R L, In, Ed., 4th ed., pp, Washington, DC, The National Council on Measurement in Education & the American Council on Education
28. Shepard L. Standard setting issues and methods. Applied Psychological Measurement 1980, 4:447-467.
29. Skakun E N, Kling S. Comparability of methods for standard setting. Journal of Educational Measurement 1980, 17:229-235.
30. Thorndike E L. Handwriting. Part II. The speed and quality of handwriting in seven school systems: Miscellaneous comments. Teachers College Record 1910, 11:77-81.
31. Torgerson W S. Theory and methods of scaling 1958, New York, Wiley
32. An introduction to NAEP. 2008, http://nces.ed.gov/nationsreportcard/pdf/about/introduction_to_naep_2008.pdf, U.S. Department of Education, Accessed November 2, 2008 at
33. Yen WM, Fitzpatrick AR. Item response theory. Educational measurement 2006, 111-153. Brennan R L, In, Ed., 4th ed., pp, Westport, CT, American Council on Education and Praeger
34. A historical perspective on setting standards. Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments 1995, 1-38. Zieky, M. J., In, pp, Washington, DC, National Assessment Governing Board and National Center for Education Statistics
35. Interpreting the results of three different standard-setting procedures. Educational Measurement: Issues and Practice 2003, 22(1):22-32. Green, D. R., Trimble, C. S., Lewis, D. M.
36. A guide to establishing and evaluating performance standards on tests 2007, Cizek, G. J., &, Bunch, M. B., Thousand Oaks, CA, Sage Publications