A Response to “Setting Reasonable and Useful Performance Standards” in the National Academy of Science’Grading the Nations Report Card

Educational Measurement: Issues and Practice

Volumn 19, Issue 2, 2000, Pages 5-14

  Hambleton, Ronald K ^a   Brennan, Robert L ^b   Brown, William ^c   Dodd, Barbara ^d   Forsyth, Robert A ^b   Mehrens, William A ^e   Nellhaus, Jeff ^f   Reckase, Mark ^e   Rindone, Douglas ^g   van der Linden, Wim J ^h   Zwick, Rebecca ⁱ  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b UNIVERSITY OF IOWA   (United States)

^c President of Brown star Inc   (United States)

^d UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^e MICHIGAN STATE UNIVERSITY   (United States)

^f The Director of Student Assessment for the Massachusetts Department of Education   (United States)

^g The Chief of the Bureau of Student Assessment and Research   (United States)

^h UNIVERSITY OF TWENTE   (Netherlands)

ⁱ UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0742280616     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2000.tb00024.x     Document Type: Article

References (37)

1. ACT. (1993a) Description of mathematics achievement levels-setting process and proposed achievement level descriptions: Volume 1. Iowa City, IA: Author.
2. ACT. (1993b) Setting achievement levels on the 1992 National Assessment of Educational Progress in mathematics, reading, and writing: a technical report on reliability and validity. Iowa City, IA: Author.
3. ACT. (1995, December) Research studies on the achievement levels set for the 1994 NAEP in geography and U.S. history. Iowa City, IA: Author.
4. ACT. (1997a) Setting achievement levels on the 1996 National Assessment of Educational Progress in science: final report volume I, pilot study 1. Iowa City, IA: Author.
5. ACT. (1997b) Setting achievement levels on the 1996 National Assessment of Educational Progress in Science: final report volume II, pilot study 2. Iowa City, IA: Author.
6. ACT. (1997c) Setting achievement levels on the 1996 National Assessment of Educational Progress in science: final report volume III—achievement levels setting study. Iowa City, IA: Author.
7. ACT. (1997d) Setting achievement levels on the 1996 National Assessment of Educational Progress in science: final report volume IV, validity evidence and special studies. Iowa City, IA: Author.
8. ACT. (1997e) Setting achievement levels on the 1996 National Assessment of Educational Progress in science: final report volume V, technical decisions and NAGB actions. Iowa City, IA: Author.
9. ACT. (1997f, March) A proposal to the National Assessment Governing Board for developing achievement levels on the 1998 NAEP in civics and writing: Technical Proposal. Iowa City, IA: Author.
10. ACT. (1997g September) Developing achievement levels on the 1998 NAEP in civics and writing: planning document. Iowa City, IA: Author.
11. ACT. (1997h December) Developing achievement levels on the 1998 NAEP in civics and writing: design document. Iowa City, IA: Author.
12. ACT. (1998, November) Developing achievement levels on the 1998 NAEP in civics and writing: planning document, update 1. Iowa City, IA: Author.
13. Bourque, M. L. (Ed.). (1995) Proceedings of the joint conference on standard setting for large-scale assessments. Washington, DC: National Assessment Governing Board, National Center for Education Statistics.
14. Bracey, G. W. (1999) The ninth Bracey report on the condition of public education. Phi Delta Kappan, 81 (2), 147–168.
15. Brennan, R. L. (1998) Misconceptions at the intersection of measurement theory and practice. Educational Measurement: Issues and Practice, 17(1), 5–9, 30.
16. Burstein, L., Koretz, D. Linn, R., Sugrue, B., Novak, J., & Baker, E. L. (1996) Describing performance standards: Validity of the 1992 National Assessment of Educational Progress achievement level descriptions as characterizations of mathematics performance. Educational Assessment, 3(1), 9–51.
17. Cizek, G. J. (1993) Reaction to National Academy of Education Report, “Setting Performance Standards for Student Achievement”. Washington, DC: National Assessment Governing Board.
18. DeMars, C. (1998) The impact of test consequences and response format on performance. Unpublished doctoral dissertation, Michigan State University, East Lansing, MI.
19. Glaser, R., Linn, R., & Bohrnstedt, G. (1993) Setting performance standards for student achievement. Stanford: National Academy of Education.
20. Hambleton, R. K., & Bourque, M. L. (1991) The levels of mathematics achievement (Vol. III, Tech. Rep.). Washington, DC: National Assessment Governing Board.
21. Jaeger, R. M. (1990) Establishing standards for teacher certification tests. Educational Measurement: Issues and Practice, 9 (4), 15–20.
22. Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards: How to assess evaluations of educational programs (2nd ed). Thousand Oaks, CA: Sage.
23. Kane, M. (1993) Comment on the NAE evaluation of the NAGB achievement levels. Washington, DC: National Assessment Governing Board.
24. Kane, M. (1994) Validating the performance standards associated with passing scores. Review of Educational Research, 64, 425–461.
25. Kane, M. (1995) Examinee-centered vs. task-centered standard setting. In M. L. Bourque, (Ed.), Joint Conference on Standard Setting for Large-Scale Assessments. Washington: NCES-NAGB.
26. Linn, R. L. (1999, February) Assessment and accountability systems. Paper (invited) presented at the meeting of the American Association of School Administrators, New Orleans.
27. McLaughlin, D. H. (1993a) Validity of the 1992 NAEP achievement-level setting process. In R. Glaser, R. Linn, & G. Bohrnstedt, (Eds.), Setting performance standards for student achievement: Background studies. Stanford: National Academy of Education.
28. McLaughlin, D. H. (1993b) Order of Angoff ratings in multiple simultaneous standards. In R. Glaser, R. Linn, & G. Bohrnstedt, (Eds.), Setting performance standards for student achievement: Background studies. Stanford: National Academy of Education.
29. McLaughlin, D. H. (1993c) Rated achievement levels of completed NAEP mathematics booklets. In R. Glaser, R. L. Linn, & G. Bohrnstedt, (Eds.), Setting performance standards for student achievement: Background studies. Stanford: National Academy of Education.
30. McLaughlin, D. H., DuBois, P. A., Eaton, M. S., Ehrlich, D. E., Stancavage, F. B., O'Donnell, C. A., Yu, J. Y., DeStefano, L., Pearson, D., Bottomley, D., Bullock, C. A., Hanson, M., & Rucinski, C. (1993) Comparison of teachers' and researchers' ratings for students' performance in mathematics and reading with NAEP measurement of achievement levels. In R. Glaser, R. Linn, & G. Bohrnstedt, (Eds.), Setting performance standards for student achievement: Background studies. Stanford: National Academy of Education.
31. Mehrens, W. A. (1995) Methodological issues in standard setting for educational exams. In M. L. Bourque, (Ed.), Proceedings of the joint conference on standard setting for large-scale assessments (pp. 221–263). Washington, DC: National Assessment Governing Board, National Center for Education Statistics.
32. National Academy of Sciences. (1998, July) A unique national resource. Washington, DC: Author.
33. Pellegrino, J. W., Jones, L. R., & Mitchell, K. J. (1999) Grading the nation's report card. Washington, DC: National Academy Press.
34. Reckase, M. D., & Bay, L. (1998, April) Analysis of methods for collecting test-based judgements. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Diego.
35. Rothstein, R. (1998) The way we were? The myths and realities of America's student achievement. New York: Century Foundation.
36. Shepard, L. A., Glaser, R., Linn, R. L., & Bohrnstedt, G. (1993) Setting performance standards for student achievement (Final Report). Stanford: National Academy of Education.
37. Zieky, M. (1995) A historical perspective on setting standards. In M. L. Bourque, (Ed.), Joint Conference on Standard Setting for Large-Scale Assessments (pp. 1–38). Washington, DC: NCES-NAGB