Performance Standards: Utility for Different Uses of Assessments

Education Policy Analysis Archives

Volumn 11, Issue , 2003, Pages

  Linn, Robert L ^{a,b,c,d,e,f,g,h}  

^a UNIVERSITY OF COLORADO   (United States)

^b Natl Ctr Res Eval Std S   (United States)

^c American Educational Research Association   (United States)

^d Natl Cncl on Msrmt in Education   (United States)

^e AMERICAN PSYCHOLOGICAL ASSOCIATION   (United States)

^f Research and Measurement Division   (United States)

^g National Academy of Education   (United States)

^h NATIONAL ACADEMY OF SCIENCES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 3042558364     PISSN: 10682341     EISSN: None     Source Type: Journal    
DOI: 10.14507/epaa.v11n31.2003     Document Type: Review

References (52)

1. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 508-600). Washington, DC: American Council on Education.
2. Applewhite, A., Evens, W. R. III, & Frothingham, A. (1992). And I quote. New York: St. Martin's Press.
3. Bond, L. (1995). Ensuring fairness in the setting of performance standards. In Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments. (pp. 311-324). Washington, DC: National Assessment Governing Board and National Center for Education Statistics.
4. Braswell, J. S., Lutkus, A. D., Grigg, W. S., Santapau, S. L., Tay-lim, B.S.-H., & Johnson. M. S. (2001). The nation's report card: Mathematics 2000. Washington, DC: National Center for Education Statistics.
5. Cizek, G. J. (1993). Reactions to National Academy of Education report, Setting performance standards for student achievement. Washington, DC: National Assessment Governing Board.
6. Crocker, L. & Zieky, M. (1995). Executive Summary: Joint conference on setting standards for large-scale assessments. In Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments. (pp. ES-1 - ES-17). Washington, DC: National Assessment Governing Board and National Center for Education Statistics.
7. Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443-507).
8. CTB/McGraw-Hill. (2001), Kentucky standard setting technical report. Monterey, CA: Author.
9. Ebel, R. L. (1972). Essentials of educational measurement. Englewood Cliffs, NJ: Prentice-Hall.
10. Glaser, R. (1963). Instructional technology and the measurement of learning outcomes. American Psychologist, 18, 519-521.
11. Glaser R. & Nitko, A. J. (1971). Measurement in learning and instruction. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 625-670). Washington, DC: American Council on Education.
12. Glass, G. V. (1978). Standards and criteria. Journal of Educational Measurement, 15, 237-261.
13. Goals 2000: Educate America Act of 1994, Public Law 103-227, Sec. 1 et seq. 108 Stat. 125 (1994).
14. Green, B. F. (1981). A primer of testing. American Psychologist, 36, 1001-1011.
15. Green, D. R., Trimble, C. Scott, & Lewis, D. M. (2003). Interpreting the results of three different standard-setting procedures. Educational Measurement: Issues and Practice, 22, No. 1, 22-32.
16. Grigg, W. S., Daane, M. C., Jin, Y. & Campbell, J. R. (2003). The nation's report card: Reading 2002. Washington, DC: National Center for Education Statistics.
17. Hambleton, R. K. (1978). On the use of cut-off scores with criterion referenced tests in instructional settings. Journal of Educational Measurement, 15, 277-290.
18. Hambleton, R. K. (1980). Test score validity and standard-setting methods. In R. A. Berk (Ed.), Criterion-referenced testing: Motives, models, measures and consequences (pp. 80-123). Baltimore, MD: Johns Hopkins University Press.
19. Hambleton, R. K. (2001). Setting performance standards on educational assessments and criteria for evaluating the process. In G. J Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (pp. 89-116). Mahwah, NJ: Lawrence Erlbaum.
20. Hambleton, R. K. & Rogers, J. H. (1991). Advances in criterion-referenced measurement. In R. K Hambleton & J. N Zall (Eds.), Advances in educational and psychological testing (pp. 3-44). Boston: Kluwer Academic.
21. Hoover, H. D. (2003). Some common misconceptions about testing. Educational Measurement: Issues and Practice, 22, No. 1, 5-14.
22. Holland, P. (2002). Measuring progress in student achievement: Changes in scores and score gaps over time. Report of the Ad Hoc Committee on Confirming Test Results. Washington, DC: National Assessment Governing Board.
23. Jaeger, R. M. (1989). Certification of student competence. In R. L. Linn (ed.), Educational Measurement (3rd ed., pp. 485-514). New York: Macmillan.
24. Jaeger, R. M., Cole, J., Irwin, D. M., and Pratto, D. J. (1980). An interactive structure judgment process for setting passing scores on competency tests applied to the North Carolina high school competency tests in reading and mathematics. Greensboro, NC: Center for Education Research and Evaluation, University of North Carolina at Greensboro.
25. Jaeger, R. M. and Mills, C. (2001). An integrated judgment procedure for setting standards on complex, large-scale assessments. In G. J. Cizek (Ed.), Setting performance standards; Concepts, methods, and perspectives (pp. 313-318). Mahwah, NJ: Lawrence Erlbaum.
26. Kane, M. (1993). Comments on the NAE evaluation of NAGB achievement levels. Washington, DC: National Assessment Governing Board.
27. Kane, M. (1995). Examinee-centered and task-centered standard setting. In Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments. (pp. 119-141). Washington, DC: National Assessment Governing Board and National Center for Education Statistics.
28. Kane, M. T. (2001). So much remains the same: Conception and status of validation in setting standards. In G. J Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (pp. 53-88). Mahwah, NJ: Lawrence Erlbaum.
29. Kentucky Department of Education. (2001). Standard setting: Synthesis of three procedures - procedures and findings. Frankfort, KY: Kentucky Department of Education. Available at www.kde.state.ky.us.
30. Koffler, S.L. (1980). A comparison of approaches for setting proficiency standards. Journal of Educational Measurement, 17, 167-178.
31. Lewis, D. M., Green, D. R., Mitzel, H. C., Baum, K., & Patz, R. J. (1998). The Bookmark standard setting procedure: Methodology and recent implementations. Paper presented at the 1998 annual meeting of the National Council on Measurement, San Diego, CA.
32. Linn, R. L. (1994). Criterion-referenced measurement: A valuable perspective clouded by surplus meaning. Educational Measurement: Issues and Practice, 13 (4), 12-14.
33. Linn, R. L. (1995). The likely impact of performance standards as a function of uses: From rhetoric to sanction. In Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments. (pp. 267-276). Washington, DC: National Assessment Governing Board and National Center for Education Statistics.
34. Linn, R. L. (2000). Assessments and accountability. Educational Researcher, 29(2), 4-16.
35. Linn, R. L. (in press). Accountability: Responsibility and reasonable expectations. Educational Researcher.
36. McLaughlin, D. & Bandeira de Mello, V. (2002). Comparison of state elementary school mathematics achievement standards using NAEP 2000. Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA, April.
37. Mehrens, W. A. (1995). Methodological issues in standard setting for educational exam. In Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments. (pp. 221-263). Washington, DC: National Assessment Governing Board and National Center for Education Statistics.
38. Mehrens, W. A. & Cizek, G. J. (2001). Standard setting and the public good: Benefits accrued and anticipated. In G. J Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (pp. 477-485). Mahwah, NJ: Lawrence Erlbaum.
39. Mitzel, H. C., Lewis, D. M., Patz, R. J., & Green, D. R. (2001). The Bookmark procedure: Psychological perspectives. In G. J Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (pp. 249-281). Mahwah, NJ: Lawrence Erlbaum.
40. National Educational Goals Panel. (1993). Report of the Goals 3 and 4 Technical Planning Group on the Review of Education Standards. Washington, DC: Author.
41. No Child Left Behind Act of 2001. Public Law 107-110.
42. Olson, L. (2003). "Approved' is relative term for Ed. Dep.: 11 states fully meet ESEA requirements. Education Week, Vol. XXII, No. 43. August 6, pp. 1, 34-36.
43. Pellegrino, J. W., Jones, L. R., & Mitchell, K. J. (Eds.). (1999). Grading the nation's report card: Evaluating NAEP and transforming the assessment of educational progress. Washington, DC: National Academy Press.
44. Poggio, J. P., Glasnapp, D. R., & Eros, D. S. (1981). An empirical investigation of the Angoff, Ebel, and Nedelsky standard setting methods. Paper presented at the annual meeting of the American Educational Research Association, Los Angeles, April.
45. Popham, W. J. (1978). As always, provocative. Journal of Educational Measurement, 15, 297-300.
46. Raymond, M. R. & Reid, J. B. (2001). Who made thee judge? Selecting and training participants for standard setting. In G. J Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (pp. 119-157). Mahwah, NJ: Lawrence Erlbaum.
47. Shepard, L. A. (1979). Setting standards. In M. A. Bunda & R Sanders (Eds.), Practices and problems in competency-based measurement (pp. 72-88). Washington, DC: National Council on Measurement in Education.
48. Shepard, L. A. (1980). Technical issues in minimum competency testing. In D. C. Berliner (Ed.), Review of research in education: Vol. 8 (pp. 30-82). Washington, DC: American Educational Research Association.
49. Shepard, L. A. (1984). Setting performance standards. In R. A. Berk (Ed.), Criterion-referenced testing: Motives, models, measures and consequences (pp. 169-198). Baltimore, MD: Johns Hopkins University Press.
50. Shepard, L., Glaser, R., Linn, R. & Bohrnstedt, G. (1993). Setting performance standards for student achievement. Stanford, CA: National Academy of Education.
51. Zieky, M. J. (1995). A historical perspective on setting standards. In Proceedings of the Joint Conference on Standard Setting for Large-Scale Assessments n Statistics. (pp. 1-38). Washington, DC: National Assessment Governing Board and National Center for Education Statistics.
52. Zieky, M. J. (2001). So much has changed: How the setting of cutscores has evolved since the 1980s. In G. J Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (pp. 19-51). Mahwah, NJ: Lawrence Erlbaum.