Limitations in the use of achievement tests as measures of educators' productivity

Journal of Human Resources

Volumn 37, Issue 4, 2002, Pages 752-777

  Koretz, Daniel M ^a  

^a HARVARD GRADUATE SCHOOL OF EDUCATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PRODUCTIVITY;

EID: 0036763565     PISSN: 0022166X     EISSN: None     Source Type: Journal    
DOI: 10.2307/3069616     Document Type: Article

References (50)

1. Airasian, P. 1987. "State Mandated Testing and Educational Reform: Context and Consequences." American Journal of Education 95(3):393-412.
2. Cannell, J. J. 1987. Nationally Normed Elementary Achievement Testing in America's Public Schools: How All Fifty States are Above the National Average, Daniels, W. Va.: Friends for Education.
3. Cronbach, L. J., G. C. Gleser H. Nanda and M. Rajaratnam N. 1972. The Dependability of Behavioral Measurements: The Generalizability of Scores and Profiles. New York: Wiley.
4. Darling-Harmmond, L. and A. E. Wise. 1985. "Beyond Standardization: State Standards and School Improvement." The Elementary School Journal 85(3):315-36.
5. Feuer, M. J., P. W. Holland, B. F. Green, M. W. Bertenthal, M. W., and F. C. Hemphill, eds. 1999. Committee on Equivalency and Linkage of Educational Tests, National Research. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, D.C.: National Academy Press.
6. Goodnough, A. 1999. "Answers Allegedly Supplied In Effort to Raise Test Scores." The New York Times, December 8.
7. Goslin, D. A. 1963. The Search for Ability: Standardized Testing in Social Perspective. New York: Russell Sage.
8. Goslin, D., R. R. Epstein B. A. Hallock. 1965. The Use of Standardized Tests in Elementary Schools. New York: Russell Sage.
9. Hambleton, R., K. R. M.Jaeger, D. Koretz, R. L. Linn, J. Millman and S. E. Phillips. 1995. Review of the Measurement Quality of the Kentucky Instructional Results Information System, 1991-1994. Frankfort, KY: Office of Education Accountability, Kentucky General Assembly, June.
10. Haney, W. 1981. "Validity, Vaudeville and Values: A Short History of Social Concerns Over Standardized Testing." American Psychologist 36(10):1021-34.
11. Haney, W. 2000. "The Myth of the Texas Miracle in Education Reform." In The New Discrimination: Creating and Recreating Discrimination in Public Schools, ed. L. McNeil (Chair). Symposium presented at the annual meeting of the American Educational Research Association, New Orleans, April 27.
12. Hedges, L. V., A. Nowell. 1998. "Black-White Test Score Convergence Since 1965." In The Black-White Test Score Gap, ed. C. Jencks and M. Phillips, 149-81. New York: Brookings
13. Jaeger, R. M. 1982. "The Final Hurdle: Minimum Competency Achievement Testing." In The Rise and Fall of National Test Scores, ed. G. R. Austin and H. Garber, 223-46. New York: Academic Press
14. Kane, T. J., D. O. Staiger. 2001. "Volatility in School Test Scores: Implications for Test-based Accountability Systems." Paper presented at a Brookings Institution conference on educational accountability, Washington, D.C., May 15.
15. Kentucky Department of Education, 1997. "KIRIS Accountability Cycle 2 Technical Manual." Frankfort, KY: Kentucky Department of Education.
16. Kiplinger, V. L., and R. L. Linn. 1995. "Raising the Stakes of Test Administration: The Impact on Student Performance on the National Assessment of Educational Progress." Educational Assessment 3(2):111-34.
17. Klein, S., L. Hamilton, D. McCaffrey, B. Stecher. 2000. "What Do Test Scores in Texas Tell Us?" (IP-202) Santa Monica, Calif: RAND.
18. Koretz, D. M. 1988. "Arriving in Lake Wobegon: Are Standardized Tests Exaggerating Achievement and Distorting Instruction? American Educator 12(2):8-15, 46-52.
19. Koretz, D. M. 1992. "State and National Assessment." In Encyclopedia of Educational Research, Sixth Edition, ed. M. C. Alkin, 1262-67. Washington, D.C.: American Educational Research Association.
20. Koretz, D. M. 1998. "Large-scale Portfolio Assessments in the US: Evidence Pertaining to the Quality of Measurement." In Records of Achievement, ed. D. Koretz, A. Wolf, and P. Broadfoot. Special issue of Assessment In Education 5(3):309-34.
21. Koretz, D. M., and S. I. Barron. 1998. "The Validity of Gains on the Kentucky Instructional Results Information System." (KIRIS). Santa Monica: RAND.
22. Koretz, D. M., S. Barron, K. Mitchell, B. Stecher. 1996a. "The Perceived Effects of the Kentucky Instructional Results Information System. " (KIRIS). MR-792-PCT/FF, Santa Monica: RAND.
23. Koretz, D. M., K. Mitchell, S. Barron, S. Keith. 1996b. "The Perceived Effects of the Maryland School Performance Assessment Program." CSE Technical Report No. 409. Los Angeles: Center for the Study of Evaluation, University of California.
24. Koretz, D. M., B. S. Stecher, S. Klein, D. F. McCaffrey. 1994. "The Vermont Portfolio Assessment Program: Findings and Implications." Educational Measurement: Issues and Practice 13(3):5-16.
25. Koretz, D. M., M. W. Bertenthal, B. F. Green. eds. 1999. "Embedding Questions: The Pursuit of a Common Measure in Uncommon Tests." Committee on Embedding Common Test Items in State and District Assessment, National Research Council. Washington, D.C.: National Academies Press.
26. Koretz, D. M., and E. Deibert. 1996. "Setting Standards and Interpreting Achievement: A Cautionary Tale from the National Assessment of Educational Progress." Educational Assessment 3(1):53-81.
27. Koretz, D. M., R. L. Linn, S. B. Dunbar, L. A. Shepard. 1991. "The Effects of High-Stakes Testing: Preliminary Evidence About Generalization Across Tests." In The Effects of High Stakes Testing, ed. R. L. Linn (chair). Symposium presented at the annual meetings of the American Educational Research Association and the National Council on Measurement in Education. Chicago, April.
28. Koretz, D. M., D. F. McCaffrey, and L. S. Hamilton. 2001. "Toward a Framework for Validating Gains Under High-stakes Conditions." In New Work on the Evaluation of High-stakes Testing Programs, ed. D. M. Koretz (Chair). Symposium at the annual meeting of the National Council on Measurement in Education, Seattle, April 11.
29. Linn, R. L. 2000. "Assessment and accountability."Educational Researcher, 29(2):4-16.
30. Linn, R. L., and S. B. Dunbar. 1990. "The Nation's Report Card Goes Home: Good News and Bad About Trends in Achievement." Phi Delta Kappan 72(2):127-33.
31. Linn, R. L., M. E. Graue, and N. M. Sanders. 1990. "Comparing State and District Test Results to National Norms: The Validity of the Claims That 'Everyone Is Above Average."' Educational Measurement: Issues and Practice 9(3):5-14.
32. National Commission on Excellence in Education. 1983. A Nation at Risk. Washington, D.C.: U.S. Department of Education.
33. New Jersey Department of Education. 1976. "Educational Assessment Program: State Report 1975-76." Trenton, N.J.: New Jersey Department of Education.
34. O'Neil, H. F., B. Sugrue, and E. L. Baker. 1995. "Effects of Motivational Interventions on the National Assessment of Educational Progress Mathematics Performance." Educational Assessment 3(2):135-58.
35. Pipho, C. 1985. "Tracking the Reforms, Part 5: Testing-Can it Measure the Success of the Reform Movement? Education Week 4(35):19.
36. Popham, W. J., K. L. Cruse, S. C. Rankin, P. D. Sandifer, and P. L. Williams. 1985. "Measurement-driven Instruction: It's on the Road. "Phi Delta Kappan 66(9):628-34.
37. Reckase, M. D. 2001. "The Controversy Over the National Assessment Governing Board Standards." Brookings Papers on Educational Policy, 231-53.
38. Resnick, D. 1982. "History of Educational Testing." In Ability Testing: Uses, Consequences, and Controversies, Part II, ed. A. K. Wigdor and W. R. Garner, 173-94. Washington, D.C.: National Academy Press.
39. Roeber, E. 1988. "A History of Large-scale Testing Activities at the State Level." Paper presented at the Indiana Governor's Symposium on ISTEP, Madison, In., February 10.
40. Salmon-Cox, L. 1982. "MAP Math: End of Year One Report."Learning Research and Development Center, University of Pittsburgh. Unpublished.
41. Salmon-Cox L. 1984. "MAP Reading End-of-Year Report."Learning Research and Development Center. Unpublished.
42. Shavelson R. J., and N. M. Webb. 1991. Generalizability Theory: A Primer. Newbury Park: Sage.
43. Shepard, L. A. 1988a. "Should Instruction Be Measurement-driven?: A Debate." Paper presented at the annual meeting of the American Educational Research Association, New Orleans, April.
44. Shepard, L. A. 1988b. "The Harm of Measurement-driven Instruction. " Paper presented at the annual meeting of the American Educational Research Association, Washington, D.C. (April).
45. Shepard, L. A. 1990. "Inflated Test Score Gains: Is the Problem Old Norms or Teaching the Test? Educational Measurement: Issues and Practice 9(3):15-22.
46. Shepard, L. A., and K. D. Dougherty. 1991. "Effects of High-stakes Testing on Instruction." In The Effects of High Stakes Testing, ed. R. L. Linn (Chair). Symposium presented at the annual meetings of the American Educational Research Association and the National Council on Measurement in Education, Chicago, III., April.
47. Stecher, B. M. 1998. "The Local Benefits and Burdens of Large-scale Portfolio Assessment. In Records of Achievement, ed. D. Koretz, A. Wolf, and P. Broadfoot. Special issue of Assessment in Education 5(3):335-51.
48. Stecher, B. M. and S. I. Barron. 1999. "Quadrennial Milepost Accountability Testing in Kentucky." CSE Technical Report No. 505, Los Angeles: Center for the Study of Evaluation, University of California.
49. Stecher, B. M., and K. J. Mitchell. 1995. "Portfolio-Driven Reform: Vermont Teachers' Understanding of Mathematical Problem Solving and Related Changes in Classroom Practice." CSE Technical Report No. 400. Los Angeles: Center for the Study of Evaluation, University of California.
50. Wilgoren, J. 2001. "Possible Cheating Scandal is investigated in Michigan." The New York Times, June 9.