Validating Measures of Performance

Educational Measurement: Issues and Practice

Volumn 18, Issue 2, 1999, Pages 5-17

  Kane, Michael ^a   Crooks, Terence ^b   Cohen, Allan ^c  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF OTAGO   (New Zealand)

^c Director of Testing and Evaluation Services   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0002336281     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.1999.tb00010.x     Document Type: Article

References (51)

1. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (1985) Standards for Educational and Psychological Testing. Washington, DC: American Psychological Association.
2. Brennan, R. L. (1983) Elements of generalizability theory. Iowa City: American College Testing.
3. Brennan, R. L., & Johnson, E. G. (1995) Generalizability of performance assessments. Educational Measurement: Issues and Practice, 14(4), 25–27.
4. Cizek, G. J. (1991a.) Innovation or enervation? Performance assessment in perspective. Phi Delta Kappan, 72, 695–699.
5. Cizek, G. J. (1991b.) Confusion effusion: A rejoinder to Wiggins. Phi Delta Kappan, 72, 150–153.
6. Cronbach, L. J. (1971) Test validation. In R. L. Thorndike, (Ed.), Educational measurement (2nd ed., pp. 443–507). Washington, DC: American Council on Education.
7. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972) The dependability of behavioral measurement. New York: Wiley.
8. Crooks, T. J. (1988) The impact of classroom evaluation practices on students. Review of Educational Research, 58, 438–481.
9. Crooks, T. J., & Flockton, L. (1996) Science assessment results 1995. Dunedin, NZ: University of Otago, Educational Assessment Research Unit.
10. Crooks, T. J., Kane, M. T., & Cohen, A. S. (1996) Threats to the valid use of assessment. Assessment in Education, 3(3), 265–285.
11. Feldt, L. S., & Brennan, R. L. (1989) Reliability. In R. L. Linn, (Ed.), Educational measurement (3rd ed., pp. 105–146). New York: American Council on Education & Macmillan.
12. Fitzpatrick, R., & Morrison, E. J. (1971) Performance and product evaluation. In R. L. Thorndike, (Ed.), Educational measurement (2nd ed., pp. 237–270). Washington, DC: American Council on Education.
13. Flockton, L., & Crooks, T. (1997) Reading & speaking assessment results 1996. Dunedin, NZ: University of Otago, Educational Assessment Research Unit.
14. Fredericksen, J. R., & Collins, A. (1989) A systems approach to educational testing. Educational Researcher, 18(9), 27–32.
15. Frederickson, N. (1984) The real test bias: Influences of testing on teaching and learning. American Psychologist, 39, 193–202.
16. Gao, X., Shavelson, R. J., & Baxter, G. P. (1993) Generalizability of large-scale performance assessments in science: promises and problems. Applied Measurement in Education, 7, 323–342.
17. Guion, R. M. (1995) Comments on values and standards in performance assessment. Educational Measurement: Issues and Practice, 14(4), 25–27.
18. House, E. R. (1980) Evaluating with validity. Beverly Hills: Sage.
19. Kane, M. T. (1982) A sampling model for validity. Applied Psychological Measurement, 6, 125–160.
20. Kane, M. T. (1992) An argument-based approach to validity. Psychological Bulletin, 112, 527–535.
21. Linn, R. L. (1992) Linking results of distinct assessments. Unpublished manuscript.
22. Linn, R. L., Baker, E. L. & Dunbar, S. B. (1991) Complex performance assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15–21.
23. Lukhele, R., Thissen, D., & Wainer, H. (1994) On the relative value of multiple-choice, constructed response, and examinee-selected items on two achievement tests. Journal of Educational Measurement, 31(3), 234–250.
24. Madaus, G. F. (1988) The influences of testing on the curriculum. In L. N. Tarner, (Ed.), Critical issues in curriculum (pp. 83–121). Eighty-Seventh Yearbook of the National Society for the Study of Education, Part I. Chicago: University of Chicago Press.
25. Mehrens, W. A. (1992) Using performance assessment for accountability purposes. Educational Measurement: Issues and Practice, 11(1), 3–9, 20.
26. Messick, S. (1989) Validity. In R. L. Linn, (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: American Council on Education & Macmillan.
27. Messick, S. (1994) The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13–23.
28. Messick, S. (1995) Standards of validity and the validity of and standards in performance assessment. Educational Measurement: Issues and Practice, 14(4), 5–8.
29. Moss, P. A. (1994) Can there be validity without reliability Educational Researcher, 23(2), 5–12.
30. National Council on Education Standards and Testing. (1992) Raising standards for American education. Washington, DC: Author.
31. Newmann, F. M. (1992) The assessment of discourse in social studies. In H. Berlak, F. Newmann, E. Adams, D. Archbald, T. Burgess, J. Raven, & T. Romberg, Toward a new science of educational testing and assessment (pp. 53–69). Albany: State University of New York Press.
32. Newmann, F. M. (1998) Letter to editor. Educational Researcher, 27(6), 19–20.
33. Newmann, F. M., & Archbald, D. M. (1992) The nature of authentic academic achievement. In H. Berlak, F. Newmann, E. Adams, D. Archbald, T. Burgess, J. Raven, & T. Romberg, Toward a new science of educational testing and assessment (pp. 71–83). Albany: State University of New York Press.
34. Porter, A. C. (1993) School delivery standards. Educational Researcher, 22(5), 24–30.
35. Ruiz-Primo, M. A., Baxter, G. P., & Shavelson, R. J. (1993) On the stability of performance assessments. Journal of Educational Measurement, 30, 41–53.
36. Shavelson, R. J., Baxter, G. P., & Gao, X. (1993) Sampling variability of performance assessments. Journal of Educational Measurement, 30, 215–232.
37. Shavelson, R. J., Baxter, G. P., & Pine, J. (1991) Performance assessment in science. Applied Measurement in Education, 4, 347–362.
38. Shavelson, R. J., & Webb, N. M. (1991) Generalizability theory: A primer. Newbury Park, CA: Sage.
39. Shepard, L. A. (1993) Evaluating test validity. In L. Darling-Hammond, (Ed.), Review of research in education (Vol. 19, pp. 405–450). Washington, DC: American Educational Research Association.
40. Shepard, L. A., & Bleim, C. L. (1995) Parents' thinking about standardized tests and performance assessments. Educational Researcher, 24(8), 25–32.
41. Snow, R. E., & Lohman, D. E. (1989) Implications of cognitive psychology for educational measurement. In R. L. Linn, (Ed.), Educational measurement (3rd ed., pp. 263–332). New York: American Council on Education & Macmillan.
42. Swanson, D., Norman, G., & Linn, R. L. (1995) Performance-based assessment: Lessons from the health professions. Educational Researcher, 24(5), 5–11, 35.
43. Terwilliger, J. S. (1997) Semantics, psychometrics, and assessment reform: A close look at “authentic” assessment. Educational Researcher, 26(8), 24–27.
44. Terwilliger, J. S. (1998) Rejoinder: Response to Wiggins and Newmann. Educational Researcher, 27(6) 22–23.
45. Thissen, D., Wainer, H., & Wang, X. (1994) Are tests compromising both multiple-choice and free-response items necessarily more unidimensional than multiple-choice tests? An analysis of two tests. Journal of Educational Measurement, 31, 113–123.
46. University of Pittsburgh, Learning Research and Development Center. (1992) The New Standards Project 1992–1995: A proposal. Pittsburgh: Author.
47. Vu, N., & Barrows, H. (1994) Use of standardized patients in clinical assessments: Recent developments and measurement findings. Educational Researcher, 23(3), 23–30.
48. Wiggins, G. (1989) A true test: Toward more authentic and equitable assessment. Phi Delta Kappan, 70, 703–713.
49. Wiggins, G. (1991) A response to Cizek. Phi Delta Kappan, 72, 700–703.
50. Wiggins, G. (1993) Assessing student performance: Exploring the purpose and limits of testing. San Francisco: Jossey-Bass.
51. Wiggins, G. (1998) Letter to editor. Educational Researcher, 27(6), 20–22.