Assessment of complex performances:Limitations of key measurement assumptions

Educational Researcher

Volumn 27, Issue 2, 1998, Pages 14-24

  Delandshere, Ginette ^a   Petrosky, Anthony R ^b  

^a INDIANA UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0002233166     PISSN: 0013189X     EISSN: 1935102X     Source Type: Journal    
DOI: 10.3102/0013189X027002014     Document Type: Note

References (54)

1. Allen, MJ, and WM Yen (1979). Introduction to measurement theory. Monterey, CA: Brooks-Cole.
2. Anastasi, A (1976). Psychological testing, 4th. ed. New York: Macmillan Publishing Co., Inc.
3. Athanases, SZ (1990). Assessing the teaching of literacy in the elementary grades: Project overview. Stanford, CA: Stanford University. (Teacher Assessment Project, Technical Report No. L1).
4. Berk, RA (Ed.) (1980). A guide to criterion-references test construction. Baltimore: The Johns Hopkins University Press.
5. Bower, G, and ER Hilgard (1981). Theories of learning. Englewood Cliffs, NJ: Prentice-Hall, Inc.
6. Cattell, RB (1946). Description and measurement of personality theory. Yonkers, NY: World Book Co.
7. Crocker, L, and J Algina (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart, and Winston.
8. Cronbach, LJ, and PE Meehl (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281-302.
9. Delandshere, G, and A Petrosky (1993). Early Adolescence/English Language Arts Assessment Development Laboratory, preliminary report. Pittsburgh, PA:University of Pittsburgh.
10. Delandshere, G, and A Petrosky (1994). Capturing teachers' knowledge: Performance assessment and post-structuralism. Educational Researcher, 23(5), 11-18.
11. Feldt, LS, and RL Brennan (1989). Reliability. In RL Linn (Ed.), Educational measurement, 3rd ed (pp. 105-146). New York: American Council on Education, Macmillan Publishing Co.
12. Firestone, WA (1993). Alternative arguments for generalizing from data as applied to qualitative research. Educational Researcher, 22(4), 16-23.
13. Gipps, C (1994). Beyond testing. Bristol, PA: The Falmer Press.
14. Gitomer, DH, and D Rock (1993). Addressing process variables in test analysis. In N Frederiksen, RJ Mislevy and II Bejar (Eds.), Test theory for a new generation of tests (pp. 243-268). Hillsdale, NJ: Lawrence Erlbaum Associates.
15. Goodenough, FL (1949). Mental testing. New York: Rinehart.
16. Guiford, JP (1959). Personality. New York: McGraw-Hill.
17. Hively, W (1974). Introduction to domain-referenced testing. In W Hively (Ed.), Domain-referenced testing (pp. 5-15). Englewood Cliffs, NJ: Prentice Hall.
18. Hopkins, KC, JC Stanley, and BR Hopkins (1990). Educational and psychological measurement and evaluation. New York: Prentice Hall.
19. Jaeger, RM (1995). Setting standards for complex performance: An iterative, judgmental policy-capturing strategy. Educational Measurement: Issues and Practice, 14(4), 16-20.
20. Kane, MT (1982). A sampling model for validity. Applied Psychological Measurement, 6(2), 125-160.
21. Linn, RL, and NE Gronlund (1995). Measurement and assessment in teaching, 7th ed. Englewood Cliffs, NJ:Prentice Hall.
22. Loevinger, J (1957). Objective tests as instruments of psychological theory [Monograph]. Psychological Reports, 3((Supp.9)), 635-694.
23. Loevinger, J (1965). Person and population as psychometric concepts. Psychological Review, 72, 143-155.
24. Madaus, GF (1993). A national testing system: Manna from above? A historical/technological perspective.Journal of Assessment in Education, 1, 9-26.
25. Madaus, GF (1994). Testing place in society: An essay review of testing: Social consequences of examined life. American Journal of Education, 102, 222-234.
26. Magnusson, D (1967). Test theory. Menlo Park, CA: Addison-Wesley.
27. Messick, S (1989). Validity. In RL Linn (Ed.), Educational measurement, 3rd ed (pp. 13-103). New York: American Council on Education, Macmillan Publishing Co.
28. Messick, S (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13-23.
29. Messick, S (1995). Validity of psychological assessment. American Psychologist, 50(9), 741-749.
30. Mislevy, RJ (1993). Foundations of a new test theory. In N Frederiksen, RJ Mislevy and II Bejar (Eds.), Test theory for a new generation of tests (pp. 19-39). Hillsdale, NJ: Lawrence Erlbaum Associates.
31. Moss, PA (1994). Can there be validity without reliability? Educational Researcher, 23(2), 5-12.
32. Moss, PA (1995). Themes and variations in validity theory. Educational Measurement: Issues and Practice, 14(2), 5-13.
33. Narens, L, and RD Luce (1986). Measurement: The theory of numerical assignments. Psychological Bulletin, 99(2), 166-180.
34. National Board for Professional Teaching Standards (1989). Toward high and rigorous standards for the teaching profession.Detroit, MI:Author.
35. National Board for Professional Teaching Standards (April 11, 1990). Early Adolescence/English Language Arts request for proposals (RFP). In Detroit, MI:Author.
36. National Board for Professional Teaching Standards (1993). Early Adolescence/English Language Arts standards.Detroit, MI:Author.
37. Nichols, PD (1994). A framework for developing cognitively diagnostic assessment. Review of Educational Research, 64(4), 575-603.
38. Nitko, AJ (1980). Defining "criterion-referenced test.". In RA Berk (Ed.), A guide to criterion-references test construction (pp. 8-28).Baltimore: The Johns Hopkins University Press.
39. Popham, WJ (1980). Specifying the domain of content or behaviors. In RA Berk (Ed.), A guide to criterion-references test construction (pp. 29-48).Baltimore: The Johns Hopkins University Press.
40. Popham, WJ (1990). Modern educational measurement: A practitioner's perspective, 2nd ed. Englewood Cliffs, NJ: Prentice Hall.
41. Putman, SE, P Pence, and RM Jaeger (April, 1994). A multi-stage dominant profile method for setting standards on complex performance assessments. Paper presented at the annual meeting of the American Educational Research Association and the National Council on Measurement in Education, New Orleans, LA.
42. Resnick, LB, and DP Resnick (1992). Assessing the thinking curriculum: New tools for educational reform. In B Gifford and M O'Connor (Eds.), Changing assessment: Alternative views of aptitude, achievement and instruction (pp. 37-76). London: Kluwer Academic Publishers.
43. Shavelson, RJ, and NM Webb (1991). Generalizability theory: A primer. Newbury Park, CA: Sage Publications.
44. Shepard, LA (1989). Why we need better assessments. Educational Leadership, 46, 4-9.
45. Shepard, LA (1991). Psychometrician's beliefs about learning. Educational Researcher, 20(6), 2-16.
46. Snow, RE, and DF Lohman (1993). Cognitive psychology, new test design, and new test theory: An introduction. In N Frederiksen, RJ Mislevy and II Bejar (Eds.), Test theory for a new generation of tests (pp. 1-18). Hillsdale, NJ: Lawrence Erlbaum Associates.
47. Spearman, C (1904). General intelligence objectively determined and measured. American Journal of Psychology, 15, 201-293.
48. Spearman, C (1927). The abilities of man. New York:Macmillan.
49. Stevens, SS (1951). Mathematics, measurement, and psychophysics. In SS Stevens (Ed.), Handbook of experimental psychology (pp. 1-49). New York: Wiley.
50. Thorndike, RL, and E Hagen (1961). Measurement and evaluation in psychology and education. New York, London, Sydney, Australia: John Wiley and Sons.
51. Thurstone, LL (1935). Vector of mind: Multiple-factor analysis for the isolation of primary traits. Chicago: University of Chicago Press.
52. Vermont State Department of Education (1990). Vermont writing assessment: The pilot year. Montpelier, VT:Author.
53. Wiggins, GP (1993). Assessing student performance, exploring the purpose and limits of testing. San Francisco: Jossey-Bass Publishers.
54. Wolf, D, J Bixby, J Glenn, and H Gardner (1991). To use their minds well: Investigating new forms of student assessment. In G Grant (Ed.), Review of research in education, Vol. 17 (pp. 31-74). Washington, DC: American Educational Research Association.