Using rating augmentation to expand the scale of an analytic rubric

Journal of Experimental Education

Volumn 68, Issue 3, 2000, Pages 269-287

  Penny, Jim ^a   Johnson, Robert L ^b   Gordon, Belita ^c  

^a Center for Creative Leadership   (United States)

^b UNIVERSITY OF SOUTH CAROLINA   (United States)

^c UNIVERSITY OF GEORGIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034145314     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.1080/00220970009600096     Document Type: Article

References (25)

1. Baxter, G., Shavelson, R., Goldman, S., & Pine, J. (1992). Evaluation of procedure-based scoring for hands-on science assessment. Journal of Educational Measurement, 29(1), l-l 7.
2. Breland, H. (1983). The direct assessment of writing skill: A measurement review (Technical Report No. 83-6). Princeton, NJ: College Entrance Examination Board.
3. Brennan, R., & Kane, M. (1977). An index of dependability for mastery tests. Journal of Educational Measurement, 14, 277-289.
4. Coffman, W. (1971). On the reliability of ratings of essay examinations in English. Research in the Teaching of English, 5, 24-36.
5. Cooper, P. (1984). The assessment of writing ability: A review of research (Technical Report No. 84-12). Princeton, NJ: Education Testing Service.
6. Crick, J., & Brennan, R. (1984). GENOVA (Computer software). Philadelphia, PA: National Board of Medical Examiners.
7. Crocker, L„ & Algina, J. (1986). Introduction to classical and modem test theory. New York: Holt, Rinehart, and Winston.
8. Cronbach, L., Linn, R., Brennan, R., & Haertel, E. (1995). Generalizability analysis for educational assessments. Los Angeles: Center for the Study of Evaluation. Standards, and Student Testing, University of California at Los Angeles.
9. Diederich, P. (1974). Measuring growth in English. Urbana, 1L: National Council of Teachers of English.
10. Georgia Department of Education. (1993). Georgia High School Writing Test: Assessment and instructional guide. Atlanta, GA: Author.
11. Glaser, R. (1994). Instructional technology and the measurement of learning outcomes. Educational Measurement: Issues and Practice, 13(4), 6-8.
12. Godshalk, F„ Swineford, F„ & Coffman, W. (1966). The measurement of writing ability. Princeton, NJ; College Entrance Examination Board.
13. Gosling, G. (1966). Marking English compositions. Victoria: Australian Council for Educational Research.
14. Hambleton, R. K., Swaminathan, H„ & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
15. Johnson, R. L., Penny J., & Johnson, C. (1998, February). A review of methods for resolving score discrepancies in the rating of perfomutnce assessments. Paper presented at the annual meeting of the South Carolina Educators for the Practical Use of Research, Columbia, SC.
16. Longford, N. (1994). A case for adjusting subjectively rated scores in the Advanced Placement tests (Technical Report No. 94-5). Princeton, NJ: Education Testing Service.
17. Lord, F. M. (1980). Applications of item response theory to practical problems. Hillsdale, NJ: Erlbaum.
18. McColly, W., & Remstad, R. (1965). Composition rating scales for general merit: An experimental evaluation. The Journal of Educational Research, 59. 55-56.
19. Myers, M. (1980). A procedure for writing assessment and holistic scoring. Urbana, IL: National Council of Teachers of English.
20. Samejima, F. (1969). Estimation of ability using a response pattern of graded scores. Psychometrika Monograph, No. 17.
21. Samejima, F. (1979). A new family of models for the multiple choice item (Office of Naval Research Report 79-4). Knoxville: University of Tennessee.
22. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
23. Smith, W. (1993). Assessing the reliability and adequacy of using holistic scoring of essays as a college composition placement technique. In M. Williamson & B. Huot (Eds), Validating holistic scoring for writing assessment: Theoretical and empirical foundations (pp. 142-205). Cresskill, NJ: Hampton Press.
24. Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 4, 361-370.
25. Wolcott, W. (1998). An overview of writing assessment: Theory, research, and practice. Urbana, IL: National Council of Teachers of English.