Training and Scoring Issues Involved in Large-Scale Writing Assessments

Educational Measurement: Issues and Practice

Volumn 21, Issue 2, 2002, Pages 15-19

  Moon, Tonya R ^a   Hughes, Kevin R ^b  

^a UNIVERSITY OF VIRGINIA   (United States)

^b Albemarle County Public Schools   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 54049100141     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2002.tb00088.x     Document Type: Article

References (12)

1. Bennett, R. E., Ward, W. C., Rock, D. A., &Lahart, C. (1990) Toward a framework for constructed-response items (ETS Research Report No. 90-7). Princeton, NJ: Educational Testing Service.
2. Brennan, R. L., Gao, X., &Colton, D.A. (1995) Generalizability analysis of work keys listening and writing tests. Educational and Psychological Measurement, 55, 157–176.
3. Coffman, W. E. (1966) On the validity of essay tests of achievement. Journal of Educational Measurement, 3, 151–156.
4. Coward, A. F. (1952) A comparison of two methods of grading English compositions. Journal of Educational Research, 46, 81–93.
5. Frederiksen, J. R., &Collins, A. (1989) A system approach to educational testing. Educational Researcher, 18(9), 27–32.
6. Klein, S. P., McCaffrey, D., Stecher, B., &Koretz, D. (1995) The reliability of mathematics portfolio scores: Lessons from the Vermont experience. Applied Measurement in Education, 8, 243–260.
7. Latham, G., Wexley, K., &Pursell, E. (1975) Training managers to minimize rating errors in the observation of behavior. Journal of Applied Psychology, 60, 550–555.
8. Moon, T. R., Loyd, B. H., Hughes, K. R., &Winter, P. (1996, April) Using generalizability theory to estimate the reliability of large-scale writing assessments. Paper presented at the annual meeting of the American Educational Research Association, New York.
9. Moss, P. A., Cole, N. S., &Khampalikit, C. (1982) A comparison of procedures to assess written language skills at grades 4, 7, and 10. Journal of Educational Measurement, 19, 37–47.
10. Pulakos, E. D. (1986) The development of training programs to increase accuracy with different rating tasks. Organizational Behavior and Human Decision Processes, 38, 76–91.
11. Shavelson, R. J., Baxter, G. P., &Gao, X. (1993) Sampling variability of performance assessments. Journal of Educational Measurement, 30, 215–232.
12. Shohamy, E., Gordon, C., &Kraemer, R. (1992) The effect of raters' background and training on reliability of direct writing tests. The Modern Language Journal, 76, 27–33.