Resistance to confounding style and content in scoring constructed-response items

Educational Measurement: Issues and Practice

Volumn 24, Issue 2, 2005, Pages 22-28

  Schafer, William D ^a   Gagné, Phill ^a   Lissitz, Robert W ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Essay scoring; Rating constructed responses; Writing style in scoring

Indexed keywords

EID: 27944503917     PISSN: 07311745     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2005.00008.x     Document Type: Article

References (10)

1. Chase, C. I. (1986). Essay test scoring: Interaction of relevant variables. Journal of Educational Measurement, 23, 33-41.
2. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
3. Engelhard, G., Jr., Walker, E. V. S., Gordon, B., & Gabrielson, S. (1994). Writing tasks and gender: Influence on writing quality of Black and White students. Journal of Educational Research, 87, 197-209.
4. Gyagenda, I. S., & Engelhard, G., Jr. (1998, April). Rater, domain, and gender influences on the assessed quality of student writing using weighted and unweighted scoring. Paper presented at the annual meeting of the American Educational Research Association, San Diego: CA.
5. Hambleton, R. K., Impara, J., Mehrens, W., & Plake, B. S. (2000). Psychometric review of the Maryland School Performance Assessment Program (MSPAP). Baltimore: Maryland State Department of Education.
6. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
7. Hyde, J. S., & Linn, M. C. (1988). Gender differences in verbal ability: A meta-analysis. Psychological Bulletin, 104, 53-69.
8. Powers, D. E., & Fowles, M. E. (2002). Balancing test user needs and responsible professional practice: A case study involving the assessment of graduate-level writing skills. Applied Measurement in Education, 15, 217-247.
9. Schafer, W. D. (2001). Replication: A design principle for field research. Practical Assessment, Research, & Evaluation, 7. Available online: http://PAREonline.net/getvn.asp?v=7&n=15.
10. Wolfe, E. W., & Kao, C.-W. (1996, April). The relationship between scoring procedures and focus and the reliability of direct writing assessment scores. Paper presented at the Annual Meeting of the American Educational Research Association, New York, NY.