Validity of Automated Essay Scoring Systems

Automated Essay Scoring: A Cross-Disciplinary Perspective

Volumn , Issue , 2003, Pages 140-159

  Keith, Timothy Z ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85142552075     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781410606860-19     Document Type: Chapter

References (23)

1. Ajay, H.B., Tillett, P.I., and Page, E.B. (Principal Investigator) (1973, December). Analysis of essays by computer (AEC-II) (8-0102). Final Report to the National Center for Educational Research and Development. Washington, DC: U.S. Dept of Health, Education, and Welfare, Office of Education, National Center for Educational Research and Development.
2. Burstein, J. (this volume). The e-rater scoring engine: Automated essay scoring with natural language processing. In M.D.Shermis, and J.Burstein (Eds.). Automated essay scoring: A crossdisciplinary perspective. Mahwah, NJ: Erlbaum.
3. Burstein, J. and Chodorow, M. (1999, June). Automated essay scoring for nonnative English speakers. Joint Symposium of the Association of Computational Linguistics and the International Association of Language Learning Technologies, Workshop on Computer-Mediated Language Assessment and Evaluation of Natural Language Processing, College Park, MD.
4. Burstein J., Kukich, K., Wolff, S., Lu, C., and Chodorow, M. (1998, April), Computer analysis of essays. NCME Symposium on Automated Scoring.
5. Cohen, J. (1983). The cost of dichotomisation. Applied Psychology! Measurement, 7, 249-253.
6. Elliot, S.M. (1999). Construct validity of Intellimetric™™ with international assessment. Yardley, PA: Vantage Technologies (RB-323).
7. Elliot, S.M. (2000). Applying Intellimetric™™ technology to the scoring of K-12 persuasive writing: A subsample cross validation study. Yardley, PA: Vantage Technologies (RB-424).
8. Elliot, S.M. (this volume). Intellimetric™: From here to validity. In M.D.Shermis, and J.C. Burstein (Eds.). Automated essay scoring. A cross-disciplinary perspective. Mahwah, NJ: Erlbaum.
9. Keith, T.Z. (1996, April). Types of construct validity in PEG measures. In E.B.Page (Moderator), J.W.Asher, B.S.Plake, and D.Lubinski (Discussants), Grading essays by computer: Qualitative and quantitative grading in large programs and in classrooms. Invited symposium at the annual meeting of the National Council for Measurement in Education, New York.
10. Keith, T.Z. (1998, April). Construct validity of PEG, Paper presented at the American Educational Research Association, San Diego, CA.
11. Landauer, T.K., Laham, D., and Foltz, P. (In press). Automatic essay assessment with latent semantic analysis. Journal of Applied Educational Measurement.
12. Landauer, T.K., Laham, D., and Foltz, P. (this volume). Automated scoring and annotation of essays with the intelligent essay assessor. In M.D.Shermis, and J.C.Burstein (Eds.). Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Erlbaum.
13. Messick, S (1989). Validity. In R.L.Linn (Ed.), Educational measurement (pp. 13-103). New York Macmillan.
14. Page, E.B. (1966). The imminence of grading essays by computer. Phi Delta Kappan, 48, 238-243.
15. Page, E.B. (1994). Computer grading of student prose, using modem concepts and software. Journal of Experimental Education, 62(2), 27-142.
16. Page, E.B. (this volume). Project essay grade: PEG. In M.D.Shermis, and J.C.Burstein (Eds.). Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Erlbaum.
17. Page, E.B., Lavoie, M.J., and Keith, T.Z. (1996, April). Computer grading of essay traits in student writing Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY.
18. Page, E.B. and Petersen, N.S. (1995). The computer moves into essay grading: Updating the ancient test Phi Delta Kappan 76(7), 561-565.
19. Page, E.B. (1997, March). The second blind test with ETS:PEG predicts the Graduate Record Exams. Handout for AERA/NCME Symposium, Chicago
20. Peterson, N.S. (1997, March). Automated scoring of writing essays: Can such scores be valid? Paper presented at the annual meeting of the National Council on Education, Chicago.
21. Powers, D.E., Burstein, J.C., Chodorow, M., Fowles, M.E., and Kukich, K. (2000). Comparing the validity of automated and human essay scoring (GRE No. 98-08aR). Princeton, NJ: Educational Testing Service.
22. Shermis, M.D., and Daniels, K.E. (this volume). Norming and scaling for automated essay scoring. In M.D.Shermis, and J.C.Burstein (Eds.). Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Erlbaum.
23. Shermis, M.D., Koch, C.M., Page, E.B., Keith, T.Z., and Harrington, S. (in press). Trait ratings for automated essay grading. Educational and Psychological Measurement.