Automated versus human essay scoring: A comparative study

Theory and Practice in Language Studies

Volumn 2, Issue 4, 2012, Pages 719-725

  Toranj, Somaye ^a   Ansari, Dariush Nejad ^b  

^a ISLAMIC AZAD UNIVERSITY   (Iran)

^b UNIVERSITY OF ISFAHAN   (Iran)

Author keywords

Automate essay scoring (AES); Correlation; Human scoring; Reliability; Validity

Indexed keywords

EID: 84901191252     PISSN: 17992591     EISSN: 20530692     Source Type: Journal    
DOI: 10.4304/tpls.2.4.719-725     Document Type: Article

References (23)

1. Allen, Dave. (2004). The Oxford Placement Test. Oxford: Oxford University Press.
2. Attali, Y., Bridgeman, B., and, Trapani, C. (2010). Performance of a Generic Approach in Automated Essay Scoring. Journal of Technology, Learning, and Assessment, 10.3, 4-7.
3. Attali, Y. (2004). Exploring the feedback and revision features of Criterion. Journal of Second Language Writing, 14.3, 191-205.
4. Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater v.2. Journal of Technology, Learning, and Assessment 4.3, 13-18.
5. Bennett, R. E. (2004). Moving the field forward: Some thoughts on validity and automated scoring (ETS Research Memorandum No. RM-04-01). Princeton, NJ: ETS.
6. Bennett, R. E., & Ben-Simon, A. (2005). Toward theoretically meaningful automated essay scoring. Journal of Technology, Learning, and Assessment 6.1, 1-47.
7. Chung and O'Neil, (1997). Methodological Approaches to Online Scoring of Essays CSE Technical report 461, National Center for Research on Evaluation, Standards, and Student Testing.
8. Dikli, S. (2006). An overview of automated scoring of essays. Journal of technology, learning, and assessment, 5.1, 5-22.
9. Elliot, S. (2003). IntelliMetric™: From here to validity. In M.D. Shermis & J.C. Burstein (Eds.), Automatic essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Lawrence Erlaum Associates, 71-86.
10. Hamp-Lyons, L. (2006). Feedback in portfolio based writing courses. In K. Hyland & F. Hyland (Eds.), Feedback in second language writing: Contexts and issues. Cambridge: Cambridge University Press, 140-161.
11. Hyland, K. (2003). Second language writing. New York: Cambridge University Press. P. xv-29.
12. Kukich, K. (2000). Beyond automated essay scoring. IEEE intelligent systems, 15.5, 22-27.
13. Landauer, T.K., & Laham, D. (2000). The Intelligent Essay Assessor. IEEE intelligent systems, 15.5, 27-31.
14. Page, E. B. (2003). Project Essay Grade: PEG. In M. D. Shermis & J. Burstein (Eds.), Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Lawrence Erlbaum Associates, 43-54.
15. Page, E.B. (1966). The imminence of grading essays by computers. Phi Delta Kappan, 47, 238-243.
16. Page, E. (1994). Computer Grading of Student Prose, Using Modern Concepts and Software Journal of Experimental Education, 62.2, 127-142.
17. Shermis, M., & Burstein, J. (Eds.) (2003). Automated essay scoring: A cross-disciplinary perspective. Hillsdale, NJ: Lawrence Erlbaum, xiii-xvi.
18. Shermis, M., & Burstein, J., & Higgins, D., and Zechner, K. (2010). Automated Essay Scoring: Writing Assessment and Instruction, 6-12.
19. Wang, J., & Brown, M. S. (2008). Automated essay scoring versus human scoring: A correlational study. Contemporary Issues in Technology and Teacher Education, 8.4, 310-325.
20. Wang, J. & Brown, M. (2007). Automated essay scoring versus human scoring: A comparative study. Journal of Technology, Learning, and Assessment, 6.2, 20-22.
21. Warschauer, M. (2002). A review of Language and the Internet by David Crystal. Education, Communication, and Information, 2.2, 241-244.
22. Warschauer, M., & Kern, R. (Eds.). (2000). Network-based language teaching: Concepts and practice. Cambridge: Cambridge University Press, 41-58.
23. Wresch, W. (1993). The imminence of grading essays by computers-25 years later. Computers and composition 10.2, 45-58.