Comparison of Human and Machine Scoring of Essays: Differences by Gender, Ethnicity, and Country

Applied Measurement in Education

Volumn 25, Issue 1, 2012, Pages 27-40

  Bridgeman, Brent ^a   Trapani, Catherine ^a   Attali, Yigal ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84855958640     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1080/08957347.2012.635502     Document Type: Article

References (11)

1. Attali, Y. 2007. Construct validity of e-rater in scoring TOEFL essays, Princeton, NJ: Educational Testing Service. ETS-RR-07-21
2. Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater V.2. Journal of Technology, Learning, and Assessment (JTLA), 4(3). http://www.jtla.org (http://www.jtla.org)
3. Bennett, R. and Bejar, I. 1997. Validity and automated scoring: It's not only the scoring, NJ: Educational Testing Service. (ETS RR-97-13). Princeton
4. Burstein, J. and Chodorow, M. 1999. "Automated essay scoring for nonnative English speakers". In Computer mediated language assessment and evaluation in natural language processings, Edited by: Broman Olsen, M. 68-75. Morristown, NJ: Association for Computational Linguistics.
5. Chodorow, M. and Burstein, J. 2004. Beyond essay length: Evaluation of e-rater's performance on TOEFL essays, NJ: Educational Testing Service. (ETS RR-04-04). Princeton
6. Dikli, S. (2006). An overview of automated scoring of essays. The Journal of Technology, Learning, and Assessment, 5(1). http://www.jtla.org (http://www.jtla.org)
7. Fleiss, J. L. and Cohen, J. 1973. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33: 613-619.
8. GRE (2009). GRE General Test: How the test is scored. http://www.ets.org/gre/general/scores/how/index.html (http://www.ets.org/gre/general/scores/how/index.html)
9. Ostler, S. E. 1987. "English in parallels: A comparison of English and Arabic prose". In Writing across languages: An analysis of L2 text, Edited by: Conner, U. and Kaplan, R. B. 169-185. Reading, MA: Addison Wesley.
10. Page, E. 2003. "Project Essay Grade: PEG". In Automated essay scoring: A cross-disciplinary perspective, Edited by: Shermis, M. D. and Burstein, J. C. 43-54. Mahwah, NJ: Lawrence Erlbaum.
11. Shermis, M. and Burstein, J. 2003. Automated essay scoring: A cross-disciplinary perspective, Mahwah, NJ: Lawrence Erlbaum.