Experimenting with a computer essay-scoring program based on ESL student writing scripts

ReCALL

Volumn 21, Issue 2, 2009, Pages 259-279

  Coniam, David ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Assessment; Computer scoring; English language; Writing

Indexed keywords

EID: 70450193105     PISSN: 09583440     EISSN: 14740109     Source Type: Journal    
DOI: 10.1017/S0958344009000147     Document Type: Conference Paper

References (37)

1. Alderson, J. C. (2000) Technology in testing: The present and the future. System, 28: 593-603.
2. Attali, Y. and Burstein, J. (2006) Automated essay scoring with e-rater v.2. Journal of Technology, Learning, and Assessment, (JTLA) 4(3).
3. Burstein, J. (2003) The e-rater scoring engine: Automated essay scoring with natural language processing. In: Shermis, M. D. and Burstein, J. (eds.), Automated essay scoring: A crossdisciplinary perspective. Mahwah, NJ: Lawrence Erlbaum Associates, Inc., 113-122.
4. Chalhoub-Deville, M. and Deville, C. (1999) Computer adaptive testing in second language contexts. Annual Review of Applied Linguistics, 19: 273-299.
5. Chapelle, C. A. and Douglas, D. (2006) Assessing Language through Computer Technology. Cambridge, UK: Cambridge University Press.
6. Cheung, W. K., Mørch, A. I., Wong, K. C., Lee, C., Liu, J. and Lam, M. H. (2005) Grounding Collaborative Learning in Semantics-Based Critiquing. In: Rynson, W. H., Lau Qing Li, Cheung, R. and Wenyin Liu (eds.), Advances in Web-based learning - ICWL 2005. New York: Springer, 244-255.
7. Chung, G. K., and O'Neil, H. F., Jr. (1997) Methodological Approaches to Online Scoring of Essays. ERIC Document Reproduction Service No. ED 418 101.
8. Clapham, C. (2000) Assessment and testing. Annual Review of Applied Linguistics, 20: 147-161.
9. Coniam, D. (2005) Raw scores as examination results: How far can they be relied upon? Paper presented at the ALTE Second International Conference, Berlin, 19-21 May 2005.
10. Coniam, D. (1998) Voice recognition software accuracy with second language speakers of English. System, 27(1): 1-16.
11. Coniam, D. (1999) Second language proficiency and word frequency in English. Asian Journal of English Language Teaching, 9: 59-74.
12. Dikli, S. (2006) An Overview of Automated Scoring of Essays. Journal of Technology, Learning, and Assessment, 5(1). http://escholarship.bc.edu/jtla/
13. Drechsel, J. (1999) Writing into Silence: Losing Voice with Writing Assessment Technology. Teaching English in the Two-Year College, 26(4): 380-387.
14. Foltz, P. W., Kintsch, W. and Landauer, T. K. (1998) The measurement of textual coherence with Latent Semantic Analysis. Discourse Processes, 25(2&3): 285-307.
15. Foltz, P. W., Laham, D. and Landauer, T. K. (1999) The Intelligent Essay Assessor: Applications to Educational Technology. Interactive Multimedia Electronic Journal of Computer- Enhanced Learning, 1(2). http://imej.wfu.edu/ articles/1999/2/04/index.asp
16. Hay, J. (1982) General Impression Marking: Some Caveats. English in Australia, 59: 50-58.
17. Hatch, E. and Lazaraton, A. (1991) The Research Manual: Design and Statistics for Applied Linguistics. Boston, MA: Heinle and Heinle.
18. Hong Kong Examinations and Assessment Authority (HKEAA) (2006) Language Proficiency Assessment for Teachers (English Language) 2006: Assessment Report. http://eant01.hkeaa. edu.hk/hkea/redirector.asp?p-direction5body&p- clickurl5otherexam%5Fbycategory%2Easp
19. Hong Kong Examinations and Assessment Authority (HKEAA) (2007) HKCEE English language examination report and question papers. Hong Kong: Hong Kong Examinations and Assessment Authority.
20. Hughes, A. (2003) Testing for language teachers. Cambridge, UK: Cambridge University Press.
21. Hunt, K. W. (1970) Syntactic maturity in school children and adults. Monographs of the Society for Research in Child Development, 135(35/1). Chicago: University of Chicago Press.
22. Jamieson, J. (2005) Research in language assessment: trends in computer-based second language assessment. Annual Review of Applied Linguistics, 25: 228-242.
23. Landauer, T. K., Foltz, P. W. and Laham, D. (1998) Introduction to Latent Semantic Analysis. Discourse Processes, 25: 259-284.
24. Legislative Council Panel on Education (2005) LC Paper No. CB(2)323/05-06(01): Grant to support the modernization and development of the Hong Kong Examinations and Assessment Authority's examination systems. http://www.legco.gov.hk/yr05-06/english/ panels/ed/papers/ed1114cb2-323-1e.pdf
25. Linacre, J. M. (1994) FACETS: Rasch Measurement Computer Program. Chicago: MESA Press.
26. Linacre, J. M. (1997) Communicating examinee measures as expected ratings. Rasch Measurement Transactions, 11(1): 550-551. Retrieved October 11, 2007, from http://www.rasch. org/rmt/rmt111m.htm
27. Nerbonne, J. (2003) Natural Language Processing in Computer-Assisted Language Learning. In: Mitkov, R. (ed.), The Oxford Handbook of Computational Linguistics. Oxford: Oxford University Press, 670-698.
28. McNamara, T. (1996) Measuring second language performance. New York: Longman.
29. Page, E. B. (2003) Project Essay Grade: PEG. In: Shermis, M. D. and Burstein, J. (eds.), Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Lawrence Erlbaum Associates, 43-54.
30. Page, E. B., Poggio, J. P. and Keith, T. Z. (1997) Computer analysis of student essays: Finding trait differences in the student profile. AERA/NCME Symposium on Grading Essays by Computer.
31. Powers, D. E., Burstein, J. C., Chodorow, M., Fowles, M. E. and Kukich, K. (2001) Stumping e-rater: Challenging the validity of automated essay scoring (GRE Board Professional Rep. No. 98-08bP, ETS Research Rep. No. 01-03). Princeton, NJ: Educational Testing Service.
32. Powers, D. E., Burstein, J. C., Chodorow, M. S., Fowles, M. E. and Kukich, K. (2002) Comparing the validity of automated and human scoring of essays. Journal of Educational Computing Research, 26(4): 407-425.
33. Rudner, L. M. and Liang, T. (2002) Automated essay scoring using Bayes' theorem. The Journal of Technology, Learning, and Assessment, 1(2). http://www.jtla.org
34. Valenti, S., Neri, F. and Cucchiarelli, A. (2003) An overview of current research on automated essay grading. Journal of Information Technology Education, (2), 319-330.
35. Warschauer, M. and Healey, D. (1998) Computers and language learning: An overview. Language Teaching, 31: 57-71.
36. Warschauer, M. and Ware, P. (2006) Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research, 10(2): 1-24.
37. Weigle, S. C. (2002) Assessing writing. Cambridge: Cambridge University Press.