Automated essay scoring: Writing assessment and instruction

International Encyclopedia of Education

Volumn , Issue , 2010, Pages 20-26

  Shermis, M D ^a   Burstein, J ^b   Higgins, D ^b   Zechner, K ^b  

^a UNIVERSITY OF AKRON   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Assessment; Automated essay scoring; Electronic portfolios; English language assessment; English language learners; High stakes testing; Measurement technologies; Performance assessment; Spoken language assessment; Testing; Writing assessment; Writing instruction

Indexed keywords

EID: 80053288701     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-08-044894-7.00233-5     Document Type: Chapter

References (55)

1. Attali Y., Burstein J. Automated essay scoring with e-rater V.2. Journal of Technology, Learning, and Assessment 2006, 4(3). (accessed August 2009). http://www.jtla.org.
2. Bernstein J. PhonePass Testing: Structure and Construct 1999, Ordinate Corporation, Menlo Park, CA.
3. Bernstein J., DeJong J., Pisoni D., Townshend B. Two experiments in automatic scoring of spoken language proficiency 2000.
4. Burstein J. The E-rater scoring engine: Automated essay scoring with natural language processing. Automated Essay Scoring: A Cross-Disciplinary Perspective 2003, 113-122. Erlbaum, Mahwah, NJ. M.D. Shermis, J. Burstein (Eds.).
5. Burstein J. Opportunities for natural language processing in education. Springer Lecture Notes in Computer Science 2009, vol. 5449:6-27. Springer, New York. A. Gebulkh (Ed.).
6. Burstein J., Chodorow M., Leacock C. Criterion: Online essay evaluation: An application for automated evaluation of test-taker essays 2003.
7. Burstein J., Chodorow M., Leacock C. Automated essay evaluation: The Criterion Online writing service. AI Magazine 2004, 25(3):27-36.
8. Carlo M.S., August D., McLaughlin B., et al. Closing the gap: Addressing the vocabulary needs of English language learners in bilingual and mainstream classrooms. Reading Research Quarterly 2004, 39(2):188-215.
9. Chai C.O.L. Development and Validation of Procedures to Assess Writing Plans 2004, University of British Columbia, Vancouver, Unpublished dissertation.
10. Cucchiarini C., Strik H., Boves L. Automatic evaluation of Dutch pronunciation by using speech recognition technology 1997.
11. Cucchiarini C., Strik H., Boves L. Using speech recognition technology to assess foreign speakers' pronunciation of Dutch 1997.
12. Elbow P. Writing without Teachers 1973, Oxford University Press, New York.
13. Elliot S. Intellimetric: From here to validity. Automated Essay Scoring: A Cross-Disciplinary Perspective 2003, 71-86. Erlbaum, Mahwah, NJ. M.D. Shermis, J. Burstein (Eds.).
14. Fitzgerald J. English-as-a-second-language learners' cognitive reading processes: A review of research in the United States. Review of Educational Research 1995, 65(2):145-190.
15. Franco H., Abrash V., Precoda K., et al. The SRI EduSpeak system: Recognition and pronunciation scoring for language learning 2000.
16. Futagi Y., Deane P., Chodorow M., Tetreault J. A computational approach to detecting collocation errors in the writing of non-native speakers of English. Computer Assisted Language Learning 2008, 21:353-367.
17. Goldstein A.A., Carr P.G. Can Students Benefit from Process Writing? 1996, National Center for Educational Statistics, Washington, DC.
18. Han N.-R., Chodorow M., Leacock C. Detecting errors in English article usage with a maximum entropy classifier trained on a large, diverse corpus 2004.
19. Hancin-Bhatt B., Nagy W.E. Lexical transfer and second language morphological development. Applied Psycholinguistics 1994, 15(3):289-310.
20. Higgins D., Burstein J., Attali Y. Identifying off-topic student essays without topic-specific training data. Natural Language Engineering 2006, 12(2):145-159.
21. Ihnot C. Read Naturally 1997, Read Naturally, St. Paul, MN.
22. James C., Klein K. Foreign language learners' spelling and proof reading strategies. Papers and Studies in Contrastive Linguistics 1994, 19:31-46.
23. Jimenez R.T., Garcia G.E., Pearson D.P. The reading strategies of bilingual Latina/o who are successful English readers: Opportunities and obstacles. Reading Research Quarterly 1996, 31(1):90-112.
24. Kawate-Mierzejewska M. E-rater software 2003.
25. Keith T.Z. Validity and automated essay scoring systems. Automated Essay Scoring: A Cross-Disciplinary Perspective 2003, 147-168. Erlbaum, Mahwah, NJ. M.D. Shermis, J. Burstein (Eds.).
26. Landauer T.K., Foltz P.W., Laham D. Introduction to latent semantic analysis. Discourse Processes 1998, 25:259-284.
27. Landauer T.K., Laham D., Foltz P.W. Automated scoring and annotation of essays with the Intelligent Essay Assessor. Automated Essay Scoring: A Cross-Disciplinary Perspective 2003, 87-112. Erlbaum, Mahwah, NJ. M.D. Shermis, J. Burstein (Eds.).
28. Leacock C., Chodorow M. C-rater: Scoring of short-answer questions. Computers and the Humanities 2003, 37(4):389-405.
29. Lin D. Automatic retrieval and clustering of similar words 1998.
30. MacDonald N.H., Frase L., Gingrich P., Keenan S.A. The writer's workbench: Computer aids for text analysis. IEEE Transactions on Communications 1982, 30(1):105-110.
31. Marcu D. The Theory and Practice of Discourse Parsing and Summarization 2000, MIT Press, Cambridge, MA.
32. Nagy W.E., Garcia G.E., Durgunoglu A.Y., Hancin-Bhatt B. Spanish-English bilingual students' use of cognates in English reading. Journal of Reading Behavior 1993, 25(3):241-259.
33. Oh S.Y. Two types of input modification and EFL reading comprehension: Simplification versus elaboration. TESOL Quarterly 2001, 35(1):69-96.
34. Page E.B. The imminence of grading essays by computer. Phi Delta Kappan 1966, 48:238-243.
35. Page E.B., Keith T., Lavoie M.J. Construct validity in the computer grading of essays 1995.
36. Page E.B., Petersen N.S. The computer moves into essay grading: Updating the ancient test. Phi Delta Kappan 1995, 76(7):561-565.
37. Pantel P., Lin D. Word-for-word glossing with contextually similar words 2000.
38. Perez E. Oral language competence improves reading skills of Mexican-American third graders. Reading Teacher 1981, 35(1):24-27.
39. Shei C., Pain H. An ESL writer's collocational aid. Computer Assisted Language Learning 2000, 13(2):167-182.
40. Shermis M.D., Burstein J. Introduction. Automated Essay Scoring: A Cross-Disciplinary Perspective 2003, xiii-xvi. Erlbaum, Mahwah, NJ. M.D. Shermis, J. Burstein (Eds.).
41. Shermis M.D., Mzumara H.R., Olson J., Harrington S. On-line grading of student essays: PEG goes on the web at IUPUI. Assessment and Evaluation in Higher Education 2001, 26(3):247-259.
42. Shore J., Burstein J., Sabatini J. Web-based technology that supports ELL reading instruction 2009, (accessed August 2009). http://ciaesig.ning.com/.
43. A Preliminary Study of the Efficacy of IntelliMetric™ TM for Use in Scoring Hebrew Assessments 2001, Vantage Learning, Vantage Learning, Newtown, PA.
44. TM for Responses in Scoring Bahasa Malay 2002, Vantage Learning, Vantage Learning, Newtown, PA.
45. SM v1.0. Educational Testing Service 2008.
46. Xi X., Zechner K., Bejar I. Extracting meaningful speech features to support diagnostic feedback: An ECD approach to automated scoring 2006.
47. Yano Y., Long M., Ross S. The effects of simplified and elaborated texts on foreign language reading comprehension. Language Learning 1994, 44:189-219.
48. Zechner K., Bejar I. Towards automatic scoring of non-native spontaneous speech 2006.
49. Zechner K., Higgins D., Xi X., Williamson D.M. Automatic scoring of non-native spontaneous speech in tests of spoken English. Speech Communication 2009, 51(10):883-895.
50. Ajay H.B., Tillett P.I., Page E.B. Analysis of Essays by Computer (AEC-II) (No. 8-0102) 1973, U.S. Department of Health, Education, and Welfare, Office of Education, National Center for Educational Research and Development, Washington, DC, (No. 8-0102).
51. Machine Scoring of Student Essays: Truth and Consequences 2006, Utah State University Press, Logan, UT. P.F. Ericsson, R. Haswell (Eds.).
52. - Educational Testing Service: Criterion. http://www.ets.org/criterion.
53. - Language Weaver. http://www.languageweaver.com.
54. - Pearson's Knowledge Technologies. http://www.pearsonkt.com.
55. - Vantage Learning. http://www.vantagelearning.com.