Developing pedagogically-guided threshold algorithms for intelligent automated essay feedback

Proceedings of the 25th International Florida Artificial Intelligence Research Society Conference, FLAIRS-25

Volumn , Issue , 2012, Pages 466-471

  Roscoe, Rod D ^c   Kugler, Danica ^a   Crossley, Scott A ^b   Weston, Jennifer L ^a   McNamara, Danielle S ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b GEORGIA STATE UNIVERSITY   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; TECHNICAL PRESENTATIONS;

'CURRENT; COMPUTER BASED TOOLS; FEEDBACK ALGORITHMS; FORMATIVE FEEDBACKS; THRESHOLD ALGORITHMS; WRITING INSTRUCTION;

TEACHING;

EID: 84865035365     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Attali, Y. & Burstein, J. (2006). Automated essay scoring with e-rater V.2. Journal of Technology, Learning, and Assessment, 4, 3-30.
2. Burstein, J., Chodorow, M., & Leacock, C. (2004). Automated essay evaluation: The Criterion online writing system. AI Magazine, 25, 27-36.
3. Clauser, B., Kane, M. & Swanson, D. (2002). Validity issues for performance-based tests scored with computer-automated scoring systems. Applied Measurement in Education, 15, 413-432.
4. College Board (2011). Essay scoring guide: A framework for scoring SAT essays. Retrieved November 15, 2011, from http://professionals.collegeboard.com/ testing/sat-reasoning/scores/essay/guide
5. th Intl. Conference on Artificial Intelligence in Education. Auckland, NZ: AIED.
6. de la Paz, S. (2009). Rubrics: Heuristics for developing writing strategies. Assessment for Effective Intervention, 34, 134-146.
7. Graesser, A. & McNamara, D. (2011). Computational analyses of multilevel discourse comprehension. Topics in Cognitive Science, 2, 371-398.
8. Grimes, D. & Warschauer, M. (2010). Utility in a fallible tool: A multi-site case study of automated writing evaluation. Journal of Technology, Learning, and Assessment, 8, 4-43.
9. th Edition. Boston, MA: Bedford/St. Martin's.
10. Kellogg, R. & Raulerson, B. (2007). Improving the writing skills of college students. Psychonomic Bulletin and Review, 14, 237-242.
11. Kellogg, R. Whiteford, A., & Quinlan, T. (2010). Does automated feedback help students learn to write? Journal of Educational Computing Research, 42, 173-196.
12. Landauer, T., Laham, D., & Foltz, P. (2003). Automatic essay assessment. Assessment in Education, 10, 295-308.
13. McGarrell, H., & Verbeem, J. (2007). Motivating revision of drafts through formative feedback. ELT Journal. 61, 228-236.
14. McNamara, D. & Graesser, A. (2011). Coh-Metrix: An automated tool for theoretical and applied natural language processing. In P. McCarthy & C. Boonthum (Eds.), Applied natural language processing and content analysis: Identification, investigation, and resolution. Hershey, PA: IGI Global.
15. McNamara, D., Raine, R., Roscoe, R., Crossley, S., Dai, J., Cai, Z., Renner, A., Brandon, R., Weston, J., Dempsey, K., Lam, D., Sullivan, S., Kim, L., Rus, V., Floyd, R., McCarthy, P., & Graesser, A. (2011). The Writing-Pal: Natural language algorithms to support intelligent tutoring on writing strategies. In P. McCarthy & C. Boonthum (eds.), Applied natural language processing and content analysis: Identification, investigation, and resolution. Hershey, PA: IGI Global.
16. th International Florida Artificial Intelligence Research Society (FLAIRS) Conference (pp. 543-548). Menlo Park, CA: AAAI Press.
17. Rudner, L., Garcia, V., & Welch, C. (2006). An evaluation of the IntelliMetric essay scoring system. Journal of Technology, Learning, and Assessment, 4, 3-21.
18. Shermis, M. & Burstein, J. (Eds.). (2003). Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Erlbaum.
19. Shermis, M. D., Burstein, J. C., & Bliss, L. (2004, April). The impact of automated essay scoring on high stakes writing assessments. Presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
20. Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78, 153-189.
21. Sommers, N. (1982). Responding to student writing. College Composition and Communication, 33, 148-156.
22. Warschauer, M., & Ware, P. (2006). Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research, 10, 1-24.