Internal usability testing of automated essay feedback in an intelligent writing tutor

Proceedings of the 24th International Florida Artificial Intelligence Research Society, FLAIRS - 24

Volumn , Issue , 2011, Pages 543-548

  Roscoe, Rod D ^a   Varner, Laura K ^a   Cai, Zhiqiang ^a   Weston, Jennifer L ^a   Crossley, Scott A ^b   McNamara, Danielle S ^a  

^a University of Memphis   (United States)

^b GEORGIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED FEEDBACK; INTELLIGENT TUTORS; USABILITY TESTING; WRITING TUTORS;

ARTIFICIAL INTELLIGENCE; RESEARCH;

AUTOMATION;

EID: 80052411264     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Attali, Y. (2004). Exploring the feedback and revision features of Criterion. Paper presented at the National Council on Measurement in Education. San Diego, CA. (April).
2. Attali, Y. & Burstein, J. (2006). Automated essay scoring with e-rater V.2. Journal of Technology, Learning, and Assessment, 4(3). Retrieved Nov. 5, 2010 from www.jtla.org.
3. Burstein, J., Chodorow, M., & Leacock, C. (2004). Automated essay evaluation: The Criterion online writing system. Al Magazine, 25, 27-36.
4. Butler, D. & Winne, P. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65, 245-281.
5. Craig, S., Driscoll, D., & Gholson, B. (2004). Constructing knowledge from dialog in an intelligent tutoring system: Interactive learning, vicarious learning, and pedagogical agents. Journal of Educational Multimedia and Hypermedia, 13, 163-183.
6. Dikli, S. (2006). An overview of automated essay scoring of essays. Journal of Technology, Learning, and Assessment, 5(1). Retrieved Nov. 5, 2010 from www.jtla.org.
7. Hearst, M. ed. (2002). The Debate on automated essay grading. IEEE Intelligent Systems, 15, 22-37
8. Kellogg, R., Whiteford, A., & Quinlan, T. (2010). Does automated feedback help students learn to write? Journal of Educational Computing Research, 42, 173-196.
9. Kellogg, R. & Raulerson, B. (2007). Improving the writing skills of college students. Psychonomic Bulletin and Review, 14, 237-242.
10. Kluger, A. & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254-284. (Pubitemid 126042646)
11. Landauer, T., Laham, D., & Foltz, P. (2003). Automatic essay assessment. Assessment in Education, 10, 295-308.
12. McNamara, D., Crossley, S., & McCarthy, P. (2010). The linguistic features of quality writing. Written Communication, 27, 57-86.
13. McNamara, D., Louwerse, M., McCarthy, P., and Graesser, A. (2010). Coh-Metrix: Capturing linguistic features of cohesion. Discourse Processes, 47, 292-330.
14. McNamara, D., Raine, R., Roscoe, R., Crossley, S., Dai, J., Cai, Z., Renner, A., Brandon, R., Weston, J., Dempsey, K., Lam, D., Sullivan, S., Kim, L., Rus, V., Floyd, R., McCarthy, P., & Graesser, A. (in press). The Writing-Pal: Natural language algorithms to support intelligent tutoring on writing strategies. In P. McCarthy & C. Boonthum (eds.), Applied natural language processing and content analysis: Identification, investigation, and resolution. Hershey, PA: IGI Global.
15. National Commission on Writing. (2003). The Neglected "R." NY: College Entrance Examination Board.
16. Powers, D., Burstein, J., Chodorow, M., Fowles, M., & Kukich, K. (2002). Stumping e-rater: Challenging the validity of automated essay scoring. Computers in Human Behavior, 18, 103-134. (Pubitemid 34086277)
17. th grade (Research Report RR-07-07). Princeton, NJ: Educational Testing Service.
18. Rudner, L., Garcia, V., & Welch, C. (2006). An evaluation of the IntelliMetric essay scoring system. Journal of Technology, Learning, and Assessment, 4(4). Retrieved Nov. 5, 2010 from www.jtla.org.
19. Shermis, M. & Burstein, J., eds. (2003). Automated essay scoring: A Cross-disciplinary perspective. Mahwah, NJ: Erlbaum.
20. Shute, V. (2008). Focus on formative feedback. Review of Educational Research, 78, 153-189.
21. Wang, J. & Brown, M. (2007). Automated essay scoring versus human scoring: A comparative study. Journal of Technology, Learning, and Assessment, 6(2). Retrieved Nov. 5, 2010 from www.jtla.org.
22. Warschauer, M. & Ware, P. (2006). Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research, 10, 1-24.