Identifying off-topic student essays without topic-specific training data

Natural Language Engineering

Volumn 12, Issue 2, 2006, Pages 145-159

  Higgins, D ^a   Burstein, J ^a   Attali, Y ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER AIDED INSTRUCTION; COMPUTER SOFTWARE; PERSONNEL TRAINING; STUDENTS; USER INTERFACES;

EDUCATIONAL ASSESSMENT APPLICATIONS; NATURAL-LANGUAGE INTERFACES; STUDENT ESSAYS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 33646865685     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S1351324906004189     Document Type: Article

References (22)

1. Allan, J. Carbonell, J., Doddington, G., Yamron, J. and Yang, Y. (1998) Topic detection and tracking pilot study: Final report. Proceedings of the Broadcast News Transcription and Understanding Workshop, pp. 194-218.
2. Attali, Y. and Burstein, J. (2004) Automated essay scoring with e-rater V.2.0. Presentation at the Annual Meeting of the International Association for Educational Assessment, Philadelphia, PA.
3. Billsus, D. and Pazzani, M. (1999) A hybrid user model for news story classification. Proceedings of the Seventh International Conference on User Modeling (UM '99).
4. Burstein, J., Kukich, K., Wolff, S., Lu, C., Chodorow, M., Braden-Harder, L. and Harris, M. (1998) Automated scoring using a hybrid feature identification technique. Proceedings of 36th Annual Meeting of the Association for Computational Linguistics, pp. 206-210.
5. Burstein, J., Chodorow, M. and Leacock, C. (2004) Automated essay evaluation: The Criterion online writing service. AI Magazine 25(3): 27-36.
6. Burstein, J. (2003) The e-rater® scoring engine: Automated essay scoring with natural language processing. In: M. Shermis and J. Burstein (eds.), Automated Essay Scoring: A cross-disciplinary perspective. Hillsdale, NJ: Lawrence Erlbaum.
7. Chapman, W., Christensen, L., Wagner, M., Haug, P., Ivanov, O., Dowling, J. and Olszewski, R. (2005) Classifying free-text triage chief complaints into syndromic categories with natural language processing. Artificial Intelligence in Medicine 33(1): 30-40.
8. Christianini, N. and Shawe-Taylor, J. (2000) Support Vector Machines and other Kernel-based Learning Methods. Cambridge, UK: Cambridge University Press.
9. Cohen, W., Carvalho V. and Mitchell, T. (2004) Learning to classify email into "Speech Acts". Proceedings of EMNLP 2004, pp. 309-316.
10. Elliott, S. (2003) Intellimetric: From here to validity. In: M. Shermis and J. Burstein (eds.), Automated Essay Scoring: A cross-disciplinary perspective. Hillsdale, NJ: Lawrence Erlbaum.
11. Foltz, P., Kintsch, W. and Landauer, T. (1998) Analysis of Text Coherence Using Latent Semantic Analysis. Discourse Processes 25(2-3): 285-307.
12. Harman, D. (1992) The DARPA TIPSTER project. SIGIR Forum 26(2): 26-28.
13. Hripcsak, G., Friedman, C., Alderson, P., DuMouchel, W., Johnson, S. and Clayton, P. (1995) Unlocking clinical data from narrative reports: A study of natural language processing. Annals of Internal Medicine 122(9): 681-688.
14. Joachims, T. (2002) Optimizing search engines using clickthrough data. Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD)
15. Larkey, L. (1998) Automatic essay grading using text categorization techniques. Proceedings of the 21st ACM-SIGIR Conference on Research and Development in Information Retrieval, pp. 90-95.
16. McCallum, A., Nigam, K., Rennie, J. and Seymore, K. (1999) Building Domain-Specific Search Engines with Machine Learning Techniques. Proceedings of the AAAI-99 Spring Symposium on Intelligent Agents in Cyberspace.
17. Page, E. (1966) The imminence of grading essays by computer. Phi Delta Kappan 48: 238-243.
18. Sahami, M., Dumais, S., Heckerman, D. and Horvitz, E. (1998) A Bayesian approach to filtering junk email. Learning for Text Categorization: Papers from the 1998 Workshop. AAAI Technical Report WS-98-05.
19. Sahlgren, M. (2001) Vector-based semantic analysis: Representing word meanings based on random labels. Proceedings of the ESSLLI 2001 Workshop on Semantic Knowledge Acquisition and Categorisation.
20. Salton, G. (1989) Information Retrieval: Data Structures and Algorithms. Reading, MA: Addison-Wesley.
21. Vapnik, V. (1995) The Nature of Statistical Learning Theory. New York: Springer-Verlag.
22. Wilcox A. and Hripcsak G. (2003) The role of domain knowledge in automating medical text report classification. Journal of the American Medical Informatics Association 10: 330-338.