Comparison of dimension reduction methods for automated essay grading

Educational Technology and Society

Volumn 11, Issue 3, 2008, Pages 275-288

  Kakkonen, Tuomo ^a   Myller, Niko ^a   Sutinen, Erkki ^a   Timonen, Jari ^a  

^a UNIVERSITY OF EASTERN FINLAND   (Finland)

Author keywords

Automatic essay grading; Dimensionality reduction; Latent Dirichlet allocation; Latent semantic analysis; Probabilistic latent semantic analysis

Indexed keywords

EID: 54149116924     PISSN: 11763647     EISSN: 14364522     Source Type: Journal    
DOI: None     Document Type: Article

References (35)

1. Baldi, P., Frasconi, P., & Smyth, P. (2003). Modeling the Internet and the web: probabilistic methods and algorithms, Chichester, England: Wiley.
2. Bingham, E., & Mannila, H. (2001). Random projection in dimensionality reduction: Applications to image and text data. Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY: ACM Press, 245-250.
3. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3 (5), 993-1022.
4. Brants, T. (2005). Test data likelihood for PLSA models. Information Retrieval, 8 (2), 181-196.
5. Burstein, J., Kukich, K., Wolff, S., Lu, C., Chodorow, M., Braden-Harder, L., & Harris, M. D. (1998). Automated scoring using a hybrid feature identification technique. Proceedings of the Annual Meeting of the Association of Computational Linguistics, Morristown, NJ: Association for Computational Linguistics, 206-210.
6. Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990). Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41 (6), 391-407.
7. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39(B), 1-38.
8. Foltz, P. W., & Dumais, S. T. (1992). Personalized information delivery: an analysis of information filtering methods. Communications of the ACM, 35 (12), 51-60.
9. Foltz, P. W., Gilliam, S., & Kendall, S. (2000). Supporting content-based feedback in online writing evaluation with LSA. Interactive Learning Environments, 8 (2), 111-129.
10. Foltz, P. W., Laham, D., & Landauer, T. K. (1999). The intelligent essay assessor: applications to educational technology. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning, 1 (2), retrieved June 2, 2008, from http://imej.wfu.edu/articles/1999/2/04/.
11. Girolami, M., & Kabán, A. (2003). On an equivalence between PLSI and LDA. Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New York, NY, USA: ACM Press, 433-434.
12. Globerson, A., & Tishby, N. (2003). Sufficient dimensionality reduction. Journal of Machine Learning Research, 3, 1307-1331.
13. Hofmann, T. (2001). Unsupervised learning by probabilistic latent semantic analysis. Machine Learning, 42 (1-2), 177-196.
14. Kakkonen, T., Myller, N., & Sutinen, E. (2006). Applying latent Dirichlet allocation to automatic essay grading. In Salakoski, T., Ginter, F., Pyysalo, S., Pahikkala, T. (Eds.), Proceedings of the 5th International Conference on Natural Language Processing, Berlin/Heidelberg: Springer, 110-120.
15. Kakkonen, T., Myller, N., Timonen, J., & Sutinen, E. (2005a). Automatic essay grading with probabilistic latent semantic analysis. Proceedings of the Second Workshop on Building Educational Applications Using NLP, New Brunswick: The Association for Computational Linguistics, 29-36.
16. Kakkonen, T., & Sutinen, E. (2004). Automatic assessment of the content of essays based on course materials. Proceedings of the International Conference on Information Technology: Research and Education, New York, NY: IEEE Press, 126-130.
17. Kakkonen, T., Timonen, J., & Sutinen, E. (2005b). Applying validation methods for noise reduction in LSA-based essay grading. WSEAS Transactions on Information Science and Applications, 9 (2), 1334-1342.
18. Kaplan, R. M., Wolff, S., Burstein, J., Li, C., Rock, D., & Kaplan, B. (1998). Scoring essays automatically using surface features, Technical Report 94-21P, New Jersey, USA: Educational Testing Service.
19. Kim, Y.-S., Chang, J.-H., & Zhang, B.-T. (2003). An empirical study on dimensionality optimization in text mining for linguistic knowledge acquisition. Lecture Notes in Artificial Intelligence, 2637, 111-116.
20. Landauer, T. K., Foltz, P. W., & Laham, D. (1998). Introduction to latent semantic analysis. Discourse Processes, 25 (2&3), 259-284.
21. Landauer, T. K., Laham, D., Rehder, B., & Schreiner, M. (1997). How well can passage meaning be derived without using word order? A comparison of latent semantic analysis and humans. In Shafto, M. G., Langley, P. (Eds.), Proceedings of the 19th Annual Conference of the Cognitive Science Society, Stanford, USA: Cognitive Science Society, 412-417.
22. Larkey, L. (1998). Automatic essay grading using text categorization techniques. Proceedings of the 21st Annual International Conference on Research and Development in Information Retrieval, New York: ACM Press, 90-95.
23. Lingsoft Inc. (2007). Lingsoft Oy, Retrieved June 28, 2008 from http://www.lingsoft.fi/.
24. Minka, T., & Lafferty, J. (2002). Expectation-propagation for the generative aspect model. In Breese, J., Koller, D. (Eds.), Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA: Morgan Kaufmann, 352-359.
25. Page, E. B. (1966). The imminence of grading essays by computer. Phi Delta Kappa, 47(1), 238-243.
26. Page, E. B., & Petersen, N. S. (1995). The computer moves into essay grading. Phi Delta Kappa, 76 (7), 561-565.
27. Praks, P., Dvorský, J., & Snášel, V. (2003). Latent semantic indexing for image retrieval systems. Proceedings of the SIAM Conference on Applied Linear Algebra. International Linear Algebra Society (ILAS), Philadelphia, PA: SLAM, Retrieved June 28,2008 from http://www.siam.org/meetings/la03/proceedings/Dvorsky.pdf.
28. Quesada, J. (2003). Latent problem solving analysis (LPSA): a computational theory of representation in complex, dynamic problem solving tasks, PhD thesis, Psychology, University of Granada.
29. Rudner, L. M., & Liang, T. (2002). Automated essay scoring using Bayes' theorem. The Journal of Technology, Learning and Assessment, 1 (2), 3-21.
30. Sebastiani, G. (2002). Machine learning in automated text categorization. ACM Computing Surveys, 34(1), 1-47.
31. Si, L., & Jin, R. (2005). Adjusting mixture weights of gaussian mixture model via regularized probabilistic latent semantic analysis. Lecture Notes on Computer Science, 3518, 622-631.
32. Wade-Stein, D., & Kintsch, E. (2003). Summary street: Interactive computer support for writing, Technical report, Boulder, CO: Institute for Cognitive Science, University of Colorado.
33. Wiemer-Hastings, P. M., Wiemer-Hastings, K., & Graesser, A. C. (1999). Approximate natural language understanding for an intelligent tutor. Proceedings of the Twelfth International Florida Artificial Intelligence Research Society Conference, Menlo Park, California, USA: AAAI Press, 192-196.
34. Yu-Seop, K., Jeong-Ho, C., & Byoung-Tak, Z. (2002). A comparative evaluation of data-driven models in translation selection of machine translation. Proceedings of the 19th International Conference on Computational Linguistics, Morristown, NJ, USA: Association for Computational Linguistics, 1-7.
35. th International Conference on Information and Knowledge Management, New York: ACM Press, 113-118.