Automatic summarization assessment through a combination of semantic and syntactic information for intelligent educational systems

Information Processing and Management

Volumn 51, Issue 4, 2015, Pages 340-358

  Abdi, Asad ^a   Idris, Norisma ^a   Alguliev, Rasim M ^b   Aliguliyev, Ramiz M ^b  

^a UNIVERSITY OF MALAYA   (Malaysia)

^b INSTITUTE OF PHYSICS   (Azerbaijan)

Author keywords

Automatic grading; Automatic summary assessment; Content coverage; Intelligent tutoring systems; Natural language processing

Indexed keywords

COMPUTER AIDED INSTRUCTION; EDUCATION; GRADING; SEMANTICS; SYNTACTICS; TEACHING;

AUTOMATIC GRADING; AUTOMATIC SUMMARY ASSESSMENT; CONTENT COVERAGE; INTELLIGENT TUTORING SYSTEM; NATURAL LANGUAGE PROCESSING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84924545141     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2015.02.001     Document Type: Article

References (56)

1. R.M. Alguliev, R.M. Aliguliyev, and C.A. Mehdiyev Sentence selection for generic document summarization using an adaptive differential evolution algorithm Swarm and Evolutionary Computation 1 2011 213 222
2. R.M. Aliguliyev A new sentence similarity measure and sentence based extractive technique for automatic text summarization Expert Systems with Applications 36 2009 7764 7772
3. L. Alonso, I. Castellón, S. Climent, M. Fuentes, L. Padró, and H. RodrIguez Approaches to text summarization: Questions and answers Inteligencia Artificial 8 2004 22
4. H.S. Alyousef Teaching reading comprehension to ESL/EFL learners Journal of Language and Learning 5 2006 63 73
5. J. Atkinson-Abutridy, C. Mellish, and S. Aitken Combining information extraction with genetic algorithms for text mining IEEE Intelligent Systems 19 2004 22 30
6. Y. Aytar, M. Shah, and J. Luo Utilizing semantic word similarity measures for video retrieval IEEE Conference on Computer Vision and Pattern Recognition, 2008. CVPR 2008 2008 IEEE 1 8
7. Brill, E. (1994). Some advances in transformation-based part of speech tagging. arXiv preprint cmp-lg/9406010.
8. A.L. Brown, and J.D. Day Macrorules for summarizing texts: The development of expertise Journal of Verbal Learning and Verbal Behavior 22 1983 1 14
9. C. Burgess, K. Livesay, and K. Lund Explorations in context space: Words, sentences, discourse Discourse Processes 25 1998 211 257
10. K.-E. Chang, Y.-T. Sung, and I.-D. Chen The effect of concept mapping to enhance text comprehension and summarization The Journal of Experimental Education 71 2002 5 23
11. Cho, Y. (2012). Teaching summary writing through direct instruction to improve text comprehension for students in ESL/EFL classroom. University of Wisconsin-River Falls.
12. Choi, F. Y., Wiemer-Hastings, P., & Moore, J. (2001). Latent semantic analysis for text segmentation. In Proceedings of EMNLP: Citeseer.
13. S.C. Deerwester, S.T. Dumais, T.K. Landauer, G.W. Furnas, and R.A. Harshman Indexing by latent semantic analysis JASIS 41 1990 391 407
14. De Marneffe, M.-C., MacCartney, B., & Manning, C. D. (2006). Generating typed dependency parses from phrase structure parses. In Proceedings of LREC (vol. 6, pp. 449-454).
15. H.P. Edmundson New methods in automatic extracting Journal of the ACM (JACM) 16 1969 264 285
16. G. Erkan, and D.R. Radev LexRank: Graph-based lexical centrality as salience in text summarization Journal of Artificial Intelligence Research (JAIR) 22 2004 457 479
17. Ermakova, L. (2012). Automatic summary evaluation. Roug e modifications
18. Y.-C. Fan The effect of comprehension strategy instruction on EFL Learners' reading comprehension Asian Social Science 6 2010 P19
19. M.A. Fattah, and F. Ren GA, MR, FFNN, PNN and GMM based models for automatic text summarization Computer Speech & Language 23 2009 126 144
20. P.W. Foltz Latent semantic analysis for text-based research Behavior Research Methods, Instruments, & Computers 28 1996 197 202
21. P.W. Foltz, W. Kintsch, and T.K. Landauer The measurement of textual coherence with latent semantic analysis Discourse Processes 25 1998 285 307
22. P.W. Foltz, D. Laham, and T.K. Landauer The intelligent essay assessor: Applications to educational technology Interactive Multimedia Electronic Journal of Computer-Enhanced Learning 1 1999
23. Franzke, M., & Streeter, L.A. (2006). Building student summarization, writing and reading comprehension skills with guided practice and automated feedback. Highlights From Research at the University of Colorado, A white paper from Pearson Knowledge Technologies.
24. T. Hedge Teaching and learning in the language classroom Vol. 106 2001 Oxford University Press Oxford, UK
25. Y. He, S.C. Hui, and T.T. Quan Automatic summary assessment for intelligent tutoring systems Computers & Education 53 2009 890 899
26. K.S. Jones, and J.R. Galliers Evaluating natural language processing systems: An analysis and review Vol. 1083 1996 Springer
27. D. Kanejiya, A. Kumar, and S. Prasad Automatic evaluation of students' answers using syntactically enhanced LSA Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing Vol. 2 2003 Association for Computational Linguistics 53 60
28. Y. Ko, J. Park, and J. Seo Improving text categorization using the importance of sentences Information Processing & Management 40 2004 65 79
29. J. Kupiec, J. Pedersen, and F. Chen A trainable document summarizer Proceedings of the 18th annual international ACM SIGIR conference on research and development in information retrieval 1995 ACM 68 73
30. T.K. Landauer On the computational basis of learning and cognition: Arguments from LSA Psychology of Learning and Motivation 41 2002 43 84
31. T.K. Landauer, and S.T. Dumais A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge Psychological Review 104 1997 211
32. Landauer, T. K., Laham, D., Rehder, B., & Schreiner, M. E. (1997). How well can passage meaning be derived without using word order? A comparison of Latent Semantic Analysis and humans. In Proceedings of the 19th annual meeting of the cognitive science society (pp. 412-417).
33. T.K. Landauer, P.W. Foltz, and D. Laham An introduction to latent semantic analysis Discourse Processes 25 1998 259 284
34. J.R. Landis, and G.G. Koch The measurement of observer agreement for categorical data Biometrics 1977 159 174
35. J.A. León, R. Olmos, I. Escudero, J.J. Cañas, and L. Salmerón Assessing short summaries with human judgments procedure and latent semantic analysis in narrative and expository texts Behavior Research Methods 38 2006 616 627
36. Y. Li, D. McLean, Z.A. Bandar, J.D. O'shea, and K. Crockett Sentence similarity based on semantic nets and corpus statistics IEEE Transactions on Knowledge and Data Engineering 18 2006 1138 1150
37. Lin, D. (1998). An information-theoretic definition of similarity. In ICML (Vol. 98, pp. 296-304).
38. Lin, C.-Y. (2004). Rouge: A package for automatic evaluation of summaries. In Text summarization branches out: Proceedings of the ACL-04 workshop (pp. 74-81).
39. Mihalcea, R., Corley, C., & Strapparava, C. (2006). Corpus-based and knowledge-based measures of text semantic similarity. In AAAI (Vol. 6, pp. 775-780).
40. G.A. Miller, and W.G. Charles Contextual correlates of semantic similarity Language and Cognitive Processes 6 1991 1 28
41. M. Mohler, R. Bunescu, and R. Mihalcea Learning to grade short answer questions using semantic similarity measures and dependency graph alignments Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies Vol. 1 2011 Association for Computational Linguistics 752 762
42. M. Pakzadian, and A.E. Rasekh The effects of using summarization strategies on Iranian EFL learners' reading comprehension English Linguistics Research 1 2013 p118
43. K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu BLEU: A method for automatic evaluation of machine translation Proceedings of the 40th annual meeting on association for computational linguistics 2002 Association for Computational Linguistics 311 318
44. Pérez, D., Alfonseca, E., & RodrIguez, P. (2004). Upper bounds of the BLEU algorithm applied to assessing student essays. In Proceedings of the 30th international association for educational assessment (IAEA) conference.
45. Pérez, D., Gliozzo, A.M., Strapparava, C., Alfonseca, E., Rodríguez, P., & Magnini, B. (2005). Automatic Assessment of students' free-text answers underpinned by the combination of a BLEU-inspired algorithm and latent semantic analysis. In FLAIRS conference (pp. 358-363).
46. V. Rus, A. Graesser, and K. Desai Lexico-syntactic subsumption for textual entailment Amsterdam Studies in the Theory and History of Linguistic Science Series 4 2007 292 187
47. Salton, G. (1989). Automatic text processing: The transformation, analysis, and retrieval of: Addison-Wesley.
48. Y. Tian, H. Li, Q. Cai, and S. Zhao Measuring the similarity of short texts by word similarity and tree kernels Information Computing and Telecommunications (YC-ICT), 2010 IEEE Youth Conference on 2010 IEEE 363 366
49. S. Valenti, F. Neri, and A. Cucchiarelli An overview of current research on automated essay grading Journal of Information Technology Education: Research 2 2003 319 330
50. Warin, M. (2004). Using WordNet and semantic similarity to disambiguate an ontology. (Retrieved 25.01.08).
51. Wiemer-Hastings, P., & Wiemer, P. (2000). Adding syntactic information to LSA. In Proceedings of the 22nd annual meeting of the cognitive science society. Citeseer.
52. Wiemer-Hastings, P., & Zipitria, I. (2001). Rules for syntax, vectors for semantics. In Proceedings of the twenty-third annual conference of the cognitive science society (pp. 1112-1117).
53. J. Zhang, L. Sun, and Q. Zhou A cue-based hub-authority approach for multi-document text summarization Proceedings of 2005 IEEE international conference on natural language processing and knowledge engineering, 2005. IEEE NLP-KE'05 2005 IEEE 642 645
54. I. Zipitria, J.A. Elorriaga, A. Arruarte, and A.D. de Ilarraza From human to automatic summary evaluation Intelligent tutoring systems 2004 Springer 432 442
55. Zipitria, I., Arruarte, A., Elorriaga, J. A. (2010). Automatically grading the use of language in learner summaries. In Proceedings of the 18th international conference on computers in education, Putrajaya, Malaysia (pp. 46-50).
56. I. Zipitria, P. Larrañaga, R. Armañanzas, A. Arruarte, and J.A. Elorriaga What is behind a summary-evaluation decision? Behavior Research Methods 40 2008 597 612