On automated evaluation of readability of summaries: Capturing grammaticality, focus, structure and coherence

NAACL-HLT 2010 - Human Language Technologies: 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Student Research Workshop

Volumn , Issue , 2010, Pages 7-12

  Vadlapudi, Ravikiran ^a   Katragadda, Rahul ^b  

^a INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; COMPUTATIONAL LINGUISTICS;

AUTOMATED EVALUATION; AUTOMATED METRIC; EVALUATION METRICS; QUALITY CONTENT;

QUALITY CONTROL;

EID: 85072933275     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Regina Barzilay and Mirella Lapata. 2005. Modeling local coherence: An entity-based approach. In ACL.
2. Thorsten Brants. 2000. Tnt: a statistical part-of-speech tagger. In Proceedings of the sixth conference on Applied natural language processing, pages 224–231, Morristown, NJ, USA. Association for Computational Linguistics.
3. Jieun Chae and Ani Nenkova. 2009. Predicting the fluency of text with shallow structural features: Case studies of machine translation and human-written text. In EACL, pages 139–147. The Association for Computer Linguistics.
4. Rudolf Flesch. 1948. A new readability yardstick. Journal of Applied Psychology, 32:221–233.
5. M.A.K Halliday and Ruqayia Hasan. 1976. Longman publishers.
6. Derrick Higgins, Jill Burstein, Daniel Marcu, and Claudia Gentile. 2004. Evaluating multiple aspects of coherence in student essays. In HLT-NAACL 2004: Main Proceedings, pages 185–192, Boston, Massachusetts, USA, May 2 - May 7. Association for Computational Linguistics.
7. Lynette Hirschman and Inderjeet Mani. 2001. Evaluation.
8. Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In the proceedings of ACL Workshop on Text Summarization Branches Out. ACL.
9. Jane Morris and Graeme Hirst. 1991. Lexical cohesion computed by thesaural relations as an indicator of the structure of text. Comput. Linguist., 17(1):21–48.
10. Andrew Mutton, Mark Dras, Stephen Wan, and Robert Dale. 2007. Gleu: Automatic evaluation of sentence-level fluency. In ACL. The Association for Computer Linguistics.
11. Emily Pitler and Ani Nenkova. 2008. Revisiting readability: A unified framework for predicting text quality. In EMNLP, pages 186–195. ACL.
12. Michael Strube and Simone Paolo Ponzetto. 2006. Wikirelate! computing semantic relatedness using wikipedia. In 21. AAAI / 18. IAAI 2006. AAAI Press, july.
13. Ravikiran Vadlapudi and Rahul Katragadda. 2010. Quantitative evaluation of grammaticality of summaries. In CICLing.