Readability assessment for text simplification: From analysing documents to identifying sentential simplifications

ITL - International Journal of Applied Linguistics (Belgium)

Volumn 165, Issue 2, 2014, Pages 194-222

  Vajjala, Sowmya ^b   Meurers, Detmar ^a  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b NONE

Author keywords

Generalizability of readability models; Readability assessment; Sentence readability; Simplification evaluation; Text simplification

Indexed keywords

EID: 85037154243     PISSN: 00190829     EISSN: 17831490     Source Type: Journal    
DOI: 10.1075/itl.165.2.04vaj     Document Type: Article

References (69)

1. Allen, D. (2009). Using a corpus of simplified news texts to investigate features of the intuitive approach to simplification. Proceedings of the Corpus Linguistics Conference (pp. 585–599).
2. Aluisio, S., Specia, L., Gasperin, C., & Scarton, C. (2010). Readability assessment for text simplification. Proceedings of the NAACL HLT 2010 Fifth Workshop on Innovative Use of NLP for Building Educational Applications (pp. 1–9). Association for Computational Linguistics.
3. Aranzabe, M. J., de Ilarraza, A. D., & Gonzalez-Dios, I. (2012). First approach to automatic text simplification in Basque. Proceedings of the First workshop on Natural Language Processing for Improving Textual Accessibility (NLP4ITA) (pp. 1–8).
4. Baayen, R. H., Piepenbrock, R., & Gulikers, L. (1995). The CELEX lexical database (CD-ROM). http://www.ldc.upenn.edu/Catalog/readme_files/celex.readme.html.
5. Bach, N., Gao, Q., Vogel, S., & Waibel, A. (2011). TriS: A statistical sentence simplifier with log-linear models and margin-based discriminative training. Proceedings of 5th International Joint Conference on Natural Language Processing (IJCNLP) (pp. 474–482).
6. Barlacchi, G., & Tonelli, S. (2013). ERNESTA: A sentence simplification tool for children’s stories in Italian. Proceedings of the 14th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing), (pp. 476–487).
7. Biran, O., Brody, S., & Elhadad, N. (2011). Putting it simply: A context-aware approach to lexical simplification. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT) (pp. 496–501).
8. Bormuth, J. R. (1966). Readability: A new approach. Reading Research Quarterly, 1(3), 79–132. DOI: 10.2307/747021
9. Boston, M. F., Hale, J. T., Patil, U., Kliegl, R., & Vasishth, S. (2008). Parsing costs as predictors of reading difficulty: An evaluation using the Potsdam Sentence Corpus. Journal of Eye Movement Research, 2, 1–12.
10. Bott, S., & Saggion, H. (2011). Spanish text simplification: An exploratory study. Proceedings of the 27th Conference of the Spanish Society for Natural Language Processing (pp. 87–95).
11. Carroll, J., Minnen, G., Canning, Y., Devlin, S., & Tait, J. (1998). Practical simplification of English newspaper text to assist aphasic readers. Proceedings of the AAAI-98 Workshop on Integrating Artificial Intelligence and Assistive Technology (pp. 7–10).
12. Canning, Y., Tait, J., Archibald, J., & Crawley, R. (1999). Cohesive generation of syntactically simplified newspaper text. Proceedings of the Third International Workshop on Text, Speech and Dialogue (pp. 145–150).
13. Chall, J. S., & Dale, E. (1995). Readability revisited: The new Dale-Chall readability formula. Brookeline Books.
14. Chandrasekar, R., Doran, C., & Srinivas, B. (1996). Motivations and methods for text simplification. Proceedings of the 16th Conference on Computational Linguistics (COLING) (pp. 1041–1044).
15. Chandrasekar, R., & Srinivas, B. (1997). Automatic induction of rules for text simplification. Knowledge Based Systems, 10, 183–190. DOI: 10.1016/S0950-7051(97)00029-4
16. Collins-Thompson, K., & Callan, J. (2005). Predicting reading difficulty with statistical language models. Journal of the American Society for Information Science and Technology, 56, 1448–1462. DOI: 10.1002/asi.20243
17. Coster, W., & Kauchak, D. (2011). Learning to simplify sentences using wikipedia. Proceedings of the Workshop on Monolingual Text-To-Text Generation, (pp. 1–9).
18. Crossley, S. A., Dufty, D. F., McCarthy, P. M., & McNamara, D. S. (2007). Toward a new readability: A mixed model approach. Proceedings of the 29th annual conference of the Cognitive Science Society (pp. 197–202).
19. Dell’Orletta, F., Montemagni, S., & Venturi, G. (2011). READ-IT: Assessing readability of Italian texts with a view to text simplification. Proceedings of the 2nd Workshop on Speech and Language Processing for Assistive Technologies (pp. 73–83).
20. Dubay, W. H. (Ed.). (2006). The classic readability studies. Costa Mesa: Impact Information.
21. Feng, L., Elhadad, N., & Huenerfauth, M. (2009). Cognitively motivated features for readability assessment. Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009) (pp. 229–237).
22. Flor, M., Klebanov, B. B. & Sheehan, K. M. (2013). Lexical Tightness and Text Complexity. Proceedings of the Second Workshop on Natural Language Processing for Improving Textual Accessibility (pp. 29–38).
23. François, T., & Watrin, P. (2011). On the contribution of MWE-based features to a readability formula for French as a foreign language. Proceedings of Recent Advances in Natural Language Processing (RANLP) (pp. 441–447).
24. Futagi, Y., Kostin, I. W., & Sheehan, K. M. (2007). Reading level assessment for literacy and expository texts. Proceedings of the 29th Annual Meeting of the Cognitive Science Society (pp. 18–53).
25. Gasperin, C., Specia, L., Pereira, T. F., & Aluisio, S. M. (2009). Learning when to simplify sentences for natural text simplification. Proceedings of the Encontro Nacional de Inteligência Artificial (ENIA-2009) (pp. 809–818).
26. Graesser, A. C., McNamara, D. S., & Kulikowich, J. M. (2012). Coh-metrix: Providing multilevel analyses of text characteristics. Educational Researcher, 40(5), 223–234. DOI: 10.3102/0013189X11413260
27. Hancke, J., Vajjala, S., & Meurers, D. (2012). Readability classification for German using lexical, syntactic and morphological features. Proceedings of the 24th International Conference on Computational Linguistics (COLING) (pp. 1063–1080).
28. Heilman, M., Collins-Thompson, K., Callan, J., & Eskenazi, M. (2007). Combining lexical and grammatical features to improve readability measures for first and second language texts. Proceedings of the Human Language Technologies Conference (HLT) (pp. 460–467). Association for Computational Linguistics.
29. Heilman, M., Collins-Thompson K., & Eskenazi, M. (2008). An analysis of statistical models and features for reading difficulty prediction. Proceedings of the 3rd Workshop on Innovative Use of NLP for Building Educational Applications (pp. 71–79). Association for Computational Linguistics.
30. Heilman, M., Zhao, L., Pino, J., & Eskenazi, M. (2008a). Retrieval of reading materials for vocabulary and reading practice. Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications (BEA3) (pp. 80–88).
31. Hunt, K. W. (1970). Do sentences in the second language grow like those in the first? TESOL Quarterly, 4, 195–202. DOI: 10.2307/3w585720
32. Jonnalagadda, S., Tari, L., Hakenberg, J., Baral, C., & Gonzalez, G. (2009). Towards effective sentence simplification for automatic processing of biomedical text. Proceedings of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL HLT) (pp. 177–180).
33. Kim, J. Y., Collins-Thompson, K., Bennett, P. N., & Dumais, S. T. (2012). Characterizing web content, user interests, and search behavior by reading level and topic. Proceedings of the Fifth ACM International Conference on Web Search and Data Mining (WSDM) (pp. 213–222).
34. Kincaid, J. P., Fishburne Jr., R. P., Rogers, R. L., & Chissom, B. S. (1975). Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for Navy enlisted personnel. Research Branch Report. Naval Technical Training Command. (pp. 8–75).
35. Klebanov, B. B., Knight, K., & Marcu, D. (2004). Text simplification for information-seeking applications. On the Move to Meaningful Internet Systems, Lecture Notes in Computer Science (pp. 735–747). DOI: 10.1007/978-3-540-30468-5_47
36. Klerke, S., & Søgaard A. (2012). Dsim, a Danish parallel corpus for text simplification. Proceedings of Language Resources and Evaluation Conference (LREC) (pp. 4015–4018).
37. Kuperman, V., Stadthagen-Gonzalez, H., & Brysbaert, Marc. (2012). Age-of-acquisition ratings for 30,000 English words. Behavior Research Methods, 44, 978–990. DOI: 10.3758/s13428-012-0210-4
38. Landauer, T., & Way, D. (2012). Improving text complexity measurement through reading maturity metric. Annual Meeting of the National Council on Measurement in Education. http://www.pearsonassessments.com/hai/images/tmrs/Word_Maturity_and_Text_Complexity_NCME.pdf
39. Levy, R., & Andrew, G. (2006). Tregex and Tsurgeon: Tools for querying and manipulating tree data structures. Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC) (pp. 2231–2234).
40. Liu, X., Croft, W. B., Oh, P., & Hart, D. (2004). Automatic recognition of reading levels from user queries. Proceedings of the 27th Annual International ACM SIGIR Conference on RESEARCH and Development in Information Retrieval (pp. 548–549).
41. Ma., Y., Fosler-Lussier, E., & Lofthus, R. (2012). Ranking-based readability assessment for early primary children’s literature. Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (pp. 548–552).
42. Martin, L., & Gottron., T. (2012). Readability and the web. Future Internet, 4, 238–252. DOI: 10.3390/fi4010238
43. Medero, J., & Ostendorf, M. (2011). Identifying targets for syntactic simplification. Proceedings of the International Workshop on Speech and Language Technology in Education (SLaTE 2011). http://ssli.ee.washington.edu/people/jmedero/publications/2011_slate.pdf
44. Napoles, C., & Dredze, M. (2010). Learning simple wikipedia: A cogitation in ascertaining abecedarian language. Proceedings of the NAACL HLT 2010 Workshop on Computational Linguistics and Writing: Writing Processes and Authoring Aids (pp. 42–50).
45. Nelson, J., Perfetti, C., Liben, D., & Liben, M. (2012). Measures of Text Difficulty: Testing their Predictive Value for Grade Levels and Student Performance. The Council of Chief State School Officers Technical Report.
46. Pera, M. S., & Ng, Y-K. (2012). BReK12: A book recommender for K-12 users. Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) (pp. 1037–1038).
47. Petersen, S. E., & Ostendorf, M. (2007). Text simplification for language learners: A corpus analysis. Proceedings of Speech and Language Technology for Education (SLaTE). http://www.cs.cmu.edu/~max/mainpage_files/files/SLaTE07_Petersen_Text_Simplification.pdf
48. Petrov, S., & Klein, D. (2007). Improved inference for unlexicalized parsing. Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics (pp. 404–411).
49. Sheehan, K. M., Kostin, I., & Futagi, Y. (2009). When do standard approaches for measuring vocabulary difficulty, syntactic complexity and referential cohesion yield biased estimates of text difficulty? Proceedings of the 30th Annual Meeting of the Cognitive Science Society (pp. 1978–1983).
50. Sheehan, K. M., Kostin, I., Futagi, Y., & Flor, M. (2010). Generating automated text complexity classifications that are aligned with targeted text complexity standards. ETS Research Report, RR-10-28.
51. Siddharthan, A. (2002). An architecture for a text simplification system. Proceedings of the Language Engineering Conference (LEC) (pp. 64–71).
52. Siddharthan, A. (2003). Preserving discourse structure when simplifying text. Proceedings of the European Natural Language Generation Workshop (ENLG) (pp. 103–110).
53. Siddharthan, A. (2004). Syntactic simplification and text cohesion. PhD Thesis, University of Cambridge.
54. Specia, L. (2010). Translating from complex to simplified sentences. Proceedings of the 9th international Conference on Computational Processing of the Portuguese Language (PROPOR’10) (pp. 30–39).
55. Specia, L., Jauhar, S. K., & Mihalcea, R. (2012). SemEval-2012 task 1: English lexical simplification. Proceedings of the 6th International Conference on Semantic Evaluation (SemEval) (pp. 347–355).
56. Štajner, S., Drndarevic, B., & Saggion, H. (2013). Corpus-based sentence deletion and split decisions for Spanish text simplification. Computación y Sistemas (CICLing 2013) 17(2). 251–262.
57. Toutanova, K., & Klein, D. (2003). Feature-Rich Part-of-speech tagging with a cyclic dependency network. Proceedings of HLT-NAACL 2003 (pp. 252–259).
58. Vajjala, S., & Meurers, D. (2012). On improving the accuracy of readability classification. Proceedings of the Seventh Workshop on Innovative use of NLP for Building Educational Applications (BEA7) (pp. 163–173). Association for Computational Linguistics.
59. Vajjala, S., & Meurers, D. (2013). On The applicability of readability models to web texts. Proceedings of the Second Workshop on Predicting and Improving Text Readability for Target Reader Populations (PITR) (pp. 59–68). Association for Computational Linguistics.
60. Vajjala, S., & Meurers, D. (2014). Exploring measures of Readability for spoken language: Analyzing linguistic features of subtitles to identify age-specific TV programs. Proceedings of the 3rd Workshop on Predicting and Improving Text Readability for Target Reader Populations. Association for Computational Linguistics. Gothenburg, Sweden.
61. Vor der Brück, T., Hartrumpf, S., & Helbig, H. (2008). A readability checker with supervised learning using deep syntactic and semantic indicators. Informatica, 32, 429–435.
62. Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bulletin, 1(6), 80–83. DOI: 10.2307/3001968
63. Wilson, M. D. (1988). The MRC psycholinguistic database: Machine readable dictionary, Version 2. Behavioral Research Methods, Instruments and Computers, 20, 6–11. DOI: 10.3758/BF03202594
64. Witten, I. H., & Frank, E. (2005). Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufman, Amsterdam; Boston, MA.
65. Woodsend, K., & Lapata, M. (2011). Learning to simplify sentences with quasi-synchronous grammar and integer programming. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 409–420).
66. Wubben, S., van den Bosch, A., & Krahmer, E. (2012). Sentence simplification by monolingual machine translation. Proceedings of ACL 2012 (pp. 1015–1024).
67. Yatskar, M., Pang, B., Danescu-Niculescu-Mizil, C., & Lee, L. (2010). For the sake of simplicity: Unsupervised extraction of lexical simplifications from Wikipedia. Proceedings of NAACL-HLT (pp. 365–368).
68. Zhao, J., & Kan, M-Y. (2010). Domain-specific iterative readability computation. Proceedings of the 10th annual joint conference on Digital libraries (pp. 205–214).
69. Zhu, Z., Bernhard, D., & Gurevych, I. (2010). A monolingual tree-based translation model for sentence simplification. Proceedings of The 23rd International Conference on Computational Linguistics (COLING) (pp. 1353–1361).