Grammatical and context-sensitive error correction using a statistical machine translation framework

Software - Practice and Experience

Volumn 43, Issue 2, 2013, Pages 187-206

  Ehsan, Nava ^a   Faili, Heshaam ^a  

^a UNIVERSITY OF TEHRAN   (Iran)

Author keywords

grammar checker; Persian language; real word error; statistical machine translation; syntactic error

Indexed keywords

GRAMMAR CHECKERS; PERSIANS; REAL-WORD ERRORS; STATISTICAL MACHINE TRANSLATION; SYNTACTIC ERRORS;

ERROR CORRECTION; INFORMATION MANAGEMENT; LINGUISTICS; MODEL CHECKING; TRANSLATION (LANGUAGES); VIRTUAL REALITY;

CONTEXT SENSITIVE LANGUAGES;

EID: 84872148952     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.2110     Document Type: Article

References (50)

1. Bhagat M,. Spelling error pattern analysis of Punjabi typed text. Master's Thesis, Computer Science and Engineering Department Thapar Institute of Engineering and Technology Deemed University Patiala, 2007.
2. Leacock C, Chodorow M, Gamon M, Tetreault J,. Automated grammatical error detection for language learners. Synthesis Lectures on Human Language Technologies 2010; 3 (1): 1-134.
3. Kukich K,. Techniques for automatically correcting words in text. ACM Computing Surveys (CSUR) 1992; 24 (4): 377-439. (Pubitemid 23687641)
4. Ehsan N, Faili H,. Towards grammar checker development for Persian language. The 6th IEEE International Conference on Natural Language Processing and Knowledge Engineering (IEEE NLP-KE'10), 2010; 150-157.
5. Faili H,. Detection and correction of real-word spelling errors in Persian language. Proceedings of the 6th IEEE International Conference on Natural Language Processing and Knowledge Engineering, 2010; 533-536.
6. Naber D,. A rule-based style and grammar checker. Master's Thesis, Diplomarbeit.Technische Fakultat Universitat Bielefeld, 2003.
7. Shaalan KF,. Arabic GramCheck: A grammar checker for Arabic. Software: Practice and Experience 2005; 35 (7): 643-665. (Pubitemid 40795496)
8. Lee J, Seneff S,. Automatic grammar correction for second-language learners. Ninth International Conference on Spoken Language Processing, 2006; 1978-1981.
9. Sun G, Liu X, Cong G, Zhou M, Xiong Z, Lee J, Lin C,. Detecting erroneous sentences using automatically mined sequential patterns. Annual Meeting-Association for Computational Linguistics 2007; 45: 81-88.
10. Chodorow M, Leacock C,. An unsupervised method for detecting grammatical errors. Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference, 2000; 140-147.
11. Milkowski M,. Developing an open-source, rule-based proofreading tool. Software: Practice and Experience 2010; 40 (7): 543-566.
12. Bustamante FR, Leõn FS,. GramCheck: A grammar and style checker. Proceedings of the 16th conference on Computational linguistics-Volume 1, 1996; 175-181.
13. Brockett C, Dolan WB, Gamon M,. Correcting ESL errors using phrasal SMT techniques. Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, 2006; 249-256.
14. Simard M, Goutte C, Isabelle P,. Statistical phrase-based post-editing. Proceedings of the North American chapter of the Association for Computational Linguistics conferencer HLT-NAACL, 2007; 508-515.
15. Simard M, Ueffing N, Isabelle P, Kuhn R,. Rule-based translation with statistical phrase-based post-editing. Proceedings of the Second Workshop on Statistical Machine Translation (WMT), 2007; 203-206.
16. Lee J, Seneff S,. Interlingua-based translation for language learning systems. IEEE Workshop on Automatic Speech Recognition and Understanding, 2005; 133-138.
17. Arppe A,. Developing a grammar checker for Swedish. The 12th Nordic Conference of Computational Linguistics, 2000; 13-27.
18. Sjobergh J, Knutsson O,. Faking errors to avoid making errors: Machine learning for error detection in writing. Proceedings of RANLP, 2005.
19. Shamsfard M, Jafari HS, Ilbeygi M,. SteP-1: A set of fundamental tools for Persian text processing. 8th Language Resources and Evaluation Conference, 2010.
20. Kashefi O, Nasri M, Kanani K,. Towards Automatic Persian Spell Checking. SCICT: Tehran, Iran, 2010.
21. Kies D,. Evaluating grammar checkers: A Comparative ten-year study. 6th International Conference on Education and Information Systems, Technologies and Applications: EISTA, 2008.
22. Wilcox-O'Hearn A, Hirst G, Budanitsky A,. Real-word spelling correction with trigrams: A reconsideration of the Mays, Damerau, and Mercer model. Computational Linguistics and Intelligent Text Processing, 2000; 605-616.
23. Mays E, Damerau FJ, Mercer RL,. Context based spelling correction. Information Processing and Management 1991; 27 (5): 517-522.
24. Golding AR, Roth D,. A winnow-based approach to context-sensitive spelling correction. Machine learning 1999; 34 (1): 107-130.
25. Golding AR,. A Bayesian hybrid method for context-sensitive spelling correction. Proceedings of the Third Workshop on Very Large Corpora 1995; 3: 39-53.
26. Jones MP, Martin JH,. Contextual spelling correction using latent semantic analysis. Proceedings of the fifth conference on Applied natural language processing, 1997; 166-173.
27. Carlson AJ, Rosen J, Roth D,. Scaling up context-sensitive text correction. Urbana 2001; 51: 45-50. (Pubitemid 34600868)
28. Golding AR, Schabes Y,. Combining trigram-based and feature-based methods for context-sensitive spelling correction. Proceedings of the 34th annual meeting on Association for Computational Linguistics, 1996; 71-78.
29. Ingason AK, Johannsson SB, Rognvaldsson E, Helgadõttir S, Loftsson H,. Context-sensitive spelling correction and rich morphology. Proceedings of NODALIDA, vol 17, 2009.
30. Church KW, Hanks P,. Word association norms, mutual information, and lexicography. Computational linguistics 1990; 16 (1): 22-29.
31. Fellbaum C,. WordNet: An Electronic Lexical Database. MIT Press: Cambridge, MA, 1998.
32. Pedler J,. Computer correction of real-word spelling errors in dyslexic text. PhD Thesis, Birkbeck, London University, 2007.
33. Jurafsky D, Martin J, Kehler A, Vander Linden K, Ward N,. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, Vol. 163. MIT Press, 2010.
34. Brown PF, Pietra SA, Mercer RL, Pietra VJ,. The mathematics of statistical machine translation. Computational linguistics 1993; 19: 263-311.
35. Koehn P, Hoang H, Birch A, Callison-Burch C, Federico M, Bertoldi N, Cowan B, Shen W, Moran C, Zens R,. Moses: Open source toolkit for statistical machine translation. Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, 2007; 177-180.
36. Och FJ, Ney H,. A systematic comparison of various statistical alignment models. Computational Linguistics 2003; 29 (1): 19-51. (Pubitemid 37049767)
37. Stolcke A,. SRILM-an extensible language modeling toolkit. Seventh International Conference on Spoken Language Processing 2002; 3: 901-904.
38. Axelrod A,. Factored language model for statistical machine translation. Master of Science Thesis, Institute for Communicating and Collaborative Systems, Division of Informatics, University of Edinburgh, 2006.
39. Koehn P,. MOSES, statistical machine translation system, user manual and code guide. Edinburgh, Uk, 2010.
40. Bijankhan M,. Naghshe Peykarehaye Zabani dar Neveshtane Dasture Zaban:Mo'arrefiye yek Narmafzare Rayane'i [the Role of Corpus in generating grammar: Presenting a computational software and Corpus]. Iranian Linguistic Journal 2006; 19: 48-67.
41. Tabibzadeh O,. Verb Valency and Basic Sentence Structures in Modern Persian (A Dependency-Based Approach). Nashr-e Markaz Publishing Co.: Tehran, Iran, 2006.
42. Sagot B, Walther G,. A morphological lexicon for the Persian language. Proceedings of the 7th Language Resources and Evaluation Conference (LREC'10), 2010; 300-303.
43. Megerdoomian K,. Finite-state morphological analysis of Persian. Proceedings of the Workshop on Computational Approaches to Arabic Script-based Languages, 2004; 35-41.
44. Nicholls D,. The Cambridge learner corpus-error coding and analysis for lexicography and ELT. Proceedings of the Corpus Linguistics 2003 conference, 2003; 572-581.
45. Damerau F,. A technique for computer detection and correction of spelling errors. Communications of the ACM 1964; 7 (3): 171-176.
46. The international corpus of learner English. http://www.uclouvain.be/en- cecl-icle.html.
47. Izumi E, Uchimoto K, Isahara H,. The NICT JLE Corpus: Exploiting the language learners speech database for research and education. International Journal of the Computer, the Internet and Management 2004; 12 (2): 119-125.
48. Milkowski M,. Automated building of error corpora of Polish. Corpus Linguistics, Computer Tools, and Applications-State of the Art. PALC 2007, 2008; 631-639.
49. Marcus MP, Marcinkiewicz MA, Santorini B,. Building a large annotated corpus of English: The Penn treebank. Computational linguistics 1994; 19: 313-330.
50. Shamsfard M,. Developing FarsNet: A lexical ontology for Persian. Proceedings of the 4th Global WordNet conference (GWC 2008), 2008.