Automated grammatical error detection for language learners

Synthesis Lectures on Human Language Technologies

Volumn 3, Issue 1, 2010, Pages 1-134

  Leacock, Claudia ^a   Chodorow, Martin ^b   Gamon, Michael ^c   Tetreault, Joel ^d  

^a Butler Hill Group   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

^c MICROSOFT RESEARCH   (United States)

^d EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Grammatical error detection; Learner corpora; Linguistic annotation; Statistical natural language processing

Indexed keywords

AUTOMATION; DATA MINING; NATURAL LANGUAGE PROCESSING SYSTEMS;

AUTOMATED APPROACH; ENGLISH LANGUAGES; EVALUATION SCHEME; GRAMMATICAL ERROR DETECTIONS; LEARNER CORPORA; LINGUISTIC ANNOTATIONS; STATISTICAL NATURAL LANGUAGE PROCESSING; SYSTEM EVALUATION;

ERROR DETECTION;

EID: 84986314589     PISSN: None     EISSN: 19474040     Source Type: Book Series    
DOI: 10.2200/S00275ED1V01Y201006HLT009     Document Type: Article

References (210)

1. Mohammad Said Al-Zahrani. Knowledge of English lexical collocations among male Saudi college students majoring in English at a Saudi University. PhD thesis, Indiana University of Pennsylvania, Pennsylvania, 1998. 25
2. Md. Jahangir Alam, Naushad UzZaman, and Mumit Khan. N-gram based statistical checker for Bangla and English. In Proceedings of International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh, 2006. 74
3. Itziar Aldabe, Bertol Arrieta, Arantza Díaz de Ilarraza, Montse Maritxalar, Maite Oronoz, Larriatz Uria, and Leire Amoros. Learner and error corpora based computational systems. Corpora and ICT in Language Studies: PALC 2005, 13, 2007. 84
4. Keith Allan. Nouns and countability. Language, 56(3):541-567, September 1980. DOI: 10.2307/414449 23
5. Quentin Grant Allan. The TELEC secondary learner corpus: A resource for teacher development. In S. Granger, J. Hung, and S. Petch-Tyson, editors, Computer Learner Corpora, Second Language Acquisition and Foreign LanguageTeaching, pages 195-211. John Benjamins, Amsterdan, 2002. 31
6. Antti Arppe. Developing a grammar checker for Swedish. In Proceedings of the Twelfth Nordic Conference in Computational Linguistics (NoDaLiDa), pages 13-27,Trondheim, Norway, 2000. 5, 77
7. Yigal Attali. Exploring the feedback and revision features of criterion. In Proceedings of the Annual Meeting of the National Council on Measurement in Education, pages 1-22, San Diego, CA, 2004. 98
8. Eric Steven Atwell. How to detect grammatical errors in a text without parsing it. In Proceedings of the Third Conference of the European Association for Computational Linguistics (EACL), pages 38-45, Copenhagen, 1987. DOI: 10.3115/976858.976865 12
9. Jens Bahns and Moira Eldaw. Should we teach EFL students collocations? System, 21(1):101-114, February 1993. DOI: 10.1016/0346-251X(93)90010-E 25
10. Emily M. Bender, Dan Flickinger, Stephan Oepen, and Timothy Baldwin. Arboretum: Using a precision grammar for grammar checking in CALL. In Proceedings of the Integrating Speech Technology in Learning/Intelligent Computer Assisted Language Learning (inSTIL/ICALL) Symposium: NLP and Speech Technologies in Advanced Language Learning Systems, Venice, 2004. 5, 6, 52, 73
11. Morton Benson, Evelyn Benson, and Robert Ilson. The BBI Dictionary of Combinatory English Words. John Benjamins, Philadelphia, revised edition, 1997. 63
12. Shane Bergsma, Dekang Lin, and Randy Goebel. Web-scale n-gram models for lexical disambiguation. In Proceedings of the 21st International Joint Conference on Artifical Intelligence, pages 1507-1512, Pasadena, 2009. 56, 92, 94
13. Juhani Birn. Detecting grammar errors with Lingsoft's Swedish grammar checker. In Proceedings of theTwelfth Nordic Conference in Computational Linguistics (NoDaLiDa), pages 28-40,Trondheim, Norway, 2000. 77
14. John Bitchener. Evidence in support of corrective feedback. Journal of Second LanguageWriting, 17: 102-118, 2008. DOI: 10.1016/j.jslw.2007.11.004 98
15. John Bitchener, Stuart Young, and Denise Cameron. The effect of different types of corrective feedback on ESL student writing. Journal of Second Language Writing, 14:191-205, 2005. DOI: 10.1016/j.jslw.2005.08.001 20, 97
16. Phil Blunsom andTimothy Baldwin. Multilingual deep lexical acquisition for HPSGs via supertagging. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 164-171, Sydney, July 2006. 5
17. Philip Bolt. An evaluation of grammar-checking programs as self-help learning aids for learners of English as a foreign language. Computer Assisted Language Learning, 5(1):49-91, 1992. DOI: 10.1080/0958822920050106 7
18. Francis Bond, Kentaro Ogura, and Satoru Ikehara. Countability and number in Japanese-to-English machine translation. In Proceedings of the 15th International Conference on Computational Linguistics (COLING), pages 32-38, 1994. DOI: 10.3115/991886.991889 52
19. Thorsten Brants and Alex Franz. Web 1T 5-gram version 1, 2006. Available at http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2006T13. 34
20. Chris Brockett, William B. Dolan, and Michael Gamon. Correcting ESL errors using phrasal SMT techniques. In Proceedings of the 21st International Conference on Computational Linguistics (COLING) and 44th Annual Meeting of the Association for Computational Linguistics (ACL), pages 249-256, Sydney, 2006. DOI: 10.3115/1220175.1220207 34, 95
21. Jill Burstein, Martin Chodorow, and Claudia Leacock. Automated Essay Evaluation: The criterion online writing service. AI Magazine, 25(3):27-36, 2004. 19, 57
22. Miriam Butt, HelgeDyvik,Tracy Holloway King, Hiroshi Masuichi, and Christian Rohrer.The parallel grammar project. In Proceedings of the 19th International Conference on Computational Linguistics (COLING) 2002Workshop onGrammar Engineering and Evaluation, pages 1-7,Taipei,Taiwan, 2002. DOI: 10.3115/1118783.1118786 5
23. Donna K. Byron. The uncommon denominator: A proposal for consistent reporting of pronoun resolution results. Computational Linguistics, 27(4), 2001. 44
24. Chris Callison-Burch. Fast, cheap, and creative: Evaluating translation quality using Amazon's Mechanical Turk. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 286-295, Singapore, August 2009. 87, 90
25. Andrew A. Carlson, Jeffrey Rosen, and Dan Roth. Scaling up context-sensitive text correction. In Proceedings of the 13th Conference on Innovative Applications of Artificial Intelligence, pages 45-50, 2001. 78
26. Mark Catt and Graeme Hirst.AnintelligentCALI system for grammatical error diagnosis. Computer Aided Language Learning, 3:3-26, 1990. DOI: 10.1080/0958822900030102 6, 7
27. Yu-Chia Chang, Jason S. Chang, Hao-Jan Chen, and Hsien-Chin Liou. An automatic collocation writing assistant for Taiwanese EFL learners: A case of corpus-based NLP technology. Computer Assisted Language Learning, 21(3):283-299, 2008. DOI: 10.1080/09588220802090337 70, 96
28. Eugene Charniak. Tree-bank grammars. In Proceedings of the 13th National Conference on Artificial Intelligence, pages 1031-1036, 1996. 5
29. Martin Chodorow and Claudia Leacock. An unsupervised method for detecting grammatical errors. In Proceedings of the Conference of the North American Chapter of the Association of Computational Linguistics (NAACL), pages 140-147, 2000. 86
30. Martin Chodorow, Joel Tetreault, and Na-Rae Han. Detection of grammatical errors involving prepositions. In Proceedings of the Fourth ACL-SIGSEM Workshop on Prepositions, pages 25-30, 2007. 48, 53, 56, 94, 95
31. Martin Chodorow, Michael Gamon, and Joel Tetreault. The utility of grammatical error detection systems for English language learners: Feedback and assessment. Under Submission, 2010. 99
32. Jaeho Choi. The use of feedback in the ESL writing class integrating automated essay scoring. In Proceedings of the Society for Information Technology and Teacher Education International Conference (SITE), pages 3008-3012, San Diego, 2010. 98
33. Noam Chomsky. Remarks on nominalization. InR. A. Jacobs and P.S. Rosenbaum, editors, Readings in EnglishTransformational Grammar, pages 184-221. Ginn and Company,Waltham, MA, 1970. 22
34. Ken Church, Ted Hart, and Jianfeng Gao. Compressing trigram language models with Golomb coding. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 199-207, 2007. 95
35. Kenneth Church and Patrick Hanks.Word association norms,mutual information,and lexicography. Computational Linguistics, 16(1):22-29, 1990. 64, 69
36. Kenneth Church, William Gale, Patrick Hanks, and Donald Hindle. Using statistics in lexical analysis. In Uri Zernik, editor, Lexical Acquisition: Exploiting On-line Resources to Build a Lexicon, pages 115-164. Lawrence Erlbaum, Hillsdale, New Jersey, 1991. 64
37. Jacob Cohen. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1):37-46, 1960. DOI: 10.1177/001316446002000104 43
38. Michael J. Collins. Head-driven Statistical Models for Natural Language Parsing. PhD thesis, University of Pennsylvania, Philadelphia, Pennsylvania, 1999. 51, 56
39. Robert J. Connors and Andrea A. Lunsford. Frequency of formal errors in current college writing, or Ma and Pa Kettle do research. College Composition and Communication, 39(4):395-409, 1988. DOI: 10.2307/357695 15, 17
40. Ann Copestake and Dan Flickinger. An open source grammar development environment and broad coverage English grammar using HPSG. In Proceedings of the Second Conference on Language Resources and Evaluation (LREC), pages 591-600, 2000. 5
41. Anthony Paul Cowie. Multiword units in newspaper language. In S. Granger, editor, Perspectives on the English Lexicon, pages 101-116. Cahiers de l'Institut de Linguistique de Louvain, Louvainla-Neuve, 1991. 24
42. Anthony Paul Cowie. Multi-word lexical units and communicative language teaching. In P.Arnaud and H. Bejoint, editors,Vocabulary and Applied Linguistics, pages 1-12. Macmillan,London, 1992. 24
43. Ido Dagan and Sean Engelson. Committee-based sampling for training probabilistic classifiers. In Proceedings of the Twelfth International Conference on Machine Learning (ICML), pages 150-157, 1995. 86
44. Estelle Dagneaux, Sharon Denness, Sylviane Granger, and Fanny Meunier. Error tagging manual, version 1.1, 1996. 85
45. GerardM. Dalgish. Computer-assisted ESL research and courseware development. Computers and Composition, 2(4):45-61, 1985. 20
46. Rachele De Felice and Stephen G. Pulman. Automatically acquiring models of preposition use. In Proceedings of the Fourth ACL-SIGSEMWorkshop on Prepositions, pages 45-50, Prague, 2007. 54, 56
47. Rachele De Felice and Stephen G. Pulman. A classifier-based approach to preposition and determiner error correction in L2 English. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING), pages 169-176, Manchester, UK, 2008. 37, 48, 49, 51, 53, 54, 56
48. Rachele De Felice and Stephen G. Pulman. Automatic detection of preposition errors in learner writing. CALICO Journal, 26(3):512-528, 2009. 42, 55
49. Arantza Díaz De Ilarraza, Koldo Gojenola, and Maite Oronoz. Detecting erroneous uses of complex postpositions in an agglutinative language. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING), pages 31-34, Manchester, UK, 2008. 54
50. Paul Deane. A nonparametric method for extraction of candidate phrasal terms. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL), pages 605-613, Ann Arbor, MI, 2005. DOI: 10.3115/1219840.1219915 67, 68, 69
51. Nuwar Diab. The transfer of Arabic in the English writings of Lebanese students. The ESPeccialist, 18(1):71-83, 1997. 20
52. Ana Diaz-Negrillo and Jesus Fernández-Dominguez. Error tagging systems for learner corpora. Revista Española de Lingüística Aplicada (RESLA), 19:83-102, 2006. 85
53. Markus Dickinson, Ross Israel, and Sun-Hee Lee. Building a Korean web corpus for analyzing learner language, 2010. 102
54. Luca Dini and Giovanni Malnati. Weak constraints and preference rules. In P. Bennett and P.Paggio, editors, Preference in Eurotra, pages 75-90. Commission of the European Communities, Luxembourg, 1993. 6
55. William B. Dolan, Stephen D. Richardson, and Lucy Vanderwende. Automatically deriving structured knowledge bases from on-line dictionaries. Technical Report MSR-TR-93-07, Microsoft Research,May 1993. 8
56. Richard Domeji, Ola Knutsson, Johan Carlberger, and Viggo Kann. Granska - an efficient hybrid system for Swedish grammar checking. In Proceedings of the Twelfth Nordic Conference in Computational Linguistics (NoDaLiDa), pages 49-56,Trondheim, Norway, 2000. 77
57. Steven Donahue. Formal errors: Mainstream and ESL students. Presented at the 2001 Conference of the Two-Year College Association (TYCA), 2001. 15
58. Shona Douglas and Robert Dale. Towards robust PATR. In Proceedings of the 15th International Conference on Computational Linguistics (COLING), pages 468-474, Nantes, France, 1992. DOI: 10.3115/992133.992143 6
59. Ted Dunning. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74, 1993. 64, 66
60. Benjamin Van Durme and Ashwin Lall. Probabilistic counting with randomized storage. In Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence (IJCAI, pages 1574-1579, Pasadena, 2009. 95
61. Jens Eeg-Olofsson and Ola Knuttson. Automatic grammar checking for second language learners - the use of prepositions. In Proceedings of the 14th Nordic Conference in Computational Linguistics (NoDaLiDa), 2003. 54, 55
62. Rob Ellis, Younghee Sheen, Mihoko Murakami, and Hide Takashima. The effects of focused and unfocused written corrective feedback in an English as a Foreign Language context. System, 36: 353-371, 2008. DOI: 10.1016/j.system.2008.02.001 98
63. Sean Engelson and Ido Dagan. Minimizing manual annotation cost in supervised training from corpora. In Proceedings of the 34th Meeting of the Association for Computational Linguistics (ACL), pages 319-326, 1996. DOI: 10.3115/981863.981905 86
64. Stefan Evert. The Statistics of Word Cooccurrences: Word Pairs and Collocations. PhD thesis, Institut für maschinelle Sprachverarbeitung, University of Stuttgart, Stuttgart, 2004. 64, 67
65. Stefan Evert and Brigitte Krenn. Methods for the qualitative evaluation of lexical association measures. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (ACL), pages 188-195,Toulouse, 2001. DOI: 10.3115/1073012.1073037 67
66. Stefan Evert and Brigitte Krenn. Using small random samples for the manual evaluation of statistical association measures. Computer Speech and Language, 19(4):450-466, 2005. DOI: 10.1016/j.csl.2005.02.005 67
67. Daniel Fallman. The penguin: Using the web as a database for descriptive and dynamic grammar and spell checking. In Proceedings of the Conference on Human Factors in Computing Systems (CHI), pages 616-617, Minneapolis, Minnesota, 2002. 92
68. Mohammed Farghal and Hussein Obiedat. Collocations: A neglected variable in EFL. International Review of Applied Linguistics in Language Teaching, 33(4):315-331, 1995. DOI: 10.1515/iral.1995.33.4.315 25
69. John R. Firth. Modes of Meaning. Oxford University Press, Oxford, 1957. 63
70. Joseph Fleiss. Statistical Methods for Rates and Proportions. John Wiley, New York, second edition, 1981. 44
71. Gerhard Fliedner.Asystem for checkingNPagreement in German texts. In Proceedings of the Student ResearchWorkshop at the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 12-17, Philadelphia, 2002. 77
72. Jennifer Foster and Øistein Andersen. GenERRate: Generating errors for use in grammatical error detection. In Proceedings of the Fourth Workshop on Building Educational Applications Using NLP (BEA) at, pages 82-90, 2009. 33
73. Frederik Fouvry. Constraint relaxation with weighted feature structures. In Proceedings of the Eighth InternationalWorkshop on Parsing Technologies (IWPT-03), Nancy, France, 2003. 6
74. Annette Frank, Tracy Holloway King, Jonas Kuhn, and John Maxwell. Optimality theory style constraint ranking in large scale LFG grammars. In Proceedings of the Lexical Functional Grammar Conference (LFG) LFG-98, Brisbane, 1998. 5
75. Ian S. Fraser and Lynda M. Hodson. Twenty-one kicks at the grammar horse. English Journal, 67 (9):49-54, December 1978. DOI: 10.2307/815131 1
76. Yoav Freund and Robert E. Schapire. Large margin classification using the perceptron algorithm. Machine Learning, 37:277-296, 1999. DOI: 10.1023/A:1007662407062 54
77. Yoko Futagi, Paul Deane, Martin Chodorow, and Joel Tetreault. A computational approach to detecting collocation errors in the writing of non-native speakers of English. Computer Assisted Language Learning, 21:353-367, 2008. DOI: 10.1080/09588220802343561 25, 69
78. William Gale, Ken Church, and David Yarowsky. Work on statistical methods for word sense disambiguation. In Proceedings of the AAAI Fall Symposium on Probabilistic Approaches to Natural Language, pages 54-60, Cambridge, MA, 1992. 11
79. Michael Gamon. Using mostly native data to correct errors in learners' writing. In Proceedings of the Eleventh Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Los Angeles, 2010. 27, 42, 43, 49, 53, 54, 55, 57, 58
80. Michael Gamon, Carmen Lozano, Jessie Pinkham, and Tom Reutter. Practical experience with grammar sharing in multilingual NLP. Technical Report MSR-TR-93-16, Microsoft Research, 1997. 8
81. Michael Gamon, Jianfeng Gao, Chris Brockett, Alex Klementiev,William B. Dolan, Dmitriy Belenko, and Lucy Vanderwende. Using contextual speller techniques and language modeling for ESL error correction. In Proceedings of the International Joint Conference on Natural Language Processing (IJCNLP), pages 449-456, Hyderabad, India, 2008. 37, 39, 40, 41, 48, 49, 51, 53, 54, 56, 57, 83
82. Michael Gamon, Claudia Leacock, Chris Brockett,William B. Dolan, Jianfeng Gao, Dmitriy Belenko, and Alexandre Klementiev. Using statistical techniques and web search to correct ESL errors. CALICO Journal, 26(3), 2009. 12, 75, 76
83. Barbara Gawronska-Werngren. "Translation great problem" - on the problem of inserting articles when translating from Russian into Swedish. In Proceedings of the 13th International Conference on Computational Linguistics (COLING), pages 133-138, 1990. DOI: 10.3115/997939.997962 52
84. Mandeep Singh Gill and Gurpreet Singh Lehal. A grammar checking system for Punjabi. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING), pages 149-152, 2008. 77
85. Andrew Golding. A Bayesian hybrid method for context sensitive spelling correction. In Proceedings of the ThirdWorkshop on Very Large Corpora (WVLC-3), pages 39-53, 1995. 11, 78
86. Andrew Golding and Dan Roth. Applying Winnow to context-sensitive spelling correction. In Proceedings of the International Conference on Machine Learning (ICML), pages 182-190, 1996. 11, 78
87. David Graff and Christopher Cieri. English Gigaword, 2003. Available at http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2003T05. 34
88. Sylviane Granger.The International Corpus of Learner English:Anewresource for foreigh language learning and teaching and second language acquisition research. TESOL Quarterly, 37(3):538-546, 2003. DOI: 10.2307/3588404 84
89. Sylviane Granger, Estelle Dagneaux,and Fanny Meunier.The International Corpus of Learner English: Handbook and CD-ROM. Presses Universitaires de Louvain, Louvain-la-Neuve, 2002b. 29, 85
90. Yan Guo and Gulbahar H. Beckett. The hegemony of English as a global language: Reclaiming local knowledge and culture in China, 2007. 2
91. Kirl L. Hagen. Unification-based parsing applications for intelligent foreign language tutoring systems. Calico Journal, 2(2):2-8, 1995. 6
92. Na-Rae Han, Martin Chodorow, and Claudia Leacock. Detecting errors in English article usage with a maximum entropy classifier trained on a large, diverse corpus. In Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC), pages 1625-1628, Lisbon, Portugal, 2004. 53
93. Na-Rae Han, Martin Chodorow, and Claudia Leacock. Detecting errors in English article usage by non-native speakers. Natural Language Engineering, 12(2):115-129, 2006. DOI: 10.1017/S1351324906004190 42, 49, 50, 53
94. Na-Rae Han, Joel Tetreault, Soo-Hwa Lee, and Jin-Young Ha. Using error-annotated ESL data to develop an ESL error correction system. In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC), Malta, 2010. 27, 34, 42, 54, 55, 57
95. George E. Heidorn. Intelligent writing assistance. In R. Dale, H. Moisl, and H. Somers, editors, Handbook of Natural Language Processing, pages 181-207. Marcel Dekker, New York, 2000. 8, 73
96. George E. Heidorn. Augmented phrase structure grammars. In B.L. Webber and R. Schank, editors,Theoretical Issues inNatural Language Processing, pages 1-5. Association for Computational Linguistics, 1975. DOI: 10.3115/980190.980197 8
97. George E. Heidorn, Karen Jensen, Lance A. Miller, Roy J. Byrd, and Martin Chodorow. The epistle text-critiquing system. IBM Systems Journal, 21(3):305-326, 1982. 5, 6, 8
98. Trude Heift and Mathias Schulze. Errors and Intelligence in Computer-Assissted Language Learning: Parsers and Pedagogues. Routledge, New York and London, 2007. 1, 3, 7, 78
99. Julia E. Heine. Definiteness predictions for Japanese noun phrases. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics (ACL) and 17th International Conference on Computational Linguistics (COLING), pages 519-525, Montreal, 1998. DOI: 10.3115/980845.980932 52
100. Johannes Heinecke, Jurgen Kunze,Wolfgang Menzel, and Idno Schroder. Eliminative parsing with graded constraints. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics (ACL) and 17th International Conference on Computational Linguistics (COLING), pages 243-259, 1998. DOI: 10.3115/980451.980933 6
101. Antje Helfrich and Bradley Music. Design and evaluation of grammar checkers in multiple languages. In Proceedings of the 18th International Conference on Computational Linguistics (COLING), pages 1036-1040, 2000. DOI: 10.3115/992730.992800 9
102. Matthieu Hermet and Alain Désilets. Using first and second language models to correct preposition errors in second language authoring. In Proceedings of the FourthWorkshop on Building Educational Applications Using NLP (BEA), pages 64-72, 2009. 54, 95, 96, 102
103. Matthieu Hermet, Alain Désilets, and Stan Szpakowicz. Using the web as a linguistic resource to automatically correct lexico-syntactic errors. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC), pages 390-396, Marrekech, Morocco, 2008. 54, 55, 92, 93, 94, 95
104. Jimmie Hill. Teaching Collocation, chapter Revising Priorities: From Grammatical Failure to Collocational Success, pages 47-70. Language Teaching Publications, London, 2000. 25
105. Graeme Hirst and Alexander Budanitsky. Correcting real-world spelling errors by restoring lexical cohesion. Natural Language Engineering, 11(1):87-111, March 2005. DOI: 10.1017/S1351324904003560 78
106. Peter Howarth. The phraseology of learners' academic writing. In A.P. Cowie, editor, Phraseology: Theory, Analysis, and Application, pages 161-186. Clarendon Press, Oxford, 1998. 24
107. Jeng-Yih Hsu. Lexical collocations and their impact on the online writing of Taiwanese college English majors and non-English major. Electronic Journal of Foreign Language Teaching, 4(2): 192-209, 2007. 25
108. Diana Zaiu Inkpen and Graeme Hirst. Acquiring collocations for lexical choice between near-synonyms. In Unsupervised Lexical Acquisition: Proceedings of the Workshop of the ACL Special Interest Group on the Lexicon (SIGLEX), pages 67-76, Philadelphia, 2002. DOI: 10.3115/1118627.1118636 67
109. Aminul Islam and Diane Inkpen. Real-word spelling correction using Google Web 1T 3-grams. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1241-1249, Singapore, 2009. 78
110. Emi Izumi, Kiyotaka Uchimoto,Toyomi Saiga, Thepchai Supnithi, and Hitoshi Isahara. Automatic error detection in the Japanese learners' English spoken data. In Companion Volume to the Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL), pages 145-148, 2003. DOI: 10.3115/1075178.1075202 20, 48, 53
111. Emi Izumi, Kiyotaka Uchimoto, and Hitoshi Isahara. The overview of the SST speech corpus of Japanese Learner English and evaluation through the experiment on automatic detection of learners' errors. In Proceedings of Language Resource and Evaluation Conference (LREC) 2004, pages 1435-1438, Lisbon, Portugal, 2004a. 42
112. Emi Izumi, Kiyotaka Uchimoto, and Hitoshi Isahara. The NICT JLE Corpus: Exploiting the language learners' speech database for research and education. International Journal of the Computer, the Internet and Management, 12(2):119-125, 2004b. 30
113. Emi Izumi, Kiyotaka Uchimoto, and Hitoshi Isahara. SST speech corpus of Japanese learners' English and automatic detection of learners' errors. International Computer Archive of Modern English Journal, 28:31-48, 2004c. 30, 48, 49, 53, 57
114. Karen Jensen, George E. Heidorn, Lance A. Miller, and Yael Ravin. Parse fitting and prose fixing: Getting a hold on ill-formedness. American Journal of Computational Linguistics, 9(3-4):147-160, 1983. 7, 8
115. Karen Jensen, George E. Heidorn, and Stephen D. Richardson. Natural Language Processing: The PLNLP Approach. Kluwer, Dordrecht, 1993. 8
116. Jia-Yan Jian, Yu-Chia Chang, and Jason S. Chang. Collocational translation memory extraction based on statistical and linguistic information. Presented at ROCLING 2004, Conference on Computational Linguistics and Speech Processing, 2004. 70
117. Janne Bondi Johannessen, Kristin Hagen, and Pia Lane. The performance of a grammar checker with deviant language input. In Proceedings of the 19th International Conference on Computational Linguistics (COLING), pages 1-8,Taipei,Taiwan, 2002. DOI: 10.3115/1071884.1071894 5
118. Daniel Jurafsky and James H. Martin. Speech and Language Processing. Prentice Hall, 2 edition, 2008. 3
119. John S. Justeson and Slava M. Katz. Technical terminology: Some linguistic properties and an algorithm for identification in text. Natural Language Engineering, 1(1):9-27, 1995. DOI: 10.1017/S1351324900000048 64
120. FredKarlsson, Atro Voutilainen, Juha Heikkila, and Arto Anttila. ConstraintGrammar: A Language-Independent System for Parsing UnrestrictedText. Mouton de Gruyter, Berlin and New York, 1995. 5, 6, 53
121. Adam Kilgarriff. Googleology is bad science. Computational Linguistics, 33(1):147-151, 2007. DOI: 10.1162/coli.2007.33.1.147 93
122. Kevin Knight and Ishwar Chander. Automated postediting of documents. In Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI), pages 779-784, Seattle, 1994. 12, 50, 52
123. Brigitte Krenn and Stefan Evert. Can we do better than frequency? A case study on extracting PP-verb collocations. In Proceedings of the Workshop on Collocations at the 50th Annual Meeting of the Association for Computational Linguistics (ACL), pages 36-46,Toulouse, 2001. 67
124. Karen Kukich. Techniques for automatically correcting words in text. Computing Surveys, 24(4): 377-439, 1992. DOI: 10.1145/146370.146380 78
125. Stan C. Kwasny and Norman K. Sondheimer. Relaxation theories for parsing ill-formed input. American Journal of Computational Linguistics, 7:99-108, 1981. 6
126. Richard J. Landis and Gary G. Koch. The measurement of observer agreement for categorical data. Biometrics, 33:159-174, 1977. DOI: 10.2307/2529310 44
127. Claudia Leacock and Martin Chodorow. Automated grammatical error detection. In M.D. Shermis and J.C. Burstein, editors, Automated Essay Scoring: A Cross-Disciplinary Perspective, pages 195-207. Lawrence Erlbaum Associates, Mahwah, NJ, 2003. 17, 19, 75
128. Claudia Leacock, GeoffreyTowell, and Ellen M.Voorhees. Corpus-based statistical sense resolution. In Proceedings of the ARPA Human Language TechnologyWorkshop, pages 260-265, San Francisco, 1993. DOI: 10.3115/1075671.1075730 57
129. Claudia Leacock, Michael Gamon, and Chris Brockett. User input and interactions on Microsoft Research ESL Assistant. In Proceedings of the FourthWorkshop on Building Educational Applications Using NLP (BEA), pages 73-81, 2009. 99
130. Chong Min Lee, Soojeong Eom, and Markus Dickinson. Towards analyzing Korean learner particles. In Proceedings of theWorkshop on Automatic Analysis of Learner Language (AALL) at CALICO 2009,Tempe, AZ, 2009a. 77
131. John Lee. Automatic article restoration. In Proceedings of theHuman LanguageTechnology Conference of the North American Chapter of the Association for Computational Linguistics (HLT), pages 31-36, Boston, 2004. 50, 52, 57
132. John Lee and Stephanie Seneff. Automatic grammar correction for second-language learners. In Proceedings of the Ninth International Conference on Spoken Language Processing (Interspeech), pages 1978-1981, 2006. 48, 51, 53, 56, 57
133. John Lee and Stephanie Seneff. Correcting misuse of verb forms. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technology (ACL/HLT), pages 174-182, 2008. 33, 42, 43, 77, 78
134. John Lee, Ming Zhou, and Xiaohua Lin. Detection of non-native sentences using machinetranslated training data. In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), pages 93-97, 2007. 74
135. John Lee, Joel Tetreault, and Martin Chodorow. Human evaluation of article and noun number usage: Influences of context and construction variability. In Proceedings of the Third Linguistic AnnotationWorkshop (LAW), pages 60-63, Suntec, Singapore, 2009b. 81
136. Beth Levin. English Verb Classes and Alternations: A Preliminary Investigation. University of Chicago Press, Chicago, 1993. 22
137. Dekang Lin. An information-theoretic definition of similarity. In In Proceedings of the 15th International Conference on Machine Learning(ICML-98), pages 296-304, Madison,Wisconsin, 1998. 68
138. Dekang Lin. Automatic identification of non-compositional phrases. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL), pages 317-324, 1999. DOI: 10.3115/1034678.1034730 68
139. Anastasiya A. Lipnevich and Jeffrey K. Smith. Response to assessment feedback: The effects of differential feedback on students' performance. Technical report, Educational Testing Service, 2008. 98
140. Ann Li-E Liu. A corpus-based lexical semantic investigation of verb-noun miscollocations in Taiwan learners English. Master's thesis,Tamkang University,Taipei, 2002. 25, 70
141. Ann Li-E Liu, David Wible, and Nai-Lung Tsao. Automated suggestions for miscollocations. In Proceedings of the ACL Fourth Workshop on Innovative Use of NLP for Building Educational Applications (BEA), pages 47-50, Boulder, Colorado, June 2009. 70
142. Nina H. MacDonald, Lawrence T. Frase, Patricia S. Gingrich, and Stacey A. Keenan. The Writer's Workbench: Computer aids for text analysis. IEEETransactions on Communications, 30(1), 1982. DOI: 10.1080/00461528209529254 5
143. David M. Magerman. Statistical decision-tree models for parsing. In Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics (ACL), pages 276-283, 1995. DOI: 10.3115/981658.981695 5
144. ChristopherD.Manning and Hinrich Schütze.Foundations of StatisticalNatural LanguageProcessing. MIT Press, 1999. 3, 64, 66, 67
145. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19:313-330, 1993. 5
146. Chris S. Mellish. Some chart-based techniques for parsing ill-formed input. In Proceedings of the 27th Annual Meeting of the Association for Computational Linguistics (ACL), pages 102-109, 1989. DOI: 10.3115/981623.981636 7
147. Wolfgang Menzel. Error diagnosing and selection in a training system for second language learning. In Proceedings of the 13th International Conference on Computational Linguistics (COLING), pages 422-424, Helsinki, 1990. DOI: 10.3115/991146.991238 6
148. George A. Miller. WordNet: A lexical database for English. Communications of the ACM, 38(11): 39-41, 1995. DOI: 10.1145/219717.219748 52
149. Guido Minnen, Francis Bond, and Ann Copestake. Memory-based learning for article generation. In Proceedings of the Conference on Natural Language Learning (CoNLL), pages 43-48, 2000. DOI: 10.3115/1117601.1117611 50, 52
150. Tom M. Mitchell. Machine Learning. McGraw-Hill, 1997. 3
151. Masaki Murata and Makoto Nagao. Determination of referential property and number of nouns in Japanese sentences for machine translation into English. In Proceedings of the Fifth International Conference on Theoretical and Methodological Issues in Machine Translation, pages 218-225, Kyoto, Japan, 1993. 52
152. Ryo Nagata,Tatsuya Iguchi, KentaWakidera, Fumito Masui, and Atsuo Kawai. Recognizing article errors in the writing of Japanese learners of English. Systems and Computers in Japan, 36(7):60-68, 2005a. DOI: 10.1002/scj.v36:7 52
153. Ryo Nagata,Tatsuya Iguchi, Fumito Masui, Atsuo Kawai, and Naoki Isu. A statistical model based on the three head words for detecting article errors. The Institute of Electronics, Information and Communication Engineers (IEICE)Transactions on Information and Systems, E88-D(7):1700-1706, 2005b. DOI: 10.1093/ietisy/e88-d.7.1700 52
154. Ryo Nagata, Atsuo Kawai, Koichiro Morihiro, and Naoki Isu. A feedback-augmented method for detecting errors in the writing of learners of English. In Proceedings of the 21st International Conference of Computational Linguistics (COLING) and 44th Annual Meeting of the Association for Computational Linguistics (ACL), pages 241-248, 2006a. DOI: 10.3115/1220175.1220206 52
155. Ryo Nagata, Tatsuya Iguchi, Kenta Wakidera, Fumito Masui, Atsuo Kawai, and Naoki Isu. Recognizing article errors using prepositional information. Systems and Computers in Japan, 37(12): 873-881, 2006b. DOI: 10.1002/scj.v37:12 51, 52
156. Ryo Nagata, Atsuo Kawai, Koichiro Morihori, and Naoki Isu. Reinforcing English countability prediction with one countability per discourse property. In Proceedings of the 21st International Conference of Computational Linguistics (COLING) and 44th Annual Meeting of the Association for Computational Linguistics (ACL), volume 595-602, 2006c. 52
157. John Nerbonne. Computer-Assisted Language Learning and natural Language Processing. In R. Mitkov, editor, The Oxford Handbook of Computational Linguistics, pages 670-698. The Oxford University Press, 2003. 3
158. Nadja Nesselhauf. The use of collocations by advanced learners of English and some implications for teaching. Applied Linguistics, 24:223-242, 2003. DOI: 10.1093/applin/24.2.223 25
159. Diane Nicholls. Error coding and analysis for lexicography and ELT. In Proceedings of the Corpus Linguistics 2003 Conference, pages 572-581, Lancaster, United Kingdom, 2003. 84
160. Diane Nicholls. The Cambridge Learner Corpus-error coding and analysis for writing dictionaries and other books for English learners. Presented at the SummerWorkshop on Learner Corpora, Showa Woman's University, 1999. 17
161. Nazlia Omar,Nur Asma Mohd Razali, and Saadiyah Darus. Automated essay marking tool for ESL writing based on heuristics. In Proceedings of the International Conference of Education, Research and Innovation (ICERI), Madrid, 2008. 77
162. Robert Östling andOla Knutsson.Acorpus-based tool for helpingwriters with Swedish collocations. In Proceedings of the Workshop on Extracting and Using Constructions in NLP, Odense, Denmark, 2009. 70, 77
163. Pavel Pecina. An extensive empirical study of collocation extraction methods. In Proceedings of the Student ResearchWorkshop at the 43rdAnnual Meeting of theAssociation for Computational Linguistics (ACL), pages 13-18, Ann Arbor, 2005. DOI: 10.3115/1628960.1628964 64, 67
164. Ted Pedersen. Fishing for exactness. In Proceedings of the South-Central SAS Users Group Conference (SCSUG), pages 188-200, Austin,TX, 1996. 66
165. Steven Pinker. The Language Instinct: The New Science of Language and Mind. Penguin Books, New York, 1994. 20, 21
166. John Ross Quinlan. Induction of decision trees. Machine Learning, 1(1):81-106, 1986. DOI: 10.1007/BF00116251 47
167. Chris Quirk and Arul Menezes. Dependency treelet translation: The convergence of statistical and example-based machine translation? Machine Translation, 20(1):43-65, 2006. DOI: 10.1007/s10590-006-9008-4 8
168. Randolph Quirk, Sidney Greenbaum, Geoffrey Leech, and Jan Svartvik. A Comprehensive Grammar of the English Language. Longman Group, New York, 1985. 24
169. Adwait Ratnaparkhi. Maximum Entropy Models for natural language ambiguity resolution. PhD thesis, University of Pennsylvania, 1998. 47
170. Yael Ravin. Disambiguating and interpreting verb definitions. In Proceedings of the 28th Annual Meeting of the Association for Computational Linguistics (ACL), pages 260-267, 1990. DOI: 10.3115/981823.981856 23
171. Veit Reuer. Error recognition and feedback with lexical functional grammar. CALICO Journal, 20 (3):497-512, 2003. 5
172. Stephen Richardson and Lisa Braden-Harder. The experience of developing a large-scale natural language processing system: Critique. In Proceedings of the Second Conference on Applied NLP, pages 195-202, 1988. DOI: 10.3115/974235.974271 5
173. Anne Rimrott and Trude Heift. Language learners and generic spell checkers in CALL. CALICO, 23(1):17-48, 2005. 79
174. Alla Rozovskaya and Dan Roth. Annotating ESL errors: Challenges and rewards. In Proceedings of the HLT-NAACL Fifth Workshop on Building Educational Applications Using NLP, Los Angeles, 2010. 84
175. David Schneider and Kathleen McCoy. Recognizing syntactic errors in the writing of second language learners. In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics (ACL) and the 17th International Conference on Computational Linguistics (COLING), pages 1198-1204, Montreal, 1998. DOI: 10.3115/980432.980765 6
176. Ethel Schuster. The role of native grammars in correcting errors in second language learning. Computational Intelligence, 2:93-98, 1986. DOI: 10.1111/j.1467-8640.1986.tb00074.x 7
177. Camilla B. Schwind. Sensitive parsing: Error analysis and explanation in an intelligent language tutoring system. In Proceedings of theTwelfth International Conference on Computational Linguistics (COLING), pages 608-618, 1988. DOI: 10.3115/991719.991763 7
178. Camilla B. Schwind. Feature grammars for semantic analysis. Computer Intelligence, 6:172-178, 1990a. DOI: 10.1111/j.1467-8640.1990.tb00132.x 6
179. Camilla B. Schwind. An intelligent language tutoring system. Journal of Man-Mchine Studies, 33: 557-579, 1990b. DOI: 10.1016/S0020-7373(05)80053-7 7
180. Camilla B. Schwind. Error analysis and explanation in knowledge language tutoring. Computer Assisted Language Learning, 8(4):295-324, 1995. DOI: 10.1080/0958822950080402 6
181. Younghee Sheen. The effect of focused written corrective feedback and language aptitude on ESL learners' acquisition of articles. TESOL Quarterly, 41:255-283, 2007. DOI: 10.2307/40264353 98
182. Chi-Chiang Shei and Helen Pain. An ESL writer's collocational aid. Computer Assisted Language Learning, 13(2):167-182, 2000. DOI: 10.1076/0958-8221(200004)13:2;1-D;FT167 69
183. Victor Sheng, Foster Provost, and Panagiotis Ipeirotis. Get another label? Improving data quality and data mining using multiple, noisy labelers. In Proceeding of the ACM Special Interest Group on Knowledge Discovery and Data Mining (ACM-SIGKDD), Las Vegas, Nevada, 2008. DOI: 10.1145/1401890.1401965 87
184. Sayori Shimohata, Toshiyuki Sugio, and Junji Nagata. Retrieving collocations by co-occurrences and word order constraints. In Proceedings of the Eighth Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 476-481, Madrid, 1997. DOI: 10.3115/979617.979678 64
185. Jonas Sjöbergh and Ola Knutsson. Faking errors to avoid making errors: Very weakly supervised learning for error detection in writing. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP), pages 506-512, Borovets, Bulgaria, 2005. 33
186. Rion Snow, Brendan O'Connor, Daniel Jurafsky, and Andrew Ng. Cheap and fast-but is it good? Evaluating non-expert annotations for natural language tasks. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 254-263, Honolulu, Hawaii, 2008. 87, 90
187. Guihua Sun, Xiaohua Liu, Gao Cong, Ming Zhou, Zhongyang Xiong, John Lee, and Chin-Yew Lin. Detecting erroneous sentences using automatically mined sequential patterns. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, pages 81-88, 2007. 73
188. Michael Swan and Bernard Smith, editors. Learner English: A teacher's guide to interference and other problems. Cambridge University Press, 2 edition, 2001. DOI: 10.1017/CBO9780511667121 19, 23, 91
189. David Talbot. Succinct approximate counting of skewed data. In Proceedings of the 21st International Joint Conference on Artificial INtelligence (IJCAI), pages 1243-1248, Pasadena, 2009. 95
190. David Talbot and Miles Osborne. Randomised language modelling for statistical machine translation. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics (ACL), pages 512-519, Prague, 2007a. 95
191. David Talbot and Miles Osborne. Smoothed Bloom filter language models: Tera-scale LMs on the cheap. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 468-476, Prague, 2007b. 95
192. Joel Tetreault and Martin Chodorow. The ups and downs of preposition error detection in ESL writing. InProceedings of the 22nd International Conference on Computational Linguistics (COLING), pages 865-872, 2008a. 37, 53, 54, 55
193. Joel Tetreault and Martin Chodorow. Native Judgments of non-native usage: Experiments in preposition error detection. In Proceedings of the Workshop on Human Judgments in Computational Linguistics at the 22nd International Conference on Computational Linguistics (COLING), pages 24-32, 2008b. 39, 40, 42, 43, 56, 81, 84, 85, 86
194. Joel Tetreault and Martin Chodorow. Examining the use of region web counts for ESL error detection. In Proceedings of theWeb as CorpusWorkshop (WAC-5), San Sebastian, Spain, 2009. 53, 54, 55, 93, 96, 97, 102
195. Joel Tetreault, Elena Filatova, and Martin Chodorow. Rethinking grammatical error annotation and evaluation with the Amazon Mechanical Turk. Submitted, 2010. 87
196. John Truscott. The case against grammar correction in L2 writing classes. Language Learning, 46: 327-369, 1996. DOI: 10.1111/j.1467-1770.1996.tb01238.x 97
197. Jenine Turner and Eugene Charniak. Language modeling for determiner selection. In Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume, pages 177-180, Rochester,NY, 2007. 51, 53, 57
198. Larraitz Uria, Bertol Arrieta, Arantza Díaz de Ilarraza, Montse Maritxalar, and Maite Oronoz. Determiner errors in Basque: Analysis and automatic detection. Procesamiento del Lenguaje Natural, pages 41-48, 2009. 53, 77
199. Vladimir N. Vapnik. The Nature of Statistical Learning Theory. Springer, 1995. 47
200. Carl Vogel and Robin Cooper. Robust chart parsing with mildly inconsistent feature structures. In A. Schöter and C.Vogel, editors,Nonclassical Feature Systems, pages 197-216. Centre for Cognitive Science, University of Edinburgh,Working Papers in Cognitive Science, 1995. Volume 10. 6
201. Joachim Wagner, Jennifer Foster, and Josef van Genabith. A comparative evaluation of deep and shallow approaches to the automatic detection of common grammatical errors. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP and CONLL), pages 112-121, 2007. 34
202. Joachim Wagner, Jennifer Foster, and Josef van Genabith. Judging grammaticality: Experiments in sentence classification. CALICO Journal, 26(3):474-490, 2009. 34
203. Ralph Weischedel, Wilfried M. Voge, and Mark James. An artificial intelligence approach to language instruction. Artificial Intelligence, 10:225-240, 1978. DOI: 10.1016/S0004-3702(78)80015-0 7
204. Casey Whitelaw, Ben Hutchinson, Grace Y. Chung, and Ged Ellis. Using the Web for language independent spellchecking and autocorrection. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 890-899, Singapore, 2009. 79
205. David Wible, Chin-Hwa Kwo, Nai-Lung Tsao, Anne Liu, and Hsiu-Ling Lin. Bootstrapping in a language learning environment. Journal of Computer Assisted Learning, 19(4):90-102, 2003. DOI: 10.1046/j.0266-4909.2002.00009.x 25, 69
206. David Wible, Chin-Hwa Kuo, Meng-Chang Chen,Nai-Lung Tsao, and Tsung-Fu Hung. A computational approach to the discovery and representation of lexical chunks. In Proceedings of the 13th Conference Sur Le Traitement Automatique des Langues Naturelles (TALN), pages 868-875, Leuven, 2006. 68
207. Alison Wray. Formulaic sequences in second language teaching. Applied Linguistics, 21(4), 2000. DOI: 10.1093/applin/21.4.463 24
208. David Yarowsky. Decision lists for lexical ambiguity resolution: Application to accent restoration in Spanish and French. In Proceedings of the 32nd Annual Meeting of the Association for Computational Linguistics (ACL), pages 88-95, Las Cruces, NM, 1994. DOI: 10.3115/981732.981745 11
209. Xing Yi, Jianfeng Gao, andWilliam B. Dolan. A web-based English proofing system for English as a second language users. In Proceedings of the International Joint Conference on Natural Language Processing (IJCNLP), pages 619-624, Hyderabad, India, 2008. 49, 54, 92
210. Alan X. Zhang. English collocations and their effect on the writing of native and non-native College Freshmen. PhD thesis, Indiana University of Pennsylvania, Pennsylvania, 1993. 25