A discriminative candidate generator for string transformations

EMNLP 2008 - 2008 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference: A Meeting of SIGDAT, a Special Interest Group of the ACL

Volumn , Issue , 2008, Pages 447-456

  Okazaki, Naoaki ^a   Tsuruoka, Yoshimasa ^b   Ananiadou, Sophia ^b   Tsujii, Jun'ichi ^a,b  

^a UNIVERSITY OF TOKYO   (Japan)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

REGRESSION ANALYSIS;

DECISION BOUNDARY; DISCRIMINATIVE APPROACH; LEMMATIZATION; LOGISTIC REGRESSION MODELING; NEGATIVE INSTANCES; SPELLING CORRECTION; STRING TRANSFORMATION; SUBSTRING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 79952255652     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1613715.1613772     Document Type: Conference Paper

References (27)

1. George W. Adamson and Jillian Boreham. 1974. The use of an association measure based on character structure to identify semantically related pairs of words and document titles. Information Storage and Retrieval, 10(7-8):253-260.
2. Farooq Ahmad and Grzegorz Kondrak. 2005. Learning a spelling error model from search query logs. In Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing (HLT-EMNLP 2005), pages 955-962.
3. Galen Andrew and Jianfeng Gao. 2007. Scalable training of L1-regularized log-linear models. In Proceedings of the 24th International Conference on Machine Learning (ICML 2007), pages 33-40.
4. Eiji Aramaki, Takeshi Imai, Kengo Miyo, and Kazuhiko Ohe. 2008. Orthographic disambiguation incorporating transliterated probability. In Proceedings of the Third International Joint Conference on Natural Language Processing (IJCNLP 2008), pages 48-55.
5. Adam L. Berger, Vincent J. Della Pietra, and Stephen A. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71.
6. Shane Bergsma and Grzegorz Kondrak. 2007. Alignment-based discriminative string similarity. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL 2007), pages 656-663.
7. Mikhail Bilenko and Raymond J. Mooney. 2003. Adaptive duplicate detection using learnable string similarity measures. In Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining (KDD 2003), pages 39-48.
8. Eric Brill and Robert C. Moore. 2000. An improved error model for noisy channel spelling correction. In Proceedings of the 38th Annual Meeting on the Association for Computational Linguistics (ACL 2000), pages 286-293.
9. Eric Brill. 1995. Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging. Computational Linguistics, 21(4):543-565.
10. Andrew Carlson and Ian Fette. 2007. Memory-based context-sensitive spelling correction at web scale. In Proceedings of the Sixth International Conference on Machine Learning and Applications (ICMLA 2007), pages 166-171.
11. Qing Chen, Mu Li, and Ming Zhou. 2007. Improving query spelling correction using web search results. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL 2007), pages 181-189.
12. Hercules Dalianis and Bart Jongejan. 2006. Handcrafted versus machine-learned inflectional rules: The euroling-siteseeker stemmer and cst's lemmatiser. In In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC 2006), pages 663-666.
13. Okan Kolak and Philip Resnik. 2002. OCR error correction using a noisy channel model. In Proceedings of the second international conference on Human Language Technology Research (HLT 2002), pages 257- 262.
14. Grzegorz Kondrak. 2005. Cognates and word alignment in bitexts. In Proceedings of the Tenth Machine Translation Summit (MT Summit X), pages 305-312.
15. Lillian Lee. 1999. Measures of distributional similarity. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL 1999), pages 25-32.
16. Vladimir I. Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady, 10(8):707-710.
17. Mu Li, Yang Zhang, Muhua Zhu, and Ming Zhou. 2006. Exploring distributional similarity based models for query spelling correction. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics (Coling-ACL 2006), pages 1025-1032.
18. Andrew McCallum, Kedar Bellare, and Fernando Pereira. 2005. A conditional random field for discriminativelytrained finite-state string edit distance. In Proceedings of the 21st Conference on Uncertainty in Artificial Intelligence (UAI 2005), pages 388-395.
19. I. Dan Melamed. 1999. Bitext maps and alignment via pattern recognition. Computational Linguistics, 25(1):107-130.
20. Guido Minnen, John Carroll, and Darren Pearce. 2001. Applied morphological processing of English. Natural Language Engineering, 7(3):207-223.
21. Gonzalo Navarro. 2001. A guided tour to approximate string matching. ACM Computing Surveys (CSUR), 33(1):31-88.
22. Andrew Y. Ng. 2004. Feature selection, L1 vs. L2 regularization, and rotational invariance. In Proceedings of the twenty-first international conference on Machine learning (ICML 2004), pages 78-85.
23. Martin F. Porter. 1980. An algorithm for suffix stripping. Program, 14(3):130-137.
24. Claude E. Shannon. 1948. A mathematical theory of communication. Bell System Technical Journal, 27(3):379-423.
25. Robert Tibshirani. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), 58(1):267-288.
26. Yoshimasa Tsuruoka, John McNaught, and Sophia Ananiadou. 2008. Normalizing biomedical terms by minimizing ambiguity and variability. BMC Bioinformatics, Suppl 3(9):S2.
27. W. John Wilbur, Won Kim, and Natalie Xie. 2006. Spelling correction in the PubMed search engine. Information Retrieval, 9(5):543-564.