Stochastic contextual edit distance and probabilistic FSTs

52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014 - Proceedings of the Conference

Volumn 2, Issue , 2014, Pages 625-630

  Cotterell, Ryan ^a   Peng, Nanyun ^a   Eisner, Jason ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; PROBABILITY DISTRIBUTIONS;

CONTEXTUAL FEATURE; EDIT DISTANCE; FINITE STATE TRANSDUCERS; SOCIAL MEDIA; STRING SIMILARITY;

STOCHASTIC SYSTEMS;

EID: 84906923502     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/p14-2102     Document Type: Conference Paper

References (25)

1. Cyril Allauzen, Michael Riley, Johan Schalkwyk, Wojciech Skut, and Mehryar Mohri. 2007. OpenFst: A general and efficient weighted finite-state transducer library. In Implementation and Application of Automata, pages 11-23. Springer.
2. Nicholas Andrews, Jason Eisner, and Mark Dredze. 2014. Robust entity clustering via phylogenetic inference. In Proceedings of ACL.
3. Eiji Aramaki. 2010. Typo corpus. Available at http://luululu.com/tweet/ #cr, January.
4. Taylor Berg-Kirkpatrick, Alexandre Bouchard-Côté, John DeNero, and Dan Klein. 2010. Painless unsupervised learning with features. In Proceedings of HLT-NAACL, pages 582-590.
5. Alexandre Bouchard-Côté, Percy Liang, Thomas L. Griffiths, and Dan Klein. 2007. A probabilistic approach to language change. In NIPS.
6. Colin Cherry and Dekang Lin. 2003. A probability model to improve word alignment. In Proceedings of ACL, pages 88-95.
7. Zhiyi Chi and Stuart Geman. 1998. Estimation of probabilistic context-free grammars. Computational Linguistics, 24(2):299-305.
8. Kenneth W. Church and William A. Gale. 1991. Probability scoring for spelling correction. Statistics and Computing, 1(2):93-103.
9. Ryan Cotterell and Adithya Renduchintala. 2014. brezel: A library for training FSTs. Technical report, Johns Hopkins University.
10. Markus Dreyer, Jason R. Smith, and Jason Eisner. 2008. Latent-variable modeling of string transductions with finite-state methods. In Proceedings of EMNLP, EMNLP '08, pages 1080-1089.
11. Chris Dyer, Victor Chahuneau, and Noah A. Smith. 2013. A simple, fast, and effective reparameterization of IBM Model 2. In Proceedings of NAACLHLT, pages 644-648.
12. Jason Eisner. 2001. Expectation semirings: Flexible EM for learning finite-state transducers. In Proceedings of the ESSLLI Workshop on Finite-State Methods in NLP.
13. Dale Gerdemann and Gertjan van Noord. 1999. Transducers from rewrite rules with backreferences. In Proceedings of EACL.
14. Ronald M. Kaplan and Martin Kay. 1994. Regular models of phonological rule systems. Computational Linguistics, 20(3):331-378.
15. Dan Klein and Christopher D. Manning. 2002. Conditional structure versus conditional estimation in NLP models. In Proceedings of EMNLP, pages 9-16.
16. Kevin Knight and Jonathan Graehl. 2005. An overview of probabilistic tree transducers for natural language processing. In Proc. of the Sixth International Conference on Intelligent Text Processing and Computational Linguistics (CICLing).
17. Karen Kukich. 1992. Techniques for automatically correcting words in text. ACM Computing Surveys (CSUR), 24(4):377-439.
18. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the International Conference on Machine Learning.
19. Yang Liu, Qun Liu, and Shouxun Lin. 2005. Loglinear models for word alignment. In Proceedings of ACL, pages 459-466.
20. Eric Mays, Fred J. Damerau, and Robert L. Mercer. 1991. Context based spelling correction. Information Processing & Management, 27(5):517-522.
21. Andrew McCallum, Dayne Freitag, and Fernando Pereira. 2000. Maximum entropy Markov models for information extraction and segmentation. In Proceedings of ICML.
22. Mehryar Mohri and Richard Sproat. 1996. An efficient compiler for weighted rewrite rules. In Proceedings of ACL, pages 231-238.
23. Mehryar Mohri. 1997. Finite-state transducers in language and speech processing. Computational Linguistics, 23(2):269-311.
24. Mehryar Mohri. 2003. Edit-distance of weighted automata: General definitions and algorithms. International Journal of Foundations of Computer Science, 14(06):957-982.
25. Eric Sven Ristad and Peter N. Yianilos. 1998. Learning string edit distance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(5):522-532.