Supervised morphological segmentation in a low-resource learning setting using conditional random fields

CoNLL 2013 - 17th Conference on Computational Natural Language Learning, Proceedings

Volumn , Issue , 2013, Pages 29-37

  Ruokolainen, Teemu ^a   Kohonen, Oskar ^a   Virpioja, Sami ^a   Kurimo, Mikko ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; REGRESSION ANALYSIS;

CONDITIONAL RANDOM FIELD; LEARNING SETTINGS; LOGLINEAR MODEL; MODEL TRAINING; MORPH SEQUENCES; MORPHOLOGICAL SEGMENTATION; SEMI-SUPERVISED; STATE-OF-ART METHODS;

RANDOM PROCESSES;

EID: 85072755546     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. M. Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing (EMNLP 2002), volume 10, pages 1–8. Association for Computational Linguistics.
2. M. Creutz, T. Hirsimäki, M. Kurimo, A. Puurula, J. Pylkkönen, V. Siivola, M. Varjokallio, E. Arisoy, M. Saraçlar, and A Stolcke. 2007. Morph-based speech recognition and modeling of out-of-vocabulary words across languages. ACM Transactions on Speech and Language Processing, 5(1):3:1–3:29, December.
3. S. Green and J. DeNero. 2012. A class-based agreement model for generating accurately inflected translations. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, pages 146–155. Association for Computational Linguistics.
4. H. Hammarström and L. Borin. 2011. Unsupervised learning of morphology. Computational Linguistics, 37(2):309–350, June.
5. T. Hirsimäki, M. Creutz, V. Siivola, M. Kurimo, S. Virpioja, and J. Pylkkönen. 2006. Unlimited vocabulary speech recognition with morph language models applied to Finnish. Computer Speech and Language, 20(4):515–541, October.
6. O. Kohonen, S. Virpioja, and K. Lagus. 2010. Semi-supervised learning of concatenative morphology. In Proceedings of the 11th Meeting of the ACL Special Interest Group on Computational Morphology and Phonology, pages 78–86, Uppsala, Sweden, July. Association for Computational Linguistics.
7. M. Kurimo, S. Virpioja, V. Turunen, G. W. Blackwood, and W. Byrne. 2009. Overview and results of Morpho Challenge 2009. In Working Notes for the CLEF 2009 Workshop, Corfu, Greece, September.
8. M. Kurimo, S. Virpioja, and V. Turunen. 2010. Overview and results of Morpho Challenge 2010. In Proceedings of the Morpho Challenge 2010 Workshop, pages 7–24, Espoo, Finland, September. Aalto University School of Science and Technology, Department of Information and Computer Science. Technical Report TKK-ICS-R37.
9. J. Lafferty, A. McCallum, and F.C.N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, pages 282–289.
10. M. Maamouri, A. Bies, T. Buckwalter, and W. Mekki. 2004. The penn arabic treebank: Building a large-scale annotated arabic corpus. In NEMLAR Conference on Arabic Language Resources and Tools, pages 102–109.
11. G. Mann and A. McCallum. 2008. Generalized expectation criteria for semi-supervised learning of conditional random fields. In Proceedings of ACL-08: HLT, pages 870–878. Association for Computational Linguistics.
12. A. McCallum and W. Li. 2003. Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003-Volume 4, pages 188–191. Association for Computational Linguistics.
13. A. McCallum, D. Freitag, and F. Pereira. 2000. Maximum entropy Markov models for information extraction and segmentation. In Pat Langley, editor, Proceedings of the Seventeenth International Conference on Machine Learning (ICML 2000), pages 591–598, Stanford, CA, USA. Morgan Kaufmann.
14. F. Peng, F. Feng, and A. McCallum. 2004. Chinese segmentation and new word detection using conditional random fields. In Proceedings of the 20th International Conference on Computational Linguistics (COLING 2004), page 562. Association for Computational Linguistics.
15. H. Poon, C. Cherry, and K. Toutanova. 2009. Unsupervised morphological segmentation with log-linear models. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 209–217. Association for Computational Linguistics.
16. F. Sha and F. Pereira. 2003. Shallow parsing with conditional random fields. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology-Volume 1, pages 134–141. Association for Computational Linguistics.
17. B. Snyder and R. Barzilay. 2008. Crosslingual propagation for morphological analysis. In Proceedings of the AAAI, pages 848–854.
18. M. Szummer, P. Kohli, and D. Hoiem. 2008. Learning CRFs using graph cuts. Computer Vision–ECCV 2008, pages 582–595.
19. V. Turunen and M. Kurimo. 2011. Speech retrieval from unsegmented Finnish audio using statistical morpheme-like units for segmentation, recognition, and retrieval. ACM Transactions on Speech and Language Processing, 8(1):1:1–1:25, October.
20. S. Virpioja, V. Turunen, S. Spiegler, O. Kohonen, and M. Kurimo. 2011. Empirical comparison of evaluation methods for unsupervised learning of morphology. Traitement Automatique des Langues, 52(2):45–90.
21. H. Zhao, C.N. Huang, and M. Li. 2006. An improved chinese word segmentation system with conditional random field. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, volume 1082117. Sydney: July.