A comparative study of minimally supervised morphological segmentation

Computational Linguistics

Volumn 42, Issue 1, 2016, Pages 91-120

  Ruokolainen, Teemu ^a   Kohonen, Oskar ^a   Sirts, Kairit ^b   Grönroos, Stig Arne ^a   Kurimo, Mikko ^a   Virpioja, Sami ^a  

^a AALTO UNIVERSITY   (Finland)

^b TALLINN UNIVERSITY OF TECHNOLOGY   (Estonia)

Author keywords

[No Author keywords available]

Indexed keywords

SURVEYS;

BOUNDARY DETECTION; COMPARATIVE STUDIES; EMPIRICAL - COMPARISONS; EMPIRICAL EVALUATIONS; LEARNING SETTINGS; LITERATURE SURVEY; MORPHOLOGICAL SEGMENTATION; SEGMENTATION MODELS;

MORPHOLOGY;

EID: 84964048195     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/COLI_a_00243     Document Type: Article

References (62)

1. Brent, Michael R. 1999. An efficient, probabilistically sound algorithm for segmentation and word discovery. Machine Learning, 34(1-3):71-105.
2. Chrupala, Grzegorz, Georgiana Dinu, and Josef van Genabith. 2008. Learning morphology with Morfette. In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC 2008), pages 2362-2367, Marrakech.
3. Collins, Michael. 2002. Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms. In Proceedings of the 2002. Conference on Empirical Methods in Natural Language Processing (EMNLP 2002), volume 10, pages 1-8, Philadelphia, PA.
4. Çöltekin, Çăgrı. 2010. Improving successor variety for morphological segmentation. LOT Occasional Series, 16:13-28.
5. Cozman, Fabio and Ira Cohen. 2006. Risks of semi-supervised learning: How unlabelled data can degrade performance of generative classifiers. In Olivier Chapelle, Bernhard Schölkopf, Alexander Zien, editors, Semi-supervised learning, pages 57-72. MIT press.
6. Cozman, Fabio Gagliardi, Ira Cohen, and Marcelo Cesar Cirelo. 2003. Semi-supervised learning of mixture models. In Proceedings of the 20th International Conference on Machine Learning (ICML-2003), pages 99-106, Washington, DC.
7. Creutz, Mathias, Teemu Hirsimäki, Mikko Kurimo, Antti Puurula, Janne Pylkkönen, Vesa Siivola, Matti Varjokallio, Ebru Arisoy, Murat Saraçlar, and Andreas Stolcke. 2007. Morph-based speech recognition and modeling of out-of-vocabulary words across languages. ACM Transactions on Speech and Language Processing, 5(1):3:1-3:29.
8. Creutz, Mathias and Krista Lagus. 2002. Unsupervised discovery of morphemes. In Proceedings of the Workshop on Morphological and Phonological Learning of ACL 2002, pages 21-30, Philadelphia, PA.
9. Creutz, Mathias and Krista Lagus. 2005. Unsupervised morpheme segmentation and morphology induction from text corpora using Morfessor 1.0. Technical Report A81, Publications in Computer and Information Science, Helsinki University of Technology.
10. Creutz, Mathias and Krista Lagus. 2007. Unsupervised models for morpheme segmentation and morphology learning. ACM Transactions on Speech and Language Processing, 4(1):1-27.
11. de Gispert, Adrià, Sami Virpioja, Mikko Kurimo, and William Byrne. 2009. Minimum Bayes risk combination of translation hypotheses from alternative morphological decompositions. In Proceedings of Human Language Technologies: The 2009. Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL HLT 2009), pages 73-76, Boulder, CO.
12. Eger, Steffen. 2013. Sequence segmentation by enumeration: An exploration. The Prague Bulletin of Mathematical Linguistics, 100:113-131.
13. Fox-Roberts, Patrick and Edward Rosten. 2014. Unbiased generative semi-supervised learning. Journal of Machine Learning Research, 15(1):367-443.
14. Goldwater, Sharon. 2006. Nonparametric Bayesian Models of Lexical Acquisition. Ph.D. thesis, Brown University.
15. Green, Spence and John DeNero. 2012. A class-based agreement model for generating accurately inflected translations. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (ACL 2012), pages 146-155, Jeju Island.
16. Grönroos, Stig-Arne, Sami Virpioja, Peter Smit, and Mikko Kurimo. 2014. Morfessor FlatCat: An HMM-based method for unsupervised and semi-supervised learning of morphology. In Proceedings of the 25th International Conference on Computational Linguistics (COLING 2014), pages 1177-1185, Dublin.
17. Hammarström, Harald and Lars Borin. 2011. Unsupervised learning of morphology. Computational Linguistics, 37(2):309-350.
18. Harris, Zellig S. 1955. From phoneme to morpheme. Language, 31(2):190-222.
19. Hirsimäki, Teemu, Mathias Creutz, Vesa Siivola, Mikko Kurimo, Sami Virpioja, and Janne Pylkkönen. 2006. Unlimited vocabulary speech recognition with morph language models applied to Finnish. Computer Speech and Language, 20(4):515-541.
20. Jiao, Feng, Shaojun Wang, Chi-Hoon Lee, Russell Greiner, and Dale Schuurmans. 2006. Semi-supervised conditional random fields for improved sequence segmentation and labeling. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics (COLING/ACL 2006), pages 209-216, Sidney.
21. Johnson, Howard and Joel Martin. 2003. Unsupervised learning of morphology for English and Inuktitut. In Proceedings of the 2003. Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology (NAACL HLT 2003), pages 43-45, Edmonton.
22. Johnson, Mark. 2008. Unsupervised word segmentation for Sesotho using adaptor grammars. In Proceedings of the 10th Meeting of the ACL Special Interest Group on Computational Morphology and Phonology (SIGMORPHON 2008), pages 20-27, Columbus, OH.
23. Johnson, Mark and Katherine Demuth. 2010. Unsupervised phonemic Chinese word segmentation using Adaptor Grammars. In Proceedings of the 23rd International Conference on Computational Linguistics, pages 528-536, Beijing.
24. Johnson, Mark and Sharon Goldwater. 2009. Improving nonparameteric Bayesian inference: Experiments on unsupervised word segmentation with adaptor grammars. In Proceedings of Human Language Technologies: The 2009. Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL HLT 2009), pages 317-325, Boulder, CO.
25. Johnson, Mark, Thomas L. Griffiths, and Sharon Goldwater. 2006. Adaptor grammars: A framework for specifying compositional nonparametric Bayesian models. In Advances in Neural Information Processing Systems, pages 641-648, Vancouver.
26. Johnson, Mark, Thomas L. Griffiths, and Sharon Goldwater. 2007. Bayesian inference for PCFGs via Markov chain Monte Carlo. In Proceedings of Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics (NAACL HLT 2007), pages 139-146, Rochester, NY.
27. Kaalep, Heiki-Jaan, Kadri Muischnek, Kristel Uiboaed, and Kaarel Veskis. 2010. The Estonian reference corpus: Its composition and morphology-aware user interface. In Proceedings of the 2010. Conference on Human Language Technologies-The Baltic Perspective: Proceedings of the Fourth International Conference Baltic (HLT 2010), pages 143-146, Riga.
28. Kılıç, Özkan and Cem Bozşahin. 2012. Semi-supervised morpheme segmentation without morphological analysis. In Proceedings of the LREC 2012. Workshop on Language Resources and Technologies for Turkic Languages, pages 52-56, Istanbul.
29. Kohonen, Oskar, Sami Virpioja, and Krista Lagus. 2010. Semi-supervised learning of concatenative morphology. In Proceedings of the 11th Meeting of the ACL Special Interest Group on Computational Morphology and Phonology (SIGMORPHON 2010), pages 78-86, Uppsala.
30. Kurimo, Mikko, Sami Virpioja, and Ville Turunen. 2010. Overview and results of Morpho Challenge 2010. In Proceedings of the Morpho Challenge 2010. Workshop, pages 7-24, Espoo.
31. Kurimo, Mikko, Sami Virpioja, Ville Turunen, Graeme W. Blackwood, and William Byrne. 2009. Overview and results of Morpho Challenge 2009. In Working Notes for the CLEF 2009. Workshop, pages 578-597, Corfu.
32. Lafferty, John, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning (ICML 2001), pages 282-289, Williamstown, MA.
33. Lee, Yoong Keok, Aria Haghighi, and Regina Barzilay. 2011. Modeling syntactic context improves morphological segmentation. In Proceedings of the Fifteenth Conference on Computational Natural Language Learning (CoNLL 2011), pages 1-9, Portland, OR.
34. Lignos, Constantine. 2010. Learning from unseen data. In Proceedings of the Morpho Challenge 2010. Workshop, pages 35-38, Helsinki.
35. Luong, Minh-Thang, Richard Socher, and Christopher D. Manning. 2013. Better word representations with recursive neural networks for morphology. In Proceedings of the 17th Conference on Computational Natural Language Learning (CoNLL 2013), pages 29-37, Sofia.
36. Mann, G. and A. McCallum. 2008. Generalized expectation criteria for semi-supervised learning of conditional random fields. In Proceedings of the 46th Annual Meeting of Association for Computational Linguistics: Human Language Technologies (ACL HLT 2008), pages 870-878, Columbus, OH.
37. Monson, Christian, Kristy Hollingshead, and Brian Roark. 2010. Simulating morphological analyzers with stochastic taggers for confidence estimation. In Multilingual Information Access Evaluation I-Text Retrieval Experiments, volume 6241. of Lecture Notes in Computer Science.
38. Narasimhan, Karthik, Damianos Karakos, Richard Schwartz, Stavros Tsakalidis, and Regina Barzilay. 2014. Morphological segmentation for keyword spotting. In Proceedings of the 2014. Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), pages 880-885, Doha.
39. Neuvel, Sylvain and Sean A. Fulop. 2002. Unsupervised learning of morphology without morphemes. In Proceedings of the 6th Workshop of the ACL Special Interest Group in Computational Phonology (SIGPHON 2002), pages 31-40, Philadelphia, PA.
40. Nigam, Kamal, Andrew Kachites McCallum, Sebastian Thrun, and Tom Mitchell. 2000. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39(2-3):103-134.
41. Pirinen, Tommi. 2008. Automatic finite state morphological analysis of Finnish language using open source resources [in Finnish]. Master's thesis, University of Helsinki.
42. Poon, Hoifung, Colin Cherry, and Kristina Toutanova. 2009. Unsupervised morphological segmentation with log-linear models. In Proceedings of Human Language Technologies: The 2009. Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL HLT 2009), pages 209-217, Boulder, CO.
43. Qiu, Siyu, Qing Cui, Jiang Bian, Bin Gao, and Tie-Yan Liu. 2014. Co-learning of word representations and morpheme representations. In Proceedings of the 25th International Conference on Computational Linguistics (COLING 2014), pages 141-150, Dublin.
44. Rissanen, Jorma. 1989. Stochastic Complexity in Statistical Inquiry, volume 15. World Scientific Series in Computer Science, Singapore.
45. Ruokolainen, Teemu, Oskar Kohonen, Sami Virpioja, and Mikko Kurimo. 2013. Supervised morphological segmentation in a low-resource learning setting using conditional random fields. In Proceedings of the 17th Conference on Computational Natural Language Learning (CoNLL 2013), pages 29-37, Sofia.
46. Ruokolainen, Teemu, Oskar Kohonen, Sami Virpioja, and Mikko Kurimo. 2014. Painless semi-supervised morphological segmentation using conditional random fields. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2014), pages 84-89. Gothenburg.
47. Schone, Patrick and Daniel Jurafsky. 2001. Knowledge-free induction of inflectional morphologies. In Proceedings of the 2nd Meeting of the North American Chapter of the Association for Computational Linguistics on Language Technologies (NAACL 2001), pages 1-9, Pittsburgh, PA.
48. Sirts, Kairit and Sharon Goldwater. 2013. Minimally-supervised morphological segmentation using adaptor grammars. Transactions of the Association for Computational Linguistics, 1(May):255-266.
49. Smit, Peter, Sami Virpioja, Stig-Arne Grönroos, and Mikko Kurimo. 2014. Morfessor 2.0: Toolkit for statistical morphological segmentation. In Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2014), pages 21-24, Gothenburg.
50. Spiegler, Sebastian and Peter A. Flach. 2010. Enhanced word decomposition by calibrating the decision threshold of probabilistic models and using a model ensemble. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL 2010), pages 375-383, Uppsala.
51. Stallard, David, Jacob Devlin, Michael Kayser, Yoong Keok Lee, and Regina Barzilay. 2012. Unsupervised morphology rivals supervised morphology for Arabic MT. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (ACL 2012), pages 322-327, Jeju Island.
52. Sun, Weiwei and Jia Xu. 2011. Enhancing Chinese word segmentation using unlabeled data. In Proceedings of the 2011. Conference on Empirical Methods in Natural Language Processing (EMNLP 2011), pages 970-979, Edinburgh.
53. Turian, Joseph, Lev Ratinov, and Yoshua Bengio. 2010. Word representations: A simple and general method for semi-supervised learning. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL 2010), pages 384-394, Uppsala.
54. Turunen, Ville and Mikko Kurimo. 2011. Speech retrieval from unsegmented Finnish audio using statistical morphemelike units for segmentation, recognition, and retrieval. ACM Transactions on Speech and Language Processing, 8(1):1:1-1:25.
55. Virpioja, Sami, Oskar Kohonen, and Krista Lagus. 2010. Unsupervised morpheme analysis with Allomorfessor. In Multilingual Information Access Evaluation I. Text Retrieval Experiments: 10th Workshop of the Cross-Language Evaluation Forum (CLEF 2009), pages 609-616, Corfu.
56. Virpioja, Sami, Oskar Kohonen, and Krista Lagus. 2011. Evaluating the effect of word frequencies in a probabilistic generative model of morphology. In Proceedings of the 18th Nordic Conference of Computational Linguistics (NODALIDA 2011), pages 230-237, Riga.
57. Virpioja, Sami, Peter Smit, Stig-Arne Grönroos, and Mikko Kurimo. 2013. Morfessor 2.0: Python implementation and extensions for Morfessor Baseline. Report 25/2013 in Aalto University publication series SCIENCE + TECHNOLOGY, Department of Signal Processing and Acoustics, Aalto University, Helsinki, Finland.
58. Virpioja, Sami, Ville Turunen, Sebastian Spiegler, Oskar Kohonen, and Mikko Kurimo. 2011. Empirical comparison of evaluation methods for unsupervised learning of morphology. Traitement Automatique des Langues, 52(2):45-90.
59. Wang, Yang, Gholamreza Haffari, Shaojun Wang, and Greg Mori. 2009. A rate distortion approach for semi-supervised conditional random fields. In Advances in Neural Information Processing Systems (NIPS), pages 2008-2016, Vancouver.
60. Wang, Yiou, Yoshimasa Tsuruoka Jun'ichi Kazama, Yoshimasa Tsuruoka, Wenliang Chen, Yujie Zhang, and Kentaro Torisawa. 2011. Improving Chinese word segmentation and POS tagging with semi-supervised methods using large auto-analyzed data. In Proceedings of the 5th International Joint Conference on Natural Language Processing, pages 309-317, Chiang Mai.
61. Yarowsky, David and RichardWicentowski. 2000. Minimally supervised morphological analysis by multimodal alignment. In Proceedings of the 38th Meeting of the Association for Computational Linguistics (ACL 2000), pages 207-216, Hong Kong.
62. Zhu, Xiaojin and Andrew B. Goldberg. 2009. Introduction to semi-supervised learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 3(1):1-130.