Morphological analysis for unsegmented languages using recurrent neural network language model

Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing

Volumn , Issue , 2015, Pages 2292-2297

  Morita, Hajime ^a,b   Kawahara, Daisuke ^a   Kurohashi, Sadao ^a,b  

^a KYOTO UNIVERSITY   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS;

BASELINE MODELS; LANGUAGE MODEL; MORPHOLOGICAL ANALYSIS;

RECURRENT NEURAL NETWORKS;

EID: 84959890058     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/d15-1276     Document Type: Conference Paper

References (21)

1. Masatsugu Hangyo, Daisuke Kawahara, and Sadao Kurohashi. 2012. Building a diverse document leads corpus annotated with semantic relations. In Proceedings of the 26th Pacific Asia Conference on Language, Information, and Computation, pages 535-544.
2. Nobuhiro Kaji and Masaru Kitsuregawa. 2014. Accurate word segmentation and POS tagging for japanese microblogs: Corpus annotation and joint modeling with lexical normalization. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 99-109, Doha, Qatar. Association for Computational Linguistics.
3. Daisuke Kawahara and Sadao Kurohashi. 2006. Case frame compilation from the web using highperformance computing. In Proceedings of the 5th International Conference on Language Resources and Evaluation, pages 1344-1347.
4. Daisuke Kawahara, Sadao Kurohashi, and Kôiti Hasida. 2002. Construction of a Japanese relevance-tagged corpus. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC-2002), Las Palmas, Canary Islands - Spain, May. European Language Resources Association (ELRA). ACL Anthology Identifier: L02-1302.
5. Canasai Kruengkrai, Virach Sornlerflamvanich, and Hitoshi Isahara. 2006. A conditional random field framework for Thai morphological analysis. In Proceedings of LREC, pages 2419-2424.
6. Taku Kudo, Kaoru Yamamoto, and Yuji Matsumoto. 2004. Applying conditional random fields to Japanese morphological analysis. In Proceedings of the Conference on Emprical Methods in Natural Language Processing (EMNLP 2004), volume 2004.
7. Sadao Kurohashi and Daisuke Kawahara, 2009. Japanese Morphological Analysis System JUMAN 6.0 Users Manual. http://nlp. ist.i. kyoto-u.ac.jp/EN/index.php?JUMAN.
8. Xiaodong Liu, Kevin Duh, Yuji Matsumoto, and Tomoya Iwakura. 2014. Learning character representations for Chinese word segmentation. In NIPS 2014 Workshop on Modern Machine Learning and Natural Language Processing.
9. Mairgup Mansur, Wenzhe Pei, and Baobao Chang. 2013. Feature-based neural language model and Chinese word segmentation. In Proceedings of the Sixth International Joint Conference on Natural Language Processing, pages 1271-1277, Nagoya, Japan, October. Asian Federation of Natural Language Processing.
10. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernocky, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In INTERSPEECH 2010, 11th Annual Conference of the International Speech Communication Association, Makuhari, Chiba, Japan, September 26-30, 2010, pages 1045-1048.
11. Tomas Mikolov, Anoop Deoras, Dan Povey, Lukar Burget, and Jan Honza Cernocky. 2011. Strategies for training large scale neural network language models. In Proceedings of ASRU 2011, pages 196-201. IEEE Automatic Speech Recognition and Understanding Workshop.
12. Tomas Mikolov. 2012. Statistical language models based on neural networks. Ph. D. thesis, Brno university of technology.
13. Wenzhe Pei, Tao Ge, and Baobao Chang. 2014. Maxmargin tensor neural network for Chinese word segmentation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014, June 22-27, 2014, Baltimore, MD, USA, Volume 1: Long Papers, pages 293-303.
14. Mo Shen, Hongxiao Liu, Daisuke Kawahara, and Sadao Kurohashi. 2014. Chinese Morphological Analysis with Character-level POS Tagging. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 253-258, Baltimore, Maryland. Association for Computational Linguistics.
15. Andreas Stolcke. 2002. SRILM - an extensible language modeling toolkit. In John H L Hansen and Bryan L Pellom, editors, 7th International Conference on Spoken Language Processing, ICSLP2002 - INTERSPEECH 2002, Denver, Colorado, USA, September 16-20, 2002, pages 901-904. ISCA.
16. Scott M. Thede and Mary P. Harper. 1999. A secondorder Hidden Markov Model for part-of-speech tagging. In Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, pages 175-182, Morristown, NJ, USA, June. Association for Computational Linguistics.
17. Yiou Wang, Jun'ichi Kazama, Wenliang Chen, Yujie Zhang, Kentaro Torisawa, and Yoshimasa Tsuruoka. 2011. Improving Chinese word segmentation and POS tagging with semi-supervised methods using large auto-analyzed data. In Proceedings of the Fifth International Joint Conference on Natural Language Processing (IJCNLP-2011), pages 309-317, Chiang Mai, Thailand. Asian Federation of Natural Language Processing.
18. Jialei Wang, Peilin Zhao, and Steven C. H. Hoi. 2012. Exact soft confidence-weighted learning. In 29th International Conference on Machine Learning (ICML 2012), pages 121-128.
19. Yue Zhang and Stephen Clark. 2008. Joint word segmentation and pos tagging using a single perceptron. In Proceedings of ACL-08: HLT, pages 888-896, Columbus, Ohio, June. Association for Computational Linguistics.
20. Ying Zhang, Stephan Vogel, and Alex Waibel. 2004. Interpreting bleu/nist scores: How much improvement do we need to have a better system? In Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC-2004), Lisbon, Portugal, May. European Language Resources Association (ELRA). ACL Anthology Identifier: L04-1489.
21. Xiaoqing Zheng, Hanyang Chen, and Tianyu Xu. 2013. Deep learning for Chinese word segmentation and POS tagging. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, EMNLP 2013, 18-21 October 2013, Grand Hyatt Seattle, Seattle, Washington, USA, A meeting of SIGDAT, a Special Interest Group of the ACL, pages 647-657.