Feature-based Neural Language Model and Chinese Word Segmentation

6th International Joint Conference on Natural Language Processing, IJCNLP 2013 - Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 1271-1277

  Mansur, Mairgup ^a   Pei, Wenzhe ^a   Chang, Baobao ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CHARACTER FEATURE; CHINESE WORD SEGMENTATION; CONTEXT FEATURES; FEATURE-BASED; FEATURES SETS; LANGUAGE MODEL; LEARN+; NEURAL ARCHITECTURES; PERFORMANCE; SEGMENTATION MODELS;

COMPUTATIONAL LINGUISTICS;

EID: 84943739276     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin. 2003. A neural probabilistic language model. The Journal of Machine Learning Research, 3:1137–1155.
2. Léon Bottou. 1991. Stochastic gradient learning in neural networks. Proceedings of Neuro-Nımes, 91:8.
3. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. The Journal of Machine Learning Research, 12:2493–2537.
4. Geoffrey E Hinton. 1986. Learning distributed representations of concepts. In Proceedings of the eighth annual conference of the cognitive science society, pages 1–12. Amherst, MA.
5. J. Lafferty, A. McCallum, and F. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conf. on Machine Learning, pages 282–289.
6. Nanyuan Liang. 1987.”written chinese word segmentation system–cdws”. Journal of Chinese Information Processing, 21:9–19.(in Chinese).
7. Jin Kiat Low. 2005. A maximum entropy approach to chinese word segmentation. Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing, Jeju Island, Korea, pages 161–164.
8. Tomas Mikolov, Stefan Kombrink, Lukas Burget, JH Cernocky, and Sanjeev Khudanpur. 2011. Extensions of recurrent neural network language model. In Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on, pages 5528–5531. IEEE.
9. Fuchun Peng, Fangfang Feng, and McCallum Andrew. 2004. Chinese segmentation and new word detection using conditional random fields. In Proceedings of the 20th International Conf. on Computational Linguistics, pages 562–568.
10. Holger Schwenk and Jean-Luc Gauvain. 2004. Neural network language models for conversational speech recognition. In ICSLP 2004.
11. Holger Schwenk, Anthony Rousseau, and Mohammed Attik. 2012. Large, pruned or continuous space language models on a gpu for statistical machine translation. NAACL-HLT 2012, page 11.
12. Huihsin Tseng. 2005. A conditional random field word segmenter for sighan 2005. Proceedings of the 4th SIGHAN Workshop on Chinese Language Processing, Jeju Island, Korea, pages 168–171.
13. Nianwen Xue. 2003. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing, 8:29–48.