Minimum tag error for discriminative training of conditional random fields

Information Sciences

Volumn 179, Issue 1-2, 2009, Pages 169-179

  Xiong, Ying ^a   Zhu, Jie ^a   Huang, Hao ^a   Xu, Haihua ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Chinese word segmentation; Conditional random fields; Discriminative training; Machine learning; Natural language processing

Indexed keywords

EID: 55549127511     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2008.09.018     Document Type: Article

References (36)

1. Y. Altun, T. Hofmann, Large margin methods for label sequence learning, in: Proceeding of the Eighth European Conference on Speech Communication and Technology (EuroSpeech 2003), Geneva, Switzerland, 2003, pp. 993-996.
2. Chen B., and Chen Y.T. Extractive spoken document summarization for information retrieval. Pattern Recognition Letters 29 4 (2007) 217-238
3. W. Chen, Y. Zhang, H. Isahara, Chinese named entity recognition with conditional random fields, in: Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, Sydney, Australia, 2006, pp. 118-121.
4. Chen Y., and Chan K.-P. Using data mining techniques and rough set theory for language modeling. ACM Transactions on Asian Language Information Processing 6 1 (2007) Article 2
5. T. Emerson, The second international Chinese word segmentation bakeoff, in: Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, Jeju Island, Korea, 2005, pp. 123-133.
6. Fu G., Kit C., and Webster J.J. Chinese word segmentation as morpheme-based lexical chunking. Information Sciences 178 9 (2008) 2282-2296
7. Goh C.-L., Asahara M., and Matsumoto Y. Chinese word segmentation by classification of characters. Computational Linguistics and Chinese Language Processing 10 3 (2005) 381-396
8. S.S. Gross, O. Russakovsky, C.B. Do, S. Batzoglou, Training conditional random fields for maximum labelwise accuracy, in: Proceedings of the 20th Annual Conference on Neural Information Processing Systems (NIPS 2006), Vancouver, Canada, 2006.
9. A. Gunawardana, M. Mahajan, A. Acero, J.C. Platt, Hidden conditional random fields for phone classification, in: Proceedings of the Ninth European Conference on Speech Communication and Technology (InterSpeech 2005), Lisbon, Portugal, 2005, pp. 1117-1120.
10. Jeong M., and Lee G.G. Practical use of non-local features for statistical spoken language understanding. Computer Speech and Language 22 (2008) 148-170
11. Klinger R., Furlong L.I., Friendrich C.M., Mevissen H.T., Fluck J., Juliane S., Sanz F., and Hofmann-Apitius M. Identifying gene specific variations in biomedical text. Journal of Bioinformatics and Computational Biology 5 6 (2007) 1277-1296
12. T. Kudo, CRF++: yet another CRF toolkit, 2007. .
13. Kuo J.W., Liu S.H., Wang H.M., and Chen B. An empirical study of word error minimization approaches for mandarin large vocabulary speech recognition. International Journal of Computational Linguistics and Chinese Language Processing 11 3 (2006) 201-222
14. J. Lafferty, A. McCallum, F. Pereira, Conditional random fields: probabilistic models for segmenting and labeling sequence data, in: Proceedings of the 18th International Conference on Machine Learning (ICML 2001), Williamstown, MA, USA, 2001, pp. 282-289.
15. Lee C.-J., Chang J.S., and Jang J.-S.R. Extraction of transliteration pairs from parallel corpora using a statistical transliteration model. Information Sciences 176 (2006) 67-90
16. G.-A. Levow, The third international Chinese language processing bakeoff: word segmentation and named entity recognition, in: Proceeding of the Fifth SIGHAN Workshop on Chinese Language Processing, Sydney, Australia, 2006, pp. 108-117.
17. A. McCallum, W. Li, Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons, in: Proceedings of the Seventh Conference on Nature Language Learning, Edmonton, Canada, 2003, pp. 188-191.
18. Oh H.-J., Myaeng S.H., and Jang M.-G. Semantic passage segmentation based on sentence topics for question answering. Information Sciences 177 18 (2007) 3696-3717
19. D. Povey, P.C. Woodland, Minimum phone error and I-smoothing for improved discriminative training, in: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2002), Orlando, Florida, USA, 2002, pp. 105-108.
20. D. Povey, Discriminative training for large vocabulary speech recognition, Ph.D. Thesis, Cambridge University, Cambridge, 2004.
21. F. Peng, F. Feng, A. McCallum, Chinese segmentation and new word detection using conditional random fields, in: Proceedings of the 20th International Conference on Computational Linguistics, Geneva, Switzerland, 2004, pp. 562-568.
22. J.L. Roux, E. McDermott, Optimization methods for discriminative training, in: Proceedings of the Ninth European Conference on Speech Communication and Technology (InterSpeech 2005), Lisbon, Portugal, 2005, pp. 3341-3344.
23. F. Sha, F. Pereira, Shallow parsing with conditional random fields, in: Proceedings of Human Language Technology Conference and North American Chapter of the Association for Computational Linguistics, Edmonton, Canada, 2003, pp. 213-220.
24. J. Suzuki, E. McDermott, H. Isozaki, Training conditional random fields with multivariate evaluation measures, in: Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the ACL, Sydney, Australia, 2006, pp. 217-224.
25. B. Taskar, C. Guestrin, D. Koller, Max-margin Markov networks, in: Proceedings of the 17th Annual Conference on Neural Information Processing Systems (NIPS 2003), Vancouver, Canada, 2003.
26. Tou J.T. An intelligent full-text Chinese-English translation system. Information Sciences 125 1-4 (2000) 1-18
27. Tsochantaridis I., Joachims T., Hofmann T., and Altun Y. Large margin methods for structured and interdependent output variables. Journal of Machine Learning Research 6 (2005) 1453-1484
28. S. Vishwanathan, N. Schraudolph, M. Schmidt, K. Murphy, Accelerated training of conditional random fields with stochastic meta-descent, in: Proceeding of the 23rd International Conference on Machine Learning, Pittsburgh (ICML 2006), USA, 2006, pp. 969-976.
29. Wu A. Customizable segmentation of morphologically derived words in Chinese. Computational Linguistics and Chinese Language Processing 8 1 (2003) 1-28
30. Xue N. Chinese word segmentation as character tagging. Computational Linguistics and Chinese Language Processing 8 1 (2003) 29-48
31. Zhang M.Y., Lu Z.-D., and Zou C.-Y. A Chinese word segmentation based on language situation in processing ambiguous words. Information Sciences 162 3-4 (2004) 275-285
32. R. Zhang, G. Kikui, E. Sumita, Subword-based tagging by conditional random fields for Chinese word segmentation, in: Proceeding of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, New York, USA, 2006, pp. 193-196.
33. H. Zhao, C.N. Huang, M. Li, An improved Chinese word segmentation system with conditional random fields, in: Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, Sydney, Australia, 2006, pp. 162-165.
34. H. Zhao, C.N. Huang, M. Li, B.L. Lu, Effective tag set selection in Chinese word segmentation via conditional random field modeling, in: Proceedings of PACLIC-20, Wuhan China, 2006, pp. 87-94.
35. H. Zhao, C. Kit, Unsupervised segmentation helps supervised learning of character tagging for word segmentation and named entity recognition, in: Proceedings of the Sixth SIGHAN Workshop on Chinese Language Processing, Hyderabad, India, 2008, pp. 106-111.
36. J. Zhou, X. Dai, R. Ni, J. Chen, A hybrid approach to Chinese word segmentation around CRFs, in: Proceedings of the Fourth SIGHAN Workshop on Chinese Language Processing, Jeju Island, Korea, 2005, pp. 196-199.