Capturing Long-distance Dependencies in Sequence Models: A Case Study of Chinese Part-of-speech Tagging

6th International Joint Conference on Natural Language Processing, IJCNLP 2013 - Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 180-188

  Sun, Weiwei ^a   Peng, Xiaochang ^a   Wan, Xiaojun ^a  

^a Peking University   (China)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

CASE-STUDIES; COMPLEXITY MODELING; HIGH COMPLEXITY; LEARNING TECHNIQUES; LOCAL INFORMATION; LONG-DISTANCE DEPENDENCIES; PART OF SPEECH TAGGING; PARTS-OF-SPEECH TAGGING; SEQUENCE MODELS; TWO-STEPS STRATEGY;

COMPUTATIONAL LINGUISTICS;

EID: 84988565202     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Leo Breiman. 1996. Stacked regressions. Machine Learning, 24:49–64, July.
2. Cristian Bucila, Rich Caruana, and Alexandru Niculescu-Mizil. 2006. Model compression. In KDD, pages 535–541.
3. Eugene Charniak. 2000. A maximum-entropy-inspired parser. In Proceedings of NAACL.
4. Stephen Clark and James R. Curran. 2004. The importance of supertagging for wide-coverage ccg parsing. In Proceedings of Coling 2004, pages 282–288, Geneva, Switzerland, Aug 23–Aug 27. COLING.
5. Michael Collins. 2002. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proceedings of EMNLP, pages 1–8. Association for Computational Linguistics, July.
6. Michael Collins. 2003. Head-driven statistical models for natural language parsing. Computational Linguistics, 29(4):589–637.
7. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. 2006. Online passive-aggressive algorithms. JOURNAL OF MACHINE LEARNING RESEARCH, 7:551–585.
8. Mark Craven. 1996. Extracting Comprehensible Models from Trained Neural Networks. Ph.D. thesis, University of Wisconsin-Madison, Department of Computer Sciences. Also appears as UW Technical Report CS-TR-96-1326.
9. Jan Hajič, Massimiliano Ciaramita, Richard Johansson, Daisuke Kawahara, Maria Antònia Martí, Lluís Màrquez, Adam Meyers, Joakim Nivre, Sebastian Padó, Jan Štěpánek, Pavel Straňák, Mihai Surdeanu, Nianwen Xue, and Yi Zhang. 2009. The CoNLL-2009 shared task: Syntactic and semantic dependencies in multiple languages. In Proceedings of the 13th Conference on Computational Natural Language Learning (CoNLL-2009), June 4-5, Boulder, Colorado, USA.
10. Jun Hatori, Takuya Matsuzaki, Yusuke Miyao, and Jun’ichi Tsujii. 2011. Incremental joint POS tagging and dependency parsing in chinese. In Proceedings of 5th International Joint Conference on Natural Language Processing, pages 1216–1224, Chiang Mai, Thailand, November. Asian Federation of Natural Language Processing.
11. Zhongqiang Huang, Vladimir Eidelman, and Mary Harper. 2009. Improving a simple bigram hmm part-of-speech tagger by latent annotation and self-training. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers, pages 213–216, Boulder, Colorado, June. Association for Computational Linguistics.
12. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, ICML ’01, pages 282–289, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
13. Zhenghua Li, Min Zhang, Wanxiang Che, Ting Liu, Wenliang Chen, and Haizhou Li. 2011. Joint models for Chinese POS tagging and dependency parsing. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 1180–1191, Edinburgh, Scotland, UK., July. Association for Computational Linguistics.
14. Percy Liang, Hal Daumé, III, and Dan Klein. 2008. Structure compilation: trading structure for features. In Proceedings of the 25th international conference on Machine learning, ICML’08, pages 592–599, New York, NY, USA. ACM.
15. Takuya Matsuzaki, Yusuke Miyao, and Jun’ichi Tsujii. 2005. Probabilistic cfg with latent annotations. In Proceedings of ACL, ACL’05, pages 75–82, Stroudsburg, PA, USA. Association for Computational Linguistics.
16. Joakim Nivre and Ryan McDonald. 2008. Integrating graph-based and transition-based dependency parsers. In Proceedings of ACL-08: HLT, pages 950–958, Columbus, Ohio, June. Association for Computational Linguistics.
17. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and interpretable tree annotation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 433–440, Sydney, Australia, July. Association for Computational Linguistics.
18. Alexander M Rush, David Sontag, Michael Collins, and Tommi Jaakkola. 2010. On dual decomposition and linear programming relaxations for natural language processing. In Proceedings of EMNLP, pages 1–11, Cambridge, MA, October. Association for Computational Linguistics.
19. Hiroyuki Shindo, Yusuke Miyao, Akinori Fujino, and Masaaki Nagata. 2012. Bayesian symbol-refined tree substitution grammars for syntactic parsing. In Proceedings of ACL, pages 440–448, Jeju Island, Korea, July. Association for Computational Linguistics.
20. Weiwei Sun and Hans Uszkoreit. 2012. Capturing paradigmatic and syntagmatic lexical relations: Towards accurate Chinese part-of-speech tagging. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, July.
21. Weiwei Sun. 2011. A stacked sub-word model for joint Chinese word segmentation and part-of-speech tagging. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 1385–1394, Portland, Oregon, USA, June. Association for Computational Linguistics.
22. Daniel Tse and James R. Curran. 2012. The challenges of parsing chinese with combinatory categorial grammar. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 295–304, Montréal, Canada, June. Association for Computational Linguistics.
23. Yoshimasa Tsuruoka, Jun’ichi Tsujii, and Sophia Ananiadou. 2009. Fast full parsing by linear-chain conditional random fields. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), pages 790–798, Athens, Greece, March. Association for Computational Linguistics.
24. David H. Wolpert. 1992. Original contribution: Stacked generalization. Neural Netw., 5:241–259, February.
25. Nianwen Xue, Fei Xia, Fu-Dong Chiou, and Martha Palmer. 2005. The penn Chinese treebank: Phrase structure annotation of a large corpus. Natural Language Engineering, 11(2):207–238.
26. Yue Zhang and Stephen Clark. 2009. Transition-based parsing of the Chinese treebank using a global discriminative model. In Proceedings of the 11th International Conference on Parsing Technologies (IWPT’09), pages 162–171, Paris, France, October. Association for Computational Linguistics.
27. Zhi-Hua Zhou. 2009. When semi-supervised learning meets ensemble learning. In Proceedings of the 8th International Workshop on Multiple Classifier Systems, MCS’09, pages 529–538, Berlin, Heidelberg. Springer-Verlag.