Distributional representations for handling sparsity in supervised sequence-labeling

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 495-503

  Huang, Fei ^a   Yates, Alexander ^a  

^a TEMPLE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

DIFFERENT DOMAINS; ESTIMATING PARAMETERS; IMPROVE PERFORMANCE; NATURAL LANGUAGE PROCESSING; PART-OF-SPEECH TAGGER; SAMPLE COMPLEXITY; SEQUENCE LABELING; UNANNOTATED TEXTS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 80053028502     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1687878.1687948     Document Type: Conference Paper

References (30)

1. Rie Kubota Ando and Tong Zhang. 2005. A highperformance semi-supervised learning method for text chunking. In ACL.
2. Michele Banko and Robert C. Moore. 2004. Part of speech tagging in context. In COLING.
3. Yoshua Bengio, Réjean Ducharme, Pascal Vincent, and Christian Janvin. 2003. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155.
4. C. Biemann, C. Giuliano, and A. Gliozzo. 2007. Unsupervised pos tagging supporting supervised methods. Proceeding of RANLP-07.
5. J. Blitzer, A. Globerson, and F. Pereira. 2005. Distributed latent variable models of lexical cooccurrences. In Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics.
6. John Blitzer, Ryan McDonald, and Fernando Pereira. 2006. Domain adaptation with structural correspondence learning. In EMNLP.
7. E. Brill. 1994. Some Advances in Rule-Based Part of Speech Tagging. In AAAI, pages 722-727, Seattle, Washington.
8. Ciprian Chelba and Alex Acero. 2004. Adaptation of maximum entropy classifier: Little data can help a lot. In EMNLP.
9. Stanley F. Chen and Joshua Goodman. 1996. An empirical study of smoothing techniques for language modeling. In Proceedings of the 34th annual meeting on Association for Computational Linguistics, pages 310-318, Morristown, NJ, USA. Association for Computational Linguistics.
10. Hal Daumé III and DanielMarcu. 2006. Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research, 26.
11. Hal Daumé III. 2007. Frustratingly easy domain adaptation. In ACL.
12. S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman. 1990. Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41(6):391-407.
13. Arthur Dempster, Nan Laird, and Donald Rubin. 1977. Likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1):1-38.
14. Doug Downey, Stefan Schoenmackers, and Oren Etzioni. 2007. Sparse information extraction: Unsupervised language models to the rescue. In ACL.
15. A. Emami, P. Xu, and F. Jelinek. 2003. Using a connectionist model in a syntactical based language model. In Proceedings of the International Conference on Spoken Language Processing, pages 372-375.
16. Zoubin Ghahramani and Michael I. Jordan. 1997. Factorial hidden markov models. Machine Learning, 29(2-3):245-273.
17. Sharon Goldwater and Thomas L. Griffiths. 2007. A fully bayesian approach to unsupervised part-of-speech tagging. In ACL.
18. Mark Johnson. 2007. Why doesn't EM find good HMM POS-taggers. In EMNLP.
19. J. Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the International Conference on Machine Learning.
20. Mitchell P. Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics, 19(2):313-330.
21. Andriy Mnih and Geoffrey Hinton. 2007. Three new graphical models for statistical language modelling. In Proceedings of the 24th International Conference on Machine Learning, pages 641-648, New York, NY, USA. ACM.
22. F.Morin and Y. Bengio. 2005. Hierarchical probabilistic neural network language model. In Proceedings of the International Workshop on Artificial Intelligence and Statistics, pages 246-252.
23. PennBioIE. 2005. Mining the bibliome project. http://bioie.ldc.upenn.edu/ .
24. Lawrence R. Rabiner. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257-285.
25. Randi Reppen, Nancy Ide, and Keith Suderman. 2005. American national corpus (ANC) second release. Linguistic Data Consortium.
26. F. Sha and Fernando Pereira. 2003. Shallow parsing with conditional random fields. In Proceedings of Human Language Technology - NAACL.
27. Noah A. Smith and Jason Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL), pages 354-362, Ann Arbor, Michigan, June.
28. Erik F. Tjong, Kim Sang, and Sabine Buchholz. 2000. Introduction to the CoNLL-2000 shared task: Chunking. In Proceedings of the 4th Conference on Computational Natural Language Learning, pages 127-132.
29. Kristina Toutanova and Mark Johnson. 2007. A bayesian LDA-based model for semi-supervised part-of-speech tagging. In NIPS.
30. GuoDong Zhou. 2004. Discriminative hidden Markov modeling with long state dependence using a kNN ensemble. In COLING.