Efficient optimization of an MDL-inspired objective function for unsupervised part-of-speech tagging

ACL 2010 - 48th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

Volumn , Issue , 2010, Pages 209-214

  Vaswani, Ashish ^a   Pauls, Adam ^b   Chiang, David ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; GENERATIVE MODEL; LOG LIKELIHOOD; MDL PRINCIPLE; MINIMUM DESCRIPTION LENGTH PRINCIPLE; MODEL SELECTION; MODEL SIZE; OBJECTIVE FUNCTIONS; PART OF SPEECH TAGGING; POS TAGGING; SEARCH ALGORITHMS;

COMPUTATIONAL LINGUISTICS; HIDDEN MARKOV MODELS; LEARNING ALGORITHMS;

OPTIMIZATION;

EID: 84859998316     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. R. Andreani, E. G. Birgin, J. M. Martnez, and M. L. Schuverdt. 2007. On Augmented Lagrangian methods with general lower-level constraints. SIAM Journal on Optimization, 18:1286-1309.
2. A. Barron, J. Rissanen, and B. Yu. 1998. The minimum description length principle in coding and modeling. IEEE Transactions on Information Theory, 44(6):2743-2760.
3. C. Bishop. 2006. Pattern Recognition and Machine Learning. Springer.
4. J. Bos, C. Bosco, and A. Mazzei. 2009. Converting a dependency treebank to a categorical grammar treebank for italian. In Eighth International Workshop on Treebanks and Linguistic Theories (TLT8).
5. D. Chiang, J. Graehl, K. Knight, A. Pauls, and S. Ravi. 2010. Bayesian inference for Finite-State transducers. In Proceedings of the North American Association of Computational Linguistics.
6. A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Computational Linguistics, 39(4):1-38.
7. Y. Goldberg, M. Adler, and M. Elhadad. 2008. EM can find pretty good HMM POS-taggers (when given a good start). In Proceedings of the ACL.
8. S. Goldwater and T. L. Griffiths. 2007. A fully Bayesian approach to unsupervised part-of-speech tagging. In Proceedings of the ACL.
9. M. Hyder and K. Mahata. 2009. An approximate L0 norm minimization algorithm for compressed sensing. In Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.
10. B. Merialdo. 1994. Tagging English text with a probabilistic model. Computational Linguistics, 20(2):155-171.
11. H. Mohimani, M. Babaie-Zadeh, and C. Jutten. 2007. Fast sparse representation based on smoothed L0 norm. In Proceedings of the 7th International Conference on Independent Component Analysis and Signal Separation (ICA2007).
12. S. Ravi and K. Knight. 2009. Minimized models for unsupervised part-of-speech tagging. In Proceedings of ACL-IJCNLP.
13. N. Smith. and J. Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proceedings of the ACL.