Multilingual part-of-speech tagging: Two unsupervised approaches

Journal of Artificial Intelligence Research

Volumn 36, Issue , 2009, Pages 341-385

  Naseem, Tahira ^a   Snyder, Benjamin ^a   Eisenstein, Jacob ^a   Barzilay, Regina ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HIERARCHICAL BAYESIAN MODELS; LATENT VARIABLE; MARKOV CHAIN MONTE CARLO; MULTILINGUAL CONTEXT; MULTILINGUAL LEARNING; MULTIPLE LANGUAGES; PART OF SPEECH TAGGING; PERFORMANCE GAIN; SINGLE SEQUENCES; TAG STRUCTURE; UNSUPERVISED APPROACHES;

BAYESIAN NETWORKS; MARKOV PROCESSES; SECURITY OF DATA;

LINGUISTICS;

EID: 73649125826     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.2843     Document Type: Article

References (46)

1. Baker, J. (1979). Trainable grammars for speech recognition. In Proceedings of the Acoustical Society of America.
2. Banko, M., & Moore, R. C. (2004). Part-of-speech tagging in context. In Proceedings of the COLING, pp. 556-561.
3. Bertoldi, N., Barbaiani, M., Federico, M., & Cattoni, R. (2008). Phrase-based statistical machine translation with pivot languages. In International Workshop on Spoken Language Translation Evaluation Campaign on Spoken Language Translation (IWSLT), pp. 143-149.
4. Bhattacharya, I., Getoor, L., & Bengio, Y. (2004). Unsupervised sense disambiguation using bilingual probabilistic models. In ACL '04: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, p. 287, Morristown, NJ, USA. Association for Computational Linguistics.
5. Brill, E. (1995). Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging. Computational Linguistics, 21(4), 543-565.
6. Brown, P. F., Pietra, S. A. D., Pietra, V. J. D., & Mercer, R. L. (1991). Word-sense disambiguation using statistical methods. In Proceedings of the ACL, pp. 264-270.
7. Chen, Y., Eisele, A., & Kay, M. (2008). Improving statistical machine translation efficiency by triangulation. In Proceedings of LREC.
8. Chiang, D. (2005). A hierarchical phrase-based model for statistical machine translation. In Proceedings of the ACL, pp. 263-270.
9. Cohn, T., & Lapata, M. (2007). Machine translation by triangulation: Making effective use of multi-parallel corpora. In Proceedings of ACL.
10. Comrie, B. (1989). Language universals and linguistic typology: Syntax and morphology. Oxford: Blackwell.
11. Dagan, I., Itai, A., & Schwall, U. (1991). Two languages are more informative than one. In Proceedings of the ACL, pp. 130-137.
12. Diab, M., & Resnik, P. (2002). An unsupervised method for word sense tagging using parallel corpora. In Proceedings of the ACL, pp. 255-262.
13. Erjavec, T. (2004). MULTEXT-East version 3: Multilingual morphosyntactic specifications, lexicons and corpora. In Fourth International Conference on Language Resources and Evaluation, LREC, Vol. 4, pp. 1535-1538.
14. Escobar, M., & West, M. (1995). Bayesian density estimation and inference using mixtures. Journal of the american statistical association, 90(230), 577-588.
15. Ferguson, T. (1973). A bayesian analysis of some nonparametric problems. The annals of statistics, 1, 209-230.
16. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis. Chapman and Hall/CRC.
17. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
18. Genzel, D. (2005). Inducing a multilingual dictionary from a parallel multitext in related languages. In Proceedings of HLT/EMNLP, pp. 875-882.
19. Gilks, W., Richardson, S., & Spiegelhalter, D. (1996). Markov chain Monte Carlo in practice. Chapman & Hall/CRC.
20. Goldwater, S., & Griffiths, T. L. (2007). A fully Bayesian approach to unsupervised part-of-speech tagging. In Proceedings of the ACL, pp. 744-751.
21. Haghighi, A., & Klein, D. (2006). Prototype-driven learning for sequence models. In Proceedings of HLT-NAACL, pp. 320-327.
22. Hinton, G. E. (1999). Products of experts. In Proceedings of the Ninth International Conference on Artificial Neural Networks, Vol. 1, pp. 1-6.
23. Johnson, M. (2007). Why doesn't EM find good HMM POS-taggers?. In Proceedings of EMNLP/CoNLL, pp. 296-305.
24. Kuhn, J. (2004). Experiments in parallel-text based grammar induction. In Proceedings of the ACL, p. 470.
25. Li, C., & Li, H. (2002). Word translation disambiguation using bilingual bootstrapping. In Proceedings of the ACL, pp. 343-351.
26. Liu, J. S. (1994). The collapsed Gibbs sampler in Bayesian computations with applications to a gene regulation problem. Journal of the American Statistical Association, 89(427), 958-966.
27. Merialdo, B. (1994). Tagging english text with a probabilistic model. Computational Linguistics, 20(2), 155-171.
28. Mihalcea, R. (2004). Current Issues in Linguistic Theory: Recent Advances in Natural Language Processing, chap. Unsupervised Natural Language Disambiguation Using Non-Ambiguous Words. John Benjamins Publisher.
29. Myers, J. L., & Well, A. D. (2002). Research Design and Statistical Analysis (2nd edition). Lawrence Erlbaum.
30. Ng, H. T., Wang, B., & Chan, Y. S. (2003). Exploiting parallel texts for word sense disambiguation: an empirical study. In Proceedings of the ACL, pp. 455-462.
31. Och, F. J., & Ney, H. (2001). Statistical multi-source translation. In MT Summit 2001, pp. 253-258.
32. Och, F. J., & Ney, H. (2003). A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1), 19-51.
33. Padó, S., & Lapata, M. (2006). Optimal constituent alignment with edge covers for semantic projection. In Proceedings of ACL, pp. 1161 - 1168.
34. Rabiner, L. R. (1989). A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257-286.
35. Resnik, P., & Yarowsky, D. (1997). A perspective on word sense disambiguation methods and their evaluation. In Proceedings of the ACL SIGLEX Workshop on Tagging Text with Lexical Semantics: Why, What, and How?, pp. 79-86.
36. Sethuraman, J. (1994). A constructive definition of Dirichlet priors. Statistica Sinica, 4(2), 639-650.
37. Smith, N. A., & Eisner, J. (2005). Contrastive estimation: Training log-linear models on unlabeled data. In Proceedings of the ACL, pp. 354-362.
38. Snyder, B., & Barzilay, R. (2008). Unsupervised multilingual learning for morphological segmentation. In Proceedings of the ACL/HLT, pp. 737-745.
39. Snyder, B., Naseem, T., Eisenstein, J., & Barzilay, R. (2008). Unsupervised multilingual learning for pos tagging. In Proceedings of EMNLP.
40. Snyder, B., Naseem, T., Eisenstein, J., & Barzilay, R. (2009). Adding more languages improves unsupervised multilingual part-of-speech tagging: A bayesian non-parametric approach. In Proceedings of NAACL/HLT.
41. Toutanova, K., & Johnson, M. (2008). A Bayesian LDA-based model for semi-supervised part-of-speech tagging. In Advances in Neural Information Processing Systems 20, pp. 1521-1528. MIT Press.
42. Utiyama, M., & Isahara, H. (2006). A comparison of pivot methods for phrase-based statistical machine translation. In Proceedings of NAACL/HLT, pp. 484-491.
43. Wu, D. (1995). Stochastic inversion transduction grammars, with application to segmentation, bracketing, and alignment of parallel corpora. In IJCAI, pp. 1328-1337.
44. Wu, D., & Wong, H. (1998). Machine translation with a stochastic grammatical channel. In Proceedings of the ACL/COLING, pp. 1408-1415.
45. Xi, C., & Hwa, R. (2005). A backoff model for bootstrapping resources for non-English languages. In Proceedings of EMNLP, pp. 851 - 858.
46. Yarowsky, D., Ngai, G., & Wicentowski, R. (2000). Inducing multilingual text analysis tools via robust projection across aligned corpora. In Proceedings of HLT, pp. 161-168.