Sparse data and smoothing in statistical part-of-speech tagging

Journal of Quantitative Linguistics

Volumn 7, Issue 1, 2000, Pages 1-17

  Nivre, Joakim ^a  

^a UNIVERSITY OF GOTHENBURG   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34248735623     PISSN: 09296174     EISSN: 17445035     Source Type: Journal    
DOI: 10.1076/0929-6174(200004)07:01;1-3;FT001     Document Type: Article

References (25)

1. Baum, L.E. (1972). An inequality and associated maximization technique in statistical estimation for probabilistic functions of a Markov process. Inequalities, 3, 1-8.
2. Brants, T., & Samuelsson, C. (1995). Tagging the Teleman corpus. In Proceedings of the 10th Nordic Conference of Computational Linguistics, NODALIDA-95. Helsinki, 7-20.
3. Brill, E. (1992). A simple rule-based part of speech tagger. In Third Conference of Applied Natural Language Processing, ACL.
4. Brown, P.F., Della Pietra, V.J., Jelinek, F., Lafferty, J.D., Mercer, R.L., & Roossin, P.S. (1992). Class-based n-gram models of natural language. Computational Linguistics, 18, 467-479.
5. Chanod, J.-P., & Tapanainen, P. (1995). Tagging French - comparing a statistical and a constraint-based method. In 7th Conference of the European Chapter of the Association for Computational Linguistics. Dublin, 149-156.
6. Charniak, E. (1993). Statistical Language Learning. Cambridge, MA: MIT Press.
7. Charniak, E., Hendrickson, C., Jacobson, N., & Perkowitz, M. (1993). Equations for part-of-speech tagging. In Proceedings of the 11th National Conference on Artificial Intelligence. Cambridge, MA: AAAI Press/MIT Press.
8. Church, K.W., & Gale, W.A. (1991). A comparison of the enhanced Good-Turing and deleted estimation methods for estimating probabilities of English bigrams. Computer Speech and Language, 5, 19-54.
9. Cutting, D., Kupiec, J., Pedersen, J., & Sibun, P. (1992). A practical part-of-speech tagger. In 3rd Conference on Applied Natural Language Processing, ACL, 133-140.
10. Daelemans, W., Zavrel, J., Berck, P., & Gillis, S. (1996). MBT: A memory-based part of speech tagger-generator. In E. Ejerhed & I. Dagan. (Eds), Proceedings of the 4th Workshop on Very Large Corpora. Copenhagen, Denmark, 14-27.
11. Dempster, A.P., Laird, N.M., & Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39, 1-38.
12. DeRose, S.J. (1988). Grammatical category disambiguation by statistical optimization. Computational Linguistics, 14, 31-39.
13. Ejerhed, E., Källgren, G., Wennstedt, O., & Åström, M. (1992). The linguistic annotation system of the Stockholm-Umeå corpus project. Report 33. University of Umeå: Department of Linguistics.
14. Gale, W.A., & Church, K.W. (1990). Poor estimates of context are worse than none. In Proceedings of the Speech and Natural Language Workshop, Morgan Kaufmann, 283-287.
15. Gale, W.A., & Church, K.W. (1994). What is wrong with adding one? In N. Oostdijk & P. deHaan (Eds.), Corpus-Based Research into Language (pp. 189-198). Amsterdam: Rodopi.
16. Gale, W.A., & Sampson, G. (1995). Good-Turing frequency estimation without tears. Journal of Quantitative Linguistics, 2, 217-237.
17. Good, I.J. (1953). The population frequencies of species and the estimation of population parameters. Biometrika, 43, 45-63.
18. Jelinek, F. (1997). Statistical Methods for Speech Recognition. Cambridge: MA: MIT Press.
19. Jelinek, F., & Mercer, R. (1985). Probability distribution estimation from sparse data. IBM Technical Disclosure Bulletin, 28, 2591-2594.
20. Katz, S. (1987). Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Transactions on Acoustics, Speech and Signal Processing, 35, 400-401.
21. Lidstone, G.J. (1920). Note on the general case of the Bayes-Laplace formula for inductive or a posteriori probabilities. Transactions of the Faculty of Actuaries, 8, 182-192.
22. Lindgren, B.W. (1993). Statistical Theory. Chapman-Hall.
23. Merialdo, B. (1994). Tagging English text with a probabilistic model. Computational Linguistics, 20, 155-171.
24. Ney, H., Martin, S., & Wessel, F. (1997). Statistical language modeling using leaving-one-out. In S. Young & G. Bloothooft (Eds.), Corpus-Based Methods in Language and Speech Processing. Dordrecht: Kluwer Academic Publishers.
25. Viterbi, A.J. (1967). Error bounds for convolutional codes and an asymptotically optimal decoding algorithm. IEEE Transactions on Information Theory, 13, 260-269.