MAP adaptation of stochastic grammars

Computer Speech and Language

Volumn 20, Issue 1, 2006, Pages 41-68

  Bacchiani, Michiel ^a   Riley, Michael ^b   Roark, Brian ^c   Sproat, Richard ^d  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b GOOGLE INC   (United States)

^c OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ESTIMATION; INTERPOLATION; MONTE CARLO METHODS; PROBABILITY; RANDOM PROCESSES; SAMPLING; SPEECH RECOGNITION;

MAXIMUM A POSTERIORI (MAP); MONTE CARLO SAMPLING; PROBABILISTIC CONTEXT-FREE GRAMMARS (PCFG); STOCHASTIC GRAMMARS;

LINGUISTICS;

EID: 27744563098     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2004.12.001     Document Type: Article

References (38)

1. Bacchiani, M., 2001. Automatic transcription of voicemail at AT&T. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
2. Bacchiani, M., Roark, B., 2003. Unsupervised language model adaptation. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 224-227.
3. Charniak, E., 1997. Statistical parsing with a context-free grammar and word statistics. In: Proceedings of the Fourteenth National Conference on Artificial Intelligence, pp. 598-603.
4. Charniak, E., 2000. A maximum-entropy-inspired parser. In: Proceedings of the 1st Conference of the North American Chapter of the Association for Computational Linguistics, pp. 132-139.
5. Z. Chi, and S. Geman Estimation of probabilistic context-free grammars Computational Linguistics 24 2 1998 299 305
6. Collins, M.J., 1997. Three generative, lexicalised models for statistical parsing. In: Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, pp. 16-23.
7. Collins, M.J., 1999. Head-driven statistical models for natural language parsing. Ph.D. Thesis, University of Pennsylvania.
8. Collins, M.J., 2000. Discriminative reranking for natural language parsing. In: The Proceedings of the 17th International Conference on Machine Learning.
9. M.J.F. Gales Maximum likelihood linear transformations for HMM-based speech recognition Computer Speech and Language 1998 75 98
10. J.-L. Gauvain, and C.-H. Lee Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains IEEE Transactions on Speech and Audio Processing 2 2 1994 291 298
11. Gildea, D., 2001. Corpus variation and parser performance. In: Proceedings of the Sixth Conference on Empirical Methods in Natural Language Processing (EMNLP-01).
12. I.J. Good The population frequencies of species and the estimation of population parameters Biometrica V 40 3,4 1953 237 264
13. A.L. Gorin, A. Abella, T. Alonso, G. Riccardi, and J.H. Wright Automated natural spoken dialogue IEEE Computer Magazine 35 4 2002 51 56
14. Gretter, R., Riccardi, G., 2001. On-line learning of language models with word error probability distributions. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 557-560.
15. Hwa, R., 1999. Supervised grammar induction using training data with limited constituent information. In: Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics.
16. Hwa, R., 2001. On minimizing training corpus for parser acquisition. In: Proceedings of the Fifth Computational Natural Language Learning Workshop.
17. Jelinek, F., Mercer, R.L., 1980. Interpolated estimation of markov source parameters from sparse data. In: Proceedings of the Workshop on Pattern Recognition in Practice, pp. 381-397.
18. M. Johnson PCFG models of linguistic tree representations Computational Linguistics 24 4 1998 617 636
19. Johnson, M., Roark, B., 2000. Compact non-left-recursive grammars using the selective left-corner transform and factoring. In: Proceedings of the 18th International Conference on Computational Linguistics (COLING), pp. 355-361.
20. S.M. Katz Estimation of probabilities from sparse data for the language model component of a speech recogniser IEEE Transactions on Acoustic, Speech, and Signal Processing 35 3 1987 400 401
21. Kneser, R., Ney, R., 1995.Improved backing-off for m-gram language modeling. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 181-184.
22. Lamel, L., Gauvain, J.-L., Adda, G., 2002. Unsupervised acoustic model training. In: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 877-880.
23. C.J. Legetter, and P. Woodland Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models Computer Speech and Language 1995 171 185
24. Ljolje, A., Hindle, D., Riley, M., Sproat, R., 2000. The AT&T LVCSR-2000 system. In: Proceedings of the NIST LVCSR Workshop.
25. Mangu, L., Brill, E., Stolcke, A., 1999. Finding consensus among words: lattice-based word error minimization. In: Proceedings of Eurospeech.
26. Pereira, F.C., Schabes, Y., 1992. Inside-outside reestimation from partially bracketed corpora. In: Proceedings of the 30th Annual Meeting of the Association for Computational Linguistics, pp. 128-135.
27. A. Ratnaparkhi Learning to parse natural language with maximum entropy models Machine Learning 34 1999 151 175
28. Riley, M., Roark, B., Sproat, R., 2003. Good-turing estimation from word lattices for unsupervised language model adaptation. In: Proceedings of the IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), pp. 453-458.
29. B. Roark Probabilistic top-down parsing and language modeling Computational Linguistics 27 2 2001 249 276
30. Roark, B., 2001b. Robust probabilistic predictive syntactic processing. Ph.D. Thesis, Brown University. Available from: < http://arXiv.org/abs/cs/ 0105019>.
31. B. Roark Robust garden path parsing Natural Language Engineering 10 1 2004 1 24
32. Roark, B., Bacchiani, M., 2003. Supervised and unsupervised PCFG adaptation to novel domains. In: Proceedings of the Human Language Technology Conference and Meeting of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL), pp. 205-212.
33. Steedman, M., Hwa, R., Clark, S., Osborne, M., Sarkar, A., Hockenmaier, J., Ruhlen, P., Baker, S., Grim, J., 2003a. Example selection for bootstrapping statistical parsers. In: Proceedings of the Human Language Technology Conference and Meeting of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL), pp. 157-164.
34. Steedman, M., Osborne, M., Sarkar, A., Clark, S., Hwa, R., Hockenmaier, J., Ruhlen, P., Baker, S., Grim, J., 2003b. Bootstrapping statistical parsers from small datasets. In: Proceedings of the Tenth Conference of the European Chapter of the ACL, pp. 331-338.
35. Stolcke, A., 2001. Error modeling and unsupervised language modeling. In: Proceedings of the 2001 NIST Large Vocabulary Conversational Speech Recognition Workshop, Linthicum, MD, May.
36. I.H. Witten, and T.C. Bell The zero-frequency problem: estimating the probabilities of novel events in adaptive text compression IEEE Transactions on Information Theory 37 4 1991 1085 1094
37. Woodland, P., Hain, T., 1998. The September 1998 HTK Hub 5E System. In: The Proceedings of the 9th Hub-5 Conversational Speech Recognition Workshop.
38. Woodland, P., Hain, T., Moore, G., Niesler, T., Povey, D., Tuerk, A., Whittaker, E., 1998. The 1998 HTK broadcast news transcription system: development and results. In: DARPA Broadcast News Transcription and Understanding Workshop.