Learning lexicons from speech using a pronunciation mixture model

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 2, 2013, Pages 357-366

  McGraw, Ian ^a   Badr, Ibrahim ^a   Glass, James R ^a  

^a Department of Electrical Engineering and Computer Science   (United States)

Author keywords

Baseform generation; dictionary training with acoustics via EM; pronunciation learning; stochastic lexicon

Indexed keywords

ACHILLES HEEL; AUTOMATIC SPEECH RECOGNIZERS; BASEFORM GENERATION; BASEFORM PRONUNCIATION; CONTINUOUS SPEECH; HIGH QUALITY; LANGUAGE MODEL; MANUAL INTERVENTION; MIXTURE MODEL; PARAMETER SETTING; PRONUNCIATION LEARNING; SPEECH DATA; STOCHASTIC LEXICON; TRAINING DATA; WEATHER INFORMATION;

COMPUTATIONAL LINGUISTICS;

STOCHASTIC SYSTEMS;

EID: 84871369973     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2226158     Document Type: Article

References (34)

1. I. Badr, I. McGraw, and J. R. Glass, "Learning new word pronunciations from spoken examples, " in Proc. INTERSPEECH, 2010, pp. 2294-2297.
2. I. Badr, I. McGraw, and J. R. Glass, "Pronunciation learning from continuous speech, " in Proc. INTERSPEECH, 2011, pp. 549-552.
3. M. Bisani and H. Ney, "Joint-sequence models for grapheme-tophoneme conversion, " Speech Commun., vol. 50, no. 5, pp. 434-451, May 2008.
4. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm, " J. R. Statist. Soc., Ser. B, vol. 39, no. 1, pp. 1-38, 1977.
5. L. R. Bahl, F. Jelinek, and R. L. Mercer, "A maximum likelihood approach to continuous speech recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-5, no. 2, pp. 179-190, Mar. 1983. (Pubitemid 13555897)
6. J. R. Glass, "A probabilistic framework for segment-based speech recognition, " Comput. Speech Lang., vol. 17, no. 2-3, pp. 137-152, 2003.
7. I. L. Hetherington, "The MIT finite-state transducer toolkit for speech and language processing, " in Proc. INTERSPEECH, 2004, pp. 2609-2612.
8. I. L. Hetherington, "An efficient implementation of phonological rules using finite-state transducers, " in Proc. EuroSpeech, 2001, pp. 1599-1602.
9. T. J. Hazen, I. L. Hetherington, H. Shu, and K. Livescu, "Pronunciation modeling using a finite-state transducer representation, " Speech Commun., vol. 46, no. 2, pp. 189-203, 2005. (Pubitemid 40753202)
10. H. Strik and C. Cucchiarini, "Modeling pronunciation variation for ASR: A survey of the literature, " Speech Commun., vol. 29, no. 2-4, pp. 225-246, 1999. (Pubitemid 30514833)
11. I. L. Hetherington, "A characterization of the problem of new, out-of-vocabulary words in continuous-speech recognition and understanding, " Ph. D. dissertation, Massachusetts Inst. of Technol., Cambridge, MA, 1995.
12. F. Wessel, R. Schlüter, K. Macherey, and H. Ney, "Confidence measures for large vocabulary continuous speech recognition, " IEEE Trans. Speech Audio Process., vol. 9, no. 3, pp. 288-298, Mar. 2001. (Pubitemid 32286598)
13. M. Bisani and H. Ney, "Open vocabulary speech recognition with flat hybrid models, " in Proc. INTERSPEECH, 2005, pp. 725-728. (Pubitemid 43908165)
14. S. F. Chen, "Conditional and joint models for grapheme-to-phoneme conversion, " in Proc. INTERSPEECH, 2003, pp. 2033-2036.
15. R. M. Kaplan and M. Kay, "Regular models of phonological rule systems, " Comput. Linguist., vol. 20, pp. 331-378, 1994.
16. S. Seneff, "Reversible sound-to-letter/letter-to-sound modeling based on syllable structure, " in Proc. Human Lang. Technol. : Conf. North Amer. Chap. Assoc. for Comput. Linguist. (HLT-NACCL), 2007, pp. 153-156.
17. Y. Marchand and R. I. Damper, "A multi-strategy approach to improving pronunciation by analogy, " Comput. Linguist., vol. 26, pp. 195-219, 2000.
18. J. Bellegarda, "Unsupervised, language-independent grapheme-tophoneme conversion by latent analogy, " Speech Commun., vol. 46, no. 2, pp. 140-152, 2005. (Pubitemid 40753199)
19. A. Laurent, P. Delglise, and S. Meignier, "Grapheme to phoneme conversion using an SMT system, " in Proc. INTERSPEECH, 2009, pp. 708-711.
20. S. Jiampojamarn and G. Kondrak, "Online discriminative training for grapheme-to-phoneme conversion, " in Proc. INTERSPEECH, 2009, pp. 1303-1306.
21. V. Pagel, K. Lenzo, and A. W. Black, "Letter to sound rules for accented lexicon compression, " in Proc. Int. Conf. Spoken Lang. Process. (ICSLP), 1998.
22. J. Häkkinen, J. Suontausta, S. Riis, and K. J. Jensen, "Assessing text-to-phoneme mapping strategies in speaker independent isolated word recognition, " Speech Commun., vol. 41, no. 2-3, pp. 455-467, 2003.
23. S. Wang, "Using graphone models in automatic speech recognition, " M. S. thesis, Massachusetts Inst. of Technol., Cambridge, MA, 2009.
24. D. McAllaster, L. Gillick, F. Scattone, and M. Newman, "Fabricating conversational speech data with acoustic models: A program to examine model-data mismatch, " in Proc. Int. Conf. Spoken Lang. Process. (ICSLP), 1998.
25. B. Maison, "Automatic baseform generation from acoustic data, " in Proc. INTERSPEECH, 2003, pp. 2545-2548.
26. G. F. Choueiter, M. I. Ohannessian, S. Seneff, and J. R. Glass, "A turbo-style algorithm for lexical baseforms estimation, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2008, pp. 4313-4316.
27. L. R. Bahl, S. Das, P. V. Desouza, M. Epstein, R. L. Mercer, B. Merialdo, D. Nahamoo, M. A. Picheny, and J. Powell, "Automatic phonetic baseform determination, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1991, pp. 173-176.
28. X. Li, A. Gunawardana, and A. Acero, "Adapting grapheme-tophoneme conversion for name recognition, " in Proc. Autom. Speech Recognit. Understand. Workshop (ASRU), 2007, pp. 130-135.
29. O. Vinyals, L. Deng, D. Yu, and A. Acero, "Discriminative pronounciation learning using phonetic decoder and minimum-classification-error criterion, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2009, pp. 4445-4448.
30. V. Zue, S. Seneff, J. Glass, J. Polifroni, C. Pao, T. J. Hazen, and L. Hetherington, "Jupiter: A telephone-based conversational interface for weather information, " IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 85-96, Jan. 2000. (Pubitemid 30540738)
31. P. Kingsbury, S. Strassel, and R. MacIntyre, CALLHOME American English lexicon (PRONLEX), 1997, lDC Catalog No. LDC97L20.
32. L. Gillick and S. Cox, "Some statistical issues in the comparison of speech recognition algorithms, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1989, pp. 532-535. (Pubitemid 20604171)
33. I. McGraw, S. Cyphers, P. Pasupat, J. Liu, and J. Glass, "Automating crowd-supervised learning for spoken language systems, " in Proc. INTERSPEECH, 2012.
34. C. Lee and J. R. Glass, "A nonparametric Bayesian approach to acoustic model discovery, " in Proc. 50th Annu. Meeting Assoc. Comput. Linguist. (ACL), 2012, pp. 40-49.