Cross-lingual automatic speech recognition using tandem features

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 12, 2013, Pages 2506-2515

  Lal, Partha ^a   King, Simon ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Automatic speech recognition; multilayer perceptrons

Indexed keywords

ACOUSTIC FEATURES; ACOUSTIC SIMILARITIES; ARTICULATORY FEATURES; AUTOMATIC SPEECH RECOGNITION; CROSS-LINGUAL SETTINGS; SOURCE LANGUAGE; SPEECH RECORDING; TARGET LANGUAGE;

MULTILAYER NEURAL NETWORKS; NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH PROCESSING;

LINGUISTICS;

EID: 84887376692     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2277932     Document Type: Article

References (30)

1. A. Janin, A. Stolcke,X.Anguera,K. Boakye, O. Çetin, J. Frankel, and J. Zheng, "The ICSI-SRI Spring 2006 Meeting Recognition System," in Proc. 3rd Int. Workshop Mach. Learn. Multimodal Interact.: (MLMI '06), S. Renals, S. Bengio, and J. Fiscus, Eds., 2007, Lecture Notes in Computer Science, pp. 444-456, Washington, D.C.: Springer.
2. , R. G. Gordon, Jr. and B. F. Grimes, Eds., Ethnologue: Languages of the World, 15th ed. Dallas, TX, USA: SIL International, 2005 [Online]. Available: www.ethnologue.com
3. T. Schultz and A. Waibel, "Language adaptive LVCSR through polyphone decision tree specialization," in Workshop Multi-Lingual Interoperability Speech Technol. (MIST), Leusden, The Netherlands, Sep. 1999, pp. 85-90.
4. D. Imseng, H. Bourlard, M. Magimai.-Doss, and J. Dines, "Language dependent universal phoneme posterior estimation for mixed language speech recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., May 2011, pp. 5012-5015.
5. T. Schultz and K. Kirchhoff, Multilingual Speech Processing. Burlington, MA, USA: Academic, 2006.
6. J. Frankel and S. King, "A hybrid ANN/DBN approach to articulatory feature recognition," in Proc. 9th Eur. Conf. Speech Commun. Technol., Lisbon, Portugal, Sep. 2005.
7. L. R. Rabiner, "A tutorial on hiddenMarkovmodels and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
8. H. Hermansky, D. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2000, vol. 3, pp. 1635-1638.
9. D. P. W. Ellis, R. Singh, and S. Sivadas, "Tandem acoustic modeling in large-vocabulary recognition," in IEEE Int. Conf. Acoust., Speech, Signal Process., Salt Lake City, UT, USA, May 2001, vol. 1, pp. 517-520. (Pubitemid 32839300)
10. Q. Zhu, A. Stolcke, B. Y. Chen, and N. Morgan, "Using MLP features in SRI's conversational speech recognition system," in Proc. 9th Eur. Conf. Speech Commun. Technol., Lisbon, Portugal, Sep. 2005, pp. 2141-2144. (Pubitemid 43908517)
11. O. Çetin, A. Kantor, S. King, C. Bartels,M.Magimai-Doss, J. Frankel, and K. Livescu, "An articulatory feature-based tandem approach and factored observation modeling," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Honolulu, HI, USA, Apr. 2007.
12. S. Sivadas and H. Hermansky, "On use of task independent training data in tandem feature extraction," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Montreal, QC, Canada, 2004, vol. 1, pp. I-541-I-544.
13. Y. K. Muthusamy, R. A. Cole, and B. T. Oshika, "The OGI multi-language telephone speech corpus," in Proc. 2nd Int. Conf. Spoken Lang. Process., Banff, AB, Canada, 1992, pp. 895-898.
14. Speech in Noisy Environments Database, [Online]. Available: http://www.speech.sri.com/projects/spine/
15. A. Stolcke, F. Grézl, M.-Y. Hwang, X. Lei, N. Morgan, and D. Vergyri, "Cross-domain and cross-language portability of acoustic features estimated by multilayer perceptrons," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Toulouse, France, May 2006, vol. I, pp. 321-324.
16. O. Çetin,M.Magimai-Doss, A. Kantor, S. King, C. Bartels, J. Frankel, and K. Livescu, "Monolingual and crosslingual comparison of tandem features derived from articulatory and phone MLPs," in Proc. 10th Biannual IEEE Workshop Autom. Speech Recognition Understand., Kyoto, Japan, Dec. 2007.
17. L. Toth, J. Frankel, G. Gosztolya, and S. King, "cross-lingual portability of MLP-based tandem features-A case study for English and Hungarian," in Proc. 9th Int. Conf. Int. Speech Commun. Assoc., Brisbane, Australia, Sep. 2008, pp. 2695-2698.
18. J. Frankel, M. Magimai-Doss, S. King, K. Livescu, and O. Çetin, "Articulatory feature classifiers trained on 2000 hours of telephone speech," in Proc. 8th Int. Conf. Spoken Lang. Process., Antwerp, Belgium, Aug. 2007.
19. S. Thomas, S. Ganapathy, and H. Hermansky, "Cross-lingual and multi-stream posterior features for low-resource LVCSR systems," in Proc. 11th Annu. Conf. Int. Speech Commun. Assoc., Makuhari, Japan, Sep. 2010.
20. R. Rasipuram andM.Magimai-Doss, "Integrating articulatory features using Kullback-Leibler divergence based acoustic model for phoneme recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2011, pp. 5192-5195.
21. Y.-R. Chao, A Grammar of Spoken Chinese. Berkeley, CA, USA: Univ. of California Press, 1968.
22. P. Ladefoged and I. Maddieson, The Sounds of the World's Languages. Hoboken, NJ, USA: Blackwell, 1996.
23. J. W. Harris, Spanish Phonology. Cambridge,MA, USA: MIT Press, 1969.
24. S. Tsakalidis and W. Byrne, "Acoustic training from heterogeneous data sources: Experiments in Mandarin conversational telephone speech transcription," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Philadelphia, PA, USA, Mar. 2005.
25. N. Kumar, "Investigation of silicon auditory models and generalization of linear discriminant analysis for improved speech recognition," Ph.D. dissertation, Johns Hopkins Univ., Baltimore, MD, USA, 1997.
26. S. J. Young, G. Evermann, M. J. F. Gales, T. Hain, D. Kershaw, G. Moore, J. Odell, D. Ollason, D. Povey, V. Valtchev, and P. C. Woodland, TheHTK Book. Cambridge,U.K.: Cambridge Univ. Eng.Dept., 2006, version 3.4.
27. D. Johnson, D. Ellis, C. Oei, C. Wooters, and P. Faerber, Quicknet, 2011, [Online]. Available: www.icsi.berkeley.edu/Speech/qn.html
28. L. Gillick and S. Cox, "Some statistical issue in the comparison of speech recognition algorithms," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Glasgow, U.K., May 1989, pp. 532-535. (Pubitemid 20604171)
29. T. Schultz and A. Waibel, "Language independent and language adaptive acoustic modeling for speech recognition," Speech Commun., vol. 35, pp. 31-51, Aug. 2001. (Pubitemid 32599645)
30. P. Lal, "Cross-lingual automatic speech recognition using tandem features," Ph.D. dissertation, Univ. of Edinburgh, Edinburgh, U.K., 2011.