A multimodal real-time MRI articulatory corpus for speech research

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 837-840

  Narayanan, Shrikanth ^a   Bresch, Erik ^a   Ghosh, Prasanta ^a   Goldstein, Louis ^a   Katsamanis, Athanasios ^a   Kim, Yoon ^a   Lammert, Adam ^a   Proctor, Michael ^a   Ramanarayanan, Vikram ^a   Zhu, Yinghua ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Large scale phonetic tools; Multi modal database; Real time MRI; Speech corpora; Speech production

Indexed keywords

AMERICAN ENGLISH; LARGE-SCALE DATABASE; MID-SAGITTAL PLANES; MULTI-MODAL; MULTIMODAL DATABASE; REAL-TIME MRI; SPEECH CORPORA; SPEECH DATA; SPEECH PRODUCTION; SPEECH RESEARCH; TISSUE BOUNDARY; TOOLSETS; UPPER AIRWAY; VIDEO FRAME; VOCAL-TRACTS;

DATABASE SYSTEMS; MAGNETIC RESONANCE IMAGING; TISSUE;

SOFTWARE AGENTS;

EID: 84865738977     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. A. Wrench and W. Hardcastle, "A multichannel articulatory speech database and its application for automatic speech recognition," in Proc. 5th SSP, Kloster Seeon, 2000, pp. 305-308.
2. R. Rose, J. Schroeter, and M. M. Sondhi, "The potential role of speech production models in automatic speech recognition," JASA, vol. 99, pp. 1699-1709, 1995.
3. A. M. Liberman and D. H. Whalen, "On the relation of speech to language," Trends in Cog. Sci., vol. 4, no. 5, pp. 187-196, 2000.
4. C. Y. Espy-Wilson, "Articulatory strategies, speech acoustics and variability," in From Sound to Sense: 50+ Years of Discoveries in Speech Communication, J. Slifka, S. Manuel, and M. Mathies, Eds. MIT, 2004, pp. B62-B76.
5. T.-P. Jung, A. Krishnamurthy, S. Ahalt, M. Beckman, and S. Lee, "Deriving gestural score from articulator-movement records using weighted temporal decomposition," IEEE Trans. Speech and Audio Processing, vol. 4, no. 1, pp. 2-18, 1996.
6. S. Lee, E. Bresch, and S. S. Narayanan, "An exploratory study of emotional speech production using functional data analysis techniques," in Proc. ISSP, Ubatuba, Brazil, 2006, pp. 11-17.
7. S. King, J. Frankel, K. Livescu, E. McDermott, K. Richmond, and M. Wester, "Speech production knowledge in automatic speech recognition," JASA, vol. 121, no. 2, pp. 723-742, 2007.
8. V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, and L. Goldstein, "Articulatory information for noise robust speech recognition," IEEE Trans. Audio, Speech and Lang. Proc., in press.
9. J. R.Westbury, G. Turner, and J. Dembowski, "X-Ray microbeam speech production database user's handbook," Waisman Center, University of Wisconsin, Tech. Rep., 1994.
10. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, "DARPA TIMIT Acoustic Phonetic Continuous Speech Corpus CDROM," 1993.
11. S. Narayanan, K. Nayak, S. Lee, A. Sethy, and D. Byrd, "An approach to real-time magnetic resonance imaging for speech production," JASA, vol. 115, pp. 1771-1776, 2004.
12. E. Bresch, Y.-C. Kim, K. Nayak, D. Byrd, and S. Narayanan, "Seeing speech: Capturing vocal tract shaping using real-time MRI," IEEE Sig. Proc. Mag., vol. 25, no. 3, pp. 123-132, 2008.
13. E. Bresch, J. Nielsen, K. Nayak, and S. Narayanan, "Synchronized and noise-robust audio recordings during realtime MRI scans," JASA, vol. 120, no. 4, pp. 1791-1794, 2006.
14. A. Katsamanis, M. Black, P. Georgiou, L. Goldstein, and S. Narayanan, "SailAlign: Robust long speech-text alignment," in Workshop on New Tools and Methods for VLSPR, 2011.
15. E. Bresch and S. Narayanan, "Region segmentation in the frequency domain applied to upper airway real-time MRI," IEEE Trans. Medical Imaging, vol. 28, no. 3, pp. 323-338, 2009.
16. A. Lammert, M. I. Proctor, and S. S. Narayanan, "Data-Driven Analysis of Realtime Vocal Tract MRI using Correlated Image Regions," in Proc. Interspeech, Makuhari, Japan, Sep 2010.
17. C. Hagedorn, M. Proctor, and L. Goldstein, "Automatic Analysis of Geminate Consonant Articulation using Real-time Magnetic Resonance Imaging," in Proc. 9th ISSP, Montreal, Canada, 2011.
18. M. Proctor, A. Lammert, L. Goldstein, and S. Narayanan, "Temporal analysis of articulatory speech errors using direct image analysis of rtMRI," JASA, vol. 128, no. 4, pp. 2289-2289, 2010.
19. A. Lammert, M. Proctor, and S. Narayanan, "Morphological Variation in the Adult Vocal Tract: A Study Using rtMRI," in Proc. 9th ISSP, Montreal, Canada, 2011.
20. M. I. Proctor, N. Katsamanis, L. Goldstein, C. Hagedorn, A. Lammert, and S. Narayanan, "Direct estimation of articulatory dynamics from real-time magnetic resonance image sequences," in Proc. Interspeech, Florence, Italy, Aug 2011.
21. B. Atal, J. Chang, M. Mathews, and J. Tukey, "Inversion of articulatory-to-acoustic transformation in the vocal tract by a computer-sorting technique," JASA, vol. 63, pp. 1535-1555, 1978.
22. P. K. Ghosh and S. S. Narayanan, "A generalized smoothness criterion for acoustic-to-articulatory inversion," JASA, vol. 128, no. 4, pp. 2162-2172, 2010.
23. E. Bresch, A. Katsamanis, L. Goldstein, and S. Narayanan, "Statistical multi-stream modeling of real-time MRI articulatory speech data," in Proc. Interspeech, Makuhari, Japan, 2010.
24. A. Katsamanis, E. Bresch, V. Ramanarayanan, and S. Narayanan, "Validating rt-MRI based articulatory representations via articulatory recognition," in Proc. Interspeech, Florence, Italy, Aug 2011.