Articulatory distinctiveness of vowels and consonants: A data-driven approach

Journal of Speech, Language, and Hearing Research

Volumn 56, Issue 5, 2013, Pages 1539-1551

  Wang, Jun ^a,b   Green, Jordan R ^a,b   Samal, Ashok ^a   Yunusova, Yana ^c  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^b UNIVERSITY OF NEBRASKA MEDICAL CENTER   (United States)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

Articulatory consonant space; Articulatory vowel space; Procrustes analysis; Speech production; Support vector machine

Indexed keywords

ADULT; ARTICLE; ARTICULATORY CONSONANT SPACE; ARTICULATORY VOWEL SPACE; BIOMECHANICS; FEMALE; HUMAN; LIP; MIDDLE AGED; MOVEMENT (PHYSIOLOGY); PHONATION; PHONETICS; PHYSIOLOGY; PROCRUSTES ANALYSIS; SPEECH; SPEECH INTELLIGIBILITY; SUPPORT VECTOR MACHINE; TONGUE; VOICE; YOUNG ADULT;

ARTICULATORY CONSONANT SPACE; ARTICULATORY VOWEL SPACE; PROCRUSTES ANALYSIS; SPEECH PRODUCTION; SUPPORT VECTOR MACHINE;

ADULT; BIOMECHANICAL PHENOMENA; FEMALE; HUMANS; LIP; MIDDLE AGED; MOVEMENT; PHONATION; PHONETICS; SPEECH; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; TONGUE; VOICE; YOUNG ADULT;

EID: 84886644229     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/1092-4388(2013/12-0030)     Document Type: Article

References (64)

1. Ball, L. J., Willis, A., Beukelman, D. R., & Pattee, G. L. (2001). A protocol for identification of early bulbar signs in ALS. Journal of Neurological Sciences, 191, 43-53.
2. Boser, B. E., Guyon, I., & Vapnik, V. (1992). A training algorithm for optimal margin classifiers. In D. Haussler (Ed.), Proceedings of the Fifth Annual Workshop on Computational Learning Theory (pp. 144-152). New York, NY: Association for Computing Machinery.
3. Bunton, K., & Story, B. (2010). Identification of synthetic vowels based on a time-varying model of the vocal tract area function. The Journal of Acoustical Society of America, 127, EL146-EL152.
4. Chang, C. C., & Lin, C. J. (2011). LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3), 1-27.
5. Cortes, C., & Vapnik, V. (1995). Support-vector network. Machine Learning, 20, 273-297.
6. Cox, R. F., & Cox, M. A. A. (1994). Multidimensional scaling. London, UK: Chapman & Hall.
7. Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J. M., & Brumberg, J. S. (2010). Silent speech interfaces. Speech Communication, 52, 270-287.
8. Dryden, I. L., & Mardia, K. V. (1998). Statistical shape analysis. Hoboken, NJ: Wiley.
9. Fagan, M. J., Ell, S. R., Gilbert, J. M., Sarrazin, E., & Chapman, P. M. (2008). Development of a (silent) speech recognition system for patients following laryngectomy. Medical Engineering & Physics, 30, 419-425.
10. Fuchs, S., Winkler, R., & Perrier, P. (2008). Do speakers' vocal tract geometries shape their articulatory vowel space? In Proceedings of the 8th International Seminar on Speech Production (pp. 333-336). Retrieved from http://issp2008.loria.fr/Proceedings/PDF/issp2008-77.pdf
11. Gower, J. C. (1975). Generalized Procrustes analysis. Psychometrika, 40, 33-51.
12. Green, J. R., & Nip, I. S. B. (2010). Organization principles in the development of early speech. In B. Maaseen & P. H. H. M. van Lieshout (Eds.), Speech motor control: New developments in basic and applied research (pp. 171-188). Oxford, UK: Oxford University Press.
13. Green, J. R., Nip, I. S. B., Mefferd, A. S., Wilson, E. M., & Yunusova, Y. (2010). Lip movement exaggerations during infantdirected speech. Journal of Speech, Language, and Hearing Research, 53, 1-14.
14. Green, J. R., & Wang, Y. (2003). Tongue-surface movement patterns during speech and swallowing. The Journal of Acoustical Society of America, 113, 2820-2833.
15. Green, J. R., Wilson, E. M., Wang, Y., & Moore, C. A. (2007). Estimating mandibular motion based on chin surface targets during speech. Journal of Speech, Language, and Hearing Research, 50, 928-939.
16. Heracleous, P., Aboutabit, N., & Beautemps, D. (2009). Lip shape and hand position fusion for automatic vowel recognition in cued speech for French. IEEE Signal Processing Letters, 16, 339-342.
17. Higgins, C. M., & Hodge, M. M. (2002). Vowel area and intelligibility in children with and without dysarthria. Journal of Medical Speech-Language Pathology, 10, 271-277.
18. Honda, K., Maeda, S., Hashi, M., Dembowski, J. S., & Westbury, J. R. (1996). Human palate and related structures: Their articulatory consequences. In Proceedings of the International Conference on Spoken Language Processing (pp. 784-787). Baixas, France: International Speech Communication Association.
19. Hueber, T., Benaroya, E-L., Chollet, G., Denby, B., Dreyfus, G., & Stone, M. (2010). Development of a silent speech interface driven by ultrasound and optical images of the tongue and lips. Speech Communication, 52, 288-300.
20. Jin, N., & Mokhtarian, F. (2005). Human motion recognition based on statistical shape analysis. In Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (pp. 4-9). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
21. Johnson, K. (2000). Adaptive dispersion in vowel perception. Phonetica, 57, 181-188.
22. Kim, H., Hasegawa-Johnson, M., & Perlman, A. (2011). Vowel contrast and speech intelligibility in dysarthria. Folia Phoniatrica et Logopaedica, 63, 187-194.
23. King, S., Frankel, J., Livescu, K., McDermott, E., Richmond, K., & Wester, M. (2007). Speech production knowledge in automatic speech recognition. The Journal of the Acoustical Society of America, 121, 723-742.
24. Kuhl, P. K., Andruski, J. E., Chistovich, I. A., Chistovich, L. A., Kozhevnikova, E. V., Ryskina, V. L., Lacerda, F. (1997, August 1). Cross-language analysis of phonetic units in language addressed to infants. Science, 277, 684-686.
25. Kuhl, P. K., & Meltzoff, A. N. (1997). Evolution, nativism, and learning in the development of language and speech. In M. Gopnik (Ed.), The inheritance and innateness of grammars, (pp. 7-44). New York, NY: Oxford University Press.
26. Ladefoged, P., & Johnson, K. (2011). A course in phonetics (6th ed.). Independence, KY: Cengage Learning.
27. Lee, S., Potamianos, A., & Narayanan, S. (1999). Acoustics of children's speech: Developmental changes of temporal and spectral parameters. The Journal of the Acoustical Society of America, 105, 1455-1468.
28. Lindblom, B. (1990). Explaining variation: A sketch of the H and H theory. In W. Hardcastle & A. Marchal (Eds.), Speech production and speech modeling (pp. 403-439). Dordrecht, the Netherlands: Kluwer Academic.
29. Lindblom, B., & Sussman, H. M. (2012). Dissecting coarticulation: How locus equations happen. Journal of Phonetics, 40, 1-19.
30. Livescu, K., Cetin, O., Hasegawa-Johnson, M., King, S., Bartels, C., Borges, N., Saenko, K. (2007). Articulatory feature-based methods for acoustic and audio-visual speech recognition: Summary from the 2006 JHU Summer Workshop. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (pp. 621-624). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
31. McRae, P. A., Tjaden, K., & Schoonings, B. (2002). Acoustic and perceptual consequences of articulatory rate change in Parkinson disease. Journal of Speech, Language, and Hearing Research, 45, 35-50.
32. Mefferd, A. S., & Green, J. R. (2010). Articulatory-to-acoustic relations in response to speaking rate and loudness manipulations. Journal of Speech, Language, and Hearing Research, 53, 1206-1219.
33. Meyer, G. J., Gustafson, S. C., & Arnold, G. D. (2002). Using Procrustes distance and shape space for automatic target recognition. SPIE 4667, Image Processing; Algorithms and Systems, 66-73. doi:10.1117/12.468018
34. Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008, May). Predicting human brain activity associated with the meanings of nouns. Science, 320, 1191-1195.
35. Neel, A. T. (2008). Vowel space characteristics and vowel identification accuracy. Journal of Speech, Language, and Hearing Research, 51, 574-585.
36. Perkell, J. S., & Cohen, M. H. (1989). An indirect test of the quantal nature of speech in the production of the vowels /i/, /a/ and /u/. Journal of Phonetics, 17, 123-133.
37. Potamianos, G., Neti, C., Gravier, G., Garg, A., & Senior, A. W. (2003). Recent advances in the automatic recognition of audiovisual speech. Proceedings of IEEE, 91, 1306-1326.
38. Richardson, M., Bilmes, J., & Diorio, C. (2000). Hidden-articulator Markov models for speech recognition. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (pp. 713-716). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
39. Rosner, B. S., & Pickering, J. B. (1994). Vowel perception and production. Oxford, UK: Oxford University Press.
40. Rudzicz, F. (2011). Articulatory knowledge in the recognition of dysarthric speech. IEEE Transactions on Audio, Speech, and Language Processing, 19, 947-960.
41. Rvachew, S., Mattock, K., Polka, L., & Ménard, L. (2006). Developmental and cross-linguistic variation in the infant vowel space: The case of Canadian English and Canadian French. The Journal of the Acoustical Society of America, 120, 2250-2259.
42. Sadeghi, V. S., & Yaghmaie, K. (2006). Vowel recognition using neural networks. International Journal of Computer Science and Network Security, 6, 154-158.
43. Saenko, K., Livescu, K., Glass, J., & Darrell, T. (2009). Multistream articulatory feature-based models for visual speech recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 1700-1707.
44. Shinchi, T. (1998). Vowel recognition according to lip shapes by using neural networks. In Proceedings of the IEEE International Joint Conference on Computational Intelligence (Vol. 3, pp. 1772-1777). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
45. Sibson, R. (1978). Studies in the robustness of multidimensional scaling: Procrustes statistics. Journal of Royal Statistical Society: Series B, 40, 234-238.
46. Stevens, K. N., & Klatt, D. H. (1974). Role of formant transitions in the voiced-voiceless distinction for stops. The Journal of Acoustical Society of America, 55, 653-659.
47. Sujith, K. R., & Ramanan, G. V. (2005, October). Procrustes analysis and Moore-Penrose inverse based classifiers for face recognition. Paper presented at the International Workshop on Biometric Recognition Systems, Beijing, China.
48. Tjaden, K., & Wilding, G. E. (2004). Rate and loudness manipulations in dysarthria: Acoustic and perceptual findings. Journal of Speech, Language, and Hearing Research, 47, 766-783.
49. Tsao, Y. C., & Iqbal, K. (2005). Can acoustic vowel space predict the habitual speech rate of the speaker? In Proceedings of the IEEE International Conference on Engineering in Medicine and Biology (pp. 1220-1223). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
50. Turner, G. S., Tjaden, K., & Weismer, G. (1995). The influence of speaking rate on vowel space and speech intelligibility for individuals with amyotrophic lateral sclerosis. Journal of Speech, Language, and Hearing Research, 38, 1001-1013.
51. Visser, M., Poel, M., & Nijholt, A. (1999). Classifying visemes for automatic lipreading. In Lecture notes of computer science (Vol. 1692, pp. 349-352). Berlin, Germany: Springer.
52. Wang, J. (2011). Silent speech recognition from articulatory motion (Unpublished doctoral dissertation). University of Nebraska- Lincoln.
53. Wang, J., Green, J. R., Samal, A., & Carrell, T. D. (2010). Vowel recognition from continuous articulatory movements for speaker-dependent applications. In Proceedings of the IEEE International Conference on Signal Processing and Communication Systems (pp. 1-7). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
54. Wang, J., Green, J. R., Samal, A., & Marx, D. B. (2011, August). Quantifying articulatory distinctiveness of vowels. Paper presented at InterSpeech, Florence, Italy. Retrieved from http://digitalcommons.unl.edu/specedfacpub/74/
55. Wang, J., Samal, A., Green, J. R., & Carrell, T. D. (2009). Vowel recognition from articulatory position time-series data. In Proceedings of the IEEE International Conference on Signal Processing and Communication Systems (pp. 1-6). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
56. Wang, J., Samal, A., Green, J. R., & Rudzicz, F. (2012a). Sentence recognition from articulatory movements for silent speech interfaces. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (pp. 4985-4988). Piscataway, NJ: Institute of Electrical and Electronics Engineers.
57. Wang, J., Samal, A., Green, J. R., & Rudzicz, F. (2012b, September). Whole-word recognition from articulatory movements for silent speech interfaces. Paper presented at InterSpeech, Portland, OR. Retrieved from http://digitalcommons.unl.edu/specedfacpub/76/
58. Weismer, G., Jeng, J. Y., Laures, J. S., Kent, R. D., & Kent, J. F. (2001). Acoustic and intelligibility characteristics of sentence production in neurogenic speech disorders. Folia Phoniatrica et Logopaedica, 53, 1-18.
59. Westbury, J. (1994). X-ray microbeam speech production database user's handbook. Unpublished manuscript, University of Wisconsin-Madison.
60. Yunusova, Y., Green, J. R., & Mefferd, A. (2009). Accuracy assessment for AG500 electromagnetic articulograph. Journal of Speech, Language, and Hearing Research, 52, 547-555.
61. Yunusova, Y., Green, J. R., Wang, J., Pattee, G., & Zinman, L. (2011). A protocol for comprehensive assessment of bulbar dysfunction in amyotrophic lateral sclerosis (ALS). Journal of Visualized Experiments, 48, e2422. doi:10.3791/2422
62. Yunusova, Y., Weismer, G., & Lindstrom, J. (2011). Classification of vocalic segments from articulatory kinematics: healthy controls and speakers with dysarthria. Journal of Speech, Language, and Hearing Research, 54, 1302-1311.
63. Yunusova, Y., Weismer, G., Westbury, J. R., & Lindstrom, M. (2008). Articulatory movements during vowels in speakers with dysarthria and in normal controls. Journal of Speech, Language, and Hearing Research, 51, 596-611.
64. Zajac, D. J., Roberts, J. E., Hennon, E. A., Harris, A. A., Barnes, E. F., & Misenheimer, J. (2006). Articulation rate and vowel space characteristics of young males with fragile X syndrome: Preliminary acoustic findings. Journal of Speech, Language, and Hearing Research, 49, 1147-1155.