Using automatic alignment to analyze endangered language data: Testing the viability of untrained alignment

Journal of the Acoustical Society of America

Volumn 134, Issue 3, 2013, Pages 2235-2246

  Dicanio, Christian ^a   Nam, Hosung ^a   Whalen, Douglas H ^a   Timothy Bunnell, H ^b   Amith, Jonathan D ^c   García, Rey Castillo ^d  

^a HASKINS LABORATORIES   (United States)

^b NEMOURS CHILDREN S CLINIC   (United States)

^c GETTYSBURG COLLEGE   (United States)

^d Secretaría de Educación Pública   (Mexico)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT ACCURACY; ALIGNMENT SYSTEM; AUTOMATIC ALIGNMENT; CONTEXTUALIZATION; ENDANGERED LANGUAGES; PHONETIC ANALYSIS; SMALL DATA SET; TARGET LANGUAGE;

LINGUISTICS; SPEECH PROCESSING; TELEPHONE SETS; TELEPHONE SYSTEMS;

ALIGNMENT;

ACOUSTICS; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPARATIVE STUDY; COMPUTER PROGRAM; FEASIBILITY STUDY; HUMAN; PHONETICS; REPRODUCIBILITY; SIGNAL PROCESSING; SOUND DETECTION; SPEECH; SPEECH ANALYSIS; VOICE;

ACOUSTICS; FEASIBILITY STUDIES; HUMANS; PATTERN RECOGNITION, AUTOMATED; PHONETICS; REPRODUCIBILITY OF RESULTS; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOFTWARE DESIGN; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH PRODUCTION MEASUREMENT; VOICE QUALITY;

EID: 84883392022     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4816491     Document Type: Article

References (49)

1. Adda-Decker, M., and Snoeren, N. D. (2011). " Quantifying temporal speech reduction in French using forced speech alignment.," J. Phonetics 39, 261-270. 10.1016/j.wocn.2010.11.011
2. Baayen, R. H. (2008). Analyzing Linguistic Data: A Practical Introduction to Statistics Using R (Cambridge University Press, Cambridge, UK).
3. Badenhorst, J., van Heerden, C., Davel, M., and Barnard, E. (2011). " Collecting and evaluating speech recognition corpora for 11 South African languages.," Lang. Res. Eval. 45 (3), 289-309. 10.1007/s10579-011-9152-1
4. Bates, D. M. (2005). " Fitting linear mixed models in R.," R News 5, 27-30.
5. Beddor, P. S., and Krakow, R. A. (1999). " Perception of coarticulatory nasalization by speakers of English and Thai: Evidence for partial compensation.," J. Acoust. Soc. Am. 106 (5), 2868-2887. 10.1121/1.428111
6. Bickel, B., Banjade, G., Gaenszle, M., Lieven, E., Paudyal, N. P., Rai, I. P., Rai, M., Rai, N. K., and Stoll, S. (2007). " Free prefix ordering in Chintang.," Language 83 (1), 43-73. 10.1353/lan.2007.0002
7. Boersma, P., and Weenink, D. (2012). "Praat: Doing phonetics by computer" [computer program], www.praat.org (date last viewed 10/1/12).
8. Boula de Mareüil, P., Corredor-Ardoy, C., and Adda-Decker, M. (1999). " Multi-lingual automatic phoneme clustering.," in Proceedings of the 14th International Congress of the Phonetic Sciences, San Francisco, CA, pp. 1209-1212.
9. Burget, L., Schwarz, P., Agarwal, M., Akyazi, P., Feng, K., Ghoshal, A., Glembek, O., Goel, N., Karafiát, M., Povey, D., Rastrow, A., Rose, R. C., and Thomas, S. (2010). " Multilingual acoustic modeling for speech recognition based on subspace Gaussian mixture models.," in Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 4334-4337.
10. Dalsgaard, P., Andersen, O., and Barry, W. (1991). " Multi-lingual label alignment using acoustic- phonetic features derived by neural-network technique.," Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Vol. 1, 197-200.
11. Dankovičová, J. (1997). " Czech.," J. Int. Phonetic Assoc. 27 (1), 77-80. 10.1017/S0025100300005442
12. DiCanio, C., Amith, J., and Castillo-García, R. (2012). " Phonetic alignment in Yoloxóchitl Mixtec tone.," talk presented at The Society for the Study of the Indigenous Languages of the Americas, Annual Meeting, Portland, OR.
13. Du Bois, J. W. (1987). " The discourse basis of ergativity.," Language 63 (4), 805-855. 10.2307/415719
14. Garofolo, J. S., Lamel, L. F., Fisher, W. M., Fiscus, J. G., Pallett, D. S., Dahlgren, N. L., and Zue, V. (1993). TIMIT Acoustic-Phonetic Continuous Speech Corpus (Linguistic Data Consortium, Philadelphia).
15. Hai, D. V., Xiao, X., Chng, E. S., and Li, H. (2012). " Context dependent phone mapping for cross-lingual acoustic modeling.," in Proceedings of ISCSLP, pp. 16-20.
16. Hinton, G., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., and Kingsbury, B. (2012). " Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups.," IEEE Signal Process. Mag. 29 (6), 82-97. 10.1109/MSP.2012.2205597
17. Hirose, K., and Kawanami, H. (2002). " Temporal rate change of dialogue speech in prosodic units as compared to read speech.," Speech Commun. 36, 97-111. 10.1016/S0167-6393(01)00028-0
18. Hosom, J-P. (2009). " Speaker-independent phoneme alignment using transition-dependent states.," Speech Commun. 51, 352-368. 10.1016/j.specom.2008.11.003
19. Huffman, M. K. (2005). " Segmental and prosodic effects on coda glottalization.," J. Phonetics 33, 335-362. 10.1016/j.wocn.2005.02.004
20. Hura, S. L., Lindblom, B., and Diehl, R. L. (1992). " On the role of perception in shaping phonological assimilation rules.," Lang. Speech 35 (1-2), 59-72.
21. Imseng, D., Bourlard, H., and Garner, P. N. (2012). " Boosting under-resourced speech recognizers by exploiting out of language data-A case study on Afrikaans.," in Proceedings of the 3rd International Workshop on Spoken Languages Technologies for Under-resourced Languages, pp. 60-67.
22. Jarifi, S., Pastor, D., and Rosec, O. (2008). " A fusion approach for automatic speech segmentation of large corpora with application to speech synthesis.," Speech Commun. 50, 67-80. 10.1016/j.specom.2007.07.001
23. Jones, D., and Ward, D. (1969). The Phonetics of Russian (Cambridge University Press, Cambridge, UK).
24. Karafiát, M., Janda, M., Černocky, J., and Burget, L. (2012). " Region dependent linear transforms in multilingual speech recognition.," in Proceedings from ICASSP 2012, pp. 4885-4888.
25. Krauss, M. (1992). " The world's languages in crisis.," Language 68, 4-10. 10.1353/lan.1992.0075
26. Laan, G. P. M. (1997). " The contribution of intonation, segmental durations, and spectral features to the perception of a spontaneous and a read speaking style.," Speech Commun. 22, 43-65. 10.1016/S0167-6393(97)00012-5
27. Lei, X., Hwang, M-Y., and Ostendorf, M. (2005). " Incorporating tone-related MLP posteriors in the feature representation for Mandarin ASR.," in Proceedings of Interspeech-2005, Lisbon, Portugal, pp. 2981-2984.
28. Lin, C-Y., Roger Jang, J-S., Chen, K-T. (2005). " Automatic segmentation and labeling for Mandarin Chinese speech corpora for concatenation-based TTS.," Comput. Ling. Chinese Lang. Process. 10 (2), 145-166.
29. Livescu, K., Fosler-Lussier, E., and Metze, F. (2012). " Subword modeling for automatic speech recognition: Past, present, and emerging approaches.," IEEE Signal Process. Mag. November, 44-57.
30. Macken, M. A., and Salmons, J. C. (1997). " Prosodic templates in sound change.," Diachronica 14 (1), 31-66. 10.1075/dia.14.1.03mac
31. Malfrère, F., Deroo, O., Dutoit, T., and Ris, C. (2003). " Phonetic alignment: Speech synthesis-based vs. Viterbi-based.," Speech Commun. 40, 503-515. 10.1016/S0167-6393(02)00131-0
32. Manuel, S. Y. (1991). " Some phonetic bases for the relative malleability of syllable-final versus syllable-initial consonants.," in Proceedings of the 12th International Congress of Phonetic Sciences, Université de Provence, Aix-en-Provence, Vol. 5, pp. 118-121.
33. Mehta, G., and Cutler, A. (1988). " Detection of target phonemes in spontaneous and read speech.," Lang. Speech 31 (2), 135-156.
34. Ní Chasaide, A., Wogan, J., Ó Raghallaigh, B., Ní Bhriain, Á., Zoerner, E., Berthelsen, H., and Gobl, C. (2006). Speech Technology for Minority Languages: The Case of Irish (Gaelic), in INTERSPEECH-2006, pp. 181-184.
35. Ohala, J. (1990). " The phonetics and phonology of aspects of assimilation.," Papers Lab. Phonol. 1, 258-275
36. R Development Core Team (2012). "R: A language and environment for statistical computing" [computer program], http://www.R-project.org, R Foundation for Statistical Computing, Vienna, Austria (date last viewed 10/1/12).
37. Rabiner, Lawrence, R., and Juang, B. H. (1993). Fundamentals of Speech Recognition, Prentice-Hall Signal Processing Series (Prentice Hall, Englewood Cliffs, NJ).
38. Roux, J. C., and Visagie, A. S. (2007). " Data-driven approach to rapid prototyping Xhosa speech synthesis.," in Proceedings of the 6th ISCA Workshop on Speech Synthesis, pp. 143-147.
39. Silverman, K., and Pierrehumbert, J. (1990). " The timing of prenuclear high accents in English.," in Papers in Laboratory Phonology I: Between the Grammar and Physics of Speech, edited by, J. Kingston, and, M. Beckman, Cascadilla Proceedings Project, Somerville, MA, pp. 103-112.
40. Sim, K. C., and Li, H. (2008a). " Robust phone mapping using decision tree clustering for cross-lingual phone recognition.," in Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 4309-4312.
41. Sim, K. C., and Li, H. (2008b). " Context-sensitive probabilistic phone mapping model for cross-lingual speech recognition.," In Proceedings of Interspeech 2008, International Speech Communication Association (ISCA), pp. 2715-2718.
42. Whalen, D. H., and Simons, G. F. (2012). " Endangered language families.," Language 88, 155-173. 10.1353/lan.2012.0012
43. Whalen, D. H., and Xu, Y. (1992). " Information for Mandarin tones in the amplitude contour and in brief segments.," Phonetica 49, 25-47. 10.1159/000261901
44. Yarrington, D., Pennington, C., Bunnell, H. T., Gray, J., Lilley, J., Nagao, K., and Polikoff, J. (2008). " ModelTalker voice recorder (MTVR)-A system for capturing individual voices for synthetic speech.," talk presented at the ISAAC 13th Biennial Conference, Montreal, Canada (August 2-7).
45. Yip, M. (2002). Tone, Cambridge Textbooks in Linguistics (Cambridge University Press, Cambridge, UK), p. 376.
46. Yuan, J., and Liberman, M. (2008). " Speaker identification on the SCOTUS corpus.," in Proceedings of Acoustics 2008, pp. 5687-5690.
47. Yuan, J., and Liberman, M. (2009). " Investigating /l/ variation in English through forced alignment.," in INTERSPEECH-2009, pp. 2215-2218.
48. Zue, V. W., and Seneff, S. (1996). " Transcription and alignment of the TIMIT database.," in Recent Research towards Advanced Man-Machine Interface through Spoken Language, edited by, H. Fujisaki, (Elsevier, Amsterdam), pp. 515-525.
49. Zue, V., Seneff, S., and Glass, J. (1990). " Speech database development at MIT: TIMIT and beyond.," Speech Commun. 9, 351-356. 10.1016/0167-6393(90)90010-7