Dynamic speech spectrum representation and tracking variable number of vocal tract resonance frequencies with time-varying dirichlet process mixture models

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 8, 2009, Pages 1518-1532

  Özkan, Emre ^a   Yucel Ozbek I ^a   Demirekler, Mübeccel ^a  

^a MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

Author keywords

Dirichlet process; Formant tracking; Particle filter; Spectral representation; Spectrum estimation; Vocal tract resonance (VTR)

Indexed keywords

DIRICHLET PROCESS; FORMANT TRACKING; PARTICLE FILTER; SPECTRAL REPRESENTATION; SPECTRUM ESTIMATION; VOCAL TRACT RESONANCE (VTR);

AIR FILTERS; BAYESIAN NETWORKS; INFERENCE ENGINES; MIXTURES; NONLINEAR FILTERING; PHASE MEASUREMENT; RESONANCE; SPECTRAL DENSITY; SPEECH; TIME VARYING SYSTEMS; TRACKING (POSITION); VIDEOCASSETTE RECORDERS;

TARGET TRACKING;

EID: 69249099357     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2022198     Document Type: Article

References (54)

1. Acoustic Theory of Speech Production, G. Fant, Ed.. New York: Mouton, 1960.
2. Speech Analysis Synthesis and Perception, J. L. Flanagan, Ed.. New York: Springer Verlang, 1965.
3. L. R. Rabiner, "Digital-formant synthesizer for speech-synthesis studies," J. Acoust. Soc. Amer., vol.43, no.4, pp. 822-828, 1968.
4. D. Klatt, "Software for a cascade/parallel formant synthesizer," J Acoust. Soc. Amer., vol.67, no.3, pp. 971-995, 1980.
5. E. Klabbers and R. Veldhuis, "Reducing audible spectral discontinuities,", vol.9, no.1, pp. 39-51, Jan. 2001.
6. J. Bellegarda,"A global, boundary-centric framework for unit selection text-to-speech synthesis," IEEE Trans. Speech Audio Process., vol.14, no.3, pp. 990-997, May. 2006.
7. L. Welling and H. Ney, "Formant estimation for speech recognition," IEEE Trans. Speech Audio Process., vol.6, no.1, pp. 36-48, Jan. 1998.
8. P. Garner and W. Holmes, "On the robust incorporation of formant features into hidden Markov models for automatic speech recognition," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1998, pp. 1-4.
9. D. Rentzos, S. Vaseghi, Q. Yan, and C.-H. Ho, "Parametric formant modeling and transformation in voice conversion," Int. J. Speech Technol. Springer, vol.8, pp. 227-245, 2005.
10. T. Claes, I. Dologlou, L. ten Bosch, and D. Van Compernolle, "A novel feature transformation for vocal tract length normalization in automatic speech recognition," IEEE Trans. Speech Audio Process., vol.6, no.6, pp. 549-557, Nov. 1998.
11. R. S. S.Umesh, "A study offilter bank smoothingin MFCC features for recognition of children's speech," IEEE Trans. Speech Audio Process., vol.15, no.8, pp. 2418-2430, Nov. 2007.
12. A. Watanabe and T. Sakata, "Reliable methods for estimating relative vocal tract lengths from formant trajectories of common words," IEEE Trans. Speech Audio Process., vol.14, no.4, pp. 1193-1204, Jul. 2006.
13. Q. Yan, S. Vaseghi, D. Rentzos, and C.-H. Ho, "Analysis and synthesis of formant spaces of British, Australian, and American accents," IEEE Trans. Speech Audio Process., vol.15, no.2, pp. 676-689, Feb. 2007.
14. Q. Yan, S. Vaseghi, E. Zavarehei, B. Milner, J. Darch, P. White, and I. Andrianakis, "Formant tracking linear prediction model using HMMs and Kalman filters for noisy speech processing," Comput. Speech Lang., vol.21, no.3, pp. 543-561, 2007.
15. A. Potamianosa and P. Maragos, "Speech formant frequency and bandwidth tracking using multiband energy demodulation," Acoust. Soc. Amer., vol.99, no.6, pp. 3795-3806, 1996.
16. A. Watanabe, "Formant estimation method using inverse-filter control," IEEE Trans. Speech Audio Process., vol.9, no.4, pp. 317-326, May 2001.
17. A. Rao and R. Kumaresan, "On decomposing speech into modulated components," IEEE Trans. Speech Audio Process., vol.8, no.3, pp. 240-254, May 2000.
18. K. Mustafa and I. C. Bruce, "Robust formant tracking for continuous speech with speaker variability," IEEE Trans. Speech Audio Process., vol.14, no.2, pp. 435-444, Mar. 2006.
19. J. Vargas and S. McLaughlin, "Cascade prediction filters with adaptive zeros to track the time-varying resonances of the vocal tract," IEEE Trans. Speech Audio Process., vol.16, no.1, pp. 1-7, Jan. 2008.
20. M. S. A. Fattah and W.-P. Zhu, "An approach to formant frequency estimation at low signal-to-noise ratio," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2007, pp. 469-472.
21. S. McCandless, "An algorithm for automatic formant extraction using linear prediction spectra," IEEE Trans. Acoust., Speech, Signal Process., vol.ASSP-22, no.2, pp. 135-141, Apr. 1974.
22. G. Kopec, "Formant tracking using hidden Markov models and vector quantization," IEEE Trans. Acoust., Speech, Signal Process., vol.ASSP-34, no.4, pp. 709-729, Aug. 1986.
23. D. Talkin, "Speech formant trajectory estimation using dynamic programming with modulated transition costs," Acoust. Soc. Amer., vol.1, no.6, p. 55, 1987.
24. K. Xia and C. Espy-Wilson, "A new strategy of format tracking using dynamic programming," in Proc. Int. Conf. Spoken Lang. Process (ICSLP), 2000, pp. 1-4.
25. M.Lee,J. van Santen, B. Mobius, and J. Olive, "Formant tracking using context-dependent phonemic information," IEEE Trans. Speech Audio Process., vol.13, no.5, pp. 240-254, Sep. 2005.
26. Y. Laprie and M. Berger, "A new paradigm for reliable automatic for-mant tracking," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1994, pp. 201-205.
27. P. Zolfaghari, S. Watanabe, A. Nakamura, and S. Katagiri, "Bayesian modelling of the speech spectrum using mixture of Gaussians," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2004, pp. 556-559.
28. P. Zolfaghari, H. Kato, Y. Minami, A. Nakamura, and S. Katagiri, "Dynamic assignment of Gaussian components in modeling speech spectra," J. VLSI Signal Process., vol.45, no.1-2, pp. 7-19, 2006.
29. D. T. Toledano, J. G. Villardebó, and L. H. Gómez, "Initialization, training, and context-dependency in HMM-based formant tracking," IEEE Trans. Speech Audio Process., vol.14, no.2, pp. 511-523, Mar. 2006.
30. G. Rigoll, "A new algorithm for estimation of formant trajectories directly from the speech signal based on an extended Kalman-filter," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1986, pp. 1229-1232.
31. G. Rigoll, "Formant tracking with quasi-linearization," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1988, pp. 307-310.
32. M. Niranjan and I. Cox, "Recursive tracking of formants in speech signals," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1994, pp. 205-208.
33. R. Togneri and L.Deng,"A state-space model with neural-network prediction for recovering vocal tract resonances in fluent speech from mel-cepstral coefficients," Speech Commun., vol.48, pp. 971-988, 2006.
34. L.Deng, A. Acero, and I. Bazzi, "Tracking vocal tract resonances using a quantized nonlinear function embedded in a temporal constraint," IEEE Trans. Speech Audio Process., vol.14, pp. 425-434, 2006.
35. L. Deng, X. Cui, R. Pruvenok, Y. Chen, S. Momen, and A. Alwan, "A database ofvocal tract resonance trajectories for research inspeech processing," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2006, pp. 369-372.
36. L. Deng, L. J. Lee, H. Attias, and A. Acero, "Adaptive Kalman filtering and smoothing for tracking vocal tract resonances using a continuous-valued hidden dynamic model," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.1, pp. 13-23, Jan. 2007.
37. D. D. Rudoy andP. J. Wolfe, "Conditionally linear Gaussian models for tracking of vocal tract resonances," in Proc. Interspeech Conf., 2007, pp. 526-529.
38. Y. Zheng and M. Hasegawa-Johnson, "Formant tracking by mixture state particle filter," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2004, pp. 565-568.
39. I. Y. Özbek and M. Demirekler, "Tracking of visible vocal tract resonances (VVTR) based on Kalman filtering," in Proc. Interspeech Conf., 2006.
40. Q. Yan, S. Vaseghi, E. Zavarehei, B. Milner, J. Darch, P. White, and I. Andrianakis, "Formant tracking linear prediction model using HMMs and Kalman filters for noisy speech processing," Comput. Speech Lang., vol.21, no.3, pp. 543-561, 2007.
41. I. Y. Özbek and M. Demirekler, "Vocal tract resonances tracking based on voiced and unvoiced speech classification using dynamic programming and fixed interval Kalman smoother," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2008, pp. 4217-4220.
42. C. Antoniak, "Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems," Ann. Statist., vol.2, pp. 1152-1174, 1974.
43. F. Caron, M. Davy, and A. Doucet, "Generalized Polya urn for time-varying Dirichlet process mixtures," in Proc. Int. Conf. Uncertainty Artif. Intell., Vancouver, BC, Canada, 2007.
44. J. R. Deller , Jr, J. G. Proakis, and J. H. Hansen, Discrete-Time Processing of Speech Signals. Piscataway, NJ: IEEE Press, 2000.
45. M. T.-T. Jackson, C. Espy-Wilson, and S. E. Boyce, "Verifying a vocal tract model with a closed side-branch," J. Acoust. Soc. Amer., vol.109, no.6, pp. 2983-2987, 2001.
46. T. F. Quatieri, Discrete-Time Speech Signal Processing: Principles and Practice. Upper Saddle River, NJ: Prentice-Hall, 2002.
47. J. M. Heinz and K. N. Stevens, "On the properties of voiceless fricative consonants," J. Acoust. Soc. Amer., vol.33, no.5, pp. 589-596, 1961.
48. S. Sarkka, A. Vehtari, and J. Lampinen, "Rao-Blackwellized particle filter for multiple target tracking," Inf. Fusion, vol.8, pp. 2-15, 2007.
49. Y. W. Teh, "Dirichlet processes," in Encyclopedia of Machine Learning. New York: Springer, 2007.
50. M. I. Jordan, "Dirichlet processes Chinese restaurant processes and all that," in Tutorial presentation at NIPS Conf., 2005.
51. R. Neal, "Markov chain sampling methods for Dirichlet process mixture models," J. Comput. Graph. Statist., vol.9, pp. 249-265, 2000.
52. D. Blackwell and J. MacQueen, "Ferguson distributions via Polya urn schemes," Annals Statist., vol.1, pp. 353-355, 1973.
53. J. Sethuraman, "A constructive definition of Dirichlet priors," Statist. Sinica, vol.4, pp. 639-650, 1994.
54. S. Blackman and R. Popoli, Design and Analysis of Modern Tracking Systems. Norwood, MA: Artech House, 1999.