Data-driven voice source waveform analysis and synthesis

Speech Communication

Volumn 54, Issue 2, 2012, Pages 199-211

  Gudnason, Jon ^a   Thomas, Mark R P ^b   Ellis, Daniel P W ^c   Naylor, Patrick A ^b  

^a REYKJAVIK UNIVERSITY   (Iceland)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

^c Columbia University ^*  (United States)

Author keywords

Gaussian mixture model; Inverse filtering; Principal component analysis; Segmental signal to reconstruction ratio; Vocal tract modeling; Voice source signal

Indexed keywords

GAUSSIAN MIXTURE MODEL; INVERSE FILTERING; PRINCIPAL COMPONENTS; SEGMENTAL SIGNAL TO RECONSTRUCTION RATIO; VOCAL-TRACTS; VOICE SOURCE SIGNAL;

IMAGE SEGMENTATION; MODELS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 80055082229     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2011.08.003     Document Type: Article

References (54)

1. E.R.M. Abberton, D.M. Howard, and A.J. Fourcin Laryngographic assessment of normal voice: a tutorial Clin. Linguist. Phonet. 3 1989 281 296 (Pubitemid 19198790)
2. F. Alipour, D.A. Berry, and I.R. Titze A finite-element model of vocal-fold vibration J. Acoust. Soc. Amer. 108 2000 3003 3012
3. P. Alku Glottal wave analysis with pitch synchronous iterative adaptive filtering Speech Comm. 11 1992 109 118 (Pubitemid 23572504)
4. P. Alku, C. Magi, S. Yrttiaho, T. Bäckström, and B. Story Closed phase covariance analysis based on constrained linear prediction for glottal inverse filtering J. Acoust. Soc. Amer. 125 2009 3289 3305
5. Ananthapadmanabha, T.; Fant, G.; 1984. Acoustic analysis of voice source dynamics. In: STL-QPSR 25, Department of Speech, Music and Hearing, KTH, 1984, pp. 1-24. .
6. B.S. Atal, and S.L. Hanauer Speech analysis and synthesis by linear prediction of the speech wave J. Acoust. Soc. Amer. 50 1971 637 655
7. T. Backstrom, P. Alku, and E. Vilkman Time-domain parameterization of the closing phase of glottal airflow waveform from voices over a large intensity range IEEE Trans. Speech Audio Process. 10 2002 186 192 (Pubitemid 34692542)
8. Black, A.W.; Zen, H.; Tokuda, K.; 2007. Statistical parametric speech synthesis. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), vol. IV, pp. 1229-1232.
9. D.M. Brookes, and D.S. Chan Speaker characteristics from a glottal airflow model using glottal inverse filtering Proc. Inst. Acoust. 15 1994 501 508
10. Carlson, R.; Fant, G.; Gobl, C.; Granstrom, B.; Karlsson, I.; Lin, Q.; 1989. Voice source rules for text-to-speech synthesis. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), pp. 223-226. (Pubitemid 20604095)
11. E. Cataldo, J.C. Lucero, R. Sampaio, and L. Nicolato Comparison of some mechanical models of larynx in the synthesis of voiced sounds J. Brazilian Soc. Mech. Sci. Eng. 28 2006
12. D.S.F. Chan, and D.M. Brookes Variability of excitation parameters derived from robust closed phase glottal inverse filtering Proc. Eur. Conf. Speech Comm. Technol. 33 1989
13. D.G. Childers, J.C. Principe, and Y.T. Ting Adaptive WRLS-VFF for speech analysis IEEE Trans. Speech Audio Process. 3 1995 209 213
14. K.E. Cummings, and M.A. Clements Glottal models for digital speech processing - a historical survey and new results Digital Signal Process. 5 1995 21 42
15. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm J. Roy. Statist. Soc. Ser. B 39 1977 1 38
16. Ding, C.; He, X.; 2004. K-means clustering via principal component analysis. In: Proc. Internat. Conf. Machine Learning (ICML), pp. 225-232. (Pubitemid 40290812)
17. Drugman, T.; Wilfart, G.; Moinet, A.; Dutoit, T.; 2009. Using a pitch-synchronous residual codebook for hybrid HMM/frame selection speech synthesis. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Taipei, Taiwan.
18. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2001 John Wiley and Sons
19. U. Eysholdt, M. Tigges, T. Wittenberg, and U. Pröschel Direct evaluation of high-speed recordings of vocal fold vibrations Folia Phoniatr. Logop 48 1996 163 170 (Pubitemid 126485139)
20. G. Fant Acoustic Theory of Speech Production 1960 Mouton The Hague, The Netherlands
21. G. Fant, J. Liljencrants, and Q. Lin A four-parameter model of glottal flow STL-QPSR 26 1985 1 13
22. J.L. Flanagan Speech Analysis, Synthesis and Perception second ed. 1972 Springer-Verlag New York
23. J. Flanagan, and L. Landgraf Self-oscillating source for vocal-tract synthesizers IEEE Trans. Audio Electroacoust. 16 1968 57 64
24. Fujisaki, H.; Ljungqvist, M.; 1987. Estimation of voice source and vocal tract parameters based on ARMA analysis and a model for the glottal source waveform. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), vol. 12, pp. 637-640. (Pubitemid 17596296)
25. Gudnason, J.; Brookes, M.; 2008. Voice Source cepstrum coefficients for speaker identification. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), pp. 4821-4824.
26. Gudnason, J.; Thomas, M.R.P.; Naylor, P.A.; Ellis, D.P.W.; 2009. Voice source waveform analysis and synthesis using principal component analysis and Gaussian mixture modelling. In: Proc. Interspeech Conf.; Brighton, UK.
27. J. Hartigan, and M. Wang A k-means clustering algorithm Appl. Statist. 28 1979 100 108
28. M. Hirano Clinical Examination of Voice 1981 Springer
29. IEC, IEC 61672:2003: Electroacoustics - Sound Level Meters, Technical Report, IEC, 2003.
30. K. Ishizaka, and J. Flanagan Synthesis of voiced sounds from a two-mass model of the vocal cords Bell Syst. Tech. J. 51 1972 1233 1268
31. D.S. Jurafsky, and J.H. Martin Speech and Language Processing 2000 Prentice-Hall New Jersey
32. D.H. Klatt, and L.C. Klatt Analysis, synthesis and perception of voice quality variations among female and male talkers J. Acoust. Soc. Amer. 87 1990 820 857 (Pubitemid 20129722)
33. Kumar, A.; Gersho, A.; 1997. Voiced speech synthesis with a nonlinear glottal model. In: Proc. IEEE Workshop on Speech Coding For Telecommunications Proceeding, pp. 3-4.
34. F. Lecluse, M. Brocaar, and J. Verschuure The electroglottography and its relation to glottal activity Folia Phoniatr. 17 1975 215 224
35. Lindsey, G.; Breen, A.; Nevard, S. SPAR's Archivable Actual-Word Databases. Technical Report, University College London, 1987.
36. C. Ma, Y. Kamp, and L.F. Willems A Frobenius norm approach to glottal closure detection from the speech signal IEEE Trans. Speech Audio Process. 2 1994 258 265
37. J. Makhoul Linear prediction: a tutorial review Proc. IEEE 63 1975 561 580
38. J.D. Markel, and A.H. Gray Jr. Linear Prediction of Speech 1976 Springer-Verlag
39. E. Moulines, and F. Charpentier Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones Speech Comm. 9 1990 453 467
40. P.A. Naylor, A. Kounoudes, J. Gudnason, and M. Brookes Estimation of glottal closure instants in voiced speech using the DYPSA algorithm IEEE Trans. Speech Audio Process. 15 2007 34 43
41. M.D. Plumpe, T.F. Quatieri, and D.A. Reynolds Modeling of the glottal flow derivative waveform with application to speaker identification IEEE Trans. Speech Audio Process. 7 1999 569 576
42. A.E. Rosenberg Effect of glottal pulse shape on the quality of natural vowels J. Acoust. Soc. Amer. 49 1971 583 590
43. A.S. Spanias Speech coding: a tutorial review Proc. IEEE 82 1994 1541 1582
44. B.H. Story, and I.R. Titze Voice simulation with a body-cover model of the vocal folds J. Acoust. Soc. Amer. 97 1994 1249 1260
45. H.W. Strube Determination of the instant of glottal closure from the speech wave J. Acoust. Soc. Amer. 56 1974 1625 1629
46. Y. Stylianou, O. Cappe, and E. Moulines Continuous probabilistic transform for voice conversion IEEE Trans. Speech Audio Process. 6 1998 131 142 (Pubitemid 128720639)
47. Thomas, M.R.P.; Gudnason, J.; Naylor, P.A.; 2008. Application of the DYPSA algorithm to segmented time-scale modification of speech. In: Proc. European Signal Process. Conf. (EUSIPCO), Lausanne, Switzerland.
48. Thomas, M.R.P.; Gudnason, J.; Naylor, P.A.; 2010a. Detection of glottal opening and closing instants in voiced speech using the YAGA algorithm. Submitted for peer review, 2010.
49. Thomas, M.R.P.; Gudnason, J.; Naylor, P.A.; 2010b. Data-driven voice source waveform modelling. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Taipei, Taiwan.
50. Thomas, M.R.P.; Geiser, B.; Gudnason, J.; Naylor, P.A.; Vary, P.; 2010c. Voice source estimation for artificial bandwidth extension of telephone speech. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Dallas, TX, USA.
51. I. Titze, B. Story, G. Burnett, J. Holzrichter, L. Ng, and W. Lean Comparison between electroglottography and electromagnetic glottography J. Acoust. Soc. Amer. 107 2000 581 588 (Pubitemid 30039182)
52. J. Svec, and H. Schutte Videokymography: high-speed line scanning of vocal fold vibration J. Voice 10 1996 201 205 (Pubitemid 26142601)
53. D.Y. Wong, J.D. Markel, and J.A.H. Gray Least squares glottal inverse filtering from the acoustic speech waveform IEEE Trans. Acoust. Speech Signal Process. 27 1979 350 355 (Pubitemid 10188876)
54. Zhu, W.; Kasuya, H.; 1996. A new speech synthesis system based on the ARX speech production model. In: Proc. Internat. Conf. on Spoken Language Processing, pp. 1413-1416.