Noise in HMM-based speech synthesis adaptation: Analysis, evaluation methods and experiments

IEEE Journal on Selected Topics in Signal Processing

Volumn 8, Issue 2, 2014, Pages 285-295

  Karhila, Reima ^a   Remes, Ulpu ^a   Kurimo, Mikko ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Adaptation; evaluation methods; noise robustness; speech synthesis

Indexed keywords

ADAPTATION; ENVIRONMENTAL NOISE; EVALUATION METHODS; HMM-BASED SPEECH SYNTHESIS; INVESTIGATE EFFECTS; NOISE ROBUSTNESS; PERSONALIZED VOICE; SYNTHESIZED SPEECH;

FEATURE EXTRACTION; SPEECH SYNTHESIS; TREES (MATHEMATICS);

EXPERIMENTS;

EID: 84897869648     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2013.2278492     Document Type: Article

References (39)

1. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis" Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009
2. J. Yamagishi, B. Usabaev, S. King, O. Watts, J. Dines, J. Tian, Y. Guan, R. Hu, K. Oura, Y. J. Wu, K. Tokuda, R. Karhila, and M. Kurimo, "Thousands of voices for HMM-based speech synthesis-analysis and application of TTS systems built on various ASR corpora" IEEE Trans. Audio, Speech, Lang. Process, vol. 18, no. 5, pp. 984-1004, Jul. 2010
3. J. Yamagishi and T. Kobayashi, "Average-voice-based speech synthesis using HSMM-based speaker adaptation and adaptive training" IEICE Trans. Inf. Syst., vol. E90-D, no. 2, pp. 533-543, 2007 (Pubitemid 46279829)
4. M. Aylett and J. Yamagishi, "Combining statistical parametric speech synthesis and unit-selection for automatic voice cloning" in Proc. LangTech, 2008
5. J.Yamagishi, Z. Ling, and S.King, "Robustness ofHMM-based speech synthesis" in Proc. Interspeech, 2008
6. R. Karhila, U. Remes, andM.Kurimo, "HMM-based speech synthesis adaptation using noisy data: Analysis and evaluation methods" in Proc. ICASSP, 2013
7. J. Yamagishi, T. Kobayashi, Y. Nakano, K. Ogata, and J. Isogai, "Analysis of speaker adaptation algorithms for HMM-based speech synthesis and a constrained SMAPLR adaptation algorithm" IEEE Trans. Audio, Speech, Lang. Process, vol. 17, no. 1, pp. 66-83, 2009
8. K.-T. Chen, W.-W. Liau, H.-M. Wang, and L.-S. Lee, "Fast speaker adaptation using eigenspace-based maximum likelihood linear regression" in Proc. ICSLP, 2000
9. "Recommendation P.835 (2003/11) Subjective Test Methodology for Evaluating Speech Communication Systems that Include Noise Suppression Algorithm" ITU-T
10. M. Wester and R. Karhila, "Speaker similarity evaluation of foreignaccented speech synthesis using HMM-based speaker adaptation" in Proc. ICASSP, 2011
11. B. Raj, T. Virtanen, S. Chaudhuri, and R. Singh, "Non-negative matrix factorization based compensation of music for automatic speech recognition" in Proc. Interspeech, 2010
12. M. J. F. Gales, "Maximum likelihood linear transformations for HMMbased speech recognition" Comput. Speech Lang., vol. 12, pp. 75-98, 1998 (Pubitemid 128383747)
13. R. Karhila and M. Wester, "Rapid adaptation of foreign-accented HMM-based speech synthesis" in Proc. Interspeech, 2011
14. R. Kuhn, J.-C. Junqua, P. Nguyen, and N. Niedzielski, "Rapid speaker adaptation in eigenvoice space" IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 695-707, Nov. 2000 (Pubitemid 32025317)
15. K. Shichiri, A. Sawabe, T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Eigenvoices for HMM-based speech synthesis" in Proc. ICSLP, 2002, vol. 2, pp. 1269-1272
16. S. Mika, B. Schlkopf, A. Smola, K.-R. Mller, M. Scholz, and G. Rtsch, "Kernel PCA and de-noising in feature spaces" in Proc. NIPS, 1999, pp. 536-542
17. M. J. F. Gales, "Cluster adaptive training of hidden Markov models" IEEE Trans. Speech Audio Process., vol. 8, no. 4, pp. 417-428, Jul. 2000
18. H. Zen, N. Braunschweiler, S. Buchholz, M. J. F. Gales, K. Knill, S. Krstulovic, and J. Latorre, "Statistical parametric speech synthesis based on speaker and language factorization" IEEE Trans. Audio, Speech, Lang. Process, vol. 20, no. 6, pp. 1713-1724, Aug. 2012
19. V. Wan, J. Latorre, K. Chin, L. Chen, M. Gales, H. Zen, K. Knill, and M. Akamine, "Combining multiple high quality corpora for improving HMM-TTS" in Proc. Interspeech, 2012
20. B. Mak, J. Kwok, and S. Ho, "Kernel eigenvoice speaker adaptation" IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 984-992, Sep. 2005 (Pubitemid 41558912)
21. B.K.-W. Mak,R. W.-H.Hsiao, S.K.-L. Ho, and J. Kwok, "Embedded kernel eigenvoice speaker adaptation and its implication to reference speaker weighting" IEEE Trans. Audio, Speech, Lang. Process, vol. 14, no. 4, pp. 1267-1280, Jul. 2006
22. Z. Roupakia and M. Gales, "Kernel eigenvoices (revisited) for largevocabulary speech recognition" IEEE Signal Process. Lett., vol. 18, no. 12, pp. 709-712, Dec. 2011
23. B. Mak and R. Hsiao, "Kernel eigenspace-based MLLR adaptation" IEEE Trans. Audio, Speech, Lang. Process, vol. 15, no. 3, pp. 784-795, Mar. 2007
24. N. Kitawaki, H. Nagabuchi, and K. Itoh, "Objective quality evaluation for low-bit-rate speech coding systems" IEEE J. Sel. Areas Commun., vol. 6, no. 2, pp. 242-248, Feb. 1988 (Pubitemid 18596866)
25. J. M. Tribolet, P. Noll, B. J. McDermott, and R. E. Crochiere, "A study of complexity and quality of speech waveform coders" in Proc. ICASSP, 1978, pp. 586-590
26. "Recommendation P.862 (02/2001) perceptual evaluation of speech quality (PESQ): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs" ITU-T
27. Y. Hu and P. Loizou, "Evaluation of objective quality measures for speech enhancement" IEEE Trans. Audio, Speech, Lang. Process, vol. 16, no. 1, pp. 229-238, Jan. 2008
28. M. Brookes, VOICEBOX: Speech Processing Toolbox for MATLAB, 1998
29. R. A. J. Clark, M. Podsiad?o, M. Fraser, C. Mayo, and S. King, "Statistical analysis of the Blizzard Challenge 2007 listening test results" in Proc. Blizzard Workshop, 2007
30. M. Wester, "The EMIME Bilingual Database" Univ. of Edinburgh, Edinburgh, U.K., 2010, Tech. Rep. EDI-INF-RR-1388
31. A. Varga and H. Steeneken, "Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems" Speech Commun., vol. 12, no. 3, pp. 247-251, 1993
32. J. Yamagishi and O.Watts, "The CSTR/EMIME HTS system for Blizzard Challenge" in Proc. Blizzard Challenge, 2010
33. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveign, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds" Speech Commun., vol. 27, pp. 187-207, 1999
34. D. Arifianto, T. Tanaka, T. Masuko, and T. Kobayashi, "Robust F0 estimation of speech signal using harmonicity measure based on instantaneous frequency" IEICE Trans. Inf. Syst., vol. 87, no. 12, pp. 2812-2820, 2004 (Pubitemid 40021353)
35. H. Kawahara, H. Katayose, A. de Cheveign, and R. D. Patterson, "Fixed point analysis of frequency to instantaneous frequencymapping for accurate estimation of F0 and periodicity" in Proc. Eurospeech, 1999, pp. 2781-2784
36. D. Talkin, "A robust algorithm for pitch tracking (RAPT)" Speech Coding Synth., pp. 495-518, 1995
37. "ES 202 050 V1.1.5 speech processing, transmission and quality aspects (STQ), distributed speech recognition" ETSI, 2007
38. D. Iskra, B. Grosskopf, K. Marasek, H. van den Heuvel, F. Diehl, and A. Kiessling, "Speecon-speech databases for consumer devices: Database specification and validation" in Proc. LREC, 2002
39. U. Remes, R. Karhila, and M. Kurimo, "Objective evaluation measures for speaker-adaptive HMM-TTS systems" in Proc. SSW.