A deep auto-encoder based low-dimensional feature extraction from FFT spectral envelopes for statistical parametric speech synthesis

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 5535-5539

  Takaki, Shinji ^a   Yamagishi, Junichi ^a,b  

^a NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Deep auto encoder; Spectral envelope; Statistical parametric speech synthesis; Vocoder

Indexed keywords

EID: 84973309345     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472736     Document Type: Conference Paper

References (29)

1. H. Zen, A. Senior, and M. Schuster, "Statistical parametric speech synthesis using deep neural networks, " Proceedings of ICASSP, pp. 7962-7966, 2013
2. Z.-H. Ling, L. Deng, and D. Yu, "Modeling spectral envelopes using restricted Boltzmann machines and deep belief networks for statistical parametric speech synthesis, " Audio, Speech, and Language Processing, IEEE Transactions on, vol. 21, pp. 2129-2139, 2013
3. Y. Fan, Y. Qian, F. Xie, and F. K. Soong, "TTS synthesis with bidirectional LSTM based recurrent neural networks, " Proceedings of Interspeech, pp. 1964-1968, 2014
4. R. Fernandez, A. Rendel, B. Ramabhadran, and R. Hoory, "Prosody contour prediction with long short-term memory, bidirectional, deep recurrent neural networks, " Proceedings of Interspeech, pp. 2268-2272, 2014
5. S. Takaki, W. Zhenzhou, and J Yamagishi, "A function-wise pre-training technique for constructing a deep neural network based spectral model in statistical parametric speech synthesis, " Machine Learning in Spoken Language Processing (MLSLP), 2015
6. L.-H. Chen, T. Raitio, C. Valentini-Botinhao, J. Yamagishi, and Z.-H. Ling, "DNN-based stochastic postfilter for HMM-based speech synthesis, " Proceedings of Interspeech, pp. 1954-1958, 2014
7. S. Takaki, S.-J. Kim, J. Yamagishi, and j.-J Kim, "Multiple feed-forward deep neural networks for statistical parametric speech synthesis, " Proceedings of Interspeech, pp. 2242-2246, 2015
8. Z. Tuske, P. Golik, R. Schluter, and H. Ney, "Acoustic modeling with deep neural networks using raw time signal for lvcsr, " Proceedings of Interspeech, pp. 890-894, 2014
9. D. Palaz, M. Magimai.-Doss, and Collobert R., "Convolutional neural networks-based continuous speech recognition using raw speech signal2, journal =, "
10. T. N. Sainath, R. J. Weiss, A. Senior, K. W. Wilson, and O. Vinyals, "Learning the speech front-end with raw waveform cldnns, " Proceedings of Interspeech, pp. 1-5, 2015
11. H. Kawahara, I. Masuda-Katsuse, and A. Cheveigne, "Restructuring speech representations using a pitch-adaptive timefrequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds, " Speech Communication, vol. 27, pp. 187-207, 1999
12. M. Morise, "An attempt to develop a singing synthesizer by collaborative creation, " the Stockholm Music Acoustics Conference 2013 (SMAC2013), pp. 289-292, 2015
13. M. Morise, "Cheaptrick, a spectral envelope estimator for high-quality speech synthesis, " Speech Communication, vol. 67, pp. 1-7, 2015
14. M. Morise, "Error evaluation of an f0-adaptive spectral envelope estimator in robustness against the additive noise and f0 error, " IEICE transactions on information and systems, vol. E98-D, no. 7, pp. 1405-1408, 2015
15. T. N. Sainath, B. Kingsbury, and B. Ramabhadran, "Autoencoder bottleneck features using deep belief networks, " Proceedings of ICASSP, pp. 4153-4156, 2012
16. J. Gehring, Y. Miao, F. Metze, and A. Waibel, "Extracting deep bottleneck features using stacked auto-encoders, " Proceedings of ICASSP, pp. 3377-3381, 2013
17. A. L. Maas, Q. V. Le, T. M. ONeil, O. Vinyals, P. Nguyen, and A. Ng Andrew, "Recurrent neural networks for noise reduction in robust ASR, " Proceedings of Interspeech, pp. 22-25, 2012
18. T. Ishii, H. Komiyama, T. Shinozaki, Y. Horiuchi, and S Kuroiwa, "Reverberant speech recognition based on denoising autoencoder, " Proceedings of Interspeech, pp. 3512-3516, 2013
19. X. Feng, Y. Zhang, and J. Glass, "Speech feature denoising and dereverberation via deep autoencoders for noisy reverberant speech recognition, " Proceedings of ICASSP, pp. 1778-1782, 2014
20. L. Deng, M. Seltzer1, D. Yu, A. Acero, A. Mohamed, and G. Hinton, "Binary coding of speech spectrograms using a deep auto-encoder, " Proceedings of Interspeech, pp. 1692-1695, 2010
21. X. Lu, Y. Tsao, S. Matsuda1, and C. Hori, "Speech enhancement based on deep denoising autoencoder, " Proceedings of Interspeech, pp. 436-440, 2013
22. R. Vishnubhotla, S. Fernandez and B. Ramabhadran, "An autoencoder neural-network based low-dimensionality approach to excitation modeling for hmm-based text-to-speech, " Proceedings of ICASSP, pp. 4614-4617, 2010
23. T. Raitio, A. Suni, L. Juvela, M. Vainio, and P. Alku, "Deep neural network based trainable voice source model for synthesis of speech with varying vocal effort, " Proceedings of Interspeech, pp. 1969-1973, 2014
24. P. K. Muthukumar and Black. A., "A deep learning approach to data-driven parameterizations for statistical parametric speech synthesis, " CoRR, vol. Abs/1409. 8558, 2014
25. G. E. Hinton and R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science 28, vol. 313, no. 5786, pp. 504-507, 2006
26. S King and V. Karaiskos, "The blizzard challenge 2011, " 2011
27. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis, " Speech Communication, vol. 51, pp. 1039-1064, 2009
28. T. Toda and K. Tokuda, "Speech parameter generation algorithm considering global variance for HMM-based speech synthesis, " Proceedings of Interspeech 2005, pp. 2801-2804, 2005
29. K. Richmond, R. Clark, and S. Fitt, "On generating combilex pronunciations via morphological analysis, " Proceedings of Interspeech, pp. 1974-1977, 2010.