Prosody contour prediction with long short-term memory, bi-directional, deep recurrent neural networks

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 2268-2272

  Fernandez, Raul ^a   Rendel, Asaf ^b   Ramabhadran, Bhuvana ^a   Hoory, Ron ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b IBM HAIFA RESEARCH LAB   (Israel)

Author keywords

Deep learning; Prosody prediction; Recurrent neural networks; Speech synthesis; Text to speech

Indexed keywords

FORECASTING; MEAN SQUARE ERROR; SPEECH COMMUNICATION; SPEECH SYNTHESIS;

CONTEXTUAL FACTORS; DEEP LEARNING; DEEP NEURAL NETWORKS; LONG SHORT-TERM MEMORY; PROSODY PREDICTIONS; RELATIVE REDUCTION; STATE-OF-THE-ART PERFORMANCE; TEXT TO SPEECH;

RECURRENT NEURAL NETWORKS;

EID: 84910068142     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. K. Tokuda, T. Yoshimura, T. Masuko, T. Kobayashi, and T. Kitamura, "Speech parameter generation algorithms for HMM-based speech synthesis, " in ICASSP, 2000, pp. 1315-1318.
2. R. Fernandez, R. Rendel, B. Ramabhadran, and R. Hoory, "F0 contour prediction with a Deep Belief Network-Gaussian Process hybrid model, " in ICASSP, 2013, pp. 6885-6889.
3. H. Zen, A. Senior, and M. Schuster, "Statistical parametric speech synthesis using Deep Neural Networks, " in ICASSP, 2013, pp. 7962-7966.
4. Z.-H. Ling, L. Deng, and D. Yu, "Modeling spectral envelops using Restricted Boltzmann Machines and Deep Belief Networks for statistical parametric speech synthesis, " IEEE Trans. Audio, Speech, and Lang. Proc., vol. 21, no. 10, pp. 2129-2139, 2013.
5. S. Kang, X. Qian, and H. Meng, "Multi-distribution Deep Belief Networks for speech synthesis, " in ICASSP, 2013, pp. 8012-8016.
6. M. L. Seltzer and J. Droppo, "Multi-task learning in Deep Neural Networks for improved phoneme recognition, " in Proc. ICASSP, 2013, pp. 6965-6969.
7. A. Graves and J. Schmidhuber, "Offline handwriting recognition with multidimensional Recurrent Neural Networks, " in NIPS, 2009.
8. A. Graves, M. Abdel-rahman, and G. Hinton, "Speech recognition with Deep Recurrent Neural Networks, " in ICASSP, 2013, pp. 6885-6889.
9. S. Shattuck-Hufnagel, "Phrase-level phonology in speech production planning: Evidence for the role of prosodic structure, " in Prosody: Theory and Experiment. Studies Presented to Gösta Bruce, ser. Text, Speech and Language Technology, G. Bruce and M. Horne, Eds. Netherlands: Springer, 2000, vol. 14, pp. 201- 229.
10. S. Hochreiter and J. Schmidhuber, "Long short-term memory, " Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
11. F. A. Gers, J. Schmidhuber, and F. Cummings, "Learning to forget: Continual prediction with LSTM, " Neural Computaiton, vol. 12, no. 10, pp. 2451-2471, 2000.
12. F. A. Gers, N. N. Schraudolph, and J. Schmidhuber, "Learning precise timing with LSTM Recurrent Networks, " J. of Machine Learning Research, vol. 3, pp. 115-143, 2002.
13. M. Riedmiller and H. Braun, "A direct adaptive method for faster back propagation learning: The RPROP algorithm, " in Proc. IEEE Intnl. Conf. on Neural Networks, 1993, pp. 586-591.
14. A. Graves, "RNNLIB: A Recurrent Neural Network library for sequence learning problems, " http://sourceforge.net/projects/rnnl/.
15. T. Toda and K. Tokuda, "Speech parameter generation algorithm considering global variance for HMM-based speech synthesis, " in Inter speech, 2005, pp. 2801-2804.
16. F. Ribeiro, D. Floreâncio, C. Zhang, and M. Seltzer, "CROWDMOS: An approach for crowd sourcing Mean Opinion Score studies, " in ICASSP, 2011, pp. 2416-2419.