Impacts of machine translation and speech synthesis on speech-to-speech translation

Speech Communication

Volumn 54, Issue 7, 2012, Pages 857-866

  Hashimoto, Kei ^a   Yamagishi, Junichi ^b   Byrne, William ^c   King, Simon ^b   Tokuda, Keiichi ^a  

^a NAGOYA INSTITUTE OF TECHNOLOGY   (Japan)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Machine translation; Speech synthesis; Speech to speech translation; Subjective evaluation

Indexed keywords

MACHINE TRANSLATIONS; SPEECH-TO-SPEECH TRANSLATION; SUBJECTIVE EVALUATIONS; SYNTHESIZED SPEECH; THREE COMPONENT;

SPEECH INTELLIGIBILITY; SPEECH RECOGNITION; SPEECH SYNTHESIS;

COMPUTER AIDED LANGUAGE TRANSLATION;

EID: 84861092214     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2012.02.004     Document Type: Article

References (32)

1. Boidin, C.; Rieser, V.; Plas, L.; Lemon, O.; Chevelu, J.; 2009. Predicting how it sounds: Re-ranking dialogue prompts based on TTS quality for adaptive spoken dialogue systems. In: Proc. of Interspeech, 2009, pp. 2487-2490.
2. I. Bulyko, and M. Ostendorf Efficient integrated response generation from multiple target using weighted finite state transducers Comput. Speech and Language 16 2002 533 550
3. Callison-Burch, C.; 2009. Fast, cheap, and creative: evaluating translation quality using amazon's mechanical turk. In: Proc. of EMNLP, pp. 286-295.
4. Callison-Burch, C.; Dredze, M.; 2010. Creating speech and language data with amazon's mechanical turk. In: Proc. of NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, pp. 1-12.
5. F. Casacuberta, M. Federico, H. Ney, and E. Vidal Recent efforts in spoken language translation IEEE Trans. Signal Process. 25 3 2008 80 88 (Pubitemid 351695643)
6. Chae, J.; Nenkova, A. 2009. Predicting the fluency of text with shallow structural features: case studies of machine translation and human-written text. In: Proc. of the 12th Conf. of the European Chapter of the Association of Computational Linguistics, pp. 139-147.
7. K. Fort, G. Adda, and K. Cohen Amazon Mechanical Turk: Gold mine or coal mine? Computational Linguistics 37 2 2011 413 420
8. Gispert, A.; Virpioja, S.; Kurimo, M.; Byrne, W. 2009. Minimum Bayes risk combination of translation hypotheses from alternative morphological decompositions. In: Proc. of NAACL-HLT 2009, pp. 73-76.
9. Heilman, M.; Smith, N.A. 2010. Rating computer-generated questions with mechanical turk. In: Proc. of NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, pp. 35-40.
10. Iglesias, G.; Gispert, A.; Banga, E.; Byrne, W. 2009. Hierarchical phrase-based translation with weighted finite state transducers. In: Proc. of NAACL-HLT 2009, pp. 433-441.
11. H. Kawahara, I. Masuda-Katsuse, and A. Cheveigne Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds Speech Commun. 27 1999 187 207
12. R. Kneser, and H. Ney Improved backing-off for m-gram language model Proc. ICASSP 1995 1995 181 184
13. Koehn, P. 2005. Europarl: a parallel corpus for statistical machine translation. In: Proc. of MT Summit, pp. 79-86.
14. Kunath, S.; Weinberger, S. 2010. The wisdom of the crowd's ear: speech accent rating and annotation with amazon mechanical turk. In: Proc. of NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk, pp. 168-171.
15. L. Malfait, J. Berger, and M. Kastner P.563 - The ITU-T standard for signal-ended speech quality assesment IEEE Trans. Audio Speech Language Process. 14 6 2006 1924 1934
16. Mutton, A.; Dras, M.; Wan, S.; Dale, R. 2007. GLEU: automatic evaluation of sentence-level fluency. In: Proc. of the 45th Annual Meeting of the Association of Computational Linguistics, pp. 344-351.
17. Nakatsu, C.; White, M. 2006. Learning to say it well: Reranking realizations by predicted synthesis quality. In: Proc. of ACL 2006, pp. 1113-1120.
18. Ney, H. 1999. Speech translation: coupling of recognition and translation. In: Proc. of ICASSP 1999, pp. 1149-1152.
19. E. Noth, A. Batliner, A. Kießling, R. Kompe, and H. Niemann VERBMOBIL: the use of prosody in the linguistic components of a speech understanding system IEEE Trans. Speech Audio Process. 8 5 2000 519 532
20. Parlikar, A.; Black, A.; Vogel, S. 2010. Improving speech synthesis of machine translation output. In: Proc. of Interspeech 2010, pp. 194-197.
21. Snow, R.; O'Connor, B.; Jurafsky, D.; Ng, A. 2008. Cheap and fast-but is it good?: evaluating non-expert annotations for natural language tasks. In: Proc. of EMNLP, pp. 254-263.
22. Stolcke, A. 2002. SRILM - An extensible language model toolkit. In: Proc. of ICSLP, pp. 901-904.
23. Tokuda, K.; Masuko, T.; Miyazaki, N.; Kobayashi, T. 1999. Hidden Markov models based on multi-space probability distribution for pitch pattern modeling. In: Proc. of ICASSP 1999, pp. 229-232.
24. Tokuda, K.; Yoshimura, T.; Masuko, T.; Kobayashi, T.; Kitamura, T. 2000. Speech parameter generation algorithms for HMM-based speech synthesis. In: Proc. of ICASSP 2000, pp. 936-939.
25. Vidal, E. 1997. Finite-state speech-to-speech translation. In: Proc. of ICASSP 1997, pp. 111-114.
26. Wan, S.; Dale, R.; Dras, M. 2005. Searching for grammaticality: propagating dependencies in the viterbi algorithm. In: Proc. of the 10th European Workshop on Natural Language Generation.
27. White, J.; O'Connell, T.; O'Mara, F. 1994. The ARPA MT evaluation methodologies: evolution, lessons, and future approaches. In: Proc. of AMTA, pp. 193-205.
28. Wolters, M.; Isaac, K.; Renals, S. 2010. Evaluating speech synthesis intelligibility using amazon mechanical turk. In: Proc. of SSW7, pp. 136-141.
29. Wu, Y.; Nankaku, Y.; Tokuda, K. 2009. State mapping based method for cross-lingual speaker adaptation in HMM-based speech synthesis. In: Proc. of Interspeech 2009, pp. 528-531.
30. Yamada, S.; Kodama, S.; Matsuoka, T.; Araki, H.; Murakami, Y.; Takano, O.; Sakamoto, Y. 2005. A report on the machine translation market in Japan. In: Proc. of MT Summit X, pp. 55-62.
31. Yoshimura, T.; Tokuda, K.; Masuko, T.; Kobayashi, T.; Kitamura, T. 1999. Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis. In: Proc. of Eurospeech, pp. 2347-2350.
32. Zen, H.; Tokuda, K.; Masuko, T.; Kobayashi, T.; Kitamura, T. 2004. Hidden semi-Markov model based speech synthesis. In: Proc. of ICSLP, pp. 1185-1180.