Splitting input for machine translation using N-gram language model together with utterance similarity

IEICE Transactions on Information and Systems

Volumn E88-D, Issue 6, 2005, Pages 1256-1264

  Doi, Takao ^a   Sumita, Eiichiro ^a,b  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b ACM Transactions

Author keywords

Corpus based machine translation; Edit distance; N gram language model; Similarity; Utterance splitting

Indexed keywords

FORMAL LANGUAGES; LEARNING SYSTEMS; MATHEMATICAL MODELS;

CORPUS-BASED MACHINE TRANSLATION; EDIT-DISTANCE; N-GRAM LANGUAGE MODEL; SIMILARITY; UTTERANCE SPLITTING;

SPEECH ANALYSIS;

EID: 25844443771     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1093/ietisy/e88-d.6.1256     Document Type: Article

References (22)

1. A. Lavie, "GLR*: A robust grammar-focused parser for spontaneously spoken languages," CMU-CS-96-126, School of Computer Science, Carnegie Mellon University, 1996.
2. A. Berger, S.A. Della Pietra, and V.J. Della Pietra, "A maximum entropy approach to natural language processing," Computational Linguistics, vol.22, no.1, pp. 1-36, 1996.
3. T. Takezawa and T. Morimoto, "Transformation into meaningful chunks by dividing or connecting utterance units," Journal of Natural Language Processing, vol.6, no.2, pp.83-95, 1999.
4. H. Nakajima and H. Yamamoto, "The statistical language model for utterance splitting in speech recognition," Trans. IPSJ, vol.42, no. 11, pp.2681-2688, 2001.
5. N. Gupta, S. Bangalore, and M. Rahim, "Extracting clauses for spoken language understanding in conversational systems," Proc. ICSLP 2002, pp.361-364, 2002.
6. E. Sumita and H. Iida, "Experiments and prospects of example-based machine translation," Proc. 29th Annual Meeting of ACL, pp.185-192, 1991.
7. L. Cranias, H. Papageorgiou, and S. Piperidis, "Example retrieval from a translation memory," Natural Language Engineering, vol.3, no.4, pp.255-277, 1997.
8. T. Doi, E. Sumita, and H. Yamamoto, "Efficient retrieval method and performance evaluation of example-based machine translation using edit-distance," Trans. IPSJ, vol.45, no.6, pp.1681-1695, 2004.
9. T. Doi and E. Sumita, "Input sentence splitting and translating," Proc. Workshop on Building and Using Parallel Texts, HLT-NAACL 2003, pp.104-110, 2003.
10. K. Imamura, "Application of translation knowledge acquired by hierarchical phrase alignment for pattern-based MT," Proc. TMI-2002, pp.74-84, 2002.
11. E. Sumita, "Example-based machine translation using DP-matching between word sequences," Proc. 39th ACL Workshop on DDMT, pp.1-8, 2001.
12. T. Watanabe and E. Sumita, "Example-based decoding for statistical machine translation," Proc. MT Summit IX, pp.410-417, 2003.
13. O. Furuse, S. Yamada, and K. Yamamoto, "Splitting long or ill-formed input for robust spoken-language translation," Proc. COLING-ACL'98, pp.421-427, 1998.
14. D.C. Manning and H. Schütze, Foundations of statistical natural language processing, The MIT Press, London, England, 1999.
15. T. Takezawa and G. Kikui, "Collecting machine-translation-aided bilingual dialogues for corpus-based speech translation," Proc. EUROSPEECH, pp.2757-2760, 2003.
16. G. Kikui, E. Sumita, T. Takezawa, and S. Yamamoto, "Creating corpora for speech-to-speech translation," Proc. EUROSPEECH, pp.381-384, 2003.
17. S. Ohno and M. Hamanishi, Ruigo-Shin-Jiten, Kadokawa, Tokyo, Japan, 1984.
18. P. Clarkson and R. Rosenfeld, "Statistical language modeling using the CMU-Cambridge toolkit," Proc. EUROSPEECH, pp.2707-2710, 1997.
19. K. Papineni, S. Roukos, T. Ward, and W. Zhu, "Bleu: A method for automatic evaluation of machine translation," Proc. 40th Annual Meeting of ACL, pp.311-318, 2002.
20. G. Doddington, "Automatic evaluation of machine translation quality using N-gram co-occurrence statistics," Proc. HLT 2002 Conference, 2002.
21. N. Ueffing, F. Och, and H. Ney, "Generation of word graphs in statistical machine translation," Proc. Conf. on Empirical Methods for Natural Language Processing, pp. 156-163, 2002.
22. A. Siddharthan, "An architecture for a text simplification system," Proc. Language Engineering Conference 2002, pp.64-71, 2002.