Learning finite-state models for machine translation

Machine Learning

Volumn 66, Issue 1, 2007, Pages 69-91

  Casacuberta, Francisco ^a   Vidal, Enrique ^a  

^a INSTITUTO TECNOLÓGICO DE INFORMÁTICA   (Spain)

Author keywords

Grammatical inference; Machine translation; Stochastic finite state transducers

Indexed keywords

CONFORMAL MAPPING; FINITE AUTOMATA; FORMAL LANGUAGES; PROBLEM SOLVING; SECURITY OF DATA; TRANSDUCERS; TRANSLATION (LANGUAGES);

GRAMMATICAL INFERENCE; MACHINE TRANSLATION; STOCHASTIC FINITE STATE TRANSDUCERS; TASK COMPLEXITY;

LEARNING SYSTEMS;

EID: 33845194768     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-006-9612-9     Document Type: Article

References (80)

1. Alshawi, H., Bangalore, S., & Douglas, S. (2000). Learning dependency translation models as collections of finite state head transducers. Computational Linguistics, 20(1), 45-60.
2. Amengual, J., Benedí, J., Casacuberta, F., Castaño, A., Castellanos, A., Jiménez, V., Llorens, D., Marzal, A., Pastor, M., Prat, F., Vidal, E., & Vilar, J. (2000). The EuTrans-I speech translation system. Machine Translation, 15, 75-103.
3. Amengual, J., Sanchis, A., Vidal, E., & Benedí, J. (2001). Language simplification through error-correcting and grammatical inference techniques. Machine Learning, 44, 143-159.
4. Amengual, J., & Vidal, E. (1998). Efficient error-corecting viterbi parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(10), 1109-1116.
5. Andrés, J. (2005). N-HSEST: N-history segmented enumerable stochastic transducer. Technical Report DSIC-11/16/05, Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia.
6. Bangalore, S., & Riccardi, G. (2003). Stochastic finite-state models for spoken language machine translation. Machine Translation, 17(3), 165-184.
7. Barrachina, S., Bender, O., Casacuberta, F., Civera, J., Cubel, E., Khadivi, S., Lagarda, A., Ney, H., Tomás, J., Vidal, E., & Vilar, J.-M. (2006). Statistical approaches to computer-assisted translation. To be published.
8. Barrachina, S., & Vilar, J. M. (1999). Bilingual clustering using monolingual algorithms. In Proceedings of the 8th International Conference on Theoretical and Methodological Issues in Machine Translation (TMI 99), (pp. 77-87), University College, Chester, England.
9. Berger, A. L., Brown, P. F., Pietra, S. A. D., Pietra, V. J. D., Gillett, J. R., Kehler, A. S., & Mercer, R. L. (1996). Language translation apparatus and method of using context-based translation models. United States Patent, No. 5510981.
10. Berstel, J. (1979). Transductions and context-free languages. B. G. Teubner Stuttgart.
11. Brown, P. F., Cocke, J., Pietra, S. A. D., Pietra, V. J. D., Jelinek, F., Lafferty, J. D., Mercer, R. L., & Roosin, P. S. (1990). A statistical approach to machine translation. Computational Linguistics, 16(2), 79-85.
12. Brown, P. F., Pietra, S. A. D., Pietra, V. J. D., & Mercer, R. L. (1993). The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2), 263-311.
13. Casacuberta, F. (2000). Inference of finite-state transducers by using regular grammars and morphisms. In Grammatical inference: Algorithms and applications. Proceedings of the 5th ICGI, vol. 1891 of Lecture Notes in Computer Science (pp. 1-14). Springer-Verlag.
14. Casacuberta, F., & de la Higuera, C. (2000). Computational complexity of problems on probabilistic grammars and transducers. In Grammatical inference: Algorithms and applications. Proceedings of the 5th ICGI, vol. 1891 of Lecture Notes in Computer Science (pp. 15-24). Springer-Verlag.
15. Casacuberta, F., Ney, H., Och, F. J., Vidal, E., Vilar, J. M., Barrachina, S., García-Varea, I., Llorens, D., Martínez, C., Molau, S., Nevado, F., Pastor, M., Picó, D., Sanchis, A., & Tillmann, C. (2004). Some approaches to statistical and finite-state speech-to-speech translation. Computer Speech and Language, 18, 25-47.
16. Casacuberta, F., & Vidal, E. (2004). Machine translation with inferred stochastic finite-state transducers. Computational Linguistics, 30(2), 205-225.
17. Casacuberta, F., Vidal, E., & Picó, D. (2005). Inference of finite-state transducers from regular languages. Pattern Recognition, 38, 1431-1443.
18. Castellanos, A., Galiano, I., & Vidal, E. (1994). Application of OSTIA to machine translation tasks. In R. C. Carrasco, & J. Oncina (Eds.), Grammatical inference and applications, Proceedings of 2nd ICGI, vol. 862 of Lecture Notes in Computer Science (pp. 93-105). Springer-Verlag.
19. Castellanos, A., Vidal, E., Varó, A., & Oncina, J. (1998). Language understanding and subsequential transducer learning. Computer Speech and Language, 12, 193-228.
20. Charniak, E., Knight, K., & Yamada, K. (2003). Syntax-based language models for statistical machine translation. In Proceedings of the Machine Translation Summit IX, (pp. 40-46), New Orleans, Louisiana, USA.
21. Civera, J., Vilar, J., Cubel, E., Lagarda, A., Barrachina, S., Casacuberta, F., Vidal, E., Picó, D., & González, J. (2004). A syntactic pattern recognition approach to computer assisted translation. In A. Fred, T. Caelli, A. Campilho, R. P. Duin, & de Ridder, D. (Eds.), Advances in statistical, structural and syntactical pattern recognition. Proceedings of the Joint IAPR International Workshops on Syntactical and Structural Pattern Recognition and Statistical Pattern Recognition, Lecture Notes in Computer Science (pp. 207-215). Springer-Verlag.
22. Cubel, E., Civera, J. F. C., Lagarda, A. L., Vilar, J. M., & Vidal, E. (2005). Hybrid stochastic finite-state learning techniques and search algorithms (deliverable d5.3). Technical report, TransType2(IST-2001-32091), ITI.
23. Cubel, E., González, J., Lagarda, A., Casacuberta, F., Juan, A., & Vidal, E. (2003). Adapting finite-state translation to the transtype2 project. In Proceedings of the Joint Conference Combining the 8th International Workshop of the European Association for Machine Translation and the 4th Controlled Language Applications Workshop (pp. 54-60), Dublin, Ireland.
24. Díaz-Verdejo, J., Peinado, A., Rubio, A., Segarra, E., Prieto, N., & Casacuberta, F. (1998). Albayzin: A task oriented Spanish speech corpus. In Proceedings of First International Conference on Language Resources and Evaluation (LREC-98) (vol. 1, pp. 497-501).
25. EuTrans (2000). Example-based language translation systems. Final report. Technical report, Instituto Tecnológico de Informática, Fondazione Ugo Bordoni, Rheinisch Westfälische Technische Hochschule Aachen Lehrstuhl für Informatik VI, Zeres GmbH Bochum: Long Term Research Domain, Project Number 30268.
26. Extra (1997). Extensions of the text and speech translation system to restricted domains that can be learnt from examples. Universitat Jaume I and Universitat Politècnica de València, CICYT project.
27. Feldman, J. A., Lakoff, G., Stolcke, A., & san Hollbach Weber, S. (1990). Miniature Language Acquisition: A touchstone for cognitive science. Technical Report TR-90-009, International Computer Science Institute, Berkeley, California (EEUU).
28. Germann, U. (2003). Greedy decoding for statistical machine translation in almost linear time. In M. Hearst, & M. Ostendorf (Eds.), Proceedings of the Human Language Technology and North American Association for Computational Linguistics Conference (HLT/NAACL) (pp. 72-79), Edmonton, Alberta, Canada.
29. Gonzalez, J., Nevado, F., Navarro, J., Pastor, M., Casacuberta, F., Vidal, E., Fabregat, F., de Val, J., Arenas, L., Pla, F., & Tomás, J. (2002). SISHITRA: Sistemas de traducción catalán-castellano y castellano-catalán con entrada de texto y voz. In Actas de las II Jornadas en Tecnología del Habla, Granada. Red Temática en Tecnologías del Habla.
30. Gonzalez, J., Ortiz, D., Tomás, J., & Casacuberta, F. (2004). A comparison of different statistical machine translation approaches for Spanish-to-Basque translation. In Proceedings of the Terceras Jornadas de Tecnología del Habla (pp. 213-218). Valencia, Spain.
31. Jelinek, F. (1998). Statistical methods for speech recognition. Cambridge, MA. The MIT Press.
32. Khadivi, S. & Goutte, C. (2003). Tools for corpus alignment and evaluation of the alignments (deliverable d4.9). Technical report, TransType2(IST-2001-32091), RWTH Aachen and Xerox Co.
33. Knight, K. (1999). Decoding complexity in word-replacement translation models. Computational Linguistics, 25(4), 607-615.
34. Knight, K., & Al-Onaizan, Y. (1998). Translation with finite-state devices. In Proceedings of the 4th AMTA Conference (pp. 421-437). Langhorne, Pennsylvania.
35. Knight, K., Al-Onaizan, Y., Curin, J., Jahr, M., Lafferty, J., Melamed, D., Purdyand, D., Och, F., Smith, N., & Yarowsky, D. (1999). EGYPT a statistical machine translation toolki. http://www.clsp.jhu.edu/ws99/projects/ mt/. An NFS Workshop: Language Engineering for Students and Professionals Integrating Research and Education.
36. Koehn, P. (2004). Pharaoh: a beam search decoder for phrase-based statistical machine translation models. In Proceedings of the The 6th Conference of the Association for Machine Translation in the Americas (AMTA04), vol. 3265 of Lecture Notes in Artificial Intelligence (pp. 115-124). Georgetown University, Washington DC, USA: Springer.
37. Kornai, A. (1985). Natural languages and the chomsky hierarchy. In Proceedings of the Second Conference on European CChapter of the Association for Computational Linguistics (pp. 1-7). Morristown, NJ, USA. Association for Computational Linguistics.
38. Kumar, S., & Byrne, W. (2003). A weighted finite state transducer implementation of the alignment template model for statistical machine translation. In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (pp. 63-70). Edmonton.
39. Kumar, S., Deng, Y., & Byrne, W. (2006). A weighted finite state transducer translation template model for statistical machine translation. Natural Language Engineering 12(1), 35-75.
40. Langlais, P., Foster, G., & Lapalme, G. (2000). TransType: A computer-aided translation typing system. In Proceedings of the Workshop on Embedded Machine Translation Systems (NAACL/ANLP2000) (pp. 46-52). Seattle, Washington.
41. Llorens, D., Vilar, J. M., & Casacuberta, F. (2002). Finite state language models smoothed using n-grams. International Journal of Pattern Recognition and Artificial Intelligence, 16(3), 275-289.
42. Macklovitch, E. (2004). The contribution of end-users to the transtype2 project. In Proceedings of the 6th Conference of the Association for Machine Translation in the Americas (AMTA-2004) (pp. 197-207). TT2.
43. Mäkinen, E. (1999). Inferring finite transducers. Technical Report A-1999-3. University of Tampere.
44. Marcu, D., & Wong, W. (2002). A phrase-based joint probability model for statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and Very Large Corpora EMNLP-02 (pp. 133-139). Philadelphia PA, USA.
45. Ney, H., Martin, S., & Wessel, F. (1997). Statistical language modeling using leaving-one-out. In S. Young, & G. Bloothooft (Eds.), Corpus-Based Statiscal Methods in Speech and Language Processing (pp. 174-207). Kluwer Academic Publishers.
46. Ney, H., Nießen, S., Och, F. J., Sawaf, H., Tillmann, C., & Vogel, S. (2000). Algorithms for statistical translation of spoken language. IEEE Transactions on Speech and Audio Processing, 8(1), 24-36.
47. Ney, H., Welling, L., Ortmanns, S., Beulen, K., & Wessel, F. (1998). The RWTH large vocabulary continuous speech recognition system. In Proceeding of the International Conference on Acoustic, Speech and Signal Processing (pp. 853-856).
48. Niwßen, S. (2003). Improving statistical machine translation using morpho-syntactic information. PhD thesis, RWTH Aachen, Germany.
49. Nießen, S., Och, F., Leusch, G., & Ney, H. (2000). An evaluation tool for machine translation: Fast evaluation for MT research. In Proceedings of the 2nd International Conference on Language Resources and Evaluation (pp. 39-45). Athens, Greece.
50. Och, F., & Ney, H. (2003). A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1), 19-51.
51. Och, F., & Ney, H. (2004). The alignment template approach to statistical machine translation. Computational Linguistics, 30(4), 417-449.
52. Och, F., Zens, R., & Ney, H. (2003). Efficient search for interactive statistical machine translation. In Proceedings of the 10th Conference of the European Chapter of the Association for Computational Linguistics (EACL) (pp. 387-393). Budapest, Hungary.
53. Oncina, J., García, P., & Vidal, E. (1993). Learning subsequential transducers for pattern recognition interpretation tasks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(5), 448-458.
54. Oncina, J., & Varó, M. (1996). Using domain information during the learning of a subsequential transducer. In Grammatical Inference: Learning Syntax from Sentences, vol. 1147 of Lecture Notes on Computer Science (pp. 313-325).
55. Ortiz, D., García-Varea, I., & Casacuberta, F. (2005). Thot: a toolkit to train phrase-based statistical translation models. In Proceedings of the Tenth Machine Translation Summit (pp. 141-148). Phuket, Thailand.
56. Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2002). BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association Computational Linguistics (ACL) (pp. 311-318) Philadelphia PA, USA.
57. Pérez, A., Casacuberta, F., Torres, I., & Guijarrubia, V. (2005). Finite state transducers based on K-TSS grammars for speech translation. In Proceedings of the Finite-State Methods and Natural Language Processing (FSMNLP 2005) (pp. 270-272) Helsinki, Finland.
58. Picó, D., & Casacuberta, F. (2001). Some statistical- estimation methods for stochastic finite-state transducers. Machine Learning, 44, 121-141.
59. Picó, D., Caseiro, D., González, J., Trancoso, I., & Casacuberta, F. (2005). Finite-state transducer inference for a speech-input portuguese-to-english machine translation system. In Proceedings of Interspeech'2005 - Eurospeech: 9th European Conference on Speech Communication and Technology (pp. 2277-2280). Lisbon, Portugal.
60. Picó, D., Tomás, J., & Casacuberta, F. (2004). GIATI: A general methodology for finite-state translation using alignments. In Statistical, Structural and Syntactical Pattern Recognition. Proceedings of the Joint IAPR Intternational Workshops SSPR2004 and SPR2004, vol. 3138 of Lecture Notes in Computer Science (pp. 216-223). Lisboa, Portugal: Springer-Verlag.
61. SisHiTra (2001). Hybrid systems for the catalan-to-spanish transaltion from text and speech. Instituto Tecnológico de Informática and Universitat d'Alacant, CICYT project.
62. TeFaTe (2003). Finite-state technologies for specialized translation. Universitat Politècnica de València and Universitat d'Alacant, CICYT project.
63. Tillmann, C., & Ney, H. (2003). Word reordering and a dynamic programming beam search algorithm for statistical machine translation. Computational Linguistics, 29(1), 97-133.
64. Tomás, J., & Casacuberta, F. (2001). Monotone statistical translation using word groups. In Proceedings of the Machine Translation Summit VIII (pp. 357-361). Santiago de Compostela.
65. Tomás, J., & Casacuberta, F. (2006). Monotone and non-monotone phrase-based statistical machine translation. To be published.
66. Tomás, J., Lloret, J., & Casacuberta, F. (2005). Phrase-based alignment models for statistical machine translation. In Proceedings of the Iberian Conference on Pattern Recognition and Image Analysis, vol. 3523 of Lecture Notes in Computer Science (pp. 605-613). Estoril (Portugal), Springer-Verlag.
67. Tracom (1995). Spoken language translation and understanding using learning techniques from examples. Universitat Politècnica de València and Universitat Jaume I, CICYT project.
68. TransType2 (2001). TT2. TransType2 - Computer Assisted Translation. Project Technical Annex.
69. Tsukada, H., & Nagata, M. (2004). Efficient decoding for statistical machine translation with a fully expanded WFST model. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing (pp. 427-433). Barcelona.
70. Vidal, E. (1997). Finite-state speech-to-speech translation. In Proceedings of the International Conference on Acoustics Speech and Signal Processing (ICASSP-97), (vol. 1, pp. 111-114). Munich.
71. Vidal, E., & Casacuberta, F. (2004). Learning finite-state models for machine translation. In Grammatical inference: Algorithms and applications. Proceedings of the 7th International Coloquium ICGI 2004, vol. 3264 of Lecture Notes in Artificial Intelligence (pp. 16-27). Athens, Greece: Springer, Invited conference.
72. Vidal, E., García, P., & Segarra, E. (1989). Inductive learning of finite-state transducers for the interpretation of unidimensional objects. In R. Mohr, T. Pavlidis, & A. Sanfeliu (Eds.), Structural pattern analysis (pp. 17-35). World Scientific pub.
73. Vidal, E., Thollard, F., de la Higuera, F. C. C., & Carrasco, R. (2005). Probabilistic finite-state machines - part II. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(7), 1026-1039.
74. Vilar, J. M. (2000). Improve the learning of subsequential transducers by using alignments and dictionaries. In Grammatical Inference: Algorithms and Applications, vol. 1891 of Lecture Notes in Artificial Intelligence (pp. 298-312). Springer-Verlag.
75. Vilar, J. M., Jiménez, V. M., Amengual, J. C., Castellanos, A., Llorens, D., & Vidal, E. (1996a). Text and speech translation by means of subsequential transducers. Natural Language Engineeering, 2(4), 351-354. Special issue on Extended Finite Models of Language.
76. Vilar, J. M., Vidal, E., & Amengual, J. C. (1996b). Learning extended finite-state models for language translation. In Proc. of Extended Finite State Models Workshop (of ECAI'96) (pp. 92-96). Budapest.
77. Wu, D. (1995). Stochastic inversion transduction grammars, with application to segmentation, bracketing, and alignment of parallel corpora. In Proceedings of 14th International Joint Conference on Artificial Intelligence (pp. 1328-1335). Montreal, Canada.
78. Young, S., Odell, J., Ollason, D., Valtchev, V., & Woodland, P. (1997). The HTK Book (Version 2.1). Cambridge University Department and Entropic Research Laboratories Inc.
79. Zens, R., & Ney, H. (2004). Improvements in phrase-based statistical machine translation. In Proceedings of the Human Language Technology Conference (HLT-NAACL) (pp. 257-264). Boston, MA.
80. Zens, R., Och, F., & Ney, H. (2002). Phrase-based statistical machine translation. In G. L. M., Jarke, & J. Koehler, (Eds.), Advances in artificial intelligence. Proceedings of the 25. Annual German Conference on AI, KI 2002, vol. 2479 of LNAI (pp. 18-32). Springer Verlag.