Sentence alignment of Hungarian-English parallel corpora using a hybrid algorithm

Acta Cybernetica

Volumn 18, Issue 3, 2008, Pages 463-478

  Tóth, Krisztina ^a   Farkas, Richárd ^a   Kocsor, András ^a  

^a UNIVERSITY OF SZEGED   (Hungary)

Author keywords

Anchor; Cognates; Dynamic programming; Hybrid method; Length based alignment; Named entity recognition; Sentence alignment; Sentence segmentation

Indexed keywords

EID: 47749106772     PISSN: 0324721X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. Brown, P. F., Lai, J. C., and Mercer, R. L. Aligning sentences in parallel corpora. In Meeting of the Association for Computational Linguistics, pages 169-176, 1991.
2. Chen, S. F. Aligning sentences in bilingual corpora using lexical information. In Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics, pages 9-16. Columbus, Ohio, 1993.
3. Chuang, Thomas C. and Chang, Jason S. Adaptive bilingual sentence alignment. In AMTA '02: Proceedings of the 5th Conference of the Association for Machine Translation in the Americas on Machine Translation: From Research to Real Users, pages 21-30, London, UK, 2002. Springer-Verlag.
4. Collier, N., Ono, K., and Hirakawa, H. An experiment in hybrid dictionary and statistical sentence alignment. In COLING-ACL, pages 268-274, 1998.
5. Csendes, D., Csirik, J., and Gyimóthy, T. The szeged corpus: A pos tagged and syntactically annotated hungarian natural language corpus. In Proceedings of the 7th International Conference on Text, Speech and Dialogue (TSD 2004), pages 41-47, 2004.
6. Fattah, Mohamed Abdel, Ren, Fuji, and Kuroiwa, Shingo. Probabilistic neural network based english-arabic sentence alignment. In CICLing, pages 97-100, 2006.
7. Francis, W. and Kucera, H. Frequency analysis of English usage: Lexicon and grammar. Houghton Mifflin, Boston, 1982.
8. Gale, W. A. and Church, K. W. A program for aligning sentences in bilingual corpora. In Meeting of the Association for Computational Linguistics, pages 177-184, 1991.
9. Hofland, K. and Johansson, S. The translation corpus aligner: A program for automatic alignment of parallel texts. In Johansson, S. and Oksefjell, S., editors, Corpora and Cross-linguistic Research: Theory, Method, and Case Studies, pages 87-100. Amsterdam: Rodopi, 1998.
10. Kay, M. and Röscheisen, M. Text-translation alignment. volume 19, pages 121-142, 1993.
11. Liberman, M. Y. and Church, K. W. Text analysis and word pronunciation in text-to-speech synthesis. In Sadaoki Furui and Man Mohan Sondhi, editors, Advances in Speech Signal Processing, pages 791-831. Marcel Dekker, Inc., 1992.
12. McEnery, A. M. and Oakes, M. P. Cognate extraction in the crater project. In S. Armstrong-Warwick and E. Tzoukerman (eds.), Proceedings of the EACL-SIGDAT Workshop (Dublin), pages 77-86, 1995.
13. Moore, R. C. Fast and accurate sentence alignment of bilingual corpora. In AMTA '02: Proceedings of the 5th Conference of the Association for Machine Translation in the Americas on Machine Translation: From Research to Real Users, pages 135-144, London, UK, 2002. Springer-Verlag.
14. Muller, H., Amerl, V., and Natalis, G. Worterkennungsverfahren als Grundlage einer Universalmethode zur automatischen Segmentierung von Texten in Sätze. Ein Verfahren zur maschinellen Satzgrenzenbestimmung im Englischen. Sprache und Datenverarbeitung, 1. 1980.
15. Pohl, G. Szövegszinkronizációs módszerek, hibrid bekezdés- és mondatszinkronizációs megoldás. In Proceedings of Magyar Számítógé pes Nyelvészeti Konferencia (MSZNY 2003), pages 254-259, 2003.
16. Quinlan, J. R. C4.5: Programs for machine learning. Morgan Kaufmann, 1993.
17. és Kommunikáció Tanszék Média Oktató és Kutató Központ, BME Szociológia. Hunglish cd-rom, http://szotar.mokk.bme.hu/hunglish/search/corpus. 2006.
18. Sang, E. F. Tjong Kim and Meulder, F. De. Introduction to the conll-2003 shared task: Language-independent named entity recognition. In Daelemans, Walter and Osborne, Miles, editors, Proceedings of CoNLL-2003, pages 142-147. Edmonton, Canada, 2003.
19. Schapire, Robert E. The Strength of Weak Learnability, volume 5. 1990.
20. Simard, M., Foster, G., and Isabelle, P. Using cognates to align sentences in bilingual corpora. In Proceedings of the Fourth International Conference on Theoretical and Methodogical Issues in Machine translation (TMI92), (Montreal), pages 67-81, 1992.
21. Szarvas, Gy., Farkas, R., Felfoldi, L., Kocsor, A., and Csirik, J. A highly accurate named entity corpus for hungarian. In Proceedings of LREC2006, 2006.
22. Szarvas, Gy., Farkas, R., and Kocsor, A. A Multilingual Named Entity Recognition System Using Boosting and C4.5 Decision Tree Learning Algorithms. Springer-Verlag, 2006.
23. Varga, D., Halacsy, P., Kornai, A., Nagy, V., Nemeth, L., and Tron, V. Parallel corpora for medium density languages. pages 590-596. Borovets, Bulgaria, 2005.