A beam-search extraction algorithm for comparable data

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 225-228

  Tillmann, Christoph ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; DATA MINING;

BEAM SEARCH; BEAM SEARCH ALGORITHMS; CANDIDATE TARGET; EXTRACTING PARALLEL SENTENCE PAIRS; EXTRACTION ALGORITHMS; NOVEL ALGORITHM; PRE-FILTERING; ENTROPY CLASSIFIERS; MAXIMUM-ENTROPY;

DATA MINING; INFORMATION RETRIEVAL SYSTEMS;

EID: 79953849023     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1667583.1667653     Document Type: Conference Paper

References (16)

1. Peter F. Brown, Vincent J. Della Pietra, Stephen A. Della Pietra, and Robert L. Mercer. 1993. The Mathematics of Statistical Machine Translation: Parameter Estimation. CL, 19(2):263-311.
2. Pascale Fung and Percy Cheung. 2004. Mining Very- Non-Parallel Corpora: Parallel Sentence and Lexicon Extraction via Bootstrapping and EM. In Proc, of EMNLP 2004, pages 57-63, Barcelona, Spain, July.
3. Dave Graff. 2006. LDC2006T12: Spanish Gigaword Corpus First Edition. LDC.
4. Dave Graff. 2007. LDC2007T07: English Gigaword Corpus Third Edition. LDC.
5. Philipp Koehn. 2004. Pharaoh: a Beam Search Decoder for Phrase-Based Statistical Machine Translation Models. In Proceedings of AMTA'04,Washington DC, September-October.
6. Dragos S. Munteanu and Daniel Marcu. 2005. Improving Machine Translation Performance by Exploiting Non-Parallel Corpora. CL, 31(4):477-504.
7. H. Ney. 1984. The Use of a One-stage Dynamic Programming Algorithm for ConnectedWord Recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing, 32(2):263-271.
8. Chris Quirk, Raghavendra Udupa, and Arul Menezes. 2007. Generative Models of Noisy Translations with Applications to Parallel Fragment Extraction. In Proc. of the MT Summit XI, pages 321-327, Copenhagen,Demark, September.
9. Philip Resnik and Noah Smith. 2003. The Web as Parallel Corpus. CL, 29(3):349-380.
10. S E Robertson, S Walker, M M Beaulieu, and M Gatford. 1995. Okapi at TREC-4. In Proc. of the 4th Text Retrieval Conference (TREC-4), pages 73-96.
11. Matthew Snover, Bonnie Dorr, and Richard Schwartz. 2008. Language and Translation Model Adaptation using Comparable Corpora. In Proc. of EMNLP08, pages 856-865, Honolulu, Hawaii, October.
12. Christoph Tillmann and Jian-Ming Xu. 2009. A Simple Sentence-Level Extraction Algorithm for Comparable Data. In Companion Vol. of NAACL HLT 09, pages 93-96, Boulder, Colorado, June.
13. Christoph Tillmann and Tong Zhang. 2007. A Block Bigram Prediction Model for Statistical Machine Translation. ACM-TSLP, 4(6):1-31, July.
14. Christoph Tillmann, Stefan Vogel, Hermann Ney, and Alex Zubiaga. 1997. A DP-based Search Using Monotone Alignments in Statistical Translation. In Proc. of ACL 97, pages 289-296, Madrid,Spain, July.
15. Masao Utiyama and Hitoshi Isahara. 2003. Reliable Measures for Aligning Japanese-English News Articles and Sentences. In Proc. of ACL03, pages 72-79, Sapporo, Japan, July.
16. T.K. Vintsyuk. 1971. Element-Wise Recognition of Continuous Speech Consisting of Words From a Specified Vocabulary. Cybernetics (Kibernetica), (2):133-143,March-April