Adaptation of machine translation for multilingual information retrieval in the medical domain

Artificial Intelligence in Medicine

Volumn 61, Issue 3, 2014, Pages 165-185

  Pecina, Pavel ^a   Dušek, Ondřej ^a   Goeuriot, Lorraine ^b   Hajič, Jan ^a   Hlaváčová, Jaroslava ^a   Jones, Gareth J F ^b   Kelly, Liadh ^b   Leveling, Johannes ^b   Mareček, David ^a   Novák, Michal ^a   Popel, Martin ^a   Rosa, Rudolf ^a   Tamchyna, Aleš ^a   Urešová, Zdeňka ^a  

^a CHARLES UNIVERSITY   (Czech Republic)

^b DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Compound splitting; Cross language information retrieval; Domain adaptation of statistical machine translation; Intelligent training data selection for machine translation; Medical query translation; Statistical machine translation

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; DATA REDUCTION; EXPERIMENTS; INFORMATION RETRIEVAL; NATURAL LANGUAGE PROCESSING SYSTEMS; SEARCH ENGINES;

COMPOUND SPLITTING; CROSS LANGUAGE INFORMATION RETRIEVAL; MACHINE TRANSLATIONS; QUERY TRANSLATIONS; STATISTICAL MACHINE TRANSLATION;

QUALITY CONTROL;

ADAPTATION; ALGORITHM; ARTICLE; AUTOMATIC SPEECH RECOGNITION; BOOK; COMPUTER SYSTEM; FEEDBACK SYSTEM; GENERAL PRACTITIONER; HIDDEN MARKOV MODEL; HUMAN; INFORMATION RETRIEVAL; LANGUAGE; LINGUISTICS; MACHINE LEARNING; MEDICAL INFORMATICS; MEDICAL LITERATURE; MEDICAL SUBJECT HEADINGS; MEDICAL TERMINOLOGY; PRIORITY JOURNAL; PUBLICATION; SEARCH ENGINE; TELEHEALTH; TRAINING; UNIFIED MEDICAL LANGUAGE SYSTEM; ARTIFICIAL INTELLIGENCE; COMPUTER PROGRAM; NATURAL LANGUAGE PROCESSING; PROCEDURES; TRANSLATING (LANGUAGE);

ALGORITHMS; ARTIFICIAL INTELLIGENCE; INFORMATION STORAGE AND RETRIEVAL; LANGUAGE; NATURAL LANGUAGE PROCESSING; SOFTWARE; TRANSLATING; UNIFIED MEDICAL LANGUAGE SYSTEM;

EID: 84904321749     PISSN: 09333657     EISSN: 18732860     Source Type: Journal    
DOI: 10.1016/j.artmed.2014.01.004     Document Type: Article

References (135)

1. Fox S. Health Topics: 80% of internet users look for health information online, Technical Report 2011, Pew Research Center.
2. Cline R.J.W., Haynes K.M. Consumer health information seeking on the internet: the state of the art. Health Education Research 2001, 16:671-692.
3. Lopes C.T., Ribeiro C. Measuring the value of health query translation: an analysis by user language proficiency. Journal of the American Society for Information Science and Technology 2013, 64:951-963.
4. Koehn P., Hoang H., Birch A., Callison-Burch C., Federico M., Bertoldi N., et al. Moses: open source toolkit for statistical machine translation. Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, Companion Volume Proceedings of the Demo and Poster Sessions 2007, 177-180. Association for Computational Linguistics, Prague, Czech Republic.
5. Papineni K., Roukos S., Ward T., Zhu W.-J. BLEU: a method for automatic evaluation of machine translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics 2002, 311-318. Association for Computational Linguistics, Philadelphia, PA, USA.
6. Tillmann C., Vogel S., Ney H., Zubiaga A., Sawaf H. Accelerated DP based search for statistical translation. Proceedings of the Fifth European Conference on Speech Communication and Technology 1997, 2667-2670. International Speech Communication Association, Rhodes, Greece. G. Kokkinakis, N. Fakotakis, E. Dermatas (Eds.).
7. Jelinek F. Statistical methods for speech recognition 1997, MIT Press, Cambridge, MA, USA.
8. Och F.J., Ney H. A systematic comparison of various statistical alignment models. Computational Linguistics 2003, 29:19-51.
9. Och F.J. Minimum error rate training in statistical machine translation. Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics 2003, 160-167. Association for Computational Linguistics, Sapporo, Japan.
10. Bertoldi N., Haddow B., Fouet J.-B. Improved minimum error rate training in Moses. Prague Bulletin of Mathematical Linguistics 2009, 91:7-16.
11. Koehn P. Europarl: a parallel corpus for statistical machine translation. Conference Proceedings: the tenth Machine Translation Summit 2005, 79-86. Asia-Pacific Association for Machine Translation, Phuket, Thailand.
12. Roukos S., Graff D., Melamed D. Hansard corpus of parallel English and French 1995, Linguistic Data Consortium, Philadelphia, PA, USA.
13. Steinberger R., Pouliquen B., Widiger A., Ignat C., Erjavec T., Tufis D., et al. The JRC-Acquis: a multilingual aligned parallel corpus with 20+ languages. Proceedings of the Fifth International Conference on Language Resources and Evaluation 2006, 2141-2147. European Language Resources Association, Genoa, Italy. N. Calzolari, K. Choukri, A. Gangemi, B. Maegaard, J. Mariani, J. Odijk, D. Tapias (Eds.).
14. Callison-Burch C., Koehn P., Monz C., Post M., Soricut R., Specia L. Findings of the 2012 workshop on statistical machine translation. Proceedings of the Seventh Workshop on Statistical Machine Translation 2012, 10-51. Association for Computational Linguistics, Montréal, Canada.
15. Pecina P., Toral A., Papavassiliou V., Prokopidis P., van Genabith J. Domain adaptation of statistical machine translation using web-crawled resources: A case study. EAMT 2012: Proceedings of the 16th Annual Conference of the European Association for Machine Translation 2012, 145-152. European Association for Machine Translation, Trento, Italy. M. Cettolo, M. Federico, L. Specia, A. Way (Eds.).
16. Langlais P. Improving a general-purpose statistical translation engine by terminological lexicons. COLING-02 on COMPUTERM 2002: second international workshop on computational terminology, vol. 14 2002, 1-7. Association for Computational Linguistics, Taipei, Taiwan.
17. Sanchis-Trilles G., Casacuberta F. Log-linear weight optimisation via bayesian adaptation in statistical machine translation. Proceedings of the 23rd International Conference on Computational Linguistics: Posters 2010, 1077-1085. Association for Computational Linguistics, Beijing, China.
18. Bisazza A., Ruiz N., Federico M. Fill-up versus interpolation methods for phrase-based SMT adaptation. Proceedings of the International Workshop on Spoken Language Translation 2011, 136-143. International Speech Communication Association, San Francisco, CA, USA.
19. Nakov P. Improving English-Spanish statistical machine translation: experiments in domain adaptation, sentence paraphrasing tokenization and recasing. Proceedings of the Third Workshop on Statistical Machine Translation 2008, 147-150. Association for Computational Linguistics, Columbus, OH, USA.
20. Koehn P., Schroeder J. Experiments in domain adaptation for statistical machine translation. Proceedings of the Second Workshop on Statistical Machine Translation 2007, 224-227. Association for Computational Linguistics, Prague, Czech Republic.
21. Wu H., Wang H. Improving domain-specific word alignment with a general bilingual corpus. Machine translation: from real users to research, volume 3265 of Lecture Notes in Computer Science 2004, 262-271. Springer, Berlin, Heidelberg. R.E. Frederking, K.B. Taylor (Eds.).
22. Carpuat M., Daumé H., Fraser A., Quirk C., Braune F., Clifton A., et al. Domain adaptation in machine translation: Final report. 2012 Johns Hopkins Summer Workshop Final Report 2012, 61-72. Johns Hopkins University.
23. Eck M., Vogel S., Waibel A. Language model adaptation for statistical machine translation based on information retrieval. Proceedings of the International Conference on Language Resources and Evaluation 2004, 327-330. European Language Resources Association, Lisbon, Portugal. M.T. Lino, M.F. Xavier, F. Ferreira, R. Costa, R. Silva (Eds.).
24. Moore R.C., Lewis W. Intelligent selection of language model training data. Proceedings of the ACL 2010 Conference Short Papers 2010, 220-224. Association for Computational Linguistics, Uppsala, Sweden.
25. Hildebrand A.S., Eck M., Vogel S., Waibel A. Adaptation of the translation model for statistical machine translation based on information retrieval. Proceedings of the 10th Annual Conference of the European Association for Machine Translation 2005, 133-142. European Association for Machine Translation, Budapest, Hungary.
26. Axelrod A., He X., Gao J. Domain adaptation via pseudo in-domain data selection. Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing 2011, 355-362. Association for Computational Linguistics, Edinburgh, United Kingdom.
27. Mansour S., Wuebker J., Ney H. Combining translation and language model scoring for domain-specific data filtering. International Workshop on Spoken Language Translation 2011, 222-229. International Speech Communication Association, San Francisco, CA, USA.
28. Byrne W., Doermann D.S., Franz M., Gustman S., Hajič J., Oard D.W., et al. Automatic recognition of spontaneous speech for access to multilingual oral history archives. IEEE Transactions on Speech and Audio Processing 2004, 12:420-435.
29. Munteanu D.S., Marcu D. Improving machine translation performance by exploiting non-parallel corpora. Computational Linguistics 2005, 31:477-504.
30. Daumé H., Jagarlamudi J. Domain adaptation for machine translation by mining unseen words. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics and Human Language Technologies, Short Papers 2011, 407-412. Association for Computational Linguistics, Portland, OR, USA.
31. Bertoldi N., Federico M. Domain adaptation for statistical machine translation with monolingual resources. Proceedings of the Fourth Workshop on Statistical Machine Translation 2009, 182-189. Association for Computational Linguistics, Athens, Greece.
32. Pecina P., Toral A., Way A., Papavassiliou V., Prokopidis P., Giagkou M. Towards using web-crawled data for domain adaptation in statistical machine translation. Proceedings of the 15th Annual Conference of the European Association for Machine Translation 2011, 297-304. European Association for Machine Translation, Leuven, Belgium.
33. Ceausu A., Tinsley J., Zhang J., Way A. Experiments on domain adaptation for patent machine translation in the PLuTO project. Proceedings of the 15th Annual Meeting of the European Association for Machine Translation 2011, 21-28. European Association for Machine Translation.
34. Callison-Burch C., Koehn P., Monz C., Zaidan O. Findings of the 2011 Workshop on Statistical Machine Translation. Proceedings of the Sixth Workshop on Statistical Machine Translation 2011, 22-64. Association for Computational Linguistics, Edinburgh, Scotland.
35. Banerjee P., Naskar S.K., Roturier J., Way A., van Genabith J. Domain adaptation in SMT of user-generated forum content guided by OOV word reduction: Normalization and/or supplementary data?. Proceedings of the 16th Annual Meeting of the European Association for Machine Translation 2012, 169-176. European Association for Machine Translation, Trento, Italy.
36. Bisazza A., Federico M. Cutting the long tail: hybrid language models for translation style adaptation. Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics 2012, 439-448. Association for Computational Linguistics, Avignon, France.
37. Fishel M., Georgakopoulou Y., Penkale S., Petukhova V., Rojc M., Volk M., Way A. From subtitles to parallel corpora. Proceedings of the 16th Annual Conference of the European Association for Machine Translation EAMT'2012 2012, 3-6. European Association for Machine Translation, Trento, Italy.
38. Nikoulina V., Kovachev B., Lagos N., Monz C. Adaptation of statistical machine translation model for cross-lingual information retrieval in a service context. Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics 2012, 109-119. Association for Computational Linguistics, Avignon, France.
39. Eck M., Vogel S., Waibel A. Improving statistical machine translation in the medical domain using the Unified Medical Language System. COLING 2004: Proceedings of the 20th International Conference on Computational Linguistics 2004, 792-798. Association for Computational Linguistics, Geneva, Switzerland.
40. U.S.National Library of Medicine UMLS reference manual 2009, Metathesaurus, Bethesda, MD, USA.
41. Wu C., Xia F., Deleger L., Solti I. Statistical machine translation for biomedical text: are we there yet?. AMIA Annual Symposium Proceedings 2011, 1290-1299.
42. Costa-jussà M.R., Farrús M., Pons J.S. Machine translation in medicine. A quality analysis of statistical machine translation in the medical domain. Proceedings of the 1st Virtual International Conference on Advanced Research in Scientific Areas 2012, 1995-1998. Žilinská univerzita, Žilina, Slovakia.
43. Jimeno Yepes A., Prieur-Gaston É., Névéol A. Combining MEDLINE and publisher data to create parallel corpora for the automatic translation of biomedical text. BMC Bioinformatics 2013, 14:1-10.
44. Chen A. Cross-language retrieval experiments at CLEF 2002. Advances in Cross-Language Information Retrieval, volume 2785 of Lecture Notes in Computer Science 2002, 28-48. Springer, Berlin, Heidelberg, Rome, Italy. C. Peters, M. Braschler, J. Gonzalo (Eds.).
45. Koehn P., Knight K. Empirical methods for compound splitting. Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics 2003, 187-193. Association for Computational Linguistics, Budapest, Hungary.
46. Popović M., Stein D., Ney H. Statistical machine translation of German compound words. Proceedings of the 5th international conference on Advances in Natural Language Processing 2006, 616-624. Springer-Verlag, Turku, Finland.
47. Niessen S., Ney H. Improving SMT quality with morpho-syntactic analysis. Proceedings of the 18th International Conference on Computational Linguistics, vol. 2 2000, 1081-1085. Association for Computational Linguistics, Saarbrücken, Germany.
48. Alfonseca E., Bilac S., Pharies S. Decompounding query keywords from compounding languages. Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics, Short Papers 2008, 253-256. Association for Computational Linguistics, Columbus, OH, USA.
49. Wu H., Zhou M. Optimizing synonym extraction using monolingual and bilingual resources. Proceedings of the second international workshop on Paraphrasing, vol. 16 2003, 72-79. Association for Computational Linguistics, Sapporo, Japan.
50. Jones G.J., Fantino F., Newman E., Zhang Y. Domain-specific query translation for multilingual information access using machine translation augmented with dictionaries mined from Wikipedia. CLIA 2008-2nd International Workshop on Cross Lingual Information Access: addressing the information need of multilingual societies 2008, 34-41.
51. Han X., Li H., Zhao T. Train the machine with what it can learn: corpus selection for SMT. Proceedings of the 2nd Workshop on Building and Using Comparable Corpora: from Parallel to Non-parallel Corpora 2009, 27-33. Association for Computational Linguistics, Singapore.
52. Griffon N., Chebil W., Rollin L., Kerdelhue G., Thirion B., Gehanno J.-F., et al. Performance evaluation of Unified Medical Language System's synonyms expansion to query PubMed. BMC Medical Informatics and Decision Making 2012, 12:12.
53. Nakayama K., Pei M., Erdmann M., Ito M., Shirakawa M., Hara T., Nishio S. Wikipedia mining - Wikipedia as a corpus for knowledge extraction. Proceedings of Annual Wikipedia Conference (Wikimania) 2008.
54. Bizer C., Lehmann J., Kobilarov G., Auer S., Becker C., Cyganiak R., Hellmann S. DBpedia - a crystallization point for the web of data. Web Semantics: Science, Services and Agents on the World Wide Web 2009, 7:154-165.
55. Tiedemann J. News from OPUS - a collection of multilingual parallel corpora with tools and interfaces. Recent Advances in Natural Language Processing, vol. 5 2009, 237-248. John Benjamins, Borovets, Bulgaria.
56. Buitelaar P., Sacaleanu B., Špela Vintar D., Steffen M., Volk H., Dejean E., Gaussier D., Widdows O., Weiser R., Frederking Multilingual Concept Hierarchies for Medical Information Organization and Retrieval 2003, Public deliverable, MuchMore project.
57. Wäschle K., Riezler S. Analyzing parallelism and domain similarities in the MAREC patent corpus. Multidisciplinary Information Retrieval, volume 7356 of Lecture Notes in Computer Science 2012, 12-27. Springer, Berlin, Heidelberg. M. Salampasis, B. Larsen (Eds.).
58. Pouliquen B., Mazenc C. COPPA, CLIR and TAPTA: three tools to assist in overcoming the patent barrier at WIPO. Proceedings of the Thirteenth Machine Translation Summit 2011, 24-30. Asia-Pacific Association for Machine Translation, Xiamen, China.
59. Smith J.R., Saint-Amand H., Plamada M., Koehn P., Callison-Burch C., Lopez A. Dirt cheap web-scale parallel text from the common crawl. Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2013, 1374-1383. Association for Computational Linguistics, Sofia, Bulgaria.
60. Forcada M.L., Ginestí-Rosell M., Nordfalk J., O'Regan J., Ortiz-Rojas S., Pérez-Ortiz J.A., Sánchez-Martínez F., Ramírez-Sánchez G., Tyers F.M. Apertium: a free/open-source platform for rule-based machine translation. Machine Translation 2011, 25:127-144.
61. Bojar O., Žabokrtský Z., Dušek O., Galuščáková P., Majliš M., Mareček D., Marší k J., Novák M., Popel M., Tamchyna A. The joy of parallelism with CzEng 1.0. Proceedings of the Eighth International Conference on Language Resources and Evaluation 2012, 3921-3928. European Language Resources Association, Istanbul, Turkey. N. Calzolari, K. Choukri, T. Declerck, M.U. Doǧan, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis (Eds.).
62. Eisele A., Chen Y. MultiUN: a multilingual corpus from United Nation documents. Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC-2010) 2010, 2868-2872. European Language Resources Association, Valletta, Malta. N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner, D. Tapias (Eds.).
63. Dickersin K., Manheimer E., Wieland S., Robinson K.A., Lefebvre C., McDonald S. Development of the Cochrane Collaboration's CENTRAL Register of controlled clinical trials. Evaluation & the Health Professions 2002, 25:38-64.
64. Knox C., Law V., Jewison T., Liu P., Ly S., Frolkis A., Pon A., Banco K., Mak C., Neveu V., Djoumbou Y., Eisner R., Guo A.C., Wishart D.S. DrugBank 3.0: a comprehensive resource for 'Omics' research on drugs. Nucleic Acids Research 2011, 39:D1035-D1041.
65. Thompson P., Iqbal S., McNaught J., Ananiadou S. Construction of an annotated corpus to support biomedical information extraction. BMC Bioinformatics 2009, 10:349.
66. Kim J.-D., Ohta T., Tateisi Y., Tsujii J. GENIA corpus - a semantically annotated corpus for bio-textmining. Bioinformatics 2003, 19:i180-i182.
67. Rosse C., Mejino J.L.V. The foundational model of anatomy ontology. Anatomy Ontologies for Bioinformatics, volume 6 of Computational Biology 2008, 59-117. Springer, London. A. Burger, D. Davidson, R. Baldock (Eds.).
68. Rogers F. Medical subject headings. Bulletin of the Medical Library Association 1963, 51:114-116.
69. Bouayad-Agha N., Scott D.R., Power R. Integrating content and style in documents: a case study of patient information leaflets. Information Design Journal 2000, 9:161-176.
70. Shuyo N. Language detection library for Java 2010, http://code.google.com/p/language-detection/.
71. Majliš M. Yet another language identifier. Proceedings of the Student Research Workshop at the 13th Conference of the European Chapter of the Association for Computational Linguistics 2012, 46-54. Association for Computational Linguistics, Avignon, France.
72. Boyer C., Belle W., Pletneva N., Lawson N., Samwald M., Hanbury A. Prototype of a first search system for intensive tests (D8.3) 2012, Public deliverable, Khresmoi EU project.
73. Parker R., Graff D., Kong J., Chen K., Maeda K. English Gigaword 2011, Linguistic Data Consortium, Philadelphia, PA, USA. 5th edition.
74. Popel M., Žabokrtský Z. TectoMT: Modular NLP framework. Advances in Natural Language Processing, volume 6233 of Lecture Notes in Computer Science 2010, 293-304. Springer, Berlin, Heidelberg, Reykjavik, Iceland. H. Loftsson, E. Rögnvaldsson, S. Helgadóttir (Eds.).
75. Spoustová D., Hajič J., Votrubec J., Krbec P., Květoň P. The best of two worlds: cooperation of statistical and rule-based taggers for Czech. Proceedings of the Workshop on Balto-Slavonic Natural Language Processing 2007 2007, 67-74. Association for Computational Linguistics, Prague, Czech Republic.
76. Schmid H. Probabilistic part-of-speech tagging using decision trees. Proceedings of international conference on new methods in language processing, vol. 12 1994, 44-49.
77. Hajič J. Disambiguation of rich inflection (Computational morphology of Czech) 2004, Nakladatelství Karolinum, Prague, Czech Republic.
78. Popel M., Žabokrtský Z. Improving English-Czech tectogrammatical MT. The Prague Bulletin of Mathematical Linguistics 2009, 92:1-20.
79. Boyer C., Gschwandtner M., Hanbury A., Kritz M., Pletneva N., Samwald M., Vargas A. Use case definition including concrete data requirements (D8.2) 2012, Public deliverable, Khresmoi project.
80. Meats E., Brassey J., Heneghan C., Glasziou P. Using the Turning Research Into Practice (TRIP) database: how do clinicians really search?. Journal of the Medical Library Association 2007, 95:156-163.
81. Spink A., Wolfram D., Jansen M.B.J., Saracevic T. Searching the web: the public and their queries. Journal of the American Society for Information Science and Technology 2001, 52:226-234.
82. Dyer C., Chahuneau V., Smith N.A. A simple, fast, and effective reparameterization of IBM Model 2. Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 2013, 644-648. Association for Computational Linguistics, Atlanta, GA, USA.
83. Stolcke A. SRILM - an extensible language modeling toolkit. Proceedings of International Conference on Spoken Language Processing 2002, 901-904. International Speech Communication Association, Denver, CO, USA.
84. Kneser R., Ney H. Improved backing-off for N-gram language modeling. Proceedings of the International Conference on Acoustics, Speech and Signal Processing, vol. 1 1995, 181-184. IEEE, Detroit, MI, USA.
85. Heafield K. KenLM: faster and smaller language model queries. Proceedings of the Sixth Workshop on Statistical Machine Translation 2011, 187-197. Association for Computational Linguistics, Edinburgh, United Kingdom.
86. Koehn P., Axelrod A., Birch A., Callison-Burch C., Osborne M., Talbot D. Edinburgh system description for the 2005 IWSLT speech translation evaluation. Proceedings of the International Workshop on Spoken Language Translation 2005 2005, 78-85.
87. Bojar O., Rosa R., Tamchyna A. Chimera - three heads for English-to-Czech translation. Proceedings of the Eighth Workshop on Statistical Machine Translation 2013, 92-98. Association for Computational Linguistics, Sofia, Bulgaria.
88. Bojar O., Tamchyna A. The design of Eman, an experiment manager. Prague Bulletin of Mathematical Linguistics 2013, 100:39-58.
89. Levenshtein V.I. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady 1966, 10:707-710.
90. Koehn P. Statistical significance tests for machine translation evaluation. Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing 2004, 388-395. Association for Computational Linguistics, Barcelona, Spain. D. Lin, D. Wu (Eds.).
91. Bojar O., Buck C., Callison-Burch C., Federmann C., Haddow B., Koehn P., et al. Findings of the 2013 Workshop on Statistical Machine Translation. Proceedings of the Eighth Workshop on Statistical Machine Translation 2013, 1-44. Association for Computational Linguistics, Sofia, Bulgaria.
92. Pecina P., Toral A., van Genabith J. Simple and effective parameter tuning for domain adaptation of statistical machine translation. Proceedings of the 24th International Conference on Computational Linguistics (Coling 2012) 2012, 2209-2224. Coling 2012 Organizing Committee, Mumbai, India. M. Kay, C. Boitet (Eds.).
93. Porter M.F. An algorithm for suffix stripping. Program: Electronic Library and Information Systems 1980, 14:130-137.
94. Oard D.W., Levow G.-A., Cabezas C.I. CLEF experiments at Maryland: Statistical stemming and backoff translation. Cross-Language Information Retrieval and Evaluation, volume 2069 of Lecture Notes in Computer Science 2001, 176-187. Springer, Berlin, Heidelberg. C. Peters (Ed.).
95. Porter M.F. Snowball: a language for stemming algorithms 2001, http://snowball.tartarus.org/.
96. Bojar O., Ercegovčević M., Popel M., Zaidan O.F. A grain of salt for the WMT manual evaluation. Proceedings of the Sixth Workshop on Statistical Machine Translation 2011, 1-11. Association for Computational Linguistics, Edinburgh, Scotland.
97. Magdy W., Jones G.J.F. An efficient method for using machine translation technologies in cross-language patent search. Proceedings of the 20th ACM International Conference on Information and Knowledge Management 2011, 1925-1928. Association for Computing Machinery, Glasgow, United Kingdom.
98. Mooers C.E. Coding, information retrieval, and the rapid selector. American Documentation 1950, 1:225-229.
99. Manning C.D., Raghavan P., Schütze H. Introduction to Information Retrieval 2008, Cambridge University Press, New York, NY, USA.
100. Hersh W., Buckley C., Leone T., Hickam D. OHSUMED: an interactive retrieval evaluation and new large test collection for research. Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval 1994, 192-201. Springer-Verlag New York, Inc., Dublin, Ireland.
101. Roberts P.M., Cohen A.M., Hersh W.R. Tasks, topics and relevance judging for the TREC Genomics Track: five years of experience evaluating biomedical text information retrieval systems. Information Retrieval 2009, 12:81-97.
102. Voorhees E.M., Tong R.M. Overview of the TREC 2011 Medical Records Track. The Eleventh Text Retrieval Conference (TREC 2002) 2011, 1-11. National Institute of Standards and Technology, Gaithersburg, MD, USA.
103. Suominen H., Salanterä S., Velupillai S., Chapman W.W., Savova G., Elhadad N., et al. Overview of the ShARe/CLEF eHealth evaluation lab 2013. Information Access Evaluation. Multilinguality, Multimodality, and Visualization. 4th International Conference of the CLEF Initiative, CLEF 2013, volume 8138 of Lecture Notes in Computer Science 2013, 212-231. Springer, Berlin, Heidelberg, Valencia, Spain. P. Forner, H. Müller, R. Paredes, P. Rosso, B. Stein (Eds.).
104. Ruiz M., Diekema A., Sheridan P., Plaza D.C. CINDOR conceptual interlingua document retrieval: TREC-8 evaluation. The Eighth Text REtrieval Conference (TREC 8) 1999, 597-605. National Institute of Standards and Technology, Gaithersburg, MD, USA.
105. Blei D.M., Ng A.Y., Jordan M.I. Latent Dirichlet allocation. Journal of Machine Learning Research 2003, 3:993-1022.
106. Nie J.-Y. Cross-language information retrieval, Synthesis Lectures on Human Language Technologies 2010, Morgan & Claypool Publishers.
107. Peters C., Braschler M., Clough P. Multilingual information retrieval: from research to practice 2012, Springer, Berlin Heidelberg.
108. Zhou D., Truran M., Brailsford T., Wade V., Ashman H. Translation techniques in cross-language information retrieval. ACM Computing Surveys 2012, 45. 1:1-1:44.
109. Ballesteros L., Croft W.B. Resolving ambiguity for cross-language retrieval. Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval 1998, 64-71. Association for Computing Machinery, Melbourne, Australia.
110. Maeda A., Sadat F., Yoshikawa M., Uemura S. Query term disambiguation for Web cross-language information retrieval using a search engine. Proceedings of the fifth international workshop on Information retrieval with Asian languages 2000, 25-32. Association for Computing Machinery, Hong Kong, China.
111. Gao J., Nie J.-Y. A study of statistical models for query translation: finding a good unit of translation. Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval 2006, 194-201. Association for Computing Machinery, Seattle, Washington, USA.
112. Pirkola A. The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval. Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval 1998, 55-63. Association for Computing Machinery, Melbourne, Australia.
113. Darwish K., Oard D.W. Probabilistic structured query methods. Proceedings of the 26th annual international ACM SIGIR conference on Research and development in information retrieval 2003, 338-344. Association for Computing Machinery, Toronto, Canada.
114. Federico M., Bertoldi N. Statistical cross-language information retrieval using n-best query translations. Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval 2002, 167-174. Association for Computing Machinery, Tampere, Finland.
115. Hollink V., Kamps J., Monz C., de Rijke M. Monolingual document retrieval for European languages. Information Retrieval 2004, 7:33-52.
116. Attar R., Fraenkel A.S. Local feedback in full-text retrieval systems. Journal of Association for Computing Machinery 1977, 24:397-417.
117. Ballesteros L., Croft W.B. Phrasal translation and query expansion techniques for cross-language information retrieval. SIGIR Forum 1997, 31:84-91.
118. Eichmann D., Ruiz M.E., Srinivasan P. Cross-language information retrieval with the UMLS metathesaurus. Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval 1998, 72-80. Association for Computing Machinery, Melbourne, Australia.
119. Volk M., Ripplinger B., Vintar Š., Buitelaar P., Raileanu D., Sacaleanu B. Semantic annotation for concept-based cross-language medical information retrieval. International Journal of Medical Informatics 2002, 67:97-112.
120. Tran T.D., Garcelon N., Burgun A., Beux P.L. Experiments in cross-language medical information retrieval using a mixing translation module. Studies in Health Technology and Informatic 2004, 107:946-949.
121. Déjean H., Gaussier E., Renders J.-M., Sadat F. Automatic processing of multilingual medical terminology: applications to thesaurus enrichment and cross-language information retrieval. Artificial Intelligence in Medicine 2005, 33:111-124.
122. Rosemblat G., Gemoets D., Browne A.C., Tse T. Machine translation-supported cross-language information retrieval for a consumer health resource. AMIA Annual Symposium proceedings 2003, 564-568.
123. Markó K., Schulz S., Hahn U. MorphoSaurus-design and evaluation of an interlingua-based, cross-language document retrieval engine for the medical domain. Methods of Information in Medicine 2005, 44:9.
124. Markó K.G., Daumke P., Schulz S., Klar R., Hahn U. Large-scale evaluation of a medical cross-language information retrieval system. Proceedings of the 12th World Congress on Health (Medical) Informatics - Building Sustainable Health Systems, volume 129 of Studies in Health Technology and Informatics 2007, 392-396. IOS Press, Brisbane, Australia. K.A. Kuhn, J.R. Warren, T.-Y. Leong (Eds.).
125. Goeuriot L., Jones G.J.F., Kelly L., Leveling J., Hanbury A., Müller H., et al. ShARe/CLEF eHealth evaluation lab 2013, task 3: Information retrieval to address patients' questions when reading clinical reports. CLEF 2013 Evaluation Labs and Workshop, Online Working Notes 2013, Valencia, Spain. D.T. Pamela Forner, R. Navigli (Eds.).
126. Robertson S.E., Walker S., Jones S., Hancock-Beaulieu M.M., Gatford M. Okapi at TREC-3. Overview of the Third Text Retrieval Conference (TREC-3) 1995, 109-126. National Institute of Standards and Technology, Gaithersburg, MD, USA.
127. Robertson S.E., Walker S., Beaulieu M. Okapi at TREC-7: Automatic ad hoc, filtering, VLC and interactive track. The Seventh Text REtrieval Conference (TREC-7) 1998, 253-264. National Institute of Standards and Technology, Gaithersburg, MD, USA. D.K. Harman (Ed.).
128. Leveling J., Goeuriot L., Kelly L., Jones G.J. DCU@TRECMed 2012: using ad-hoc baselines for domain-specific retrieval. Text Retrieval Conference (TREC) 2012 2012, 1-9. National Institute of Standards and Technology, Gaithersburg, MD, USA.
129. Robertson S.E., Spärck Jones K. Relevance weighting of search terms. Journal of the American Society for Information Science 1976, 27:143-160.
130. Robertson S.E. On term selection for query expansion. Journal of Documentation 1990, 46:359-364.
131. Salton G. The SMART Retrieval System: Experiments in Automatic Document Processing 1971, Prentice-Hall, Inc., Upper Saddle River, NJ, USA.
132. Järvelin K., Kekälä inen J. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems 2002, 20:422-446.
133. TREC: experiment and evaluation in information retrieval, volume 63 of Digital libraries and electronic publishing series 2005, MIT Press, Cambridge, Cambridge, MA, USA. E.M. Voorhees, D.K. Harman (Eds.).
134. Hull D. Using statistical testing in the evaluation of retrieval experiments. Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR '93 1993, 329-338. Association for Computing Machinery, Pittsburgh, PA, USA.
135. Goeuriot L., Kelly L., Jones G.J.F., Zuccon G., Suominen H., Hanbury A., et al. Creation of a new evaluation benchmark for information retrieval targeting patient information needs. Proceedings of the 5th International Workshop on Evaluating Information Access (EVIA) 2013, 29-32. National Institute of Informatics/Kijima Printing, Tokyo/Fukuoka, Japan. R. Song, W. Webber, N. Kando, K. Kishida (Eds.).