Creating and exploiting a comparable corpus in cross-language information retrieval

ACM Transactions on Information Systems

Volumn 25, Issue 1, 2007, Pages

  Talvensaari, Tuomas ^a   Laurikkala, Jorma ^a   Järvelin, Kalervo ^a   Juhola, Martti ^a   Keskustalo, Heikki ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Comparable corpora; Cross language information retrieval; Query translation

Indexed keywords

GLOSSARIES; TEXT PROCESSING; THESAURI; TRANSLATION (LANGUAGES);

COMPARABLE CORPORA; CROSS-LANGUAGE INFORMATION RETRIEVAL; QUERY TRANSLATION; RELATIVE AVERAGE TERM FREQUENCY (RATF) VALUE;

INFORMATION RETRIEVAL;

EID: 33847681482     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1198296.1198300     Document Type: Article

References (29)

1. ALLAN, J., CALLAN, J., CROFT, B., BALLESTEROS, L., BROGLIO, J., XU, J., AND SHU, H. 1997. Inquery at TREC 5. In Proceedings of the 5th Text Retrieval Conference (TREC5) Gaithersburg, MD. E. M. Voorhees, D. K. Harman, Eds. National Institute of Standards and Technology, vol. 500-238, 119-132.
2. BALLESTEROS, L. AND CROFT, W. B. 1998. Resolving ambiguity for cross-language retrieval. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval Melbourne, Australia. W. B. CROFT, A. MOFFAT, C. J. VAN RIJSBERGEN, R. WILKINSON, J. ZOBELPP, Eds. ACM Press, New York, NY, 64-71.
3. BRASCHLER, M. AND SCHÄUBLE, P. 1998. Multilingual information retrieval based on document alignment techniques. In Proceedings of the 2nd European Conference on Research and Advanced Technology for Digital Libraries. Heraklion, Greece. C. Nikolaou, C. Stephanidis, Eds. Springer-Verlag, Berlin, Germany, 183-197.
4. CONOVIERE, W. J. 1999. Practical Nonparametric Statistics. Wiley, New York, NY.
5. DAVIS, M.W. 1998. On the effective use of large parallel corpora in cross-language text retrieval, in G. Grefenstette, Ed. Cross-Language Information Retrieval, Kluwer Academic Publishers, 11-22.
6. FRANZ, M., MCCARLEY, J. S., AND ROUKOS, S. 1999. Ad hoc and multilingual information retrieval at IBM. In The 7th Text Retrieval Conference (TREC7). Gaithersburg, MD. E. M. Voorhees, D. K. Harman, Eds. National Institute of Standards and Technology, vol. 500-242, 157-168.
7. FUNG, P. AND YEE, L. Y. 1998. An IR approach for translating new words from nonparallel, comparable texts. In Proceedings of the 17th International Conference on Computational Linguistics and 36th Annual Meeting of the Association for Computational Lingustics. Montreal, Canada. ACL/Morgan Kaufmann Publishers, San Francisco, CA, 414-420.
8. GALE, W. A. AND CHURCH, K. W. 1991. A program for aligning sentence in bilingual corpora. In Proceedings of the 29th Annual Meeting of the Association for Computational Linguistics (ACL91). Berkeley, CA. ACL, Morristown, NJ, 177-184.
9. HEDLUND, T., AIRIO, E., KESKUSTALO, H., LEHTOKANGAS, R., PIRKOLA, A., AND JÄRVELIN, K. 2004. Dictionary-based cross-language information retrieval: Learning experiences from CLEF 2000-2002. Inf. Retr. 7, 1-2, 99-119.
10. KESKUSTALO, H., HEDLUND, T., AND AIRIO, E. 2002. Utaclir-General query translation framework for several language pairs. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Tampere, Finland. K. Järvelin, M. Beaulieu, R. Baeza-Yates, S. H. Myaeng, Eds. ACM Press, New York, NY, 448-448.
11. KESKUSTALO, H., PIRKOLA, A., VISALA, K., LEPPÄNEN, E., AND JÄRVELIN, K. 2003. Non-adjacent digrams improve matching of cross-lingual spelling variants. In Proceedings of the 10th International Symposium (SPIRE2003). Manaus, Brazil. M. A. Nascimento, E. S. de Moura, A. L. Oliveira, Eds. Lecture Notes in Computer Science, vol. 2857, Springer, Berlin, Germany, 252-265.
12. KOSKENNIEMI, K. 1983. Two-Level Morphology: A General Computational Model for Word-Form Recognition and Production. Publications of the Department of General Linguistics, University of Helsinki, No. 11.
13. KWOK, K. L. 1996. A new method of weighting query terms for ad-hoc retrieval. In Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Zurich, Switzerland. H. P. Frei, D. Harman, P. Schäuble, R. Wilkinson, Eds. ACM Press, New York, NY, 187-195.
14. LEHTOKANGAS, R., KESKUSTALO, H., AND JÄRVELIN, K. 2006. Experiments with dictionary-based CLIR using graded relevance assessments: Improving effectiveness by pseudo-relevance feedback. Inform. Retriev. 9, 4, 421-433.
15. LEMUR. The homepage of the Lemur toolkit for language modeling and information retrieval. http://www.lemurproject.org/.
16. MCNAMEE, P. AND MAYFIELD, J. 2002. Comparing cross-language query expansion techniques by degrading translation resources. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Tampere, Finland. K. Järvelin, M. Beaulieu, R. Baeza-Yates, S. H. Myaeng, Eds. ACM Press, New York, NY, 159-166.
17. OAED, D. W. AND DIEKEMA, A. R. 1998. Cross-language information retrieval, Annual Review of Information Science and Technology (ARIST). 33, 223-256.
18. PETERS, C. 2004. What happened in CLEF 2004? Introduction to the working notes. Istituto di Scienza e Tecnologie dell'Informazione (Isti-Cnr), Pisa, Italy, http://www.clefcampaign.org/2004/working_notes/WorkingNotes2004/ CLEF2004WN%20-%20intro.pdf.
19. PIRKOLA, A. 1998. The effects of query structure and dictionary setups in dictionary-based crosslanguage information retrieval. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Melbourne, Australia. W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, J. Zobelpp, Eds. ACM Press, New York, NY, 55-63.
20. PIRKOLA, A., HEDLUND, T., KESKUSTALO, H., AND JÄRVELIN, K. 2001. Dictionary-based cross-language information retrieval: problems, methods, and research findings. Inform. Retriev. 4, 3/4, 209-230.
21. PIRKOLA, A. AND JÄRVELIN, K. 2001. Employing the resolution power of search keys. J. Ameri. Soci. Inform. Sci. Techn. 52, 7, 575-583.
22. PIRKOLA, A., KESKUSTALO, H., LEPPÄNEN, E., KÄNSÄLÄ, A.-P., AND JÄRVELIN, K. 2002b. Targeted s-gram matching: a novel n-gram matching technique for cross- and monolingual word form variants. Inform. Resear. 7, 2. http://InformationR.net/ir/7-2/paper126.html.
23. PIRKOLA, A., LEPPÄNEN, E., AND JÄRVELIN, K. 2002a. The RATF formula (Kwok's formula): exploiting average term frequency in cross-language retrieval. Inform. Resear. 7, 2. http://InformationR.net/ir/7-2/paper127.html.
24. RAJASHEKAR, T. B. AND CROFT, W. B. 1995. Combining automatic and manual index representations in probabilistic retrieval. J. Ameri. Soci. Inform. Sci. 46, 4, 272-283.
25. RESNIK, P. 1999. Mining the web for bilingual text. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL'99). College Park, MD. ACL/Morgan Kaufmann Publishers, San Francisco, CA, 527-534.
26. SALTON, G. AND MCGILL, M. J. 1983. Introduction to Modern Information Retrieval. McGraw-Hill.
27. SHERIDAN, P. AND BALLERINI, J. P. 1996. Experiments in multilingual information retrieval using the SPIDER system. In Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Zurich, Switzerland. H. P. Frei, D. Harman, P. Schäuble, R. Wilkinson. Eds. ACM Press, New York, NY, 58-65.
28. SINGHAL, A., BUCKLEY, C., AND MITRA, M. 1996. Pivoted document length normalization. In Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Zurich, Switzerland. H. P. Frei, D. Harman, P. Schäuble, R. Wilkinson, Eds. ACM Press, New York, NY, 21-29.
29. TALVENSAARI, T., LAURIKKALA, J., JÄ RVELIN, K., AND JUHOLA, M. 2007. Corpus-based CLIR in retrieval of highly relevant documents. J. Ameri. Soci. Inform, Sci. 58, 3, 322-334.