The fire 2008 evaluation exercise

ACM Transactions on Asian Language Information Processing

Volumn 9, Issue 3, 2010, Pages

  Majumder, Prasenjit ^a   Mitra, Mandar ^a   Pal, Dipasree ^a   Bandyopadhyay, Ayan ^a   Samaresh, Maiti ^a   Pal, Sukomal ^a   Modak, Deboshree ^a   Sanyal, Sucharita ^a  

^a INDIAN STATISTICAL INSTITUTE   (India)

Author keywords

Evaluation; Indian languages; Information retrieval

Indexed keywords

CROSS-LANGUAGE EVALUATION FORUMS; DATA SETS; EVALUATION; EVALUATION FRAMEWORK; INDIAN LANGUAGES; TEST COLLECTION; TEXT RETRIEVAL CONFERENCES;

FIRES; LINGUISTICS; NICKEL COMPOUNDS;

INFORMATION RETRIEVAL;

EID: 77956988031     PISSN: 15300226     EISSN: 15583430     Source Type: Journal    
DOI: 10.1145/1838745.1838747     Document Type: Article

References (32)

1. AMATI, G. AND RIJSBERGEN, C. V. 2002. Probabilistic models of information retrieval based on measuring the divergence from randomness. ACM Trans. Inform. Syst. 20, 4, 357-389.
2. BRASCHLER, M. AND PETERS, C. 2004. Cross-language evaluation forum: Objectives, results, achievements. Inform. Retriev. 7, 1/2, 7-31.
3. DOLAMIC, L. AND SAVOY, J. 2008. UniNE at FIRE 2008: Hindi, Bengali, and Marathi IR. In Working Notes from FIRE 2008 (FIRE'08).
4. HARMAN, D. 1995. Overview of the second text retrieval conference (TREC-2). Inform. Process Manage. 31, 3, 271-289.
5. HIEMSTRA, D. 2001. Using language models for information retrieval. Ph.D. thesis, University of Twente.
6. KANDO, N.,MITAMURA, T., AND SAKAI, T. 2008. Introduction to the NTCIR-6 Special Issue. ACM Trans. Asian Lang. Inform. Process. 7, 2, 1-3.
7. MAJUMDER, P., MITRA, M., PARUI, S., KOLE, G., MITRA, P., AND DATTA, K. 2007. YASS: Yet another suffix stripper. ACM Trans. Inform. Syst. 25, 4, 18.
8. MCNAMEE, P. 2008. N-gram Tokenization for Indian Language Text Retrieval. In Working Notes from FIRE 2008 (FIRE'08).
9. MITRA, M. 2008. Overview of FIRE 2008. In Working Notes from FIRE 2008 (FIRE'08).
10. NAKAGAWA, H.,MORI, T., AND KANDO, N., Eds. 2005. ACM Trans. Asian Lang. Inform. Process. 4.
11. OARD, D. W. 2003. The surprise language exercises. ACM Trans. Asian Lang. Inform. Process. 2, 2, 79-84.
12. OUNIS, I., AMATI, G., PLACHOURAS, V., HE, B., MACDONALD, C., AND LIOMA, C. 2006. Terrier: A high performance and scalable information retrieval platform. In Proceedings of the ACM Workshop on Open Source Information Retrieval (OSIR'06).
13. PADARIYA, N., CHINNAKOTLA, M., NAGESH, A., AND DAMANI, O. P. 2008. Evaluation of Hindi to English, Marathi to English, and English to Hindi CLIR at FIRE 2008. In Working Notes from FIRE 2008 (FIRE'08).
14. PAIK, J. H. AND PARUI, S. K. 2008. A simple stemmer for inflectional languages. In Working Notes from FIRE 2008 (FIRE'08).
15. PAL, D.,MAJUMDER, P.,MITRA, M.,MITRA, S., AND SEN, A. 2008. Issues in searching for Indian language Web content. In Proceedings of the 2nd ACM Workshop on Improving Non English Web Searching (iNEWS'08). 93-96.
16. PETERS, C. 2010. Personal communication.
17. PETERS, C., JIJKOUN, V., MANDL, T., MÜLLER, H., OARD, D., PEÑAS, A., PETRAS, V., AND SANTOS, D., Eds. 2008. In Advances in Multilingual and Multimodal Information Retrieval, the 8th Workshop of the Cross-Language Evaluation Forum (CLEF'07). Lecture Notes in Computer Science. Springer-Verlag.
18. PINGALI, P., JAGARLAMUDI, J., AND VARMA, V. 2006. Webkhoj: Indian language IR from multiple character encodings. In Proceedings of the International World Wide Web Conference (WWW'06).
19. PONTE, J. AND CROFT, W. 1998. A language modeling approach to information retrieval. In Proceedings of the 19th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR'98).
20. RAMANATHAN, A. AND RAO, D. 2003. A lightweight stemmer for Hindi. In Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL'03).
21. RAO, P. R. AND SOBHA, L. 2008. AU-KBC FIRE2008 submission - Cross lingual information retrieval track: Tamil-English. In Working Notes from FIRE 2008 (FIRE'08).
22. SAKAI, T., KANDO, N., LIN, C.-J.,MITAMURA, T., SHIMA, H., JI, D., CHEN, K.-H., AND NYBERG, E. 2008. Overview of the NTCIR-7 ACLIA IR4QA Task. In Proceedings of the NII Test Collection for Information Retrieval Workshop (NTCIR'08). 77-114.
23. SAVOY, J. 2004. Data fusion for effective European monolingual information retrieval. In Proceedings of the Cross-Language Information Retrieval and Evaluation Workshop of Cross-Language Evaluation Forum (CLEF'00). 233-244.
24. SETHURAMALINGAM, S. AND VARMA, V. 2008. IIIT Hyderabad's CLIR experiments for FIRE-2008. In Working Notes from FIRE 2008 (FIRE'08).
25. SPARCK JONES, K. AND VAN RIJSBERGEN, C. 1976. Information retrieval test collections. J. Doc. 32, 59-75.
26. SPARCK JONES, K.,WALKER, S., AND ROBERTSON, S. 2000. A probabilistic model of information retrieval: Development and comparative experiments. Inform. Process. Manage. 36, 6, 779-808.
27. SURVE, M., SINGH, S., AND BHATTACHARYYA, P. 2004. Agro-Explorer: A meaning based multilingual search engine. In Proceedings of the International Conference on Digital Libraries (ICDL'04).
28. UDUPA, R., JAGARLAMUDI, J., AND SARAVANAN, K. 2008. Hindi-English cross-language information retrieval. In Working Notes from FIRE 2008 (FIRE'08).
29. UDUPA, R., SARAVANAN, K., BAKALOV, A., AND BHOLE, A. 2009. "They are out there, if you know where to look": Mining transliterations of OOV query terms for cross-language information retrieval. In Proceedings of the European Conference on Information Retrieval (ECIR09). 437-448.
30. VOORHEES, E. AND HARMAN, D. 1997. Overview of the 5th Text Retrieval Conference. In Proceedings of the 5th Text Retrieval Conference (TREC5). 1-28.
31. VOORHEES, E. M. AND HARMAN, D. K., Eds. 2005. TREC Experiment and Evaluation in Information Retrieval. MIT Press, Cambridge, MA.
32. ZOBEL, J. 1998. How reliable are the results of large-scale information retrieval experiments? In Proceedings of the 19th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR'98).