WebKhoj: Indian language IR from multiple character encodings

Proceedings of the 15th International Conference on World Wide Web

Volumn , Issue , 2006, Pages 801-809

  Pingali, Prasad ^a   Jagarlamudi, Jagadeesh ^a   Varma, Vasudeva ^a  

^a INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

Indian languages; Non standard encodings; Web search

Indexed keywords

FORMAL LANGUAGES; INFORMATION ANALYSIS; SEARCH ENGINES; STANDARDIZATION; WORLD WIDE WEB; ENCODING (SYMBOLS); INFORMATION RETRIEVAL; LINGUISTICS; QUERY LANGUAGES;

INDIAN LANGUAGE CONTENT; LANGUAGE FOCUSED CRAWLER; MULTI-SCRIPT; MULTIPLE ENCODING; PROPRIETARY; TRANSCODING PROCESSES; WEBKHOJ;

COMPUTER APPLICATIONS; WORLD WIDE WEB;

ENCODINGS; FOCUSED CRAWLER; INDIAN LANGUAGES; NON-STANDARD ENCODINGS; TRANSCODING PROCESS; WEB CONTENT; WEB PAGE; WEB SEARCH; WEB SEARCH ENGINES;

EID: 34250613116     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1135777.1135898     Document Type: Conference Paper

References (15)

1. J. Allan, J. Aslam, N. Belkin, G. Buckley, J. Callan, B. Croft, S. Dumais, N. Fuhr, D. Harman, D. J. Harper, D. Hiemstra, T. Hofmann, E. Hovy, W. Kraaij, J. Lafferty, V. Lavrenko, D. Lewis, L. Liddy, R. Manmatha, A. McCallum, J. Ponte, J. Prager, D. Radev, P. Resnik, S. Robertson, R. Rosenfeld, S. Roukos, M. Sanderson, R. Schwartz, A. Singhal, A. Smeaton, H. Turtle, E. Voorhees, R. Weischedel, J. Xu, and C. Zhai. Challenges in Information Retrieval and Language Modeling: Report of a Workshop held at the Center for Intelligent Information Retrieval, University of Massachusetts Amherst, September 2002. SIGIR Forum, 37(1):31-47, 2003.
2. A. Arasu, J. Cho, H. Garcia-Molina, A. Paepcke, and S. Raghavan. Searching the Web. ACM Trans. Inter. Tech., 1(1):2-43, 2001.
3. G. B. 14th ed. Ethnologue: Languages of the World. SIL International, Dallas, TX, 2003.
4. S. Brin, J. Davis, and H. Garcia-Molina. Copy Detection Mechanisms for Digital Documents. In SIGMOD '95: Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data, pages 398-409, New York, NY, USA, 1995. ACM Press.
5. G. E. Burkhart, S. E. Goodman, A. Mehta, and L. Press. The Internet in India: Better times ahead? Commun. ACM, 41(11):21-26, 1998.
6. S. Chakrabarti, K. Punera, and M. Subramanyam. Accelerated Focused Crawling through Online Relevance Feedback. In WWW '02: Proceedings of the llth International Conference on World Wide Web, pages 148-159, New York, NY, USA, 2002. ACM Press.
7. F. Gey, N. Kando, and C. Peters. Cross Language Information Retrieval: A Research Roadmap. SIGIR Forum, 36(2):72-80, 2002.
8. Y. Haralambous and G. Bella. Injecting Information into Atomic Units of Text. In DocEng '05: Proceedings of the 2005 ACM Symposium on Document Engineering, pages 134-142, New York, NY, USA, 2005. ACM Press.
9. A. Joshi, A. Ganu, A. Chand, V. Parmar, and G. Mathur. Keylekh: a Keyboard for Text Entry in Indic Scripts. In CHI '04: CHI '04 Extended Abstracts on Human Factors in Computing Systems, pages 928-942, New York, NY, USA, 2004. ACM Press.
10. L. S. Larkey, M. E. Connell, and N. Abduljaleel. Hindi CLIR in thirty days. ACM Transactions on Asian Language Information Processing (TALIP), 2(2):130-142, 2003.
11. D. P. Madalli. Unicode for Multilingual Representation in Digital Libraries from the Indian Perspective. In JCDL '02: Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries, pages 398-398, New York, NY, USA, 2002. ACM Press.
12. P. Pingali and V. Varma. Word Normalization in Indian Languages. In ICON05: Proceedings of the 2005 International Conference on Natural Language Processing, 2005.
13. G. Salton and C. Buckley. Term-weighting Approaches in Automatic Text Retrieval. Information Process. Management, 24(5):513-523, 1988.
14. S. Strassel, M. Maxwell, and C. Cieri. Linguistic Resource Creation for Research and Technology Development: A Recent Experiment. ACM Transactions on Asian Language Information Processing (TALIP), 2(2): 101-117, 2003.
15. F. Yergeau. UTF-8, a transformation format of ISO 10646. RFC Editor, United States, 2003.