Language Identification of Search Engine Queries

ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf.

Volumn , Issue , 2009, Pages 1066-1074

  Ceylan, Hakan ^a   Kim, Yookyung ^b  

^a Center for Advanced Research and Technology   (United States)

^b YAHOO INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; DECISION TREES; LEARNING ALGORITHMS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CLICK THROUGH; DATA SET; DECISION TREE CLASSIFIERS; IDENTIFICATION PROBLEM; LANGUAGE IDENTIFICATION; LINGUISTIC FEATURES; TEXTUAL LANGUAGE; WRITTEN LANGUAGE IDENTIFICATION;

SEARCH ENGINES;

EID: 77958609427     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. C. Biemann and S. Teresniak. 2005. Disentangling from babylonian confusion - unsupervised language identification. In Proceedings of CICLing-2005, Computational Linguistics and Intelligent Text Processing, pages 762–773. Springer.
2. Andrei Broder. 2002. A taxonomy of web search. SIGIR Forum, 36(2):3–10.
3. William B. Cavnar and John M. Trenkle. 1994. N-gram-based text categorization. In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval, pages 161–175, Las Vegas, US.
4. J. Cowie, Y. Ludovic, and R. Zacharski. 1999. Language recognition for mono- and multi-lingual documents. In Proceedings of Vextal Conference, Venice, Italy.
5. Ted Dunning. 1994. Statistical identification of language. Technical Report MCCS-94-273, Computing Research Lab (CRL), New Mexico State University.
6. Gregory Grefenstette. 1995. Comparing two language identification schemes. In Proceedings of JADT-95, 3rd International Conference on the Statistical Analysis of Textual Data, Rome, Italy.
7. Harald Hammarström. 2006. A naive theory of affixation and an algorithm for extraction. In Proceedings of the Eighth Meeting of the ACL Special Interest Group on Computational Phonology and Morphology at HLT-NAACL 2006, pages 79–88, New York City, USA, June. Association for Computational Linguistics.
8. Harald Hammarström. 2007. A fine-grained model for language identification. In F. Lazarinis, J. Vilares, J. Tait (eds) Improving Non-English Web Searching (iNEWS07) SIGIR07 Workshop, pages 14–20.
9. B. Hughes, T. Baldwin, S. G. Bird, J. Nicholson, and A. Mackinlay. 2006. Reconsidering language identification for written language resources. In 5th International Conference on Language Resources and Evaluation (LREC2006), Genoa, Italy.
10. Norman C Ingle. 1976. A language identification table. The Incorporated Linguist, 15(4):98–101.
11. Bernard J. Jansen, Danielle L. Booth, and Amanda Spink. 2008. Determining the informational, navigational, and transactional intent of web queries. Inf. Process. Manage., 44(3):1251–1266.
12. Philipp Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. In Proceedings of the 10th Machine Translation Summit, Phuket, Thailand, pages 79–86.
13. Canasai Kruengkrai, Prapass Srichaivattana, Virach Sornlertlamvanich, and Hitoshi Isahara. 2005. Language identification based on string kernels. In In Proceedings of the 5th International Symposium on Communications and Information Technologies (ISCIT-2005, pages 896–899.
14. Uichin Lee, Zhenyu Liu, and Junghoo Cho. 2005. Automatic identification of user goals in web search. In WWW’05: Proceedings of the 14th international conference on World Wide Web, pages 391–400, New York, NY, USA. ACM.
15. Ernesto William De Luca Lena Grothe and Andreas Nrnberger. 2008. A comparative study on language identification methods. In Proceedings of the Sixth International Language Resources and Evaluation (LREC’08), Marrakech, Morocco, May. European Language Resources Association (ELRA). http://www.lrec-conf.org/proceedings/lrec2008/.
16. Ryan Levering and Michal Cutler. 2006. The portrait of a common html web page. In DocEng’06: Proceedings of the 2006 ACM symposium on Document engineering, pages 198–204, New York, NY, USA. ACM Press.
17. Yiqun Liu, Min Zhang, Liyun Ru, and Shaoping Ma. 2006. Automatic query type identification based on click through information. In AIRS, pages 593–600.
18. Arjen Poutsma. 2001. Applying monte carlo techniques to language identification. In In Proceedings of Computational Linguistics in the Netherlands (CLIN).
19. John M. Prager. 1999. Linguini: Language identification for multilingual documents. In HICSS’99: Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences-Volume 2, page 2035, Washington, DC, USA. IEEE Computer Society.
20. Daniel E. Rose and Danny Levinson. 2004. Understanding user goals in web search. In WWW’04: Proceedings of the 13th international conference on World Wide Web, pages 13–19, New York, NY, USA. ACM.
21. Penelope Sibun and Jeffrey C. Reynar. 1996. Language identification: Examining the issues. In 5th Symposium on Document Analysis and Information Retrieval, pages 125–135, Las Vegas, Nevada, U.S.A.
22. Craig Silverstein, Hannes Marais, Monika Henzinger, and Michael Moricz. 1999. Analysis of a very large web search engine query log. SIGIR Forum, 33(1):6–12.
23. C. Souter, G. Churcher, J. Hayes, and J. Hughes. 1994. Natural language identification using corpus-based models. Hermes Journal of Linguistics, 13:183–203.
24. Andreas Stolcke. 2002. Srilm – an extensible language modeling toolkit. In Proc. Intl. Conf. on Spoken Language Processing, volume 2, pages 901–904, Denver, CO.
25. Hidayet Takci and Ibrahim Sogukpinar. 2004. Centroid-based language identification using letter feature set. In CICLing, pages 640–648.
26. Ian H. Witten and Eibe Frank. 2005. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2 edition.