A comparison of language identification approaches on short, query-style texts

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5993 LNCS, Issue , 2010, Pages 611-614

  Gottron, Thomas ^a   Lipka, Nedim ^b  

^a JOHANNES GUTENBERG UNIVERSITY   (Germany)

^b BAUHAUS UNIVERSITY WEIMAR   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SCIENCE; COMPUTERS;

LANGUAGE DETECTION; LANGUAGE IDENTIFICATION; MULTI LANGUAGES; SINGLE WORDS; USER QUERY;

INFORMATION RETRIEVAL;

EID: 77952315207     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-12275-0_59     Document Type: Conference Paper

References (10)

1. Oakes, M., Xu, Y.: A search engine based on query logs, and search log analysis at the university of Sunderland. In: CLEF 2009: Proceedings of the 10th Cross Language Evaluation Forum (2009)
2. Dunning, T.: Statistical identification of language. Technical Report MCCS-94-273, Computing Research Laboratory, New Mexico State University (1994)
3. Cavnar, W.B., Trenkle, J.M.: N-gram-based text categorization. In: SDAIR 1994, Proceedings of the 3rd Annual Symposium on Document Analysis and Information Retrieval (1994)
4. Vojtek, P., Bieliková, M.: Comparing natural language identification methods based on Markov processes. In: Computer Treatment of Slavic and East European Languages, 4th Int. Seminar, pp. 271-282 (2007)
5. Suen, C.Y.: N-gram statistics for natural language understanding and text processing. IEEE Transactions on Pattern Analysis and Machine Ingelligence PAMI-1(2), 164-172 (1979)
6. Sibun, P., Reynar, J.C.: Language identification: Examining the issues (1996)
7. Rehůrek, R., Kolkus, M.: Language identification on the web: Extending the dictionary method. In: Computational Linguistics and Intelligent Text Processing. LNCS, vol.5449, pp. 357-368. Springer, Heidelberg (2009)
8. Berkling, K., Arai, T., Barnard, E.: Analysis of phoneme-based features for language identification. In: Proc. ICASSP, pp. 289-292 (1994)
9. Teahan, W.J.: Text classification and segmentation using minimum cross-entropy. In: RIAO 2000, vol.2, pp. 943-961 (2000)
10. Lewis, D.D., Yang, Y., Rose, T., Li, F.: RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research 5, 361-397 (2004)