Identification of document language is not yet a completely solved problem

CIMCA 2006: International Conference on Computational Intelligence for Modelling, Control and Automation, Jointly with IAWTIC 2006: International Conference on Intelligent Agents Web Technologies ...

Volumn , Issue , 2006, Pages 212-

  Da Silva, Joaquim Ferreira ^a   Lopes, Gabriel Pereira ^a  

^a UNIVERSIDADE NOVA DE LISBOA   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

IDENTIFICATION (CONTROL SYSTEMS); PROBLEM SOLVING; STATISTICAL METHODS;

CORRECT LANGUAGES; LANGUAGE IDENTIFICATION (LID); LANGUAGE VARIANTS;

COMPUTER PROGRAMMING LANGUAGES;

EID: 38849173179     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIMCA.2006.117     Document Type: Conference Paper

References (13)

1. K. R. Beesley. Language identifier: a computer program for automatic natural-language identification of on-line text. In Proceedings of the 29th Annual Conference of the American Translators Association, pages 47-54. ATA, 1998.
2. W. B. Cavnar and J. M. Trenkle. N-gram-based text categorization. In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval, pages 161-175, Las Vegas, US, 1994.
3. J. F. da Silva and J. G. P. Lopes. Identification of document language in hard contexts. In Proceedings of the SIGIR 2006 Workshop on New Directions in Multilingual Information Access, Seattle, USA, 2006.
4. T. Dunning. Statistical identification of language, 1994.
5. Y. Escoufier and H.L'Hermier. A propos de la comparaison graphique des matrices de variance. Biometrischc Zeitschrift, 20(5):477-483, 1978.
6. G. Grefenstette. Comparing two language identification schemes. In proceedings of 3rd International Conference on Statistical Analysis on Textual Data, (JADT), 1995.
7. N. C. Ingle. A language identification table. The Incorporated Linguist, 15(4), 1976.
8. R. A. Johnson and D. W. Wichern. Applied Multivariate Statistical Analysis. Prentice-Hall Intern., 2nd edition, 1988.
9. R. Lins and P. Gonçalves. Automatic language identification of written text. In Proceedings of the ACM Symposium on Applied Computing, SAC-2004, pages 1128-1133, 2004.
10. B. Martins and M. J. Silva. Language identification in web pages. In L. M. Liebrock, editor, The 20th ACM SAC Symposium on Applied Computing. Document Engeneering Track., pages 773-777, Santa F, Novo Mxico, EUA, 2005.
11. P.Newman. Foreighn language identification - a first step in translation. In Proc. of the 28th Annual Conference of the American Translators Association, pages 509-516, 1987.
12. P. Sibun and A. L. Spitz. Language determination: Natural language processing from scanned document images. In Proc. of the 4th ACL Conference on Applied Natural Language Processing (13-15 October 1994, Stuttgart), 1994.
13. C. Souten, G. Churcher, J. Hayes, J. Hughes, and S. Johnson. Natural language identification using corpus based methods. Hermes Journal of Linguistics, 13:183-203, 1994.