Study of Some Distance Measures for Language and Encoding Identification

COLING ACL 2006 - Linguistic Distances, Proceedings of the Workshop

Volumn , Issue , 2006, Pages 63-72

  Singh, Anil Kumar ^a  

^a INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; SIGNAL ENCODING;

AS DISTRIBUTION; DISTANCE MEASURE; ENCODINGS; INFORMATION-THEORETIC APPROACH; LANGUAGE MODEL; LANGUAGE PROCESSING; N-GRAM MODELING; N-GRAM MODELS; NATURAL LANGUAGES; SIMILARITY MEASURE;

ENCODING (SYMBOLS);

EID: 78651342601     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. Gary Adams and Philip Resnik. 1997. A language identification application built on the Java client-server platform. In Jill Burstein and Claudia Lea-cock, editors, From Research to Commercial Applications: Making NLP Work in Practice, pages 43-47. Association for Computational Linguistics.
2. K. Beesley. 1988. Language identifier: A computer program for automatic natural-language identification on on-line text.
3. William B. Cavnar and John M. Trenkle. 1994. N-gram-based text categorization. In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval, pages 161-175, Las Vegas, US.
4. H. Combrinck and E. Botha. 1994. Automatic language identification: Performance vs. complexity. In Proceedings of the Sixth Annual South Africa Workshop on Pattern Recognition.
5. Ted Dunning. 1994. Statistical identification of language. Technical Report CRL MCCS-94-273, Computing Research Lab, New Mexico State University, March.
6. E. Giguet. 1995a. Categorization according to language: A step toward combining linguistic knowledge and statistic learning.
7. Emmanuel Giguet. 1995b. Multilingual sentence categorisation according to language. In Proceedings of the European Chapter of the Association for Computational Linguistics, SIGDAT Workshop, From Text to Tags: Issues in Multilingual Language Analysis, Dublin, Ireland.
8. Norman C. Ingle. 1976. A language identification table. In The Incorporated Linguist, 15(4).
9. Jay J. Jiang and David W. Conrath. 1997. Semantic similarity based on corpus statistics and lexical taxonomy.
10. G. Kikui. 1996. Identifying the coding system and language of on-line documents on the internet. In COLING, pages 652-657.
11. Bruno Martins and Mario J. Silva. 2005. Language identification in web pages. In Proceedings of ACM-SAC-DE, the Document Engeneering Track of the 20th ACM Symposium on Applied Computing.
12. Y. K. Muthusamy, E. Barnard, and R. A. Cole. 1994. Reviewing automatic language identification. In IEEE Signal Processing Magazine.
13. Patricia Newman. 1987. Foreign language identification - first step in the translation process. In Proceedings of the 28th Annual Conference of the American Translators Association., pages 509-516.
14. Arjen Poutsma. 2001. Applying monte carlo techniques to language identification. In Proceedings of CLIN.
15. P. Sibun and J. C. Reynar. 1996. Language identification: Examining the issues. In In Proceedings of SDAIR-96, the 5th Symposium on Document Analysis and Information Retrieval., pages 125-135.
16. Kranig Simon. 2005. Evaluation of language identification methods. In BA Thesis. Universitt Tbingens.
17. C. Souter, G. Churcher, J. Hayes, J. Hughes, and S. Johnson. 1994. Natural language identification using corpus-based models. In Hermes Journal of Linguistics., pages 183-203.
18. Johnson Stephen. 1993. Solving the problem of language recognition. In Technical Report. School of Computer Studies, University of Leeds.
19. W. J. Teahan and D. J. Harper. 2001. Using compression based language models for text categorization. In J. Callan, B. Croft and J. Lafferty (eds.), Workshop on Language Modeling and Information Retrieval., pages 83-88. ARDA, Carnegie Mellon University.