Language identification from small text samples

Journal of Quantitative Linguistics

Volumn 13, Issue 1, 2006, Pages 57-80

  Murthy, Kavi Narayana ^a   Kumar, G Bharadwaja ^a  

^a UNIVERSITY OF HYDERABAD   (India)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 43249161841     PISSN: 09296174     EISSN: 17445035     Source Type: Journal    
DOI: 10.1080/09296170500500694     Document Type: Article

References (24)

1. Adams, G., & Resnik, Ph. (1997). A language identification application built on the Java client-server platform. In J. Burstein & C. Leacock (Eds), From Research to Commercial Applications: Making {NLP} Work in Practice (pp. 43-47). Somerset, New Jersey: Association for Computational Linguistics.
2. Allison, P. D. (1999). Multiple Regression: A Primer. Thousand Oaks, CA: Pine Forge Press.
3. Beesley, K. (1988). Language Identifier: A computer program for automatic natural-language identification of on-line text. Proceedings of the 29th Annual Conference of the American Translators Association, 47 - 54.
4. Bureau of Indian Standards (1991). Indian Script Code for Information Interchange - ISCI, - IS 13194: 1991. New Delhi, India.
5. Carson-Berndsen, J., Kelly, R., & Neugebauer, M. (2004). Automatic acquisition of feature-based phonotactic resources. Proceedings of the Workshop of ACL Special Interest Group on Computational Phonology - SIGPHON, Barcelona, Spain, 27 - 34.
6. Combrinck, H., & Botha, E. (1995). Automatic language identification: Resisting complexity. South African Computer Journal, 27, 18-26.
7. Constable, P., & Simons, G. (2000). Language identification and IT: Addressing problems of linguistic diversity on a global scale. SIL Electronic Working Papers 2000-2001.
8. Dunning, T. (1994). Statistical identification of language. Technical Report, CRL MCCS-94-273, New Mexico State University.
9. Giguet, E. (1995a). Multilingual sentence categorization according to language. Proceedings of the European Chapter of the Association for Computational Linguistics SIGDAT Workshop from Text to Tags: Issues in Multilingual Language Analysis, Dublin, Ireland, 73 - 76.
10. Giguet, E. (1995b). Categorization according to language: A step toward combining linguistic knowledge and statistical learning. In 4th International Workshop of Parsing Technologies, Prague, Karlovy Vary, Czech Republic, September, 20-24.
11. Glantz, S. A., & Slinker, B. K. (2000). Primer of Applied Regression and Analysis of Variance (2nd edition). New York: McGraw-Hill.
12. Jayaram, B. D., & Rajyashree, K. S. (1996). Corpora in Indian languages. In Workshop on Indian Language Corpora, CIIL, Mysore.
13. Montgomery, D. C., Peck, E. A., & Vining, G. G. (2001). Introduction to Linear Regression Analysis. New York: John Wiley & Sons, Inc.
14. Moore, D., & McCabe, G. (1993). Introduction to the Practice of Statistics. New York: W. H. Freeman and Company.
15. Murthy, K. N. (2005). Natural Language Processing - An Information Access Perspective. Bangalore: Sarada Ranganathan Endowment for Library Science.
16. Murthy, K. N., & Kumar, G. B. (2003). Language Identification from Small Text Samples. Technical Report, LERC/UoH/2003/1, Department of Computer and Information Sciences, University of Hyderabad, India.
17. Muthusamy, Y. K., Barnard, E., & Cole, R. A. (1994). Automatic language identification: A review/tutorial. IEEE Signal Processing Magazine, 11(4), 33-41.
18. Negi, A., & Murthy, K. N. (2004). Issues of document engineering in the Indian context. Technical Report, LERC/UoH/2004/1. Department of Computer and Information Sciences, University of Hyderabad, India.
19. Piotrowski, M. (1997). Statistical language identification for NLP-supported full text retrieval. Technical Report, CLUE-TR-3.
20. Prager, J. M. (1999). Linguini: Language identification for multilingual documents. Journal of Management Information Systems, 16(3), 71-101.
21. Rao, K. P., Bharati, A., Sangal, R., & Bendre, S. M. (2002). Basic statistical analysis of corpus and cross comparison among corpora. In Proceedings of the Recent Advances in Natural Language Processing (ICON-2002), 121-129.
22. Sinha, R. M. K. (1984). Computer processing of Indian languages and scripts - potentialities and problems. Journal of the Institute of Electronic and Telecommucations Engineers, 30(6), 133-149.
23. Wechsler, M., Sheridan, P., & Schauble, P. (1997). Multi-language text indexing for Internet retrieval. In Proceedings of the 5th RIAO Conference, Computer-Assisted Information Searching on the Internet, Montreal, Canada, 217-232.
24. Xafopoulos, A., Kotropoulos, C., Almpanidis, G., & Pitas, I. (2004). Language identification in web documents using discrete hidden Markov models. Pattern Recognition, 37(3), 583-594.