Automatic Identification of Arabic Language Varieties and Dialects in Social Media

SocialNLP 2014 - 2nd Workshop on Natural Language Processing for Social Media, in conjunction with COLING 2014

Volumn , Issue , 2014, Pages 22-27

  Sadat, Fatiha ^a   Kazemi, Farnazeh ^b   Farzindar, Atefeh ^b  

^a UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

^b INSTITUTE FOR RESEARCH IN IMMUNOLOGY AND CANCER   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; COMPUTATIONAL LINGUISTICS; FORMAL LANGUAGES;

ARABIC DIALECTS; ARABIC LANGUAGES; AUTOMATIC IDENTIFICATION; LANGUAGE MODEL; MEDIA COMMUNICATIONS; MODERN STANDARDS; N-GRAMS; PROBABILISTIC MODELS; SOCIAL MEDIA; STANDARD ARABICS;

SOCIAL NETWORKING (ONLINE);

EID: 85037743734     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Al-Sabbagh R. and Girju R. 2013. Yadac: Yet another dialectal arabic corpus. In N. C. C. Chair, K. Choukri, T. Declerck, M. U. Doan, B. Maegaard, J. Mariani, J. Odijk, and S. Piperidis, editors, Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12), Istanbul, Turkey, May 2012.
2. Almeman K. and Lee M. 2013. Automatic building of arabic multi dialect text corpora by bootstrapping dialect words. In Communications, Signal Processing, and their Applications (ICCSPA), 2013.
3. Baldwin T. and Lui M. 2010. Language identification: The long and the short of the matter. In Human Language Technologies: The 2010 Annual Conference of theNorth American Chapter of the Association for Computational Linguistics, HLT'10, pages 229{237, Stroudsburg, PA, USA, 2010. Association for Computational Linguistics.
4. Biadsy F., Hirschberg J., and Habash N. 2009. Spoken arabic dialect identification using phonotactic modeling. In Proceedings of the Workshop on Computational Approaches to Semitic Languages at the meeting of the European Association for Computational Linguistics (EACL), Athens, Greece.
5. Cavnar W. B., Trenkle J. M. 1994. N-gram-based text categorization. 1994. In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval. Ann Arbor MI, 48113(2):161{175, 1994.
6. Dasigi P. and Diab M. 2011. Codact: Towards identifying orthographic variants in dialectal arabic. In Proceedings of the 5th International Joint Conference on Natural Language Processing (ICJNLP), Chiangmai, Thailand, 2011.
7. Dunning T. 1994. Statistical identification of languages. Citeseer, 1994.
8. Elfardy H. and Diab M. 2012. Simplified guidelines for the creation of large scale dialectal arabic annotations. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC), Istanbul, Turkey.
9. Elfardy H. and Diab M. 2013. Sentence-Level Dialect Identification in Arabic, In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, ACL 2013, Sofia, Bulgaria. 2013.
10. Elfardy H., Al-Badrashiny M., Elfardy M. and Diab M. 2013. Sentence Level Dialect Identification in Arabic. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, pages 456-461, Sofia, Bulgaria, August 4-9 2013.
11. Gotti F., Langlais P., and Farzindar A. 2013. Translating government agencies' tweet feeds: Specificities, problems and (a few) solutions. In Proceedings of the Workshop on Language Analysis in Social Media, Atlanta, Georgia, June 2013. Association for Computational Linguistics, Association for Computational Linguistics.
12. Habash N. and Rambow O. 2006. MAGEAD: A morphological analyzer and generator for the Arabic dialects. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 681-688, Sydney, Australia, July. Association for Computational Linguistics.
13. Habash N., Diab M., and Rabmow O. 2012. Conventional orthography for dialectal arabic. In Proceedings of the Language Resources and Evaluation Conference (LREC), Istanbul, Turkey, 2012.
14. Joachims T. 1998. Text categorization with support vector machines: Learning with many relevant features. Springer, 1998.
15. Kikui G.-i. 1996. Identifying, the coding system and language, of on-line documents on the internet. In Proceedings of the 16th Conference on Computational Linguistics - Volume 2, COLING '96, pages 652{657, Stroudsburg, PA, USA, 1996. Association for Computational Linguistics.
16. Kirchhoff K. and Vergyri D. 2004. Cross-dialectal acoustic data sharing for arabic speech recognition. In Acoustics, Speech, and Signal Processing, 2004. Proceedings.(ICASSP'04). IEEE International Conference on, volume 1, pages I-765. IEEE, 2004.
17. Peng F. and Schuurmans D. 2003. Combining naive bayes and n-gram language models for text classi_cation. In Advances in Information Retrieval, pages 335{350. Springer, 2003.
18. Salloum W. and Habash N. 2011. Dialectal to standard arabic paraphrasing to improve arabic-english statistical machine translation. In Proceedings of the First Workshop on Algorithms and Resources for Modelling of Dialects and Language Varieties, pages 10-21. Association for Computational Linguistics.
19. Suliman A. F. 2008. Automatic Identification of Arabic Dialects USING Hidden Markov Models. Doctoral Dissertation, University of Pittsburgh. 2008.
20. Zaidan O. F. and Callison-Burch C. 2011. The arabic online commentary dataset: an annotated dataset of informal arabic with high dialectal content. In Proceedings of ACL, pages 37-41, 2011.
21. Zaidan O. F. and Callison-Burch C. 2012. Arabic dialect identi_cation. volume 1, Microsoft Research, 2012.