Arabic document similarity analysis using n-grams and singular value decomposition

Proceedings - International Conference on Research Challenges in Information Science

Volumn 2015-June, Issue June, 2015, Pages 445-455

  Hussein, Ashraf S ^a  

^a ARAB OPEN UNIVERSITY   (Kuwait)

Author keywords

Latent Semantic Analysis; natural language processing; plagiarism check; similarity estimation; Singular Value Decomposition; text mining; text reuse

Indexed keywords

COMPUTATIONAL LINGUISTICS; INTELLECTUAL PROPERTY; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS; SYNTACTICS; TEXT MINING;

LATENT SEMANTIC ANALYSIS; NATURAL LANGUAGE PROCESSING; PLAGIARISM CHECKS; SIMILARITY ESTIMATION; TEXT-REUSE;

SINGULAR VALUE DECOMPOSITION;

EID: 84937887901     PISSN: 21511349     EISSN: 21511357     Source Type: Conference Proceeding    
DOI: 10.1109/RCIS.2015.7128906     Document Type: Conference Paper

References (37)

1. J. Hage, P. Rademaker and N. van Vugt, "A comparison of plagiarism detection tools, " Utrecht, The Netherlands, 2010
2. A. M. E. T. Ali, H. M. D. Abdulla and V. Snasel, "Overview and comparison of plagiarism detection tools, " in Proceedings of the Dateso 2011: Annual International Workshop on Databasis, Texts, Specifications and Objects, Pisek, Czech Republic, 2011
3. "Plagiarism Checker Review, " 8 April 2014. [Online]. Available: http://plagiarism-checker-review.toptenreviews.com
4. D. Zhanga, M. Joyb, G. Cosmac, R. Boyattb, . J. Sinclairb and J. Yaud, "Source-code plagiarism in universities: a comparative study of student perspectives in China and the UK, " Assessment and Evaluation in Higher Education, December 2013
5. F. Mozgovoy, T. Kakkonen and E. Sutinen, "Using natural language parsers in plagiarism detection, " in Proceedings of the SLaTE Workshop on Speech and Language Technology in Education, Farmington, Pennsylvania, USA, 2007
6. S. Alzahrani, N. Salim and A. Abraham, "Understanding plagiarism linguistic patterns, textual features, and detection methods, " IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, vol. 42, no. 2, pp. 133-149, 2012
7. I. Bensalem, P. Rosso and S. Chikhi, "Intrinsic plagiarism detection in Arabic text: Preliminary experiments, " in Proceedings of the 2nd Spanish Conference on Information Retrieval, Valencia, Spain, 2012
8. W.-Y. Lin, N. Peng, C.-C. Yen and S.-d. Lin, "Online plagiarism detection through exploiting lexical, syntactic, and semantic information, " in Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Jeju, Republic of Korea, 2012
9. A. M. Riad, F. F. Farahat, A. S. Asem and M. A. Zaher, "Studying different methods for plagiarism detection, " International Journal of Computer Science, vol. 2, no. 5, pp. 147-154, 2013
10. M. Z. Eissen, B. Stein and M. Kulig, "Plagiarism detection without reference collections, " in Proceedings of the 30th Annual Conference of the German Classification Society (GfK1), 2007
11. G. Gruner and S. Naven, "Tool support for plagiarism detection in text documents, " in Proceedings of the ACM Symposium on Applied Computing, Santa Fe, New Mexico, 2005
12. I. A. Al-Sughaiyer and I. A. Al-Kharashi, "Arabic Morphological Analysis Techniques: A Comprehensive Survey, " Journal of the American Society for Infrmation Sciences and Technology, vol. 55, no. 3, p. 189-213, 2004
13. M. E. B. Menai, "Detection of plagiarism in Arabic documents, " International Journal of Information Technology and Computer Science, vol. 10, pp. 80-89, 2012
14. N. Meuschke and B. Gipp, "State-of-the-art in detecting academic plagiarism, " International Journal for Educational Integrity, vol. 9, no. 1, pp. 50-71, 2013
15. S. M. Alzahrani and N. Salim, "Plagiarism detection in Arabic scripts using fuzzy information retrieval, " in Proceedings of 2008 Student Conference on Research and Development (SCOReD 2008), Johor, Malaysia, 2008
16. S. M. Alzahrani and N. Salim, "Statement-based fuzzy-set IR versus fingerprints matching for plagiarism detection in Arabic documents, " in Proceedings of the 5th Postgraduate Annual Research Seminar (PARS09), Johor Bahru, Malaysia, 2009
17. M. Menai and M. Bagais, "APlag: A plagiarism checker for Arabic texts, " in Proceedings of the International Conference on Computer Science & Education (ICCSE 2011), SuperStar Virgo, Singapore, 2011
18. A. Jadalla and A. Elnagar, "A plagiarism detection system for Arabic text-based documents, " in Lecture Notes in Computer Science, 2012
19. S. Schleimer, D. Wilkerson and A. Aiken, "Winnowing: Local algorithmsfor document fingerprinting, " in Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, San Diego, California, 2003
20. M. Mozgovoy, T. Kakkonen and G. Cosma, "Automatic student plagiarism detection Future prespectives, " Journal of Educational Computing Research, vol. 43, no. 4, pp. 511-531, 2010
21. M. Mozgovoy, V. Tusov and V. Klyuev, "The use of machine semantic analysis in plagiarism detection, " in Proceedings of the 9th International Conference on Humans and Computers, Aizu-Wakamatsu, Japan, 2006
22. C. Leung and Y. Chang, "A natural language processing approach to automatic plagiarism detection, " in Proceedings of the 8th ACM SIGITE Conference on Information Technology Education, 2007
23. S. Deerwester, S. Dumais, G. Furnas, R. Harshman, T. Landauer, K. Lochbaum and L. Streeter.USA Patent US Patent 4, 839, 853, 1988
24. S. Simmons and Z. Estes, "Using latent semantic analysis to estimate similarity, " in Proceedings of the 28th Annual Conference of the Cognitive Science Society CogSci 2006, Vancouver, British Columbia, Canada, 2006
25. Z. Ceska, M. Toman and K. Jezek, "Multilingual plagiarism detection, " in Proceedings of the 13th International Conference On Artificial Intelligence: Methodology, Systems, and Applications, AIMSA 2008, Lecture Notes in Computer Science, Varna, Bulgaria, 2008
26. Z. Ceska and C. Fox, "The influence of text pre-processing on plagiarism detection, " in Proceedings of Recent Advances in Natural Language Processing, RANLP 2009, Borovets, Bulgaria, 2009
27. D. Gusfield, Algorithms on Strings, Trees, and Sequences: Computer Science and Computational Biology, Cambridge: Cambridge University Press, 1997, pp. 263-264
28. A. Hussein and H. El-Shishiny, "A framework and a prototype for Arabic question answering system, " Egyptian Informatics Journal, vol. 4, no. 1, pp. 26-39, 2003
29. I. A. El-Khair, "Effects of stop words elimination for Arabic information retrival: A comparative study, " International Journal of Computaing and Information Sciences, vol. 4, no. 3, pp. 119-133, 2006
30. Z. Ceska, I. Hanak and R. Tesar, "Teraman: A tool for N-gram extraction from large datasets, " in Proceedings of the 2007 IEEE International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, 2007
31. Z. Ceska, "Plagiarism detection based on Singular Value Decomposition, " Lecture Notes in Computer Science, vol. 5221, no. Advances in Natural Language Processing, pp. 108-119, 2008
32. G. Salton and C. Buckley, "Term-weighting approaches in automatic text retrieval, " Information Processing and Management, vol. 24, no. 5, p. 513-523, 1988
33. J.-P. Bao, J.-Y. Shen and H.-Y. Liu, "A Fast Document Copy Detection Model, " Soft Computing, vol. 10, pp. 41-46, 2006
34. M. W. Berry, M. Browne, A. N. Langville, V. P. Pauca and R. J. Plemmons, Computational Statistics and Data Analysis, 2006
35. A. S. Hussein, "G131 Kuwait Civilization History-Test Case" 2015. [Online]. Available: http://www.4shared.com/zip/cCVPO4o4ce/G131-Kuwait-Civilization-Histo.html. [Provided 2015
36. A. S. Hussein, "Arabic Law Text Book-Test Case" 2014. [Online]. Available: http://www.4shared.com/zip/QD-u-SP9ba/Arabic-Law-Text-Book-Test-Case.html. [Provided 2015
37. A. S. Hussein, "Egyptian Newspaper Chunks-Test Case" 2014. [Online]. Available: http://www.4shared.com/zip/0v9v7-5Cce/Scalability-Case.html. [Provided 2015