On the effectiveness of simhash for detecting near-miss clones in large scale software systems

Proceedings - Working Conference on Reverse Engineering, WCRE

Volumn , Issue , 2011, Pages 13-22

  Uddin, Md Sharif ^a   Roy, Chanchal K ^a   Schneider, Kevin A ^a   Hindle, Abram ^b  

^a UNIVERSITY OF SASKATCHEWAN   (Canada)

^b UNIVERSITY OF ALBERTA   (Canada)

Author keywords

clone detection; fingerprinting; simhash; similarity hashing; software clones

Indexed keywords

CLONE DETECTION; FINGERPRINTING; SIMHASH; SIMILARITY HASHING; SOFTWARE CLONES;

BUILDING CODES; CODES (SYMBOLS); COMPUTER SOFTWARE; PATTERN RECOGNITION; REVERSE ENGINEERING;

CLONING;

EID: 83455168943     PISSN: 10951350     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WCRE.2011.12     Document Type: Conference Paper

References (24)

1. B. S. Baker. "A Program for Identifying Duplicated Code". Proc. CSS Interface, 1999, Vol. 24, pp. 49-57.
2. I. D. Baxter, A. Yahin, L. Moura, M. Sant' Anna and L. Bier, "Clone detection using abstract syntax trees", Proc. ICSM, 1998, pp. 368-378.
3. M. S. Charikar, "Similarity estimation techniques from rounding algorithms". Proc. STOC, 2002, pp. 380-388.
4. M. Chilowicz, E. Duris and G. Roussel, "Syntax tree fingerprinting for source code similarity detection" Proc. ICPC, 2009, pp. 243-247.
5. J. R. Cordy, "The TXL Source Transformation Language". Science of Computer Programming, 61(3):190-210, 2006.
6. M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, "A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise", Proc. KDD, 1996, pp. 226-231.
7. C. Gong, Y. Huang, X. Cheng and S. Bai. "Detecting near-duplicates in large-scale short text databases", Proc. PAKDD, 2008, pp. 877-883.
8. M. Henzinger, "Finding near-duplicate web pages: a large-scale evaluation of algorithms", Proc. SIGIR, 2006, pp. 284-291
9. B. Hummel, E. Juergens, L. Heinemann and M. Conradt, "Index-based code clone detection: incremental, distributed, scalable", Proc. ICSM, 2010, pp. 1-9.
10. L. Jiang, G. Misherghi, Z. Su and S. Glondu. "DECKARD: Scalable and Accurate Tree-based Detection of Code Clones". Proc. ICSE, 2007, pp. 96-105.
11. J. H. Johnson, "Identifying redundancy in source code using fingerprints", Proc. CASCON, 1993, pp. 171-183.
12. T. Kamiya, S. Kusumoto and K. Inoue, "CCFinder: a multilinguistic token-based code clone detection system for large scale source code", IEEE TSE, 28(7):654- 670, 2002.
13. B. Lague, D. Proulx, E. Merlo, J. Mayrand and J. Hudepohl, "Assessing the benefits of incorporating function clone detection in a development process," Proc. ICSM, 1997, pp. 314-321.
14. Z. Li, S. Lu, S. Myagmar and Y. Zhou. "CP-Miner: Finding Copy-Paste and Related Bugs in Large-Scale Software Code". IEEE TSE, 32(3):176-192, 2006.
15. G. S. Manku, A. Jain and A.D. Sarma, "Detecting Near-Duplicates for Web Crawling", Proc. of WWW, 2007, pp. 141-150.
16. E. W. Myers, "An O (ND) difference algorithm and its variations", Algorithmica, 1(1):251-266, 1986.
17. J. Mayrand, C. Leblanc, and E. Merlo, "Experiment on the automatic detection of function clones in a software system using metrics", Proc. ICSM, 1996, pp. 244-254.
18. B. Pi, S. Fu, W. Wang and S. Han, "SimHash-based Effective and Efficient Detecting of Near-Duplicate Short Messages", Proc. ISCSCT, 2009, pp. 020-025.
19. C. K. Roy and J. R. Cordy, "A mutation / injection-based automatic framework for evaluating code clone detection tools", Proc. ICST Mutation Workshop, 2009, pp. 157-166.
20. C.K. Roy, J.R. Cordy and R. Koschke, Comparison and Evaluation of Code Clone Detection Techniques and Tools: A Qualitative Approach. Science of Computer Programming, 74 (2009): 470-495, 2009.
21. C. K. Roy and J. R. Cordy. "NiCad: Accurate Detection of Near-Miss Intentional Clones Using Flexible Pretty-Printing and Code Normalization", Proc. ICPC, 2008, pp. 172-181
22. G. M. K. Selim, K. C. Foo and Y. Zou. "Enhancing Source-Based Clone Detection Using Intermediate Representation", Proc. WCRE, 2010, pp. 227-236.
23. R. Smith and S. Horwitz, "Detecting and measuring similarity in code clones", Proc. IWSC, 2009, pp. 28-34.
24. R.Tiarks, R. Koschke, and R. Falke, "An extended assessment of type-3 clones as detected by state-of-the-art tools", Software Quality Journal, 19(2): 295-331, 2011.