Effective and Efficient Global Context Verification for Image Copy Detection

IEEE Transactions on Information Forensics and Security

Volumn 12, Issue 1, 2017, Pages 48-63

  Zhou, Zhili ^a   Wang, Yunlong ^a   Wu, Q M Jonathan ^b   Yang, Ching Nung ^c   Sun, Xingming ^a  

^a NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF WINDSOR   (Canada)

^c NATIONAL DONG HWA UNIVERSITY   (Taiwan)

Author keywords

global context; Image copy detection; near duplicate detection; overlapping region; partial duplicate detection

Indexed keywords

EFFICIENCY;

DUPLICATE DETECTION; GLOBAL CONTEXT; IMAGE COPY DETECTION; NEAR-DUPLICATE DETECTION; OVERLAPPING REGIONS;

SEMANTICS;

EID: 85011659317     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2016.2601065     Document Type: Article

References (46)

1. C. Kim, "Content-based image copy detection, " Signal Process. Image Commun., vol. 18, no. 3, pp. 169-184, Mar. 2003.
2. Z. Xia, X. Wang, X. Sun, and B. Wang, "Steganalysis of least significant bit matching using multi-order differences, " Secur. Commun. Netw., vol. 7, no. 8, pp. 1283-1291, Aug. 2014.
3. J. H. Hsiao, C. S. Chen, L. F. Chien, and M. S. Chen, "A new approach to image copy detection based on extended feature sets, " IEEE Trans. Image Process., vol. 16, no. 8, pp. 2069-2079, Aug. 2007.
4. J. Li, X. Li, B. Yang, and X. Sun, "Segmentation-based image copymove forgery detection scheme, " IEEE Trans. Inf. Forensics Security, vol. 10, no. 3, pp. 507-518, Mar. 2015.
5. A. Joly, O. Buisson, and C. Frelicot, "Content-based copy retrieval using distortion-based probabilistic similarity search, " IEEE Trans. Multimedia, vol. 9, no. 8, pp. 293-305, Feb. 2007.
6. J. Tang, H. Li, G. Qi, and T. Chua, "Image annotation by graph-based inference with integrated multiple/single instance representations, " IEEE Trans. Multimedia, vol. 12, no. 2, pp. 131-141, Feb. 2010.
7. W. Zhao, X. Wu, and C. Ngo, "On the annotation of Web videos by efficient near-duplicate search, " IEEE Trans. Multimedia, vol. 12, no. 5, pp. 448-461, Aug. 2010.
8. X. Wu, C.-W. Ngo, A. G. Hauptmann, and H.-K. Tan, "Real-time nearduplicate elimination for Web video search with content and context, " IEEE Trans. Multimedia, vol. 11, no. 2, pp. 196-207, Feb. 2009.
9. X.-Y. Wei, Z.-Q. Yang, C.-W. Ngo, and W. Zhang, "Visual typo correction by collocative optimization: A case study on merchandize images, " IEEE Trans. Image Process., vol. 23, no. 2, pp. 527-540, Feb. 2014.
10. H. Ling, H. Cheng, Q. Ma, F. Zou, and W. Yan, "Efficient image copy detection using multiscale fingerprints, " IEEE Multimedia, vol. 19, no. 1, pp. 60-69, Jan. 2012.
11. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos, " in Proc. 9th IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 1470-1477.
12. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search, " in Proc. 10th Eur. Conf. Comput. Vis., 2008, pp. 304-317.
13. M. A. Fischle and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, " Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981.
14. O. Chum, J. Matas, and S. Obdrzalek, "Enhancing RANSAC by generalized model optimization, " in Proc. Asian. Conf. Comput. Vis., Jan. 2004, pp. 812-817.
15. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
16. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian, "Spatial coding for large scale partial-duplicate Web image search, " in Proc. Int. Conf. Multimedia, Oct. 2010, pp. 511-520.
17. W. Zhou, H. Li, Y. Lu, and Q. Tian, "SIFT match verification by geometric coding for large-scale partial-duplicate Web image search, " ACM Trans. Multimedia Comput. Commun. Appl., vol. 9, no. 1, Feb. 2013, Art. no. 4.
18. Z. Zhou, X. Sun, Y. Wang, Z. Fu, and Y. Shi, "Combination of SIFT feature and convex region-based global context feature for image copy detection, " in Proc. 14th Int. Workshop Digital-Forensics Watermarking, 2015, pp. 60-71.
19. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 886-893.
20. K. Yan and L. Huston, "Efficient near-duplicate detection and subimage retrieval, " in Proc. 12th ACM Int. Conf. Multimedia, Jan. 2004, pp. 869-876.
21. L.-W. Kang, C.-Y. Hsu, H.-W. Chen, and C.-S. Lu, "Secure SIFT-based sparse representation for image copy detection and recognition, " in Proc. IEEE Int. Conf. Multimedia Expo., Jul. 2010, pp. 1248-1253.
22. Z. Xu, H. Ling, F. Zou, Z. Lu, and P. Li, "A novel image copy detection scheme based on the local multi-resolution histogram descriptor, " Multimedia Tools Appl., vol. 52, nos. 2-3, pp. 445-463, Apr. 2011.
23. H. Ling, L. Wang, F. Zou, and W. Yan, "Fine-search for image copy detection based on local affine-invariant descriptor and spatial dependent matching, " Multimedia Tools. Appl., vol. 52, nos. 2-3, pp. 551-568, Apr. 2011.
24. D. G. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
25. K. Yan and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. /Jul. 2004, pp. II-506-II-513.
26. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features (SURF), " Comput. Vis. Image Understand., vol. 110, no. 3, pp. 346-359, Jun. 2008.
27. H. Ling, L. Yan, F. Zou, C. Liu, and H. Feng, "Fast image copy detection approach based on local fingerprint defined visual words, " Signal Process., vol. 93, no. 8, pp. 2328-2338, Aug. 2013.
28. S. Wu and M. Lew, "Salient features for visual word based image copy detection, " in Proc. 4th ACM Int. Conf. Multimedia Retr., 2014, pp. 475-478.
29. L. Yan, F. Zou, R. Guo, L. Gao, K. Zhou, and C. Wang, "Feature aggregating hashing for image copy detection, " World Wide Web, vol. 19, no. 2, pp. 217-229, May 2015.
30. Y. Zhang, Z. Jia, and T. Chen, "Image retrieval with geometry-preserving visual phrases, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 809-816.
31. X. Wang, M. Yang, T. Cour, S. Zhu, K. Yu, and T. Han, "Contextual weighting for vocabulary tree based image retrieval, " in Proc. Int. Conf. Comput. Vis., 2011, pp. 209-216.
32. L. Zheng, S. Wang, and Q. Tian, "Coupled binary embedding for largescale image retrieval, " IEEE Trans. Image Process., vol. 23, no. 8, pp. 3368-3380, Aug. 2014.
33. J. Yao, B. Yang, and Q. Zhu, "Near-duplicate image retrieval based on contextual descriptor, " IEEE Signal Process. Lett., vol. 22, no. 9, pp. 1404-1408, Sep. 2015.
34. S. Zhang, Q. Tian, K. Lu, Q. Huang, and W. Gao, "Edge-SIFT: Discriminative binary descriptor for scalable partial-duplicate mobile search, " IEEE Trans. Image Process., vol. 22, no. 7, pp. 2889-2902, Jul. 2013.
35. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002.
36. G. Mori, S. Belongie, and J. Malik, "Efficient shape matching using shape contexts, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 11, pp. 1832-1837, Nov. 2005.
37. E. N. Mortensen, H. Deng, and L. Shapiro, "A SIFT descriptor with global context, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 184-190.
38. J.-N. Liu and G.-H. Zeng, "Improved global context descriptor for describing interest regions, " J. Shanghai Jiaotong Univ., vol. 17, no. 2, pp. 147-152, Apr. 2012.
39. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 2161-2168.
40. M. Heikkilä, M. Pietikäinen, and C. Schmid, "Description of interest regions with local binary patterns, " Pattern Recognit., vol. 42, no. 3, pp. 425-436, May 2009.
41. (2008). Holidays. [Online]. Available: http://lear. inrialpes. fr/~jegou/data. php
42. R. L. Graham, "An efficient algorithm for determining the convex hull of a finite planar set, " Inf. Process. Lett., vol. 1, no. 4, pp. 132-133, Jun. 1972.
43. (2008). Copydays. [Online]. Available: http://lear. inrialpes. fr/~jegou/data. php
44. (2015). Challenging Ground-Truth. [Online]. Available: http://pan. baidu. com/s/1kUFvozX
45. (2011). DupImage. [Online]. Available: http://www. cs. utsa. edu/~wzhou/ data/DupGroundTruthDataset. Tgz
46. F. A. P. Petitcolas, "Watermarking schemes evaluation, " IEEE Signal Process. Mag., vol. 17, no. 5, pp. 58-64, Sep. 2000.