Content-based copy detection through multimodal feature representation and temporal pyramid matching

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 10, Issue 1, 2013, Pages

  Mou, Luntian ^a   Huang, Tiejun ^a   Tian, Yonghong ^a   Jiang, Menglin ^a   Gao, Wen ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Content based copy detection; Feature representation; Temporal pyramid matching

Indexed keywords

ALTERNATIVE TECHNOLOGIES; CONTENT-BASED COPY DETECTIONS; COPYRIGHT PROTECTIONS; FEATURE REPRESENTATION; LOCALITY SENSITIVE HASHING; SIMILARITY EVALUATION; TEMPORAL PYRAMID MATCHING; VIDEO IDENTIFICATION;

IMAGE RETRIEVAL;

COPYRIGHTS;

EID: 84891752464     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/2542205.2542208     Document Type: Article

References (42)

1. AHMED, F., SIYAL, M. Y., AND ABBAS, U. V. 2010. A secure and robust hash-based scheme for image authentication. Signal Process. 90, 5, 1456-1470. DOI: http//dx.doi.org/10.1016/j.sigpro.2009.05.024.
2. BALLARD, D. H. 1981. Generalizing the Hough transform to detect arbitrary shapes. Patt. Recog. 13, 2, 111-122. DOI: http//dx.doi.org/10.1016/0031- 3203(81)90009-1.
3. BAY, H., TUYTELAARS, T., ANDGOOL, L. V. 2006. SURF: Speeded Up Robust Features. In Proceedings of the 9th European Conference on Computer Vision (ECCV'06), (Graz, Austria). 404-417. DOI: http://dx.doi.org/10.1007/1174402332. (Pubitemid 44029795)
4. BOSCH, A., ZISSERMAN, A., AND MUÑOZ, X. 2008. Scene classification using a hybrid generative/discriminative approach. IEEE Trans. Pattern Anal. Mach. Intell. 30, 4, 712-727. DOI: http://dx.doi.org/10.1109/TPAMI.2007.70716. (Pubitemid 351559723)
5. CANO, P., BATLLE, E., KALKER, T., AND HAITSMA, J. 2005. A review of audio fingerprinting. J. VLSI Signal Process. 41, 3, 271-284. (Pubitemid 43005841)
6. DOI: http://dx.doi.org/10.1007/s11265-005-4151-3.
7. CANO, P., BATLLE, E., MAYER, H., AND NEUSCHMIED, H. 2002. Robust sound modeling for song detection in broadcast audio. In Proceedings of AES 112th International Convention (Germany).
8. CHEN, J. AND HUANG, T. 2008. A robust feature extraction algorithm for audio fingerprinting. In Proceedings of the 9th Pacific Rim Conference on Multimedia (PCM'08), 887-890. DOI: http://dx.doi.org/10.1007/978-3-540-89796-5 106.
9. CHEN, L. AND STENTIFORD, F. W. M. 2008. Video sequence matching based on temporal ordinal measurement. Patt. Recog. Lett. 29, 13, 1824-1831. DOI: http://dx.doi.org/10.1016/j.patrec.2008.05.015.
10. CHEUNG, S. S. AND ZAKHOR, A. 2003. Efficient video similarity measurement with video signature. IEEE Trans. Circuits Syst. Video Technol. 13, 1, 59-74. DOI: http://dx.doi.org/10.1109/TCSVT.2002.808080.
11. DE ROOVER, C., DE VLEESCHOUWER, C., LEFÈBVRE, F., AND MACQ, B. 2005. Robust video hashing based on radial projections of key frames. IEEE Trans. Signal Proc. 53, 10, 4020-4037. DOI: http://dx.doi.org/10.1109/TSP.2005. 855414. (Pubitemid 41638251)
12. DOUZE, M., JÉGOU, H., AND SCHMID, C. 2010. An image-based approach to video copy detection with spatio-temporal post-filtering. IEEE Trans. Multimedia 12, 4, 257-266. DOI: http://dx.doi.org/10.1109/TMM.2010.2046265.
13. GIONIS, A., INDYK, P., AND MOTWANI, R. 1999. Similarity search in high dimensions via hashing. In Proceedings of the 25th International Conference on Very Large Data Bases. 518-529.
14. GRAUMAN, K. AND DARRELL, T. 2005. The pyramid match kernel: Discriminative classification with sets of image features. In Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV'05). 1458-1465. DOI: http://dx.doi.org/10.1109/ICCV.2005.239. (Pubitemid 44042350)
15. HAMPAPUR, A. AND BOLLE, R. M. 2001. Comparison of distance measures for video copy detection. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'01). 737-740. DOI: http://dx.doi.org/10.1109/ICME. 2001.1237827.
16. HUA, X.-S., CHEN, X., AND ZHANG, H.-J. 2004. Robust video signature based on ordinal measure. In Proceedings of the IEEE International Conference on Image Processing (ICIP'04). 685-688. DOI: http://dx.doi.org/10.1109/ICIP.2004. 1418847. (Pubitemid 40821013)
17. HUANG, T., TIAN, Y., GAO, W., AND LU, J. 2010. Mediaprinting: Identifying multimedia content for digital rights management. Computer. 43, 12, 28-35. DOI: http://dx.doi.org/10.1109/MC.2010.356.
18. IWAMOTO, K., KASUTANI, E., AND YAMADA, A. 2006. Image signature robust to caption superimposition for video sequence identification. In Proceedings of the IEEE International Conference on Image Processing (ICIP'06). 3185-3188. DOI: http://dx.doi.org/10.1109/ICIP.2006.313046. INTERNET ARCHIVE. www.archive.org.
19. JOLY, A., BUISSON, O., AND FRÉLICOT, C. 2007. Content-based copy retrieval using distortion-based probabilistic similarity search. IEEE Trans. Multimedia 9, 2, 293-306. DOI: http://dx.doi.org/10.1109/TMM.2006.886278.
20. KIM, C. AND VASUDEV, B. 2005. Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans. Circuits Syst. Video Technol. 15, 1, 127-132. DOI: http://dx.doi.org/10.1109/TCSVT.2004.836751. (Pubitemid 40135885)
21. KIM, H., LEE, J., LIU, H., AND LEE, D. 2008. Video linkage: Group based copied video detection. In Proceedings of the ACM International Conference on Content-Based Image Video Retrieval (CIVR'08). 397-406. DOI: http://dx.doi.org/10.1145/1386352.1386404.
22. LAW-TO, J., BUISSON, O., GOUET-BRUNET, V., AND BOUJEMAA, N. 2006. Robust voting algorithms based on labels of behavior for video copy detection. In Proceedings of the ACM International Conference on Multimedia (MM). (Santa Barbara, CA). 835-844. (Pubitemid 47113643)
23. DOI: http://dx.doi.org/10.1145/1180639.1180826.
24. LAZEBNIK, S., SCHMID, C., AND PONCE, J. 2006. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proceedings of the 19th IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2169-2178. DOI: http://dx.doi.org/10.1109/CVPR.2006.68. (Pubitemid 44931582)
25. LEE, S. AND YOO, C. D. 2006. Video fingerprinting based on centroids of gradient orientations. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'06). 401-404. DOI: http://dx.doi.org/10.1109/ICASSP.2006.1660364.
26. LI, Y., MOU, L., SU, C., FANG, X., QIAN, M., JIANG, M., WANG, Y., TIAN, Y., HUANG, T., AND GAO, W. 2010. PKU@TRECVID2010: Copy detection with visual-audio feature fusion and sequential pyramid matching. In Online Proceedings of TRECVID 2010 Workshop.
27. LIN, C.-Y. AND CHANG, S.-F. 2001. A robust image authentication method distinguishing jpeg compression from malicious manipulation. IEEE Trans. Circuits Syst. Video Technol. 11, 2, 153-168. DOI: http://dx.doi.org/10.1109/76. 905982. (Pubitemid 32286869)
28. LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 2, 91-110. DOI: http://dx.doi.org/10.1023/B: VISI.0000029664.99615.94.
29. MIKOLAJCZYK, K. AND SCHMID, C. 2005. A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27, 10, 1615-1630. DOI: http://dx.doi.org/10.1109/TPAMI.2005.188. (Pubitemid 41555406)
30. MOU, L., HUANG, T., TIAN, Y., LIAN, S., AND CHEN, X. 2011. Robust and discriminative image authentication based on sparse coding. In Proceedings of IEEE Consumer Communications and Networking Conference (CCNC'11). 323-326. DOI: http://dx.doi.org/10.1109/CCNC.2011.5766482.
31. MOU, L., CHEN, X., TIAN, Y., AND HUANG, T. 2012. Robust and discriminative image authentication based on standard model feature. In Proceedings of IEEE International Symposium on Circuits & Systems (ISCAS'12). 1131-1134. DOI: http://dx.doi.org/10.1109/ISCAS.2012.6271431.
32. MPEG. 2002. ISO/IEC 15938-4:2002 Information technology - Multimedia content description interface - Part 4: Audio.
33. OOSTVEEN, J., KALKER, T., AND HAITSMA, J. 2002. Feature extraction and a database strategy for video & fingerprinting. Vis. Lect. Notes Comput. Sci. 2, 117-128. DOI: http://dx.doi.org/10.1007/3-540-45925-111.
34. OVER, P., AWAD, G. M., FISCUS, J., ANTONISHEK, B., MICHEL, M., SMEATON, A. F., KRAAIJ, W., AND QUÉNOT, G. 2010. TRECVID 2010 - An overview of the goals, tasks, data, evaluation mechanisms, and metrics. In Proceedings of TRECVid.
35. RADHAKRISHNAN, R. AND BAUER, C. 2008. Robust video fingerprints based on subspace embedding. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'08). 2245-2248. DOI: http://dx.doi.org/10.1109/ICASSP.2008.4518092.
36. SHIVAKUMAR, N. N. 1999. Detecting digital copyright violations on the Internet. Ph.D. Dissertation, Stanford University.
37. SIVIC, J. AND ZISSERMAN, A. 2003. Video Google: A text retrieval approach to object matching in videos. In Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV'03). 1470-1477. DOI: http://dx.doi.org/10. 1109/ICCV.2003.1238663.
38. SWAMINATHAN, A., MAO, Y., ANDWU, M. 2006. Robust and secure image hashing. IEEE Trans. Inf. Forensics Security 1, 2, 215-230. (Pubitemid 43824632)
39. DOI: http://dx.doi.org/10.1109/TIFS.2006.873601.
40. TIAN, Y., JIANG, M., MOU, L., FANG, X., AND HUANG, T. 2011. A multimodal video copy detection approach with sequential pyramid matching. In Proceedings of the IEEE International Conference on Image Processing (ICIP'11). 3629-3632. DOI: http://dx.doi.org/10.1109/ICIP.2011.6116504.
41. WANG, X. AND KANKANHALLI, M. 2010. Multi Fusion: A boosting approach for multimedia fusion. ACM Trans. Multimedia Comput. Commun. Appl. 6, 4, Article 25, DOI: http://dx.doi.org/10.1145/1865106.1865109.
42. WEI, S., ZHAO, Y., ZHU, C., XU, C., AND ZHU, Z. 2011. Frame fusion for video copy detection. IEEE Trans. Circuits Syst. Video Technol. 21, 1, 15-28. DOI: http://dx.doi.org/10.1109/TCSVT.2011.2105554.