A robust and fast video copy detection system using content-based fingerprinting

IEEE Transactions on Information Forensics and Security

Volumn 6, Issue 1, 2011, Pages 213-226

  Esmaeili, Mani Malek ^a   Fatourechi, Mehrdad ^a   Ward, Rabab Kreidieh ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Content based fingerprinting; multimedia duplicate detection; multimedia fingerprinting; robust video hashing; video copy detection; video copy retrieval

Indexed keywords

CONTENT-BASED; DUPLICATE DETECTION; MULTIMEDIA FINGERPRINTING; ROBUST VIDEO HASHING; VIDEO COPY DETECTION; VIDEO COPY RETRIEVAL;

COPYRIGHTS; DATABASE SYSTEMS; DIGITAL WATERMARKING; IMAGE SEGMENTATION; LEARNING ALGORITHMS; NETWORK SECURITY; VIDEO RECORDING;

IMAGE MATCHING;

EID: 79951829500     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2010.2097593     Document Type: Article

References (36)

1. J. Oostveen, T. Kalker, and J. Haitsma, "Feature extraction and a database strategy for video fingerprinting," in Proc. Int. Conf. Recent Advances in Visual Information Systems (VISUAL), London, U.K., 2002, pp. 117-128, Springer-Verlag.
2. J. Lu, "Video fingerprinting for copy identification: From research to industry applications," E. J. Delp, J. Dittmann, N. D. Memon, and P. W. Wong, Eds., SPIE vol. 7254, no. 1,2009, p. 725402 [Online]. Available: http://link.aip.org/link/?PSI/7254/725402/1
3. J. Law-To, L. Chen, A. Joly, I. Laptev, O. Buisson, V. Gouet-Brunet, N. Boujemaa, and F. Stentiford, "Video copy detection: A comparative study," in Proc. ACM Int. Conf. Image and Video Retrieval, New York, NY, 2007, pp. 371-378, ACM.
4. A. Hampapur and R. M. Bolle, Videogrep: Video copy detection using inverted file indices IBM Research Division Thomas. J. Watson Research Center, Tech. Rep., 2001.
5. L. Chen and F. W. M. Stentiford, "Video sequence matching based on temporal ordinal measurement," Pattern Recogn. Lett., vol. 29, no. 13, pp. 1824-1831, 2008.
6. R. Radhakrishnan and C. Bauer, "Content-based video signatures based on projections of difference images," in Proc. MMSP, Oct. 2007, pp. 341-344.
7. C. De Roover, C. De Vleeschouwer, F. Lefebvre, and B. Macq, "Robust video hashing based on radial projections of key frames," IEEE Trans. Signal Process., vol. 53, no. 10, pp. 4020-4037, Oct. 2005. (Pubitemid 41638251)
8. S. Lee and C. Yoo, "Robust video fingerprinting for content-based video identification," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 7, pp. 983-988, Jul. 2008.
9. X. Su, T. Huang, and W. Gao, "Robust video fingerprinting based on visual attention regions," in Proc. ICASSP, Washington, DC, 2009, pp. 1525-1528, IEEE Computer Society.
10. A. Joly, O. Buisson, and C. Frelicot, "Content-based copy retrieval using distortion-based probabilistic similarity search," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 293-306, Feb. 2007.
11. J. Sivic and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Computer Vision (ICCV), Washington, DC, 2003, p. 1470, IEEE Computer Society.
12. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. Eur. Conf. Computer Vision (ECCV), Berlin, Heidelberg, Germany, 2008, pp. 304-317, Springer-Verlag.
13. A. Gionis, P. Indyk, and R. Motwani, "Similarity search in high dimensions via hashing," in Proc. Int. Conf. Very Large Data Bases (VLDB), San Francisco, CA, 1999, pp. 518-529, Morgan Kaufmann Publishers Inc.
14. Z. Liu, B. Shahraray, and T. Liu, AT&T research at TRECVID 2009 content-based copy detection [Online]. Available: http://www-nlpir. nist.gov/projects/tvpubs/tv.pubs.org.html#2009
15. M. Hritier, V. Gupta, L. Gagnon, G. Boulianne, S. Foucher, and P. Cardinal, CRIMs content-based copy detection system for TRECVID [Online]. Available: http://www-nlpir.nist.gov/projects/tvpubs/tv. pubs.org.html#2009
16. A. Natsev, M. Hill, J. R. Smith, L. Xie, R. Yan, S. Bao, D. Wang, M. Merler, and Y. Zhang, IBM research TRECVID-2009 video retrieval system [Online]. Available: http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html#2009
17. U. Cao, Y.-D. Zhang, B.-L. Feng, L. Bao, L. Pang, J.-T. Li, K. Gao, X. Wu, H.-T. Xie, W. Zhang, and Z.-D. Mao, TRECVID 2009 of MCGICT-CAS [Online]. Available: http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html#2009
18. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
19. Personal Communication With Prof. David Lowe Aug. 2010.
20. B. Coskun, B. Sankur, and N. Memon, "Spatiotemporal transform based video hashing," IEEE Trans. Multimedia, vol. 8, no. 6, pp. 1190-1208, Dec. 2006. (Pubitemid 44955684)
21. R. Radhakrishnan and C. Bauer, "Robust video fingerprints based on subspace embedding," in Proc. ICASSP, Apr. 2008, pp. 2245-2248.
22. G. Willems, T. Tuytelaars, and L. Van Gool, "Spatio-temporal features for robust content-based video copy detection," in Proc. ACM Int. Conf. Multimedia Information Retrieval, New York, NY, 2008, pp. 283-290, ACM.
23. A. Joly, O. Buisson, and C. Frelicot, "Content-based copy retrieval using distortion-based probabilistic similarity search," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 293-306, Feb. 2007.
24. C. Kim and B. Vasudev, "Spatiotemporal sequence matching for efficient video copy detection," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 1, pp. 127-132, Jan. 2005. (Pubitemid 40135885)
25. M. Malekesmaeili, M. Fatourechi, and R. K. Ward, "Video copy detection using temporally informative representative images," in Proc. Int. Conf. Machine Learning and Applications, Dec. 2009, pp. 69-74.
26. M. Malekesmaeili and R. K. Ward, "Robust video hashing based on temporally informative representative images," in Proc. IEEEInt. Conf. Consumer Electronics, Jan. 2010, pp. 179-180.
27. A. Swaminathan, Y. Mao, and M. Wu, "Robust and secure image hashing," IEEE Trans. Inf. Forensics Security, vol. 1, no. 2, pp. 215-230, Jun. 2006. (Pubitemid 43824632)
28. A. L. Varna and M. Wu, "Modeling and analysis of content identification," in Proc. ICME, 2009, pp. 1528-1531.
29. B. Coskun and N. Memon, "Confusion/diffusion capabilities of some robust hash functions," in Proc. Conf. Information Sciences and Systems (CISS), 2006, pp. 1188-1193.
30. Video Traces Research Group Arizona State University [Online]. Available: http://trace.eas.asu.edu/index.html
31. M. Muja and D. G. Lowe, "Fast approximate nearest neighbors with automatic algorithm configuration," in Proc. Int. Conf. Computer Vision Theory and Applications, 2009, pp. 331-340.
32. J. A. Haitsma, A. A. C. M. Kalker, C. P. M. J. Baggen, and J. C. Oostveen, Generating and matching hashes of multimedia content US 2002/0178410, Nov. 2002.
33. M. L. Miller, "Audio fingerprinting: Nearest neighbour search in high dimensional binary spaces," in IEEE Workshop on 2002, Multimedia Signal Processing, 2002, 2002, pp. 182-185.
34. B. Coskun and N. Memon, "Online sketching of network flows for realtime stepping-stone detection," in Proc. Annual Computer Security Applications Conf., Los Alamitos, CA, 2009, pp. 473-483, IEEE Computer Society.
35. Reef Vid: A Resource of Free Coral Reef Video Clips for Educational Use [Online]. Available: http://www.reefvid.org
36. C. van Rijsbergen, Information Retrieval. London, U.K.: Butterworth, 1979.