A Segmentation and graph-based video sequence matching method for video copy detection

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 8, 2013, Pages 1706-1718

  Liu, Hong ^a   Lu, Hong ^a   Xue, Xiangyang ^a  

^a FUDAN UNIVERSITY   (China)

Author keywords

Dual threshold method; Graph; Graph based matching; SIFT feature; SVD; Video copy detection

Indexed keywords

DUAL-THRESHOLD METHOD; GRAPH; GRAPH-BASED; SIFT FEATURE; VIDEO COPY DETECTION;

GRAPHIC METHODS; SINGULAR VALUE DECOMPOSITION;

VIDEO RECORDING;

EID: 84897723392     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.92     Document Type: Article

References (53)

1. X. Wu, C.-W. Ngo, A. Hauptmann, and H.-K. Tan, "Real-Time Near-Duplicate Elimination for Web Video Search with Content and Context," IEEE Trans. Multimedia, vol. 11, no. 2, pp. 196-207, Feb. 2009.
2. A. Hampapur and R. Bolle, "Comparison of Distance Measures for Video Copy Detection," Proc. IEEE Int'l Conf. Multimedia and Expo (ICME), pp. 188-192, 2001.
3. TRECVID 2008 Final List of Transformations, http://www-nlpir. nist.gov/projects/tv2008/active/copy.detection/final.cbcd. video. transformations.pdf, 2008.
4. Final CBCD Evaluation Plan TRECVID 2008 (v1.3), http://www-nlpir.nist. gov/projects/tv2008/Evaluation-cbcd-v1.3.htm, 2008.
5. O. Kucuktunc, M. Bastan, U. Gudukbay, and O. Ulusoy, "Video Copy Detection Using Multiple Visual Cues and MPEG-7 Descriptors," J. Visual Comm. Image Representation, vol. 21, pp. 838-849, 2010.
6. M. Douze, H. Jégou, and C. Schmid, "An Image-Based Approach to Video Copy Detection with Spatio-Temporal Post-Filtering," IEEE Trans. Multimedia, vol. 12, no. 4, pp. 257-266, June 2010.
7. M. Douze, A. Gaidon, H. Jegou, M. Marszalek, and C. Schmid, TREC Video Retrieval Evaluation Notebook Papers and Slides: INRIALEAR's Video Copy Detection System, http://www-nlpir.nist.gov/projects/tvpubs/tv8.papers/inria- lear.pdf, 2008.
8. J. Law-To, C. Li, and A. Joly, "Video Copy Detection: A Comparative Study," Proc. ACM Int'l Conf. Image and Video Retrieval, pp. 371-378, July 2007. (Pubitemid 350229648)
9. A. Hampapur, K. Hyun, and R. Bolle, "Comparison of Sequence Matching Techniques for Video Copy Detection," Proc. SPIE, Storage and Retrieval for Media Databases, vol. 4676, pp. 194-201, Jan. 2002. (Pubitemid 35229764)
10. J. Yuan, L.-Y. Duan, Q. Tian, S. Ranganath, and C. Xu, "Fast and Robust Short Video Clip Search for Copy Detection," Proc. Pacific Rim Conf. Multimedia (PCM), 2004.
11. C. Kim and B. Vasudev, "Spatiotemporal Sequence Matching for Efficient Video Copy Detection," IEEE Trans. Circuits and Systems for Video Technology, vol. 15, no. 1, pp. 127-132, Jan. 2005. (Pubitemid 40135885)
12. L. Chen and F.W.M. Stentiford, "Video Sequence Matching Based on Temporal Ordinal Measurement," Pattern Recognition Letters, vol. 29, no. 13, pp. 1824-1831, Oct. 2008.
13. H.T. Shen, X. Zhou, Z. Huang, J. Shao, and X. Zhou, "Uqlips: A Real-Time Near-Duplicate Video Clip Detection System," Proc. 33rd Int'l Conf. Very Large Data Bases (VLDB), pp. 1374-1377, 2007.
14. R. Cheng, Z. Huang, H.T. Shen, and X. Zhou, "Interactive Near-Duplicate Video Retrieval and Detection," Proc. ACM Int'l Conf. Multimedia, pp. 1001-1002, 2009.
15. Z. Huang, H.T. Shen, J. Shao, B. Cui, and X. Zhou, "Practical Online Near-Duplicate Subsequence Detection for Continuous Video Streams," IEEE Trans. Multimedia, vol. 12, no. 5, pp. 386-397, Aug. 2010.
16. I. Laptev and T. Lindeberg, "Space-Time Interest Points," Proc. Int'l Conf. Computer Vision, pp. 432-439, 2003.
17. G. Willems, T. Tuytelaars, and L.V. Gool, "Spatio-Temporal Features for Robust Content-Based Video Copy Detection," Proc. ACM Int'l Conf. Multimedia Information Retrieval (MIR), pp. 283-290, 2008.
18. Y. Ke, R. Sukthankar, and L. Huston, "Efficient Near-Duplicate Detection and Sub-Image Retrieval," Proc. Ann. ACM Int'l Conf. Multimedia, pp. 869-876, 2004. (Pubitemid 40211882)
19. J. Law-To, O. Buisson, V. Gouet-Brunet, and N. Boujemaa, "Robust Voting Algorithm Based on Labels of Behavior for Video Copy Detection," Proc. ACM Int'l Conf. Multimedia, pp. 835-844, 2006. (Pubitemid 47113643)
20. A. Joly, O. Buisson, and C. Frelicot, "Content-Based Copy Retrieval Using Distortion-Based Probabilistic Similarity Search," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 293-306, Feb. 2007.
21. C. Harris and M. Stephens, "A Combined Corner and Edge Detector," Proc. Fourth Alvey Vision Conf., pp. 147-151, 1988.
22. S. Satoh, M. Takimoto, and J. Adachi, "Scene Duplicate Detection from Videos Based on Trajectories of Feature Points," Proc. ACM Int'l Workshop Workshop Multimedia Information Retrieval, Sept. 2007.
23. X. Zhou, X. Zhou, L. Chen, A. Bouguettaya, N. Xiao, and J.A. Taylor, "An Efficient Near-Duplicate Video Shot Detection Method Using Shot-Based Interest Points," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 879-891, Aug. 2009.
24. K. Mikolajczyk and C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, Oct. 2005. (Pubitemid 41555406)
25. H.T. Shen, J. Shao, Z. Huang, and X. Zhou, "Effective and Efficient Query Processing for Video Subsequence Identification," IEEE Trans. Knowledge and Data Eng., vol. 21, no. 3, pp. 321-334, Mar. 2009.
26. H. Liu, H. Lu, and X. Xue, "SVD-SIFT for Web Near-Duplicate Image Detection," Proc. IEEE Int'l Conf. Image Processing (ICIP '10), pp. 1445-1448, 2010.
27. D. Gibbon, "Automatic Generation of Pictorial Transcripts of Video Programs," Multimedia Computing and Networking, vol. 2417, pp. 512-518, 1995.
28. F. Dufaux, "Key Frame Selection to Represent a Video," Proc. IEEE Int'l Conf. Image Processing, vol. 2, pp. 275-278, 2000. (Pubitemid 32465612)
29. K. Sze, K. Lam, and G. Qiu, "A New Key Frame Representation for Video Segment Retrieval," IEEE Trans. Circuits and Systems Video Technology, vol. 15, no. 9, pp. 1148-1155, Sept. 2005. (Pubitemid 41561858)
30. N. Guil, J.M. Gonza'lez-Linares, J.R. Co'zar, and E.L. Zapata, "A Clustering Technique for Video Copy Detection," Proc. Third Iberian Conf. Pattern Recognition and Image Analysis, Part I, pp. 452-458, June 2007.
31. H. Zhang, J. Wu, and S. Smoliar, System for Automatic Video Segmentation and Key Frame Extraction for Video Sequences Having Both Sharp and Gradual Transitions, US Patent 5,635,982, June 1997.
32. H. Lu and Y.-P. Tan, "An Effective Post-Refinement Method for Shot Boundary Detection," IEEE Trans. Circuits and Systems Video Technology, vol. 15, no. 11, pp. 1407-1421, Nov. 2005. (Pubitemid 41640549)
33. O. Kucuktunc, U. Gudukbay, and O. Ulusoya, "Fuzzy Color Histogram-Based Video Segmentation," Computer Vision and Image Understanding, vol. 114, no. 1, pp. 125-134, 2010.
34. B. Furht, S.W. Smoliar, and H.J. Zhang, Video and Image Processing in Multimedia Systems. Kluwer Academic Publisher, 1995.
35. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
36. J. Sivic and A. Zisserman, "Video Google: A Text Retrieval Approach to Object Matching in Videos," Proc. IEEE Int'l Conf. Computer Vision, pp. 1470-1477, 2003.
37. X. Zhou, L. Chen, A. Bouguettaya, Y. Shu, X. Zhou, and J.A. Taylor, "Adaptive Subspace Symbolization for Content-Based Video Detection," IEEE Trans. Knowledge and Data Eng., vol. 22, no. 10, pp. 1372-1387, Oct. 2010.
38. P. Indyk and R. Motwani, "Approximate Nearest Neighbors: Towards Removing the Curse of Dimensionality," Proc. ACM Symp. Theory of Computing, pp. 604-613, 1998.
39. H. Lu, B.C. Ooi, H.T. Shen, and X. Xue, "Hierarchical Indexing Structure for Efficient Similarity Search in Video Retrieval," IEEE Trans. Knowledge and Data Eng., vol. 18, no. 11, pp. 1544-1559, Nov. 2006.
40. V. Klema and A. Laub, "The Singular Value Decomposition: Its Computation and Some Applications," IEEE Trans. Automatic Control, vol. AC-25, no. 2, pp. 164-176, Apr. 1980. (Pubitemid 10475293)
41. Q. Tian, Y. Fainman, and S.H. Lee, "Comparison of Statistical Pattern Recognition Algorithms for Hybrid Processing. II. Eigenvector-Based Algorithms," J. Optical Soc. of Am., vol. 5, no. 10, pp. 1670-1672, 1988.
42. Z. Hong, "Algebraic Feature Extraction of Image Recognition," Pattern Recognition, vol. 24, no. 3, pp. 21l-219, 1991.
43. E. Delponte, F. Isgro, F. Odone, and A. Verri, "SVD-Matching Using Sift Features," Graphical Models, vol. 68, no. 5, pp. 415-431, 2006. (Pubitemid 44648826)
44. D.C. Lay, Linear Algebra and Its Applications. Univ. of Maryland-College Park, 2003.
45. L. Wolf and A. Shashua, "Learning over Sets Using Kernel Principal Angles," J. Machine Learning Research, vol. 4, no. 10, pp. 913-931, 2003.
46. T.-K. Kim, O. Arandjelovic, and R. Cipolla, "Learning over Sets Using Boosted Manifold Principal Angles (BoMPA)," Proc. British Machine Vision Conf., pp. 779-788, 2005.
47. K. Fukui, B. Stenger, and O. Yamaguchi, "A Framework for 3D Object Recognition Using the Kernel Constrained Mutual Subspace Method," Proc. Asian Conf. Computer Vision, pp. 315-324, 2006. (Pubitemid 43849423)
48. T.-K. Kim, J. Kittler, and R. Cipolla, "Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 6, pp. 1005-1018, June 2007. (Pubitemid 46667413)
49. N. Gengembre and S.-A. Berrani, "A Probabilistic Framework for Fusing Frame-Based Searches within a Video Copy Detection System," Proc. ACM Int'l Conf. Image and Video Retrieval, July 2008.
50. A.F. Smeaton, P. Over, and W. Kraaij, "Evaluation Campaigns and TRECVid," Proc. Eighth ACM Int'l Workshop Multimedia Information Retrieval (MIR '06), pp. 321-330, 2006. (Pubitemid 47168230)
51. TREC Video Retrieval Evaluation, http://www-nlpir.nist.gov/projects/t01v/ , 2006.
52. Final CBCD Evaluation Plan TRECVID 2010 (V2), http://www-nlpir.nist.gov/ projects/tv2010/Evaluation-cbcd-v1.3. htm#eval, 2010.
53. H. Jegou, M. Douze, and C. Schmid, "Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search," Proc. European Conf. Computer Vision, 2008.