Bimodal fusion of low-level visual features and high-level semantic features for near-duplicate video clip detection

Signal Processing: Image Communication

Volumn 26, Issue 10, 2011, Pages 612-627

  Min, Hyun Seok ^a   Choi, Jae Young ^a   De Neve, Wesley ^a   Ro, Yong Man ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

NDVC detection; Near duplicates; Semantic features; Video copy detection; Video signatures

Indexed keywords

NDVC DETECTION; NEAR-DUPLICATES; SEMANTIC FEATURES; VIDEO COPY DETECTION; VIDEO SIGNATURES;

COMPUTATIONAL COMPLEXITY; IMAGE RETRIEVAL; MOTION PICTURE EXPERTS GROUP STANDARDS; SEMANTICS; VIDEO CAMERAS; VIDEO RECORDING;

DETECTORS;

EID: 80055082808     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2011.04.001     Document Type: Article

References (53)

1. R.D. Oliveira, M. Cherubini, and N. Oliver Looking at near-duplicate videos from a human-centric perspective ACM Transactions on Multimedia Computing, Communications, and Applications 6 3 2010
2. X. Wu, C.-W. Ngo, A. Hauptmann, and H.-K. Tan Real-time near-duplicate elimination for web-video search with content and context IEEE Transactions on Multimedia 11 2 2009 196 207
3. A. Joly, O. Buisson, and C. Frelicot Content-based copy retrieval using distortion-based probabilistic similarity search IEEE Transactions on Multimedia 9 2 2007 293 306
4. C. Chih-Yi, C. Chu-Song, and C. Lee-Feng A framework for handling spatiotemporal variations in video copy detection IEEE Transactions on Circuits and Systems for Video Technology 18 3 2008 412 417
5. M. Bober, P. Brasnett, S. Paschalakis, Recent developments on standardisation of MPEG-7 Visual Signature Tools, in: Proceedings of the IEEE International Conference on Multimedia & Expo, 2010, pp. 13471352.
6. X.S. Hua, X. Chen, H.J. Zhang, Robust video signature based on ordinal measure, in: Proceedings of ICIP, 2004, pp. 685688. (Pubitemid 40821013)
7. C. Kim, and B. Vasudev Spatiotemporal sequence matching for efficient video copy detection IEEE Transactions on Circuits and Systems for Video Technology 15 1 2005 127 131
8. C. Cotsaces, N. Nikolaidis, and I. Pitas Semantic video fingerprinting and retrieval using face information Signal Processing: Image Communication 24 7 2009 598 613
9. J. Law-To, L. Chen, A. Joly, I. Laptev, O. Buisson, V. Gouet-Brunet, N. Boujemaa, F. Stentiford, Video copy detection: a comparative study, in: Proceedings of ACM CIVR, 2007, pp. 371378. (Pubitemid 350229648)
10. G. Carneiro, A.B. Chan, P.J. Moreno, and N. Vasconcelos Supervised learning of semantic classes for image annotation and retrieval IEEE Transactions on Pattern Analysis and Machine Intelligence 29 3 2007 394 410 (Pubitemid 46336416)
11. O. Chapelle, P. Haffner, and V.N. Vapnik Support vector machines for histogram-based image classification IEEE Transactions on Neural Networks 10 5 1999 1055 1064
12. A. Hauptmann, R. Yan, W.-H. Lin, M. Christel, and H. Wactlar Can high-level concepts fill the semantic gap in video retrieval? A case study with broadcast news IEEE Transactions on Multimedia 9 5 2007 958 966 (Pubitemid 47171252)
13. C.G.M. Snoek, and A.W.M. Smeulders Visual-concept search solved? IEEE Computer 43 6 2010 76 78
14. J. Yang, A.G. Hauptmann, (Un)Reliability of video concept detection, in: Proceedings of the International Conference on Content-based Image and Video Retrieval, 2008, pp. 8594.
15. P. Over, W. Kraaij, A.F. Smeaton, TRECVID 2008 - an overview, in: Proceedings of the TRECVID 2008, NIST, USA, 2008.
16. J. Law-To, A. Joly, N. Boujemaa, MUSCLE-VCD-2007: a live benchmark for video copy detection, 2007, available on 〈 http://www-rocq.inria.fr/imedia/ cive-bench 〉.
17. H.S. Min, J.Y. Choi, W. De Neve, Y.M. Ro, Near-duplicate video detection using temporal patterns of semantic concepts, in: Proceedings of the IEEE International Symposium on Multimedia, 2009, pp. 18.
18. H.S. Min, W. De Neve, Y.M. Ro, Towards using semantic features for near-duplicate video detection, in: Proceedings of the IEEE International Conference on Multimedia & Expo, 2010, pp. 13641369.
19. A. Basharat, Y. Zhai, and M. Shan Content based video matching using spatiotemporal volumes Journal of Computer Video and Image Understanding 110 3 2008 360 377
20. O. Chum, J. Philbin, A. Zisserman, Near duplicate image detection: min-hash and tf-idf weighting, in: Proceedings of the British Machine Vision Conference, 2008, pp. 7380.
21. S. Poullot, M. Crucianu, O. Buisson, Scalable mining of large video databases using copy detection, in: Proceedings of the ACM International Conference on Multimedia, 2008, pp. 6170.
22. M.-C. Yeh, K.-T. Cheng, A compact, effective descriptor for video copy detection, in: Proceedings of the ACM International Conference on Multimedia, 2009, pp. 633636.
23. L. Chen, and F.W.M. Stentiford Video sequence matching based on temporal ordinal measurement Pattern Recognition Letters 29 13 2008 1824 1831
24. T.C. Hoad, and J. Zobel Detection of video sequences using compact signatures ACM Transactions on Information Systems 24 1 2006 1 50
25. G. Leon, H. Kalva, B. Furht, Video identification using video tomography, in: Proceedings of the IEEE International Conference on Multimedia & Expo, 2008, pp. 10301033.
26. P.-H. Wu, T. Thaipanich, C. J. Kuo, Detecting duplicate video based on camera transitional behavior, in: Proceedings of the ICIP, 2009, pp. 237240.
27. W.L. Zhao, C.W. Ngo, H.K. Tan, and X. Wu Near-duplicate keyframe identification with interest point matching and pattern learning IEEE Transactions on Multimedia 9 5 2007 1037 1048 (Pubitemid 47171260)
28. X. Wu, A. G. Hauptmann, C.-W. Ngo, Practical elimination of near-duplicates from web video search, in: Proceedings of the the ACM International Conference on Multimedia, 2007, pp. 218227.
29. J. Zhu, C.H. Steven, R. Michael, S. Yan, Near-duplicate keyframe retrieval by nonrigid image matching, in: Proceedings of the ACM International Conference on Multimedia, 2008, pp. 4150.
30. J. Law-To, G.-B. Valerie, B. Olivier, B. Nozha, Local behaviours labelling for content based video copy detection, in: Proceedings of the ICPR, 2006, pp. 232235. (Pubitemid 46553105)
31. X. Zhou, Lei Chen, A. Bouguettaya, N. Xiao, and J.A. Taylor An efficient near-duplicate video shot detection method using shot-based interest points IEEE Transactions on Multimedia 11 5 2009 879 891
32. O. Küçüktunç, M. Batan, U. Güdükbay, and Ö. Ulusoy Video copy detection using multiple visual cues and MPEG-7 descriptors Journal of Visual Communication and Image Representation 21 8 2010 838 849
33. M.-C. Yeh, K.-T. Cheng, Video copy detection by fast sequence matching, in: Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR), 2009, pp. 17.
34. S. Poullot, O. Buisson, and M. Crucianu Scaling content-based copy detection to very large databases Multimedia Tools and Applications 47 2 2010 279 306
35. X. Wu, W.-L. Zhao, C.-W. Ngo, Near-duplicate keyframe retrieval with visual keywords and semantic context, in: Proceedings of the ACM International Conference on Image and Video Retrieval, July 2007, pp. 162169. (Pubitemid 350229623)
36. W. Meng, H. Xian-Sheng, H. Richang, T. Jinhui, Q. Guo-Jun, and S. Yan Unified video annotation via multigraph learning IEEE Transactions on Circuits and Systems for Video Technology 19 5 2009 733 746
37. S. Yang, S.K. Kim, and Y.M. Ro Semantic home photo categorization IEEE Transactions on Circuits and Systems for Video Technology 17 3 2007 324 335 (Pubitemid 46393330)
38. X. Anguera, P. Obrador, T. Adamek, D. Marimon, N. Oliver, Telefonica research content-based copy detection TRECVID submission, in: Proceedings of the NIST TRECVID 2009 Workshop, Notebook Paper, 2009.
39. E.-J. Hah, P. Schmutz, A.N. Tuch, D. Agotai, M. Wiedmer, and K. Opwis Cinematographic techniques in architectural animations and their effects on viewers' judgment International Journal of Design 2 3 2008 29 41
40. C. Petersohn, Fraunhofer HHI at TRECVID 2004: shot boundary detection system, in: TREC Video Retrieval Evaluation Online Proceedings, 2004.
41. Guidelines for the TRECVID 2008 Evaluation. Available on: 〈 http://www-nlpir.nist.gov/projects/tv2008/tv2008.html 〉.
42. T. Sikora The MPEG-7 visual standard for content description - an overview IEEE Transactions on Circuits and Systems for Video Technology 11 6 2001 696 702 (Pubitemid 32616531)
43. B.S. Manjunath, J.-R. Ohm, V.V. Vasudevan, and A. Yamada Color and texture descriptors IEEE Transactions on Circuits and Systems for Video Technology 11 6 2001 703 715 (Pubitemid 32616532)
44. MPEG-7 XM software. Available on: 〈 http://www.lis.ei.tum.de/ research/bv/topics/mmdb/empeg7.html 〉.
45. Video Structure Detection - Temporal Video Segmentation. Available on: 〈 http://www.hhi.fraunhofer.de/en/departments/interactive-media-human- factors/overview/video-structure-detection/ 〉.
46. Description of the MUSCLE-VCD-2007 video database. Available on: 〈 http://www-rocq.inria.fr/imedia/civr-bench/VideoDatabase.html 〉.
47. W. Kraaij, P. Over, J. Fiscus, A. Joly, Final CBCD evaluation plan TRECVID 2008 (v1.3), June 2008.
48. Final list of video transformation. Available on: 〈 http://www-nlpir.nist.gov/projects/tv2008/final.cbcd.video.transformations.pdf 〉.
49. CBCD Evaluation Plan TRECVID 2010, 2010. Available on: 〈 http://www-nlpir.nist.gov/projects/tv2010/Evaluation-cbcd-v1.3.htm#eval 〉.
50. K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf An introduction to kernel-based learning algorithms IEEE Transactions on Neural Networks 12 2 2001 181 201 (Pubitemid 32371478)
51. W.-L. Zhao, X. Wu, and C.-W. Ngo On the annotation of web videos by efficient near-duplicate search IEEE Transactions on Multimedia 12 5 2010 448 461
52. J. Willcock, A. Lumsdaine, Accelerating sparse matrix computations via data compression, in: Proceedings of the International Conference on Supercomputing, 2006, pp. 307316. (Pubitemid 47168517)
53. J.R. Gilbert, C. Moler, and R. Schreiber Sparse matrices in MATLAB: design and implementation SIAM Journal on Matrix Analysis and Applications 13 1 1992 333 356