Stochastic Multiview Hashing for Large-Scale Near-Duplicate Video Retrieval

IEEE Transactions on Multimedia

Volumn 19, Issue 1, 2017, Pages 1-14

  Hao, Yanbin ^a   Mu, Tingting ^b   Hong, Richang ^a   Wang, Meng ^a   An, Ning ^a   Goulermas, John Y ^c  

^a HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

^c UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

Divergence; hashing; multiview learning; near duplicate video retrieval (NDVR); semi supervised learning

Indexed keywords

COPYRIGHTS; EFFICIENCY; ONLINE SYSTEMS; STOCHASTIC SYSTEMS; SUPERVISED LEARNING;

DIVERGENCE; HASHING; MULTI-VIEW LEARNING; NEAR-DUPLICATE VIDEOS; SEMI- SUPERVISED LEARNING;

HASH FUNCTIONS;

EID: 85007448680     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2016.2610324     Document Type: Article

References (64)

1. X. Wu, A. G. Hauptmann, and C.-W. Ngo, "Practical elimination of nearduplicates from web video search, " in Proc. 15th ACM Int. Conf. Multimedia, 2007, pp. 218-227.
2. J. Song, Y. Yang, Z. Huang, H. T. Shen, and R. Hong, "Multiple feature hashing for real-time large scale near-duplicate video retrieval, " in Proc. 19th ACM Int. Conf. Multimedia, 2011, pp. 423-432.
3. M. Cherubini, R. De Oliveira, and N. Oliver, "Understanding nearduplicate videos: A user-centric approach, " in Proc. 17th ACM Int. Conf. Multimedia, 2009, pp. 35-44.
4. H. T. Shen, X. Zhou, Z. Huang, J. Shao, and X. Zhou, "UQLIPS: A realtime near-duplicate video clip detection system, " in Proc. 33rd Int. Conf. Very Large Data Bases, 2007, pp. 1374-1377.
5. H.-K. Tan, C.-W. Ngo, R. Hong, and T.-S. Chua, "Scalable detection of partial near-duplicate videos by visual-temporal consistency, " in Proc. 17th ACM Int. Conf. Multimedia, 2009, pp. 145-154.
6. J. Liu et al., "Near-duplicate video retrieval: Current research and future trends, " ACM Comput. Surv., vol. 45, no. 4, 2013, Art. no. 44.
7. J. Song, Y. Yang, Z. Huang, H. T. Shen, and J. Luo, "Effective multiple feature hashing for large-scale near-duplicate video retrieval, " IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1997-2008, Dec. 2013.
8. L. Shang, L. Yang, F. Wang, K.-P. Chan, and X.-S. Hua, "Real-time large scale near-duplicate web video retrieval, " in Proc. 18th ACM Int. Conf. Multimedia, 2010, pp. 531-540.
9. C.-W. Ngo, W.-L. Zhao, and Y.-G. Jiang, "Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation, " in Proc. 14th ACM Int. Conf. Multimedia, 2006, pp. 845-854.
10. X. Wu, C.-W. Ngo, A. G. Hauptmann, and H.-K. Tan, "Real-time nearduplicate elimination for web video search with content and context, " IEEE Trans. Multimedia, vol. 11, no. 2, pp. 196-207, Feb. 2009.
11. A. Hampapur, K. Hyun, and R.M. Bolle, "Comparison of sequencematching techniques for video copy detection, " in Proc. Conf. Storage Retrieval Media Databases, 2002, pp. 194-201.
12. J. Law-To et al., "Video copy detection: A comparative study, " in Proc. 6th ACM Int. Conf. Image Video Retrieval, 2007, pp. 371-378.
13. M. Douze, H. J�gou, C. Schmid, and P. P�rez, "Compact video description for copy detection with precise temporal alignment, " in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 522-535.
14. X. Liu, L. Huang, C. Deng, J. Lu, and B. Lang, "multiviewcomplementary hash tables for nearest neighbor search, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1107-1115.
15. X. Shen, F. Shen, Q. Sun, and Y. Yuan, "multiview latent hashing for efficient multimedia search, " in Proc. 23rd ACM Int. Conf. Multimedia, 2015, pp. 831-834.
16. L. Cao, X. Liu, W. Liu, R. Jia, and T. Huang, "Localizing web videos using social images, " Inf. Sci., vol. 302, pp. 122-131, 2015.
17. X. Nie, Y. Yin, and J. Sun, "Comprehensive feature-based robust video fingerprinting using tensor model, " CoRR, 2016. [Online]. Available: http://arxiv.org/abs/1601.07270
18. J. Chen, Y. He, and J. Wang, "Multi-feature fusion based fast video flame detection, " Build. Environ., vol. 45, no. 5, pp. 1113-1122, 2010.
19. J. Xu, V. Jagadeesh, and B. Manjunath, "Multi-label learning with fused multimodal bi-relational graph, " IEEE Trans. Multimedia, vol. 16, no. 2, pp. 403-412, Feb. 2014.
20. J. Song, Y. Yang, Y. Yang, Z. Huang, and H. T. Shen, "Inter-media hashing for large-scale retrieval from heterogeneous data sources, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2013, pp. 785-796.
21. M. M. Bronstein, A. M. Bronstein, F. Michel, and N. Paragios, "Data fusion through cross-modality metric learning using similarity-sensitive hashing, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 3594-3601.
22. V. Ranjan, N. Rasiwasia, and C. V. Jawahar, "Multi-label crossmodal retrieval, " in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2015, pp. 4094-4102.
23. S. Sun, "A survey of multiview machine learning, " Neural Comput. Appl., vol. 23, nos. 7/8, pp. 2031-2038, 2013.
24. X. Zhou et al., "An efficient near-duplicate video shot detection method using shot-based interest points, " IEEE Trans. Multimedia, vol. 11, no. 5, pp. 879-891, Aug. 2009.
25. C.-L. Chou, H.-T. Chen, and S.-Y. Lee, "Pattern-based near-duplicate video retrieval and localization on web-scale videos, " IEEE Trans. Multimedia, vol. 17, no. 3, pp. 382-395, Mar. 2015.
26. J. Yuan, L.-Y. Duan, Q. Tian, S. Ranganath, and C. Xu, "Fast and robust short video clip search for copy detection, " in Proc. Adv. Multimedia Inf. Process. Conf., 2005, pp. 479-488.
27. X. -S. Hua, X. Chen, and H. -J. Zhang, "Robust video signature based on ordinal measure, " in Proc. Int. Conf. Image Process., 2004, pp. 685-688.
28. D.-G. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
29. D.-G. Lowe, "Object recognition from local scale-invariant features, " in Proc. Int. Conf. Comput. Vis., 1999, pp. 1150-1157.
30. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Jun.-Jul. 2004, pp. 506-513.
31. G. Zhao and M. Pietikainen, "Dynamic texture recognition using local binary patterns with an application to facial expressions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 915-928, Jun. 2007.
32. J. Law-To, V. Gouet-Branet, O. Buisson, and N. Boujemaa, "Local behaviours labelling for content based video copy detection, " in Proc. Int. Conf. Pattern Recog., 2006, pp. 232-235.
33. C.-W. Ngo, W. -L. Zhao, and Y.-G. Jiang, "Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation, " in Proc. 14th ACM Int. Conf. Multimedia, 2006, pp. 845-854.
34. J. B. Tenenbaum, V. De Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction, " Science, vol. 290, no. 5500, pp. 2319-2323, 2000.
35. H. Hotelling, "Analysis of a complex of statistical variables into principal components, " J. Educ. Psychol., vol. 24, no. 6, pp. 417-441, 1933.
36. W. S. Torgerson, "Multidimensional scaling: I. Theory and method, " Psychometrika, vol. 17, no. 4, pp. 401-419, 1952.
37. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding, " Science, vol. 290, no. 5500, pp. 2323-2326, 2000.
38. G. E. Hinton and S. T. Roweis, "Stochastic neighbor embedding, " in Proc. Adv. Neural Inf. Process. Syst. Conf., 2002, pp. 833-840.
39. L. Van der Maaten and G. Hinton, "Visualizing data using t-SNE, " J. Mach. Learn. Res., vol. 9, no. 2579-2605, p. 85, 2008.
40. J. Venna, J. Peltonen, K. Nybo, H. Aidos, and S. Kaski, "Information retrieval perspective to nonlinear dimensionality reduction for data visualization, " J. Mach. Learn. Res., vol. 11, pp. 451-490, 2010.
41. J. Wang, H. T. Shen, J. Song, and J. Ji, "Hashing for similarity search: A survey, " CoRR, 2014. [Online]. Available: http://arxiv.org/abs/ 1408.2927
42. A. Gionis et al., "Similarity search in high dimensions via hashing, " in Proc. 25th Int. Conf. Very Large Data Bases, 1999, pp. 518-529.
43. Y. Ke, R. Sukthankar, L. Huston, Y. Ke, and R. Sukthankar, "Efficient near-duplicate detection and sub-image retrieval, " in Proc. ACM Int. Conf. Multimedia, 2004, pp. 869-876.
44. W. Dong, Z. Wang, M. Charikar, and K. Li, "Efficiently matching sets of features with random histograms, " in Proc. 16th ACM Int. Conf. Multimedia, 2008, pp. 179-188.
45. J. Song, L. Gao, Y. Yan, D. Zhang, and N. Sebe, "Supervised hashing with pseudo labels for scalable multimedia retrieval, " in Proc. 23rd ACM Int. Conf. Multimedia, 2015, pp. 827-830.
46. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing, " in Proc. Adv. Neural Inf. Process. Syst. Conf., 2009, pp. 1753-1760.
47. D. Zhang, J. Wang, D. Cai, and J. Lu, "Self-taught hashing for fast similarity search, " in Proc. 33rd Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2010, pp. 18-25.
48. R. Salakhutdinov and G. E. Hinton, "Learning a nonlinear embedding by preserving class neighbourhood structure, " in Proc. 11th Int. Conf. Artif. Intell. Statist., 2007, pp. 412-419.
49. W. Liu, J. Wang, R. Ji, Y.-G. Jiang, and S.-F. Chang, "Supervised hashing with kernels, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2074-2081.
50. L. Gao, J. Song, F. Zou, D. Zhang, and J. Shao, "Scalable multimedia retrieval by deep learning hashing with relative similarity learning, " in Proc. 23rd ACM Int. Conf. Multimedia, 2015, pp. 903-906.
51. J. Wang, T. Zhang, J. Song, N. Sebe, and H. T. Shen, "A survey on learning to hash, " CoRR, 2016. [Online]. Available: http://arxiv.org/ abs/1606.00185
52. C. G. Snoek, M. Worring, and A.W. Smeulders, "Early versus late fusion in semantic video analysis, " in Proc. 13th Annu. ACMInt. Conf.Multimedia, 2005, pp. 399-402.
53. M. Wang et al., "Unified video annotation via multigraph learning, " IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-746, May 2009.
54. Y. Yang et al., "Multi-feature fusion via hierarchical regression for multimedia analysis, " IEEE Trans. Multimedia, vol. 15, no. 3, pp. 572-581, Apr. 2013.
55. J. Yang, J.-Y. Yang, D. Zhang, and J.-F. Lu, "Feature fusion: parallel strategy vs. serial strategy, " Pattern Recog., vol. 36, no. 6, pp. 1369-1381, 2003.
56. Y. Fu, L. Cao, G. Guo, and T. S. Huang, "Multiple feature fusion by subspace learning, " in Proc. Int. Conf. Content-Based Image Video Retrieval, 2008, pp. 127-134.
57. B. Cui, A. K. Tung, C. Zhang, and Z. Zhao, "Multiple feature fusion for social media applications, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2010, pp. 435-446.
58. X. Yang, T. Zhang, and C. Xu, "Cross-domain feature learning in multimedia, " IEEE Trans. Multimedia, vol. 17, no. 1, pp. 64-78, Jan. 2015.
59. Y. Hu, Z. Jin, H. Ren, D. Cai, and X. He, "Iterative multiview hashing for cross media indexing, " in Proc. 22nd ACM Int. Conf. Multimedia, 2014, pp. 527-536.
60. F. Zou et al., "Compact image fingerprint via multiple kernel hashing, " IEEE Trans. Multimedia, vol. 17, no. 7, pp. 1006-1018, Jul. 2015.
61. L. Gao et al., "Optimal graph learning with partial tags and multiple features for image and video annotation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2015, pp. 4371-4379.
62. X. Zhu, Z. Huang, H. T. Shen, and X. Zhao, "Linear cross-modal hashing for efficient multimedia search, " in Proc. 21st ACM Int. Conf.Multimedia, 2013, pp. 143-152.
63. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation, " Neural Netw., vol. 1, no. 4, pp. 295-307, 1988.
64. X. Gao, T. Mu, and M. Wang, "Local voting based multiview embedding, " Neurocomputing, vol. 171, pp. 901-909, 2016.