Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing

IEEE Transactions on Image Processing

Volumn 25, Issue 11, 2016, Pages 5427-5440

  Ding, Guiguang ^a   Guo, Yuchen ^a   Zhou, Jile ^a   Gao, Yue ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

collective matrix factorization; cross modality search; Hashing; multimodal data; optimization; scalability

Indexed keywords

DIGITAL STORAGE; FACTORIZATION; METADATA; OPTIMIZATION; QUERY PROCESSING; SCALABILITY; SEMANTICS;

BINARY REPRESENTATIONS; COLLECTIVE MATRIX FACTORIZATIONS; CROSS MODALITY; EUCLIDEAN STRUCTURE; HASHING; MULTI-MODAL DATA; OPTIMIZATION ALGORITHMS; RESEARCH INTERESTS;

MATRIX ALGEBRA;

EID: 85015290110     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2607421     Document Type: Article

References (56)

1. N. S. Altman, "An introduction to kernel and nearest-neighbor nonparametric regression, " Amer. Statistician, vol. 46, no. 3, pp. 175-185, 1992.
2. U. Von Luxburg, "A tutorial on spectral clustering, " Statist. Comput., vol. 17, no. 4, pp. 395-416, 2007.
3. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples, " J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
4. J. H. Friedman, J. L. Bentley, and R. A. Finkel, "An algorithm for finding best matches in logarithmic expected time, " ACM Trans. Math. Softw., vol. 3, no. 3, pp. 209-226, 1997.
5. A. Gionis, P. Indyk, and R. Motwani, "Similarity search in high dimensions via hashing, " in Proc. VLDB, 1999, pp. 518-529.
6. D. Zhang, J. Wang, D. Cai, and J. Lu, "Self-taught hashing for fast similarity search, " in Proc. 33rd Int. Conf. Res. Develop. Inf. Retr., Jul. 2010, pp. 18-25.
7. J. Wang, T. Zhang, J. Song, N. Sebe, and H. T. Shen, "A survey on learning to hash, " CoRR, vol. Abs/1606. 00185, 2016.
8. H. Jégou, M. Douze, C. Schmid, and P. Pérez, "Aggregating local descriptors into a compact image representation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 3304-3311.
9. K. He, F. Wen, and J. Sun, "K-means hashing: An affinity-preserving quantization method for learning binary compact codes, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013. pp. 2938-2945.
10. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing, " in Proc. 22nd Annu. Conf. Neural Inf. Proc. Syst., 2008, pp. 1753-1760.
11. W. Liu, J. Wang, R. Ji, Y.-G. Jiang, and S.-F. Chang, "Supervised hashing with kernels, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2074-2081.
12. J. Wang, S. Kumar, and S.-F. Chang, "Semi-supervised hashing for scalable image retrieval, " in Proc. 23rd IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 3424-3431.
13. R. Salakhutdinov and G. Hinton, "Semantic hashing, " Int. J. Approx. Reasoning, vol. 50, no. 7, pp. 969-978, Jul. 2009.
14. J. Song, Y. Yang, Y. Yang, Z. Huang, and H. T. Shen, "Inter-media hashing for large-scale retrieval from heterogeneous data sources, " in Proc. Int. Conf. Manage. Data, Jun. 2013, pp. 785-796.
15. D. Zhang and W.-J. Li, "Large-scale supervised multimodal hashing with semantic correlation maximization, " in Proc. 28th Conf. Artif. Intell., Jan. 2014, pp. 2177-2183.
16. F. Wu et al, "Cross-modal learning to rank via latent joint representation, " IEEE Trans. Image Process., vol. 24, no. 5, pp. 1497-1509, May 2015.
17. Y. Wang, F. Wu, J. Song, X. Li, and Y. Zhuang, "Multi-modal mutual topic reinforce modeling for cross-media retrieval, " in Proc. Inter. Conf. Multimedia, 2014, pp. 307-316.
18. S. Kumar and R. Udupa, "Learning hash functions for cross-view similarity search, " in Proc. 22nd Inter. Joint Conf. Artif. Intell., Jul. 2011, pp. 1360-1365.
19. G. H. Golub and C. F. V. Loan, Matrix Computations. Baltimore, MD, USA: The Johns Hopkins Univ. Press, 1996.
20. M. M. Bronstein, A. M. Bronstein, F. Michel, and N. Paragios, "Data fusion through cross-modality metric learning using similarity-sensitive hashing, " in Proc. 23rd IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 3594-3601.
21. Y. Zhen and D.-Y. Yeung, "Co-regularized hashing for multimodal data, " in Proc. 26th Annu. Conf. Neural Inf. Proc. Syst., 2012, pp. 1385-1393.
22. D. Zhang, F. Wang, and L. Si, "Composite hashing with multiple information sources, " in Proc. 34th Int. Conf. Res. Develop. Inform. Retr., 2011, pp. 225-234.
23. X. He and P. Niyogi, "Locality preserving projections, " in Proc. Adv. Neural Inf. Proc. Syst., 2003, pp. 153-160.
24. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 2000.
25. S. Kim, Y. Kang, and S. Choi, "Sequential spectral learning to hash with multiple representations, " in Proc. Eur. Conf. Comput. Vis. (ECCV), Oct. 2012, pp. 538-551.
26. G. W. Furnas et al, "Information retrieval using a singular value decomposition model of latent semantic structure, " in Proc. 11st Annu. Int. ACM SIGKDD Conf. Res. Develop. Inf. Retr., 1988, pp. 465-480.
27. A. P. Singh and G. J. Gordon, "Relational learning via collective matrix factorization, " in Proc. 14th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2008, pp. 650-658.
28. Y. Koren, R. Bell, and C. Volinsky, "Matrix factorization techniques for recommender systems, " IEEE Comput., vol. 42, no. 8, pp. 30-37, Aug. 2009.
29. X. Lu, H. Wu, Y. Yuan, P. Yan, and X. Li, "Manifold regularized sparse NMF for hyperspectral unmixing, " IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2815-2826, May 2013.
30. X. Lu, H. Wu, and Y. Yuan, "Double constrained nmf for hyperspectral unmixing, " IEEE Trans. Geosci. Remote Sens., vol. 52, no. 5, pp. 2746-2758, May 2014.
31. C. M. Bishop and N. M. Nasrabadi, "Pattern recognition and machine learning, " J. Electron. Imag., vol. 16, no. 4, p. 049901, 2007.
32. D. Cai, X. He, J. Han, and T. S. Huang, "Graph regularized nonnegative matrix factorization for data representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1548-1560, Aug. 2011.
33. Y. Yuan, L. Mou, and X. Lu, "Scene recognition by manifold regularized deep learning architecture, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 10, pp. 2222-2233, Oct. 2015.
34. X. Lu, Y. Wang, and Y. Yuan, "Graph-regularized low-rank representation for destriping of hyperspectral images, " IEEE Trans. Geosci. Remote Sens., vol. 51, no. 7, pp. 4009-4018, Jul. 2013.
35. Q. Gu, C. H. Q. Ding, and J. Han, "On trivial solution and scale transfer problems in graph regularized NMF, " in Proc. 22nd Int. Joint Conf. Artif. Intell., Jul. 2011, pp. 1288-1293.
36. J. Feng, S. Jegelka, S. Yan, and T. Darrell, "Learning scalable discriminative dictionary with sample relatedness, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 1645-1652.
37. V. Vapnik, Statistical Learn. Theory. New York, NY, USA: Wiley, 1998.
38. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification, " J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Jun. 2008.
39. Y. Mu, G. Hua, W. Fan, and S.-F. Chang, "Hash-svm: Scalable kernel machines for large-scale visual classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 979-986.
40. N. Rasiwasia et al, "A new approach to cross-modal multimedia retrieval, " in Proc. ACM Int. Conf. Multimedia, 2010, pp. 251-260.
41. J. Yang, Y.-G. Jiang, A. G. Hauptmann, and C.-W. Ngo, "Evaluating bag-of-visual-words representations in scene classification, " in Proc. Int. Workshop Multimedia Inf. Retr., 2007, pp. 197-206.
42. D. G. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
43. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation, " J. Mach. Learn. Res., vol. 3, pp. 993-1022, Mar. 2003.
44. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "Nus-wide: A real-world Web image database from national University of Singapore, " in Proc. (ACM) Int. Conf. Image Video Retr., Jan. 2009, p. 48.
45. M. J. Huiskes and M. S. Lew, "The mir flickr retrieval evaluation, " in Proc. Int. Conf. Multimedia Inf. Retr., Oct. 2008, pp. 39-43.
46. S. A. Chatzichristofis and Y. S. Boutalis, "CEDD: Color and edge directivity descriptor: A compact descriptor for image indexing and retrieval, " in Proc. 6th Int. Conf. Comput. Vis. Syst., May 2008, pp. 312-322.
47. N. Quadrianto and C. H. Lampert, "Learning multi-view neighborhood preserving projections, " in Proc. 28th Int. Conf. Mach. Learn., Jan. 2011, pp. 425-432.
48. B. Wu, Q. Yang, W.-S. Zheng, Y. Wang, and J. Wang, "Quantized correlation hashing for fast cross-modal search, " in Proc. 24th Int. Joint Conf. Artif. Intell., Apr. 2015, pp. 3946-3952.
49. D. Rafailidis and F. Crestani, "Cluster-based joint matrix factorization hashing for cross-modal retrieval, " in Proc. 39th Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., Jul. 2016, pp. 781-784.
50. J. Zhou, G. Ding, Y. Guo, Q. Liu, and X. Dong, "Kernel-Based supervised hashing for Cross-view similarity search, " in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2014, pp. 1-6.
51. Y. Zhen, Y. Gao, D.-Y. Yeung, H. Zha, and X. Li, "Spectral multimodal hashing and its application to multimedia retrieval, " IEEE Trans. Cybern., vol. 46, no. 1, pp. 27-38, Jan. 2016.
52. Y. Gong, S. Lazebnik, A. Gordo, and F. Perronnin, "Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2916-2929, Dec. 2013.
53. Y. Zhen and D.-Y. Yeung, "A probabilistic model for multimodal hash function learning, " in Proc. 18th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, Aug. 2012, pp. 940-948.
54. Y. Gong and S. Lazebnik, "Iterative quantization: A procrustean approach to learning binary codes, " in Proc. 24th IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 817-824.
55. J. Wang, S. Kumar, and S.-F. Chang, "Semi-supervised hashing for largescale search, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 12, pp. 2393-2406, Dec. 2012.
56. Y. Zhu et al, "Heterogeneous transfer learning for image classification, " in Proc. 28th AAAI Conf. Artif. Intell., Aug. 2011, pp. 817-824.