Online multimodal deep similarity learning with application to image retrieval

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Volumn , Issue , 2013, Pages 153-162

  Wu, Pengcheng ^a   Hoi, Steven C H ^a   Xia, Hao ^a   Zhao, Peilin ^a   Wang, Dayong ^a   Miao, Chunyan ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Deep learning; Distance metric learning; Image retrieval; Online learning; Similarity learning

Indexed keywords

DEEP LEARNING; DEEP NEURAL NETWORKS; DISTANCE METRIC LEARNING; MULTIMEDIA INFORMATION RETRIEVAL; NON-LINEAR TRANSFORMATIONS; ONLINE LEARNING; ONLINE LEARNING SCHEME; SIMILARITY LEARNING;

MATHEMATICAL TRANSFORMATIONS; MODAL ANALYSIS;

IMAGE RETRIEVAL;

EID: 84887419657     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2502081.2502112     Document Type: Conference Paper

References (54)

1. S. Akaho. A kernel method for canonical correlation analysis. In IMPS. Springer-Verlag, 2001.
2. A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall. Learning distance functions using equivalence relations. In ICML, pages 11-18, 2003.
3. H. Bay, T. Tuytelaars, and L. Van Gool. Surf: Speeded up robust features. In ECCV, pages 404-417. Springer, 2006.
4. Y. Bengio. Learning deep architectures for AI. FTML, 2(1):1-127, 2009.
5. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layer-wise training of deep networks. In NIPS, pages 153-160. MIT Press, 2007.
6. N. Cesa-Bianchi and G. Lugosi. Prediction, Learning, and Games. Cambridge University Press, New York, NY, USA, 2006.
7. K. Chatfield, V. S. Lempitsky, A. Vedaldi, and A. Zisserman. The devil is in the details: An evaluation of recent feature encoding methods. In BMVC, pages 1-12, 2011.
8. G. Chechik, V. Sharma, U. Shalit, and S. Bengio. Large scale online learning of image similarity through ranking. JMLR, 11:1109-1135, 2010.
9. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer. Online passive-aggressive algorithms. JMLR, 7:551-585, 2006.
10. G. E. Dahl, D. Yu, L. Deng, and A. Acero. Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. TASLP, 20(1):30-42, 2012.
11. M. Dredze, K. Crammer, and F. Pereira. Confidence-weighted linear classification. In ICML, pages 264-271, 2008.
12. J. D. R. Farquhar, H. Meng, S. Szedmak, D. R. Hardoon, and J. Shawe-taylor. Two view learning: Svm-2k, theory and practice. In NIPS. MIT Press, 2006.
13. G. Hinton and R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504 - 507, 2006.
14. G. E. Hinton, S. Osindero, and Y.-W. Teh. A fast learning algorithm for deep belief nets. NC, 18(7):1527-1554, July 2006.
15. S. C. Hoi, W. Liu, and S.-F. Chang. Semi-supervised distance metric learning for collaborative image retrieval. In CVPR, June 2008.
16. S. C. Hoi, W. Liu, M. R. Lyu, and W.-Y.Ma. Learning distance metrics with contextual constraints for image retrieval. In CVPR, June 17-22 2006.
17. S. C. Hoi, M. R. Lyu, and R. Jin. A unified log-based relevance feedback scheme for image retrieval. TKDE, 18(4):509-204, 2006.
18. S. C. Hoi, J.Wang, and P. Zhao. LIBOL: A Library for Online Learning Algorithms. Nanyang Technological University, 2012.
19. P. Jain, B. Kulis, I. S. Dhillon, and K. Grauman. Online metric learning and fast similarity search. In NIPS, pages 761-768, 2008.
20. H. Jegou, F. Perronnin, M. Douze, J. Sanchez, P. Perez, and C. Schmid. Aggregating local image descriptors into compact codes. TPAMI, 34(9):1704-1716, Sept. 2012.
21. R. Jin, S. Wang, and Y. Zhou. Regularized distance metric learning: Theory and algorithm. s, pages 862-870, 2009.
22. Y. Jing and S. Baluja. Visualrank: Applying pagerank to large-scale image search. TPAMI, 30(11):1877-1890, 2008.
23. A. Joly and O. Buisson. Random maximum margin hashing. In CVPR, pages 873-880, Washington, DC, USA, 2011.
24. Y. Kang, S. Kim, and S. Choi. Deep learning to hash with multiple representations. In ICDM, pages 930-935, 2012.
25. J. Kludas, E. Bruno, and S. Marchand-Maillet. Information fusion in multimedia information retrieval. AMR, pages 147-159, 2008.
26. A. Krizhevsky, I. Sutskever, and G. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1106-1114. 2012.
27. Q. V. Le, M. Ranzato, R. Monga, M. Devin, G. Corrado, K. Chen, J. Dean, and A. Y. Ng. Building high-level features using large scale unsupervised learning. In ICML, 2012.
28. M. S. Lew, N. Sebe, C. Djeraba, and R. Jain. Content-based multimedia information retrieval: State of the art and challenges. TOMCCAP, 2(1):1-19, 2006.
29. Y. Li and P. M. Long. The relaxed online maximum margin algorithm. In NIPS, pages 498-504, 1999.
30. D. G. Lowe. Object recognition from local scale-invariant features. In ICCV, pages 1150-1157, 1999.
31. B. S. Manjunath and W.-Y. Ma. Texture features for browsing and retrieval of image data. TPAMI, 18(8):837-842, 1996.
32. B. McFee and G. Lanckriet. Learning multi-modal similarity. JMLR, 12:491-523, 2011.
33. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng. Multimodal deep learning. In ICML, Bellevue, USA, June 2011.
34. M. Norouzi, D. Fleet, and R. Salakhutdinov. Hamming distance metric learning. In NIPS. 2012.
35. A. Quattoni and A. Torralba. Recognizing indoor scenes. In CVPR, 2009.
36. R. Rahmani, S. A. Goldman, H. Zhang, S. R. Cholleti, and J. E. Fritts. Localized content-based image retrieval. TPAMI, 30(11):1902-1912, 2008.
37. F. Rosenblatt. The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65:386-407, 1958.
38. D. E. Rumelhart, G. E. Hinton, and R. J.Williams. Neurocomputing: foundations of research.MIT Press, Cambridge, MA, USA, 1988.
39. R. Salakhutdinov and G. Hinton. Semantic hashing. IJAR, 50(7), July 2009.
40. R. Salakhutdinov and G. E. Hinton. Deep boltzmann machines. AISTATS, 5:448-455, 2009.
41. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. TPAMI, 22(12):1349-1380, 2000.
42. C. G. Snoek, M. Worring, and A. W. Smeulders. Early versus late fusion in semantic video analysis. In MM, pages 399-402. ACM, 2005.
43. N. Srivastava and R. Salakhutdinov. Multimodal learning with deep boltzmann machines. In NIPS. 2012.
44. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, pages 1096-1103, 2008.
45. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. JMLR, 11:3371-3408, Dec. 2010.
46. J. Wang, P. Zhao, and S. C. H. Hoi. Exact soft confidence-weighted learning. In ICML, 2012.
47. K. Weinberger, J. Blitzer, and L. Saul. Distance metric learning for large margin nearest neighbor classification. In NIPS, pages 1473-1480, 2006.
48. L. Wu, S. C. Hoi, and N. Yu. Semantics-preserving bag-of-words models and applications. TIP, 19(7):1908-1920, 2010.
49. J. Yang, Y.-G. Jiang, A. G. Hauptmann, and C.-W. Ngo. Evaluating bag-of-visual-words representations in scene classification. In MIR, pages 197-206, 2007.
50. L. Yang and R. Jin. Distance metric learning: A comprehensive survey. Michigan State Universiy, pages 1-51, 2006.
51. D. Zhai, H. Chang, S. Shan, X. Chen, and W. Gao. Multiview metric learning with global consistency and local smoothness. TIST, 3(3):53, 2012.
52. P. Zhao, S. C. H. Hoi, and R. Jin. Double updating online learning. JMLR, 12:1587-1615, 2011.
53. S.-h. Zhong, Y. Liu, and Y. Liu. Bilinear deep learning for image classification. In MM, pages 343-352, Scottsdale, Arizona, 2011.
54. M. Zinkevich. Online convex programming and generalized infinitesimal gradientascent. In ICML, pages 928-936, 2003.