Effective multimodal retrieval based on stacked auto-encoders

Proceedings of the VLDB Endowment

Volumn 7, Issue 8, 2014, Pages 649-660

  Wang, Wei ^a   Ooi, Beng Chin ^a   Yang, Xiaoyan ^b   Zhang, Dongxiang ^a   Zhuang, Yueting ^c  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b Illinois at Singapore Pte   (Singapore)

^c ZHEJIANG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP LEARNING; LARGE DATASET; LEARNING SYSTEMS; MAPPING; SEMANTICS;

HETEROGENEOUS SOURCES; HIGH DIMENSIONAL FEATURE; LOW-DIMENSIONAL SPACES; MAPPING FUNCTIONS; MAPPING MECHANISM; METRIC DISTANCES; OBJECTIVE FUNCTIONS; STATE-OF-THE-ART METHODS;

SIGNAL ENCODING;

EID: 84901787656     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2732296.2732301     Document Type: Conference Paper

References (27)

1. M. M. Bronstein, A. M. Bronstein, F. Michel, and N. Paragios. Data fusion through cross-modality metric learning using similarity-sensitive hashing. In CVPR, pages 3594-3601, 2010.
2. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng. Nus-wide: A real-world web image database from national university of singapore. In Proc. of ACM Conf. on Image and Video Retrieval (CIVR'09), Santorini, Greece., July 8-10, 2009.
3. J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, Q. V. Le, M. Z. Mao, M. Ranzato, A. W. Senior, P. A. Tucker, K. Yang, and A. Y. Ng. Large scale distributed deep networks. In NIPS, pages 1232-1240, 2012.
4. R. Goroshin and Y. LeCun. Saturating auto-encoder. CoRR, abs/1301.3577, 2013.
5. G. Hinton. A Practical Guide to Training Restricted Boltzmann Machines. Technical report, 2010.
6. G. R. Hjaltason and H. Samet. Index-driven similarity search in metric spaces. ACM Trans. Database Syst., 28(4):517-580, 2003.
7. M. J. Huiskes and M. S. Lew. The mir flickr retrieval evaluation. In Multimedia Information Retrieval, pages 39-43, 2008.
8. A. Krizhevsky. Learning multiple layers of features from tiny images. Technical report, 2009.
9. S. Kumar and R. Udupa. Learning hash functions for cross-view similarity search. In IJCAI, pages 1360-1365, 2011.
10. Y. LeCun, L. Bottou, G. Orr, and K. Müller. Efficient BackProp. In G. Orr and K.-R. Müller, editors, Neural Networks: Tricks of the Trade, volume 1524 of Lecture Notes in Computer Science, chapter 2, pages 9-50. Springer Berlin Heidelberg, Berlin, Heidelberg, Mar. 1998.
11. W. Liu, J. Wang, S. Kumar, and S.-F. Chang. Hashing with graphs. In ICML, pages 1-8, 2011.
12. X. Lu, F. Wu, S. Tang, Z. Zhang, X. He, and Y. Zhuang. A low rank structural large margin method for cross-modal ranking. In SIGIR, pages 433-442, 2013.
13. A. L. Maas, Q. V. Le, T. M. O'Neil, O. Vinyals, P. Nguyen, and A. Y. Ng. Recurrent neural networks for noise reduction in robust asr. In INTERSPEECH, 2012.
14. C. D. Manning, P. Raghavan, and H. Schütze. Introduction to information retrieval, pages 151-175. Cambridge University Press, 2008.
15. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng. Multimodal deep learning. In ICML, pages 689-696, 2011.
16. N. Rasiwasia, J. C. Pereira, E. Coviello, G. Doyle, G. R. G. Lanckriet, R. Levy, and N. Vasconcelos. A new approach to cross-modal multimedia retrieval. In ACM Multimedia, pages 251-260, 2010.
17. S. Rifai, P. Vincent, X. Muller, X. Glorot, and Y. Bengio. Contractive auto-encoders: Explicit invariance during feature extraction. In ICML, pages 833-840, 2011.
18. R. Salakhutdinov and G. E. Hinton. Semantic hashing. Int. J. Approx. Reasoning, 50(7):969-978, 2009.
19. R. Socher, J. Pennington, E. H. Huang, A. Y. Ng, and C. D. Manning. Semi-supervised recursive autoencoders for predicting sentiment distributions. In EMNLP, pages 151-161, 2011.
20. J. Song, Y. Yang, Y. Yang, Z. Huang, and H. T. Shen. Inter-media hashing for large-scale retrieval from heterogeneous data sources. In SIGMOD Conference, pages 785-796, 2013.
21. N. Srivastava and R. Salakhutdinov. Multimodal learning with deep boltzmann machines. In NIPS, pages 2231-2239, 2012.
22. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In ICML, pages 1096-1103, 2008.
23. R. Weber, H.-J. Schek, and S. Blott. A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In VLDB, pages 194-205, 1998.
24. Y. Weiss, A. Torralba, and R. Fergus. Spectral hashing. In NIPS, pages 1753-1760, 2008.
25. Y. Zhen and D.-Y. Yeung. A probabilistic model for multimodal hash function learning. In KDD, pages 940-948, 2012.
26. X. Zhu, Z. Huang, H. T. Shen, and X. Zhao. Linear cross-modal hashing for efficient multimodal search. MM, 2013.
27. Y. Zhuang, Y. Yang, and F. Wu. Mining semantic correlation of heterogeneous multimedia data for cross-media retrieval. IEEE Transactions on Multimedia, 10(2):221-229, 2008.