Multi-modal mutual topic reinforce modeling for cross-media retrieval

MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Volumn , Issue , 2014, Pages 307-316

  Wang, Yanfei ^a   Wu, Fei ^a   Song, Jun ^a   Li, Xi ^a   Zhuang, Yueting ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

Cross media retrieval; Multi modal analysis; Mutual topic; Topic reinforcement

Indexed keywords

BAYESIAN NETWORKS; REINFORCEMENT; SEMANTICS;

AUXILIARY INFORMATION; BENCHMARK DATASETS; CROSS-MEDIA RETRIEVAL; DISCRIMINATIVE POWER; MULTI-MODAL DATA; MUTUAL TOPIC; PROBABILISTIC GRAPHICAL MODELS; SEMANTIC INFORMATION;

MODAL ANALYSIS;

EID: 84913526094     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2647868.2654901     Document Type: Conference Paper

References (31)

1. G. Andrew, R. Arora, J. Bilmes, and K. Livescu. Deep canonical correlation analysis. In Proceedings of International Conference on Machine Learning, pages 1247-1255, 2013.
2. D. Blei and M. Jordan. Modeling annotated data. In Proceedings of the international ACM SIGIR conference on Research and development in informaion retrieval, pages 127-134, 2003.
3. D. M. Blei and J. D. McAuliffe. Supervised topic models. arXiv preprint arXiv:1003.0783, 2010.
4. M. M. Bronstein, A. M. Bronstein, F. Michel, and N. Paragios. Data fusion through cross-modality metric learning using similarity-sensitive hashing. In Computer Vision and Pattern Recognition, IEEE Conference on, pages 3594-3601, 2010.
5. N. Chen, J. Zhu, F. Sun, and E. P. Xing. Large-margin predictive latent subspace learning for multiview data analysis. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(12):2365-2378, 2012.
6. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng. Nus-wide: A real-world web image database from national university of singapore. In Proceedings of ACM Conference on Image and Video Retrieval, July 2009.
7. J. Costa Pereira, E. Coviello, G. Doyle, N. Rasiwasia, G. Lanckriet, R. Levy, and N. Vasconcelos. On the role of correlation and abstraction in cross-modal multimedia retrieval. Transactions of Pattern Analysis and Machine Intelligence, 36(3):521-535, March 2014.
8. J. Farquhar, D. Hardoon, H. Meng, J. S. Shawe-taylor, and S. Szedmak. Two view learning: Svm-2k, theory and practice. In Advances in neural information processing systems, pages 355-362, 2005.
9. L. Fei-Fei, R. Fergus, and P. Perona. Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In Computer Vision and Pattern Recognition Workshop, IEEE Conference on, pages 178-178, 2004.
10. A. Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, T. Mikolov, et al. Devise: A deep visual-semantic embedding model. In Advances in Neural Information Processing Systems, pages 2121-2129, 2013.
11. T. L. Griffiths and M. Steyvers. Finding scientific topics. Proceedings of the National academy of Sciences of the United States of America, 101(Suppl 1):5228-5235, 2004.
12. H. Hotelling. Relations between two sets of variates. Biometrika, 28(3/4):321-377, 1936.
13. Y. Jia, M. Salzmann, and T. Darrell. Factorized latent spaces with structured sparsity. Advances in Neural Information Processing Systems, 23:982-990, 2010.
14. Y. Jia, M. Salzmann, and T. Darrell. Learning cross-modality similarity for multinomial data. In Computer Vision and Pattern Recognition, IEEE Conference on, pages 2407-2414, 2011.
15. S. Kumar and R. Udupa. Learning hash functions for cross-view similarity search. In Proceedings of international joint conference on Artificial Intelligence, pages 1360-1365, 2011.
16. R. Liao, J. Zhu, and Z. Qin. Nonparametric bayesian upstream supervised multi-modal topic models. In Proceedings of the ACM international conference on Web search and data mining, pages 493-502, 2014.
17. D. G. Lowe. Object recognition from local scale-invariant features. In Proceedings of the IEEE international conference on Computer vision, volume 2, pages 1150-1157, 1999.
18. X. Lu, F. Wu, S. Tang, Z. Zhang, X. He, and Y. Zhuang. A low rank structural large margin method for cross-modal ranking. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval, pages 433-442, 2013.
19. T. Minka. Estimating a dirichlet distribution. Technical report, MIT, 2000.
20. T. P. Minka. Expectation propagation for approximate bayesian inference. In Proceedings of the conference on Uncertainty in artificial intelligence, pages 362-369. Morgan Kaufmann Publishers Inc., 2001.
21. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng. Multimodal deep learning. In Proceedings of the International Conference on Machine Learning, pages 689-696, 2011.
22. D. Putthividhy, H. Attias, and S. Nagarajan. Topic regression multi-modal latent dirichlet allocation for image annotation. In Computer Vision and Pattern Recognition, IEEE Conference on, pages 3408-3415, 2010.
23. N. Rasiwasia, J. Costa Pereira, E. Coviello, G. Doyle, G. Lanckriet, R. Levy, and N. Vasconcelos. A new approach to cross-modal multimedia retrieval. In Proceedings of the international conference on Multimedia, pages 251-260, 2010.
24. A. Sharma, A. Kumar, H. Daume, and D. Jacobs. Generalized multiview analysis: A discriminative latent space. In Computer Vision and Pattern Recognition, IEEE Conference on, pages 2160-2167, 2012.
25. N. Srivastava and R. Salakhutdinov. Multimodal learning with deep boltzmann machines. In NIPS, pages 2231-2239, 2012.
26. S. Virtanen, Y. Jia, A. Klami, and T. Darrell. Factorized multi-modal topic model. arXiv preprint arXiv:1210.4920, 2012.
27. C. Wang, D. Blei, and F.-F. Li. Simultaneous image classification and annotation. In Computer Vision and Pattern Recognition, IEEE Conference on, pages 1903-1910, 2009.
28. F. Wu, X. Lu, Z. Zhang, S. Yan, Y. Rui, and Y. Zhuang. Cross-media semantic representation via bi-directional learning to rank. In Proceedings of ACM international conference on Multimedia, pages 877-886, 2013.
29. F. Wu, Z. Yu, Y. Yang, S. Tang, Y. Zhang, and Y. Zhuang. Sparse multi modal hashing. IEEE Trans. Multimedia, 2013. doi: 10.1109/TMM.2013.2291214.
30. Y. Zhen and D.-Y. Yeung. A probabilistic model for multimodal hash function learning. In Proceedings of ACM SIGKDD international conference on Knowledge discovery and data mining, pages 940-948, 2012.
31. Y. Zhuang, Y. Wang, F. Wu, Y. Zhang, and W. Lu. Supervised coupled dictionary learning with group structures for multi-modal retrieval. In Proceedings of Conference on Artificial Intelligence, pages 1070-1076, 2013.