Cross-Modal Learning to Rank via Latent Joint Representation

IEEE Transactions on Image Processing

Volumn 24, Issue 5, 2015, Pages 1497-1509

  Wu, Fei ^a   Jiang, Xinyang ^a   Li, Xi ^a   Tang, Siliang ^a   Lu, Weiming ^a   Zhang, Zhongfei ^a   Zhuang, Yueting ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

Cross modal Ranking; Latent Joint Representation; Learning to Rank

Indexed keywords

IMAGE PROCESSING;

CONDITIONAL RANDOM FIELD; CROSS-MEDIA RETRIEVAL; CROSS-MODAL; LATENT JOINT REPRESENTATION; LEARNING TO RANK; MULTI-MODAL DATA; RANKING FUNCTIONS; STRUCTURAL LEARNING;

INFORMATION RETRIEVAL;

EID: 84924942692     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2403240     Document Type: Article

References (30)

1. F. Wu, Z. Yu, Y. Yang, S. Tang, Y. Zhang, and Y. Zhuang, "Sparse multimodal hashing," IEEE Trans. Multimedia, vol. 16, no. 2, pp. 427-439, Feb. 2014.
2. Y. Zhuang, H. Gao, F. Wu, S. Tang, Y. Zhang, and Z. Zhang, "Probabilistic word selection via topic modeling," IEEE Trans. Knowl. Data Eng., to be published.
3. X. Jiang, F. Wu, Y. Zhang, S. Tang, W. Lu, and Y. Zhuang, "The classification of multi-modal data with hidden conditional random field," Pattern Recognit. Lett., vol. 51, pp. 63-69, Jan. 2015. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0167865514002517
4. Y. Wang, F. Wu, J. Song, X. Li, and Y. Zhuang, "Multi-modal mutual topic reinforce modeling for cross-media retrieval," in Proc. ACM Int. Conf. Multimedia, 2014, pp. 307-316.
5. D. Hardoon, S. Szedmak, and J. R. Shawe-Taylor, "Canonical correlation analysis: An overview with application to learning methods," Neural Comput., vol. 16, no. 12, pp. 2639-2664, Dec. 2004.
6. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
7. G. Monaci, P. Jost, P. Vandergheynst, B. Mailhe, S. Lesage, and R. Gribonval, "Learning multimodal dictionaries," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2272-2283, Sep. 2007.
8. Y. T. Zhuang, Y. F. Wang, F. Wu, Y. Zhang, and W. M. Lu, "Supervised coupled dictionary learning with group structures for multi-modal retrieval," in Proc. AAAI, 2013, pp. 1070-1076.
9. D. M. Blei and M. I. Jordan, "Modeling annotated data," in Proc. Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., 2003, pp. 127-134.
10. st Conf. Uncertainty Artif. Intell., 2005, pp. 633-641.
11. th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2002, pp. 133-142.
12. nd Int. Conf. Mach. Learn., 2005, pp. 89-96.
13. Y. Yue, T. Finley, F. Radlinski, and T. Joachims, "A support vector method for optimizing average precision," in Proc. Int. ACM SIGIR Conf. Res. Develop. Inf. Retr. (SIGIR), 2007, pp. 271-278.
14. T. Qin, T.-Y. Liu, X.-D. Zhang, D.-S. Wang, and H. Li, "Global ranking using continuous conditional random fields," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 1281-1288.
15. D. Grangier and S. Bengio, "A discriminative kernel-based approach to rank images from text queries," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 8, pp. 1371-1384, Aug. 2008.
16. B. Bai et al., "Learning to rank with (a lot of) word features," Inf. Retr., vol. 13, no. 3, pp. 291-314, Jun. 2010.
17. th Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., 2013, pp. 433-442.
18. st ACM Int. Conf. Multimedia, 2013, pp. 877-886.
19. J. Yu, Y. Rui, and D. Tao, "Click prediction for web image reranking using multimodal sparse coding," IEEE Trans. Image Process., vol. 23, no. 5, pp. 2019-2032, May 2014.
20. th Int. Conf. Mach. Learn., 2001, pp. 282-289.
21. F. Wu, H. Zhang, and Y. Zhuang, "Learning semantic correlations for cross-media retrieval," in Proc. IEEE Int. Conf. Image Process., Oct. 2006, pp. 1465-1468.
22. Y. Yang, Y.-T. Zhuang, F. Wu, and Y.-H. Pan, "Harmonizing hierarchical manifolds for multimedia document semantics understanding and crossmedia retrieval," IEEE Trans. Multimedia, vol. 10, no. 3, pp. 437-446, Apr. 2008.
23. nd Int. Conf. Mach. Learn., 2005, pp. 377-384.
24. A. Quattoni, M. Collins, and T. Darrell, "Conditional random fields for object recognition," in Proc. Adv. Neural Inf. Process. Syst., 2004, pp. 1097-1104.
25. E. P. Xing, M. I. Jordan, and S. Russell, "A generalized mean field algorithm for variational inference in exponential families," in Proc. Conf. Uncertainty Artif. Intell., 2003, pp. 583-591.
26. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng, "NUS-WIDE: A real-world web image database from National University of Singapore," in Proc. ACM Conf. Image Video Retr., Jul. 2009, Art. ID 48.
27. N. Rasiwasia et al., "A new approach to cross-modal multimedia retrieval," in Proc. Int. Conf. Multimedia, 2010, pp. 251-260.
28. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. [Online]. Available: http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html
29. st ACM Int. Conf. Multimedia Inf. Retr., 2008, pp. 39-43.
30. L. van der Maaten and G. Hinton, "Visualizing data using t-SNE," J. Mach. Learn. Res., vol. 9, pp. 2579-2605, Nov. 2008.