Understanding visual-auditory correlation from heterogeneous features for cross-media retrieval

Journal of Zhejiang University: Science A

Volumn 9, Issue 2, 2008, Pages 241-249

  Zhang, Hong ^a,b   Wang, Yan Yun ^c   Pan, Hong ^c   Wu, Fei ^b  

^a WUHAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b ZHEJIANG UNIVERSITY   (China)

^c HANGZHOU NORMAL UNIVERSITY   (China)

Author keywords

Cross media retrieval; Dynamic correlation update; Heterogeneity; Subspace optimization

Indexed keywords

ALGORITHMS; IMAGE CLASSIFICATION; SEMANTICS; VISUAL COMMUNICATION;

CROSS-MEDIA RETRIEVAL; DYNAMIC CORRELATION UPDATE; HETEROGENEITY; SUBSPACE OPTIMIZATION;

OPTICAL CORRELATION;

EID: 38949120886     PISSN: 1673565X     EISSN: 18621775     Source Type: Journal    
DOI: 10.1631/jzus.A071191     Document Type: Article

References (20)

1. Barnard, K., Duygulu, P., de Freitas, N., Forsyth, D., Blei, D., Jordan, M.I., 2003. Matching words and pictures. J. Machine Learning Research, 3(6):1107-1135. [doi:10.1162/153244303322533214]
2. Chen, Z., Liu, W.Y., Zhang, F., Li, M.J., Zhang, H.J., 2001. Web mining for web image retrieval. J. Amer. Soc. Inf. Sci. & Tech., 52(10):831-839. [doi:10.1002/asi.1132.abs]
3. Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.A., 2002. Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. Proc. 7th European Conf. on Computer Vision, p.97-112.
4. Hotelling, H., 1936. Relations between two sets of variables. Biometrika, 28:321-377. [doi:10.1093/biomet/28.3-4.321]
5. Jeon, J., Lavrenko, V., Manmatha, R., 2003. Automatic Image Annotation and Retrieval using Cross-media Relevance Models. Proc. Int. ACM Conf. on Research and Development in Information Retrieval, p.119-126.
6. Lu, T.C., Chang, C.C., 2007. Color image retrieval technique based on color features and image bitmap. Int. J. Inf. Processing and Management, 43(2):461-472. [doi:10.1016/j.ipm.2006.07.014]
7. McGurk, H., MacDonald, J., 1976. Hearing lips and seeing voices. Nature, 264:746-748. [doi:10.1038/264746a0]
8. Slaney, M., Covell, M., 2000. FaceSync: A Linear Operator for Measuring Synchronization of Video Facial Images and Audio Tracks. Proc. Neural Information Processing Systems, p.814-820.
9. Snoek, C., Worring, M., Smeulders, A.W.M., 2005. Early versus Late Fusion in Semantic Video Analysis. Proc. ACM Multimedia, p.399-402.
10. Tan, B., Shen, X.H., Zhai, C.X., 2006. Mining Long-term Search History to Improve Search Accuracy. Proc. Int. Conf. on Knowledge Discovery and Data Mining, p.718-723.
11. Wang, X.J., Ma, W.Y., Xue, G.R., Li, X., 2004. Multi-model Similarity Propagation and its Applications for Web Image Retrieval. Proc. ACM Multimedia, p.944-951.
12. Wu, F., Zhang, H., Zhuang, Y.T., 2006. Learning Semantic Correlation for Cross-media Retrieval. Proc. Int. Conf. on Image Processing, p.1465-1468. [doi:10.1109/ICIP.2006.312707]
13. Xing, E.P., Ng, A.Y., Jordan, M.I., Russell, S., 2003. Distance Metric Learning with Application to Clustering with Side-information. Proc. Neural Information Processing Systems, 15:505-512.
14. Yang, J., Hauptmann, A., 2004. Naming Every Individual in News Video Monologues. Proc. ACM Multimedia, p.580-587.
15. Ye, J.P., Li, Q., 2005. A two-stage linear discriminant analysis via QR-decomposition. IEEE Trans. on Pattern Anal. Machine Intell., 27(6):929-941. [doi:10.1109/TPAMI.2005.110]
16. Zhang, C., Chen, T., 2002. An active learning framework for content-based information retrieval. IEEE Trans. on Multimedia, 4(2):260-268. [doi:10.1109/TMM.2002.1017 738]
17. Zhang, H., Zhuang, Y.T., Wu, F., 2007. Cross-modal Correlation Learning for Clustering on Image-Audio Dataset. Proc. ACM Multimedia, p.273-276.
18. Zhang, Z.Y., Liu, Z.C., Adler, D., Cohen, M.F., Hanson, E., Shan, Y., 2004. Robust and rapid generation of animated faces from video images: a model-based modeling approach. Int. J. Computer Vision, 58(2):93-119. [doi:10.1023/B:VISI.0000015915.50080.85]
19. Zhao, R., Grosky, W.I., 2002. Negotiating the semantic gap: from feature maps to semantic landscapes. Pattern Recognition, 35(3):593-600. [doi:10.1016/S0031-3203(01)00062-0]
20. Zhao, X.Y., Zhuang, Y.T., Wu, F., 2002. Audio Clip Retrieval with Fast Relevance Feedback based on Constrained Fuzzy Clustering and Stored Index Table. Proc. 3rd Pacific-Rim Conf. on Multimedia, p.237-244.