Mining semantic correlation of heterogeneous multimedia data for cross-media retrieval

IEEE Transactions on Multimedia

Volumn 10, Issue 2, 2008, Pages 221-229

  Zhuang, Yue Ting ^a,b   Yang, Yi ^b   Wu, Fei ^b  

^a IEEE

^b ZHEJIANG UNIVERSITY   (China)

Author keywords

Cross media retrieval; Multimedia document; Multimedia semantics mining; Relevance feedback

Indexed keywords

DATA MINING; FEEDBACK; GRAPH THEORY; IMAGE PROCESSING; QUERY PROCESSING; SEMANTICS;

CROSS MEDIA RETRIEVAL; MULTIMEDIA DOCUMENTS;

MULTIMEDIA SERVICES;

EID: 38349155191     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.911822     Document Type: Article

References (44)

1. M. Lew, N. Sebe, C. Djeraba, and R. Jain, "Content-based multimedia information retrieval: State-of-the-art and challenges," ACM Trans. Multimedia Comput., Commun., Applic., vol. 2, no. 1, pp. 1-19, 2006.
2. R. Zhang and Z. (M.) Zhang, "Effective image retrieval based on hidden concept discovery in image database," IEEE Trans. Image Process., vol. 16, no. 2, pp. 562-572, Feb. 2006.
3. X. He, W. Y. Ma, and H. J. Zhang, "Learning an image manifold for retrieval," in Proc. ACM Multimedia Conf., New York, 2004.
4. J. He, M. Li, H. J. Zhang, H. Tong, and C. Zhang, "Manifold-ranking based image retrieval," in Proc. ACM Multimedia Conf., New York, 2004.
5. N. C. Maddage, C. Xu, M. S. Kankanhalli, and X. Shao, "Content-based music structure analysis with applications to music semantics understanding," in Proc. ACM Multimedia Conf., New York, 2004.
6. G. Guo and S. Z. Li, "Content-based audio classification and retrieval by support vector machines," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 209-215, Jan. 2003.
7. E. Wold, T. Blum, D. Keislar, and J. Wheaton, "Content-based classification, search and retrieval of audio," IEEE Multimedia Mag., vol. 3, no. 3, pp. 27-36, Fall 1996.
8. M. Y. Wu, C. Y. Chiu, S. P. Chao, S. N. Yang, and H. C. Lin, "Content-based retrieval for human motion data," in Proc. 16th IPPR Conf. Computer Vision, Graphics and Image Processing, Taiwan, R.O.C., 2003.
9. M. Muller, T. Roder, and M. Clausen, "Efficient content-based retrieval of motion capture data," in Proc. ACM SIGGRAPH Conf., Los Angeles, CA, 2005.
10. F. Liu, Y. Zhuang, F. Wu, and Y. Pan, "3D motion retrieval with motion index tree," Comput. Vis. Image Understanding, vol. 92, no. 2, pp. 265-284, 2003.
11. J. Fan, A. K. Elmagarmid, X. Zhu, W. G. Aref, and L. Wu, "Classview: Hierarchical video shot classification, indexing, and accessing," IEEE Trans. Multimedia, vol. 6, no. 1, pp. 70-86, Feb. 2004.
12. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Proc. 18th Annu. Conf. Neural Information Processing Systems, 2003, pp. 237-244.
13. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Ranking on data manifolds," in Proc. 18th Annu. Conf. Neural Information Processing System, 2003, pp. 169-176.
14. H. Tong, J. He, M. Li, C. Zhang, and W. Y. Ma, "Graph based multi-modality learning," in Proc. ACM Multimedia Conf., Singapore, 2005.
15. Y. Rui and T. S. Huang, "Optimizing learning in image retrieval," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2000, vol. 1, pp. 236-243.
16. J. Shrager, T. Hogg, and B. A. Huberman, "Observation of phase transitions in spreading activation networks," Science, vol. 236, pp. 1092-1094, 1987.
17. A. N. Langville and C. D. Meyer, "Deeper inside PageRank," Internet Math., vol. 1, no. 3, pp. 335-380, 2003.
18. R. Krishnapuram, S. Medasani, S. H. Jung, Y. S. Choi, and R. Balasubramaniam, "Content-based image retrieval based on a fuzzy approach," IEEE Trans. Knowl. Data Eng., vol. 16, no. 10, pp. 185-1199, Oct. 2004.
19. M. Swain and D. Ballard, "Color indexing," Int. J. Comput. Vis., vol. 7, no. 1, pp. 11-32, 1991.
20. Y. Wu, Q. Tian, and T. Huang, "Discriminant-EM algorithm with application to image retrieval," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2000, vol. 1, pp. 222-227.
21. J. R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. Jain, and C. F. Shu, "Virage image search engine: An open framework for image management," in Proc. SPIE Storage and Retrieval for Still Image and Video Databases, 1996, pp. 76-87.
22. A. D. Bimbo and P. Pala, "Content-based retrieval of 3D models," ACM Trans. Multimedia Comput., Commun., Applic., vol. 2, no. 1, pp. 20-43, 2006.
23. X. S. Zhou and T. S. Huang, "Comparing discriminating transformations and SVM for learning during multimedia retrieval," in Proc. ACM Int. Conf. Multimedia, Ottawa, ON, Canada, 2001.
24. C. Djeraba, "Association and content-based retrieval," IEEE Trans. Knowl. Data Eng., vol. 15, no. 6, pp. 118-135, Jun. 2003.
25. K. Jafari-Khouzani and H. Soltanian-Zadeh, "Radon transform orientation estimation for rotation invariant texture analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 1004-1008, Jun. 2005.
26. P. Wu, Y. Choi, Y. M. Ro, and C. S. Won, "MPEG-7 texture descriptors," Int. J. Image and Graph., vol. 1, no. 3, pp. 547-563, 2001.
27. A. Srivastava, S. H. Joshi, W. Mio, and X. Liu, "Statistical shape analysis: Clustering, learning, and testing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 4, pp. 590-602, Apr. 2005.
28. R. C. Veltkamp and M. Hagedoorn, "State of the art in shape matching," in Principles of Vis. Inform. Retrieval, 2000, pp. 87-119.
29. J. Foote, "Automatic audio segmentation using a measure of audio novelty," in Proc. IEEE Int. Conf. Multimedia and Expo, Jul.-Aug. 2000, vol. 1, pp. 452-455.
30. E. M. Bakker and M. S. Lew, "Semantic video retrieval using audio analysis," in Proc. 1st Int. Conf. Image and Video Retrieval, 2002, pp. 271-277.
31. C. Schmid, R. Mohr, and C. Bauckhage, "Evaluation of interest point detectors," Int. J. Comput. Vis., vol. 37, no. 2, pp. 151-172, 2000.
32. M. Cooper, J. Foote, A. Girgensohn, and L. Wilcox, "Temporal event clustering for digital photo collections," ACM Trans. Multimedia Comput., Commun., Applic., vol. 1, no. 3, pp. 269-288, 2005.
33. K. Mikolajczyk and C. Schmid, "Scale and affine invariant interest point detectors," Int. J. Comput. Vis., vol. 60, no. 1, pp. 63-86, 2004.
34. N. Sebe, Q. Tian, E. Loupias, M. S. Lew, and T. S. Huang, "Evaluation of salient point techniques," Image Vis. Comput., vol. 21, no. 13-14, pp. 1087-1095, 2003.
35. S. F. Chang, W. Chen, and H. Sundaram, "Semantic visual templates: Linking visual features to semantics," in Proc. IEEE Int. Conf. Image Processing, Oct. 1998, vol. 3, pp. 531-535.
36. K. Tieu and P. Viola, "Boosting image retrieval," Int. J. Comput. Vis., vol. 56, no. 1, pp. 17-36, 2004.
37. J. Assfalg, A. D. Bimbo, and P. Pala, "Retrieval of 3D objects by visual similarity," in Proc. 6th Int. Workshop on Multimedia Information Retrieval, New York, 2004.
38. M. Haas, J. Rijsdam, B. Thomee, and M. Lew, "Relevance feedback: Perceptual learning and retrieval in bio-computing, photos, and video," in Proc. 6th ACM SIGMM Int. Workshop on Multimedia Information Retrieval, New York, 2004.
39. Y. Chen, D. Che, and K. Aberer, "On the efficient evaluation of relaxed queries in biological databases," in Proc. 11th Int. Conf. Information and Knowledge Management, McLean, VA, 2002.
40. A. B. Benitez, J. R. Smith, and S. F. Chang, "Medianet: A multimedia information network for knowledge representation," in Proc. IS&T/SPIE 2000 Conf. Internet Multimedia Management Systems, 2000, vol. 4210.
41. R. Martinec and A. Salway, "A system for image-text relations in new (and old) media," Vis. Commun., vol. 4, no. 3, pp. 337-371, 2005.
42. Y. Zhuang, Y. Yang, F. Wu, and Y. Pan, "Manifold learning based cross-media retrieval: A solution to media object complementary nature," J. VLSI Signal Process., vol. 46, no. 2-3, pp. 153-164, 2007.
43. H. Zhang, Y. Zhuang, and F. Wu, "Cross-modal correlation learning for clustering on image-audio dataset," in Proc. ACM Multimedia, Augsburg, Germany, 2007.
44. F. Wu, H. Zhang, and Y. Zhuang, "Learning semantic correlation for cross-media retrieval," in Proc. 13th Int. Conf. Image Processing, Atlanta, VA, 2006.