A multimodal and multilevel ranking scheme for large-scale video retrieval

IEEE Transactions on Multimedia

Volumn 10, Issue 4, 2008, Pages 607-619

  Hoi, Steven C H ^a,b   Lyu, Michael R ^a,c  

^a IEEE

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Content based video retrieval; Graph representation; Multilevel ranking; Multimedia retrieval; Multimodal fusion; Semi supervised ranking; Support vector machines

Indexed keywords

DATA REDUCTION; MODAL ANALYSIS; PROBLEM SOLVING; SUPPORT VECTOR MACHINES;

CONTENT-BASED VIDEO RETRIEVAL; GRAPH REPRESENTATION; MULTILEVEL RANKING; MULTIMEDIA RETRIEVAL; MULTIMODAL FUSION; SEMI-SUPERVISED RANKING;

IMAGE RETRIEVAL;

EID: 44049089172     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.921735     Document Type: Article

References (44)

1. H. D. Wactlar, T. Kanade, M. A. Smith, and S. M. Stevens, "Intelligent access to digital video: Informedia project," IEEE Computer, vol. 29, no. 5, pp. 46-53, 1996.
2. M. R. Lyu, E. Yau, and K. S. Sze, "iview: An intelligent video over internet and wireless access system," in Proc. 11 th Int. World Wide Web Conf. (WWW2002), Practice and Experience Track, Honolulu, HI, 2002.
3. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, no. 12, pp. 1349-1380, 2000.
4. TRECVID, TREC Video Retrieval Evaluation [Online]. Available: http://www-nlpir.nist.gov/projects/trecvid/
5. Y. Wu, E. Y. Chang, K. C.-C. Chang, and J. R. Smith, "Optimal multimodal fusion for multimedia data analysis," in Proc. 12th ACM Int. Conf. Multimedia, New York, 2004, pp. 572-579.
6. C. G. M. Snoek, M. Worring, and A. W. M. Smeulders, "Early versus late fusion in semantic video analysis," in Proc. ACM International Conference on Multimedia, Singapore, 2005, pp. 399-402.
7. K.-S. Goh, E. Y. Chang, and W.-C. Lai, "Multimodal concept-dependent active learning for image retrieval," in Proc. 12th ACM Int. Conf. Multimedia, New York, 2004, pp. 564-571.
8. M. Christel, T. Kanade, M. Mauldin, R. Reddy, M. Sirbu, S. Stevens, and H. Wactlar, "Informedia digital video library," Commun. ACM, vol. 38, no. 4, pp. 57-58, 1994.
9. S.-F. Chang, W. Chen, H. Meng, H. Sundaram, and D. Zhong, "A fully automatic content-based video search engine supporting multi-object spatio-temporal queries," IEEE Trans. Circuits Syst. Video Technology, vol. 8, no. 3, pp. 602-615, Mar. 1998.
10. R. Yan, A. Hauptmann, and R. Jin, "Multimedia search with pseudorelevance feedback," in Proc. Int. Conf. Image and Video Retrieval (CIVR 2003), Urbana-Champaign, IL, 2003, pp. 238-247.
11. R. Yan, A. Hauptmann, and R. Jin, "Negative pseudo-relevance feedback in content-based video retrieval," in Proc. ACM Multimedia Conf. (MM 2003), Berkeley, CA, 2003.
12. A. Amir, G. Iyengar, J. Argillander, M. Campbell, A. Haubold, S. Ebadollahi, F. Kang, M. R. Naphade, A. Natsev, J. R. Smith, J. Tesic, and T. Volkmer, "IBM research trecvid-2005 video retrieval system," in Proc. TRECVID Workshop, Washington, DC, 2005.
13. R. Yan and A. G. Hauptmann, "Efficient margin-based rank learning algorithms for information retrieval," in Proc. Int. Conf. Image and Video Retrieval (CIVR 2006), Tempe, AZ, 2006, ACM Press.
14. J. Yuan, J. Li, and B. Zhang, "Learning concepts from large scale unbalanced data sets using support cluster machines," in Proc. 14th ACM Int. Conf. Multimedia, Santa Barbara, CA, 2006, pp. 441-450.
15. W. H. Hsu, L. Kennedy, and S.-F. Chang, "Video search reranking via information bottleneck principle," in Proc. ACM Multimedia Conf 2006, Santa Barbara, CA, 2006.
16. J.-Y. Pan, H.-J. Yang, C. Faloutsos, and P. Duygulu, "Automatic multimedia cross-modal correlation discovery," in Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining (KDD'04), Seattle, WA, 2004, pp. 653-658.
17. P. Doyle and J. Snell, "Random walks and electric networks," in Math. Assoc. Amer., 1984.
18. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using gaussian fields and harmonic functions," in Proc. 20th Int. Conf Machine Learning (ICML'03), Washington, DC, 2003.
19. S. C. H. Hoi and M. R. Lyu, "A semi-supervised active learning framework for image retrieval," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2005), San Diego, CA, 2005.
20. J. Zhu, Semi-Supervised Learning Literature Survey Carnegie Mellon Univ., 2005, Tech. Rep..
21. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, 2006.
22. C. Zhai and J. Lafferty, "A study of smoothing methods for language models applied to information retrieval," ACM Trans. Inform Syst., vol. 22, no. 2, pp. 179-214, 2004.
23. S. C. H. Hoi, W. Liu, M. R. Lyu, and W.-Y. Ma, "Learning distance metrics with contextual constraints for image retrieval," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'06), New York, Jun. 17-22, 2006.
24. L. Si, R. Jin, S. C. H. Hoi, and M. R. Lyu, "Collaborative image retrieval via regularized metric learning," ACM Multimedia Syst. J., vol. 12, no. 1, pp. 34-44, 2006.
25. V. N. Vapnik, Statistical Learning Theory. Hoboken, NJ: Wiley, 1998.
26. J. C. Piatt, "Probabilities for support vector machines," Adv. Large Margin Classifiers 1999.
27. P. Over, W. Kraaij, and A. F. Smeaton, "TRECVID 2005 an overview," in Proc. TRECVID Workshop, 2005.
28. S. C. H. Hoi, M. R. Lyu, and R. Jin, "A unified log-based relevance feedback scheme for image retrieval," IEEE Trans. Knowl. Data Eng., vol. 18, no. 4, pp. 509-524, 2006.
29. A. K. Jain and A. Vailaya, "Shape-based retrieval: A case study with trademark image database," Pattern Recognit., no. 9, pp. 1369-1390, 1998.
30. B. S. Manjunath and W. Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 8, pp. 837-842, 1996.
31. J. M. Ponte and W. B. Croft, "A language modeling approach to information retrieval," in Proc. 21st Annu. Int. ACM SIGIR Conf. Research and Development in Information Retrieval, 1998, pp. 275-281.
32. S. E. Robertson and S. Walker, "On relevance weights with little relevance information," in Proc. 20th Int. ACM SIGIR Conf. (SIGIR'97), 1997, pp. 16-24.
33. F. Jelinek and E. L. Mercer, "Interpolated estimation of markov source parameters from sparse data," Pattern Recognit. Practice, 1980.
34. H. Ney, U. Essen, and R. Kneser, "On structuring probabilistic dependencies in stochastic language modeling," Comput. Speech Lang., pp. 1-38, 1994.
35. A. G. Hauptmann, M. Christel, R. Concescu, J. Gao, Q. Jin, W.-H. Lin, J.-Y. Pan, S. M. Stevens, R. Yan, J. Yang, and Y. Zhang, "CMU informedia's trecvid 2005 skirmishes," in Proc. TRECVID Workshop, Washington, DC, 2005.
36. M. Datar, N. Immorlica, P. Indyk, and V. S. Mirrokni, "Locality-sensitive hashing scheme based on p-stable distributions," in Proc. 20th Annu. Symp. Computational Geometry, New York, 2004, pp. 253-262.
37. R. Yan, J. Yang, and A. G. Hauptmann, "Learning query-class dependent weights for automatic video retrieval," in Proc. ACM Multimedia Conf. (MM 2004), 2004.
38. S. Dagtas, W. Al-Khatib, A. Ghafoor, and R. Kashyap, "Models for motion-based video indexing and retrieval," IEEE Trans. Image Process., vol. 9, no. 1, pp. 88-101, Jan. 2000.
39. M. Christel and R. Yan, "Merging storyboard strategies and automatic retrieval for improving interactive video search," in Proc. Int. Conf. Image and Video Retrieval (CIVR), Amsterdam, The Netherlands, 2007.
40. C. Wang, F. Jing, L. Zhang, and H.-J. Zhang, "Image annotation refinement using random walk with restarts," in Proc. 14th ACM Int. Conf. Multimedia, Santa Barbara, CA, 2006, pp. 647-650.
41. S. Tong and E. Y. Chang, "Support vector machine active learning for image retrieval," in Proc. Ninth ACM Int. Conf. Multimedia (MM'01), 2001, pp. 107-118.
42. S. C.H. Hoi, R. Jin, and M. R. Lyu, "Large-scale text categorization by batch mode active learning," in Proc. 15th Int. World Wide Web conference (WWW'06), CITY?, U.K., May 23-26, 2006.
43. S. C. Hoi, R. Jin, and M. R. Lyu, "Learning non-parametric kernel matrices from pairwise constraints," in Proc. 24th Int. Conf. Machine Learning (ICML'07), OR, June 20-24, 2007.
44. N. Panda and E. Y. Chang, "Kdx: An indexer for support vector machines," IEEE Trans. Knowl Data Eng., vol. 18, no. 6, pp. 748-763, 2006.