Contextual bag-of-words for visual categorization

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 4, 2011, Pages 381-392

  Li, Teng ^a   Mei, Tao ^b   Kweon, In So ^a   Hua, Xian Sheng ^b  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

Bag of words; conceptual relation; local patches context; neighboring relation

Indexed keywords

AUTOMATIC TERM EXTRACTION; BAG OF WORDS; BAYESIAN; CLASS DISTRIBUTIONS; CONCEPTUAL RELATIONS; HUMAN BEING; LOCAL PATCHES CONTEXT; NEIGHBORING RELATION; SCENE CATEGORIZATION; SEMANTIC LEVELS; VIDEO EVENTS; VISUAL CATEGORIZATION; VISUAL VOCABULARIES; VISUAL WORD;

SEMANTICS;

EID: 79953759316     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2010.2041828     Document Type: Article

References (43)

1. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vision, vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
2. L. D. Baker and A. K. McCallum, "Distributional clustering of words for text classification," in Proc. Assoc. Comput. Machinery Special Interest Group Informat. Retrieval (SIGIR), 1998, pp. 96-103.
3. R. Bekkerman, R. El-Yaniv, N. Tishby, and Y. Winter, "On feature distributional clustering for text categorization," in Proc. Assoc. Comput. Machinery Special Interest Group Informat. Retrieval (SIGIR), 2001, pp. 146-153. (Pubitemid 32951067)
4. A. Berg, T. Berg, and J. Malik, "Shape matching and object recognition using low distortion correspondences," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2005, pp. 26-33.
5. M. R. Boutell, J. Luo, and C. M. Brown, "Scene parsing using regionbased generative models," IEEE Trans. Multimedia, vol. 9, no. 1, pp. 136-146, Jan. 2007. (Pubitemid 46103856)
6. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/∼cjlin/libsvm
7. O. Chapelle, P. Haffner, and V. N. Vapnik, "Support vector machines for histogram-based image classification," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1055-1064, Sep. 1999.
8. G. Csurka, C. Dance, L. Fan, J. Williamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Statist. Learning Comput. Vision Workshop (SLCV), 2004, pp. 1-22.
9. C. Wallraven, B. Caputo, and A. Graf, "Recognition with local features: The kernel recipe," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), 2003, pp. 257-264.
10. L. Fei-Fei, R. Fergus, and P. Perona, "A bayesian hierarchical model for learning natural scene categories," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2005, pp. 524-531.
11. K. Grauman and T. Darrell, "Pyramid match kernels: Discriminative classification with sets of image features," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), 2005, pp. 1458-1465. (Pubitemid 44042350)
12. M. John, F. Kubala, R. Schwartz, and R. Weischedel, "Performance measures for information extraction," in Proc. Defense Advanced Research Projects Agency (DARPA) Broadcast News Workshop, 1999, pp. 249-252.
13. F. Jurie and B. Triggs, "Creating efficient codebooks for visual recognition," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), Beijing, China, 2005, pp. 604-610. (Pubitemid 44055011)
14. Y. Ke and R. Sukthankar, "Pca-sift: A more distinctive representation for local image descriptors," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2004, pp. 506-513.
15. S. Kullback, "The Kullback-Leibler distance," Am. Statistician, vol. 41, no. 4, pp. 340-341, 1987.
16. S. Lazebnik and M. Raginsky, "Supervised learning of quantizer codebooks by information loss minimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 7, pp. 1294-1309, Jul. 2009.
17. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2006, pp. 2169-2678.
18. B. Leibe, A. Leonardis, and B. Schiele, "Robust object detection with interleaved categorization and segmentation," Int. J. Comput. Vision Special Issue Learn. Recognit. Recognit. Learn., vol. 77, nos. 1-3, pp. 259-289, 2008.
19. D. Liu and T. Chen, "Discov: A framework for discovering objects in video," IEEE Trans. Multimedia, vol. 10, no. 2, pp. 200-208, Feb. 2008.
20. J. Liu and M. Shah, "Scene modeling using co-clustering," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), 2007, pp. 1-7.
21. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
22. T. Mei, X.-S. Hua, W. Lai, L. Yang, Z.-J. Zha, Y. Liu, Z. Gu, G.-J. Qi, M. Wang, J. Tang, X. Yuan, Z. Lu, and J. Liu, "MSRA-USTC-SJTU at TRECVID 2007: High-level feature extraction and search," in Proc. Text Retrieval Conf. Video Retrieval Evaluation Online (TRECVID), 2007 [Online]. Available: http://wwwnlpir. nist.gov/projects/tvpubs/tv.pubs.org.html#2007
23. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1615-1630, Oct. 2005. (Pubitemid 41555406)
24. F. Moosmann, B. Triggs, and F. Jurie, "Fast discriminative visual codebooks using randomized clustering forests," in Proc. Adv. Neural Informat. Process. Syst. (NIPS), 2006, pp. 985-992.
25. J. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," Int. J. Comput. Vision, vol. 79, no. 3, pp. 299-318, 2008.
26. D. Nist́er and H. Steẃenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2006, pp. 2161-2168. (Pubitemid 44931581)
27. E. Nowak, F. Jurie, and B. Triggs, "Sampling strategies for bagof-features image classification," in Proc. Eur. Conf. Comput. Vision (ECCV), Graz, Austria, 2006, pp. 490-503. (Pubitemid 44029653)
28. Pascal visual object classes [Online]. Available: http://pascallin. ecs.soton.ac.uk/challenges/VOC/.
29. Wordnet [Online]. Available: http://wordnet.princeton.edu/perl/webwn? s=word-you-want
30. J. Sivic, B. Russell, A. Efros, A. Zisserman, and B. Freeman, "Discovering objects and their locations in images," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), Beijing, China, 2005, pp. 370-377. (Pubitemid 44054982)
31. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), 2003, pp. 1470-1477.
32. E. B. Sudderth, A. Torralba,W. T. Freeman, and A. S.Willsky, "Learning hierarchical models of scenes, objects, and parts," in Proc. IEEE Int. Conf. Comput. Vision (ICCV), 2005, pp. 1331-1338. (Pubitemid 44042334)
33. Trec Video Retrieval Evaluations (TRECVID) [Online]. Available: http://www.nlpir.nist.gov/projects/trecvid/
34. J. Winn, A. Criminisi, and T. Minka, "Object categorization by learned universal visual dictionary," in Proc. IEEE Int. Conf. Comput. Vision, 2005, pp. 1800-1807. (Pubitemid 44042395)
35. L. Wu, Y. Hu, M. Li, N. Yu, and X.-S. Hua "Scale-invariant visual language modeling for object categorization," IEEE Trans. Multimedia, vol. 11, no. 2, pp. 286-294, Feb. 2009.
36. X. Wu, W.-L. Zhao, and C.-W. Ngo, "Near-duplicate keyframe retrieval with visual keywords and semantic context," in Proc. Assoc. Comput. Machinery Int. Conf. Image Video Retrieval (ACM MIR), 2007, pp. 162-169. (Pubitemid 350229623)
37. A. Yanagawa, S. F. Chang, L. Kennedy, and W. Hsu, "Columbia University's baseline detectors for 374 LSCOM semantic visual concepts," Columbia Univ., New York, ADVENT Tech. Rep. 222-2006-8, 2007.
38. J. Yang, Y.-G. Jiang, A. G. Hauptmann, and C.-W. Ngo, "Evaluating bagof-visual-words representations in scene classification," in Proc. Assoc. Comput. Machinery Int. Conf. Multimedia Informat. Retrieval (ACM MIR), Augsburg, Germany, 2007, pp. 197-206.
39. Y. Yang and J. O. Pedersen, "A comparative study on feature selection in text categorization," in Proc. Int. Conf. Machine Learn. (ICML), 1997, pp. 412-420.
40. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object categories: A comprehensive study," Int. J. Comput. Vision, vol. 73, no. 2, pp. 213-238, 2007. (Pubitemid 46181625)
41. S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li, "Descriptive visual words and visual phrases for image applications," in Proc. 17th Assoc. Comput. Machinery Int. Conf. Multimedia (ACM MM), Beijing, China, 2009, pp. 75-84.
42. Q. Zheng, W. Wang, and W. Gao, "Effective and efficient objectbased image retrieval using visual phrases," in Proc. Assoc. Comput. Machinery Int. Conf. Multimedia (ACM MM), Santa Barbara, CA, 2006, pp. 77-80. (Pubitemid 47113508)
43. M. Zhu, "Recall, precision, and average precision," Dept. Statistics Actuarial Sci., Univ. Waterloo, CA, Tech. Rep. 9, 2004.