Learning multimodal latent attributes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 2, 2014, Pages 303-316

  Fu, Yanwei ^a   Hospedales, Timothy M ^a   Xiang, Tao ^a   Gong, Shaogang ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Attribute learning; latent attribute space; multitask learning; transfer learning; zero shot learning

Indexed keywords

ATTRIBUTE LEARNING; LATENT ATTRIBUTE SPACE; MULTITASK LEARNING; TRANSFER LEARNING; ZERO-SHOT LEARNING;

OBJECT RECOGNITION;

SEMANTICS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DOCUMENTATION; INFORMATION RETRIEVAL; METHODOLOGY; PHOTOGRAPHY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DOCUMENTATION; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 84891603587     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.128     Document Type: Article

References (44)

1. A. Asuncion, M. Welling, P. Smyth, and Y.W. Teh, "On Smoothing and Inference for Topic Models," Proc. 25th Conf. Uncertainty in Artificial Intelligence, 2009.
2. H. Barrow and J. Tenenbaum, "Recovering Intrinsic Scene Characteristics from Images," Computer Vision Systems, Elsevier, 1978.
3. I. Biederman, "Recognition by Components-A Theory of Human Image Understanding," Psychological Rev., vol. 94, pp. 115-147, 1987.
4. D.M. Blei and M.I. Jordan, "Modeling Annotated Data," Proc. Int'l ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 127-134, 2003.
5. D.M. Blei and J. Lafferty, "A Correlated Topic Model of Science," Annals of Applied Statistics, vol. 1, pp. 17-35, 2007.
6. D.M. Blei and J. McAuliffe, "Supervised Topic Models," Proc. Advances in Neural Information Processing Systems, 2007.
7. D.M. Blei, A.Y. Ng, and M.I. Jordan, "Latent Dirichlet Allocation," J. Machine Learning Research, vol. 3, pp. 993-1022, 2003.
8. L. Cao, S.-F. Chang, N. Codella, C. Cotton, D. Ellis, L. Gong, M. Hill, G. Hua, J. Kender, M. Merler, Y. Mu, A. Natsev, and J.R. Smith, "IBM Research and Columbia University TRECVID-2011 Multimedia Event Detection (Med) System," Proc. NIST TRECVID Workshop, 2011.
9. A. Farhadi, I. Endres, and D. Hoiem, "Attribute-Centric Recognition for Cross-Category Generalization," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 2352-2359, 2010.
10. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth, "Describing Objects by Their Attributes," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2009.
11. Y. Fu, T. Hospedales, T. Xiang, and S. Gong, "Attribute Learning for Understanding Unstructured Social Activity," Proc. European Conf. Computer Vision, 2012.
12. A. Hauptmann, R. Yan, W.-H. Lin, M. Christel, and H. Wactlar, "Can High-Level Concepts Fill the Semantic Gap in Video Retrieval? A Case Study with Broadcast News," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 958-966, Aug. 2007. (Pubitemid 47171252)
13. T. Hospedales, S. Gong, and T. Xiang, "Learning Tags from Unsegmented Videos of Multiple Human Actions," Proc. Int'l Conf. Data Mining, 2011.
14. T. Hospedales, S. Gong, and T. Xiang, "Video Behaviour Mining Using a Dynamic Topic Model," Int'l J. Computer Vision, vol. 98, pp. 303-323, 2011.
15. T. Hospedales, J. Li, S. Gong, and T. Xiang, "Identifying Rare and Subtle Behaviours: A Weakly Supervised Joint Topic Model," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 12, pp. 2451-2464, Dec. 2011.
16. S.J. Hwang, F. Sha, and K. Grauman, "Sharing Features between Objects and Their Attributes," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2011.
17. Y.-G. Jiang, J. Yang, and C.-W. Ngo, "Representations of Keypoint-Based Semantic Concept Detection: A Comprehensive Study," IEEE Trans. Multimedia, vol. 12, no. 1, pp. 42-53, Jan. 2010.
18. Y.-G. Jiang, G. Ye, S.-F. Chang, D. Ellis, and A.C. Loui, "Consumer Video Understanding: A Benchmark Database and an Evaluation of Human and Machine Performance," Proc. ACM Int'l Conf. Multimedia Retrieval, 2011.
19. Y.-G. Jiang, X. Zeng, G. Ye, S. Bhattacharya, D. Ellis, M. Shah, and S.-F. Chang, "Columbia-UCF TRECVID2010 Multimedia Event Detection: Combining Multiple Modalities Contextual Concepts and Temporal Matching," Proc. NIST TRECVID Workshop, 2010.
20. P. Kankuekul, A. Kawewong, S. Tangruamsub, and O. Hasegawa, "Online Incremental Attribute-Based Zero-Shot Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2012.
21. N. Kumar, A.C. Berg, P.N. Belhumeur, and S.K. Nayar, "Attribute and Simile Classifiers for Face Verification," Proc. IEEE Int'l Conf. Computer Vision, 2009.
22. C.H. Lampert, H. Nickisch, and S. Harmeling, "Learning to Detect Unseen Object Classes by Between-Class Attribute Transfer," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2009.
23. I. Laptev, "On Space-Time Interest Points," Int'l J. Computer Vision, vol. 64, pp. 107-123, Sept. 2005. (Pubitemid 41314645)
24. J. Liu, B. Kuipers, and S. Savarese, "Recognizing Human Actions by Attributes," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2011.
25. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, pp. 91-110, 2004.
26. D. Mahajan, S. Sellamanickam, and V. Nair, "A Joint Learning Framework for Attribute Models and Object Descriptions," Proc. IEEE Int'l Conf. Computer Vision, pp. 1227-1234, 2011.
27. D. Mimno, H.M. Wallach, J. Naradowsky, D.A. Smith, and A. McCallum, "Polylingual Topic Models," Proc. Conf. Empirical Methods on Natural Language Processing, 2009.
28. D. Newman, A. Asuncion, and P. Smyth, "Distributed Algorithms for Topic Models," J. Machine Learning Research, vol. 10, pp. 1801-1828, 2009.
29. J.C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words," Int'l J. Computer Vision, vol. 79, no. 3, pp. 299-318, 2008.
30. M. Palatucci, G. Hinton, D. Pomerleau, and T.M. Mitchell, "Zero-Shot Learning with Semantic Output Codes," Proc. Advances in Neural Information Processing Systems, 2009.
31. D. Parikh and K. Grauman, "Interactively Building a Discriminative Vocabulary of Nameable Attributes," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2011.
32. G.-J. Qi, X.-S. Hua, Y. Rui, J. Tang, T. Mei, and H.-J. Zhang, "Correlative Multi-Label Video Annotation," Proc. ACM Int'l Conf. Multimedia, 2007.
33. R. Salakhutdinov, A. Torralba, and J. Tenenbaum, "Learning to Share Visual Appearance for Multiclass Object Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2011.
34. C.G.M. Snoek, B. Huurnink, L. Hollink, M. deRijke, G. Schreiber, and M. Worring, "Adding Semantics to Detectors for Video Retrieval," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 975-986, Aug. 2007. (Pubitemid 47171254)
35. A. Sorokin and D. Forsyth, "Utility Data Annotation with Amazon Mechanical Turk," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR Workshops), 2008.
36. J. Tang, X.-S. Hua, M. Wang, Z. Gu, G.-J. Qi, and X. Wu, "Correlative Linear Neighborhood Propagation for Video Annotation," IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 39, no. 2, pp. 409-416, Apr. 2009.
37. J. Tang, S. Yan, R. Hong, G.-J. Qi, and T.-S. Chua, "Inferring Semantic Concepts from Community-Contributed Images and Noisy Tags," Proc. ACM Int'l Conf. Multimedia, 2009.
38. G. Toderici, H. Aradhye, M. Pasca, L. Sbaiz, and J. Yagnik, "Finding Meaning on Youtube: Tag Recommendation and Category Discovery," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 3447-3454, 2010.
39. C. Wang, D. Blei, and F.-F. Li, "Simultaneous Image Classification and Annotation," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2009.
40. Y. Wang and G. Mori, "Human Action Recognition by Semilatent Topic Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 10, pp. 1762-1774, Oct. 2009.
41. K. Yang, X.-S. Hua, M. Wang, and H.-J. Zhang, "Tag Tagging: Towards More Descriptive Keywords of Image Content," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 662-673, Aug. 2011.
42. Y. Yang and J.O. Pedersen, "A Comparative Study on Feature Selection in Text Categorization," Proc. Int'l Conf. Machine Learning, 1997.
43. X. Yu and Y. Aloimonos, "Attribute-Based Transfer Learning for Object Categorization with Zero/One Training Example," Proc. European Conf. Computer Vision, 2010.
44. X. Zhu, "Semi-Supervised Learning Literature Survey," Technical Report 1530, Dept. of Computer Science, Univ. of Wisconsin-Madison, 2007.