Learning discriminative localization from weakly labeled data

Pattern Recognition

Volumn 47, Issue 3, 2014, Pages 1523-1534

  Hoai, Minh ^a,d   Torresani, Lorenzo ^b   De La Torre, Fernando ^a   Rother, Carsten ^c  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b Dartmouth College   (United States)

^c DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^d UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Discriminative discovery; Event detection; Image classification; Object detection; Time series classification; Weakly supervised learning

Indexed keywords

DISCRIMINATIVE DISCOVERY; EVENT DETECTION; OBJECT DETECTION; TIME SERIES CLASSIFICATIONS; WEAKLY SUPERVISED LEARNING; ACTION RECOGNITION; OBJECT CLASSIFICATION; TEMPORAL SEGMENTS; VISUAL CATEGORIZATION;

DATA PROCESSING; OBJECT DETECTION; TIME SERIES;

IMAGE CLASSIFICATION;

EID: 84888332800     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.09.028     Document Type: Conference Paper

References (57)

1. S.X. Yu, J. Shi, Object-specific figure-ground segregation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2003.
2. B. Leibe, B. Schiele, Interleaved object categorization and segmentation, in: Proceedings of the British Machine Vision Conference, 2003.
3. E. Borenstein, E. Sharon, S. Ullman, Combining top-down and bottom-up segmentation, in: CVPR Workshop on Perceptual Organization in Computer Vision, 2004
4. Z. Tu, X. Chen, A. Yuille, and S. Zhu Image parsing unifying segmentation, detection and recognition International Journal of Computer Vision 63 2 2005 113 140
5. N. Zlatoff, B. Tellez, and A. Baskurt Combining local belief from low-level primitives for perceptual grouping Pattern Recognition 41 4 2008 1215 1229
6. M. Hoai, Z.-Z. Lan, F. De la Torre, Joint segmentation and classification of human actions in video, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2011.
7. P. Viola, and M. Jones Robust real-time face detection International Journal of Computer Vision 57 2 2004 137 154
8. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005.
9. O. Chum, A. Zisserman, An exemplar model for learning object classes, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2007.
10. M.H. Nguyen, T. Simon, F. De la Torre, J. Cohn, Action unit detection with segment-based SVMs, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010.
11. M. Villamizar, J. Andrade-Cetto, A. Sanfeliu, and F. Moreno-Noguer Bootstrapping boosted random ferns for discriminative and efficient object classification Pattern Recognition 45 9 2012 3141 3153
12. C.H. Lampert, M.B. Blaschko, T. Hofmann, Beyond sliding windows: object localization by efficient subwindow search, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2008.
13. O. Maron, A. Ratan, Multiple-instance learning for natural scene classification, in: Proceedings of the International Conference on Machine Learning, 1998.
14. S. Andrews, I. Tsochantaridis, T. Hofmann, Support vector machines for multiple-instance learning, in: Advances in Neural Information Processing Systems, 2003.
15. R. Fergus, P. Perona, A. Zisserman, Object class recognition by unsupervised scale-invariant learning, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2003.
16. B.C. Russell, A.A. Efros, J. Sivic, W.T. Freeman, A. Zisserman, Using multiple segmentations to discover objects and their extent in image collections, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006.
17. C. Rother, V. Kolmogorov, T. Minka, A. Blake, Cosegmentation of image pairs by histogram matching - incorporating a global constraint into MRFs, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006.
18. D.S. Hochbaum, V. Sing, An efficient algorithm for co-segmentation, in: Proceedings of the International Conference on Computer Vision, 2009.
19. S. Vicente, V. Kolmogorov, C. Rother, Cosegmentation revisited: Models and optimization, in: Proceedings of European Conference on Computer Vision, 2010.
20. L. Cao, L. Fei-Fei, Spatial coherent latent topic model for concurrent object segmentation and classification, in: Proceedings of the International Conference on Computer Vision, 2007.
21. S. Todorovic, N. Ahuja, Extracting subimages of an unknown category from a set of images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006.
22. C. Yang, T. Lozano-Pérez, Image database retrieval with multiple-instance learning techniques, in: International Conference on Data Engineering, 2000.
23. Y. Chen, and J.Z. Wang Image categorization by learning and reasoning with regions Journal of Machine Learning Research 5 2004 913 939
24. X. Qi, and Y. Han Incorporating multiple SVMs for automatic image annotation Pattern Recognition 40 2 2007 728 741
25. Y.-F. Li, J.T. Kwok, I.W. Tsang, Z.-H. Zhou, A convex method for locating regions of interest with multi-instance learning, in: Proceedings of the European Conference on Machine Learning, 2009.
26. R.S. Cabral, F. De la Torre, J.P. Costeira, A. Bernardino, Matrix completion for multi-label image classification, in: Advances in Neural Information Processing Systems, 2011.
27. C. Galleguillos, B. Babenko, A. Rabinovich, S. Belongie, Weakly supervised object recognition and localization with stable segmentations, in: Proceedings of the European Conference on Computer Vision, 2008.
28. B. Babenko, M.-H. Yang, S. Belongie, Visual tracking with online multiple instance learning, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2009.
29. T. Deselaers, B. Alexe, V. Ferrari, Localizing objects while learning their appearance, in: Proceedings of the European Conference on Computer Vision, 2010.
30. M. Blaschko, A. Vedaldi, A. Zisserman, Simultaneous object detection and ranking with weak supervision, in: Proceedings of Neural Information Processing Systems, 2010.
31. M.H. Nguyen, L. Torresani, F. De la Torre, C. Rother, Weakly supervised discriminative localization and classification: a joint learning process, in: Proceedings of the International Conference on Computer Vision, 2009.
32. H. Schweitzer, Utilizing scatter for pixel subspace selection, in: Proceedings of the International Conference on Computer Vision, 1999.
33. M.H. Nguyen, and F. De la Torre Optimal feature selection for support vector machines Pattern Recognition 43 3 2010 584 591
34. P. Felzenszwalb, D. McAllester, D. Ramanan, A discriminatively trained, multiscaled, deformable part model, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2008.
35. M.B. Blaschko, C.H. Lampert, Learning to localize objects with structured output regression, in: Proceedings of the European Conference on Computer Vision, 2008.
36. P. Buehler, M. Everingham, A. Zisserman, Learning sign language by watching TV (using weakly aligned subtitles), in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2009.
37. H. Zhong, J. Shi, M. Visontai, Detecting unusual activity in video, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2004.
38. C. Fanti, L. Zelnik-Manor, P. Perona, Hybrid models for human motion recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2005.
39. J.C. Niebles, H. Wang, and L. Fei-Fei Unsupervised learning of human action categories using spatial-temporal words International Journal of Computer Vision 79 3 2008 299 318
40. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun Large margin methods for structured and interdependent output variables Journal of Machine Learning Research 6 2005 1453 1484
41. C.-N.J. Yu, T. Joachims, Learning structural SVMs with latent variables, in: Proceedings of the International Conference on Machine Learning, 2009.
42. P. Siva, C. Russell, T. Xiang, In defence of negative mining for annotating weakly labelled data, in: Proceedings of the European Conference on Computer Vision, 2012.
43. D. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
44. J. Sivic, A. Zisserman, Video Google: a text retrieval approach to object matching in videos, in: Proceedings of the International Conference on Computer Vision, 2003.
45. I. Laptev, T. Lindeberg, Space-time interest points, in: Proceedings of the International Conference on Computer Vision, 2003.
46. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, in: ICCV Workshop on Visual Surveillance & Performance Evaluation of Tracking and Surveillance, 2005.
47. K. Crammer, and Y. Singer On the algorithmic implementation of multiclass kernel-based vector machines Journal of Machine Learning Research 2 2001 265 292
48. Z. Fu, A. Robles-Kelly, and J. Zhou MILIS multiple instance learning with instance selection IEEE Transactions on Pattern Analysis and Machine Intelligence 33 5 2011 958 977
49. X. Xu, B. Li, Evaluating multi-class multiple-instance learning for image categorization, in: Proceedings of the Asian Conference on Computer Vision, 2007.
50. D. Nistér, H. Stewénius, Scalable recognition with a vocabulary tree, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006.
51. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid Local features and kernels for classification of texture and object categories a comprehensive study International Journal of Computer Vision 73 2 2001 213 238
52. A. Vedaldi, B. Fulkerson, VLFeat: An Open and Portable Library of Computer Vision Algorithms, 2008, 〈 http://www.vlfeat.org/ âŒ.
53. M. Grant, and S. Boyd Graph implementations for nonsmooth convex programs V. Blondel, S. Boyd, H. Kimura, Recent Advances in Learning and Control (A Tribute to M. Vidyasagar), Lecture Notes in Control and Information Sciences 2008 Springer 95 110
54. M. Grant, S. Boyd, CVX: Matlab Software for Disciplined Convex Programming (Web Page & Software), October 2008, 〈 http://stanford.edu/~boyd/cvx âŒ.
55. S. Agarwal, A. Awan, and D. Roth Learning to detect objects in images via a sparse, part-based representation IEEE Transactions on Pattern Analysis and Machine Intelligence 26 2004 1475 1490
56. F. De la Torre, J. Hodgins, J. Montano, S. Valcarcel, J. Macey, Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database, Technical Report, CMU-RI-TR-08-22, Robotics Institute, Carnegie Mellon University, 2008.
57. L. Bao, S.S. Intille, Activity recognition from user-annotated acceleration data, in: International Conference on Pervasive Computing, 2004.