Bayesian Joint Modelling for Object Localisation in Weakly Labelled Images

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 10, 2015, Pages 1959-1972

  Shi, Zhiyuan ^a   Hospedales, Timothy M ^a   Xiang, Tao ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Bayesian Domain Transfer; Object Detection; Probabilistic Modelling; Topic Modelling; Weakly Supervised Learning

Indexed keywords

BAYESIAN NETWORKS; OBJECT DETECTION;

BAYESIAN DOMAINS; BAYESIAN FORMULATION; DISCRIMINATIVE MODELS; FOREGROUND OBJECTS; GENERATIVE MODEL; PROBABILISTIC MODELLING; TRANSFER LEARNING; WEAKLY SUPERVISED LEARNING;

OBJECT RECOGNITION;

EID: 84941089808     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2392769     Document Type: Article

References (72)

1. J. Deng, A. C. Berg, K. Li, and L. Fei-Fei, "What does classifying more than 10,000 image categories tell us? " in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 71-84.
2. T. Hospedales, J. Li, S. Gong, and T. Xiang, "Identifying rare and subtle behaviors: A weakly supervised joint topic model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 12, pp. 2451-2464, Dec. 2011.
3. V. Lempitsky, P. Kohli, C. Rother, and T. Sharp, "Image segmentation with a bounding box," in Proc. Int. Conf. Comput. Vis., 2009, pp. 277-284.
4. M. Nguyen, L. Torresani, F. de la Torre, and C. Rother, "Weakly supervised discriminative localization and classification: A joint learning process," in Proc. Int. Conf. Comput. Vis., 2009, pp. 1925-1932.
5. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
6. P. Dollár, B. Babenko, S. Belongie, P. Perona, and Z. Tu, "Multiple component learning for object detection," in Proc. 10th Eur. Conf. Comput. Vis., 2008, pp. 211-224.
7. D. Kuettel, M. Guillaumin, and V. Ferrari, "Segmentation propagation in ImageNet," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 459-473.
8. M. Rubinstein, A. Joulin, J. Kopf, and C. Liu, "Unsupervised joint object discovery and segmentation in internet images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 1939-1946.
9. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, The PASCAL visual object classes Challenge 2007 (VOC2007) results [Online]. Available: http://www.pascalnetwork. org/challenges/VOC/voc2007/workshop/index.html, 2007.
10. M. Guillaumin and V. Ferrari, "Large-scale knowledge transfer for object localization in ImageNet," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3202-3209.
11. T. Deselaers, B. Alexe, and V. Ferrari, "Weakly supervised localization and learning with generic knowledge," Int. J. Comput. Vis., vol. 100, pp. 275-293, 2012.
12. P. Siva, C. Russell, and T. Xiang, "In defence of negative mining for annotating weakly labelled data," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 594-608.
13. M. Pandey and S. Lazebnik, "Scene recognition and weakly supervised object localization with deformable part-based models," in Proc. Int. Conf. Comput. Vis., 2011, pp. 1307-1314.
14. C. Galleguillos, B. Babenko, A. Rabinovich, and S. Belongie, "Weakly supervised object recognition and localization with stable segmentations," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 193-207.
15. K. Tang, A. Joulin, L.-J. Li, and L. Fei-Fei, "Co-localization in realworld images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1464-1471.
16. R. Salakhutdinov, A. Torralba, and J. Tenenbaum, "Learning to share visual appearance for multiclass object detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1481-1488.
17. A. Prest, C. Leistner, J. Civera, C. Schmid, and V. Ferrari, "Learning object class detectors from weakly annotated video," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3282-3289.
18. A. Torralba and A. Efros, "Unbiased look at dataset bias," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1521-1528.
19. X. Zhu, "Semi-supervised learning literature survey," Dept. Comput. Sci., Univ. Wisconsin-Madison, Tech. Rep. 1530, 2007.
20. P. Siva and T. Xiang, "Weakly supervised object detector learning with model drift detection," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 343-350.
21. Z. Shi, P. Siva, and T. Xiang, "Transfer learning by ranking for weakly supervised object annotation," presented at the British Machine Vision Conf., Guildford, U.K., 2012.
22. D. Crandall and D. Huttenlocher, "Weakly supervised learning of part-based spatial models for visual object recognition," in Proc. 9th Eur. Conf. Comput. Vis., 2006, pp. 16-29.
23. A. Joulin, K. Tang, and L. Fei-Fei, "Efficient image and video colocalization with Frank-Wolfe algorithm," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 253-268.
24. O. Maron and T. Lozano-Prez, "A framework for multipleinstance learning," in Proc. Conf. Adv. Neural Inf. Process. Syst., 1998, pp. 570-576.
25. S. Andrews, I. Tsochantaridis, and T. Hofmann, "Support vector machines for multiple-instance learning," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 561-568.
26. N. Nguyen, "A new SVM approach to multi-instance multilabel learning," in Proc. IEEE 10th Int. Conf. Data Mining, 2010, pp. 384-392.
27. B. Alexe, T. Deselaers, and V. Ferrari, "Measuring the objectness of image windows," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2189-2202, Nov. 2012.
28. K. Tang, V. Ramanathan, L. Fei-Fei, and D. Koller, "Shifting weights: Adapting object detectors from image to video," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 647-655.
29. B. Alexe, T. Deselaers, and V. Ferrari, "What is an object?" in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 73-80.
30. D. Kuettel and V. Ferrari, "Figure-ground segmentation by transferring window masks," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 558-565.
31. A. Zweig and D. Weinshall, "Exploiting object hierarchy: Combining models from different category levels," in Proc. IEEE 11th Int. Conf. Comput. Vis., 2007, pp. 1-8.
32. M. Rohrbach, M. Stark, and B. Schiele, "Evaluating knowledge transfer and zero-shot learning in a large-scale setting," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1641-1648.
33. T. Pedersen, S. Patwardhan, and J. Michelizzi, "Wordnet:: Similarity: Measuring the relatedness of concepts," presented at the Demonstration Papers at HLT-NAACL 2004, Stroudsburg, PA, USA, 2004.
34. L. Cao, Z. Liu, and T. Huang, "Cross-dataset action detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 1998-2005.
35. S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345-1359, Oct. 2010.
36. J. Yang, R. Yan, and A. G. Hauptmann, "Cross-domain video concept detection using adaptive SVMs," in Proc. 15th Int. Conf. Multimedia, 2007, pp. 188-197.
37. L. T. Alessandro Bergamo, "Exploiting weakly-labeled web images to improve object classification: A domain adaptation approach," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 181-189.
38. L. Jie, T. Tommasi, and B. Caputo, "Multiclass transfer learning from unconstrained priors," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 1863-1870.
39. J. Donahue, J. Hoffman, E. Rodner, K. Saenko, and T. Darrell, "Semi-supervised domain adaptation with instance constraints," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 668-675.
40. W. Dai, G.-R. Xue, Q. Yang, and Y. Yu, "Transferring naive Bayes classifiers for text classification," in Proc. 22nd Nat. Conf. Artif. Intell., 2007, pp. 540-545.
41. M. B. Blaschko, A. Vedaldi, and A. Zisserman, "Simultaneous object detection and ranking with weak supervision," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 235-243.
42. K. Tang, R. Sukthankar, J. Yagnik, and L. Fei-Fei, "Discriminative segment annotation in weakly labeled video," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2013, pp. 2483-2490.
43. G. Hartmann, M. Grundmann, J. Hoffman, D. Tsai, V. Kwatra, O. Madani, S. Vijayanarasimhan, I. Essa, J. Rehg, and R. Sukthankar, "Weakly supervised learning of object segmentations from web-scale video," in Proc. 12th Int. Conf. Comput. Vis., 2012, pp. 198-208.
44. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
45. J. Philbin, J. Sivic, and A. Zisserman, "Geometric latent Dirichlet allocation on a matching graph for large-scale image datasets," Int. J. Comput. Vis., vol. 95, pp. 138-153, 2011.
46. J. Sivic, B. C. Russell, A. A. Efros, A. Zisserman, and W. T. Freeman, "Discovering object categories in image collections," in Proc. Int. Conf. Comput. Vis., 2005, pp. 370-377.
47. L. Fei-Fei, R. Fergus, and P. Perona, "One-shot learning of object categories," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 594-611, Apr. 2006.
48. L. Cao and L. Fei-Fei, "Spatially coherent latent topic model for concurrent object segmentation and classification," in Proc. IEEE 11th Int. Conf. Comput. Vis., 2007, pp. 1-8.
49. L.-J. Li, R. Socher, and L. Fei-Fei, "Towards total scene understanding: Classification, annotation and segmentation in an automatic framework," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2009, pp. 2036-2043.
50. C. Wang, D. Blei, and L. Fei-Fei, "Simultaneous image classification and annotation," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2009, pp. 1903-1910.
51. N. Rasiwasia and N. Vasconcelos, "Latent Dirichlet allocation models for image classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2665-2679, Nov. 2013.
52. D. M. Blei and M. I. Jordan, "Modeling annotated data," in Proc. 26th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2003, pp. 127-134.
53. R. S. Cabral, F. De la Torre, J. P. Costeira, and A. Bernardino, "Matrix completion for multi-label image classification," in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 190-198.
54. Z. Zhou and M. Zhang, "Multi-instance multilabel learning with application to scene classification," in Proc. Adv. Neural Inf. Process. Syst., 2007, pp. 1609-1616.
55. Z.-J. Zha, X.-S. Hua, T. Mei, J. Wang, G.-J. Qi, and Z. Wang, "Joint multi-label multi-instance learning for image classification," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
56. E. B. Sudderth, A. Torralba, W. T. Freeman, and A. S. Willsky, "Describing visual scenes using transformed objects and parts," Int. J. Comput. Vis., vol. 77, pp. 291-330, 2008.
57. P. V. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. IEEE 12th Int. Conf. Comput. Vis., 2009, pp. 221-228.
58. P. Gehler and S. Nowozin, "Let the kernel figure it out; principled learning of pre-processing for kernel classifiers," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 2836-2843.
59. F. Orabona, L. Jie, and B. Caputo, "Online-batch strongly convex multi kernel learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 787-794.
60. P. Siva, C. Russell, T. Xiang, and L. Agapito, "Looking beyond the image: Unsupervised learning for object saliency and detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2013, pp. 3238-3245.
61. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 248-255.
62. Z. Shi, T. M. Hospedales, and T. Xiang, "Bayesian joint topic modelling for weakly supervised object localisation," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 2984-2991.
63. J. Winn and C. M. Bishop, "Variational message passing," J. Mach. Learning Res., vol. 6, pp. 661-694, 2005.
64. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
65. J. Gall, A. Yao, N. Razavi, L. Van Gool, and V. Lempitsky, "Hough forests for object detection, tracking, and action recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, pp. 2188-2202, 2011.
66. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution grayscale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
67. J. Zhu, J. Wu, Y. Xu, E. Chang, and Z. Tu, "Unsupervised object class discovery via saliency-guided multiple class learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. PP, no. 99, p. 1, 2014, doi: 10.1109/TPAMI.2014.2353617.
68. R. Cinbis, J. Verbeek, and C. Schmid, "Multi-fold mil training for weakly supervised object localization," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 2409-2416.
69. C. Fellbaum, WordNet: An Electronic Lexical Database. Denver, CO, USA: Bradford Books, 1998.
70. A. Vezhnevets and V. Ferrari, "Associative embeddings for largescale knowledge transfer with self-assessment," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1987-1994.
71. A. Papazoglou and V. Ferrari, "Fast object segmentation in unconstrained video," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1777-1784.
72. Y. Fu, T. Hospedales, T. Xiang, and S. Gong, "Attribute learning for understanding unstructured social activity," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 530-543.