Augmented multiple instance regression for inferring object contours in bounding boxes

IEEE Transactions on Image Processing

Volumn 23, Issue 4, 2014, Pages 1722-1736

  Hsu, Kuang Jui ^a   Lin, Yen Yu ^a   Chuang, Yung Yu ^b  

^a RESEARCH CENTER FOR INFORMATION TECHNOLOGY INNOVATION   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

multiple instance regression (MIR); segment selection; Semantic segmentation; weakly supervised learning

Indexed keywords

REGRESSION ANALYSIS;

CONDITIONAL RANDOM FIELD; MULTIPLE INSTANCE REGRESSIONS (MIR); MULTIPLE INSTANCES; POSITIVE INSTANCES; SEGMENT SELECTION; SEMANTIC SEGMENTATION; TRAINING DATA SETS; WEAKLY SUPERVISED LEARNING;

IMAGE SEGMENTATION;

EID: 84896443073     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2307436     Document Type: Article

References (54)

1. X. Boix, J. M. Gonfaus, J. van de Weijer, A. D. Bagdanov, J. S. Gual, and J. Gonzàlez, "Harmony potentials-Fusing global and local scale for semantic image segmentation," Int. J. Comput. Vis., vol. 96, no. 1, pp. 83-102, 2012.
2. C. Cheng, A. Koschan, C.-H. Chen, D. L. Page, and M. A. Abidi, "Outdoor scene image segmentation based on background recognition and perceptual organization," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1007-1019, Mar. 2012.
3. J. Carreira, F. Li, and C. Sminchisescu, "Object recognition by sequential figure-ground ranking," Int. J. Comput. Vis., vol. 98, no. 3, pp. 243-262, 2012.
4. J. Shotton, J. Winn, A. Criminisi, and T. Darrell, "TextonBoost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context," Int. J. Comput. Vis., vol. 81, no. 1, pp. 2-23, 2009.
5. P. Kohli, L. Ladický, and P. H. S. Torr, "Robust higher order potentials for enforcing label consistency," Int. J. Comput. Vis., vol. 82, no. 3, pp. 302-324, 2009.
6. N. Payet and S. Todorovic, "Hough forest random field for object recognition and segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 5, pp. 1066-1079, May 2013.
7. Q. Zhou, J. Zhu, and W. Liu, "Learning dynamic hybrid Markov random field for image labeling," IEEE Trans. Image Process., vol. 22, no. 6, pp. 2219-2232, Jun. 2013.
8. P. Arbelaez, B. Hariharan, C. Gu, S. Gupta, L. D. Bourdev, and J. Malik, "Semantic segmentation using regions and parts," in Proc. Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3378-3385.
9. J. Carreira, R. Caseiro, J. Batista, and C. Sminchisescu, "Semantic segmentation with second-order pooling," in Proc. Eur. Conf. Comput. Vis., Oct. 2012, pp. 430-443.
10. B. Fulkerson, A. Vedaldi, and S. Soatto, "Class segmentation and object localization with superpixel neighborhoods," in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 670-677.
11. L. Ladický, C. Russell, P. Kohli, and P. Torr, "Associative hierarchical CRFs for object class image segmentation," in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 739-746.
12. L. Ladický, C. Russell, P. Kohli, and P. H. S. Torr, "Graph cut based inference with co-occurrence statistics," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 239-253.
13. C. Pantofaru, C. Schmid, and M. Hebert, "Object recognition by integrating multiple image segmentations," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 481-494.
14. J. Shotton, M. Johnson, and R. Cipolla, "Semantic texton forests for image categorization and segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
15. A. Vezhnevets, V. Ferrari, and J. M. Buhmann, "Weakly supervised structured ouput learning for semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 845-852.
16. J. Yao, S. Fidler, and R. Urtasun, "Describing the scene as a whole: Joint object detection, scene classification and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 702-709.
17. J. Tighe and S. Lazebnik, "Superparsing-Scalable nonparametric image parsing with superpixels," Int. J. Comput. Vis., vol. 101, no. 2, pp. 329-349, 2013.
18. A. Müller and S. Behnke, "Multi-instance methods for partially supervised image segmentation," in Proc. IAPRW Partially Supervised Learn., 2011, pp. 110-119.
19. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
20. S. Chen, L. Cao, Y. Wang, J. Liu, and X. Tang, "Image segmentation by MAP-ML estimations," IEEE Trans. Image Process., vol. 19, no. 9, pp. 2254-2264, Sep. 2010.
21. M. Mignotte, "A label field fusion Bayesian model and its penalized maximum rand estimator for image segmentation," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1610-1624, Jun. 2010.
22. A. K. Qin and D. A. Clausi, "Multivariate image segmentation using semantic region growing with adaptive edge penalty," IEEE Trans. Image Process., vol. 19, no. 8, pp. 2157-2170, Aug. 2010.
23. M. B. Salah, A. Mitiche, and I. B. Ayed, "Multiregion image segmentation by parametric kernel graph cuts," IEEE Trans. Image Process., vol. 20, no. 2, pp. 545-557, Feb. 2011.
24. C. Panagiotakis, I. Grinias, and G. Tziritas, "Natural image segmentation based on tree equipartition, Bayesian flooding and region merging," IEEE Trans. Image Process., vol. 20, no. 8, pp. 2276-2287, Aug. 2011.
25. S. Wang and J. M. Siskind, "Image segmentation with ratio cut," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 6, pp. 675-690, Jun. 2003.
26. S. Xiang, C. Pan, F. Nie, and C. Zhang, "TurboPixel segmentation using eigen-images," IEEE Trans. Image Process., vol. 19, no. 11, pp. 3024-3034, Nov. 2010.
27. J. D. Lafferty, A. McCallum, and F. C. N. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. 18th Int. Conf. Mach. Learn., 2001, pp. 282-289.
28. C. Sutton and A. McCallum, An Introduction to Conditional Random Fields for Relational Learning. Cambridge, MA, USA: MIT Press, 2006.
29. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL visual object classes (VOC) challenge," Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, Jun. 2010.
30. V. S. Lempitsky, P. Kohli, C. Rother, and T. Sharp, "Image segmentation with a bounding box prior," in Proc. Int. Conf. Comput. Vis., 2009, pp. 277-284.
31. C. Galleguillos, B. Babenko, A. Rabinovich, and S. Belongie, "Weakly supervised object localization with stable segmentations," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 193-207.
32. J. Carreira and C. Sminchisescu, "CPMC: Automatic object segmentation using constrained parametric min-cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1312-1328, Jul. 2012.
33. T. G. Dietterich, R. H. Lathrop, and T. Lozano-Pérez, "Solving the multiple instance problem with axis-parallel rectangles," Artif. Intell., vol. 89, nos. 1-2, pp. 31-71, 1997. (Pubitemid 127412230)
34. G. Takács, "Smooth maximum function based algorithms for classification, regression, and collaborative filtering," Acta Tech. Jaurinensis, Ser. Comput. Intell., vol. 3, no. 1, pp. 27-63, 2010.
35. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
36. C. Rother, V. Kolmogorov, and A. Blake, "'GrabCut': Interactive foreground extraction using iterated graph cuts," ACM Trans. Graph., vol. 23, no. 3, pp. 309-314, Aug. 2004.
37. T. Cour and J. Shi, "Recognizing objects by piecing together the segmentation puzzle," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
38. B. Alexe, T. Deselaers, and V. Ferrari, "ClassCut for unsupervised class segmentation," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 380-393.
39. R. Unnikrishnan, C. Pantofaru, and M. Hebert, "Toward objective evaluation of image segmentation algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 929-944, Jun. 2007. (Pubitemid 46667408)
40. J.-Z. Cheng, F.-J. Chang, K.-J. Hsu, and Y.-Y. Lin, "Knowledge leverage from contours to bounding boxes: A concise approach to annotation," in Proc. Asian Conf. Comput. Vis., 2012, pp. 730-744.
41. I. Endres and D. Hoiem, "Category independent object proposals," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 575-5588.
42. M. P. Kumar, H. Turki, D. Preston, and D. Koller, "Learning specificclass segmentation from diverse data," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1800-1807.
43. D. Kuettel and V. Ferrari, "Figure-ground segmentation by transferring window masks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 558-565.
44. Y. Chen, A. B. Chan, and G. Wang, "Adaptive figure-ground classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 654-661.
45. Z. Kuang, D. Schnieders, H. Zhou, K.-Y. K. Wong, Y. Yu, and B. Peng, "Learning image-specific parameters for interactive segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 590-597.
46. P. A. Viola, J. C. Platt, and C. Zhang, "Multiple instance boosting for object detection," in Proc. Adv. NIPS, 2005, pp. 1417-1426.
47. Q. Zhang, S. Goldman, W. Yu, and J. E. Fritts, "Content-based image retrieval using multiple-instance learning," in Proc. Int. Conf. Mach. Learn., 2002, pp. 682-689.
48. F. Li and C. Sminchisescu, "Convex multiple-instance learning by estimating likelihood ratio," in Proc. Adv. NIPS, Dec. 2010, pp. 1360-1368.
49. S. Ray and D. Page, "Multiple instance regression," in Proc. Int. Conf. Mach. Learn., 2001, pp. 425-432.
50. P.-M. Cheung and J. T. Kwok, "A regularization framework for multipleinstance learning," in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 193-200.
51. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
52. C. Liu, J. Yuen, and A. Torralba, "SIFT Flow: Dense correspondence across scenes and its applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 978-994, May 2011.
53. M. Varma and A. Zisserman, "Classifying images of materials: Achieving viewpoint and illumination independence," in Proc. 7th Eur. Conf. Comput. Vis., 2002, pp. 255-271.
54. A. Joulin, F. R. Bach, and J. Ponce, "Discriminative clustering for image co-segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1943-1950.