Learning to Segment Human by Watching YouTube

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 39, Issue 7, 2017, Pages 1462-1468

  Liang, Xiaodan ^a,b   Wei, Yunchao ^d   Lin, Liang ^a,b   Chen, Yunpeng ^e   Shen, Xiaohui ^e   Yang, Jianchao ^c   Yan, Shuicheng ^e  

^a SUN YAT SEN UNIVERSITY   (China)

^b Engineering Research Center   (China)

^c ADOBE RESEARCH   (United States)

^d SNAP INC   (United States)

^e NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

convolutional neural network; Human segmentation; incremental learning; weakly supervised learning

Indexed keywords

CONVOLUTION; DEEP NEURAL NETWORKS; ITERATIVE METHODS; NEURAL NETWORKS; SEMANTICS; SUPERVISED LEARNING;

CONVOLUTIONAL NEURAL NETWORK; GRAPH OPTIMIZATION; HUMAN SEGMENTATION; INCREMENTAL LEARNING; SEMANTIC SEGMENTATION; STATE-OF-THE-ART PERFORMANCE; VIDEO SEGMENTATION; WEAKLY SUPERVISED LEARNING;

IMAGE SEGMENTATION;

EID: 85020433163     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2016.2598340     Document Type: Article

References (38)

1. J. Dai, K. He, and J. Sun, "BoxSup: Exploiting bounding boxes to supervise convolutional networks for semantic segmentation," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1635-1643.
2. G. Papandreou, L.-C. Chen, K. Murphy, and A. L. Yuille, "Weakly-and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1742-1750.
3. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 3431-3440.
4. S. Zheng, et al., "Conditional random fields as recurrent neural networks," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1529-1537.
5. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in Proc. Int. Conf. Learn. Representations, arXiv:1409.1556, 2015.
6. O. Russakovsky, et al., "ImageNet large scale visual recognition challenge," Int. J. Comput. Vis., vol. 115, no. 3, pp. 211-252, 2015.
7. S. D. Jain and K. Grauman, "Supervoxel-consistent foreground propagation in video," in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 656-671.
8. K. Tang, R. Sukthankar, J. Yagnik, and L. Fei-Fei, "Discriminative segment annotation in weakly labeled video," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2483-2490.
9. D. Zhang, O. Javed, and M. Shah, "Video object segmentation through spatially accurate and temporally dense extraction of primary object regions," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 628-635.
10. C. Xu, C. Xiong, and J. J. Corso, "Streaming hierarchical video segmentation," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 626-639.
11. X. Liang, S. Liu, Y. Wei, L. Liu, L. Lin, and S. Yan, "Towards computational baby learning: A weakly-supervised approach for object detection," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 999-1007.
12. J. Pont-Tuset, P. Arbel-aez, J. Barron, F. Marques, and J. Malik, "Multiscale combinatorial grouping for image segmentation and object proposal generation," IEEE Trans. Pattern Ana. Machine Intel., 2016, Doi: 10.1109/TPAMI.2016.2537320.
13. M. Everingham, L. Van Gool, C. K. Williams, J. Winn, and A. Zisserman, "The Pascal visual object classes (VOC) challenge," Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, 2010.
14. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, "Semantic image segmentation with deep convolutional nets and fully connected CRFs," in Proc. Int. Conf. Learn. Representations, 2014.
15. T.-Y. Lin, et al., "Microsoft COCO: Common objects in context," in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 740-755.
16. C. Szegedy, et al., "Going deeper with convolutions," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015.
17. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Advances Neural Inf. Process. Syst., 2012, pp. 1097-1105.
18. R. Zhang, L. Lin, R. Zhang, W. Zuo, and L. Zhang, "Bit-scalable deep hashing with regularized similarity learning for image retrieval," IEEE Trans. Image Process., vol. 24, no. 12, pp. 4766-4779, Dec. 2015.
19. T. Chen, L. Lin, L. Liu, X. Luo, and X. Li, "DISC: Deep image saliency computing via progressive representation learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 6, pp. 1135-1149, Jun. 2016.
20. M. Guillaumin, D. Küuttel, and V. Ferrari, "ImageNet auto-annotation with segmentation propagation," Int. J. Comput. Vis., vol. 110, no. 3, pp. 328-348, 2014.
21. X. Chen, A. Shrivastava, and A. Gupta, "NEIL: Extracting visual knowledge from web data," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1409-1416.
22. A. Shrivastava, S. Singh, and A. Gupta, "Constrained semi-supervised learning using attributes and comparative attributes," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 369-383.
23. S. K. Divvala, A. Farhadi, and C. Guestrin, "Learning everything about anything: Webly-supervised visual concept learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 3270-3277.
24. J. Choi, M. Rastegari, A. Farhadi, and L. S. Davis, "Adding unlabeled samples to categories by learned attributes," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 875-882.
25. O. Russakovsky, L.-J. Li, and L. Fei-Fei, "Best of both worlds: Humanmachine collaboration for object annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 2121-2131.
26. K.Wang, D. Zhang, Y. Li, R. Zhang, and L. Lin, "Cost-effective active learning for deep image classification," IEEE Trans. Circuits Syst. Video Technol., 2016, Doi: 10.1109/TCSVT.2016.2589879.
27. A. Prest, C. Leistner, J. Civera, C. Schmid, and V. Ferrari, "Learning object class detectors from weakly annotated video," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3282-3289.
28. X. Wang and A. Gupta, "Unsupervised learning of visual representations using videos," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 2794-2802.
29. J. Xu, A. G. Schwing, and R. Urtasun, "Learning to segment under various forms of weak supervision," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 3781-3790.
30. A. Joulin, K. Tang, and L. Fei-Fei, "Efficient image and video co-localization with Frank-Wolfe algorithm," in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 253-268.
31. C. Li, L. Lin, W. Zuo, W. Wang, and J. Tang, "An approach to streaming video segmentation with sub-optimal low-rank decomposition," IEEE Trans. Image Process., vol. 25, no. 5, pp. 1947-1960, May 2016.
32. P. Kohli, L. L-ubor, and P. H. Torr, "Robust higher order potentials for enforcing label consistency," Int. J. Comput. Vis., vol. 82, no. 3, pp. 302-324, 2009.
33. B. Hariharan, P. Arbel-aez, L. Bourdev, S. Maji, and J. Malik, "Semantic contours from inverse detectors," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 991-998.
34. B. Hariharan, P. Arbel-aez, R. Girshick, and J. Malik, "Hypercolumns for object segmentation and fine-grained localization," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 447-456.
35. J. Dai, K. He, and J. Sun, "Convolutional feature masking for joint object and stuff segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 3992-4000.
36. M. Mostajabi, P. Yadollahpour, and G. Shakhnarovich, "Feedforward semantic segmentation with zoom-out features," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 3376-3385.
37. K. Tang, A. Joulin, L.-J. Li, and L. Fei-Fei, "Co-localization in real-world images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 991-998.
38. G. Lin, C. Shen, I. Reid, and A. v. d. Hengel, "Efficient piecewise training of deep structured models for semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2016.