SeGAN: Segmenting and Generating the Invisible

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2018, Pages 6144-6153

  Ehsani, Kiana ^a   Mottaghi, Roozbeh ^b   Farhadi, Ali ^a,b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b Allen Institute for Artificial Intelligence   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; IMAGE SEGMENTATION; PAINT;

DEPTH ESTIMATION; INVISIBLE PARTS; NATURAL IMAGES; OBJECT INTERACTIONS; OCCLUDED OBJECTS; PHOTOREALISTIC IMAGES; SCENE UNDERSTANDING; STATE OF THE ART;

C (PROGRAMMING LANGUAGE);

EID: 85062835130     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2018.00643     Document Type: Conference Paper

References (55)

1. A. Aguiar and R. Baillargeon. Developments in young infants' reasoning about occluded objects. Cognitive psychology, 2002.
2. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. ArXiv, 2016.
3. L.-C. Chen, Y. Yang, J. Wang, W. Xu, and A. L. Yuille. Attention to scale: Scale-Aware semantic image segmentation. In CVPR, 2016.
4. Q. Chen and V. Koltun. Photographic image synthesis with cascaded refinement networks. In ICCV, 2017.
5. Y.-T. Chen, X. Liu, and M.-H. Yang. Multi-instance object segmentation with occlusion handling. In CVPR, 2015.
6. J. Dai, K. He, Y. Li, S. Ren, and J. Sun. Instance-sensitive fully convolutional networks. In ECCV, 2016.
7. J. Dai, K. He, and J. Sun. Boxsup: Exploiting bounding boxes to supervise convolutional networks for semantic segmentation. In ICCV, 2015.
8. J. Dai, K. He, and J. Sun. Instance-Aware semantic segmentation via multi-Task network cascades. In CVPR, 2016.
9. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. ImageNet: A Large-Scale Hierarchical Image Database. In CVPR, 2009.
10. D. Eigen and R. Fergus. Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In ICCV, 2015.
11. T. Gao, B. Packer, and D. Koller. A segmentation-Aware object detection model with occlusion handling. In CVPR, 2011.
12. G. Ghiasi, Y. Yang, D. Ramanan, and C. Fowlkes. Parsing occluded people. In CVPR, 2014.
13. R. Girshick. Fast R-CNN. In ICCV, 2015.
14. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
15. R. B. Girshick, P. F. Felzenszwalb, and D. A. McAllester. Object detection with grammar models. In NIPS. 2011.
16. R. Guo and D. Hoiem. Beyond the line of sight: Labeling the underlying surfaces. In ECCV, 2012.
17. B. Hariharan, P. A. Arbeláez, L. D. Bourdev, S. Maji, and J. Malik. Semantic contours from inverse detectors. In ICCV, 2011.
18. K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In ECCV, 2014.
19. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In CVPR, 2016.
20. E. Hsiao and M. Hebert. Occlusion reasoning for object detection under arbitrary viewpoint. In CVPR, 2012.
21. P. Isola and C. Liu. Scene collaging: Analysis and synthesis of natural images with semantic layers. In ICCV, 2013.
22. P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. Image-To-image translation with conditional adversarial networks. In CVPR, 2017.
23. A. Kar, S. Tulsiani, J. Carreira, and J. Malik. Amodal completion and size constancy in natural scenes. In ICCV, 2015.
24. P. Krähenbühl and V. Koltun. Learning to propose objects. In CVPR, 2015.
25. C. Li and M.Wand. Precomputed real-Time texture synthesis with markovian generative adversarial networks. In ECCV, 2016.
26. K. Li, B. Hariharan, and J. Malik. Iterative instance segmentation. In CVPR, 2016.
27. K. Li and J. Malik. Amodal instance segmentation. In ECCV, 2016.
28. G. Lin, C. Shen, , and I. Van den Hengel, Anton Reid. Efficient piecewise training of deep structured models for semantic segmentation. In CVPR, 2016.
29. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollr, and C. L. Zitnick. Microsoft coco: Common objects in context. In ECCV, 2014.
30. Z. Liu, X. Li, P. Luo, C.-C. Loy, and X. Tang. Semantic image segmentation via deep parsing network. In ICCV, 2015.
31. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In CVPR, 2015.
32. M. Mathieu, C. Couprie, and Y. LeCun. Deep multi-scale video prediction beyond mean square error. In ICLR, 2016.
33. M. Mirza and S. Osindero. Conditional generative adversarial nets. ArXiv, 2014.
34. N. Newcombe, J. Huttenlocher, and A. Learmonth. Infants coding of location in continuous space. Infant Behavior and Development, 1999.
35. H. Noh, S. Hong, and B. Han. Learning deconvolution network for semantic segmentation. In ICCV, 2015.
36. G. Papandreou, L.-C. Chen, K. Murphy, and A. L. Yuille. Weakly-And semi-supervised learning of a dcnn for semantic image segmentation. In ICCV, 2015.
37. D. Pathak, P. Krähenbühl, J. Donahue, T. Darrell, and A. Efros. Context encoders: Feature learning by inpainting. In CVPR, 2016.
38. B. Pepik, M. Stark, P. Gehler, and B. Schiele. Occlusion patterns for object class detection. In CVPR, 2013.
39. P. O. Pinheiro, R. Collobert, and P. Dollar. Learning to segment object candidates. In NIPS, 2015.
40. P. O. Pinheiro, T.-Y. Lin, R. Collobert, and P. Dollár. Learning to refine object segments. In ECCV, 2016.
41. J. Redmon, S. Divvala, R. Girshick, and A. Farhadi. You only look once: Unified, real-time object detection. CVPR, 2016.
42. S. Ren, K. He, R. Girshick, and J. Sun. Faster R-CNN: Towards real-Time object detection with region proposal networks. In NIPS, 2015.
43. O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 234-241. Springer, 2015.
44. B. C. Russell and A. Torralba. Labelme3d: Building a database of 3d scenes from user annotations. In CVPR, 2009.
45. C. Szegedy, S. Reed, D. Erhan, and D. Anguelov. Scalable, high-quality object detection. ArXiv, 2014.
46. J. Tighe, M. Niethammer, and S. Lazebnik. Scene parsing with object instances and occlusion ordering. In CVPR, 2014.
47. J. Winn and J. Shotton. The layout consistent random field for recognizing and segmenting partially occluded objects. In CVPR, 2006.
48. Y. Xiang, R. Mottaghi, and S. Savarese. Beyond pascal: A benchmark for 3d object detection in the wild. In WACV, 2014.
49. Y. Yang, S. Hallman, D. Ramanan, and C. Fowlkes. Layered object models for image segmentation. In PAMI, 2012.
50. R. Yeh, C. Chen, T. Y. Lim, M. Hasegawa-Johnson, and M. N. Do. Semantic image inpainting with perceptual and contextual losses. ArXiv, 2016.
51. S. Zagoruyko, A. Lerer, T.-Y. Lin, P. O. Pinheiro, S. Gross, S. Chintala, and P. Dollár. A multipath network for object detection. In BMVC, 2016.
52. Z. Zhang, S. Fidler, and R. Urtasun. Instance-level segmentation for autonomous driving with deep densely connected mrfs. In CVPR, 2016.
53. S. Zheng, S. Jayasumana, B. Romera-Paredes, V. Vineet, Z. Su, D. Du, C. Huang, and P. H. Torr. Conditional random fields as recurrent neural networks. In ICCV, 2015.
54. Y. Zhu, R. Mottaghi, E. Kolve, J. J. Lim, A. Gupta, L. Fei-Fei, and A. Farhadi. Target-driven visual navigation in indoor scenes using deep reinforcement learning. In ICRA, 2017.
55. Y. Zhu, Y. Tian, D. Mexatas, and P. Dollár. Semantic amodal segmentation. In CVPR, 2017.