Semantic image segmentation with deep convolutional nets and fully connected CRFs

3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings

Volumn , Issue , 2015, Pages

  Chen, Liang Chieh ^a   Papandreou, George ^b,d   Kokkinos, Iasonas ^c   Murphy, Kevin ^b   Yuille, Alan L ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b GOOGLE INC   (United States)

^c CENTRALESUPÉLEC   (France)

^d TOYOTA TECHNOLOGICAL INSTITUTE AT CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL EFFICIENCY; CONVOLUTION; DEEP NEURAL NETWORKS; NEURAL NETWORKS; OBJECT DETECTION; RANDOM PROCESSES; SEMANTICS;

CONDITIONAL RANDOM FIELD; CONVOLUTIONAL NEURAL NETWORK; HIGH-LEVEL VISIONS; LOCALIZATION PROPERTIES; OBJECT SEGMENTATION; PROBABILISTIC GRAPHICAL MODELS; SEMANTIC IMAGE SEGMENTATIONS; STATE-OF-THE-ART PERFORMANCE;

IMAGE SEGMENTATION;

EID: 85083954148     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (51)

1. Adams, A., Baek, J., and Davis, M. A. Fast high-dimensional filtering using the permutohedral lattice. In Computer Graphics Forum, 2010.
2. Arbeláez, P., Pont-Tuset, J., Barron, J. T., Marques, F., and Malik, J. Multiscale combinatorial grouping. In CVPR, 2014.
3. Bell, S., Upchurch, P., Snavely, N., and Bala, K. Material recognition in the wild with the materials in context database. arXiv:1412.0623, 2014.
4. Carreira, J. and Sminchisescu, C. Cpmc: Automatic object segmentation using constrained parametric min-cuts. PAMI, 2012.
5. Carreira, J., Caseiro, R., Batista, J., and Sminchisescu, C. Semantic segmentation with second-order pooling. In ECCV, 2012.
6. Chen, L.-C., Papandreou, G., and Yuille, A. Learning a dictionary of shape epitomes with applications to image labeling. In ICCV, 2013.
7. Chen, L.-C., Schwing, A., Yuille, A., and Urtasun, R. Learning deep structured models. arXiv:1407.2538, 2014.
8. Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A. L. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. arXiv:1606.00915, 2016.
9. Chen, X. and Yuille, A. L. Articulated pose estimation by a graphical model with image dependent pairwise relations. In NIPS, 2014.
10. Cogswell, M., Lin, X., Purushwalkam, S., and Batra, D. Combining the best of graphical models and convnets for semantic segmentation. arXiv:1412.4313, 2014.
11. Dai, J., He, K., and Sun, J. Convolutional feature masking for joint object and stuff segmentation. arXiv:1412.1283, 2014.
12. Delong, A., Osokin, A., Isack, H. N., and Boykov, Y. Fast approximate energy minimization with label costs. IJCV, 2012.
13. Eigen, D. and Fergus, R. Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. arXiv:1411.4734, 2014.
14. Everingham, M., Eslami, S. M. A., Gool, L. V., Williams, C. K. I., Winn, J., and Zisserma, A. The pascal visual object classes challenge a retrospective. IJCV, 2014.
15. Farabet, C., Couprie, C., Najman, L., and LeCun, Y. Learning hierarchical features for scene labeling. PAMI, 2013.
16. Geiger, D. and Girosi, F. Parallel and deterministic algorithms from mrfs: Surface reconstruction. PAMI, 13(5):401–412, 1991.
17. Geiger, D. and Yuille, A. A common framework for image segmentation. IJCV, 6(3):227–243, 1991.
18. Girshick, R., Donahue, J., Darrell, T., and Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
19. Giusti, A., Ciresan, D., Masci, J., Gambardella, L., and Schmidhuber, J. Fast image scanning with deep max-pooling convolutional neural networks. In ICIP, 2013.
20. Gonfaus, J. M., Boix, X., Van de Weijer, J., Bagdanov, A. D., Serrat, J., and Gonzalez, J. Harmony potentials for joint classification and segmentation. In CVPR, 2010.
21. Hariharan, B., Arbeláez, P., Bourdev, L., Maji, S., and Malik, J. Semantic contours from inverse detectors. In ICCV, 2011.
22. Hariharan, B., Arbeláez, P., Girshick, R., and Malik, J. Hypercolumns for object segmentation and fine-grained localization. arXiv:1411.5752, 2014a.
23. Hariharan, B., Arbeláez, P., Girshick, R., and Malik, J. Simultaneous detection and segmentation. In ECCV, 2014b.
24. He, X., Zemel, R. S., and Carreira-Perpindn, M. Multiscale conditional random fields for image labeling. In CVPR, 2004.
25. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. Caffe: Convolutional architecture for fast feature embedding. arXiv:1408.5093, 2014.
26. Kohli, P., Ladicky, L., and Torr, P. H. Robust higher order potentials for enforcing label consistency. IJCV, 2009.
27. Kokkinos, I., Deriche, R., Faugeras, O., and Maragos, P. Computational analysis and learning for a biologically motivated model of boundary detection. Neurocomputing, 71(10):1798–1812, 2008.
28. Krähenbühl, P. and Koltun, V. Efficient inference in fully connected crfs with gaussian edge potentials. In NIPS, 2011.
29. Krähenbühl, P. and Koltun, V. Parameter learning and convergent inference for dense random fields. In ICML, 2013.
30. Krizhevsky, A., Sutskever, I., and Hinton, G. E. Imagenet classification with deep convolutional neural networks. In NIPS, 2013.
31. Ladicky, L., Russell, C., Kohli, P., and Torr, P. H. Associative hierarchical crfs for object class image segmentation. In ICCV, 2009.
32. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. Gradient-based learning applied to document recognition. In Proc. IEEE, 1998.
33. Lempitsky, V., Vedaldi, A., and Zisserman, A. Pylon model for semantic segmentation. In NIPS, 2011.
34. Long, J., Shelhamer, E., and Darrell, T. Fully convolutional networks for semantic segmentation. arXiv:1411.4038, 2014.
35. Lucchi, A., Li, Y., Boix, X., Smith, K., and Fua, P. Are spatial and global constraints really necessary for segmentation? In ICCV, 2011.
36. Mallat, S. A Wavelet Tour of Signal Processing. Acad. Press, 2 edition, 1999.
37. Mostajabi, M., Yadollahpour, P., and Shakhnarovich, G. Feedforward semantic segmentation with zoom-out features. arXiv:1412.0774, 2014.
38. Papandreou, G., Kokkinos, I., and Savalle, P.-A. Untangling local and global deformations in deep convolutional networks for image classification and sliding window detection. arXiv:1412.0296, 2014.
39. Papandreou, G., Chen, L.-C., Murphy, K., and Yuille, A. L. Weakly- and semi-supervised learning of a DCNN for semantic image segmentation. arXiv:1502.02734, 2015.
40. Rother, C., Kolmogorov, V., and Blake, A. Grabcut: Interactive foreground extraction using iterated graph cuts. In SIGGRAPH, 2004.
41. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y. Overfeat: Integrated recognition, localization and detection using convolutional networks. arXiv:1312.6229, 2013.
42. Shotton, J., Winn, J., Rother, C., and Criminisi, A. Textonboost for image understanding: Multiclass object recognition and segmentation by jointly modeling texture, layout, and context. IJCV, 2009.
43. Simonyan, K. and Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556, 2014.
44. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. Going deeper with convolutions. arXiv:1409.4842, 2014.
45. Tompson, J., Jain, A., LeCun, Y., and Bregler, C. Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation. In NIPS, 2014.
46. Uijlings, J., van de Sande, K., Gevers, T., and Smeulders, A. Selective search for object recognition. IJCV, 2013.
47. Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., and Yuille, A. Towards unified depth and semantic prediction from a single image. In CVPR, 2015.
48. Yadollahpour, P., Batra, D., and Shakhnarovich, G. Discriminative re-ranking of diverse segmentations. In CVPR, 2013.
49. Zeiler, M. D. and Fergus, R. Visualizing and understanding convolutional networks. In ECCV, 2014.
50. Zhang, N., Donahue, J., Girshick, R., and Darrell, T. Part-based r-cnns for fine-grained category detection. In ECCV, 2014.
51. Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., and Torr, P. Conditional random fields as recurrent neural networks. arXiv:1502.03240, 2015.