End-to-end instance segmentation with recurrent attention

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 293-301

  Ren, Mengye ^a   Zemel, Richard S ^a,b  

^a UNIVERSITY OF TORONTO   (Canada)

^b CANADIAN INSTITUTE FOR ADVANCED RESEARCH   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; PATTERN RECOGNITION; RECURRENT NEURAL NETWORKS; SEMANTICS;

ATTENTION MECHANISMS; AUTONOMOUS DRIVING; CONVOLUTIONAL NEURAL NETWORK; OBJECT SEGMENTATION; RECURRENT NEURAL NETWORK (RNN); REGIONS OF INTEREST; SEMANTIC SEGMENTATION; STRUCTURED PREDICTION;

IMAGE SEGMENTATION;

EID: 85044274041     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.39     Document Type: Conference Paper

References (45)

1. S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, C. L. Zitnick, and D. Parikh. VQA: Visual question answering. In ICCV, 2015.
2. M. Bai and R. Urtasun. Deep watershed transform for instance segmentation. CoRR, abs/1611.08303, 2016.
3. D. Banica and C. Sminchisescu. Second-order constrained parametric proposals and sequential search-based structured prediction for semantic segmentation in RGB-D images. In CVPR, 2015.
4. S. Bengio, O. Vinyals, N. Jaitly, and N. Shazeer. Scheduled sampling for sequence prediction with recurrent neural networks. In NIPS, 2015.
5. E. Borenstein and S. Ullman. Class-specific, top-down segmentation. In ECCV, 2002.
6. J. Carreira, R. Caseiro, J. Batista, and C. Sminchisescu. Freeform region description with second-order pooling. TPAMI, 37(6): 1177-1189, 2015.
7. P. Chattopadhyay, R. Vedantam, R. S. Ramprasaath, D. Batra, and D. Parikh. Counting everyday objects in everyday scenes. CoRR, abs/1604.03505, 2016.
8. M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele. The cityscapes dataset for semantic urban scene understanding. CoRR, abs/1604.01685, 2016.
9. J. Dai, K. He, Y. Li, S. Ren, and J. Sun. Instance-sensitive fully convolutional networks. In ECCV, 2016.
10. J. Dai, K. He, and J. Sun. Instance-aware semantic segmentation via multi-task network cascades. CoRR, abs/1512.04412, 2015.
11. S. M. A. Eslami, N. Heess, C. K. I. Williams, and J. M. Winn. The shape boltzmann machine: A strong model of object shape. IJCV, 107(2): 155-176, 2014.
12. A. Geiger, P. Lenz, and R. Urtasun. Are we ready for autonomous driving? The KITTI vision benchmark suite. In CVPR, 2012.
13. G. Ghiasi and C. C. Fowlkes. Laplacian pyramid reconstruction and refinement for semantic segmentation. In ECCV, 2016.
14. R. B. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
15. M. V. Giuffrida, M. Minervini, and S. Tsaftaris. Learning to count leaves in rosette plants. In Proceedings of the Computer Vision Problems in Plant Phenotyping (CVPPP), 2015.
16. K. Gregor, I. Danihelka, A. Graves, D. J. Rezende, and D. Wierstra. DRAW: A recurrent neural network for image generation. In ICML, 2015.
17. B. Hariharan, P. A. Arbeláez, R. B. Girshick, and J. Malik. Simultaneous detection and segmentation. In ECCV, 2014.
18. B. Hariharan, P. A. Arbeláez, R. B. Girshick, and J. Malik. Hypercolumns for object segmentation and fine-grained localization. In CVPR, 2015.
19. Z. Hayder, X. He, and M. Salzmann. Shape-aware instance segmentation. CoRR, abs/1612.03129, 2016.
20. H. D. III, J. Langford, and D. Marcu. Search-based structured prediction. Machine Learning, 75(3): 297-325, 2009.
21. A. Kirillov, E. Levinkov, B. Andres, B. Savchynskyy, and C. Rother. InstanceCut: from edges to instances with multicut. CoRR, abs/1611.08272.
22. V. S. Lempitsky and A. Zisserman. Learning to count objects in images. In NIPS, 2010.
23. K. Li, B. Hariharan, and J. Malik. Iterative instance segmentation. In CVPR, 2016.
24. X. Liang, Y. Wei, X. Shen, Z. Jie, J. Feng, L. Lin, and S. Yan. Reversible recursive instance-level object segmentation. In CVPR, 2016.
25. X. Liang, Y. Wei, X. Shen, J. Yang, L. Lin, and S. Yan. Proposal-free network for instance-level object segmentation. CoRR, abs/1509.02636, 2015.
26. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In CVPR, 2015.
27. M. Minervini, A. Fischbach, H. Scharr, and S. A. Tsaftaris. Finely-grained annotated datasets for image-based plant phenotyping. Pattern Recognition Letters, 2015. Special Issue on Fine-grained Categorization in Ecological Multimedia.
28. V. C. Nguyen, N. Ye,W. S. Lee, and H. L. Chieu. Conditional random field with high-order dependencies for sequence labeling and segmentation. JMLR, 15(1): 981-1009, 2014.
29. H. Noh, S. Hong, and B. Han. Learning deconvolution network for semantic segmentation. In ICCV, 2015.
30. J. Pape and C. Klukas. 3-d histogram-based segmentation and leaf detection for rosette plants. In ECCV Workshops, 2014.
31. E. Park and A. C. Berg. Learning to decompose for object detection and instance segmentation. In ICLR Workshop, 2016.
32. P. H. O. Pinheiro, R. Collobert, and P. Dollár. Learning to segment object candidates. In NIPS, 2015.
33. P. O. Pinheiro, T. Lin, R. Collobert, and P. Dollár. Learning to refine object segments. In ECCV, pages 75-91, 2016.
34. M. Ren, R. Kiros, and R. S. Zemel. Exploring models and data for image question answering. In NIPS, 2015.
35. B. Romera-Paredes and P. H. S. Torr. Recurrent instance segmentation. CoRR, abs/1511.08250, 2015.
36. H. Scharr, M. Minervini, A. P. French, C. Klukas, D. M. Kramer, X. Liu, I. Luengo, J. Pape, G. Polder, D. Vukadinovic, X. Yin, and S. A. Tsaftaris. Leaf segmentation in plant phenotyping: A collation study. Mach. Vis. Appl., 27(4): 585-606, 2016.
37. X. Shi, Z. Chen, H. Wang, D. Yeung, W. Wong, and W. Woo. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In NIPS, 2015.
38. N. Silberman, D. Sontag, and R. Fergus. Instance segmentation of indoor scenes using a coverage loss. In ECCV, 2014.
39. R. Stewart and M. Andriluka. End-to-end people detection in crowded scenes. CoRR, abs/1506.04878, 2016.
40. J. Uhrig, M. Cordts, U. Franke, and T. Brox. Pixel-level encoding and depth layering for instance-level semantic labeling. In GCPR, 2016.
41. K. Xu, J. Ba, R. Kiros, K. Cho, A. C. Courville, R. Salakhutdinov, R. S. Zemel, and Y. Bengio. Show, attend and tell: Neural image caption generation with visual attention. In ICML, 2015.
42. Y. Yang, S. Hallman, D. Ramanan, and C. C. Fowlkes. Layered object models for image segmentation. TPAMI, 34(9): 1731-1743, 2012.
43. X. Yin, X. Liu, J. Chen, and D. M. Kramer. Multi-leaf tracking from fluorescence plant videos. In ICIP, 2014.
44. Z. Zhang, S. Fidler, and R. Urtasun. Instance-level segmentation with deep densely connected MRFs. In CVPR, 2016.
45. Z. Zhang, A. G. Schwing, S. Fidler, and R. Urtasun. Monocular object instance segmentation and depth ordering with CNNs. In ICCV, 2015.