DAG-Recurrent Neural Networks for Scene Labeling

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 3620-3629

  Shuai, Bing ^a   Zuo, Zhen ^a   Wang, Bing ^a   Wang, Gang ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DIRECTED GRAPHS; IMAGE PROCESSING; PATTERN RECOGNITION; SEMANTICS;

CONTEXTUAL INFORMATION; DIRECTED ACYCLIC GRAPH (DAG); DISCRIMINATIVE POWER; RECOGNITION ACCURACY; RECURRENT NEURAL NETWORK (RNNS); SEMANTIC DEPENDENCY; STRUCTURED IMAGES; WEIGHTING FUNCTIONS;

RECURRENT NEURAL NETWORKS;

EID: 84986251704     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.394     Document Type: Conference Paper

References (38)

1. Y. Bengio, N. Boulanger-Lewandowski, and R. Pascanu. Advances in optimizing recurrent networks. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 8624-8628. IEEE, 2013.
2. G. J. Brostow, J. Shotton, J. Fauqueur, and R. Cipolla. Segmentation and recognition using structure from motion point clouds. In ECCV (1), pages 44-57, 2008.
3. S. R. Bulò and P. Kontschieder. Neural decision forests for semantic image labelling. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 81-88. IEEE, 2014.
4. W. Byeon, T. M. Breuel, F. Raue, and M. Liwicki. Scene labeling with lstm recurrent neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3547-3555, 2015.
5. H. Caesar, J. Uijlings, and V. Ferrari. Joint calibration for semantic segmentation. In BMVC, 2015.
6. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 248-255. IEEE, 2009.
7. J. L. Elman. Finding structure in time. Cognitive science, 14(2):179-211, 1990.
8. C. Farabet, C. Couprie, L. Najman, and Y. LeCun. Learning hierarchical features for scene labeling. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(8):1915-1929, 2013.
9. A. Graves. Offline Arabic handwriting recognition with multidimensional recurrent neural networks. In Guide to OCR for Arabic Scripts, pages 297-313. Springer, 2012.
10. A. Graves, A.-R. Mohamed, and G. Hinton. Speech recognition with deep recurrent neural networks. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 6645-6649. IEEE, 2013.
11. O. Irsoy and C. Cardie. Opinion mining with deep recurrent neural networks. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 720-728, 2014.
12. P. Krähenbühl and V. Koltun. Efficient inference in fully connected crfs with Gaussian edge potentials. In NIPS, 2011.
13. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105, 2012.
14. L. Ladický, P. Sturgess, K. Alahari, C. Russell, and P. H. S. Torr. What, where and how many? combining object detectors and crfs. In Computer Vision-ECCV 2010, pages 424-437. Springer, 2010.
15. C. Liu, J. Yuen, and A. Torralba. Nonparametric scene parsing: Label transfer via dense scene alignment. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 1972-1979. IEEE, 2009.
16. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on. IEEE, 2015.
17. M. Mostajabi, P. Yadollahpour, and G. Shakhnarovich. Feedforward semantic segmentation with zoom-out features. In Computer Vision and Pattern Recognition, 2015. CVPR 2015. IEEE Conference on. IEEE, 2015.
18. R. Pascanu, T. Mikolov, and Y. Bengio. On the difficulty of training recurrent neural networks. arXiv preprint arXiv:1211.5063, 2012.
19. P. Pinheiro and R. Collobert. Recurrent convolutional neural networks for scene labeling. In Proceedings of The 31st International Conference on Machine Learning, pages 82-90, 2014.
20. A. Sharma, O. Tuzel, and M.-Y. Liu. Recursive context propagation network for semantic scene labeling. In Advances in Neural Information Processing Systems, pages 2447-2455, 2014.
21. J. Shotton, J. Winn, C. Rother, and A. Criminisi. Textonboost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In Computer Vision-ECCV 2006, pages 1-15. Springer, 2006.
22. B. Shuai, G. Wang, Z. Zuo, B. Wang, and L. Zhao. Integrating parametric and non-parametric models for scene labeling. In Computer Vision and Pattern Recognition, 2015. CVPR 2015. IEEE Conference on. IEEE, 2015.
23. B. Shuai, Z. Zuo, andW. Gang. Quaddirectional 2d-recurrent neural networks for image labeling. Signal Processing Letters, IEEE, 2015.
24. B. Shuai, Z. Zuo, G.Wang, and B.Wang. Scene parsing with integration of parametric and non-parametric models. Image Processing, IEEE Transactions on, 2016.
25. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
26. P. Sturgess, K. Alahari, L. Ladický, and P. H. S. Torr. Combining appearance and structure from motion features for road scene understanding. In Computer Vision-BMVC 2009. 2009.
27. K. S. Tai, R. Socher, and C. D. Manning. Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:1503.00075, 2015.
28. J. Tighe and S. Lazebnik. Superparsing: scalable nonparametric image parsing with superpixels. In Computer Vision-ECCV 2010, pages 352-365. Springer, 2010.
29. J. Tighe and S. Lazebnik. Finding things: Image parsing with regions and per-exemplar detectors. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 3001-3008. IEEE, 2013.
30. Z. Tu. Auto-context and its application to high-level vision tasks. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8. IEEE, 2008.
31. M. J. Wainwright, T. S. Jaakkola, and A. S. Willsky. A new class of upper bounds on the log partition function. Information Theory, IEEE Transactions on, 51(7):2313-2335, 2005.
32. P. J. Werbos. Backpropagation through time: what it does and how to do it. Proceedings of the IEEE, 78(10):1550-1560, 1990.
33. J. Yang, B. Price, S. Cohen, and M.-H. Yang. Context driven scene parsing with attention to rare classes. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 3294-3301. IEEE, 2014.
34. J. S. Yedidia, W. T. Freeman, and Y. Weiss. Understanding belief propagation and its generalizations. Exploring artificial intelligence in the new millennium, 8:236-239, 2003.
35. C. Zhang, L. Wang, and R. Yang. Semantic segmentation of urban scenes using dense depth maps. In Computer Vision-ECCV 2010, pages 708-721. Springer, 2010.
36. S. Zheng, S. Jayasumana, B. Romera-Paredes, V. Vineet, Z. Su, D. Du, C. Huang, and P. Torr. Conditional random fields as recurrent neural networks. arXiv preprint arXiv:1502.03240, 2015.
37. X. Zhu, P. Sobhani, and H. Guo. Long short-term memory over tree structures. arXiv preprint arXiv:1503.04881, 2015.
38. Z. Zuo, B. Shuai, G. Wang, X. Liu, X. Wang, B. Wang, and Y. Chen. Convolutional recurrent neural networks: Learning spatial dependencies for image representation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pages 18-26, 2015.