The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 3234-3243

  Ros, German ^a,b   Sellart, Laura ^b   Materzynska, Joanna ^c   Vazquez, David ^a   Lopez, Antonio M ^a,b  

^a Campus UAB ^*  (Spain)

^b UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

^c UNIVERSITY OF VIENNA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; NEURAL NETWORKS; PATTERN RECOGNITION; PIXELS; SEMANTICS; VIRTUAL REALITY; VISION;

AUTOMATICALLY GENERATED; AUTONOMOUS DRIVING; CONVOLUTIONAL NEURAL NETWORK; SEMANTIC SEGMENTATION; SYNTHETIC IMAGES; URBAN SCENARIOS; VIRTUAL WORLDS; VISION-BASED SEMANTICS;

IMAGE SEGMENTATION;

EID: 84986265711     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.352     Document Type: Conference Paper

References (45)

1. M. Aubry, D. Maturana, A. Efros, B. Russell, and J. Sivic. Seeing 3d chairs: exemplar part-based 2d-3d alignment using a large dataset of cad models. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2014.
2. V. Badrinarayanan, A. Handa, and R. Cipolla. Seg-Net: A deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling. arXiv preprint abs/1505.07293, 2015.
3. S. Bileschi. CBCL StreetScenes challenge framework, 2007.
4. G. J. Brostow, J. Fauqueur, and R. Cipolla. Semantic object classes in video: A high-definition ground truth database. Pattern Recognition Letters, 2009.
5. G. J. Brostow, J. Shotton, and R. Cipolla. Segmentation and recognition using structure from motion point clouds. In Eur. Conf. on Computer Vision (ECCV), 2008.
6. P. P. Busto, J. Liebelt, and J. Gall. Adaptation of synthetic data for coarse-to-fine viewpoint refinement. In British Machine Vision Conf. (BMVC), 2015.
7. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman. Return of the devil in the details: Delving deep into convolutional networks. In British Machine Vision Conf. (BMVC), 2014.
8. M. Cordts, M. Omran, S. Ramos, T. Scharwächter, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele. The cityscapes dataset. In CVPR, Workshop, 2015.
9. A. Geiger, P. Lenz, C. Stiller, and R. Urtasun. Vision meets Robotics: The KITTI Dataset. Intl. J. of Robotics Research, 2013.
10. R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2014.
11. A. Handa, V. Patraucean, V. Badrinarayanan, S. Stent, and R. Cipolla. Synthcam3d: Semantic understanding with synthetic indoor scenes. arXiv preprint abs/1505.00171, 2015.
12. H. Hattori, V. Naresh Boddeti, K. M. Kitani, and T. Kanade. Learning scene-specific pedestrian detectors without real data. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015.
13. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. 2015.
14. B. Kaneva, A. Torralba, and W. T. Freeman. Evaluating image feaures using a photorealistic virtual world. In Intl. Conf. on Computer Vision (ICCV), 2011.
15. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2014.
16. D. P. Kingma and J. Ba. Adam: A method for stochastic optimization. In International Conference on Learning Representations (ICLR), 2015.
17. A. Krizhevsky, I. Sustkever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 2012.
18. A. Kundu, Y. Li, F. Dellaert, F. Li, and J. M. Rehg. Joint semantic segmentation and 3D reconstruction from monocular video. In Eur. Conf. on Computer Vision (ECCV), 2014.
19. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick. Microsoft COCO: Common Objects in Context. In Eur. Conf. on Computer Vision (ECCV), 2014.
20. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2015.
21. J. Marin, D. Vazquez, D. Geronimo, and A. Lopez. Learning appearance in virtual scenarios for pedestrian detection. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2010.
22. R. Mottaghi, X. Chen, X. Liu, N.-G. Cho, S.-W. Lee, S. Fidler, R. Urtasun, and A. Yuille. The role of context for object detection and semantic segmentation in the wild. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2014.
23. P. K. Nathan Silberman, Derek Hoiem and R. Fergus. Indoor segmentation and support inference from rgbd images. In Eur. Conf. on Computer Vision (ECCV), 2012.
24. H. Noh, S. Hong, and B. Han. Learning deconvolution network for semantic segmentation. Intl. Conf. on Computer Vision (ICCV), 2015.
25. P. Panareda, J. Liebelt, and J. Gall. Adaptation of synthetic data for coarse-to-fine viewpoint refinement. In British Machine Vision Conf. (BMVC), 2015.
26. J. Papon and M. Schoeler. Semantic pose using deep networks trained on synthetic RGB-D. In Intl. Conf. on Computer Vision (ICCV), 2015.
27. X. Peng, B. Sun, K. Ali, and K. Saenko. Learning deep object detectors from 3D models. In Intl. Conf. on Computer Vision (ICCV), 2015.
28. L. Pishchulin, A. Jain, M. Andriluka, T. Thormahlen, and B. Schiele. Articulated people detection and pose estimation: reshaping the future. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2012.
29. G. Ros, S. Ramos, M. Granados, A. Bakhtiary, D. Vázquez, and A. M. López. Vision-based offline-online perception paradigm for autonomous driving. In Winter Conference on Applications of Computer Vision (WACV), 2015.
30. G. Ros, S. Stent, P. F. Alcantarilla, and T.Watanabe. Training constrained deconvolutional networks for road scene semantic segmentation. arXiv preprint abs/1604.01545, 2016.
31. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet large scale visual recognition challenge. Intl. J. of Computer Vision, 2015.
32. B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman. LabelMe: a database and web-based tool for image annotation. Intl. J. of Computer Vision, 2008.
33. T. Scharwchter, M. Enzweiler, U. Franke, and S. Roth. Efficient multi-cue scene segmentation. In Pattern Recognition. 2013.
34. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts froma single depth image. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2011.
35. K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In arXiv preprint abs/1406.2199, 2014.
36. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In International Conference on Learning Representations (ICLR), 2015.
37. B. Sun and K. Saenko. From virtual to reality: Fast adaptation of virtual object detectors to real domains. In British Machine Vision Conf. (BMVC), 2014.
38. U. Technologies. Unity Development Platform.
39. T.L Berg, A. Sorokin, G. Wang, D.A. Forsyth, D. Hoeiem, I. Endres, and A. Farhadi. It's all about the data. Proceedings of the IEEE, 2010.
40. J. Tompson, A. Jain, Y. LeCun, and C. Bregler. Joint training of a convolutional network and a graphical model for human pose estimation. In Advances in Neural Information Processing Systems, 2014.
41. A. Torralba and A. Efros. Unbiased look at dataset bias. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2011.
42. D. Vázquez, A. López, J. Maŕ?n, D. Ponsa, andD. Gerónimo. Virtual and real world adaptation for pedestrian detection. IEEE Trans. Pattern Anal. Machine Intell., 2014.
43. L. Woensel and G. Archer. Ten technologies which could change our lives. Technical report, EPRS-European Parlimentary Research Service, January 2015.
44. J. Xu, S. Ramos, D. Vazquez, and A. Lopez. Domain adaptation of deformable part-based models. IEEE Trans. Pattern Anal. Machine Intell., 2014.
45. J. Xu, S. Ramos, D. Vazquez, and A.M. Lopez. Hierarchical adaptive structural SVM for domain adaptation. 2016.