Generative adversarial frontal view to bird view synthesis

Proceedings - 2018 International Conference on 3D Vision, 3DV 2018

Volumn , Issue , 2018, Pages 454-463

  Zhu, Xinge ^a   Yin, Zhichao ^a   Shi, Jianping ^a   Li, Hongsheng ^a   Lin, Dahua ^a  

^a SENSETIME RESEARCH   (China)

Author keywords

Generative adversarial network; Multi GAN; View synthesis

Indexed keywords

ADVERSARIAL NETWORKS; CONSISTENCY CONSTRAINTS; ENVIRONMENT PERCEPTIONS; FEATURE REPRESENTATION; MULTI-GAN; RELIABILITY AND ROBUSTNESS; SURROUNDING ENVIRONMENT; VIEW SYNTHESIS;

BIRDS;

EID: 85056780094     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/3DV.2018.00059     Document Type: Conference Paper

References (42)

1. S. Baker, A. Datta, and T. Kanade. Parameterizing homographies. Technical Report CMU-RI-TR-06-11, 2006. 2, 5
2. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In IEEE CVPR, pages 248-255. IEEE, 2009. 5
3. M. A. Fischler and R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381-395, 1981. 5
4. J. Flynn, I. Neulander, J. Philbin, and N. Snavely. Deepstereo: Learning to predict new views from the world's imagery. In IEEE CVPR, pages 5515-5524, 2016. 1
5. Y. Furukawa, C. Hernández, et al. Multi-view stereo: A tutorial. Foundations and TrendsR in Computer Graphics and Vision, 9(1-2):1-148, 2015. 1, 2
6. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS, pages 2672-2680, 2014. 1, 2, 4
7. I. J. Goodfellow, J. Shlens, and C. Szegedy. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412. 6572, 2014. 8
8. R. Hartley and A. Zisserman. Multiple view geometry in computer vision. Cambridge university press, 2003. 5
9. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In IEEE CVPR, pages 770-778, 2016. 5
10. P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. Imageto-image translation with conditional adversarial networks. arXiv preprint arXiv:1611. 07004, 2016. 2, 3, 6
11. D. Ji, J. Kwon, M. McFarland, and S. Savarese. Deep view morphing. arXiv preprint arXiv:1703. 02168, 2017. 1, 2
12. T. Kim, M. Cha, H. Kim, J. Lee, and J. Kim. Learning to discover cross-domain relations with generative adversarial networks. arXiv preprint arXiv:1703. 05192, 2017. 1, 3, 4, 6
13. D. Kingma and J. Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412. 6980, 2014. 6
14. C. Li and M. Wand. Precomputed real-time texture synthesis with markovian generative adversarial networks. In ECCV, pages 702-716. Springer, 2016. 6
15. C.-C. Lin and M.-S. Wang. A vision based top-view transformation model for a vehicle parking assistant. Sensors, 12(4):4431-4446, 2012. 2
16. M.-Y. Liu, T. Breuel, and J. Kautz. Unsupervised image-toimage translation networks. In NIPS, pages 700-708, 2017. 3
17. M.-Y. Liu and O. Tuzel. Coupled generative adversarial networks. In NIPS, pages 469-477, 2016. 3, 6
18. Y. Liu and B. Zhang. Photometric alignment for surround view camera system. In ICIP, pages 1827-1831. IEEE, 2014. 2
19. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In IEEE CVPR, pages 3431-3440, 2015. 5
20. M. Mirza and S. Osindero. Conditional generative adversarial nets. arXiv preprint arXiv:1411. 1784, 2014. 3
21. A. Nguyen, J. Yosinski, and J. Clune. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In IEEE CVPR, pages 427-436, 2015. 8
22. F. Nielsen. Surround video: A multihead camera approach. The visual computer, 21(1):92-103, 2005. 1
23. A. Palazzi, G. Borghi, D. Abati, S. Calderara, and R. Cucchiara. Learning to map vehicles into birds eye view. In International Conference on Image Analysis and Processing, pages 233-243. Springer, 2017. 5
24. S. Reed, Z. Akata, X. Yan, L. Logeswaran, B. Schiele, and H. Lee. Generative adversarial text to image synthesis. arXiv preprint arXiv:1605. 05396, 2016. 3
25. K. Regmi and A. Borji. Cross-view image synthesis using conditional gans. arXiv preprint arXiv:1803. 03396, 2018. 1, 2
26. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski. Orb: An efficient alternative to sift or surf. In IEEE ICCV, pages 2564-2571. IEEE, 2011. 5
27. T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen. Improved techniques for training gans. In NIPS, pages 2234-2242, 2016. 5
28. P. Sangkloy, J. Lu, C. Fang, F. Yu, and J. Hays. Scribbler: Controlling deep image synthesis with sketch and color. arXiv preprint arXiv:1612. 00835, 2016. 3
29. K. Sung, J. Lee, J. An, and E. Chang. Development of image synthesis algorithm with multi-camera. In Vehicular Technology Conference (VTC Spring), 2012 IEEE 75th, pages 1-5. IEEE, 2012. 1, 2
30. D. C. Tseng, T. W. Chao, and J. W. Chang. Image-based parking guiding using ackermann steering geometry. In Applied Mechanics and Materials, volume 437, pages 823-826. Trans Tech Publ, 2013. 2
31. D. Ulyanov, A. Vedaldi, and V. Lempitsky. Instance normalization: The missing ingredient for fast stylization. arXiv preprint arXiv:1607. 08022, 2016. 5
32. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600-612, 2004. 6
33. X. Yan, J. Yang, E. Yumer, Y. Guo, and H. Lee. Perspective transformer nets: Learning single-view 3d object reconstruction without 3d supervision. In NIPS, pages 1696-1704, 2016. 1, 2
34. Z. Yi, H. Zhang, P. T. Gong, et al. Dualgan: Unsupervised dual learning for image-to-image translation. arXiv preprint arXiv:1704. 02510, 2017. 1, 3, 4
35. M. Zhai, Z. Bessinger, S. Workman, and N. Jacobs. Predicting ground-level scene layout from aerial imagery. In IEEE CVPR, volume 3, 2017. 1, 2
36. B. Zhang, V. Appia, I. Pekkucuksen, Y. Liu, A. Umit Batur, P. Shastry, S. Liu, S. Sivasankaran, and K. Chitnis. A surround view camera solution for embedded systems. In IEEE CVPR Workshops, pages 662-667, 2014. 1, 2
37. H. Zhang, T. Xu, H. Li, S. Zhang, X. Huang, X. Wang, and D. Metaxas. Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks. arXiv preprint arXiv:1612. 03242, 2016. 3
38. R. Zhang, P. Isola, and A. A. Efros. Colorful image colorization. In ECCV, pages 649-666. Springer, 2016. 1
39. R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang. The unreasonable effectiveness of deep features as a perceptual metric. arXiv preprint arXiv:1801. 03924, 2018. 6
40. J. Zhao, M. Mathieu, and Y. LeCun. Energy-based generative adversarial network. arXiv preprint arXiv:1609. 03126, 2016. 6
41. T. Zhou, S. Tulsiani, W. Sun, J. Malik, and A. A. Efros. View synthesis by appearance flow. In ECCV, pages 286-301. Springer, 2016. 1
42. J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros. Unpaired imageto-image translation using cycle-consistent adversarial networks. arXiv preprint arXiv:1703. 10593, 2017. 1, 2, 3, 4, 6