Learning a Deep Convolutional Network for Light-Field Image Super-Resolution

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015-February, Issue , 2016, Pages 57-65

  Yoon, Youngjin ^a   Jeon, Hae Gon ^a   Yoo, Donggeun ^a   Lee, Joon Young ^a   Kweon, In So ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

Cameras; Image restoration; Lenses; Neural networks; Spatial resolution

Indexed keywords

CAMERAS; COMPUTER VISION; CONVOLUTION; DEEP NEURAL NETWORKS; IMAGE ENHANCEMENT; IMAGE RESOLUTION;

CONVOLUTIONAL NETWORKS; FIELD IMAGES; IMAGE SUPER RESOLUTIONS; LIGHT FIELDS; LIMITED RESOLUTION; NEURAL-NETWORKS; PRACTICAL USE; SPATIAL RESOLUTION; SUBAPERTURE; SUPERRESOLUTION;

IMAGE RECONSTRUCTION;

EID: 84962026650     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCVW.2015.17     Document Type: Conference Paper

References (33)

1. E. H. Adelson and J. R. Bergen. The plenoptic function and the elements of early vision. Computational models of visual processing, 1(2), 1991. 1
2. F. Agostinelli, M. R. Anderson, and H. Lee. Adaptive multicolumn deep neural networks with application to robust image denoising. In Advances in Neural Information Processing Systems (NIPS), 2013. 2
3. C. Birklbauer and O. Bimber. Panorama light-field imaging. Computer Graphics Forum (CGF), 33(2):43-52, 2014. 1
4. T. E. Bishop, S. Zanetti, and P. Favaro. Light field superresolution. In IEEE International Conference on Computational Photography (ICCP), 2009. 2
5. Y. Bok, H.-G. Jeon, and I. S. Kweon. Geometric calibration of micro-lens-based light-field cameras using line features. In Proceedings of European Conference on Computer Vision (ECCV), 2014. 6
6. D. Cho, S. Kim, and Y.-W. Tai. Consistent matting for light field images. In Proceedings of European Conference on Computer Vision (ECCV), 2014. 1
7. D. Cho, M. Lee, S. Kim, and Y.-W. Tai. Modeling the calibration pipeline of the lytro camera for high quality lightfield image reconstruction. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 2013. 2
8. Z. Cui, H. Chang, S. Shan, B. Zhong, and X. Chen. Deep network cascade for image super-resolution. In Proceedings of European Conference on Computer Vision (ECCV), pages 49-64. Springer, 2014. 1, 2, 5
9. Y. L. Cun, B. Boser, J. S. Denker, D. Henderson, R. Howard, W. Hubbard, and L. Jackel. Backpropagation applied to handwritten zip code recognition. Neural Computation, 1:541-551, 1989. 1
10. D. Dansereau. Ligh field toolbox v0.4. http://www.mathworks.com/matlabcentral/fileexchange/49683-light-field-toolbox-v0-4/. 7
11. C. Dong, C. C. Loy, K. He, and X. Tang. Learning a deep convolutional network for image super-resolution. In Proceedings of European Conference on Computer Vision (ECCV), 2014. 1, 2, 3, 4, 5
12. D. Eigen, D. Krishnan, and R. Fergus. Restoring an image taken through a window covered with dirt or rain. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 2013. 1, 2, 5
13. S. Heber and T. Pock. Shape from light field meets robust pca. In Proceedings of European Conference on Computer Vision (ECCV). 2014. 1
14. H.-G. Jeon, J. Park, G. Choe, J. Park, Y. Bok, Y.-W. Tai, and I. S. Kweon. Accurate depth map estimation from a lenslet light field camera. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015. 3, 7
15. Y. Jia. Caffe: Convolutional architecture for fast feature embedding. http://caffe.berkeleyvision.org/. 4
16. K. I. Kim and Y. Kwon. Single-image super-resolution using sparse regression and natural image prior. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 32(6):1127-1133, 2010. 1
17. N. Li, J. Ye, Y. Ji, H. Ling, and J. Yu. Saliency detection on light field. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. 1
18. C.-K. Liang and R. Ramamoorthi. A light transport framework for lenslet light field cameras. ACM Transactions on Graphics, 2015. 2
19. Lytro. The lytro camera. http://www.lytro.com/. 1
20. K. Mitra and A. Veeraraghavan. Light field denoising, light field superresolution and stereo camera based refocussing using a GMM light field patch prior. In IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2012. 2, 5, 6, 7
21. Raytrix. 3D light field camera technology. http://www.raytrix.de/. 1
22. C. J. Schuler, H. C. Burger, S. Harmeling, and B. Scholkopf. A machine learning approach for non-blind image deconvolution. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013. 2
23. O. Shahar, A. Faktor, and M. Irani. Space-time superresolution from a single video. In CVPR, 2011. 8
24. L. Shi, H. Hassanieh, A. Davis, D. Katabi, and F. Durand. Light field reconstruction using sparsity in the continuous fourier domain. ACM Transactions on Graphics, 34(1):12, 2014. 2
25. J. Sun, W. Cao, Z. Xu, and J. Ponce. Learning a convolutional neural network for non-uniform motion blur removal. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015. 1, 2, 5
26. J. Sun, Z. Xu, and H.-Y. Shum. Image super-resolution using gradient profile prior. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-8. IEEE, 2008. 1
27. M. W. Tao, S. Hadap, J. Malik, and R. Ramamoorthi. Depth from combining defocus and correspondence using lightfield cameras. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 2013. 1, 7
28. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing (TIP), 13(4):600-612, 2004. 5
29. S. Wanner and B. Goldluecke. Spatial and angular variational super-resolution of 4d light fields. In Proceedings of European Conference on Computer Vision (ECCV), 2012. 2, 3, 5, 6
30. S. Wanner and B. Goldluecke. Variational light field analysis for disparity estimation and super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 36(3):606-619, 2014. 2, 7
31. S. Wanner, S. Meister, and B. Goldluecke. Datasets and benchmarks for densely sampled 4d light fields. In Vision, Modelling and Visualization (VMV), 2013. 5
32. L. Xu, J. S. Ren, C. Liu, and J. Jia. Deep convolutional neural network for image deconvolution. In Advances in Neural Information Processing Systems (NIPS), 2014. 1, 2, 5
33. Z. Yu, X. Guo, H. Ling, A. Lumsdaine, and J. Yu. Line assisted light field triangulation and stereo matching. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 2013. 1