One Network to Solve Them All - Solving Linear Inverse Problems Using Deep Projection Models

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2017-October, Issue , 2017, Pages 5889-5898

  Chang, J H Rick ^a   Li, Chun Liang ^a   Poczos, Barnabas ^a   Kumar, B V K Vijaya ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DEEP LEARNING; DEEP NEURAL NETWORKS; DIFFERENTIAL EQUATIONS; ITERATIVE METHODS; PERSONNEL TRAINING; PROBLEM SOLVING;

COMPRESSIVE SENSING; DEDICATED NETWORKS; IMAGE INPAINTING; LEARNING-BASED METHODS; LINEAR INVERSE PROBLEMS; PROJECTION MODELS; PROJECTION OPERATOR; SUPER RESOLUTION;

INVERSE PROBLEMS;

EID: 85041921524     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2017.627     Document Type: Conference Paper

References (51)

1. Implementation of the proposed method and trained models. https: //github. com/image-science-lab/OneNet. 4
2. One ring to rule them all. https: //flic. kr/p/mGjhs7. 6
3. J. Adler and O. Öktem. Solving ill-posed inverse problems using iterative deep neural networks. ArXiv preprint arXiv: 1704. 04058, 2017.
4. M. Aharon, M. Elad, and A. Bruckstein. k-svd: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing, 54 (11): 4311-4322, 2006.
5. A. Bora, A. Jalal, E. Price, and A. G. Dimakis. Compressed sensing using generative models. ArXiv preprint arXiv: 1703. 03208, 2017.
6. M. Borgerding and P. Schniter. Onsager-corrected deep learning for sparse linear inverse problems. In IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2016.
7. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning, 3 (1): 1-122, 2011.
8. E. J. Candes, J. K. Romberg, and T. Tao. Stable signal recovery from incomplete and inaccurate measurements. Communications on pure and applied mathematics, 59 (8): 1207-1223, 2006.
9. T. F. Chan, J. Shen, and H.-M. Zhou. Total variation wavelet inpainting. Journal of Mathematical imaging and Vision, 25 (1): 107-125, 2006.
10. T. Che, Y. Li, A. P. Jacob, Y. Bengio, and W. Li. Mode regularized generative adversarial networks. In International Conference on Learning Representations (ICLR), 2017.
11. Y. Chen, W. Yu, and T. Pock. On learning optimized reaction diffusion processes for effective image restoration. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
12. D.-A. Clevert, T. Unterthiner, and S. Hochreiter. Fast and accurate deep network learning by exponential linear units (elus). In International Conference on Learning Representations (ICLR), 2016.
13. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian. Bm3d image denoising with shape-adaptive principal component analysis. In Signal Processing with Adaptive Sparse Structured Representations, 2009.
14. R. Dahl, M. Norouzi, and J. Shlens. Pixel recursive super resolution. ArXiv preprint arXiv: 1702. 00783, 2017.
15. K. Dale, M. K. Johnson, K. Sunkavalli, W. Matusik, and H. Pfister. Image restoration using online photo collections. In IEEE International Conference on Computer Vision (ICCV), 2009.
16. A. Dave, A. K. Vadathya, and K. Mitra. Compressive image recovery using recurrent generative model. In IEEE International Conference on Image Processing (ICIP), 2017.
17. C. Dong, C. C. Loy, K. He, and X. Tang. Learning a deep convolutional network for image super-resolution. In European Conference on Computer Vision (ECCV), 2014.
18. W. Dong, L. Zhang, G. Shi, and X. Wu. Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Transactions on Image Processing, 20 (7): 1838-1857, 2011.
19. D. L. Donoho. De-noising by soft-thresholding. IEEE Transactions on Information Theory, 41 (3): 613-627, 1995.
20. D. L. Donoho, M. Vetterli, R. A. DeVore, and I. Daubechies. Data compression and harmonic analysis. IEEE Transactions on Information Theory, 44 (6): 2435-2476, 1998.
21. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS), 2014.
22. K. Gregor and Y. LeCun. Learning fast approximations of sparse coding. In International Conference on Machine Learning (ICML), 2010.
23. Y. Guo, L. Zhang, Y. Hu, X. He, and J. Gao. Ms-celeb-1m: A dataset and benchmark for large-scale face recognition. In European Conference on Computer Vision (ECCV), 2016.
24. J. Hays and A. A. Efros. Scene completion using millions of photographs. ACM Transactions on Graphics (TOG), 26 (3): 4, 2007.
25. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
26. K. H. Jin, M. T. McCann, E. Froustey, and M. Unser. Deep convolutional neural network for inverse problems in imaging. IEEE Transactions on Image Processing, 26 (9): 4509-4522, 2017.
27. D. P. Kingma and M. Welling. Auto-encoding variational bayes. In International Conference on Learning Representations (ICLR), 2014. \
28. K. Kulkarni, S. Lohit, P. Turaga, R. Kerviche, and A. Ashok. Reconnet: Non-iterative reconstruction of images from compressively sensed measurements. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
29. C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, and W. Shi. Photo-realistic single image super-resolution using a generative adversarial network. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
30. G. Loosli, S. Canu, and L. Bottou. Training invariant support vector machines using selective sampling. In L. Bottou, O. Chapelle, D. De-Coste, and J. Weston, editors, Large Scale Kernel Machines, pages 301-320. MIT Press, 2007.
31. J. Mairal, G. Sapiro, and M. Elad. Learning multiscale sparse representations for image and video restoration. Multiscale Modeling & Simulation, 7 (1): 214-241, 2008.
32. A. Makhzani, J. Shlens, N. Jaitly, and I. J. Goodfellow. Adversarial autoencoders. ArXiv preprint arXiv: 1511. 05644, 2015.
33. T. Meinhardt, M. Möller, C. Hazirbas, and D. Cremers. Learning proximal operators: Using denoising networks for regularizing inverse imaging problems. ArXiv preprint arXiv: 1704. 03488, 2017.
34. C. A. Metzler, A. Maleki, and R. G. Baraniuk. From denoising to compressed sensing. IEEE Transactions on Information Theory, 62 (9): 5117-5144, 2016.
35. A. Mousavi and R. G. Baraniuk. Learning to invert: Signal recovery via deep convolutional networks. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017.
36. A. Mousavi, A. B. Patel, and R. G. Baraniuk. A deep learning approach to structured signal recovery. In Allerton Conference on Communication, Control, and Computing, 2015.
37. A. Nguyen, J. Yosinski, Y. Bengio, A. Dosovitskiy, and J. Clune. Plug & play generative networks: Conditional iterative generation of images in latent space. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
38. D. Pathak, P. Krahenbuhl, J. Donahue, T. Darrell, and A. A. Efros. Context encoders: Feature learning by inpainting. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
39. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli. Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Transactions on Image Processing, 12 (11): 1338-1351, 2003.
40. A. Radford, L. Metz, and S. Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. ArXiv preprint arXiv: 1511. 06434, 2015.
41. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet large scale visual recognition challenge. International Journal of Computer Vision (IJCV), 115 (3): 211-252, 2015.
42. B. C. Russell, A. Torralba, K. P. Murphy, andW. T. Freeman. Labelme: A database and web-based tool for image annotation. International Journal of Computer Vision (IJCV), 77 (1): 157-173, 2008.
43. R. Salakhutdinov and G. Hinton. Deep Boltzmann machines. In International Conference on Artificial Intelligence and Statistics (AISTATS), 2009.
44. L. Theis and M. Bethge. Generative image modeling using spatial lstms. In Advances in Neural Information Processing Systems (NIPS). 2015.
45. S. V. Venkatakrishnan, C. A. Bouman, and B. Wohlberg. Plug-andplay priors for model based reconstruction. In IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2013.
46. P. Vincent, H. Larochelle, Y. Bengio, and P.-A. Manzagol. Extracting and composing robust features with denoising autoencoders. In International Conference on Machine Learning (ICML), 2008.
47. Y. Wang, W. Yin, and J. Zeng. Global convergence of admm in nonconvex nonsmooth optimization. ArXiv preprint arXiv: 1511. 06324, 2015.
48. L. Xiao, F. Heide, W. Heidrich, B. Schölkopf, and M. Hirsch. Discriminative transfer learning for general image restoration. ArXiv preprint arXiv: 1703. 09245, 2017.
49. L. Xu, J. S. Ren, C. Liu, and J. Jia. Deep convolutional neural network for image deconvolution. In Advances in Neural Information Processing Systems (NIPS), 2014.
50. J. Yang, J. Wright, T. S. Huang, and Y. Ma. Image super-resolution via sparse representation. IEEE Transactions on Image Processing, 19 (11): 2861-2873, 2010.
51. Y.-T. Zhou, R. Chellappa, A. Vaid, and B. K. Jenkins. Image restoration using a neural network. IEEE Transactions on Acoustics, Speech, and Signal Processing, 36 (7): 1141-1151, 1988.