Non-Local Auto-Encoder with Collaborative Stabilization for Image Restoration

IEEE Transactions on Image Processing

Volumn 25, Issue 5, 2016, Pages 2117-2129

  Wang, Ruxin ^a   Tao, Dacheng ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Image Restoration; Network Stabilization; Non local Auto encoder

Indexed keywords

BRAIN; IMAGE RECONSTRUCTION; LEARNING SYSTEMS; NEURAL NETWORKS; NEUROLOGY; RESTORATION; STABILIZATION;

AUTO ENCODERS; DEEP NEURAL NETWORKS; FORWARD PROPAGATION; NATURAL IMAGES; SELF-SIMILAR; SIMILAR IMAGE; SUPER RESOLUTION; VISUAL CUES;

IMAGE DENOISING;

EID: 84963815828     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2541318     Document Type: Article

References (54)

1. V. Katkovnik, A. Foi, K. Egiazarian, J. Astola, "From local kernel to nonlocal multiple-model image denoising, " Int. J. Comput. Vis., vol. 86, no. 1, pp. 1-32, 2010.
2. A. N. Rajagopalan and R. Chellappa, Eds., Motion Deblurring: Algorithms and Systems. Cambridge, U. K. : Cambridge Univ. Press, 2014.
3. R. Wang and D. Tao. (2014). "Recent progress in image deblurring. " [Online]. Available: http://arxiv. org/abs/1409. 6838
4. S. C. Park, M. K. Park, M. G. Kang, "Super-resolution image reconstruction: A technical overview, " IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
5. C. Guillemot and O. L. Meur, "Image inpainting: Overview and recent advances, " IEEE Signal Process. Mag., vol. 31, no. 1, pp. 127-144, Jan. 2014.
6. D. D. Cox and R. L. Savoy, "Functional magnetic resonance imaging (fMRI) 'brain reading': Detecting and classifying distributed patterns of fMRI activity in human visual cortex, " Neuroimage, vol. 19, no. 2, pp. 261-270, 2003.
7. Y. Bengio, "Learning deep architectures for AI, " Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
8. T. Serre, G. Kreiman, M. Kouh, C. Cadieu, U. Knoblich, T. Poggio, "A quantitative theory of immediate visual recognition, " Progr. Brain Res., vol. 165, pp. 33-56, Oct. 2007.
9. V. Jain and S. Seung, "Natural image denoising with convolutional networks, " in Proc. NIPS, 2009, pp. 769-776.
10. J. Xie, L. Xu, E. Chen, "Image denoising and inpainting with deep neural networks, " in Proc. NIPS, 2012, pp. 341-349.
11. C. Dong, C. C. Loy, K. He, X. Tang, "Learning a deep convolutional network for image super-resolution, " in Proc. ECCV, 2014, pp. 184-199.
12. H. C. Burger, C. J. Schuler, S. Harmeling, "Image denoising: Can plain neural networks compete with BM3D?" in Proc. CVPR, 2012, pp. 2392-2399.
13. K. Dabov, A. Foi, V. Katkovnik, K. Egiazarian, "Image denoising by sparse 3-D transform-domain collaborative filtering, " IEEE Trans. Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007.
14. H. C. Burger, C. Schuler, S. Harmeling, "Learning how to combine internal and external denoising methods, " in Proc. GCPR, vol. 8142. 2013, pp. 121-130.
15. D. Zoran and Y. Weiss, "From learning models of natural image patches to whole image restoration, " in Proc. ICCV, 2011, pp. 479-486.
16. C. J. Schuler, H. C. Burger, S. Harmeling, B. Scholkopf, "A machine learning approach for non-blind image deconvolution, " in Proc. CVPR, 2013, pp. 1067-1074.
17. R. Köhler, C. Schuler, B. Schölkopf, S. Harmeling, "Maskspecific inpainting with deep neural networks, " in Proc. GCPR, 2014, pp. 523-534.
18. F. Agostinelli, M. R., erson, H. Lee, "Adaptive multi-column deep neural networks with application to robust image denoising, " in Proc. NIPS, 2013, pp. 1493-1501.
19. L. Xu, J. S. J. Ren, C. Liu, J. Jia, "Deep convolutional neural network for image deconvolution, " in Proc. NIPS, 2014, pp. 1790-1798.
20. Z. Cui, H. Chang, S. Shan, B. Zhong, X. Chen, "Deep network cascade for image super-resolution, " in Proc. ECCV, 2014, pp. 49-64.
21. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, no. 5786, pp. 504-507, 2006.
22. M. Ranzato, Y.-L. Boureau, Y. LeCun, "Sparse feature learning for deep belief networks, " in Proc. NIPS, 2008, pp. 1185-1192.
23. X. Zhu, X. Li, S. Zhang, "Block-row sparse multiview multilabel learning for image classification, " IEEE Trans. Cybern., vol. 46, no. 2, pp. 450-461, Feb. 2015.
24. X. Zhu, L. Zhang, Z. Huang, "A sparse embedding and least variance encoding approach to hashing, " IEEE Trans. Image Process., vol. 23, no. 9, pp. 3737-3750, Sep. 2014.
25. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, P.-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, " J. Mach. Learn. Res., vol. 11, no. 12, pp. 3371-3408, Dec. 2010.
26. A. Buades, B. Coll, J.-M. Morel, "A non-local algorithm for image denoising, " in Proc. IEEE CVPR, vol. 2. 2005, pp. 60-65.
27. J. Mairal, F. Bach, J. Ponce, G. Sapiro, A. Zisserman, "Nonlocal sparse models for image restoration, " in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 2272-2279.
28. W. Dong, L. Zhang, G. Shi, X. Li, "Nonlocally centralized sparse representation for image restoration, " IEEE Trans. Image Process., vol. 22, no. 4, pp. 1620-1630, Apr. 2013.
29. Y. Chen, R. Ranftl, T. Pock, "Insights into analysis operator learning: From patch-based sparse models to higher order MRFs, " IEEE Trans. Image Process., vol. 23, no. 3, pp. 1060-1072, Mar. 2014.
30. S. Gu, L. Zhang, W. Zuo, X. Feng, "Weighted nuclear norm minimization with application to image denoising, " in Proc. CVPR, 2014, pp. 2862-2869.
31. U. Schmidt and S. Roth, "Shrinkage fields for effective image restoration, " in Proc. CVPR, 2014, pp. 2774-2781.
32. G. Wu, X. Zhu, Q. Wang, D. Shen, "Image super-resolution by supervised adaption of patchwise self-similarity from high-resolution image, " in Patch-Based Techniques in Medical Imaging. Munich, Germany: Springer International Publishing, 2015, pp. 10-18.
33. V. Nair and G. E. Hinton, "3d object recognition with deep belief nets, " in Proc. NIPS, 2009, pp. 1339-1347.
34. G. E. Hinton, S. Osindero, Y.-W. Teh, "A fast learning algorithm for deep belief nets, " Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
35. Y. Bengio, P. Lamblin, D. Popovici, H. Larochelle, "Greedy layer-wise training of deep networks, " in Proc. NIPS, vol. 19. 2007, p. 153.
36. D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, S. Bengio, "Why does unsupervised pre-training help deep learning?" J. Mach. Learn. Res., vol. 11, pp. 625-660, Feb. 2010.
37. O. Chapelle, B. Schölkopf, A. Zien, Eds., Semi-Supervised Learning. Cambridge, MA, USA: MIT Press, 2010.
38. D. T. Kuan, A. A. Sawchuk, T. C. Strand, P. Chavel, "Adaptive noise smoothing filter for images with signal-dependent noise, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 7, no. 2, pp. 165-177, Mar. 1985.
39. G. E. Hinton and R. S. Zemel, "Autoencoders, minimum description length and Helmholtz free energy, " in Proc. NIPS, 1994, pp. 3-10.
40. K. Hornik, M. Stinchcombe, H. White, "Multilayer feedforward networks are universal approximators, " Neural Netw., vol. 2, no. 5, pp. 359-366, 1989.
41. S. Rifai, P. Vincent, X. Muller, X. Glorot, Y. Bengio, "Contractive auto-encoders: Explicit invariance during feature extraction, " in Proc. ICML, 2011, pp. 833-840.
42. R. Goroshin and Y. LeCun. (2013). "Saturating auto-encoders. " [Online]. Available: http://arxiv. org/abs/1301. 3577
43. S. Gu, W. Zuo, Q. Xie, D. Meng, X. Feng, L. Zhang, "Convolutional sparse coding for image super-resolution, " in Proc. ICCV, 2015, pp. 1823-1831.
44. D. Martin, C. Fowlkes, D. Tal, J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, " in Proc. 8th IEEE ICCV, vol. 2. Jul. 2001, pp. 416-423.
45. J. L. Bentley, "Multidimensional binary search trees used for associative searching, " Commun. ACM, vol. 18, no. 9, pp. 509-517, 1975.
46. H. C. Burger, C. J. Schuler, S. Harmeling. (2012). "Image denoising with multi-layer perceptrons, part 1: Comparison with existing algorithms and with bounds. " [Online]. Available: http://arxiv. org/abs/1211. 1544
47. H. C. Burger, C. J. Schuler, S. Harmeling. (2012). "Image denoising with multi-layer perceptrons, part 2: Training trade-offs and analysis of their mechanisms. " [Online]. Available: http://arxiv. org/abs/1211. 1552
48. J. Duchi, E. Hazan, Y. Singer, "Adaptive subgradient methods for online learning and stochastic optimization, " J. Mach. Learn. Res., vol. 12, pp. 2121-2159, Feb. 2011.
49. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries, " IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006.
50. D. J. Mannion, D. J. Kersten, C. A. Olman, "Regions of mid-level human visual cortex sensitive to the global coherence of local image patches, " J. Cognit. Neurosci., vol. 26, no. 8, pp. 1764-1774, 2014.
51. J. Yang, J. Wright, T. S. Huang, Y. Ma, "Image super-resolution via sparse representation, " IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
52. R. Timofte, V. De, L. Van Gool, "Anchored neighborhood regression for fast example-based super-resolution, " in Proc. ICCV, 2013, pp. 1920-1927.
53. M. Bevilacqua, A. Roumy, C. Guillemot, M. L. Alberi-Morel, "Lowcomplexity single-image super-resolution based on nonnegative neighbor embedding, " in Proc. BMVC, 2012, pp. 1351-13510.
54. R. Zeyde, M. Elad, M. Protter, "On single image scale-up using sparse-representations, " in Curves and Surfaces. Avignon, France: Springer, 2012, pp. 711-730.