Simple sparsification improves sparse denoising autoencoders in denoising highly noisy images

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 2, 2013, Pages 1469-1477

  Cho, KyungHyun ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

AUTO ENCODERS; CLEAN IMAGES; CONVENTIONAL METHODS; EVEN CLASSIFICATION; IMAGE PATCHES; SPARSIFICATION; SPARSITY REGULARIZATIONS; TEST SAMPLES;

IMAGE DENOISING;

EID: 84897512451     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Bishop, C. M. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer-Verlag New York, Inc., Secaucus, NJ, USA, 2006.
2. Burger, H., Schuler, C., and Harmeling, S. Image denoising: Can plain neural networks compete with bm3d? In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp. 2392 -2399, june 2012.
3. Chang, C.-C. and Lin, C.-J. Libsvm: A library for support vector machines. ACM Trans. Intell. Syst. Technol., 2(3):27:1-27:27, May 2011.
4. Chen, S. S., Donoho, D. L., and Saunders, M. A. Atomic decomposition by basis pursuit. SIAM Rev., 43(1):129-159, January 2001. (Pubitemid 32406896)
5. Cho, K. Boltzmann machines and denoising autoencoders for image denoising. ArXiv e-prints, January 2013.
6. Elad, M. and Aharon, M. Image denoising via sparse and redundant representations over learned dictionaries. Image Processing, IEEE Transactions on, 15 (12):3736-3745, December 2006. (Pubitemid 44811686)
7. Hyvärinen, A. Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3):626-34, 1999.
8. Hyvärinen, A., Hoyer, P., and Oja, E. Image denoising by sparse code shrinkage. In Intelligent Signal Processing. IEEE Press, 1999.
9. Krizhevsky, A. Learning multiple layers of features from tiny images. Technical report, Computer Science Department, University of Toronto, 2009.
10. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. Gradient-based learning applied to document recognition. In Proceedings of the IEEE, volume 86, pp. 2278-2324, 1998.
11. Lee, H., Ekanadham, C., and Ng, A. Sparse deep belief net model for visual area v2. In Platt, J., Koller, D., Singer, Y., and Roweis, S. (eds.), Advances in Neural Information Processing Systems 20, pp. 873-880. MIT Press, Cambridge, MA, 2008.
12. Olshausen, B. A. and Field, D. J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583):607-609, June 1996. (Pubitemid 26177476)
13. Ranzato, M., Poultney, C., Chopra, S., and LeCun, Y. Efficient learning of sparse representations with an energy-based model. In Scholköpf, B., Platt, J., and Hoffman, T. (eds.), Advances in Neural Information Processing Systems 19, pp. 1137-1144. MIT Press, Cambridge, MA, 2007.
14. Rumelhart, D. E., Hinton, G. E., and Williams, R. J. Learning representations by back-propagating errors. Nature, 323(Oct):533-536+, 1986.
15. Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., and Manzagol, P.-A. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research, 11:3371-3408, December 2010.
16. Xie, J., Xu, L., and Chen, E. Image denoising and inpainting with deep neural networks. In Bartlett, P., Pereira, F., Burges, C., Bottou, L., and Weinberger, K. (eds.), Advances in Neural Information Processing Systems 25, pp. 350-358. 2012.