Lossy image compression with compressive autoencoders

5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings

Volumn , Issue , 2017, Pages

  Theis, Lucas ^a   Shi, Wenzhe ^a   Cunningham, Andrew ^a   Huszár, Ferenc ^a  

^a TWITTER INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; NETWORK ARCHITECTURE;

AUTOENCODERS; COARSER APPROXIMATIONS; COMPRESSION ALGORITHMS; COMPUTATIONALLY EFFICIENT; HARDWARE TECHNOLOGY; HIGH RESOLUTION IMAGE; LOSSY IMAGE COMPRESSION; NEW APPROACHES;

IMAGE COMPRESSION;

EID: 85088225541     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. D. F. Andrews and C. L. Mallows. Scale mixtures of normal distributions. Journal of the Royal Statistical Society, Series B, 36(1):99-102, 1974.
2. J. Ballé, V. Laparra, and E. P. Simoncelli. End-to-end optimization of nonlinear transform codes for perceptual quality. In Picture Coding Symposium, 2016.
3. J. Bruna, P. Sprechmann, and Y. LeCun. Super-resolution with deep convolutional sufficient statistics. In The International Conference on Learning Representations, 2016.
4. S. Dieleman, J. Schluter, C. Raffel, E. Olson, S. K. Sonderby, D. Nouri, D. Maturana, M. Thoma, E. Battenberg, J. Kelly, J. De Fauw, M. Heilman, D. Moitinho de Almeida, B. McFee, H. Weide-man, G. Takacs, P. de Rivaz, J. Crall, G. Sanders, K. Rasul, C. Liu, G. French, and J. Degrave. Lasagne: First release, 2015. URL http://dx.doi.org/10.5281/zenodo.27878.
5. A. Dosovitskiy and T. Brox. Generating images with perceptual similarity metrics based on deep networks, 2016. arXiv:1602.02644.
6. L. A. Gatys, A. S. Ecker, and M. Bethge. Image style transfer using convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016.
7. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville,, and Y. Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems 27, 2014.
8. GoToVan. Canada day parade, 2014. URL https://www.flickr.com/photos/gotovan/14579921203.
9. K. Gregor, I. Danihelka, A. Graves, and D. Wierstra. Towards conceptual compression, 2016. arXiv:1601.06759.
10. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition, 2015. arXiv:1512.03385.
11. D. Kingma and M. Welling. Auto-encoding variational bayes. In International Conference on Learning Representations, 2014.
12. D. P. Kingma and J. Ba. Adam: A Method for Stochastic Optimization. In The International Conference on Learning Representations, 2015.
13. V. Laparra, J. Ballé, and E. P. Simoncelli. Perceptual image quality assessment using a normalized Laplacian pyramid. In SPIE, Conf. on Human Vision and Electronic Imaging, XXI, 2016.
14. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. 86(11), 1998.
15. C. Ledig, L. Theis, F. Huszar, J. Caballero, A. Aitken, A. Tejani, J. Totz, Z. Wang, and W. Shi. Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, 2016. arXiv:1609.04802.
16. Y. Ollivier. Auto-encoders: reconstruction versus compression, 2015. 1403.7752.
17. W. B. Pennebaker and J. L. Mitchell. JPEG still image data compression standard. Springer, 3rd edition, 1993.
18. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli. Image denoising using scale mixtures of gaussians in the wavelet domain. IEE Trans. Image Process., 12(11):1338-1351, 2003.
19. D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning representations by back-propagating errors. Nature, 323(6088):533-536, 1986.
20. W. Shi, J. Caballero, F. Huszar, J. Totz, A. Aitken, R. Bishop, D. Rueckert, and Z. Wang. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In IEEE Conf. on Computer Vision and Pattern Recognition, 2016.
21. A. Skodras, C. Christopoulos, and T. Ebrahimi. The JPEG 2000 still image compression standard. Signal Processing Magazine, 18(5):36-58, 2001.
22. R. C. Streijl, S. Winkler, and D. S. Hands. Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives. Multimedia Systems, pp. 1-15, 2014.
23. D. Del Testa and M. Rossi. Lightweight Lossy Compression of Biometric Patterns via Denoising Autoencoders. IEEE Signal Processing Letters, 22(12), 2016.
24. Theano Development Team. Theano: A Python framework for fast computation of mathematical expressions, 2016. arXiv:1605.02688.
25. L. Theis and M. Bethge. Generative Image Modeling Using Spatial LSTMs. In Advances in Neural Information Processing Systems 28, 2015.
26. L. Theis, A. van den Oord, and M. Bethge. A note on the evaluation of generative models. In The International Conference on Learning Representations, 2016.
27. G. Toderici, S. M. O'Malley, S. J. Hwang, D. Vincent, D. Minnen, S. Baluja, M. Covell, and R. Suk-thankar. Variable rate image compression with recurrent neural networks. In The International Conference on Learning Representations, 2016a.
28. G. Toderici, D. Vincent, N. Johnston, S. J. Hwang, D. Minnen, J. Shor, and M. Covell. Full resolution image compression with recurrent neural networks, 2016b. arXiv:1608.05148v1.
29. A. van den Oord and B. Schrauwen. The student-t mixture as a natural image patch prior with application to image compression. Journal of Machine Learning Research, 15(1):2061-2086, 2014.
30. A. van den Oord, N. Kalchbrenner, and K. Kavukcuoglu. Pixel recurrent neural networks. In Proceedings of the 33rd International Conference on Machine Learning, 2016a.
31. A. van den Oord, N. Kalchbrenner, O. Vinyals, L. Espeholt, A. Graves, and K. Kavukcuoglu. Conditional Image Generation with PixelCNN Decoders, 2016b. arXiv:1606.05328v2.
32. S. van der Walt, J. L. Schönberger, J. Nunez-Iglesias, F. Boulogne, J. D. Warner, N. Yager, E. Gouil-lart, and T. Yu. scikit-image: image processing in Python. PeerJ, 2, 2014.
33. G. K. Wallace. The JPEG still picture compression standard. Communications of the ACM, 34(4): 30-44, 1991.
34. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600-612, 2004a.
35. Z. Wang, E. P. Simoncelli, and A. C. Bovik. Multiscale structural similarity for image quality assessment. In Conference Record of the Thirty-Seventh Asilomar Conference on Signals, Systems and Computers, volume 2, pp. 1398-1402, 2004b.
36. R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8(3-4):229-256, 1992.