Deep generative models for distribution-preserving lossy compression

Advances in Neural Information Processing Systems

Volumn 2018-December, Issue , 2018, Pages 5929-5940

  Tschannen, Michael ^a   Agustsson, Eirikur ^b   Lucic, Mario ^b  

^a ETH ZURICH   (Switzerland)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); ELECTRIC DISTORTION; SIGNAL DISTORTION;

AUTO ENCODERS; COMPRESSION SYSTEM; GENERATIVE MODEL; LOSSY COMPRESSIONS; OPTIMIZATION PROBLEMS; PERFECT RECONSTRUCTION; RATE DISTORTION TRADE-OFF; TRAINING SAMPLE;

IMAGE COMPRESSION;

EID: 85064808138     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (46)

1. G. Toderici, S. M. O'Malley, S. J. Hwang, D. Vincent, D. Minnen, S. Baluja, M. Covell, and R. Sukthankar, “Variable rate image compression with recurrent neural networks,” International Conference on Learning Representations (ICLR), 2015.
2. G. Toderici, D. Vincent, N. Johnston, S. J. Hwang, D. Minnen, J. Shor, and M. Covell, “Full resolution image compression with recurrent neural networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5435-5443, 2017.
3. L. Theis, W. Shi, A. Cunningham, and F. Huszar, “Lossy image compression with compressive autoencoders,” in International Conference on Learning Representations (ICLR), 2017.
4. O. Rippel and L. Bourdev, “Real-time adaptive image compression,” in Proceedings of the International Conference on Machine Learning (ICML), pp. 2922-2930, 2017.
5. J. Ballé, V. Laparra, and E. P. Simoncelli, “End-to-end optimized image compression,” in International Conference on Learning Representations (ICLR), 2016.
6. E. Agustsson, F. Mentzer, M. Tschannen, L. Cavigelli, R. Timofte, L. Benini, and L. V. Gool, “Soft-to-hard vector quantization for end-to-end learning compressible representations,” in Advances in Neural Information Processing Systems (NIPS), pp. 1141-1151, 2017.
7. N. Johnston, D. Vincent, D. Minnen, M. Covell, S. Singh, T. Chinen, S. Jin Hwang, J. Shor, and G. Toderici, “Improved lossy image compression with priming and spatially adaptive bit rates for recurrent networks,” arXiv:1703.10114, 2017.
8. M. Li, W. Zuo, S. Gu, D. Zhao, and D. Zhang, “Learning convolutional networks for content-weighted image compression,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3214-3223, 2018.
9. F. Mentzer, E. Agustsson, M. Tschannen, R. Timofte, and L. Van Gool, “Conditional probability models for deep image compression,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4394-4402, 2018.
10. J. Ballé, D. Minnen, S. Singh, S. J. Hwang, and N. Johnston, “Variational image compression with a scale hyperprior,” in International Conference on Learning Representations (ICLR), 2018.
11. S. Kankanahalli, “End-to-end optimized speech coding with deep neural networks,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2521-2525, 2018.
12. C.-Y. Wu, N. Singhal, and P. Krähenbühl, “Video compression through image interpolation,” in European Conference on Computer Vision (ECCV), 2018.
13. R. Torfason, F. Mentzer, E. Agustsson, M. Tschannen, R. Timofte, and L. V. Gool, “Towards image understanding from deep compression without decoding,” in International Conference on Learning Representations (ICLR), 2018.
14. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative adversarial nets,” in Advances in Neural Information Processing Systems (NIPS), pp. 2672-2680, 2014.
15. E. Agustsson, M. Tschannen, F. Mentzer, R. Timofte, and L. Van Gool, “Generative adversarial networks for extreme learned image compression,” arXiv:1804.02958, 2018.
16. M. Arjovsky, S. Chintala, and L. Bottou, “Wasserstein generative adversarial networks,” in Proceedings of the International Conference on Machine Learning (ICML), pp. 214-223, 2017.
17. I. Tolstikhin, O. Bousquet, S. Gelly, and B. Schoelkopf, “Wasserstein auto-encoders,” in International Conference on Learning Representations (ICLR), 2018.
18. M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “GANs trained by a two time-scale update rule converge to a local Nash equilibrium,” in Advances in Neural Information Processing Systems (NIPS), pp. 6629-6640, 2017.
19. Z. Liu, P. Luo, X. Wang, and X. Tang, “Deep learning face attributes in the wild,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 3730-3738, 2015.
20. F. Yu, A. Seff, Y. Zhang, S. Song, T. Funkhouser, and J. Xiao, “LSUN: Construction of a large-scale image dataset using deep learning with humans in the loop,” arXiv:1506.03365, 2015.
21. J.-Y. Zhu, T. Park, P. Isola, and A. A. Efros, “Unpaired image-to-image translation using cycle-consistent adversarial networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2223-2232, 2017.
22. M. Mathieu, C. Couprie, and Y. LeCun, “Deep multi-scale video prediction beyond mean square error,” in International Conference on Learning Representations (ICLR), 2016.
23. J.-Y. Zhu, R. Zhang, D. Pathak, T. Darrell, A. A. Efros, O. Wang, and E. Shechtman, “Toward multimodal image-to-image translation,” in Advances in Neural Information Processing Systems (NIPS), pp. 465-476, 2017.
24. D. P. Kingma and M. Welling, “Auto-encoding variational Bayes,” in International Conference on Learning Representations (ICLR), 2014.
25. C. Villani, Optimal transport: Old and new, vol. 338. Springer Science & Business Media, 2008.
26. F. Liese and K.-J. Miescke, “Statistical decision theory,” in Statistical Decision Theory, pp. 1-52, Springer, 2007.
27. A. Gretton, K. M. Borgwardt, M. J. Rasch, B. Schölkopf, and A. Smola, “A kernel two-sample test,” Journal of Machine Learning Research, vol. 13, pp. 723-773, 2012.
28. I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, and A. C. Courville, “Improved training of Wasserstein GANs,” in Advances in Neural Information Processing Systems (NIPS), pp. 5769-5779, 2017.
29. M. Lucic, K. Kurach, M. Michalski, S. Gelly, and O. Bousquet, “Are GANs Created Equal? A Large-Scale Study,” in Advances in Neural Information Processing Systems (NeurIPS), 2018.
30. A. Radford, L. Metz, and S. Chintala, “Unsupervised representation learning with deep convolutional generative adversarial networks,” arXiv:1511.06434, 2015.
31. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, 2016.
32. F. Bellard, “BPG Image format.” https://bellard.org/bpg/, 2018. accessed 26 June 2018.
33. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” in International Conference on Learning Representations (ICLR), 2015.
34. S. Santurkar, D. Budden, and N. Shavit, “Generative compression,” in Picture Coding Symposium (PCS), pp. 258-262, 2018.
35. L. Galteri, L. Seidenari, M. Bertini, and A. Del Bimbo, “Deep generative adversarial compression artifact removal,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 4826-4835, 2017.
36. C. Ledig, L. Theis, F. Huszar, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, and W. Shi, “Photo-realistic single image super-resolution using a generative adversarial network,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4681-4690, 2017.
37. K. Gregor, F. Besse, D. J. Rezende, I. Danihelka, and D. Wierstra, “Towards conceptual compression,” in Advances in Neural Information Processing Systems (NIPS), pp. 3549-3557, 2016.
38. A. B. L. Larsen, S. K. Sønderby, H. Larochelle, and O. Winther, “Autoencoding beyond pixels using a learned similarity metric,” arXiv:1512.09300, 2015.
39. J. Donahue, P. Krähenbühl, and T. Darrell, “Adversarial feature learning,” in International Conference on Learning Representations (ICLR), 2017.
40. V. Dumoulin, I. Belghazi, B. Poole, O. Mastropietro, A. Lamb, M. Arjovsky, and A. Courville, “Adversarially learned inference,” in International Conference on Learning Representations (ICLR), 2017.
41. A. Dosovitskiy and T. Brox, “Generating images with perceptual similarity metrics based on deep networks,” in Advances in Neural Information Processing Systems (NIPS), pp. 658-666, 2016.
42. M. Rosca, B. Lakshminarayanan, D. Warde-Farley, and S. Mohamed, “Variational approaches for auto-encoding generative adversarial networks,” arXiv:1706.04987, 2017.
43. E. J. Delp and O. R. Mitchell, “Moment preserving quantization (signal processing),” IEEE Transactions on Communications, vol. 39, no. 11, pp. 1549-1558, 1991.
44. M. Li, J. Klejsa, and W. B. Kleijn, “Distribution preserving quantization with dithering and transformation,” IEEE Signal Processing Letters, vol. 17, no. 12, pp. 1014-1017, 2010.
45. H. Luschgy and G. Pagès, “Functional quantization of Gaussian processes,” Journal of Functional Analysis, vol. 196, no. 2, pp. 486-531, 2002.
46. S. Graf and H. Luschgy, Foundations of quantization for probability distributions. Springer, 2007.