Conservativeness of untied auto-encoders

30th AAAI Conference on Artificial Intelligence, AAAI 2016

Volumn , Issue , 2016, Pages 1694-1700

  Im, Daniel Jiwoong ^a   Belghazi, Mohamed Ishmael ^b   Memisevic, Roland ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b HEC MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

AUTO ENCODERS; CONSERVATIVE VECTOR FIELDS; DE-NOISING; ENERGY FUNCTIONS; HIDDEN UNIT ACTIVATION; VECTOR FIELDS;

LEARNING SYSTEMS;

EID: 85007200910     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Alain, G., and Bengio, Y. 2014. What regularized autoencoders learn from the data generating distribution. In Internaton Conference on Learning Representations.
2. Bengio, Y. 2014. How auto-encoders could provide credit assignment in deep networks via target propagation. arXiv preprint arXiv:1407.7906.
3. Bhatia, H.; Norgard, G.; Pascucci, V.; and Bremer, P.- T. 2013. The helmtholz-hodge decomposition- A survey. IEEE Transactions on visualization and computer graphics 19:1386-1404.
4. Hinton, G. 2010. A practical guide to training restricted boltzmann machines, version 1. Momentum 9.
5. Hyvarinen, A. 2005. Estimation of non-normalized statistical models by score matching. Journal of Machine Learning Research 6.
6. James, R. 1966. Advanced calculus. In Advanced Calculus. Belmont, CA: Wadsworth.
7. Kamyshanska, H. 2013. On autoencoder scoring. In Proceedings of the International Conference on Machine Learning (ICML).
8. Macedo, I., and Castro, R. 2008. Numerical solution of the naiver-stokes equations. In Technical report.
9. Seung, H. 1998. Learning continuous attractors in recurrent networks. In Proceedings of the Neural Information Processing Systems (NIPS), 654-660.
10. Swersky, K.; Buchman, D.; Marlin, B.; and de Freitas, N. 2011. On autoencoders and score matching for energy based models. In International Conference on Machine Learning (ICML).
11. Vincent, P.; Larochelle, H.; Bengio, Y.; and Manzagol, P. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th International Conference on Machine Learning (ICML).