Alternating back-propagation for generator network

31st AAAI Conference on Artificial Intelligence, AAAI 2017

Volumn , Issue , 2017, Pages 1976-1984

  Han, Tian ^a   Lu, Yang ^a   Zhu, Song Chun ^a   Wu, Ying Nian ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION ALGORITHMS; LEARNING ALGORITHMS; NEURAL NETWORKS;

CONVOLUTIONAL NEURAL NETWORK; GENERATOR MODELS; GRADIENT COMPUTATION; GRADIENT DESCENT; LANGEVIN DYNAMICS; NETWORK MODELING; NONLINEAR GENERALIZATIONS; VIDEO SEQUENCES;

BACKPROPAGATION;

EID: 85030452031     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. Candès, E. J.; Romberg, J.; and Tao, T. 2006. Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on information theory 52 (2): 489-509.
2. Dempster, A. P.; Laird, N. M.; and Rubin, D. B. 1977. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society: B 1-38.
3. Denton, E. L.; Chintala, S.; Fergus, R.; et al. 2015. Deep generative image models using a laplacian pyramid of adversarial networks. In NIPS, 1486-1494.
4. Dinh, L.; Sohl-Dickstein, J.; and Bengio, S. 2016. Density estimation using real nvp. CoRR abs/1605. 08803.
5. Doretto, G.; Chiuso, A.; Wu, Y.; and Soatto, S. 2003. Dynamic textures. IJCV 51 (2): 91-109.
6. Dosovitskiy, E.; Springenberg, J. T.; and Brox, T. 2015. Learning to generate chairs with convolutional neural networks. In CVPR.
7. Girolami, M., and Calderhead, B. 2011. Riemann manifold langevin and hamiltonian monte carlo methods. Journal of the Royal Statistical Society: B 73 (2): 123-214.
8. Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; and Bengio, Y. 2014. Generative adversarial nets. In NIPS, 2672-2680.
9. Hyvärinen, A.; Karhunen, J.; and Oja, E. 2004. Independent component analysis. John Wiley & Sons.
10. Ioffe, S., and Szegedy, C. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In ICML.
11. Kim, H., and Park, H. 2008. Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method. SIAM Journal on Matrix Analysis and Applications 30 (2): 713-730.
12. Kingma, D. P., and Welling, M. 2014. Auto-encoding variational bayes. In ICLR.
13. Koren, Y.; Bell, R.; and Volinsky, C. 2009. Matrix factorization techniques for recommender systems. Computer 42 (8): 30-37.
14. Krizhevsky, A.; Sutskever, I.; and Hinton, G. E. 2012. Imagenet classification with deep convolutional neural networks. In NIPS, 1097-1105.
15. LeCun, Y.; Bottou, L.; Bengio, Y.; and Haffner, P. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86 (11): 2278-2324.
16. Lee, D. D., and Seung, H. S. 2001. Algorithms for nonnegative matrix factorization. In NIPS, 556-562.
17. Liu, Z.; Luo, P.;Wang, X.; and Tang, X. 2015. Deep learning face attributes in the wild. In ICCV, 3730-3738.
18. Liu, C.; Rubin, D. B.; and Wu, Y. N. 1998. Parameter expansion to accelerate em: The px-em algorithm. Biometrika 85 (4): 755-770.
19. Lu, Y.; Zhu, S.-C.; and Wu, Y. N. 2016. Learning FRAME models using CNN filters. In AAAI.
20. Maas, A. L.; Hannun, A. Y.; and Ng, A. Y. 2013. Rectifier nonlinearities improve neural network acoustic models. In ICML.
21. McDermott, J. H., and Simoncelli, E. P. 2011. Sound texture perception via statistics of the auditory periphery: evidence from sound synthesis. Neuron 71 (5): 926-940.
22. Mnih, A., and Gregor, K. 2014. Neural variational inference and learning in belief networks. In ICML.
23. Neal, R. M. 2011. Mcmc using hamiltonian dynamics. Handbook of Markov Chain Monte Carlo 2.
24. Olshausen, B. A., and Field, D. J. 1997. Sparse coding with an overcomplete basis set: A strategy employed by v1 Vision Research 37 (23): 3311-3325.
25. Pascanu, R.; Montufar, G.; and Bengio, Y. 2013. On the number of response regions of deep feed forward networks with piece-wise linear activations. arXiv: 1312. 6098.
26. Radford, A.; Metz, L.; and Chintala, S. 2016. Unsupervised representation learning with deep convolutional generative adversarial networks. In ICLR.
27. Rezende, D. J.; Mohamed, S.; andWierstra, D. 2014. Stochastic backpropagation and approximate inference in deep generative models. In NIPS, 1278-1286.
28. Roweis, S. T., and Saul, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290 (5500): 2323-2326.
29. Rubin, D. B., and Thayer, D. T. 1982. Em algorithms for ml factor analysis. Psychometrika 47 (1): 69-76.
30. Rubin, D. B. 2004. Multiple imputation for nonresponse in surveys, volume 81. John Wiley & Sons.
31. Vedaldi, A., and Lenc, K. 2015. Matconvnet-convolutional neural networks for matlab. In Int. Conf. on Multimedia.
32. Vincent, P.; Larochelle, H.; Bengio, Y.; and Manzagol, P.-A. 2008. Extracting and composing robust features with denoising autoencoders. In ICML, 1096-1103.
33. Wang, Y., and Zhu, S.-C. 2003. Modeling textured motion: Particle, wave and sketch. In ICCV, 213-220.
34. Xie, J.; Lu, Y.; Zhu, S.-C.; and Wu, Y. N. 2016. A theory of generative convnet. In ICML.
35. Xu, B.; Wang, N.; Chen, T.; and Li, M. 2015. Empirical evaluation of rectified activations in convolutional network. CoRR abs/1505. 00853.
36. Younes, L. 1999. On the convergence of markovian stochastic algorithms with rapidly decreasing ergodicity rates. Stochastics: An International Journal of Probability and Stochastic Processes 65 (3-4): 177-228.