A unified energy-based framework for unsupervised learning

Journal of Machine Learning Research

Volumn 2, Issue , 2007, Pages 371-379

  Ranzato, Marc'Aurelio ^a   Boureau, Y Lan ^a   LeCun, Yann ^a   Chopra, Sumit ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMOUNT OF INFORMATION; DIMENSIONALITY REDUCTION; ENERGY FUNCTIONS; ENERGY-BASED FRAMEWORK; HIGH ENERGY; LOG PARTITION FUNCTION; LOW ENERGIES; NATURAL IMAGES; NON-PROBABILISTIC METHODS; PROBABILISTIC METHODS; PULL UP; TRAINING SAMPLE; UNIFIED FRAMEWORK;

ARTIFICIAL INTELLIGENCE; FEATURE EXTRACTION; SAMPLING;

UNSUPERVISED LEARNING;

EID: 84862270523     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (12)

1. LeCun, Y., Chopra, S., Hadsell, R., Ranato, M., and Huang, F.-J. (2006) A Tutorial on Energy-Based Learning. in Bakir et al. (eds) "Predicting Structured Outputs", MIT Press.
2. Lee, D.D. and Seung, H.S. (1999) Learning the parts of objects by non-negative matrix factorization. Nature, 401:788-791.
3. Teh, Y.W., Welling, M. and Osindero, S. and Hinton, G.E. (2003) Energy-based models for sparse overcomplete representations. Journal of Machine Learning Research, 4:1235-1260.
4. Hinton, G.E. (2002) Training products of experts by minimizing contrastive divergence. Neural Computation, 14:1771-1800.
5. Hinton, G. E. and Salakhutdinov, R. R (2006) Reducing the dimensionality of data with neural networks. Science, Vol. 313. no. 5786, pp. 504 507, 28 July 2006.
6. Doi E., Balcan, D.C. and Lewicki, M.S. (2006) A Theoretical Analysis of Robust Coding over Noisy Overcomplete Channels. Advances in Neural Information Processing Systems 18, MIT Press.
7. Olshausen, B.A. and Field, D.J. (1997) Sparse Coding with an Overcomplete Basis Set: A Strategy Employed by V1? Vision Research, 37:3311-3325.
8. The Berkeley Segmentation Dataset http://www.cs.berkeley.edu/projects/ vision/grouping/segbench/
9. Elad, M. and Aharon, M. (2006) Image Denoising Via Learned Dictionaries and Sparse Representation. Computer Vision and Pattern Recognition, 895-900.
10. Portilla, J., Strela, V.,Wainwright, M. and Simoncelli, E.P. (2003) Image Denoising Using Scale Mixtures of Gaussians in theWavelet Domain. IEEE Trans. Image Processing, 12(11): 1338-1351.
11. Ranzato, M., Poultney, C.S., Chopra, S. and LeCun, Y. (2006) Efficient Learning of Sparse Overcomplete Representations with an Energy-Based Model. Advances in Neural Information Processing Systems 19, MIT Press.
12. Roth, S. and Black, M.J. (2005) Fields of experts: a framework for learning image priors. IEEE Conference on Computer Vision and Pattern Recognition