Estimation of non-normalized statistical models by score matching

Journal of Machine Learning Research

Volumn 6, Issue , 2005, Pages

  Hyvärinen, Aapo ^a  

^a HELSINKI INSTITUTE FOR INFORMATION TECHNOLOGY   (Finland)

Author keywords

Contrastive divergence; Markov chain Monte Carlo; Non normalized densities; Pseudo likelihood; Statistical estimation

Indexed keywords

INDEPENDENT COMPONENT ANALYSIS; LEARNING SYSTEMS; MARKOV PROCESSES; MONTE CARLO METHODS; PROBABILITY DENSITY FUNCTION; PROBLEM SOLVING; STATISTICAL METHODS; THEOREM PROVING;

CONTRASTIVE DIVERGENCE; MARKOV CHAIN MONTE CARLO; NON-NORMALIZED DENSITIES; PSEUDO-LIKELIHOOD; STATISTICAL ESTIMATION;

MATHEMATICAL MODELS;

EID: 22044434800     PISSN: 15337928     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (16)

1. S.-I. Amari, A. Cichocki, and H. H. Yang. A new learning algorithm for blind source separation. In Advances in Neural Information Processing Systems 8, pages 757-763. MIT Press, 1996.
2. J. Besag. Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society, Series B, 36(2):192-236, 1974.
3. J. Besag. Efficiency of pseudolikelihood estimation for simple gaussian fields. Biometrika, 64(3):616-618, 1977.
4. C. Bouman and K. Sauer. A generalized gaussian image model for edge-preserving MAP estimation. IEEE Transactions on Image Processing, 2(3):296-310, 1993.
5. M. Á. Carreira-Perpiñán and G. E. Hinton. On contrastive divergence (CD) learning. Technical report, Dept of Computer Science, University of Toronto, 2005a. In preparation.
6. M. Á. Carreira-Perpiñán and G. E. Hinton. On contrastive divergence learning. In Proceedings of the Workshop on Artificial Intelligence and Statistics (AISTATS2005), Barbados, 2005b.
7. G. E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800, 2002.
8. A. Hyvärinen and P. O. Hoyer. A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Research, 41(18):2413-2423, 2001.
9. A. Hyvärinen and M. Inki. Estimating overcomplete independent component bases from image windows. Journal of Mathematical Imaging and Vision, 17:139-152, 2002.
10. A. Hyvärinen, J. Karhunen, and E. Oja. Independent Component Analysis. Wiley Interscience, 2001.
11. S. Z. Li. Markov Random Field Modeling in Image Analysis. Springer, 2nd edition, 2001.
12. D. J. C. Mackay. Information Theory, Inference and Learning Algorithms. Cambridge University Press, 2003.
13. B. A. Olshausen and D. J. Field. Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research, 37:3311-3325, 1997.
14. D.-T. Pham and P. Garrat. Blind separation of mixture of independent sources through a quasi-maximum likelihood approach. IEEE Transactions on Signal Processing, 45(7): 1712-1725, 1997.
15. M. Schervish. Theory of Statistics. Springer, 1995.
16. Y. W. Teh, M. Welling, S. Osindero, and G. E. Hinton. Energy-based models for sparse overcomplete representations. Journal of Machine Learning Research, 4:1235-1260, 2003.