A family of computationally efficient and simple estimators for unnormalized statistical models

Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence, UAI 2010

Volumn , Issue , 2010, Pages 442-449

  Pihlaja, Miika ^a   Gutmann, Michael ^a   Hyvärinen, Aapo ^a  

^a HELSINKI INSTITUTE FOR INFORMATION TECHNOLOGY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL EFFICIENCY; COVARIANCE MATRIX; LOGISTIC REGRESSION;

ASYMPTOTIC COVARIANCE MATRIX; COMPUTATIONALLY EFFICIENT; ESTIMATION PERFORMANCE; MONTE-CARLO ESTIMATION; NONLINEAR FUNCTIONS; OBJECTIVE FUNCTIONS; OPTIMIZATION METHOD; PARTITION FUNCTIONS;

MAXIMUM LIKELIHOOD ESTIMATION;

EID: 80053144265     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Ackley, D., Hinton, G., and Sejnowski, T. (1985). A learning algorithm for boltzmann machines. Cognitive Science, 9:147-169
2. Amari, S. (1998). Natural gradient works efficiently in learning. Neural Computation, 10:251-276 (Pubitemid 128463152)
3. Besag, J. (1974). Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society B, 36(2):192-236
4. Geyer, C. and Thompson, E. (1992). Constrained monte carlo maximum likelihood for dependent data. Journal of the Royal Statistical Society B (methodologiacal), 54(3):657-699
5. Gutmann, M. and Hyvärinen, A. (2010). Noisecontrastive estimation: A new estimation principle for unnormalized statistical models. In Proc. of the 13th International Conference on Artificial Intelligence and Statistics
6. Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning. Springer, second edition
7. Hinton, G. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1771-1800
8. Huber, P. J. (1981). Robust Statistics. Wiley
9. Hyvärinen, A. (2005). Estimation of non-normalized statistical models using score matching. Journal of Machine Learning Research, 6:695-709
10. Hyvärinen, A., Karhunen, J., and Oja, E. (2001). Independent Component Analysis. John Wiley & Sons
11. Köster, U. and Hyvärinen, A. (2010). A twolayer model of natural stimuli estimated with score matching. Neural Computation, 104
12. Köster, U., Lindgren, J., and Hyvärinen, A. (2009). Estimating markov random field potentials for natural images. In Int. Conf. of Independent Component Analysis and Blind Source Separation (ICA2009)
13. Osindero, S., Welling, M., and Hinton, G. E. (2006). Topographic product models applied to natural scene statistics. Neural Computation, 18(2):381-414 (Pubitemid 43543842)
14. Rasmussen, C. E. (2006). MATLAB implementation of conjugate gradient algorithm version 2006-09-08. available online
15. Roth, S. and Black, M. (2009). Fields of experts. International Journal of Computer Vision, 82:205-229
16. Wasserman, L. (2004). All of statistics: a concise course in statistical inference. Springer