Majorization for CRFs and latent likelihoods (Supplementary material)

Advances in Neural Information Processing Systems

Volumn 1, Issue , 2012, Pages

  Jebara, Tony ^a   Choromanska, Anna ^a  

^a Columbia University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADDITIONAL EXPERIMENTS; CONDITIONAL LIKELIHOOD; CONSTRAINED OPTIMI-ZATION PROBLEMS; JUNCTION TREES; MAXIMUM ENTROPY; PARTITION FUNCTIONS;

CONSTRAINED OPTIMIZATION; MAXIMUM LIKELIHOOD;

MAXIMUM ENTROPY METHODS;

EID: 84877784438     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. I. Ahmad and Pi-Erh Lin. A nonparametric estimation of the entropy for absolutely continuous distributions (corresp.). Information Theory, IEEE Trans. on, 22(3):372 - 375, May 1976.
2. J. Beirlant, EJ Dudewicz, L. Györfi, and EC Van der Meulen. Nonparametric entropy estimation: An overview. Intl. Journal of Mathematical and Statistical Sciences, 6:17-40, 1997.
3. L. Birge and P. Massart. Estimation of integral functions of a density. The Annals of Statistics, 23(1):11-29, 1995.
4. D. Chauveau and P. Vandekerkhove. Selection of a MCMC simulation strategy via an entropy convergence criterion. ArXiv Mathematics e-prints, May 2006.
5. J.A. Costa and A.O. Hero. Geodesic entropic graphs for dimension and entropy estimation in manifold learning. Signal Processing, IEEE Transactions on, 52(8):2210-2221, 2004.
6. P. B. Eggermont and V. N. LaRiccia. Best asymptotic normality of the kernel density entropy estimator for smooth densities. Information Theory, IEEE Trans. on, 45(4):1321-1326, May 1999.
7. E. Giné and D.M. Mason. Uniform in bandwidth estimation of integral functionals of the density function. Scandinavian Journal of Statistics, 35:739761, 2008.
8. M. Goria, N. Leonenko, V. Mergel, and P. L. Novi Inverardi. A new class of random vector entropy estimators and its applications in testing statistical hypotheses. Nonparametric Statistics, 2004.
9. R. Gupta. Quantization Strategies for Low-Power Communications. PhD thesis, University of Michigan, Ann Arbor, 2001.
10. L. Györfi and E. C. van der Meulen. Density-free convergence properties of various estimators of entropy. Comput. Statist. Data Anal., pages 425-436, 1987.
11. L. Györfi and E. C. van der Meulen. An entropy estimate based on a kernel density estimation. Limit Theorems in Probability and Statistics, pages 229-240, 1989.
12. P. Hall and S. C. Morton. On the estimation of the entropy. Ann. Inst. Statist. Meth., 45:69-88, 1993.
13. K. Hlaváčková-Schindler, M. Paluš, M. Vejmelka, and J. Bhattacharya. Causality detection based on information- theoretic approaches in time series analysis. Physics Reports, 441(1):1-46, 2007.
14. A.T. Ihler, J.W. Fisher III, and A.S. Willsky. Nonparametric estimators for online signature authentication. In Acousti cs, Speech, and Signal Processing, 2001. Proceedings. (ICASSP'01). 2001 IEEE International Conference on, volume 6, pages 3473-3476. IEEE, 2001.
15. H. Joe. Estimation of entropy and other functionals of a multivariate density. Annals of the Institute of Statistical Mathematics, 41(4):683-697, 1989.
16. G. Lanckriet, N. Cristianini, P. Bartlett, and L. El Ghaoui. Learning the kernel matrix with semi-definite programming. Journal of Machine Learning Research, 5:2004, 2002.
17. B. Laurent. Efficient estimation of integral functionals of a density. The Annals of Statistics, 24(2):659-681, 1996.
18. N. Leonenko, L. Prozanto, and V. Savani. A class of Rényi information estimators for multidimensional densities. Annals of Statistics, 36:2153-2182, 2008.
19. E. Liitiäinen, A. Lendasse, and F. Corona. On the statistical estimation of rényi entropies. In Proceedings of IEEE/MLSP 2009 International Workshop on Machine Learning for Signal Processing, Grenoble (France), September 2-4 2009.
20. D. Pal, B. Poczos, and C. Szepesvari. Estimation of Rényi entropy and mutual information based on generalized nearest-neighbor graphs. In Proc. Advances in Neural Information Processing Systems (NIPS). MIT Press, 2010.
21. Robert E. Schapire. The strength of weak learnability. Machine Learning, 5(2):197-227-227, June 1990.
22. K. Sricharan and A. O. Hero, III. Ensemble estimators for multivariate entropy estimation. ArXiv e-prints, March 2012.
23. C. Studholme, C. Drapaca, B. Iordanova, and V. Cardenas. Deformation-based mapping of volume change from serial brain mri in the presence of local tissue contrast change. Medical Imaging, IEEE Transactions on, 25(5):626-639, 2006.
24. B. van Es. Estimating functionals related to a density by class of statistics based on spacing. Scandinavian Journal of Statistics, 1992.