A widely applicable bayesian information criterion

Journal of Machine Learning Research

Volumn 14, Issue 1, 2013, Pages 867-897

  Watanabe, Sumio ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Bayes marginal likelihood; Widely applicable Bayes information criterion

Indexed keywords

ASYMPTOTIC EXPANSION; BAYES INFORMATION CRITERION; BAYESIAN INFORMATION CRITERION; INVERSE TEMPERATURES; LOG-LIKELIHOOD FUNCTIONS; MARGINAL LIKELIHOOD; POSTERIOR DISTRIBUTIONS; THEORETICAL VALUES;

FISHER INFORMATION MATRIX; FREE ENERGY; PROBABILITY DISTRIBUTIONS; SAMPLING; THERMAL LOGGING;

STATISTICS;

EID: 84876235301     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. T. W. Anderson. Estimating linear restrictions on regression coefficients for multivariate normal distributions. Annals of Mathematical Statistics, 22:327-351, 1951.
2. M. Aoyagi and K. Nagata. Learning coefficient of generalization error in Bayesian estimation and Vandermonde matrix-type singularity. Neural Computation, 24(6):1569-1610, 2012.
3. M. Aoyagi and S. Watanabe. Stochastic complexities of reduced rank regression in Bayesian estimation. Neural Networks, 18(7):924-933, 2005.
4. M. F. Atiyah. Resolution of singularities and division of distributions. Communications of Pure and Applied Mathematics, 13:145-150, 1970.
5. I. N. J. Bernstein. Analytic continuation of distributions with respect to a parameter. Functional Analysis and its Applications, 6(4):26-40, 1972.
6. M. Drton. Likelihood ratio tests and singularities. The Annals of Statistics, 37:979-1012, 2009.
7. M. Drton. Reduced rank regression. In Workshop on Singular Learning Theory. American Institute of Mathematics, 2010.
8. M. Drton, B. Sturmfels, and S. Sullivant. Lecures on Algebraic Statistics. Birkh?auser, Berlin, 2009.
9. I. M. Gelfand and G. E. Shilov. Generalized Functions. Volume I: Properties and Operations. Academic Press, San Diego, 1964.
10. I. J. Good. The Estimation of Probabilities: An Essay on Modern Bayesian Methods. MIT Press, Cambridge, 1965.
11. H. Hironaka. Resolution of singularities of an algebraic variety over a field of characteristic zero. Annals of Mathematics, 79:109-326, 1964.
12. M. Kashiwara. B-functions and holonomic systems. Inventiones Mathematicae, 38:33-53, 1976.
13. F. J. Kiŕaly, P. B̈uuau, F. C. Meinecke, D. A. J. Blythe, and K-R M̈uller. Algebraic geometric comparison of probability distributions. Journal of Machine Learning Research, 13:855-903, 2012.
14. J. Koll'ar. Singularities of pairs. In Algebraic Geometry, Santa Cruz 1995, Proceedings of Symposia in Pure Mathematics, volume 62, pages 221-286. American Mathematical Society, 1997.
15. S. Lin. Algebraic Methods for Evaluating Integrals in Bayesian Statistics. PhD thesis, Ph.D. dissertation, University of California, Berkeley, 2011.
16. D. Rusakov and D. Geiger. Asymptotic model selection for naive Bayesian network. Journal of Machine Learning Research, 6:1-35, 2005.
17. M. Saito. On real log canonical thresholds. arXiv:0707.2308v1, 2007.
18. M. Sato and T. Shintani. On zeta functions associated with prehomogeneous vector space. Annals of Mathematics, 100:131-170, 1974.
19. G. Schwarz. Estimating the dimension of a model. The Annals of Statistics, 6(2):461-464, 1978.
20. A. Varchenko. Newton polyhedrons and estimates of oscillatory integrals. Functional Analysis and its Applications, 10(3):13-38, 1976.
21. S. Watanabe. Algebraic analysis for singular statistical estimation. Lecture Notes in Computer Sciences, 1720:39-50, 1999.
22. S. Watanabe. Algebraic analysis for nonidentifiable learning machines. Neural Computation, 13 (4):899-933, 2001a.
23. S. Watanabe. Algebraic geometrical methods for hierarchical learning machines. Neural Networks, 14(8):1049-1060, 2001b.
24. S. Watanabe. Algebraic geometry and statistical learning theory. Cambridge University Press, Cambridge, UK, 2009.
25. S. Watanabe. Asymptotic learning curve and renormalizable condition in statistical learning theory. Journal of Physics Coneference Series, 233(1), 2010a. 012014. doi: 10.1088/1742-6596/233/1/012014.
26. S. Watanabe. Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory. Journal of Machine Learning Research, 11:3571-3591, 2010b.
27. K. Yamazaki and S. Watanabe. Singularities in mixture models and upper bounds of stochastic complexity. Neural Networks, 16(7):1029-1038, 2003.
28. K. Yamazaki and S. Watanabe. Singularities in complete bipartite graph-type boltzmann machines and upper bounds of stochastic complexities. IEEE Transactions on Neural Networks, 16(2): 312-324, 2005.
29. P. Zwiernik. Asymptotic model selection and identifiability of directed tree models with hidden variables. CRiSM report, 2010.
30. P. Zwiernik. An asymptotic behaviour of the marginal likelihood for general markov models. Journal of Machine Learning Research, 12:3283-3310, 2011.