Locally minimax optimal predictive modeling with Bayesian networks

Journal of Machine Learning Research

Volumn 5, Issue , 2009, Pages 504-511

  Silander, Tomi ^a   Roos, Teemu ^a   Myllymäki, Petri ^a  

^a HELSINKI INSTITUTE FOR INFORMATION TECHNOLOGY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN APPROACHES; BAYESIAN NETWORK MODELS; EMPIRICAL TEST; HYPERPARAMETERS; INFORMATION-THEORETIC APPROACH; MARGINAL LIKELIHOOD; MDL PRINCIPLE; MINIMAX; MODEL SELECTION CRITERIA; NORMALIZED MAXIMUM LIKELIHOOD; PARAMETER LEARNING; PREDICTIVE MODELING;

ARTIFICIAL INTELLIGENCE; INFORMATION THEORY; OPTIMIZATION;

BAYESIAN NETWORKS;

EID: 84862284053     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (16)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. Petrox & F. Caski (Eds.), Proceedings of the second international symposium on information theory (pp. 267-281). Budapest: Akademiai Kiado.
2. Chickering, D. (1996). Learning Bayesian networks is NP-Complete. In D. Fisher & H. Lenz (Eds.), Learning from data: Artificial intelligence and statistics v (pp. 121-130). Springer-Verlag.
3. Dawid, A. (1984). Statistical theory: The prequential approach. Journal of the Royal Statistical Society A, 147, 278-292.
4. Heckerman, D., Geiger, D., & Chickering, D. (1995). Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20 (3), 197-243.
5. Kontkanen, P., & Myllym̈aki, P. (2007). A lineartime algorithm for computing the multinomial stochastic complexity. Information Processing Letters, 103 (6), 227-233.
6. Pearl, J. (1988). Probabilistic reasoning in intelligent systems: Networks of plausible inference. Morgan Kaufmann Publishers, San Mateo, CA.
7. Rissanen, J. (1996). Fisher information and stochastic complexity. IEEE Transactions on Information Theory, 42 (1), 40-47.
8. Rissanen, J., & Roos, T. (2007). Conditional NML models. In Proceedings of the information theory and applications workshop (ITA-07). San Diego, CA.
9. Roos, T., & Rissanen, J. (2008). On sequentially normalized maximum likelihood models. In Workshop on information theoretic methods in science and engineering (WITMSE-08). Tampere, Finland.
10. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
11. Shtarkov, Y. (1987). Universal sequential coding of single messages. Problems of Information Transmission, 23, 3-17.
12. Silander, T., Kontkanen, P., & Myllym̈aki, P. (2007). On sensitivity of the MAP Bayesian network structure to the equivalent sample size parameter. In R. Parr & L. van der Gaag (Eds.), Proceedings of the 23rd conference on uncertainty in artificial intelligence (pp. 360-367). AUAI Press.
13. Silander, T., & Myllym̈aki, P. (2006). A simple approach for finding the globally optimal Bayesian network structure. In R. Dechter & T. Richardson (Eds.), Proceedings of the 22nd conference on uncertainty in artificial intelligence (pp. 445- 452). AUAI Press.
14. Silander, T., Roos, T., Kontkanen, P., & Myllym̈aki, P. (2008). Factorized normalized maximum likelihood criterion for learning Bayesian network structures. In Proceedings of the 4th European workshop on probabilistic graphical models (PGM-08) (pp. 257-264). Hirtshals, Denmark.
15. Steck, H., & Jaakkola, T. S. (2002). On the Dirichlet prior and Bayesian regularization. In Advances in neural information processing systems 15 (pp. 697-704). Vancouver, Canada: MIT Press.
16. Takimoto, E., & Warmuth, M. (2000). The last-step minimax algorithm. In Proceedings of the 11th international conference on algorithmic learning theory (pp. 279-290).