Bayesian model averaging of Bayesian network classifiers over multiple node-orders: Application to sparse datasets

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 35, Issue 6, 2005, Pages 1302-1310

  Hwang, Kyu Baek ^a   Zhang, Byoung Tak ^a  

^a Seoul National University   (South Korea)

Author keywords

Bayesian model averaging (BMA); Bayesian networks; Classification; Markov chain Monte Carlo (MCMC); Sparse data

Indexed keywords

APPROXIMATION THEORY; MARKOV PROCESSES; MATHEMATICAL MODELS; MATHEMATICAL TRANSFORMATIONS; MONTE CARLO METHODS; PROBABILITY DISTRIBUTIONS; SAMPLING;

BAYESIAN MODEL AVERAGING (BMA); BAYESIAN NETWORKS; MARKOV CHAIN MONTE CARLO (MCMC); SPARSE DATA;

STATISTICAL METHODS;

ALGORITHM; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; CLUSTER ANALYSIS; FACTUAL DATABASE; INFORMATION RETRIEVAL; LETTER; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; CLUSTER ANALYSIS; DATABASES, FACTUAL; INFORMATION STORAGE AND RETRIEVAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 29144477220     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.850162     Document Type: Article

References (23)

1. F. V. Jensen, Bayesian Networks and Decision Graphs. New York: Springer-Verlag, 2001
2. D. Heckerman, "A tutorial on learning with Bayesian networks," in Learning in Graphical Models, M. I. Jordan, Ed. Cambridge, MA: MIT Press, 1999, pp. 301-354.
3. K. B. Korb and A. E. Nicholson, Bayesian Artificial Intelligence. Boca Raton, FL: CRC, 2004.
4. N. Friedman, D. Geiger, and M. Goldszmidt, "Bayesian network classifiers," Mach. Learn., vol. 29, no. 2/3, pp. 131-163, 1997.
5. N. Friedman and M. Goldszmidt, "Learning Bayesian networks with local structure," in Learning in Graphical Models, M. I. Jordan, Ed. Cambridge, MA: MIT Press, 1999, pp. 421-459.
6. J. A. Hoeting, D. Madigan, A. E. Raftery, and C. T. Volinsky, "Bayesian model averaging: A tutorial," Statist. Sci., vol. 14, no. 4, pp. 382-401, 1999.
7. L. I. Kuncheva and C. J. Whitaker, "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy," Mach. Learn., vol. 51, no. 2, pp. 181-207, 2003.
8. B. Clarke, "Comparing Bayes model averaging and stacking when model approximation error cannot be ignored," J. Mach. Learn. Res., vol. 4, pp. 683-712, Oct. 2003.
9. D. Dash and G. F. Cooper, "Exact model averaging with naive Bayesian classifiers," in Proc. 19th Int. Conf. Machine Learning (ICML'02), Sydney, Australia, Jul. 2002, pp. 91-98.
10. J. Cerquides and R. López de Màntaras, "Tractable Bayesian learning of tree augmented naive Bayes models," in Proc. 20th Int. Conf. Machine Learning (ICML'03), Washington, DC, Aug. 2003, pp. 75-82.
11. D. Dash and G. R Cooper, "Model averaging for prediction with discrete Bayesian networks," J. Mach. Learn. Res., vol. 5, pp. 1177-1203, Sep. 2004.
12. N. Friedman and D. Koller, "Being Bayesian about network structure. A Bayesian approach to structure discovery in Bayesian networks," Mach. Learn., vol. 50, no. 1/2, pp. 95-125, 2003.
13. W. R. Gilks, S.Richardson, and D. J. Spiegelhalter, "Introducing Markov chain Monte Carlo," in Markov Chain Monte Carlo in Practice, W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Eds. Boca Raton, FL: CRC, 1998, ch. 1, pp. 1-19.
14. D. Heckerrnan, D. Geiger, and D. M. Chickering, "Learning Bayesian networks: The combination of knowledge and statistical data," Mach. Learn., vol. 20, no. 3, pp. 197-243, 1995.
15. P. Larrañaga, C. M. H. Kuijpers, R. H. Murga, and Y. Yurramendi, "Learning Bayesian network structures by searching for the best ordering with genetic algorithms," IEEE Trans. Syst., Man, Cybern. A, Syst. Humans, vol. 26, no. 4, pp. 487-493, Aug. 1996.
16. W. A. Wright, "Bayesian approach to neural-network modeling with input uncertainty," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1261-1270, 1999.
17. B.-T. Zhang and D.-Y. Cho, "System identification using evolutionary Markov chain Monte Carlo," J. Syst. Architect., vol. 47, no. 7, pp. 587-599, 2001.
18. Y. Wang and S.-C. Zhu, "Analysis and synthesis of textured motion: Particles and waves," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 10, pp. 1348-1363, Oct. 2004.
19. I. A. Beinlich, H. J. Suermondt, R. M. Chavez, and G. F. Cooper, "The ALARM monitoring system: a case study with two probabilistic inference techniques for belief networks," in Proc. 2nd Eur. Conf. Artificial Intelligence in Medicine (AIME'89), London, U.K., 1989, pp. 247-256.
20. S. Knudsen, A Biologist's Guide to Analysis of DNA Microarray Data. New York: Wiley, 2002.
21. M. H. Cheok, W. Yang, C.-H. Pui, J. R. Downing, C. Cheng, C. W. Naeve, M. V. Relling, and W. E. Evans, "Treatment-specific changes in gene expression discriminate in vivo drug response in human leukemia cells," Nature Genetics, vol. 34, no. 1, pp. 85-90, 2003.
22. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
23. G. F. Cooper, "The computational complexity of probabilistic inference using Bayesian belief networks," Artif. Intell., vol. 42, no. 2/3, pp. 393-405, 1990.