Building Bayesian network classifiers through a Bayesian complexity monitoring system

Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science

Volumn 223, Issue 3, 2009, Pages 743-756

  Ruz, G A ^a   Pham, D T ^a  

^a CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Bayes factor; Bayesian networks; Classification; Naive bayes; Tree augmented naive bayes classifier

Indexed keywords

BENCHMARKING; CLASSIFIERS; DISTRIBUTED PARAMETER NETWORKS; INDUSTRIAL APPLICATIONS; INFERENCE ENGINES; INTELLIGENT NETWORKS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NEURAL NETWORKS; SPEECH ANALYSIS; SPEECH RECOGNITION;

BAYES FACTOR; BAYESIAN; BAYESIAN APPROACHES; BAYESIAN NETWORK CLASSIFIERS; BENCHMARK DATUM; CLASSIFICATION; CLASSIFICATION ACCURACIES; ENGINEERING APPLICATIONS; LEARNING METHODS; MACHINE-LEARNING TECHNIQUES; MONITORING SYSTEMS; NAIVE BAYES; NAIVE BAYESIAN; RANDOM FOREST ALGORITHMS; SIMPLE STRUCTURES; SPANNING TREES; TRAINING DATUM; TREE CONSTRUCTIONS; TREE-AUGMENTED NAIVE BAYES CLASSIFIER;

BAYESIAN NETWORKS;

EID: 63149167438     PISSN: 09544062     EISSN: None     Source Type: Journal    
DOI: 10.1243/09544062JMES1243     Document Type: Article

References (42)

1. Pearl, J. Probabilistic reasoning in intelligent systems: networks of plausible inference, 1988 (Morgan Kaufmann, San Francisco).
2. Duda, R. O. and Hart, P. E. Pattern classification and scene analysis, 1973 (John Wiley & Sons, NewYork).
3. Langley, P., Iba, W., and Thompson, K. An analysis of Bayesian classifiers. In Proceedings of the 10th National Conference on Artificial Intelligence (AAAI'92), Menlo Park, CA, 1992, pp. 223-228.
4. Addin, O., Sapuan, S. M., Mahdi, E., and Othman, M. A naive-Bayes classifier for damage detection in engineering materials. Mater. Des., 2007, 28, 2379-2386.
5. Perzyk, M., Biernacki, R., and Kochahski A. Modeling of manufacturing processes by learning systems: the naïve Bayesian classifier versus artificial neural networks. J. Mater. Process. Technol., 2005, 164-165, 1430-1435.
6. Koskimäki, E., Göös, J., Kontkanen, P., Myllymäki, P., and Tirri, H. Comparing soft computing methods in prediction of manufacturing data. Lect. Notes Comput. Sci., 1998, 1416, 775-784.
7. Radeva, P., Bressan, M., Tovar, A., and Vitrià, J. Bayesian classification for inspection of industrial products. Lect. Notes Comput. Sci., 2002, 2504, 399-407.
8. Friedman, N., Geiger, D., and Goldszmidt, M. Bayesian network classifiers. Mach. Learn., 1997, 29(2/3), 131-163.
9. Chow, C. K. and Liu, C. N. Approximating discrete probability distributions with dependence trees. IEEE Trans. Inform. Theory, 1968, IT-14, 462-467.
10. Cooper, G. F. The computational complexity of probabilistic inference using Bayesian belief networks. Artif Intell., 1990, 42, 393-405.
11. Lam, W. and Bacchus, F. Learning Bayesian belief networks. An approach based on the MDL principle. Comput. Intell., 1994, 10, 269-293.
12. Rissanen, J. Modeling by shortest data description. Automatica, 1978, 14, 465-471.
13. Chickering, D. M. Learning Bayesian networks is NP-complete. Learning from data (Eds. D. Fisher and A. Lenz), 1996 pp. 121-130 (Springer-Verlag, NewYork).
14. Cooper, G. F. and Herskovits, E. A Bayesian method for the induction of probabilistic networks from data. Mach. Learn., 1992, 9, 309-347.
15. Heckerman, D., Geiger, D., and Chickering, D. M. Learning Bayesian networks: the combination of knowledge and statistical data. Mach. Learn., 1995, 20(3), 197-243.
16. Neapolitan, R. E. Learning Bayesian networks, 2004 (Pearson Prentice Hall, Upper Saddle River, New Jersey).
17. Heckerman, D. A tutorial on learning with Bayesian networks. Technical report MSR-TR-95-06, Microsoft Research, 1995.
18. Cerquides, J. and Lopez de Mantaras, R. TAN classifiers based on decomposable distributions. Mach. Learn., 2005, 59, 323-354.
19. Meilǎ, M. and Jaakkola, T. Tractable Bayesian learning of tree belief networks. In Proceedings of the 16th Conference on Uncertainty in artificial intelligence, 2000, pp. 380-388 (Morgan Kaufmann, San Francisco).
20. Acid, S., de Campos, L. M., and Castellano, J. G. Learning Bayesian network classifiers: search in a space of partially directed acyclic graphs. Mach. Learn., 2005, 59, 213-235.
21. Cheng, J. and Greiner, R. Comparing Bayesian network classifiers. In Proceedings of the 15th Conference on Uncertainty in artificial intelligence (UAI'99), 1999, pp. 101-107 (Morgan Kaufmann, San Francisco).
22. Shi, H. and Huang, H. Learning tree-augmented naive Bayesian networks by reduced space requirements. In Proceedings of the 1st International Conference on Machine Learning and Cybernetics, Beijing, 2002, pp. 1232-1236.
23. Monti, S. and Cooper, G. A Bayesian network classifier that combines a finite mixture model and a naive-Bayes model. In Proceedings of the 15th Conference on Uncertainty in artificial intelligence (UAI'99), 1999, pp. 447-456 (Morgan Kaufmann, San Francisco).
24. Grossman, D. and Domingos, P. Learning Bayesian network classifiers by maximizing conditional likelihood. In Proceedings of the 21st International Conference on Machine learning, Banff, Canada, 2004, pp. 361-368 (ACM, NewYork).
25. Keogh, E. and Pazzani, M. J. Learning the structure of augmented Bayesian classifiers. Int. J. Artif. Intell. Tools, 2002, 11(4), 587-601.
26. Hwang, K. and Zhang, B. Bayesian model averaging of Bayesian network classifiers over multiple node-orders: application to sparse datasets. IEEE Trans. Syst. Man Cybern. B, Cybern., 2005, 35(6), 1302-1310.
27. Jing, Y., Pavlovic, V., and Rehg, J. M. Efficient discriminative learning of Bayesian network classifier via boosted augmented naive Bayes. In Proceedings of the 22nd International Conference on Machine Learning, Bonn, Germany, 2005, pp. 369-376.
28. Kleiner, A. and Sharp, B. A new algorithm for learning Bayesian classifiers from data. In Proceedings of the 3rd IASTED International Conference on Artificial Intelligence and Soft Computing (ASC2000), Banff, Canada, July 2000, pp. 191-197.
29. Kruskal, Jr., J. B. On the shortest spanning subtree of a graph and the traveling salesman problem. Proc. Am. Math. Soc., 1956, 7, 48-50.
30. Kass, R. E. and Raftery, A. E. Bayes factors. J. Am. Stat. Assoc., 1995, 90(430), 773-795.
31. MacKay, J. C. Information theory, inference, and learning algorithms, 2003 (Cambridge University Press, UK).
32. Hellman, M. E. and Raviv, J. Probability of error, equivocation, and the Chernoff bound. IEEE Trans. Inform. Theory, 1970, IT-16, 368-372.
33. Murphy, P. M. and Aha, D. W. UCI repository of machine learning databases. Available from http://www.ics.uci.edu/~mlearn/MLRepository. html.
34. John, G. and Kohavi, R. Wrappers for feature subset selection. Artif. Intell., 1997, 97, 273-324.
35. Fayyad, U. M. and Irani, K. B. Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of the 13th International Joint Conference on Artificial Intelligence, Morgan Kaufmann, San Francisco, 1993, pp. 1022-1027.
36. Grant, E. E. and Leavenworth, R. S. Statistical quality control, 6th edition., 1988 (McGraw Hill, NewYork).
37. Pham, D. T. and Oztemel, E. Control chart pattern recognition using neural networks. J. Syst. Eng., 1992, 2, 256-262.
38. Kohavi, R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, Morgan Kaufmann, San Francisco, 1995, pp. 1137-1143.
39. Quinlan, J. R. C4.5: programs for machine learning, 1993 (Morgan Kaufmann, San Francisco).
40. Breiman, L. Random forests. Mach. Learn., 2001, 45(1), 5-32.
41. Data Mining Tools See5 and C5.0. Available from http://rulequest.com/ see5-info.html.
42. Cover, T. M. and Thomas, J. A. Elements of information theory, 1991 (Wiley, NewYork).