Using Bayesian networks in the construction of a bi-level multi-classifier. A case study using intensive care unit patients data

Artificial Intelligence in Medicine

Volumn 22, Issue 3, 2001, Pages 233-248

  Sierra, Basilio ^a   Serrano, Nicolás ^b   Larrañaga, Pedro ^a   Plasencia, Eliseo J ^b   Inza, Iñaki ^a   Jiménez, Juan José ^b   Revuelta, Pedro ^b   Mora, María Luisa ^b  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^b Intensive Care U Canary Isl U   (Spain)

Author keywords

10 Fold cross validation; Bayesian networks; Genetic algorithms; Machine learning; Stacked generalization; Supervised classification

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; STATISTICAL METHODS;

BAYESIAN NETWORKS;

MEDICAL COMPUTING;

ACCURACY; ALGORITHM; ARTICLE; BAYES THEOREM; CASE STUDY; DATA BASE; INTENSIVE CARE UNIT; PATIENT CODING; PATIENT INFORMATION; PREDICTION; PRIORITY JOURNAL; TECHNIQUE; VALIDATION PROCESS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; DECISION TREES; GENETICS; HUMANS; INTENSIVE CARE UNITS; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; PATIENT CARE PLANNING;

EID: 0035019648     PISSN: 09333657     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0933-3657(00)00111-1     Document Type: Article

References (44)

1. Aha D., Kibler D., Albert M.K. Instance-based learning algorithms. Machine Learning. 6:1991;37-66.
2. Aha D. Tolerating, irrelevant and novel attributes in instance-based learning algorithms. Int. J. Man-Machine Studies. 36(1):1992;267-287.
3. Andersen SK, Olesen KG, Jensen FV, Jensen F. HUGIN - a shell for building Bayesian belief universes for expert systems. In: Proceedings of the 11th International Joint Conference on Artificial Intelligence, 1989. p. 1128-33.
4. Breiman L, Friedman J, Olshen R, Stone C. Classification and regression trees. Monterey (CA): Wadsworth, 1984.
5. Castillo E. Gutiérrez JM, Hadi AS. Expert systems and probabilistic network models. Berlin: Springer, 1997.
6. Clark P., Nibblet T. The cn2 induction algorithm. Machine Learning. 3(4):1989;261-283.
7. Cohen WW. Fast effective rule induction, machine learning. In: Proceedings of the 12th Internacional Conference, 1995.
8. Cowell RG, Dawid APh, Lauritzen SL, Spiegelharter DJ. Probabilistic networks and expert systems. Berlin: Springer, 1999.
9. Dasarathy BV. Nearest neighbor (NN) norms: NN Pattern recognition classification techniques. Silver Spring (MD): IEEE Computer Society Press, 1991.
10. Friedman N., Geiger D., Goldszmidt M. Bayesian network classifiers. Machine Learning. 19(4):1997;131-163.
11. Goldberg DE. Genetic algorithms in search, optimization and machine learning. Reading (MA): Addison-Wesley, 1989.
12. Heckerman D., Geiger D., Chickering D.M. Learning Bayesian networks: the combination of knowledge and statistical data. Machine Learning. 20:1995;197-243.
13. Henrion M. Propagating uncertainty in Bayesian networks by probabilistic logic sampling. In: Proceedings of the 4th Conference on Uncertainty in Artificial Intelligence, 1988. p. 149-63.
14. Ho T.K., Srihati S.N. Decision combination in multiple classifier systems. IEEE Trans. Pattern Anal. Machine Intell. 16:1994;66-75.
15. Holte R.C. Very simple classification rules perform well on most commonly used databases. Machine Learning. 11:1994;63-90.
16. Inza I, Larrañaga P, Sierra B, Niño M. Combination of Classifiers. A Case Study in Oncology. Internal Report EHU-KZAA-IK-1-98, 1998.
17. Inza I., Larrañaga P., Sierra B., Etxeberria R., Lozano J.A., Peña J.M. Representing the joint behaviour of machine learning inducers by Bayesian networks. Pattern Recognition Letters. 20(11-13):1999;1201-1209.
18. Jensen FV. Introduction to Bayesian Networks. University College of London, 1996.
19. Knaus W.A., Draper E.A., Wagner D.P., Zimmerman J.E. APACHE II: a severity of disease classification system. Crit. Care Med. 13:1985;818-829.
20. Kohavi R. Scaling up the accuracy of Naive-Bayes classifiers: a decision-tree hybrid. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, 1996.
21. Kohavi R, Sommerfield D, Dougherty J. Data mining using MLC++, a machine learning library in C++, Int J Artif Intell Tools 1997;6(4) 537-66 ( http://www.sgi.com/Technology/mlc/ ).
22. Larrañaga P., Poza M., Yurramendi Y., Murga R., Kuijpers C. Structure learning of Bayesian networks by genetic algorithms: a performance analysis of control parameters. IEEE Trans. Pattern Anal. Machine Intell. 18:1996;912-926.
23. Lauritzen SL. Graphical models. Oxford: Oxford University Press, 1996.
24. Lauritzen S.L., Spiegelhalter D.J. Local computations with probabilities on graphical structures and their application on expert systems. J. R. Statist. Soc. B. 50:1988;157-224.
25. Le Gall J.R., Lemeshow S., Saulnier F. A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study. JAMA. 270:1993;2957-2963.
26. Lemeshow S., Teres D., Klar J., Avrunin J.S., Gehlbach S.H., Rapoport J. Mortality probability models (MPM II) based on an international cohort of intensive care unit patients. JAMA. 270:1993;2478-2486.
27. Martin JK. An exact probability metric for decision tree splitting and stopping. Machine Learning 1997;28(2/3).
28. Michalski RS, Mozetic I, Hong J, Lavrac N. The AQ15 inductive learning system: an overview and experiments. In: Proceedings of IMAL 1986. Orsay (France): Universitéde Paris-Sud, 1986.
29. Mingers J. A comparison of methods of pruning induced Rule Trees. Technical Report. Coventry (UK): University of Warwick, School of Industrial and Business Studies, 1988.
30. Murthy S.K., Kasif S., Salzberg S. A system for the induction of oblique decision trees. J. Artif. Intell. Res. 2:1994;1-33.
31. Niblett T, Bratko I. Learning decision rules in noisy domains. In: Bramer MA, editor. Research and development in expert systems III, Cambridge: Cambridge University Press, 1987. p. 25-34.
32. Pearl J. Evidential reasoning using stochastic simulation of causal models. Artif. Intell. 32(2):1987;245-257.
33. Pearl J. Probabilistic reasoning in intelligent systems: networks of plausible inference. San Mateo: Morgan Kaufmann, 1988.
34. Quinlan J.R. Induction of decision trees. Machine Learning. 1:1986;81-106.
35. Quinlan JR. In: McDermott J, editor. Generating production rules from decision trees, IJCAI-87. San Francisco (CA): Morgan Kaufmann, 1987. p. 304-7.
36. Quinlan JR. C4.5: Programs for Machine Learning. Los Altos (CA): Morgan Kaufmann Publishers, 1993.
37. Serrano N, Revuelta P, Jiménez JJ, Plasencia E, Martínez J, Brouard MT, Mora ML. Levels of severity at ICU discharge related those at ICU admission: Criterion for ICU discharge? Intensive Care Med 24 (1998) s10.
38. Sierra B., Larrañaga P. Predicting survival in malignant skin melanoma using Bayesian networks automatically induced by genetic algorithms. An empirical comparision between different approaches. Artif. Intell. Med. 14:1998;215-230.
39. Sierra B., Serrano N., Larrañaga P., Plasencia E.J., Inza I., Jiménez J.J., Revuelta P., Mora M.L. Machine learning inspired approaches to combine standard medical measures at an intensive care unit. Lecture Notes in Artificial Intelligence. 1620:1999;366-371.
40. Stone M. Cross-validation choice and assessment of statistical procedures. J. R. Statist. Soc. 36:1974;111-147.
41. Skalak D. Prototipe selection for composite Nearest Neighbor classifiers. Ph.D. Thesis, Amherst: University of Massachusetts, 1997.
42. Ting KM. Common issues in instance-based and Naive-Bayesian classifiers. Ph.D. Thesis, Basser Department of Computer Science. The University of Sidney, NSW, Australia, 1995.
43. Wettschereck D. A study of distance-based machine learning algorithms. Ph.D. Thesis, Oregon State University, 1994.
44. Wolpert D. Stacked generalization. Neural Networks. 5:1992;241-259.