Multi-dimensional classification with Bayesian networks

International Journal of Approximate Reasoning

Volumn 52, Issue 6, 2011, Pages 705-727

  Bielza, C ^a   Li, G ^b   Larranaga P ^a  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b REGA INSTITUTE FOR MEDICAL RESEARCH   (Belgium)

Author keywords

Bayesian network classifiers; Learning from data; MPE; Multi dimensional outputs; Multi label classification

Indexed keywords

BAYESIAN NETWORK CLASSIFIERS; LEARNING FROM DATA; MPE; MULTI-DIMENSIONAL OUTPUTS; MULTI-LABEL;

ALGORITHMS; CLASSIFICATION (OF INFORMATION); DISTRIBUTED PARAMETER NETWORKS; INFERENCE ENGINES; INTELLIGENT NETWORKS; SPEECH RECOGNITION;

BAYESIAN NETWORKS;

EID: 79955550286     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2011.01.007     Document Type: Article

References (73)

1. A.M. Abdelbar, and S.M. Hedetniemi Approximating MAP for belief networks is NP-hard and other theorems Artificial Intelligence 102 1 1998 21 38 (Pubitemid 128378356)
2. G.H. Bakir, T. Hofmann, B. Schölkopf, A. Smola, and B. Taskar Predicting Structured Data 2007 MIT Press Cambridge
3. R. Blanco, I. Inza, M. Merino, J. Quiroga, and P. Larrañaga Feature selection in Bayesian classifiers for the prognosis of survival of cirrhotic patients treated with TIPS Journal of Biomedical Informatics 38 5 2005 376 388 (Pubitemid 41405808)
4. M.R. Boutell, J. Luo, X. Shen, and C.M. Brown Learning multi-label scene classification Pattern Recognition 37 9 2004 1757 1771 (Pubitemid 38804465)
5. W. Cheng, and E. Hüllermeier Combining instance-based learning and logistic regression for multilabel classification Machine Learning 76 2-3 2009 211 225
6. W. Cheng, E. Hüllermeier, A simple instance-based approach to multi-label classification using the Mallows model, in: Proceedings of the Workshop on Learning from Multi-Label Data (MLD'09), 2009, pp. 28-38.
7. T. Cheng-Jung, L. Chien-I, and Y. Wei-Pang A discretization algorithm based on class-attribute contingency coefficient Information Sciences 178 2008 714 731
8. C. Chow, and C. Liu Approximating discrete probability distributions with dependence trees IEEE Transactions on Information Theory 14 1968 462 467
9. C. Chu, and T. Liu On the shortest arborescence of a directed graph Science Sinica 14 1968 1396 1400
10. G.F. Cooper, and E.A. Herskovits A Bayesian method for the induction of probabilistic networks from data Machine Learning 9 1992 309 347
11. A. Darwiche, Model-based diagnosis using causal networks, in: International Joint Conference on Artificial Intelligence, 1995, pp. 211-219.
12. H. Daumé III, D. Marcu, Learning as search optimization: approximate large margin methods for structured prediction, in: Proceedings of the International Conference on Machine Learning, 2005, pp. 169-176.
13. A.P. Dawid Applications of a general propagation algorithm for probabilistic expert systems Statistics and Computing 2 1992 25 36
14. A. de Carvalho, and A.A. Freitas A tutorial on multi-label classification techniques Foundations of Computational Intelligence Studies in Computational Intelligence vol. 5 2009 Springer 177 195
15. P.R. de Waal, and L.C. van der Gaag Inference and learning in multi-dimensional Bayesian network classifiers European Conference on Symbolic and Quantitative Approaches to Reasoning under Uncertainty Lecture Notes in Artificial Intelligence vol. 4724 2007 Springer 501 511
16. K. Deb, S. Agrawal, A. Pratap, T. Meyarivan, A fast elitist non-dominated sorting genetic algorithm for multi-objective optimisation: NSGA-II, in: Parallel Problem Solving from Nature (PPSN VI), Lecture Notes in Computer Science, 1917, 2000, pp. 849-858.
17. R. Dechter Bucket elimination: a unifying framework for reasoning Artificial Intelligence 113 1-2 1999 41 85 (Pubitemid 30542742)
18. R. Dechter, I. Rish, A scheme for approximating probabilistic inference, in: Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, 1997, pp. 132-141.
19. V. Delcroix, M.-A. Maalej, and S. Piechowiak Bayesian networks versus other probabilistic models for the multiple diagnosis of large devices International Journal on Artificial Intelligence Tools 16 3 2007 417 433
20. K. Dembczyński, W. Waegeman, W. Cheng, E. Hüllermeier, On label dependence in multi-label classification, in: Proceedings of the 2nd International Workshop on Learning from Multi-Label Data (MLD'10), 2010, pp. 5-12.
21. M.M. Drugan, and M.A. Wiering Feature selection for Bayesian network classifiers using the MDL-FS score International Journal of Approximate Reasoning 51 6 2010 695 717
22. R.O. Duda, P. Hart, and D. Stork Pattern Classification second ed. 2000 Wiley-Interscience
23. A. Elisseeff, and J. Weston A kernel method for multi-labelled classification T. Dietterich, S. Becker, Z. Ghahramani, Advances in Neural Information Processing Systems vol. 14 2002 MIT Press 681 687
24. N. Friedman, D. Geiger, and M. Goldszmidt Bayesian network classifiers Machine Learning 29 1997 131 163 (Pubitemid 127510036)
25. S. García, and F. Herrera An extension on "Statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons Journal of Machine Learning Research 9 2008 2677 2694
26. E.S. Gelsema Abductive reasoning in Bayesian belief networks using a genetic algorithm Pattern Recognition Letters 16 8 1995 865 871
27. S. Godbole, S. Sarawagi, Discriminative methods for multi-labeled classification, in: Proceedings of the 8th Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2004, pp. 22-30. (Pubitemid 38824880)
28. D.-J. Guan Generalized gray codes with applications Proceedings of the National Science Council of the Republic of China (A) 22 6 1998 842 848
29. M. Henrion, Propagating uncertainty in Bayesian networks by probabilistic logic sampling, in: Proceedings of the Second Annual Conference on Uncertainty in Artificial Intelligence, 1986, pp. 317-324.
30. E. Hüllermeier, J. Fürnkranz, W. Cheng, and K. Brinker Label ranking by learning pairwise preferences Artificial Intelligence 172 16-17 2008 1897 1916
31. F. Hutter, H.H. Hoos, T. Stützle, Efficient stochastic local search for MPE solving, in: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, 2005, pp. 169-174.
32. P. Ibargüengoytia, L.E. Sucar, E. Morales, Probabilistic model-based diagnosis, in: Proceedings of MICAI 2000, Lecture Notes in Artificial Intelligence, vol. 1793, 2000, pp. 687-698.
33. K. Kask, R. Dechter, Mini-bucket heuristics for improved search, in: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, 1999, pp. 314-323.
34. K. Kask, and R. Dechter A general scheme for automatic generation of search heuristics from specification dependencies Artificial Intelligence 129 1-2 2001 91 131 (Pubitemid 32498417)
35. R. Kohavi, and G. John Wrappers for feature subset selection Artificial Intelligence 97 1-2 1997 273 324 (Pubitemid 127401107)
36. D. Koller, and N. Friedman Probabilistic Graphical. Models Principles and Techniques 2009 MIT Press Cambridge
37. P. Langley, S. Sage, Tractable average-case analysis of naïve Bayesian classifiers, in: Proceedings of the 16th International Conference on Machine Learning, 1999, pp. 220-228.
38. Z. Li, B. D'Ambrosio, An efficient approach for finding the MPE in belief networks, in: Proceedings of the Ninth Annual Conference on Uncertainty in Artificial Intelligence, 1993, pp. 342-349.
39. R. Marinescu, and R. Dechter AND/OR branch-and-bound search for combinatorial optimization in graphical models Artificial Intelligence 173 16-17 2009 1457 1491
40. M. Minsky Steps toward artificial intelligence Transactions on Institute of Radio Engineers 49 1961 8 30
41. C. Parker, Y. Altun, and P. Tadepalli Guest editorial: special issue on structured prediction Machine Learning 77 2009 161 164
42. J. Pearl Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference 1988 Morgan Kaufmann Publishers
43. Y. Peng, and J.A. Reggia A probabilistic causal model for diagnostic problem solving - Part I: Integrating symbolic causal inference with numeric probabilistic inference IEEE Transactions on Systems, Man, and Cybernetics 17 2 1987 146 162
44. Y. Peng, and J.A. Reggia A probabilistic causal model for diagnostic problem solving. Part II: Diagnostic strategy IEEE Transactions on Systems, Man, and Cybernetics 17 3 1987 395 406 (Pubitemid 17632136)
45. A. Pérez, P. Larrañaga, and I. Inza Bayesian classifiers based on kernel density estimation: flexible classifiers International Journal of Approximate Reasoning 50 2 2009 341 362
46. M. Qazi,G. Fung, S. Krishnan, R. Rosales, H. Steck, R. Rao, D. Poldermans, D. Chandrasekaran, Automated heart wall motion abnormality detection from ultrasound images using Bayesian networks, in: International Joint Conference on Artificial Intelligence, 2007, pp. 519-525.
47. J. Read, B. Pfahringer, and G. Holmes Multi-label classification using ensembles of pruned sets Proceedings of the Eighth IEEE International Conference on Data Mining (ICDM'08) 2008 IEEE Computer Society 995 1000
48. G. Rebane, and J. Pearl The recovery of causal polytrees from statistical data Proceedings of the Third Annual Conference on Uncertainty in Artificial Intelligence (UAI-87) vol. 3 1987 Elsevier 222 228
49. S. Renooij, and L.C. van der Gaag Evidence and scenario sensitivities in naive Bayesian classifiers International Journal of Approximate Reasoning 49 2 2008 398 416
50. R.W. Robinson Counting labeled acyclic digraphs New Directions in Graph Theory 1973 Academic Press New York
51. J.D. Rodríguez, J.A. Lozano, Multi-objective learning of multi-dimensional Bayesian classifiers, in: Proceedings of the Eighth International Conference on Hybrid Intelligent Systems, 2008, pp. 501-506.
52. C. Rojas-Guzmán, M.A. Kramer, GALGO: a genetic algorithm decision support tool for complex uncertain systems modeled with Bayesian belief networks, in: Proceedings of the Ninth Annual Conference on Uncertainty in Artificial Intelligence, 1993, pp. 368-375.
53. M. Sahami, Learning limited dependence Bayesian classifiers, in: Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, 1996, pp. 335-338.
54. E. Santos, On the generation of alternative explanations with implications for belief revision, in: Proceedings of the Seventh Annual Conference on Uncertainty in Artificial Intelligence, 1991, pp. 339-347.
55. R.E. Schapire, and Y. Singer Boostexter: a boosting-based system for text categorization Machine Learning 39 2-3 2000 135 168 (Pubitemid 30594821)
56. S.E. Shimony Finding MAPs for belief networks is NP-hard Artificial Intelligence 68 2 1994 399 410
57. S.E. Shimony, E. Charniak, A new algorithm for finding MAP assignments to belief networks, in: Proceedings of the Sixth Annual Conference on Uncertainty in Artificial Intelligence, 1990, pp. 185-196.
58. M. Stone Cross-validatory choice and assessment of statistical predictions (with discussion) Journal of the Royal Statistical Society B 36 1974 111 147
59. C. Sutton, A. McCallum, and K. Rohanimanesh Dynamic conditional random fields: Factorized probabilistic models for labelling and segmenting sequence data Journal of Machine Learning Research 8 2007 693 723 (Pubitemid 46491655)
60. B. Taskar, C. Guestrin, D. Koller, Max-margin Markov networks, in: Advances in Neural Information and Processing Systems, vol. 16, MIT Press, 2004.
61. L. Tenenboim, L. Rokach, B. Shapira, Identification of label dependencies for multi-label classification, in: Proceedings of the 2nd International Workshop on Learning from Multi-Label Data (MLD'10), 2010, pp. 53-60.
62. K. Trohidis, G. Tsoumakas, G. Kalliris, I. Vlahavas, Multi-label classification of music into emotions, in: International Society for Music Information Retrieval Conference, 2008, pp. 325-330.
63. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun Large margin methods for structured and interdependent output variables Journal of Machine Learning Research 6 2005 1453 1484
64. G. Tsoumakas, A. Dimou, E. Spyromitros, V. Mezaris, I., Kompatsiaris, I. Vlahavas, Correlation-based pruning of stacked binary relevance models for multi-label learning, in: Proceedings of the Workshop on Learning from Multi-Label Data (MLD'09), 2009, pp. 101-116.
65. G. Tsoumakas, and I. Katakis Multi-label classification: an overview International Journal of Data Warehousing and Mining 3 3 2007 1 13
66. G. Tsoumakas, I. Katakis, I. Vlahavas, Effective and efficient multilabel classification in domains with large number of labels, in: Proceedings of ECML/PKDD 2008 Workshop on Mining Multidimensional Data (MMD'08), 2008, pp. 30-44.
67. G. Tsoumakas, I. Katakis, and I. Vlahavas Mining multi-label data Data Mining and Knowledge Discovery Handbook 2010 Springer 667 686
68. G. Tsoumakas, I. Katakis, I. Vlahavas, Random k-labelsets for multi-label classification, IEEE Transactions on Knowledge and Data Engineering (2011), in press.
69. N. Ueda, K. Saito, Parametric mixture models for multi-labeled text, in: Advances in Neural Information Processing Systems, vol. 15, 2002, pp. 721-728.
70. L. van der Gaag, P.R. de Waal, Multi-dimensional Bayesian network classifiers, in: Third European Conference on Probabilistic Graphical Models, 2006, pp. 107-114.
71. C. Vens, J. Struyf, L. Schietgat, S. Džeroski, and H. Blockeel Decision trees for hierarchical multi-label classification Machine Learning 73 2 2008 185 214
72. M. Zhang, and Z. Zhou ML-KNN: a lazy learning approach to multi-label learning Pattern Recognition 40 7 2007 2038 2048 (Pubitemid 46497248)
73. M.L. Zhang, and Z.H. Zhou Multi-label neural networks with applications to functional genomics and text categorization IEEE Transactions on Knowledge and Data Engineering 18 10 2006 1338 1351