Local causal and markov blanket induction for causal discovery and feature selection for classification part I: Algorithms and empirical evaluation

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 171-234

  Aliferis, Constantin F ^a   Statnikov, Alexander ^a   Tsamardinos, Ioannis ^b   Mani, Subramani ^c   Koutsoukos, Xenofon D ^c  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF CRETE   (Greece)

^c VANDERBILT UNIVERSITY   (United States)

Author keywords

Causal structure learning; Classification; Feature selection; Learning of Bayesian networks; Local causal discovery; Markov blanket induction

Indexed keywords

ALGORITHMIC FRAMEWORK; CAUSAL GRAPH; CAUSAL RELATIONSHIPS; CAUSAL STRUCTURE LEARNING; CLASSIFICATION; CLASSIFICATION FEATURES; EMPIRICAL EVALUATIONS; EXPERIMENTAL EVALUATION; FEATURE SELECTION; FEATURE SELECTION METHODS; FEATURE SETS; INTERPRETABILITY; LOCAL LEARNING; LOSS FUNCTIONS; MARKOV BLANKETS; NOVEL ALGORITHM; PREDICTIVITY; SMALL SAMPLES; SUFFICIENT CONDITIONS; VERY LARGE DATUM;

BAYESIAN NETWORKS; DISTRIBUTED PARAMETER NETWORKS; FEATURE EXTRACTION; INFERENCE ENGINES; INTELLIGENT NETWORKS;

LEARNING ALGORITHMS;

EID: 76749137632     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (123)

1. C. F. Aliferis and G. F. Cooper. An evaluation of an algorithm for inductive learning of Bayesian belief networks using simulated data sets. Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence (UAI), 1994.
2. C. F. Aliferis and I. Tsamardinos. Algorithms for large-scale local causal discovery and feature selection in the presence of small sample or large causal neighborhoods. Technical Report DSL 02-08, 2002a.
3. C. F. Aliferis and I. Tsamardinos. Using local causal induction to improve global causal discovery: Enhancing the sparse candidate set. Technical Report DSL 02-04, 2002b.
4. C. F. Aliferis, I. Tsamardinos, and A. Statnikov. Large-scale feature selection using Markov blanket induction for the prediction of protein-drug binding. Technical Report DSL 02-06, 2002.
5. C. F. Aliferis, I. Tsamardinos, and A. Statnikov. HITON: a novel Markov blanket algorithm for optimal variable selection. AMIA 2003 Annual Symposium Proceedings, pages 21-25, 2003a.
6. C. F. Aliferis, I. Tsamardinos, A. Statnikov, and L. E. Brown. Causal explorer: a causal probabilistic network learning toolkit for biomedical discovery. Proceedings of the 2003 International Conference on Mathematics and Engineering Techniques in Medicine and Biological Sciences (METMBS), 2003b.
7. C. F. Aliferis, A. Statnikov, E. Kokkotou, P. P. Massion, and I. Tsamardinos. Local regulatorynetwork inducing algorithms for biomarker discovery from mass-throughput datasets. Technical Report DSL 06-05, 2006a.
8. C. F. Aliferis, A. Statnikov, and P. P. Massion. Pathway induction and high-fidelity simulation for molecular signature and biomarker discovery in lung cancer using microarray gene expression data. Proceedings of the 2006 American Physiological Society Conference "Physiological Genomics and Proteomics of Lung Disease", 2006b.
9. C. F. Aliferis, A. Statnikov, I. Tsamardinos, S. Mani, and X. D. Koutsoukos. Local causal and Markov blanket induction for causal discovery and feature selection for classification. Part II: Analysis and extensions. Journal of Machine Learning Research, 11:235-284, 2010.
10. Y. Aphinyanaphongs and C. F. Aliferis. Learning boolean queries for article quality filtering. Medinfo 2004., 11(Pt 1):263-267, 2004.
11. Y. Aphinyanaphongs, A. Statnikov, and C. F. Aliferis. A comparison of citation metrics to machine learning filters for the identification of high quality medline documents. J.Am.Med.Inform.Assoc., 13(4):446-455, Jul 2006.
12. X. Bai, C. Glymour, R. Padman, J. Ramsey, P. Spirtes, and F. Wimberly. PCX: Markov blanket classification for large data sets with few cases. Technical Report, Center for Automated Learning and Discovery, 2004.
13. G. E. A. P. A. Batista and M. C. Monard. An analysis of four missing data treatment methods for supervised learning. Applied Artificial Intelligence, 17(5-6):519-533, 2003.
14. Y. Benjamini and Y. Hochberg. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society.Series B (Methodological), 57(1):289-300, 1995.
15. Y. Benjamini and D. Yekutieli. The control of the false discovery rate in multiple testing under dependency. Ann.Statist, 29(4):1165-1188, 2001.
16. A. Bhattacharjee, W. G. Richards, J. Staunton, C. Li, S. Monti, P. Vasa, C. Ladd, J. Beheshti, R. Bueno, M. Gillette, M. Loda, G. Weber, E. J. Mark, E. S. Lander, W. Wong, B. E. Johnson, T. R. Golub, D. J. Sugarbaker, and M. Meyerson. Classification of human lung carcinomas by mrna expression profiling reveals distinct adenocarcinoma subclasses. Proc.Natl.Acad.Sci.U.S.A, 98(24):13790-13795, Nov 2001.
17. L. Breiman. Random forests. Machine Learning, 45(1):5-32, 2001.
18. L. E. Brown, I. Tsamardinos, and C. F. Aliferis. A comparison of novel and state-of-the-art polynomial Bayesian network learning algorithms. Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI), 2005.
19. R. Caruana and D. Freitag. Greedy attribute selection. Proceedings of the Eleventh International Conference on Machine Learning, pages 28-36, 1994.
20. J. Cheng and R. Greiner. Comparing Bayesian network classifiers. Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence (UAI), pages 101-107, 1999.
21. J. Cheng and R. Greiner. Learning Bayesian belief network classifiers: Algorithms and system. Proceedings of 14th Biennial Conference of the Canadian Society for Computational Studies of Intelligence, 2001.
22. J. Cheng, R. Greiner, J. Kelly, D. Bell, and W. Liu. Learning Bayesian networks from data: an information-theory based approach. Artificial Intelligence, 137(1):43-90, 2002a.
23. J. Cheng, C. Hatzis, H. Hayashi, M. A. Krogel, S. Morishita, D. Page, and J. Sese. Kdd cup 2001 report. ACM SIGKDD Explorations Newsletter, 3(2):47-64, 2002b.
24. D.M. Chickering. Learning equivalence classes of bayesian-network structures. Journal of Machine Learning Research, 2:445-498, 2002.
25. D.M. Chickering. Optimal structure identification with greedy search. Journal of Machine Learning Research, 3(3):507-554, 2003.
26. D. M. Chickering, D. Geiger, and D. Heckerman. Learning Bayesian networks is NP-hard. Technical Report MSR-TR-94-17, 1994.
27. C. Chow and C. Liu. Approximating discrete probability distributions with dependence trees. IEEE Transactions on Information Theory, 14(3):462-467, 1968.
28. T. P. Conrads, V. A. Fusaro, S. Ross, D. Johann, V. Rajapakse, B. A. Hitt, S. M. Steinberg, E. C. Kohn, D. A. Fishman, G. Whitely, J. C. Barrett, L. A. Liotta, E. F. I. I. I. Petricoin, and T. D. Veenstra. High-resolution serum proteomic features for ovarian cancer detection. Endocr.Relat Cancer, 11(2):163-178, Jun 2004.
29. G. F. Cooper. A simple constraint-based algorithm for efficiently mining observational databases for causal relationships. Data Mining and Knowledge Discovery, 1(2):203-224, 1997.
30. G. F. Cooper and E. Herskovits. A Bayesian method for the induction of probabilistic networks from data. Machine Learning, 9(4):309-347, 1992.
31. G. F. Cooper and C. Yoo. Causal discovery from a mixture of experimental and observational data. Proceedings of Uncertainty in Artificial Intelligence, pages 116-125, 1999.
32. G. F. Cooper, C. F. Aliferis, R. Ambrosino, J. Aronis, B. G. Buchanan, R. Caruana, M. J. Fine, C. Glymour, G. Gordon, and B. H. Hanusa. An evaluation of machine-learning methods for predicting pneumonia mortality. Artificial Intelligence in Medicine, 9(2):107-138, 1997.
33. D. Dash and G. F. Cooper. Exact model averaging with naive Bayesian classifiers. Proc.19th Int.Conf.Machine Learning (ICML 2002), pages 91-98, 2002.
34. E. R. DeLong, D. M. DeLong, and D. L. Clarke-Pearson. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 44(3): 837-845, Sep 1988.
35. R. Diaz-Uriarte and S. Alvarez de Andres. Gene selection and classification of microarray data using random forest. BMC Bioinformatics, 7:3, 2006.
36. R. O. Duda and P. E. Hart. Pattern Classification and Scene Analysis. Wiley, New York, 1973.
37. S. Duda, C. F. Aliferis, R. Miller, A. Statnikov, and K. Johnson. Extracting drug-drug interaction articles from medline to improve the content of drug databases. AMIA 2005 Annual Symposium Proceedings, pages 216-220, 2005.
38. S. Dudoit and M. J. van der Laan. Asymptotics of cross-validated risk estimation in model selection and performance assessment. UC Berkeley Division of Biostatistics Working Paper Series, 126, 2003.
39. F. Eberhardt, C. Glymour, and R. Scheines. On the number of experiments sufficient and in the worst case necessary to identify all causal relations among n variables. Proceedings of the 21st Conference on Uncertainty in Artificial Intelligence (UAI), pages 178-183, 2005.
40. F. Eberhardt, C. Glymour, and R. Scheines. N-1 experiments suffice to determine the causal relations among n variables. Innovations in Machine Learning: Theory And Applications, 2006.
41. M. B. Eisen, P. T. Spellman, P. O. Brown, and D. Botstein. Cluster analysis and display of genomewide expression patterns. Proc.Natl.Acad.Sci.U.S. A, 95(25):14863-14868, Dec 1998.
42. J. Fan and R. Li. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456):1348-1361, 2001.
43. R. E. Fan, P. H. Chen, and C. J. Lin. Working set selection using second order information for training support vector machines. Journal of Machine Learning Research, 6(1889):1918, 2005.
44. N. Fananapazir, M. Li, D. Spentzos, and C. F. Aliferis. Formative evaluation of a prototype system for automated analysis of mass spectrometry data. AMIA 2005 Annual Symposium Proceedings, pages 241-245, 2005.
45. T. Fawcett. Roc graphs: Notes and practical considerations for researchers. Technical Report, HPL-2003-4, HP Laboratories, 2003.
46. D. P. Foster and R. A. Stine. Variable selecion in data mining: Building a predictive model for bankruptcy. Journal of the American Statistical Association, 99(466):303-314, 2004.
47. L. Frey, D. Fisher, I. Tsamardinos, C. F. Aliferis, and A. Statnikov. Identifying Markov blankets with decision tree induction. Proceedings of the Third IEEE International Conference on Data Mining (ICDM), 2003.
48. N. Friedman, D. Geiger, and M. Goldszmidt. Bayesian network classifiers. Machine Learning, 29 (2):131-163, 1997.
49. N. Friedman, M. Goldszmidt, and A. Wyner. Data analysis with Bayesian networks: A bootstrap approach. Proceedings of Uncertainty in Artificial Intelligence (UAI), pages 206-215, 1999a.
50. N. Friedman, I. Nachman, and D. Pe'er. Learning Bayesian network structure frommassive datasets: the "sparse candidate" algorithm. Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence (UAI), 1999b.
51. N. Friedman, M. Linial, I. Nachman, and D. Pe'er. Using Bayesian networks to analyze expression data. J Comput.Biol., 7(3-4):601-620, 2000. (Pubitemid 30944025)
52. G. M. Fung and O. L. Mangasarian. A feature selection newton method for support vector machine classification. Computational Optimization and Applications, 28(2):185-202, 2004.
53. T. S. Furey, N. Cristianini, N. Duffy, D. W. Bednarski, M. Schummer, and D. Haussler. Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics, 16(10):906-914, Oct 2000.
54. O. Gevaert, Smet F. De, D. Timmerman, Y. Moreau, and Moor B. De. Predicting the prognosis of breast cancer by integrating clinical and microarray data with Bayesian networks. Bioinformatics, 22(14):e184-e190, Jul 2006.
55. C. N. Glymour and G. F. Cooper. Computation, Causation, and Discovery. AAAI Press, Menlo Park, Calif, 1999.
56. P. I. Good. Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses, volume 2nd. Springer, New York, 2000.
57. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3(1):1157-1182, 2003.
58. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik. Gene selection for cancer classification using support vector machines. Machine Learning, 46(1):389-422, 2002.
59. I. Guyon, S. Gunn, M. Nikravesh, and L. A. Zadeh. Feature Extraction: Foundations and Applications. Springer-Verlag, Berlin, 2006a.
60. I. Guyon, J. Li, T. Mader, P. A. Pletscher, G. Schneider, and M. Uhr. Feature selection with the clop package. Technical report, http://clopinet.com/ isabelle/Projects/ETH/TM-fextract-class.pdf, 2006b.
61. I. Guyon, C. F. Aliferis, and A. Elisseeff. Computational Methods of Feature Selection, chapter Causal Feature Selection. Chapman and Hall, 2007.
62. D. Hardin, I. Tsamardinos, and C. F. Aliferis. A theoretical characterization of linear SVM-based feature selection. Proceedings of the Twenty First International Conference on Machine Learning (ICML), 2004.
63. D. Heckerman. A tutorial on learning with Bayesian networks. Technical Report MSR-TR-95-06, 1995.
64. D. Heckerman, D. Geiger, and D. M. Chickering. Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20(3):197-243, 1995.
65. M. Hollander and D. Wolfe. Nonparametric Statistical Methods, volume 2nd. Wiley, New York, NY, USA, 1999.
66. J. H. Holmes, D. R. Durbin, and F. K. Winston. The learning classifier system: an evolutionary computation approach to knowledge discovery in epidemiologic surveillance. Artif.Intell.Med., 19(1):53-74, May 2000.
67. N. Hoot, I. Feurer, C. W. Pinson, and C. F. Aliferis. Modelling liver transplant survival: comparing techniques of deriving predictor sets. Journal of Gastrointestinal Surgery, 9(4):563, Apr 2005.
68. T. Joachims. Learning to Classify Text Using Support Vector Machines. Kluwer Academic Publishers, Boston, 2002.
69. K. Kira and L. A. Rendell. A practical approach to feature selection. Proceedings of the Ninth International Workshop on Machine Learning, pages 249-256, 1992.
70. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2): 273-324, 1997.
71. D. Koller and M. Sahami. Toward optimal feature selection. Proceedings of the International Conference on Machine Learning, 1996, 1996.
72. I. Kononenko. Estimating attributes: Analysis and extensions of relief. Proceedings of the European Conference on Machine Learning, pages 171-182, 1994.
73. L. Li, C. R. Weinberg, T. A. Darden, and L. G. Pedersen. Gene selection for sample classification based on gene expression data: study of sensitivity to choice of parameters of the ga/knn method. Bioinformatics, 17(12):1131-1142, Dec 2001.
74. H. Liu and H.Motoda. Feature Extraction, Construction and Selection: A Data Mining Perspective. Kluwer Academic, Boston, 1998.
75. H. Liu, F. Hussain, C. L. Tan, and M. Dash. Discretization: an enabling technique. Data Mining and Knowledge Discovery, 6(4):393-423, 2002.
76. S. Mani and G. F. Cooper. A study in causal discovery from population-based infant birth and death records. Proceedings of the AMIA Annual Fall Symposium, 319, 1999.
77. S. Mani and G. F. Cooper. Causal discovery using a Bayesian local causal discovery algorithm. Medinfo 2004., 11(Pt 1):731-735, 2004.
78. D. Margaritis and S. Thrun. Bayesian network induction via local neighborhoods. Advances in Neural Information Processing Systems, 12:505-511, 1999.
79. S. Meganck, P. Leray, and B. Manderick. Learning causal Bayesian networks from observations and experiments: A decision theoretic approach. Modeling Decisions in Artificial Intelligence, LNCS, pages 58-69, 2006.
80. A. Moore and W. K. Wong. Optimal reinsertion: a new search operator for accelerated and more accurate Bayesian network structure learning. Proceedings of the Twentieth International Conference on Machine Learning (ICML), pages 552-559, 2003.
81. K. P. Murphy. Active learning of causal Bayes net structure. Technical Report, University of California, Berkeley, 2001.
82. R. E. Neapolitan. Probabilistic Reasoning in Expert Systems: Theory and Algorithms. Wiley, New York, 1990.
83. R. E. Neapolitan. Learning Bayesian networks. Pearson Prentice Hall, Upper Saddle River, NJ, 2004.
84. J. Peña, J. Bjorkegren, and J. Tegner. Growing Bayesian network models of gene networks from seed genes. Bioinformatics, 21(2):224-229, 2005a.
85. J. Peña, J. Bjorkegren, and J. Tegner. Scalable, efficient and correct learning of Markov boundaries under the faithfulness assumption. Proceedings of the Eighth European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty, 2005b.
86. J. Peña, R. Nilsson, J. Bjorkegren, and J. Tegnér. Towards scalable and data efficient learning of Markov boundaries. International Journal of Approximate Reasoning, 45(2):211-232, 2007.
87. J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers, San Mateo, California, 1988.
88. J. Pearl. Causality: Models, Reasoning, and Inference. Cambridge University Press, Cambridge, U.K, 2000.
89. J. Pearl and T. Verma. A theory of inferred causation. Principles of Knowledge Representation and Reasoning: Proceedings of Second International Conference, pages 441-452, 1991.
90. J. Pearl and T. S. Verma. Equivalence and synthesis of causal models. Proceedings of the Sixth Conference on Uncertainty in Artificial Intelligence, pages 220-227, 1990.
91. I. Pournara and L. Wernisch. Reconstruction of gene networks using Bayesian learning and manipulation experiments. Bioinformatics, 20(17):2934-2942, Nov 2004.
92. A. Rakotomamonjy. Variable selection using SVM-based criteria. Journal of Machine Learning Research, 3(7-8):1357-1370, 2003.
93. J. Ramsey. A pc-style Markov blanket search for high-dimensional datasets. Technical Report, CMU-PHIL-177, Carnegie Mellon University, Department of Philosophy, 2006.
94. J. Ramsey, J. Zhang, and P. Spirtes. Adjacency-faithfulness and conservative causal inference. Proceedings of the 22nd Annual Conference on Uncertainty in Artificial Intelligence (UAI-06), 2006.
95. A. Rosenwald, G. Wright, W. C. Chan, J. M. Connors, E. Campo, R. I. Fisher, R. D. Gascoyne, H. K.Muller-Hermelink, E. B. Smeland, J.M. Giltnane, E.M. Hurt, H. Zhao, L. Averett, L. Yang, W. H. Wilson, E. S. Jaffe, R. Simon, R. D. Klausner, J. Powell, P. L. Duffey, D. L. Longo, T. C. Greiner, D. D. Weisenburger, W. G. Sanger, B. J. Dave, J. C. Lynch, J. Vose, J. O. Armitage, E. Montserrat, A. Lopez-Guillermo, T. M. Grogan, T. P. Miller, M. LeBlanc, G. Ott, S. Kvaloy, J. Delabie, H. Holte, P. Krajci, T. Stokke, and L. M. Staudt. The use of molecular profiling to predict survival after chemotherapy for diffuse large-b-cell lymphoma. N.Engl.J Med., 346(25): 1937-1947, Jun 2002.
96. A. Sboner and C. F. Aliferis. Modeling clinical judgment and implicit guideline compliance in the diagnosis of melanomas using machine learning. AMIA 2005 Annual Symposium Proceedings, pages 664-668, 2005.
97. T. Scheffer. Error Estimation and Model Selection. PhD thesis, Ph.D.Thesis, Technischen Universitet Berlin, School of Computer Science, 1999.
98. C. Silverstein, S. Brin, R.Motwani, and J. Ullman. Scalable techniques for mining causal structures. Data Mining and Knowledge Discovery, 4(2):163-192, 2000.
99. P. T. Spellman, G. Sherlock, M. Q. Zhang, V. R. Iyer, K. Anders, M. B. Eisen, P. O. Brown, D. Botstein, and B. Futcher. Comprehensive identification of cell cycle-regulated genes of the yeast saccharomyces cerevisiae by microarray hybridization. Mol.Biol Cell, 9(12):3273-3297, Dec 1998.
100. P. Spirtes, C. N. Glymour, and R. Scheines. Causation, Prediction, and Search, volume 2nd. MIT Press, Cambridge, Mass, 2000.
101. A. Statnikov. Algorithms for discovery of multiple Markov boundaries: Application to the molecular signature multiplicity problem. Ph.D.Thesis, Department of Biomedical Informatics, Vanderbilt University, 2008.
102. A. Statnikov, C. F. Aliferis, I. Tsamardinos, D. Hardin, and S. Levy. A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics, 21(5):631-643, Mar 2005a.
103. A. Statnikov, I. Tsamardinos, Y. Dosbayev, and C. F. Aliferis. Gems: a system for automated cancer diagnosis and biomarker discovery from microarray gene expression data. Int.J.Med.Inform., 74 (7-8):491-503, Aug 2005b. (Pubitemid 41021913)
104. A. Statnikov, D. Hardin, and C. F. Aliferis. Using SVM weight-based methods to identify causally relevant and non-causally relevant variables. Proceedings of the NIPS 2006 Workshop on Causality and Feature Selection, 2006.
105. J. Tian and J. Pearl. Causal discovery from changes: A bayesian approach. UCLA Cognitive Systems Laboratory, Technical Report (R-285), 2001.
106. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society.Series B (Methodological), 58(1):267-288, 1996.
107. S. Tong and D. Koller. Active learning for structure in bayesian networks. Proceedings of the International Joint Conference on Artificial Intelligence, 17:863-869, 2001.
108. I. Tsamardinos and C. F. Aliferis. Towards principled feature selection: relevancy, filters and wrappers. Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics (AI & Stats), 2003.
109. I. Tsamardinos and L. E. Brown. Bounding the false discovery rate in local Bayesian network learning. Proceedings of the Twenty Third National Conference on Artificial Intelligence (AAAI), 2008a.
110. I. Tsamardinos and L. E. Brown. Markov blanket-based variable selection in feature space. Technical report DSL-08-01, 2008b.
111. I. Tsamardinos, C. F. Aliferis, and A. Statnikov. Algorithms for large scale Markov blanket discovery. Proceedings of the Sixteenth International Florida Artificial Intelligence Research Society Conference (FLAIRS), pages 376-381, 2003a.
112. I. Tsamardinos, C. F. Aliferis, and A. Statnikov. Time and sample efficient discovery of Markov blankets and direct causal relations. Proceedings of the Ninth International Conference on Knowledge Discovery and Data Mining (KDD), pages 673-678, 2003b.
113. I. Tsamardinos, C. F. Aliferis, A. Statnikov, and L. E. Brown. Scaling-up Bayesian network learning to thousands of variables using local learning technique. Technical Report DSL 03-02, 12, 2003c.
114. I. Tsamardinos, Brown L.E., and C. F. Aliferis. The max-min hill-climbing Bayesian network structure learning algorithm. Technical report DSL-05-01, 2005.
115. I. Tsamardinos, L. E. Brown, and C. F. Aliferis. The max-min hill-climbing Bayesian network structure learning algorithm. Machine Learning, 65(1):31-78, 2006.
116. L.Wang, J. Zhu, and H. Zou. The doubly regularized support vector machine. Statistica Sinica, 16: 589-615, 2006. (Pubitemid 44085519)
117. Y.Wang, J. G. Klijn, Y. Zhang, A.M. Sieuwerts,M. P. Look, F. Yang, D. Talantov,M. Timmermans, M. E. Meijer-van Gelder, J. Yu, T. Jatkoe, E. M. Berns, D. Atkins, and J. A. Foekens. Geneexpression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet, 365(9460):671-679, Feb 2005.
118. J. Weston, A. Elisseeff, B. Scholkopf, and M. Tipping. Use of the zero-norm with linear models and kernel methods. Journal of Machine Learning Research, 3(7):1439-1461, 2003.
119. S. Yaramakala and D. Margaritis. Speculative Markov blanket discovery for optimal feature selection. Proceedings of the Fifth IEEE International Conference on Data Mining, pages 809-812, 2005.
120. C. Yoo and G. F. Cooper. An evaluation of a system that recommends microarray experiments to perform to discover gene-regulation pathways. Artif.Intell.Med., 31(2):169-182, Jun 2004.
121. X. Zhou, M. C. J. Kao, and W. H. Wong. Transitive functional annotation by shortest-path analysis of gene expression data. Proceedings of the National Academy of Sciences, 99(20):12783-12788, 2002.
122. J. Zhu, S. Rosset, T. Hastie, and R. Tibshirani. 1-norm support vector machines. Advances in Neural Information Processing Systems (NIPS), 16, 2004.
123. H. Zou and T. Hastie. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society Series B(Statistical Methodology), 67(2):301-320, 2005.