Towards integrative causal analysis of heterogeneous data sets and studies

Journal of Machine Learning Research

Volumn 13, Issue , 2012, Pages 1097-1157

  Tsamardinos, Ioannis ^a   Triantafillou, Sofia ^a   Lagani, Vincenzo ^a  

^a INSTITUTE OF COMPUTER SCIENCE   (Greece)

Author keywords

Bayesian networks; Causal discovery; Causality; Data fusion; Integrative causal analysis; Maximal ancestral graphs; Statistical matching; Structural equation models

Indexed keywords

ANCESTRAL GRAPHS; CAUSAL ANALYSIS; CAUSAL DISCOVERY; CAUSALITY; STATISTICAL MATCHING; STRUCTURAL EQUATION MODELS;

BAYESIAN NETWORKS; DATA FUSION; EXPERIMENTS;

ALGORITHMS;

EID: 84860672357     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Review

References (72)

1. B Abramson, J Brown, W Edwards, A Murphy, and RL Winkler. Hailfinder: A Bayesian system for forecasting severe weather. International Journal of Forecasting, 12(1):57-71, 1996. (Pubitemid 126160223)
2. J Alcalá-Fdez, L Sánchez, S García, M J Jesus, S Ventura, J M Garrell, J Otero, C Romero, J Bacardit, V M Rivas, J C Fernández, and F Herrera. KEEL: A software tool to assess evolutionary algorithms for data mining problems. Soft Computing, 13(3):307-318, 2009.
3. CF Aliferis, A Statnikov, I Tsamardinos, S Mani, and X Koutsoukos. Local causal and Markov blanket induction for causal discovery and feature selection for classification part ii : Analysis and extensions. Journal of Machine Learning Research, 11:235-284, 2010.
4. N Angelopoulos and J Cussens. Bayesian learning of Bayesian networks with informative priors. Annals of Mathematics and Artificial Intelligence, 54(1-3):53-98, 2008.
5. Y Aphinyanaphongs, AR Statnikov, and CF Aliferis. A comparison of citation metrics to machine learning filters for the identification of high quality MEDLINE documents. JAMIA, 13(4):446-455, 2006. (Pubitemid 43947624)
6. A Balke and J Pearl. Bounds on treatment effects from studies with imperfect compliance. Journal of the American Statistical Association, 92(439):1172-1176, 1997.
7. IA Beinlich, HJ Suermondt, RM Chavez, and GF Cooper. The ALARM monitoring system: A case study with two probabilistic inference techniques for belief networks. In Second European Conference on Artificial Intelligence in Medicine, volume 38, pages 247-256. Springer-Verlag, Berlin, 1989.
8. J Binder, D Koller, S Russell, and K Kanazawa. Adaptive probabilistic networks with hidden variables. Machine Learning, 29, 1997.
9. JA Blackard and DJ Dean. Comparative accuracies of artificial neural networks and discriminant analysis in predicting forest cover types from cartographic variables. Computers and Electronics in Agriculture, 24(3):131-151, 1999. (Pubitemid 30059342)
10. G Borboudakis, S Triantafillou, V Lagani, and I Tsamardinos. A constraint-based approach to incorporate prior knowledge in causal models. In Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), 2011.
11. M Cannataro, D Talia, and P Trunfio. Distributed data mining on the grid. Future Gener. Comput. Syst., 18:1101-1112, October 2002.
12. T Claassen and T Heskes. Causal discovery in multiple models from different experiments. In Advances in Neural Information Processing Systems (NIPS 2010), volume 23, pages 1-9, 2010.
13. TP et al. Conrads. High-resolution serum proteomic features for ovarian cancer detection. Endocrine-Related Cancer, 11(2):163-78, 2004.
14. GF Cooper and Ch Yoo. Causal discovery from a mixture of experimental and observational data. In Proceedings of Uncertainty in Artificial Intelligence (UAI 1999), volume 10, pages 116-125, 1999.
15. P Cortez, Ao Cerdeira, F Almeida, T Matos, and J Reis. Modeling wine preferences by data mining from physicochemical properties. Decision Support Systems, 47(4):547-553, November 2009. ISSN 01679236.
16. R Cudeck. An estimate of the covariance between variables which are not jointly observed. Psychometrika, 65(4):539-546, 2000. (Pubitemid 33222966)
17. SA Danziger, R Baronio, L Ho, L Hall, K Salmon, GW Hatfield, P Kaiser, and RH Lathrop. Predicting positive p53 cancer rescue regions using most informative positive (MIP) active learning. PLoS Computational Biology, 5(9):12, 2009.
18. M D'Orazio, MD Zio, and M Scanu. Statistical Matching: Theory and Practice. Wiley, 2006.
19. F Eberhardt. A sufficient condition for pooling data. Synthese, 163(3):433-442, February 2008.
20. F Eberhardt, PO Hoyer, and R Scheines. Combining experiments to discover linear cyclic models with latent variables. In Proceedings of Artificial Intelligence anf Statistics 2010, volume 9, pages 185-192, 2010.
21. C Elkan. Magical thinking in data mining: lessons from CoIL challenge 2000. Proceedings of the seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 426-431, 2001.
22. RA Fisher. On the interpretation of c2 from contingency tables, and the calculation of p. Journal of the Royal Statistical Society, 85(1):87-94, 1922.
23. A Frank and A Asuncion. UCI machine learning repository, 2010. URL http://archive.ics.uci.edu/ml.
24. JH Gennari, ML Neal, BE Carlson, and DL Cook. Integration of multi-scale biosimulation models via light-weight semantics. Pacific Symposium On Biocomputing, 425:414-25, 2008.
25. L Getoor and B Taskar. Introduction to Statistical Relational Learning, volume L. The MIT Press, 2007.
26. HA Guvenir and I Uysal. Bilkent University function approximation repository, 2000. URL http://funapp.cs.bilkent.edu.tr.
27. I Guyon, S Gunn, M Nikravesh, and L Zadeh. Feature Extraction, Foundations and Applications. Springer-Verlag, Berlin, Germany, 2006a.
28. I Guyon, A Saffari, G Dror, and J Buhmann. Performance prediction challenge. The 2006 IEEE International Joint Conference on Neural Network Proceedings, pages 1649-1656, 2006b. (Pubitemid 351369520)
29. A Hyttinen, F Eberhardt, and PO Hoyer. Causal discovery for linear cyclic models with latent variables. In Proccedings of the 5th European Workshop on Probabilistic Graphical Models, 2010.
30. A Hyttinen, F Eberhardt, and PO Hoyer. Noisy-OR models with latent confounding. In Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI 2011), 2011.
31. Th Joachims. Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms. (The Kluwer International Series in Engineering and Computer Science). Springer, 2002.
32. SH Kim. Markovian combination of subgraphs of DAGs. In Proceedings of The 10th IASTED International Conference on Artificial Intelligence and Applications, pages 90-95, 2010.
33. SH Kim and S Lee. New Developments in Robotics, Automation and Control. In-Tech, Vienna, Austria, 2008.
34. MH Maathuis, M Kalisch, and P Bühlmann. Estimating high-dimensional intervention effects from observational data. Annals of Statistics, 37:3133-3164, 2009.
35. MH Maathuis, D Colombo, M Kalisch, and P Bühlmann. Predicting causal effects in large-scale systems from observational data. Nature Methods, 7(4):247-248, 2010. ISSN 15487105.
36. S Mani and GF Cooper. Causal discovery using a Bayesian local causal discovery algorithm. Medinfo 2004, 11:731-735, 2004.
37. C Meek. Causal inference and causal explanation with background knowledge. In Proceedings of the 11th Conference of Uncertainty in Aritficial Intelligence, pages 403-410, 1995.
38. C Moriarity and F Scheuren. Statistical matching: A paradigm for assessing the uncertainty in the procedure. Journal of Official Statistics, 17:407-422, 2001.
39. RT O'Donnell, AE Nicholson, B. Han, KB Korb, MJ Alam, and LR Hope. Incorporating Expert Elicited Structural Information in the CaMML Causal Discovery Program. Technical report, Clayton School of Information Technology, Monash University, Melbourne, 2006.
40. K O'Rourke. An historical perspective on meta-analysis: dealing quantitatively with varying study results. Journal of the Royal Society of Medicine, 100(12):579-582, 2007.
41. SJ Pan and Q Yang. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 22(10):1345-1359, 2010.
42. J Pearl. Causality: Models, Reasoning and Inference, volume 113 of Hardcover. Cambridge University Press, 2000.
43. J Pearl. Causal inference in statistics: An overview. Statistics Surveys, 3:96-146, 2009.
44. K Pearson. On a criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can reasonably be supposed to have arisen from random sampling. Philosophical Magazine, 50(50):157-175, 1900.
45. JP Pellet and A Elisseeff. Finding latent causes in causal networks: An efficient approach based on Markov blankets. In Proceedings of the 22nd Annual Conference on Neural Information Processing Systems, 2008.
46. J Ramsey, P Spirtes, and J Zhang. Adjacency faithfulness and conservative causal inference. In Proceedings of Uncertainty in Artificial Intelligence, 2006.
47. T Richardson and P Spirtes. Ancestral graph markov models. The Annals of Statistics, 30(4): 962-1030, 2002. (Pubitemid 37095336)
48. A Rosenwald et al. The use of molecular profiling to predict survival after chemotherapy for diffuse large-b-cell lymphoma. N Engl J Med, 346(25):1937-1947, 2002. (Pubitemid 34651353)
49. DG Rubin. Characterizing the estimation of parameters in incomplete-data problems. Journal of the American Statistical Association, 69:467-474, 1974.
50. G Samsa, G Hu, and M Root. Combining information from multiple data sources to create multivariable risk models: Illustration and preliminary assessment of a new method. Journal of Biomedicine and Biotechnology, 2005(2):113-123, 2005. (Pubitemid 41627867)
51. S Shimizu, PO Hoyer, A Hyvärinen, and A Kerminen. A linear non-Gaussian acyclic model for causal discovery. Journal of Machine Learning Research, 7(2):2003-2030, 2006. (Pubitemid 44497456)
52. S Shimizu, T Inazumi, Y Sogawa, A Hyvarinen, Y Kawahara, T Washio, PO Hoyer, and K Bollen. DirectLiNGAM: A direct method for learning a linear non-Gaussian structural equation model. Journal of Machine Learning Research, 12:1225-1248, 2011.
53. A Spanos. Revisiting the omitted variables argument: Substantive vs. statistical adequacy. Journal of Economic Methodology, 13(2):179-218, 2006. (Pubitemid 43970609)
54. P Spirtes and TS Richardson. A polynomial time algorithm for determining DAG equivalence in the presence of latent variables and selection bias. In Proceedings of the 6th International Workshop on Artificial Intelligence and Statistics, pages 489-500, 1996.
55. P Spirtes, C Glymour, and R Scheines. Causation, Prediction, and Search. The MIT Press, second edition, January 2001.
56. J Tian and J Pearl. Causal Discovery from Changes. Proceedings of UAI, pages 512-521, 2001.
57. RE Tillman. Structure learning with independent non-identically distributed data. In Proceedings of the 26th Annual International Conference on Machine Learning, pages 1041-1048. ACM, 2009.
58. RE Tillman and P Spirtes. Learning equivalence classes of acyclic models with latent and selection variables from multiple datasets with overlapping variables. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, volume 15, pages 3-15, 2011.
59. RE Tillman, David Danks, and Clark Glymour. Integrating locally learned causal structures with overlapping variables. In Advances in Neural Information Processing Systems (NIPS, 2008.
60. S Triantafillou, I Tsamardinos, and IG Tollis. Learning causal structure from overlapping variable sets. In Proceedings of Artificial Intelligence and Statistics, volume 9, 2010.
61. I Tsamardinos and G Borboudakis. Permutation testing improves Bayesian network learning. In ECML PKDD, pages 322-337, 2010.
62. I Tsamardinos and LE Brown. Bounding the false discovery rate in local Bayesian network learning. In Proceedings of the 23rd Conference on Artificial Intelligence (AAAI), pages 1100-1105, 2008.
63. I Tsamardinos and S Triantafillou. The possibility of integrative causal analysis: Learning from different datasets and studies. Journal of Engineering Intelligent Systems, 17(2/3):163-175, 2009.
64. I Tsamardinos, LE Brown, and CF Aliferis. The max-min hill-climbing Bayesian network structure learning algorithm. Machine Learning, 65(1):31-78, 2006. (Pubitemid 44451193)
65. G Tsoumakas, I Katakis, and I Vlahavas. Mining multi-label data. Data Mining and Knowledge Discovery Handbook, pages 1-20, 2010.
66. B Vantaggi. Statistical matching of multiple sources: A look through coherence. Int. J. Approx. Reasoning, 49(3):701-711, 2008.
67. Y et al. Wang. Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet, 365(9460):671-679, 2005. (Pubitemid 40260888)
68. AV Werhli and D Husmeier. Reconstructing gene regulatory networks with Bayesian networks by combining expression data with multiple sources of prior knowledge. Statistical Applications in Genetics and Molecular Biology, 6(1):Article15, 2007.
69. S Wright. The method of path coefficients. The Annals of Mathematical Statistics, 5(3):161-215, 1934.
70. J Zhang. On the completeness of orientation rules for causal discovery in the presence of latent confounders and selection bias. Artificial Intelligence, 172(16-17):1873-1896, 2008.
71. XH Zhou, N Hu, G Hu, and M Root. Synthesis analysis of regression models with a continuous outcome. Statistics in Medicine, 28(11):1620-1635, 2009.
72. DW Zimmerman, BD Zumbo, and RH Williams. Bias in estimation and hypothesis testing of correlation. Psicoliogica, 24:133-158, 2003.