Data integration in machine learning

Proceedings - 2015 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2015

Volumn , Issue , 2015, Pages 1665-1671

  Li, Yifeng ^a   Ngom, Alioune ^b  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b UNIVERSITY OF WINDSOR   (Canada)

Author keywords

Bayesian network; data integration; decision tree; deep learning; feature extraction; multiple kernel learning; random forest

Indexed keywords

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; BIOINFORMATICS; DATA MINING; DECISION MAKING; DECISION TREES; FEATURE EXTRACTION; LEARNING SYSTEMS;

DEEP LEARNING; HETEROGENEOUS INFORMATION; INTEGRATION TECHNIQUES; MACHINE LEARNING MODELS; MULTIPLE KERNEL LEARNING; MULTIPLE SOURCE; RANDOM FORESTS;

DATA INTEGRATION;

EID: 84962476203     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BIBM.2015.7359925     Document Type: Conference Paper

References (53)

1. Z. Zhou, N. Chawla, Y. Jin, and G. Williams, "Big data opportunities and challenges: Discussions from data analytics perspectives, " IEEE Computational Intelligence Magazine, vol. 9, no. 4, pp. 62-74, 2014.
2. W. Nobel, "Support vector machine applications in computational biology, " in Kernel Methods in Computational Biology, B. Scholkopf, K. Tsuda, and J.-P. Vert, Eds. The MIT Press, 2004, ch. 3, pp. 71-92.
3. M. L. II, D. Hall, and J. Llinas, Handbook of Multisensor Data Fusion: Theory and Practice, 2nd ed. Boca Raton, Floria: CRC Press, 2008.
4. M. Ritchie, E. Holzinger, R. Li, S. Pendergrass, and D. Kim, "Methods of integrating data to uncover genotype-phenotype interactions, " Nature Review Genetics, vol. 15, pp. 85-97, 2015.
5. c. Cortes and V. Vapnik, "Support vector networks, " Machine Learning, vol. 20, pp. 273-297, 1995.
6. R. Tibshirani, "Regression shrinkage and selection via the Lasso, " Journal of the Royal Statistical Society. Series B (Methodological), vol. 58, no. 1, pp. 267-288, 1996.
7. R. Pique-Regi, J. Degner, A. Pai, D. Gaffney, Y. Gilad, and J. Pritchard, "Accurate inference of transcription factor binding from DNA sequence and chromatin accessibility data, " Genome Research, vol. 21, pp. 447-455, 2011.
8. J. Pearl, Probabilistic Reasoning in Intelligent Systems. San Mateo, CA: Morgan Kaufmann, 1988.
9. D. Chickering, "Learning Bayesian networks is NPcomplete, " in Learning from Data: Al and Statistics V, ser. Lecture Notes in Statistics, D. Frisher and H.-J. Lenz, Eds. Springer, 1996, ch. 12, pp. 121-130.
10. G. Elidan, I. Nachman, and N. Friedman, ""Ideal Parent " structure learning for continuous variable Bayesian networks, " Journal of Machine Learning Research, vol. 8, pp. 1799-1833, 2007.
11. S. Davies and A. Moore, "Mix-nets: Factored mixtures of Gaussians in Bayesian networks with mixed continuous and discrete variables, " in Proceedings of The Sixteenth Conference on Uncertainty in Artificial Intelligence. San Francisco, CA: Morgan Kaufmann Publishers Inc, 2000, pp. 168-175.
12. J. Cheng and R. Greiner, "Comparing Bayesian network classifiers, " in Proceedings of The Fifteenth Conference on Uncertainty in Artificial Intelligence. San Francisco, CA: Morgan Kaufmann Publishers Inc, 1999, pp. 101-108.
13. P. Langley, W. Iba, and K. Thompson, "An analysis of Bayesian classifiers, " in Proceedings of AAAI, 1992, pp. 223-228.
14. N. Friedman, D. Geiger, and M. Goldszmith, "Bayesian network classifiers, " Machine Learning, vol. 29, pp. 103-130, 1997.
15. L. Breiman, J. Friedman, C. Stone, and R. A. Olshen, Classification and Regression Trees. Chapman and Hall/CRC, 1984.
16. J. Friedman, R. Tibshirani, and T. Hastie, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. Springer, 2009.
17. D. Opitz and R. Maclin, "Popular ensemble methods: An empirical study, " Journal of Artificial Intelligence Research, vol. 11, pp. 169-198, 1999.
18. M. Sewell, "Ensemble learning, " 2011.
19. L. Breiman, "Bagging predictors, " Machine Learning, vol. 24, no. 3, pp. 123-140, 1996.
20. M. Kearns, "Thoughts on hypothesis boosting, " 1988.
21. L. Breiman, "Arcing classifiers, " The Annals of Statistics, vol. 26, no. 3, pp. 801-849, 1998.
22. R. Polikar, "Ensemble based systems in decision making, " IEEE Circuits and Systems Magazine, vol. 6, no. 3, pp. 21-45, 2006.
23. -, "Bootstrap inspired techniques in computational intelligence: Ensemble of classifiers, incremental learning, data fusion and missing features, " IEEE Signal Processing Magazine, vol. 24, no. 4, pp. 59-72, 2007.
24. M. Wozniak, M. Grana, and E. Corchado, "A survey of multiple classifier systems as hybrid systems, " Information Fusion, vol. 16, pp. 3-17, 2014.
25. C. Chen, A. Liaw, and L. Breiman, "Using Random Forest to Learn Imbalanced Data, " Department of Statistics, University of California, Berkeley, Tech. Rep., 2004.
26. D. Popovic, A. Sifrim, J. Davis, Y. Moreau, and B. D. Moor, "Problems with the nested granularity of feature domains in bioinformatics: The eXtasy case, " BMC Bioinformatics, vol. 16, no. 4, p. S2, 2015.
27. J. Pittman, E. Huang, H. Dressman, c.-F. Horng, S. Cheng, M.-H. Tsou, C.-M. Chen, A. Bild, E. Iversen, A. Huang, J. Nevins, and M. West, "Integrated modeling of clinical and gene expression information for personalized prediction of disease outcomes, " PNAS, vol. 101, no. 22, pp. 8431-8436, 2004.
28. M. Gonen and E. Alpaydin, "Multiple kernel learning algorithms, " Journal of Machine Learning Research, vol. 12, pp. 2211-2268, July 2011.
29. J. Wang, H. T. Do, A. Woznica, and A. Kalousis, "Metric learning with multiple kernels, " in Advances in Neural Information Processing Systems 24, J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, Eds., 2011, pp. 1170-1178.
30. E. P. Xing, M. I. Jordan, S. J. Russell, and A. Y. Ng, "Distance metric learning with application to clustering with sideinformation, " in Advances in Neural Information Processing Systems 15, S. Becker, S. Thrun, and K. Obermayer, Eds. MIT Press, 2003, pp. 521-528.
31. A. Bellet, A. Habrard, and M. Sebban, "A survey on metric learning for feature vectors and structured data, " CoRR, vol. abs/1306.6709, 2013.
32. B. Kulis, "Metric learning: A survey, " Foundations and Trends in Machine Learning, vol. 5, no. 4, pp. 287-364, 2012.
33. Y. Li, R. Caron, and A. Ngom, "A decomposition method for large-scale sparse coding in representation learning, " in World Congress on Computational Intelligence (lJCNNIWCCl). IEEE, July 2014, pp. 3732-2738.
34. S.-J. Kim, A. Magnani, and S. Boyd, "Optimal kernel selection in kernel fisher discriminant analysis, " in International Conference on Machine Learning, 2006, pp. 465-472.
35. I. Jolliffe, Principal Component Analysis. Springer, 2002.
36. M. Wall, A. Rechtsteiner, and L. Rocha, " Singular value decomposition and principal component analysis, " in A Practical Approach to Microarray Data Analysis, D. Berrar, W. Dubitzky, and M. Granzow, Eds. Norwell, MA: Kluwer, 2003, pp. 91-109.
37. D. Lawley, 'The estimation of factor loadings by the method of maximum likelihood, " Proceedings of the Royal Society of Edinburgh, vol. 60, pp. 64-82, 1940.
38. M. West, "Bayesian factor regression models in the "large p, small n " paradigm, " Bayesian Statistics, vol. 7, pp. 723-732, 2003.
39. D. D. Lee and S. Seung, "Learning the parts of objects by non-negative matrix factorization, " Nature, vol. 401, pp. 788-791, 1999.
40. E. Fertig, J. Ding, A. Favorov, G. Parmigiani, and M. Ochs, "CoGAPS: an RJC++ package to identify patterns and biological process activity in transcriptomic data, " Bioinformatics, vol. 26, no. 21, pp. 2792-2793, 2010.
41. Y. Li and A. Ngom, "The non-negative matrix factorization toolbox for biological data mining, " BMC Source Code for Biology and Medicine, vol. 8, no. 1, p. 10, 2013, https://sites.google.com/site/nmftool.
42. Y. Li, C. Chen, A. Kaye, and W. Wasserman, "The identification of cis-regulatory elements: A review from a machine learning perspective, " BioSystems, 2015, under revision.
43. T. Kolda and B. Bader, "Tensor decompositions and applications, " SlAM Review, vol. 51, no. 3, pp. 455-500, 2009.
44. Y. Li and A. Ngom, "Non-negative matrix and tensor factorization based classification of clinical microarray gene expression data, " in IEEE lnternational Conference on Bioinformatics & Biomedicine, IEEE. Piscataway, NJ: IEEE Press, Dec. 2010, pp. 438-443.
45. -, "Versatile sparse matrix factorization: Theory and applications, " Neurocomputing, vol. 145, pp. 23-29, 2014.
46. S. Virtanen, A. Klami, S. Khan, and S. Kaski, "Bayesian group factor analysis, " in Proceedings of the 15th lnternational Conference on Artificial Intelligence and Statistics, 2012, pp. 1269-1277.
47. A. Klami, S. Virtanen, and S. Kaski, "Bayesian cononical correlation analysis, " Journal of Machine Learning Research, vol. 14, pp. 965-1003, 2013.
48. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning, " Nature, vol. 521, pp. 436-444, 2015.
49. G. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets, " Neural Computation, vol. 18, pp. 1527-1554, 2006.
50. Y. LeCun and Y. Bengio, "Convolutional networks for images, speech, and time series, " in The Handbook of Brain Theory and Neural Networks. Cambridge, MA: MIT Press, 1995, pp. 255-258.
51. A. Graves and N. Jaitly, "Towards end-to-end speech recognition with recurrent neural networks, " in IEEE International Conference on Machine Learning (ICML), 2014, pp. 1764-1772.
52. Y. Li, C. Chen, and W. Wasserman, "Deep feature selection: Theory and application to identify enhancers and promoters, " Journal of Computational Biology, 2015, accepted (RECOMB 2015 Special Issue).
53. N. Srivastava and R. Salakhutdinov, "Multi modal learning with deep boltzmann machines, " Journal of Machine Learning Research, vol. 15, pp. 2949-2980, 2014.