A comparative analysis of ensemble classifiers: Case studies in genomics

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2013, Pages 807-816

  Whalen, Sean ^a   Pandey, Gaurav ^a  

^a MOUNT SINAI SCHOOL OF MEDICINE   (United States)

Author keywords

Bioinformatics; Ensemble methods; Ensemble selection; Genomics; Stacking; Supervised learning

Indexed keywords

EID: 84894669509     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2013.21     Document Type: Conference Paper

References (52)

1. L. Rokach, "Ensemble-Based Classifiers," Artificial Intelligence Review, vol. 33, no. 1-2, pp. 1-39, 2009.
2. G. Seni and J. Elder, Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions. Morgan & Claypool, 2010.
3. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-Time Human Pose Recognition in Parts from Single Depth Images," in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 1297-1304.
4. D. Kim, "Forecasting Time Series with Genetic Fuzzy Predictor Ensemble," IEEE Transactions on Fuzzy Systems, vol. 5, no. 4, pp. 523-535, 1997.
5. P. Yang, Y. H. Yang, B. B. Zhou, and A. Y. Zomaya, "A Review of Ensemble Methods in Bioinformatics," Current Bioinformatics, vol. 5, no. 4, pp. 296-308, 2010.
6. A. Altmann, M. Rosen-Zvi, M. Prosperi, E. Aharoni, H. Neuvirth, E. Schülter, J. Büch, D. Struck, Y. Peres, F. Incardona, A. Sönnerborg, R. Kaiser, M. Zazzi, and T. Lengauer, "Comparison of Classifier Fusion Methods for Predicting Response to Anti HIV-1 Therapy," PLoS ONE, vol. 3, no. 10, p. e3470, 2008.
7. M. Liu, D. Zhang, and D. Shen, "Ensemble Sparse Classification of Alzheimer's Disease," Neuroimage, vol. 60, no. 2, pp. 1106-1116, 2012.
8. A. Khan, A. Majid, and T.-S. Choi, "Predicting Protein Subcellular Location: Exploiting Amino Acid Based Sequence of Feature Spaces and Fusion of Diverse Classifiers," Amino Acids, vol. 38, no. 1, pp. 347-350, 2010.
9. G. Pandey, B. Zhang, A. N. Chang, C. L. Myers, J. Zhu, V. Kumar, and E. E. Schadt, "An Integrative Multi-Network and Multi-Classifier Approach to Predict Genetic Interactions," PLoS Computational Biology, vol. 6, no. 9, p. e1000928, 2010.
10. K. Tumer and J. Ghosh, "Error Correlation and Error Reduction in Ensemble Classifiers," Connection Science, vol. 8, no. 3-4, pp. 385-404, 1996.
11. L. I. Kuncheva and C. J. Whitaker, "Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy," Machine Learning, vol. 51, no. 2, pp. 181-207, 2003.
12. T. G. Dietterich, "An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization," Machine Learning, vol. 40, no. 2, pp. 139-157, 2000.
13. E. K. Tang, P. N. Suganthan, and X. Yao, "An Analysis of Diversity Measures," Machine Learning, vol. 65, no. 1, pp. 247-271, 2006.
14. L. Breiman, "Bagging Predictors," Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
15. R. E. Schapire and Y. Freund, Boosting: Foundations and Algorithms. MIT Press, 2012.
16. C. J. Merz, "Using Correspondence Analysis to Combine Classifiers," Machine Learning, vol. 36, no. 1-2, pp. 33-58, 1999.
17. D. H. Wolpert, "Stacked Generalization," Neural Networks, vol. 5, no. 2, pp. 241-259, 1992.
18. R. Caruana, A. Niculescu-Mizil, G. Crew, and A. Ksikes, "Ensemble Selection from Libraries of Models," in Proceedings of the 21st International Conference on Machine Learning, 2004, pp. 18-26.
19. R. Caruana, A. Munson, and A. Niculescu-Mizil, "Getting the Most Out of Ensemble Selection," in Proceedings of the 6th International Conference on Data Mining, 2006, pp. 828-833.
20. A. Niculescu-Mizil, C. Perlich, G. Swirszcz, V. Sindhwani, and Y. Liu, "Winning the KDD Cup Orange Challenge with Ensemble Selection," Journal of Machine Learning Research Proceedings Track, vol. 7, pp. 23-24, 2009.
21. G. Pandey, V. Kumar, and M. Steinbach, "Computational Approaches for Protein Function Prediction: A Survey," University of Minnesota, Tech. Rep., 2006.
22. D. C. Hess, C. L. Myers, C. Huttenhower, M. A. Hibbs, A. P. Hayes, J. Paw, J. J. Clore, R. M. Mendoza, B. S. Luis, C. Nislow, G. Giaever, M. Costanzo, O. G. Troyanskaya, and A. A. Caudy, "Computationally Driven, Quantitative Experiments Discover Genes Required for Mitochondrial Biogenesis," PLoS Genetics, vol. 5, no. 3, p. e1000407, 2009.
23. E. Szczurek, N. Misra, and M. Vingron, "Synthetic Sickness or Lethality Points at Candidate Combination Therapy Targets in Glioblastoma," International Journal of Cancer, 2013.
24. A. Bella, C. Ferri, J. Hernández-Orallo, and M. J. Ramírez-Quintana, "On the Effect of Calibration in Classifier Combination," Applied Intelligence, pp. 1-20, 2012.
25. T. R. Hughes, M. J. Marton, A. R. Jones, C. J. Roberts, R. Stoughton, C. D. Armour, H. A. Bennett, E. Coffey, H. Dai, Y. D. He, M. J. Kidd, A. M. King, M. R. Meyer, D. Slade, P. Y. Lum, S. B. Stepaniants, D. D. Shoemaker, D. Gachotte, K. Chakraburtty, J. Simon, M. Bard, and S. H. Friend, "Functional Discovery via a Compendium of Expression Profiles," Cell, vol. 102, no. 1, pp. 109-126, 2000.
26. C. L. Myers, D. R. Barrett, M. A. Hibbs, C. Huttenhower, and O. G. Troyanskaya, "Finding Function: Evaluation Methods for Functional Genomic Data," BMC Genomics, vol. 7, no. 187, 2006.
27. G. Pandey, C. L. Myers, and V. Kumar, "Incorporating Functional Inter-Relationships Into Protein Function Prediction Algorithms," BMC Bioinformatics, vol. 10, no. 142, 2009.
28. J. L. Hartman, B. Garvik, and L. Hartwell, "Principles for the Buffering of Genetic Variation," Science, vol. 291, no. 5506, pp. 1001-1004, 2001.
29. T. Horn, T. Sandmann, B. Fischer, E. Axelsson, W. Huber, and M. Boutros, "Mapping of Signaling Networks Through Synthetic Genetic Interaction Analysis by RNAi," Nature Methods, vol. 8, no. 4, pp. 341-346, 2011.
30. B. VanderSluis, J. Bellay, G. Musso, M. Costanzo, B. Papp, F. J. Vizeacoumar, A. Baryshnikova, B. J. Andrews, C. Boone, and C. L. Myers, "Genetic Interactions Reveal the Evolutionary Trajectories of Duplicate Genes," Molecular Systems Biology, vol. 6, no. 1, 2010.
31. R Core Team, "R: A Language and Environment for Statistical Computing," 2012.
32. K. Hornik, C. Buchta, and A. Zeileis, "Open-Source Machine Learning: R Meets Weka," Computational Statistics, vol. 24, no. 2, pp. 225-232, 2009.
33. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The WEKA Data Mining Software: An Update," SIGKDD Explorations, vol. 11, no. 1, pp. 10-18, 2009.
34. M. Kuhn, "Building Predictive Models in R Using the caret Package," Journal of Statistical Software, vol. 28, no. 5, pp. 1-26, 2008.
35. T. Hothorn, P. Bühlmann, T. Kneib, M. Schmid, and B. Hofner, "Model-Based Boosting 2.0," Journal of Machine Learning Research, vol. 11, no. Aug, pp. 2109-2113, 2010.
36. J. H. Friedman, T. Hastie, and R. J. Tibshirani, "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, vol. 33, no. 1, pp. 1-22, 2010.
37. W. N. Venables and B. D. Ripley, Modern Applied Statistics with S, 4th ed. Springer, 2002.
38. G. Ridgeway, "gbm: Generalized Boosted Regression Models," 2013.
39. A. Liaw and M. Wiener, "Classification and Regression by randomForest," R News, vol. 2, no. 3, pp. 18-22, 2002.
40. T. Hastie, R. J. Tibshirani, B. Narasimhan, and G. Chu, "Diagnosis of Multiple Cancer Types by Shrunken Centroids of Gene Expression," Proceedings of the National Academy of Sciences of the United States of America, vol. 99, no. 10, pp. 6567-6572, 2002.
41. K. M. Ting and I. H. Witten, "Issues in Stacked Generalization, " Journal of Artificial Intelligence Research, vol. 10, no. 1, pp. 271-289, 1999.
42. G. U. Yule, "On the Association of Attributes in Statistics: With Illustrations from the Material of the Childhood Society," Philosophical Transactions of the Royal Society of London, Series A, vol. 194, pp. 257-319, 1900.
43. J. Cohen, "A Coefficient of Agreement for Nominal Scales," Educational and Psychological Measurement, vol. 20, no. 1, pp. 37-46, 1960.
44. D. Eddelbuettel and R. François, "Rcpp: Seamless R and C++ Integration," Journal of Statistical Software, vol. 40, no. 8, pp. 1-18, 2011.
45. J. Demšar, "Statistical Comparisons of Classifiers over Multiple Data Sets," Journal of Machine Learning Research, vol. 7, no. Jan, pp. 1-30, 2006.
46. M. Friedman, "The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance," Journal of the American Statistical Association, vol. 32, no. 200, pp. 675-701, 1937.
47. P. B. Nemenyi, "Distribution-Free Multiple Comparisons," Ph.D. dissertation, Princeton University, 1963.
48. G. Brown and L. I. Kuncheva, Good" and "Bad" Diversity in Majority Vote Ensembles," in Proceedings of the 9th International Conference on Multiple Classifier Systems, 2010, pp. 124-133.
49. N. Li, Y. Yu, and Z.-H. Zhou, "Diversity Regularized Ensemble Pruning," in Proceedings of the 2012 European Conference on Machine Learning and Knowledge Discovery in Databases, 2012, pp. 330-345.
50. G. W. Brier, "Verification of Forecasts Expressed in Terms of Probability," Monthly Weather Review, vol. 78, no. 1, pp. 1-3, 1950.
51. J. C. Platt, "Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods," Advances in Large Margin Classifiers, vol. 10, no. 3, pp. 61-74, 1999.
52. B. Zadrozny and C. Elkan, "Transforming Classifier Scores Into Accurate Multiclass Probability Estimates," in Proceedings of the 8th ACM International Conference on Knowledge Discovery and Data Mining, 2002, pp. 694-699.