Feature selection with the r package mxm: Discovering statistically equivalent feature subsets

Journal of Statistical Software

Volumn 80, Issue , 2017, Pages 1-25

  Lagani, Vincenzo ^a,b   Athineou, Giorgos ^a   Farcomeni, Alessio ^c   Tsagris, Michail ^a   Tsamardinos, Ioannis ^a,b  

^a UNIVERSITY OF CRETE   (Greece)

^b Science and Technology Park of Crete   (Greece)

^c SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Constraint based algorithms; Feature selection; Multiple predictive signatures

Indexed keywords

EID: 85089684667     PISSN: 15487660     EISSN: None     Source Type: Journal    
DOI: 10.18637/JSS.V080.I07     Document Type: Article

References (46)

1. Aliferis CF, Statnikov A, Tsamardinos I, Mani S, Koutsoukos XD (2010). “Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification Part I: Algorithms and Empirical Evaluation.” Journal of Machine Learning Research, 11, 171–234.
2. Aliferis CF, Statnikov AR, Tsamardinos I, Brown LE (2003). “Causal Explorer: A Causal Probabilistic Network Learning Toolkit for Biomedical Discovery.” In The 2003 International Conference on Mathematics and Engineering Techniques in Medicine and Biological Sciences (METMBS ’03).
3. Barton K (2016). MuMIn: Multi-Model Inference. R package version 1.15.6, URL https://CRAN.R-project.org/package=MuMIn.
4. Brown C (2013). hash: Ful l Feature Implementation of Hash/Associated Arrays/Dictionaries. R package version 2.2.6, URL https://CRAN.R-project.org/package=hash.
5. Buckland ST, Burnham KP, Augustin NH (1997). “Model Selection: An Integral Part of Inference.” Biometrics, pp. 603–618. doi:10.2307/2533961.
6. Calcagno V, de Mazancourt C (2010). “glmulti: An R Package for Easy Automated Model Selection with (Generalized) Linear Models.” Journal of Statistical Software, 34(12), 1–29. doi:10.18637/jss.v034.i12.
7. Christensen RHB (2015). “ordinal: Regression Models for Ordinal Data.” R package version 2015.6-28, URL https://CRAN.R-project.org/package=ordinal.
8. Cox DR (1972). “Regression Models and Life-Tables.” Journal of the Royal Statistical Society B, 34, 187–220. doi:10.2307/2985181.
9. Efron B, Hastie T, Johnstone I, Tibshirani R (2004). “Least Angle Regression.” The Annals of Statistics, 32(2), 407–499. doi:10.1214/009053604000000067.
10. Fawcett T (2006). “An Introduction to ROC Analysis.” Pattern Recognition Letters, 27, 861–874. doi:10.1016/j.patrec.2005.10.010.
11. Fisher RA (1924). “The Distribution of the Partial Correlation Coefficient.” Metron, 3, 329–332.
12. Friedman J, Hastie T, Tibshirani R (2010). “Regularization Paths for Generalized Linear Models via Coordinate Descent.” Journal of Statistical Software, 33(1), 1–13. doi:10. 18637/jss.v033.i01.
13. Gentleman R, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JY, Zhang J (2004). “Bioconductor: Open Software Development for Computational Biology and Bioinformatics.” Genome Biology, 5(10), R80. doi:10.1186/gb-2004-5-10-r80.
14. Guyon I, Elisseeff A (2003). “An Introduction to Variable and Feature Selection.” Journal of Machine Learning Research, 3, 1157–1182. doi:10.1162/153244303322753616.
15. Harrell FE (2001). Regression Modeling Strategies – With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer-Verlag, New York. doi:10.1007/978-1-4757-3462-1.
16. Huang GT, Tsamardinos I, Raghu V, Kaminski N, Benos PV (2015). “T-Recs: Stable Selection of Dynamically Formed Groups of Features with Application to Prediction of Clinical Outcomes.” In Pacific Symposium on Biocomputing (PSB).
17. Huber W, Carey VJ, Gentleman R, Anders S, Carlson M, Carvalho BS, Bravo HC, Davis S, Gatto L, Girke T, Gottardo R, Hahne F, Hansen KD, Irizarry RA, Lawrence M, Love MI, MacDonald J, Obenchain V, ś AKO, Pagès H, Reyes A, Shannon P, Smyth GK, Tenenbaum D, Waldron L, Morgan M (2015). “Orchestrating High-Throughput Genomic Analysis with Bioconductor.” Nature Methods, 12(2), 115–121. doi:10.1038/nmeth.3252.
18. Kane MJ, Emerson J, Weston S (2013). “Scalable Strategies for Computing with Massive Data.” Journal of Statistical Software, 55(14), 1–19. doi:10.18637/jss.v055.i14.
19. Koenker R (2017). quantreg: Quantile Regression. R package version 5.33, URL https://CRAN.R-project.org/package=quantreg.
20. Kuhn M (2013). QSARdata: Quantitative Structure Activity Relationship (QSAR) Data Sets. R package version 1.3, URL https://CRAN.R-project.org/package=QSARdata.
21. Lagani V, Kortas G, Tsamardinos I (2013). “Biomarker Signature Identification in “Omics” Data with Multi-Class Outcome.” Computational and Structural Biotechnology Journal, 6, e201303004. doi:10.5936/csbj.201303004.
22. Lagani V, Tsamardinos I (2010). “Structure-Based Variable Selection for Survival Data.” Bioinformatics, 26(15), 1887–1894.
23. Landsheer JA (2010). “The Specification of Causal Models with Tetrad IV: A Review.” Structural Equation Modeling, 17, 703–711. doi:10.1080/10705511.2010.510074.
24. Mazerolle MJ (2016). AICcmodavg: Model Selection and Multimodel Inference Based on (Q)AIC(c). R package version 2.0-4, URL https://CRAN.R-project.org/package= AICcmodavg.
25. Meinshausen N, Bühlmann P (2006). “High-Dimensional Graphs and Variable Selection with the Lasso.” The Annals of Statistics, 34(3), 1436–1462. doi:10.1214/009053606000000281.
26. Neapolitan RE (2004). Learning Bayesian Networks. Pearson Prentice Hall, Upper Saddle River.
27. Raftery A, Hoeting J, Volinsky C, Painter I, Yeung KY (2015). BMA: Bayesian Model Averaging. R package version 3.18.6, URL https://CRAN.R-project.org/package=BMA.
28. R Core Team (2017). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
29. Reshef DN, Reshef YA, Finucane HK, Grossman SR, Mcvean G, Turnbaugh PJ, Lander ES, Mitzenmacher M, Sabeti PC (2011). “Detecting Novel Association in Large Data Sets.” Science, 334(6062), 1518–1523. doi:10.1126/science.1205438.
30. Revolution Analytics, Weston S (2015a). doParallel: Foreach Paral lel Adaptor for the parallel Package. R package version 1.0.10, URL https://CRAN.R-project.org/package= doParallel.
31. Revolution Analytics, Weston S (2015b). foreach: Provides Foreach Looping Construct for R. R package version 1.4.3, URL https://CRAN.R-project.org/package=foreach.
32. Schroeder M, Haibe-Kains B, Culhane A, Sotiriou C, Bontempi G, Quackenbush J (2011). breastCancerVDX: Gene Expression Datasets Published by Wang et al. (2005) and Minn et al. (2007) (VDX). R package version 1.6.0, URL https://www.bioconductor.org/packages/release/data/experiment/html/breastCancerVDX.html.
33. Scutari M (2010). “Learning Bayesian Networks with the bnlearn R Package.” Journal of Statistical Software, 35(3), 1–22. doi:10.18637/jss.v035.i03.
34. Simon N, Tibshirani R (2014). “Comment on “Detecting Novel Associations in Large Data Sets” by Reshef et al., Science, Dec 16, 2011.” ArXiv preprint.
35. Spirtes P, Glymour CN, Scheines R (2000). Causation, Prediction, and Search. MIT Press. doi:10.1007/978-1-4612-2748-9.
36. Statnikov A, Aliferis CF (2010). “Analysis and Computational Dissection of Molecular Signature Multiplicity.” PLoS Computational Biology, 6(5), e1000790. doi:10.1371/journal. pcbi.1000790.
37. Talete srl (2013). Dragon: Application for the Calculation of Molecular Descriptors. Talete srl., Milano. URL http://www.talete.mi.it/products/dragon_description.htm.
38. The MathWorks Inc (2014). MATLAB – The Language of Technical Computing, Version R2014b. Natick, Massachusetts. URL http://www.mathworks.com/products/matlab/.
39. Therneau T (2017). survival: A Package for Survival Analysis in S. R package version 2.41-3, URL https://CRAN.R-project.org/package=survival.
40. Tsamardinos I, Aliferis CF (2003). “Towards Principled Feature Selection: Relevancy, Filters, and Wrappers.” In Proceedings of the Ninth International Workshop on Artificial Intel ligence and Statistics.
41. Tsamardinos I, Brown LE, Aliferis CF (2006). “The Max-Min Hill-Climbing Bayesian Network Structure Learning Algorithm.” Machine Learning, 65(1), 31–78. doi:10.1007/s10994-006-6889-7.
42. Tsamardinos I, Lagani V, Athineou G, Tsagris M, Borboudakis G, Roumpelaki A (2017). MXM: Discovering Multiple, Statistical ly-Equivalent Signatures. R package version 1.0.0, URL https://CRAN.R-project.org/package=MXM.
43. Tsamardinos I, Lagani V, Pappas D (2012). “Discovering Multiple, Equivalent Biomarker Signatures.” In 7th Conference of the Hel lenic Society for Computational Biology and Bioinformatics (HSCBB12).
44. Tsamardinos I, Rakhshani A, Lagani V (2014). “Performance-Estimation Properties of Cross-Validation-Based Protocols with Simultaneous Hyper-Parameter Optimization.” In A Likas, K Blekas, D Kalles (eds.), Artificial Intel ligence: Methods and Applications, volume 8445 of Lecture Notes in Computer Science, pp. 1–14. Springer-Verlag. doi: 10.1007/978-3-319-07064-3_1.
45. Van De Vijver MJ, He YD, Van’t Veer LJ, Dai H, Hart AAM, Voskuil DW, Schreiber GJ, Peterse JL, Roberts C, Marton MJ, Parrish M, Atsma D, Witteveen A, Glas A, Delahaye L, van der Velde T, Bartelink H, Rodenhuis S, Rutgers ET, Friend SH, Bernards R (2002). “A Gene-Expression Signature as a Predictor of Survival in Breast Cancer.” The New England Journal of Medicine, 347(25), 1999–2009. doi:10.1056/nejmoa021967.
46. Venables WN, Ripley BD (2002). Modern Applied Statistics with S. 4th edition. Springer-Verlag, New York. doi:10.1007/978-0-387-21706-2.