Regularized logistic regression without a penalty term: An application to cancer classification with microarray data

Expert Systems with Applications

Volumn 38, Issue 5, 2011, Pages 5110-5118

  Bielza, Concha ^a   Robles, Víctor ^a   Larrañaga, Pedro ^a  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

Author keywords

Cancer classification; Estimation of distribution algorithms; Logistic regression; Microarray data; Regularization

Indexed keywords

CANCER CLASSIFICATION; ESTIMATION OF DISTRIBUTION ALGORITHMS; LOGISTIC REGRESSION; MICROARRAY DATA; REGULARIZATION;

ALGORITHMS; BEHAVIORAL RESEARCH; CLASSIFICATION (OF INFORMATION); ESTIMATION;

REGRESSION ANALYSIS;

EID: 79151480613     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.09.140     Document Type: Article

References (69)

1. A.M. Aguilera, M. Escabias, and M.J. Valderrama Using principal components for estimating logistic regression with high-dimensional multicollinear data Computational Statistics and Data Analysis 50 2006 1905 1924
2. U. Alon, N. Barkai, D. Notterman, K. Gish, S. Ybarra, and D. Mack Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide microarrays Proceedings of the National Academy of Sciences USA 96 1999 6745 6750
3. A. Antoniadis, S. Lambert-Lacroix, and F. Leblanc Effective dimension reduction methods for tumor classification using gene expression data Bioinformatics 19 5 2003 563 570
4. S. Balakrishnan, and D. Madigan Algorithms for sparse linear classifier in the massive data setting Journal of Machine Learning Research 9 2008 313 337
5. C. Baumgartner, C. Böhm, D. Baumgartner, G. Marini, K. Weinberger, and B. Olgemöller Supervised machine learning techniques for the classification of metabolic disorders in newborns Bioinformatics 20 2004 2985 2996
6. P.J. Bickel, and B. Li Regularization in statistics Test 15 2006 271 344
7. U.M. Braga-Neto, and E.R. Dougherty Is cross-validation valid for small-sample microarray classification? Bioinformatics 20 2004 374 380
8. G.C. Cawley, and N. Talbot Gene selection in cancer classification using sparse logistic regression with Bayesian regularization Bioinformatics 22 2006 2348 2355
9. C. Cortes, and M. Mohri AUC optimization vs. error rate minimization Advances in neural information processing systems Vol. 16 2004 The MIT Press Cambridge, MA
10. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
11. S. Dudoit, J. Fridlyand, and T.P. Speed Comparison of discrimination methods for the classification of tumors using gene expression data Journal of the American Statistical Association 97 2002 77 87
12. B. Efron Estimating the error rate of a prediction rule: Improvement on cross-validation Journal of the American Statistical Association 78 1983 316 331
13. P. Eilers, J. Boer, G. van Ommen, and H. van Houwelingen Classification of microarray data with penalized logistic regression Proceedings of SPIE. Progress in Biomedical Optics and Images 4266 2 2001 187 198
14. Fan, J.; & Li, R. (2006). Statistical challenges with high dimensionality: Feature selection in knowledge discovery. In Proceedings of the Madrid international congress of mathematicians (Vol. III, pp. 595-622).
15. D. Firth Bias reduction of maximum likelihood estimates Biometrika 80 1993 27 38
16. G. Fort, and S. Lambert-Lacroix Classification using partial least squares with penalized logistic regression Bioinformatics 21 2005 1104 1111
17. I.E. Frank, and J.H. Friedman A statistical view of some chemometric regression tools Technometrics 35 1993 109 148
18. W.J. Fu Penalized regression: The bridge versus the LASSO Journal of Computational and Graphical Statistics 7 1998 397 416
19. S. Gao, and J. Shen Asymptotic properties of a double penalized maximum likelihood estimator in logistic regression Statistics and Probability Letters 77 2007 925 930
20. A. Genkin, D.D. Lewis, and D. Madigan Large-scale Bayesian logistic regression for text categorization Technometrics 49 2007 291 304
21. T.R. Golub, D.K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, and J.P. Mesirov Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring Science 286 1999 531 537
22. c algorithm with tournament selection. Behaviour on linear and quadratic functions International Journal of Approximate Reasoning 31 2002 313 340
23. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik Gene selection for cancer classification using support vector machines Machine Learning 46 2002 389 422
24. J.A. Hanley, and B.J. McNeil The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology 143 1982 29 36
25. T. Hastie, and R. Tibshirani Efficient quadratic regularization for expression arrays Biostatistics 5 2004 329 340
26. T. Hastie, R. Tibshirani, and J. Friedman The elements of statistical learning 2001 Springer
27. A.E. Hoerl, and R.W. Kennard Ridge regression: Biased estimates for nonorthogonal problems Technometrics 12 1970 55 67
28. D.W. Hosmer, and S. Lemeshow Applied logistic regression 2nd ed. 2000 J. Wiley and Sons New York
29. J. Huang, and C.X. Ling Using AUC and accuracy in evaluating learning algorithms IEEE Transactions on Knowledge and Data Engineering 17 2005 299 310
30. R. Ihaka, and R. Gentleman R: A language for data analysis and graphics Journal of Computational and Graphical Statistics 5 1996 229 314
31. I. Inza, P. Larrañaga, R. Blanco, and A. Cerrolaza Filter versus wrapper gene selection approaches in DNA microarray domains Artificial Intelligence in Medicine 31 2004 91 103
32. S.S. Keerthi, K.B. Duan, S.K. Shevade, and A.N. Poo A fast dual algorithm for kernel logistic regression Machine Learning 61 2005 151 165
33. M.Y. Kiang A comparative assessment of classification methods Decision Support Systems 35 2003 441 454
34. R. Kohavi, and G.H. John Wrappers for feature subset selection Artificial Intelligence 97 1997 273 324
35. 1-regularized logistic regression Journal of Machine Learning Research 8 2007 1519 1555
36. Larrañaga, P.; Etxeberria, R.; Lozano, J. A.; & Peña, J. M. (2000). Optimization in continuous domains by learning and simulation of Gaussian networks. In Workshop in optimization by building and using probabilistic models. Genetic and evolutionary computation conference, GECCO 2000 (pp. 201-204).
37. P. Larrañaga, J.A. Lozano, Estimation of distribution algorithms. A new tool for evolutionary computation 2002 Kluwer A.P
38. T.A. Lasko, J.G. Bhagwat, K.H. Zou, and L. Ohno-Machado The use of ROC curves in biomedical informatics Journal of Biomedical Informatics 38 2005 404 415
39. S. Le Cessie, and J.C. van Houwelingen Ridge estimators in logistic regression Applied Statistics 41 1992 191 201
40. Lee, S.-I.; Lee, H.; Abbeel, P.; & Ng, A. Y. (2006). Efficient L1 regularized logistic regression. Proceedings of the 21st national conference on artificial intelligence (AAAI-06) (pp. 1-9).
41. J.W. Lee, J.B. Lee, M. Park, and S.H. Song An extensive comparison of recent classification tools applied to microarray data Computational Statistics and Data Analysis 48 2005 869 885
42. A. Lee, and M. Silvapulle Ridge estimation in logistic regression Communications in Statistics, Part B-Simulation and Computation 17 1988 1231 1257
43. J.G. Liao, and K.-V. Chin Logistic regression for disease classification using microarray data: Model selection in a large p and small n case Bioinformatics 23 2007 1945 1951
44. p penalty for biomarker identification Statistical Applications in Genetics and Molecular Biology 6 2007 [Article 6]
45. H. Liu, and H. Motoda Computational methods of feature selection 2008 Chapman and Hall/CRC Press
46. Lokhorst, J. (1999) The lasso and generalized linear models. Technical Report, University of Adelaide.
47. J.A. Lozano, P. Larrañaga, I. Inza, E. Bengoetxea, Towards a new evolutionary computation. Advances in estimation of distribution algorithms 2006 Springer New York
48. S. Ma, and J. Huang Regularized ROC method for disease classification and biomarker selection with microarray data Bioinformatics 21 2005 4356 4362
49. L. Meier, S. van de Geer, and P. Bühlmann The group Lasso for logistic regression Journal of the Royal Statistical Society, Series B 70 2008 53 71
50. Nakamichi, R. E.; Imoto, S.; & Miyano, S. (2004). Case-control study of binary disease trait considering interactions between SNPs and environmental effects using logistic regression. In Fourth IEEE symposium on bioinformatics and bioengineering (Vol. 21, pp. 73-78).
51. 2 regularization, and rotational invariants. In Proceedings of the 21st international conference on machine learning.
52. D.V. Nguyen, and D.M. Rocke Tumor classification by partial least squares using microarray gene expression data Bioinformatics 18 2002 39 50
53. 1 regularization path algorithm for generalized linear models. Technical Report, Stanford University.
54. M. Pelikan Hierarchical Bayesian optimization algorithm: Toward a new generation of evolutionary algorithms 2005 Springer
55. 1-regularized linear and logistic regression Lecture notes in computer science Vol. 4723 2007 Springer
56. L. Shen, and E.C. Tan Dimension reduction-based penalized logistic regression for cancer classification using microarray data IEEE Transactions on Computational Biology and Bioinformatics 2 2005 166 175
57. S.K. Shevade, and S.S. Keerthi A simple and efficient algorithm for gene selection using sparse logistic regression Bioinformatics 19 2003 2246 2253
58. R.A. Thisted Elements of statistical computing 1988 Chapman and Hall New York
59. R. Tibshirani Regression shrinkage and selection via the LASSO Journal of the Royal Statistical Society, Series B 58 1996 267 288
60. R. Tibshirani, M. Saunders, S. Rosset, J. Zhu, and K. Knight Sparsity and smothness via the fused lasso Journal of the Royal Statistical Society, Series B 67 2005 91 108
61. O. Uncu, and I.B. Türksen A novel feature selection approach: Combining feature wrappers and filters Information Sciences 177 2007 449 466
62. S. Vinterbo, and L. Ohno-Machado A genetic algorithm to select variables in logistic regression: Example in the domain of myocardial infarct Journal of the American Medical Informatics Association 6 1999 984 988
63. G. Weber, S. Vinterbo, and L. Ohno-Machado Multivariate selection of genetic markers in diagnostic classification Artificial Intelligence in Medicine 31 2004 155 167
64. M. West, C. Blanchette, H. Dressman, E. Huang, S. Ishida, and R. Spang Predicting the clinical status of human breast cancer by using gene expression profiles Proceedings of the National Academy of Sciences USA 98 20 2001 11462 11467
65. M. Yuan, and Y. Lin Model selection and estimation in regression with grouped variables Journal of the Royal Statistical Society, Series B 68 2006 49 67
66. P. Zhao, and B. Yu Stagewise Lasso Journal of Machine Learning Research 8 2007 2701 2726
67. H. Zhou, and T. Hastie Regularization and variable selection via the elastic net Journal of the Royal Statistical Society, Series B 67 2005 301 320
68. J. Zhu, and T. Hastie Classification of gene microarrays by penalized logistic regression Biostatistics 5 2004 427 443
69. H. Zou The adaptive Lasso and its oracle properties Journal of the American Statistical Association 101 2006 1418 1429