Comparison between SVM and logistic regression: Which one is better to discriminate?;Comparación entre SVM y regresión logística: ¿cuál es más recomendable para discriminar?

Revista Colombiana de Estadistica

Volumn 35, Issue 2 SPEC. ISSUE, 2012, Pages 223-237

  Salazar, Diego Alejandro ^a   Vélez, Jorge Iván ^a   Salazar, Juan Carlos ^a  

^a UNIVERSIDAD NACIONAL DE COLOMBIA   (Colombia)

Author keywords

Classification; Genetics; Logistic regression; Simulation; Support vector machines

Indexed keywords

EID: 84867587433     PISSN: 01201751     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (29)

1. Anderson, T. (1984), An Introduction to Multivariate Statistical Analysis, John Wiley & Sons, New York.
2. Asparoukhova, K. & Krzanowskib, J. (2001), 'A comparison of discriminant procedures for binary variables', Computational Statistics & Data Analysis 38, 139-160.
3. Cornfield, J. (1962), 'Joint dependence of the risk of coronary heart disease on serum cholesterol and systolic blood pressure: A discriminant function analysis', Proceedings of the Federal American Society of Experimental Biology 21, 58-61.
4. Cortes, C. & Vapnik, V. (1995), 'Support-vector networks', Machine Learning 20(3), 273-297.
5. Cover, T. M. (1965), 'Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition', IEEE Transactions on Electronic Computers 14, 326-334.
6. Cox, D. (1966), Some Procedures Associated with the Logistic Qualitative Response Curve, John Wiley & Sons, New York.
7. David, A. & Lerner, B. (2005), 'Support vector machine-based image classification for genetic syndrome diagnosis', Pattern Recognition Letters 26, 1029-1038.
8. Day, N. & Kerridge, D. (1967), 'A general maximum likelihood discriminant', Biometrics 23, 313-323.
9. Dimitriadou, E., Hornik, K., Leisch, F., Meyer, D., &Weingessel, A. (2011), e1071: Misc Functions of the Department of Statistics (e1071), TU Wien. R package version 1.5-27. *http://CRAN.R-project.org/package=e1071
10. Fisher, R. (1936), 'The use of multiple measurements in taxonomic problems', Annual Eugenics 7, 179-188.
11. Furey, T. S., Cristianini, N., Duffy, N., Bednarski, D. W., Schummer, M. & Haussler, D. (2000), 'Support vector machine classification and validation of cancer tissue samples using microarray expression data', Bioinformatics 16(10), 906-914.
12. Gentleman, R., Carey, V., Huber, W. & Hahne, F. (2011), Genefilter: Methods for filtering genes from microarray experiments. R package version 1.34.0.
13. Golub, T., Slonim, D., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J., Coller, H., Loh, M., Downing, J., Caligiuri, M., Bloomfield, C. & Lander, E. (1999), 'Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring', Science 286, 531-537.
14. Hernández, F. & Correa, J. C. (2009), 'Comparación entre tres técnicas de clasificación', Revista Colombiana de Estadística 32(2), 247-265.
15. Hosmer, D. & Lemeshow, S. (1989), Applied Logistic Regression, John Wiley & Sons, New York.
16. Karatzoglou, A., Meyer, D. & Hornik, K. (2006), 'Support vector machines in R', Journal of Statistical Software 15(8), 267-73.
17. Lee, J. B., Park, M. & Song, H. S. (2005), 'An extensive comparison of recent classification tools applied to microarray data', Computational Statistics & Data Analysis 48, 869-885.
18. Li, L., Jiang, W., Li, X., Moser, K. L., Guo, Z., Du, L., Wang, Q., Topol, E. J., Wang, Q. & Rao, S. (2005), 'A robust hybrid between genetic algorithm and support vector machine for extracting an optimal feature gene subset', Genomics 85(1), 16-23.
19. Moguerza, J. & Muñoz, A. (2006), 'Vector machines with applications', Statistical Science 21(3), 322-336.
20. Mootha, V. K., Lindgren, C. M., Eriksson, K. F., Subramanian, A., Sihag, S., Lehar, J., Puigserver, P., Carlsson, E., Ridderstrele, M., Laurila, E., Houstis, N., Daly, M. J., Patterson, N., Mesirov, J. P., Golub, T. R., Tamayo, P., Spiegelman, B., Lander, E. S., Hirschhorn, J. N., Altshuler, D. & Groop, L. C. (2003), 'Pgc-1α-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes', Nature Genetics 34(3), 267-73.
21. Noble, W. (2006), 'What is a support vector machine?', Nature Biotechnology 24(12), 1565-1567.
22. Peng, S., Xum, Q., Bruce Ling, X., Peng, X., Du, W. & Chen, L. (2003), 'Molecular classification of cancer types from microarray data using the combination of genetic algorithms and support vector machines', FEBS Letters 555, 358-362.
23. R Development Core Team (2011), R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. *http://www.R-project.org/
24. Salazar, D. (2012), Comparación de Máquinas de Soporte vectorial vs. Regresión Logística: cuál es más recomendable para discriminar?, Tesis de Maestría, Escuela de Estadística, Universidad Nacional de Colombia, Sede Medellín.
25. Shou, T., Hsiao, Y. & Huang, Y. (2009), 'Comparative analysis of logistic regression, support vector machine and artificial neural network for the differential diagnosis of benign and malignant solid breast tumors by the use of threedimensional power doppler', Korean Journal of Radiology 10, 464-471.
26. Tibshirani, R. & Friedman, J. (2008), The Elements of Statistical Learning, Springer, California.
27. Verplancke, T., Van Looy, S., Benoit, D., Vansteelandt, S., Depuydt, P., De Turck, F. & Decruyenaere, J. (2008), 'Support vector machine versus logistic regression modeling for prediction of hospital mortality in critically ill patients with haematological malignancies', BMC Medical Informatics and Decision Making 8, 56-64.
28. Wang, G. & Huan, G. (2011), 'Application of support vector machine in cancer diagnosis', Med. Oncol. 28(1), 613-618.
29. Westreich, D., Lessler, J. & Jonsson, M. (2010), 'Propensity score estimation: Neural networks, support vector machines, decision trees (CART), and metaclassifiers as alternatives to logistic regression', Journal of Clinical Epidemiology 63, 826-833.