Optimizing area under the ROC curve using semi-supervised learning

Pattern Recognition

Volumn 48, Issue 1, 2015, Pages 276-287

  Wang, Shijun ^a   Li, Diana ^a   Petrick, Nicholas ^b   Sahiner, Berkman ^b   Linguraru, Marius George ^c,d   Summers, Ronald M ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

^b CENTER FOR DEVICES AND RADIOLOGICAL HEALTH   (United States)

^c CHILDREN'S NATIONAL MEDICAL CENTER   (United States)

^d GEORGE WASHINGTON UNIVERSITY SCHOOL OF MEDICINE AND HEALTH SCIENCES   (United States)

Author keywords

AUC; RankBoost; Receiver operating characteristic; Semi supervised learning; Semidefinite programming; SSLROC; SVMROC; Transfer learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); LEARNING SYSTEMS; OPTIMIZATION; TRANSFER LEARNING;

RANKBOOST; RECEIVER OPERATING CHARACTERISTICS; SEMI-DEFINITE PROGRAMMING; SSLROC; SVMROC;

SEMI-SUPERVISED LEARNING;

EID: 85027958432     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.07.025     Document Type: Article

References (54)

1. A.P. Bradley The use of the area under the ROC curve in the evaluation of machine learning algorithms Pattern Recognit. 30 1997 1145 1159
2. D.J. Hand, and R.J. Till A simple generalisation of the area under the ROC curve for multiple class classification problems Mach. Learn. 45 2001 171 186
3. C.X. Ling, J. Huang, H. Zhang, AUC: a statistically consistent and more discriminating measure than accuracy, in: 18th International Joint Conferences on Artificial Intelligence (IJCAI '03), 2003.
4. C. Cortes, M. Mohri, AUC optimization vs. error rate minimization, in: Advances in Neural Information Processing, 2004.
5. A. Rakotomamonjy, Optimizing area under ROC curves with SVMs, in: ECAI 04 ROC and Artificial Intelligence Workshop, 2004.
6. U. Brefeld, T. Scheffer, AUC maximizing support vector learning, in: Workshop on ROC Analysis in Machine Learning, 2005.
7. J. Huang, and C.X. Ling Using AUC and accuracy in evaluating learning algorithms IEEE Trans. Knowl. Data Eng. 17 2005 299 310
8. T. Calders, S. Jaroszewicz, Efficient AUC optimization for classification, in: Knowledge Discovery in Databases: PKDD 2007, vol. 4702, 2007.
9. W.H. Lee, P.D. Gader, and J.N. Wilson Optimizing the area under a receiver operating characteristic curve with application to land-mine detection IEEE Trans. Geosci. Remote Sens. 45 2007 389 397
10. S. Vanderlooy, and E. Hullermeier A critical analysis of variants of the AUC Mach. Learn. 72 2008 247 262
11. K.A. Toh, J. Kim, and S. Lee Maximizing area under ROC curve for biometric scores fusion Pattern Recognit. 41 2008 3373 3392
12. P. Flach, J. Hernández-Orallo, C. Ferri, A coherent interpretation of AUC as a measure of aggregated classification performance, in: International Conference on Machine Learning, 2011.
13. M.H. Zweig, and G. Campbell Receiver-operating characteristic (ROC) plots - a fundamental evaluation tool in clinical medicine Clin. Chem. 39 4 1993 561 577
14. S. Wang, M. McKenna, N. Petrick, B. Sahiner, M.G. Linguraru, Z. Wei, J. Yao, R.M. Summers, ROC-like optimization by sample ranking: application to CT colonography, in: 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI), 2012, pp. 478-481.
15. D. Berrar, and P. Flach Caveats and pitfalls of ROC analysis in clinical microarray research (and how to avoid them) Brief. Bioinform. 13 1 2012 83 97
16. J.M. Lobo, A. Jiménez-Valverde, and R. Real AUC a misleading measure of the performance of predictive distribution models Glob. Ecol. Biogeogr. 17 2 2007 145 151
17. B. Hanczar, J. Hua, C. Sima, J. Weinstein, M. Bittner, and E.R. Dougherty Small-sample precision of ROC-related estimates Bioinformatics 26 6 2010 822 830
18. C. Marrocco, R.P.W. Duin, and F. Tortorella Maximizing the area under the ROC curve by pairwise feature combination Pattern Recognit. 41 6 2008 1961 1974
19. Y. Liu, and X. Yao Ensemble learning via negative correlation Neural Netw. 12 10 1999 1399 1404
20. T.G. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees bagging, and randomization Mach. Learn. 40 2 2000 139 157
21. L. Breiman Bagging predictors Mach. Learn. 24 2 1996 123 140
22. Y. Freund, R.E. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, in: Computational Learning Theory, vol. 904, Springer Berlin/Heidelberg, 1995, pp. 23-37.
23. Y. Freund, R. Iyer, R. Schapire, and Y. Singer An efficient boosting algorithm for combining preferences J. Mach. Learn. Res. 4 2003 933 969
24. W. Gao, R. Jin, S. Zhu, Z.-H. Zhou, One-pass AUC optimization, in: 30th International Conference on Machine Learning, 2013.
25. O. Chapelle, B. Scholkopf, and A. Zien Semi-supervised Learning 2006 MIT Press Cambridge, MA, USA
26. X. Zhu, Semi-supervised learning literature survey, Technical Report, University of Wisconsin, Madison, 2007.
27. A. Gammerman, V. Vovk, V. Vapnik, Learning by transduction, in: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence (UAI), 1998, pp. 148-155.
28. V. Sindhwani, S.S. Keerthi, Large scale semi-supervised linear SVMs, in: The 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2006, pp. 477-484.
29. V. Sindhwani, and S.S. Keerthi Newton methods for fast solution of semi-supervised linear SVMs Large Scale Kernel Machines 2007 MIT Press Cambridge MA, US
30. M.-R. Amini, T.-V. Truong, C. Goutte, A boosting algorithm for learning bipartite ranking functions with partially labeled data, in: ACM Special Interest Group on Information Retrieval (ACM SIGIR), 2008, pp. 99-106.
31. L. Ralaivola, Semi-supervised bipartite ranking with the normalized Rayleigh coefficient, in: European Symposium on Artificial Neural Networks - Advances in Computational Intelligence and Learning, 2009, pp. 47-52.
32. N. Usunier, M.-R. Amini, C. Goutte, Multiview semi-supervised learning for ranking multilingual documents, in: Machine Learning and Knowledge Discovery in Databases, Lecture Notes in Computer Science, vol. 6913, Springer, New York City, US, 2011, pp. 443-458.
33. L. Vandenberghe, and S. Boyd Semidefinite programming SIAM Rev. 38 1 1996 49 95
34. K. Bennett, and A. Demiriz Semi-supervised support vector machines D.A.C. Michael, S. Kearns, Sara A. Solla, Advances in Neural Information Processing Systems vol. 11 1999 368 374
35. C.-C. Chang, and C.-J. Lin LIBSVM a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 3 2011 27:1 27:27
36. T.G. Dietterich Approximate statistical tests for comparing supervised classification learning algorithms Neural Comput. 10 7 1998 1895 1923
37. R.H. Tutuncu, K.C. Toh, and M.J. Todd Solving semidefinite-quadratic-linear programs using SDPT3 Math. Progr. 95 2 2003 189 217
38. Y. Labit, D. Peaucelle, D. Henrion, SEDUMI INTERFACE 1.02: a tool for solving LMI problems with SEDUMI, in: Proceedings of IEEE International Symposium on Computer Aided Control System Design, 2002, pp. 272-277.
39. J. Lofberg, YALMIP: a toolbox for modeling and optimization in MATLAB, in: 2004 IEEE International Symposium on Computer Aided Control Systems Design, 2004.
40. S. Canu, Y. Grandvalet, V. Guigue, and A. Rakotomamonjy SVM and Kernel Methods Matlab Toolbox 2005 Perception Systemes et Information, INSA de Rouen Rouen, France
41. A. Frank, A. Asuncion, UCI machine learning repository. 〈 http://archive.ics.uci.edu/ml 〉, University of California, School of Information and Computer Science, Irvine, CA.
42. J.M. Lachin Introduction to sample-size determination and power analysis for clinical-trials Control. Clin. Trials 2 2 1981 93 113
43. Y. Hochberg A sharper Bonferroni procedure for multiple tests of significance Biometrika 75 4 1988 800 802
44. R. Siegel, D. Naishadham, and A. Jemal Cancer statistics 2012 Ca-a Cancer J. Clin. 62 1 2012 10 29
45. P.J. Pickhardt, J.R. Choi, I. Hwang, J.A. Butler, M.L. Puckett, H.A. Hildebrandt, R.K. Wong, P.A. Nugent, P.A. Mysliwiec, and W.R. Schindler Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults N. Engl. J. Med. 349 23 2003 2191 2200
46. R.M. Summers Improving the accuracy of CT colonography interpretation: computer-aided diagnosis Gastrointest. Endosc. Clin. N. Am. 20 2010 245 257
47. S. Wang, J. Yao, N. Petrick, and R.M. Summers Combining statistical and geometric features for colonic polyp detection in CTC based on multiple kernel learning Int. J. Comput. Intell. Appl. 9 1 2010 1 15
48. K. Suzuki, J. Zhang, and J.W. Xu Massive-training artificial neural network coupled with Laplacian-eigenfunction-based dimensionality reduction for computer-aided detection of polyps in CT colonography IEEE Trans. Med. Imag. 29 11 2010 1907 1917
49. S. Wang, M.T. McKenna, T.B. Nguyen, J.E. Burns, N. Petrick, B. Sahiner, and R.M. Summers Seeing is believing video classification for computed tomographic colonography using multiple-instance learning IEEE Trans. Med. Imag. 31 5 2012 1141 1153
50. M. Franaszek, R.M. Summers, P.J. Pickhardt, and J.R. Choi Hybrid segmentation of colon filled with air and opacified fluid for CT colonography IEEE Trans. Med. Imag. 25 3 2006 358 368
51. A.K. Jerebko, J.D. Malley, M. Franaszek, and R.M. Summers Support vector machines committee classification method for computer-aided polyp detection in CT colonography Acad. Radiol. 12 4 2005 479 486
52. A.Y. Ng, Feature selection, L1 vs. L2 regularization, and rotational invariance, in: the 21st International Conference on Machine Learning, 2004.
53. J. Zhu, S. Rosset, T. Hastie, R. Tibshirani, 1-norm support vector machines, in: Advances in Neural Information Processing Systems, vol. 16, 2004.
54. S. Boyd, and L. Vandenberghe Convex Optimization 2004 Cambridge University Press Cambridge, England