AUC maximization linear classifier based on active learning and its application

Neurocomputing

Volumn 73, Issue 7-9, 2010, Pages 1272-1280

  Han, Guang ^a   Zhao, Chunxia ^a  

^a NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Active learning; AUC maximization; Dynamic clustering; Gradient descent method; Linear classifier; Obstacle detection

Indexed keywords

ACTIVE LEARNING; DYNAMIC CLUSTERING; GRADIENT DESCENT METHOD; LINEAR CLASSIFIERS; OBSTACLE DETECTION;

CLASSIFIERS; CLUSTERING ALGORITHMS; EXPERIMENTS; LABELING; OBSTACLE DETECTORS; OPTIMIZATION;

CLASSIFICATION (OF INFORMATION);

ARTICLE; CLASSIFICATION ALGORITHM; CLUSTER ANALYSIS; DATA BASE; LEARNING; MATHEMATICAL ANALYSIS; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; WEB BROWSER;

EID: 77649231232     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.01.001     Document Type: Article

References (50)

1. C.X. Ling, J. Huang, H. Zhang, AUC: a better measure than accuracy in comparing learning algorithms, in: Proc.eedings of the International Joint Conferences on Artificial Intelligence, Acapulco, Mexico, (2003), pp. 329-341.
2. K. Ataman, N. Street, Y. Zhang, Learning to rank by maximizing AUC with linear programming, in: Proc.eedings of the International Joint Conference on Neural Networks, Vancouver, BC, Canada, (2006), pp. 123-129.
3. U. Brefeld, T. Scheffer, AUC maximizing support vector learning, in: Proc.eedings of the International Conference on Machine Learning-Workshop on ROC Analysis in Machine Learning, Bonn, Germany, (2005).
4. D.J.M. Tax, R.P.W. Duin. Arzhaeva Y, Linear model combining by optimizing the area under the roc curve, in: Proc.eedings of the International Conference on Pattern Recognition, Hong Kong, China, (2006), pp. 119-122.
5. Toh K.A., Kim J., and Lee S. Maximizing area under ROC curve for biometric scores fusion. Pattern Recognition 41 (2008) 3373-3392
6. Marroccoa C., Duinb R.P.W., and Tortorellaa F. Maximizing the area under the ROC curve by pairwise feature combination. Pattern Recognition 41 (2008) 1961-1974
7. T. Calders, S. Jaroszewicz, Efficient AUC optimization for classification, in: Proc.eedings of the European Conference on Principles and Practice of Knowledge Discovery in Databases, Warsaw, Poland. (, 2007), pp. 42-53.
8. Manduchi R. Obstacle detection and terrain classification for autonomous off-road navigation. Autonomous Robots 18 1 (2005) 81-102
9. Tong S., and Koller D. Support vector machine active learning with applications to text classification. Journal of Machine Learning Research 2 (2002) 45-66
10. Vlachos A. A stopping criterion for active learning. Computer Speech and Language 22 (2008) 295-312
11. Cord M., Gosselin P.H., and Philipp-Foliguet S. Stochastic exploration and active learning for image retrieval. Image and Vision Computing 25 1 (2006) 14-23
12. Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters 27 (2006) 861-874
13. L. Yan, R. Dodier, M.C. Mozer, et al., Optimizing classifier performance via the Wilcoxon-Mann-Whitney statistics, in: Proc.eedings of the International Conference on Machine Learning, Washington, USA, (2003), pp. 848-855.
14. A. Herschtal, B. Raskutti, Optimising area under the ROC curve using gradient descent, in: Proc.eedings of the International Conference on Machine Learning, Alberta, Canada, (2004), pp. 385-392.
15. L.I. Kuncheva, C.J. Whitaker, C.A. Shipp, et al., Is independence good for combining classifiers? In: Proc.eedings of the International Conference on Pattern Recognition, Barcelona, Spain, (2000), pp. 168-171.
16. Robert J.G., Crits-Christoph P., Muenz L.R., et al. Determination and interpretation of the Optimal Operating Pointoptimal operating point for ROC Curvescurves derived through generalized linear models. Understanding Statistics 2 4 (2003) 219-242
17. Permuter H., and Jermyn J. A study of Gaussian mixture models of color and texture features for image classification and segmentation. Pattern Recognition 39 (2006) 695-706
18. R. Castano, R. Manduchi, J. Fox, Classification experiments on real-world texture, in: Proc.eedings on Empirical Evaluation Methods in Computer Vision, Hawaii, USA, 2001, pp. 3-20.
19. Gosselin P.H., and Cord M. Active learning methods for interactive image retrieval. IEEE Transactions on Image Processing 17 7 (2008) 1200-1211
20. C. Dima, N. Vandapel, M. Hebert, Classifier Fusionfusion for Outdoor Obstacle Detectionoutdoor obstacle detection, in: International Conference on Robotics and Automation, (2004), pp. 665-671.
21. D. Kim, S. M. Oh, J. M. Rehg, Traversability classification for UGV navigation a comparison of patch and superpixel representations, in: The IEEE/RSJ International Conference on Intelligent Robots and Systems, (2007), pp. 3166-3173.
22. Pietikäinen M., Nurmela T., Mäenpää T., et al. View-based recognition of real-world textures. Pattern Recognition 37 2 (2004) 313-323
23. P. Belutta, R. Manduchi, L. Matthies, et al., Terrain Perception for Demo III, in: Proceedings of the IEEE Intelligent Vehicles Symposium, (2000), pp. 326-331.
24. C. Cortes, M. Mohri, AUC optimization vs. error rate minimization, in: Advances in Neural Information Processing Systems, Vancouver, Canada, (2004), pp. 313-320.
25. Marrocco C., Molinara M., and Tortorella F. Exploiting ACU for optimal linear combination of dichotomizers. Pattern Recognition Letters 27 8 (2006) 900-907
26. D.M.J. Tax, C. Veenman, Tuning the hyperparameter of an AUC-optimized classifier, in: Proc.eedings of the International Conference on Artificial Intelligence, Brussels, Belgium, (2005), pp. 224-231.
27. T. Joachims, A support vector method for multivariate performance measures, in Proc.eedings of the International Conference on Machine Learning, Bonn, Germany, (2005), pp. 377-384.
28. F. Provost, T. Fawcett, R. Kohavi, The case against accuracy estimation for comparing induction algorithms, in: Proc.eedings of the International Conference on Machine Learning, Wisconsin, USA, (1998), pp. 445-553.
29. Wang Q.H., Yao L.L., and Lai P. Estimation of the area under ROC curve with censored data. Journal of Statistical Planning and Inference 139 3 (2009) 1033-1044
30. Bradley A.P. The use of the area under the roc curve in the evaluation of machine learning algorithms. Pattern Recognition 30 7 (1997) 1145-1159
31. Monard M.C., and Batista G.E. Learning with skewed class distributions. Artificial Intelligence and Robotics (2002) 173-179
32. C.L. Castro, A.P. Braga, Optimization of the area under the ROC curve, in: Proc.eedings of the Brazilian Symposium on Neural Networks, (2008), pp. 141-146.
33. K. Morik, P. Brockhausen, T. Joachims, Combining statistical learning with a knowledge-based approach - A case study in intensive care monitoring, in: Proc.eedings of the International Conference on Machine Learning, Bled, Slovenia, (1999), pp. 268-277.
34. Lin Y., Lee Y., and Wahba G. Support vector machines for classification in nonstandard situations. Machine Learning 46 (2002) 191-202
35. C. Ferri, P. Flach, J. Hernandez-Orallo, Learning decision trees using the area under roc curve, in: Proc.eedings of the International Conference on Machine Learning, Sydney, Australia, (2002), pp. 139-146.
36. A. Herschtal, B. Raskutti, P.K. Campbell, Area under roc optimisation using a ramp approximation, in: Proc.eedings of the International Conference on Data Mining, Bethesda, MD, USA, (2006).
37. Hand D.J., and Till R.J. A simple generalization of the area under the ROC curve for multiple class classification problems. Machine Learning 45 (2001) 171-186
38. Provost F., and Fawcett T. Robust classification for imprecise environments. Machine Learning 42 3 (2001) 203-231
39. M.C. Mozer, R. Dodier, M.D. Colagrosso, C. Guerra-Salcedo, R. Wolniewicz, Prodding the ROC curve: constrained optimization of classifier performance, in: Proceedings of the International Conference on Neural Information Processing Systems, Vancouver, Canada, (2001), pp. 1409-1415.
40. K.A. Toh, Learning from target knowledge approximation, in: Proc.eedings of the International Conference on Industrial Electronics and Applications, Singapore, (2006), pp. 815-822.
41. Bamber D. The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. Journal of Mathematical Psychology 12 (1975) 387-415
42. A. Rakotomamonjy, Optimizing area under ROC curve with SVMs, in: ROC Analysis in Artificial Intelligence, 1st International Workshop, Valencia, Spain, (2004), pp. 71-80.
43. D. David Lewis, A. Gale William, A sequential algorithm for training text classifiers, in: Proc.eedings of the ACM SIGIR Conference on Research and development in information retrieval, Dublin, Ireland, (1994), pp. 3-12.
44. N. Abe, H. Mamitsuka, Query learning strategies using boosting and bagging, in: Proc.eedings of the International Conference on Machine Learning, Madison, Wisconson, USA, (1998), pp. 1-9.
45. I. Muslea, S. Minton, C.A. Knoblock, Selective sampling with redundant views, In Proc.eedings of the National Conference on Artificial Intelligence, Austin, Texas, (2000), pp. 621-626.
46. N. Roy, A. McCallum, Toward optimal active learning through Monte Carlo estimation of error reduction, In: Proc.eedings of the International Conference on Machine Learning, Williamstown, (2001).
47. C. Dima, Active Learninglearning for Outdoor Perceptionoutdoor perception, Ph.D. thesisThesis, The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, (2005).
48. H.S. Seung, M. Opper, H. Sompolinsky, Query by committee, In: Proc.eedings of the Workshop on Computaional Learning Theory, San Mateo, CA, (1992), pp. 287-294.
49. Freund Y., Sebastian Seung H., Shamir E., et al. Selective sampling using the query by committee algorithm. Machine Learning 28 2-3 (1997) 133-168
50. E. S. Robert, The Boosting Approach to Machine Learning An Overviewmachine learning: an overview, in: MSRI Workshop on Nonlinear Estimation and Classification, (2002).