Active learning to maximize area under the ROC curve

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2006, Pages 149-158

  Culver, Matt ^a   Kun, Deng ^a   Scott, Stephen ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION ACCURACY; CLOSEST SAMPLING; POSTERIOR PROBABILITY; ROC CURVE;

COMPUTER SIMULATION; DATA MINING; ESTIMATION; HEURISTIC ALGORITHMS; OPTIMIZATION; PROBABILITY;

LEARNING SYSTEMS;

EID: 62449187253     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2006.12     Document Type: Conference Paper

References (28)

1. N. Abe and H. Mamitsuka. Query learning strategies using boosting and bagging. In Proceedings of the 15th Int. Conf. on Machine Learning, pages 1-10, 1998.
2. Y. Baram, R. El-Yaniv, and K. Luz. Online choice of active learning algorithms. Journal of Machine Learning Research, 5(Mar):255-291, 2004.
3. C. L. Blake, D.J. Newman, S. Hettich and C. J. Merz. UCI repository of machine learning databases, 2006. http://www.ics.uci.edu/~mlearn/MLRepository. html
4. K. Brinker. Incorporating diversity in active learning with support vector machines. In Proc. of the 20th Int. Conf. on Machine Learning, pages 59-66, 2003.
5. G. Cauwenberghs and T. Poggio Incremental and decremental support vector machine learning. In Advances in Neural Information Processing Systems, pages 409-415, 2000.
6. D. Cohn, L. Atlas, and R. Ladner. Improving generalization with active learning. Machine Learning, 15(2):201-221, 1994.
7. C. Cortes and M. Mohri. AUC optimization vs. error rate minimization. In Advances in Neural Information Processing Systems, Volume 16, 2004.
8. C. Drummond and R. Holte. Cost curves: An improved method for visualizing classifier performance. Machine Learning, 65(1):95-130, 2006.
9. Y. Freund, H. S. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. Machine Learning, 28(2-3): 133-168, 1997.
10. D. Green and J. Swets. Signal detection theory and psychophysics. John Wiley & Sons, 1964.
11. J. Hanley and B. J. McNeil. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143:29-36, 1982.
12. V. S. Iyengar, C. Apte, and T. Zhang. Active learning using adaptive resampling. In Proc. of the 6th ACM Int. Conf. on Knowledge Discovery and Data Mining, pages 91-98, 2000.
13. E. L. Lehmann. Nonparametrics: Statistical Methods Based on Ranks. Holden-Day, 1975.
14. M. Lindenbaum, S. Markovitch, and D. Rusakov. Selective sampling for nearest neighbor classifiers. Machine Learning, 54:125-152, 2004.
15. D. McClish. Comparing the areas under more than two indepedent ROC curves. Med. Decis. Making, 7:149-155, 1987.
16. P. Melville and R. Mooney. Diverse ensembles for active learning. In Proceedings of the 21st International Conference on Machine Learning, pages 584-591, 2004.
17. P. Mitra, C. A. Murthy, and S. K. Pal. A probabilistic active support vector learning algorithm. IEEE Trans, on Pattern Analysis and Machine Intelligence, 26(3):413-418, 2004.
18. H. T. Nguyen and A. Smeulders. Active learning using preclustering. In Proceedings of the 21st International Conference on Machine Learning, pages 623-630, 2004.
19. T. Osugi, D. Kun, and S. Scott. Balancing exploration and exploitation: A new algorithm for active machine learning. In Proceedings of the Fifth IEEE International Conference on Data Mining, pages 330-337, 2005.
20. J.-M. Park. Convergence and application of online active sampling using orthogonal pillar vectors. IEEE Trans, on Pattern Analysis and Machine Intelligence, 26(9): 1197-1207, 2004.
21. A. Rakotomamonjy. Optimising area under the ROC curve with SVMs. In ROCAI, pages 71-80, 2004.
22. S. Rosset. Model selection via the AUC. In Proc. of the 21st Int. Conf. on Machine Learning, pages 89-96, 2004.
23. N. Roy and A. McCallum. Toward optimal active learning through sampling estimation of error reduction. In Proceedings of the 18th International Conference on Machine Learning, pages 441-448, 2001.
24. G. Schohn and D. Cohn. Less is more: Active learning with support vector machines. In Proceedings of the 17th Intl. Conf. on Machine Learning, pages 839-846, 2000.
25. H. S. Seung, M. Opper, and H. Sompolinsky. Query by committee. In Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pages 287-294, 1992.
26. S. Tong and D. Koller. Support vector machine active learning with applications to text classification. Journal of Machine Learning Research, 2(Nov):45-66, 2001.
27. I. H. Witten and E. Frank. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco, 2nd edition, 2005.
28. G. Xiao, F. Southey, R. C. Holte, and D. Wilkinson. Software testing by active learning for commercial games. In Proc. of the 20th Nat. Conf. on AI, pages 898-903, 2005.