Querying discriminative and representative samples for batch mode active learning

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn Part F128815, Issue , 2013, Pages 158-166

  Wang, Zheng ^a   Ye, Jieping ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Active learning; Empirical risk minimization; Maximum mean discrepancy; Representative and discriminative

Indexed keywords

ARTIFICIAL INTELLIGENCE; BENCHMARKING; DATA MINING; INTEGER PROGRAMMING; LEARNING SYSTEMS; OPTIMIZATION;

ACTIVE LEARNING; ALTERNATING OPTIMIZATIONS; BATCH MODE ACTIVE LEARNING; CONVEX INTEGER PROGRAMMING; EMPIRICAL RISK MINIMIZATION; MAXIMUM MEAN DISCREPANCY; REPRESENTATIVE AND DISCRIMINATIVE; STATE-OF-THE-ART METHODS;

EDUCATION;

EID: 85016811324     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2487575.2487643     Document Type: Conference Paper

References (36)

1. N. Abe, B. Zadrozny, and J. Langford. Outlier detection by active learning. In Proceedings of the 12th ACM SIGKDD International Conference in Knowledge Discovery and Data Mining (KDD), pages 504-509, 2006.
2. P. L. Bartlett and M. S. Rademacher and Gaussian complexities: Risk bounds and structural results. Journal of Machine Learning Research, 3:463-482, 2002.
3. A. Beygelzimer, S. Dasgupta, and J. Langford. Importance weighted active learning. In Proceedings of the 26th International Conference on Machine Learning (ICML), pages 49-56, 2009.
4. J. C. Bezdek and R. J. Hathaway. Convergence of alternating optimization. Neural, Parallel & Scientific Computations, 11(4):351-368, 2003.
5. K. M. Borgwardt, A. Gretton, M. J. Rasch, H.-P. Kriegel, B. Schölkopf, and A. J. Smola. Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics, 22(14):49-57, 2006.
6. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning, 3:1-122, 2011.
7. C. J. C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2):121-167, 1998.
8. C. Campbell, N. Cristianini, and A. J. Smola. Query learning with large margin classifiers. In Proceedings of the Seventeenth International Conference on Machine Learning (ICML), pages 111-118, 2000.
9. C.-C. Chang and C.-J. Lin. Libsvm: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3):27:1-27:27, 2011.
10. O. Chapelle, B. Schölkopf, and A. Zien, editors. Semi-Supervised Learning. MIT Press, Cambridge, MA, 2006.
11. R. Chattopadhyay, Z. Wang, W. Fan, I. Davidson, S. Panchanathan, and J. Ye. Batch mode active sampling based on marginal probability distribution matching. In Proceedings of the tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pages 741-749, 2012.
12. D. A. Cohn, Z. Ghahramani, and M. I. Jordan. Active learning with statistical models. Journal of Artificial Intelligence Research, 4(1):129-145, 1996.
13. F. d'Alché Buc, Y. Grandvalet, and C. Ambroise. Semi-supervised marginboost. In Advances in Neural Information Processing Systems (NIPS) 14, 2002.
14. S. Dasgupta. Two faces of active learning. Theoretical Computer Science, 412(19):1767-1781, 2011.
15. R. M. Dudley. Real analysis and probability. Cambridge University Press, 2002.
16. A. Frank and A. Asuncion. UCI machine learning repository, 2010.
17. Y. Freund, H. S. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. Machine Learning, 28(2-3):133-168, 1997.
18. A. Gretton, K. M. Borgwardt, M. J. Rasch, B. Schölkopf, and A. Smola. A kernel two-sample test. Journal of Machine Learning Research, 13:723-773, 2012.
19. Y. Guo. Active instance sampling via matrix partition. In Advances in Neural Information Processing Systems (NIPS) 23, pages 802-810, 2010.
20. Y. Guo and D. Schuurmans. Discriminative batch mode active learning. In Advances in Neural Information Processing Systems (NIPS) 20, pages 593-600, 2008.
21. S. C. Hoi, R. Jin, J. Zhu, and M. R. Lyu. Batch mode active learning and its application to medical image classification. In Proceedings of the 23rd International Conference on Machine Learning (ICML), pages 417-424, Pittsburgh, PA, USA, 2006.
22. S.-J. Huang, R. Jin, and Z.-H. Zhou. Active learning by querying informative and representative examples. In Advances in Neural Information Processing Systems (NIPS) 23, pages 892-900, 2010.
23. Y. Koren. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD), pages 426-434, 2008.
24. H. T. Nguyen and A. Smeulders. Active learning using pre-clustering. In Proceedings of the 21st International Conference on Machine Learning (ICML), pages 79-86, New York, NY, USA, 2004. ACM.
25. N. Roy and A. McCallum. Toward optimal active learning through sampling estimation of error reduction. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML), pages 441-448, 2001.
26. B. Settles. Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, 2009.
27. H. S. Seung, M. Opper, and H. Sompolinsky. Query by committee. In Proceedings of the Fifth Annual Conference on Computational Learning Theory (COLT), pages 287-294, 1992.
28. B. K. Sriperumbudur, A. Gretton, K. Fukumizu, B. Schölkopf, and G. R. Lanckriet. Hilbert space embeddings and metrics on probability measures. Journal of Machine Learning Research, 11:1517-1561, 2010.
29. M. Sugiyama. Active learning in approximately linear regression based on conditional expectation of generalization error. Journal of Machine Learning Research, 7:141-166, 2006.
30. S. Tong and D. Koller. Support vector machine active learning with applications to text classification. Journal of Machine Learning Research, 2:45-66, 2002.
31. V. Vapnik. Statistical learning theory. Wiley, 1998.
32. Z. Wang, S. Yan, and C. Zhang. Active learning with adaptive regularization. Pattern Recognition, 44(10-11):2375-2383, 2011.
33. M. K. Warmuth, G. Rätsch, M. Mathieson, J. Liao, and C. Lemmen. Active learning in the drug discovery process. In Advances in Neural Information Processing Systems (NIPS) 14, pages 1449-1456, 2001.
34. Z. Xu, K. Yu, V. Tresp, X. Xu, and J. Wang. Representative sampling for text classification using support vector machines. In Proceedings of European Conference on Information Retrieval (ECIR), pages 393-407, 2003.
35. K. Yu, J. Bi, and V. Tresp. Active learning via transductive experimental design. In Proceedings of the 23rd International Conference on Machine Learning (ICML), pages 1081-1088, 2006.
36. X. Zhu, J. Lafferty, and Z. Ghahramani. Combining active learning and semi-supervised learning using gaussian fields and harmonic functions. In ICML 2003 workshop on The Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, 2003.