Efficient active learning of halfspaces: An aggressive approach

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 480-488

  Gonen, Alon ^a   Sabato, Sivan ^b   Shalev Shwartz, Shai ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

ACTIVE LEARNERS; ACTIVE LEARNING; FORMAL APPROXIMATIONS; HALF SPACES; POOL-BASED; THEORETICAL GUARANTEES;

LAKES;

EID: 84897564027     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Arkin, E.M., Meijer, H., Mitchell, J.S.B., Rappaport, D., and Skiena, S.S. Decision trees for geometric models. In Proceedings of the ninth annual symposium on Computational geometry, pp. 369-378. ACM, 1993.
2. Balcan, M.F., Beygelzimer, A., and Langford, J. Agnostic active learning. In Proceedings of the 23rd international conference on Machine learning, pp. 65-72. ACM, 2006.
3. Balcan, M.F., Broder, A., and Zhang, T. Margin based active learning. Learning Theory, pp. 35-50, 2007.
4. Brightwell, G. and Winkler, P. Counting linear extensions is #p-complete. In Proceedings of the twenty-third annual ACM symposium on Theory of computing, STOC '91, pp. 175-181, 1991.
5. Cohn, D., Atlas, L., and Ladner, R. Improving generalization with active learning. Machine Learning, 15(2): 201-221, 1994.
6. Dasgupta, S. Analysis of a greedy active learning strategy. Advances in neural information processing systems, 17: 337-344, 2005.
7. Dasgupta, S. Coarse sample complexity bounds for active learning. Advances in neural information processing systems, 18:235, 2006.
8. Dasgupta, S., Kalai, A., and Monteleoni, C. Analysis of perceptron-based active learning. Learning Theory, pp. 889-905, 2005.
9. Dasgupta, S., Hsu, D., and Monteleoni, C. A general agnostic active learning algorithm. Advances in neural information processing systems, 20:353-360, 2007.
10. El-Yaniv, R. and Wiener, Y. Active learning via perfect selective classification. The Journal of Machine Learning Research, 13:255-279, 2012.
11. Freund, Y., Seung, H.S., Shamir, E., and Tishby, N. Selective sampling using the query by committee algorithm. Machine learning, 28(2):133-168, 1997. (Pubitemid 127506338)
12. Friedman, E. Active learning for smooth problems. In Proceedings of the 22nd Conference on Learning Theory, volume 1, pp. 3-2, 2009.
13. Gilad-Bachrach, R., Navot, A., and Tishby, N. Query by committee made real. Advances in Neural Information Processing Systems (NIPS), 19, 2005.
14. Golovin, D. and Krause, A. Adaptive submodularity: A new approach to active learning and stochastic optimization. In Proceedings of International Conference on Learning Theory (COLT), 2010.
15. Gonen, A., Sabato, S., and Shalev-Shwartz, S. Efficient pool-based active learning of halfspaces. CoRR, abs/1208.3561, 2012.
16. Hanneke, S. A bound on the label complexity of agnostic active learning. In ICML, 2007.
17. Hanneke, S. Rates of convergence in active learning. The Annals of Statistics, 39(1):333-361, 2011.
18. Håstad, J. On the size of weights for threshold gates. SIAM Journal on Discrete Mathematics, 7:484, 1994.
19. 5) volume algorithm for convex bodies. Random structures and algorithms, 11(1):1-50, 1997.
20. Lovász, L. Hit-and-run mixes fast. Mathematical Programming, 86(3):443-461, 1999.
21. Matoušek, J. Lectures on discrete geometry, volume 212. Springer Verlag, 2002.
22. McCallum, A. and Nigam, K. Employing em in pool-based active learning for text classification. In Proceedings of ICML-98, 15th International Conference on Machine Learning, pp. 350-358, 1998.
23. Muroga, S., Toda, I., and Takasu, S. Theory of majority decision elements. Journal of the Franklin Institute, 271 (5):376-418, 1961.
24. Seung, H.S., Opper, M., and Sompolinsky, H. Query by committee. In Proceedings of the fifth annual workshop on Computational learning theory, pp. 287-294. ACM, 1992.
25. Tong, S. and Koller, D. Support vector machine active learning with applications to text classification. The Journal of Machine Learning Research, 2:45-66, 2002.