Active learning with distributional estimates

Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012

Volumn , Issue , 2012, Pages 715-725

  Röder, Jens ^a   Nadler, Boaz ^b   Kunzmann, Kevin ^c   Hamprecht, Fred A ^c  

^a ROBERT BOSCH GMBH   (Germany)

^b WEIZMANN INSTITUTE OF SCIENCE   (Israel)

^c UNIVERSITY OF HEIDELBERG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; CONDITIONAL PROBABILITIES; DECISION BOUNDARY; ERROR REDUCTION; KERNEL DENSITY; LEARNING CURVES; MATHEMATICAL FRAMEWORKS; UNCERTAINTY SAMPLINGS;

ARTIFICIAL INTELLIGENCE;

UNCERTAINTY ANALYSIS;

EID: 84871757048     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. M. Balcan, S. Hanneke, and J.Wortman. The true sample complexity of active learning. Machine Learning, 80: 111-139, 2010.
2. Y. Baram, R. El-Yaniv, and K. Luz. Online choice of active learning algorithms. Journal of Machine Learning Research, 5:255-291, 2004.
3. E. Baum. Neural net algorithms that learn in polynomial time from examples and queries. IEEE Transactions on Neural Networks, 2(1):5-19, 1991.
4. A. Beygelzimer, S. Dasgupta, and J. Langford. Importance weighted active learning. In ICML, pages 49-56, 2009.
5. C. Boutilier, R. S. Zemel, and B. Marlin. Active collaborative filtering. In Proceedings of the Nineteenth Annual Conference on Uncertainty in Artificial Intelligence, pages 98-106, 2003.
6. L. Breiman. Random forests. Machine Learning, 45(1): 5-32, 2001.
7. S. Chatzichristofis and Y. Boutalis. CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval. Computer Vision Systems, pages 312-322, 2008.
8. J. Dem?sar. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7:1-30, 2006.
9. R. Fergus, P. Perona, and A. Zisserman. Object class recognition by unsupervised scale-invariant learning. In CVPR, volume 2, pages 264-271, 2003.
10. A. Frank and A. Asuncion. UCI machine learning repository, 2010.URL http://archive.ics.uci.edu/ml.
11. J. H. Friedman. On bias, variance, 0/1-loss, and the curseof- dimensionality. Data Mining and Knowledge Discovery, 1:55-77, 1997.
12. S. Hanneke. Rates of convergence in active learning. Annals of Statistics, 39(1):333-361, 2011.
13. W. Hardle, M. Muller, S. Sperlich, and A.Werwatz. Nonparametric and Semiparametric Models. Springer, 2004.
14. S.-J. Huang, R. Jin, and Z.-H. Zhou. Active learning by querying informative and representative examples. In NIPS, pages 892-900, 2010.
15. J. Hwang, J. Choi, S. Oh, R. Marks, et al. Query-based learning applied to partially trained multilayer perceptrons. IEEE Transactions on Neural Networks, 2(1): 131-136, 1991.
16. H. Jeffreys. An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences, 186(1007):453-461, 1946.
17. A. Kapoor, K. Grauman, R. Urtasun, and T. Darrell. Active learning with gaussian processes for object categorization. In ICCV, 2007.
18. Y. LeCun, O. Matan, B. Boser, J. S. Denker, et al. Handwritten zip code recognition with multilayer networks. In ICPR, volume II, pages 35-40, 1990.
19. D. Lewis and W. Gale. A sequential algorithm for training text classifiers. In ACM SIGIR Conf on Research and Development in Information Retrieval, pages 3-12, 1994.
20. D. J. MacKay. The evidence framework applied to classification networks. Neural Computation, 4:720-736, 1992.
21. H. Nickisch and C. E. Rasmussen. Approximations for binary gaussian process classification. Journal of Machine Learning Research, 9:2035-2078, 2008.
22. B. Ripley. Pattern recognition and neural networks. Cambridge Univ Press, 2008.
23. N. Roy and A. McCallum. Toward optimal active learning through sampling estimation of error reduction. In ICML, pages 441-448, 2001.
24. J. Sacks,W.Welch, T.Mitchell, and H.Wynn. Design and analysis of computer experiments. Statistical Science, 4(4):409-423, 1989.
25. A. Schein and L. Ungar. Active learning for logistic regression: an evaluation. Machine Learning, 68:235-265, 2007.
26. D. W. Scott. Multivariate Density Estimation. John Wiley, 1992.
27. B. Settles. Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, 2010.
28. H. Seung, M. Opper, and H. Sompolinsky. Query by committee. In 5th Annual Workshop on Computational Learning Theory, pages 287-294, 1992.
29. B. Siddiquie and A. Gupta. Beyond active noun tagging: Modeling contextual interactions for multi-class active learning. In CVPR, pages 2979-2986, 2010.
30. E. Snelson and Z. Ghahramani. Compact approximations to bayesian predictive distributions. In ICML, pages 840-847, 2005.
31. S. Tong and D. Koller. Support vector machine active learning with applications to text classification. Journal of Machine Learning Research, 2:45-66, 2002.
32. M. Zhu and A. Ghodsi. Automatic dimensionality selection from the scree plot via the use of profile likelihood. Computational Statistics &Data Analysis, 51: 918-930, 2006.
33. X. Zhu, J. Lafferty, and Z. Ghahramani. Combining active learning and semi-supervised learning using gaussian fields and harmonic functions. In ICML Workshop on The Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, pages 58-65, 2003.