Active learning from multiple knowledge sources

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 1350-1357

  Yan, Y ^a   Rosales, R ^b   Fung, G ^c   Farooq, F ^c   Rao, B ^c   Dy, J ^a  

^a NORTHEASTERN UNIVERSITY   (United States)

^b YAHOO RESEARCH   (United States)

^c SIEMENS CORPORATE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALUMINUM; INFORMATION THEORY;

ACTIVE LEARNING; DATA POINTS; GROUND TRUTH; KNOWLEDGE SOURCES; LEARNING PROBLEM; UNLABELED SAMPLES;

ARTIFICIAL INTELLIGENCE;

EID: 84954199832     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (24)

1. A. Brew, D. Greene, and P. Cunningham. The interaction between supervised learning and crowdsourcing. In NIPS Workshop on Comp. Social Science and the Wisdom of Crowds, 2010.
2. D. Cohn, Z. Ghahramani, and M. Jordan. Active learning with statistical models. Journal of Artificial Intelligence Research, 4:129-145, 1996.
3. T. Cover, T. M., and J. A. Thomas. Elements of information theory. Wiley Interscience, New York, NY, USA, 1991.
4. A. Dempster, N. Laird, and D. Rubin. Maximum likelihood estimation from incomplete data. Journal of the Royal Stat. Soc. (B), 39(1), 1977.
5. P. Donmez and J. G. Carbonell. Proactive learning: Cost-sensitive active learning with multiple imperfect oracles. In Conference on Information and Knowledge Management (CIKM), pages 619-628, 2008.
6. P. Donmez, J. G. Carbonell, and J. Schneider. Efficiently learning the accuracy of labeling sources for selective sampling. In Knowledge Discovery and Data Mining (KDD), 2009.
7. Y. Freund, S. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. Machine Learning, 2-3:133-168, 1997.
8. J. Howe. Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business. Crown Business, 2008.
9. G. Kasneci, J. V. Gael, D. Stern, and T. Graepel. CoBayes: Bayesian knowledge corroboration with assessors of unknown areas of expertise. In Conference on Web Search and Data Mining, pages 465-474, 2011.
10. D. Lewis and W. Gale. A sequential algorithm for training text classifiers. In SIGIR, pages 3-12, 1994.
11. D. Lindley. On a measure of the information provided by an experiment. Ann. Math. Stat, 27:986-1005, 1956.
12. D. MacKay. Information-based objective functions for active data selection. Neural Computation, 4:590-604, 1992.
13. U. Paquet, J. Van Gael, D. Stern, G. Kasneci, R. Herbrich, and T. Graepel. Vuvuzelas and active learning for online classification. In NIPS Workshop on Comp. Social Science and the Wisdom of Crowds, 2010.
14. V. C. Raykar, S. Yu, L. Zhao, A. Jerebko, C. Florin, G. Hermosillo-Valadez, L. Bogoni, and L. Moy. Supervised learning from multiple experts: Whom to trust when everyone lies a bit. In International Conference on Machine Learning, pages 889-896, 2009.
15. V. C. Raykar, S. Yu, L. Zhao, A. Jerebko, C. Florin, G. Hermosillo-Valadez, L. Bogoni, and L. Moy. Supervised learning from multiple experts: Whom to trust when everyone lies a bit. In Int. Conference on Machine Learning (ICML), pages 889-896, 2009.
16. N. Roy and A. McCallum. Toward optimal active learning through sampling estimation of error reduction. In 18th International Conference on Machine Learning, pages 444-448, 2001.
17. A. Rzhetsky, H. Shatkay, and W. J. Wilbur. How to get the most out of your curation effort. PLoS Computational Biology, 5(5):e1000391, 2009.
18. B. Settles, M. Craven, and S. Ray. Multipleinstance active learning. In In Advances in Neural Information Processing Systems (NIPS, pages 1289-1296. MIT Press, 2008.
19. S. Seung, M. Opper, and H. Sompolinsky. Query by committee. In Fifth Workshop on Computational Learning Theory, pages 287-94, 1992.
20. V. S. Sheng, F. Provost, and P. G. Ipeirotis. Get another label? Improving data quality and data mining using multiple, noisy labelers. In Knowledge Discovery and Data Mining (KDD), pages 614-622, 2008.
21. P. Smyth, U. Fayyad, M. Burl, P. Perona, and P. Baldi. Inferring ground truth from subjective labeling of Venus images. In Advances in Neural Information Processing Systems, volume 7, pages 1085-1092, 1995.
22. P. Welinder, S. Branson, S. Belongie, and P. Perona. The multidimensional wisdom of crowds. In Advances in Neural Information Processing Systems, 2011.
23. Y. Yan, R. Rosales, G. Fung, and J. Dy. Active learning from crowds. In International Conference on Machine Learning, 2011.
24. Y. Yan, R. Rosales, G. Fung, M. Schmidt, G. Hermosillo, L. Bogoni, L. Moy, and J. Dy. Modeling annotator expertise: Learning when everybody knows a bit of something. In International Conference on Artificial Intelligence and Statistics, pages 932-939, 2010.