Active learning without knowing individual instance labels: A pairwise label homogeneity query approach

IEEE Transactions on Knowledge and Data Engineering

Volumn 26, Issue 4, 2014, Pages 808-822

  Fu, Yifan ^a   Li, Bin ^b   Zhu, Xingquan ^c   Zhang, Chengqi ^b  

^a CHARLES STURT UNIVERSITY   (Australia)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c Florida Atlantic University   (United States)

Author keywords

Active learning; Pairwise label homogeneity; Weak labeling

Indexed keywords

COMPUTATIONAL METHODS; INFORMATION SYSTEMS;

ACTIVE LEARNERS; ACTIVE LEARNING; ACTIVE LEARNING METHODS; ACTIVE-LEARNING PROCESS; ALTERNATIVE SOLUTIONS; DIFFERENT CLASS; PAIRWISE LABELS; STATE-OF-THE-ART METHODS;

LEARNING SYSTEMS;

EID: 84897441570     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2013.165     Document Type: Article

References (44)

1. H. Abe and H. Mamitsuka, "Query Learning Strategies Using Boosting and Bagging," Proc. Int'l Conf. Machine Learning (ICML '98), pp. 1-9, 1998.
2. A. Culotta and A. McCallum, "Reducing Labeling Effort for Structured Prediction Tasks," Proc. 20th Nat'l Conf. Artificial Intelligence (AAAI), pp. 746-751, 2005. (Pubitemid 43006698)
3. D. Angluin, "Queries and Concept Learning," Machine Learning, vol. 2, pp. 319-342, 1988.
4. A. Blum and S. Chawla, "Learning from Labeled and Unlabeled Data Using Graph Mincuts," Proc. 18th Int'l Conf. Machine Learning (ICML), pp. 19-26, 2001.
5. A. Blum, J. Lafferty, M. R. Rwebangira, and R. Reddy, "Semi-Supervise Learning Using Randomized Mincuts," Proc. 21st Int'l Conf. Machine Learning (ICML), 2004.
6. D. Cohn, Z. Ghahramani, and M. Jordan, "Active Learning with Statistical Models," J. Artificial Intelligence Research, vol. 4, pp. 129-145, 1996. (Pubitemid 126646151)
7. T. Cover and P. Hart, "Nearest Neighbor Pattern Classification, " IEEE Trans. Information Theory, vol. IT-13, no. 1, pp. 21-27, Jan. 1967.
8. P. Donmez and J. Carbonell, "Proactive Learning: Cost-Sensitive Active Learning with Multiple Imperfect Oracles," Proc. 17th ACM Conf. Information and Knowledge Management (CIKM '08), pp. 619-628, 2008.
9. P. Donmez and J. G. Carbonell, "Optimizing Estimated Loss Reduction for Active Sampling in Rank Learning," Proc. Int'l Conf. Machine Learning (ICML '08), 2008.
10. G. Druck, G. Mann, and A. McCallum, "Learning from Labeled Features Using Generalized Expectation Criteria," Proc. 31st Ann. Int'l ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR), pp. 595-602, 2008.
11. J. Du and C. C. Ling, "Asking Generalized Queries to Domain Experts to Improve Learning," IEEE Trans. Knowledge and Data Eng., vol. 22, no. 6, pp. 812-825, June 2010.
12. J. Edmonds and R. Karp, "Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems," J. the ACM, vol. 19, pp. 248-264, 1972.
13. M. Fang, J. Yin, and X. Zhu, "Knowledge Transfer for Multi-Labeler Active Learning," Proc. European Conf. Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML/PKDD), Sept. 2013.
14. Y. Fu, B. Li, X. Zhu, and C. Zhang, "Do They Belong to the Same Class: Active Learning by Querying Pairwise Label Homogeneity," Proc. 20th ACM Int'l Conf. Information and Knowledge Management (CIKM), pp. 2161-2164, 2011.
15. Y. Fu, X. Zhu, and B. Li, "A Survey on Instance Selection for Active Learning," Knowledge and Information Systems, vol. 35, pp. 249-283, 2013.
16. Y. Guo and R Greiner, "Optimistic Active Learning Using Mutual Information," Proc. 20th Int'l Joint Conf. Artificial Intelligence (IJCAI '07), pp. 823-829, 2007.
17. S. Hoi, R. Jin, J. Zhu, and M. Lyu, "Batch Mode Active Learning and its Application to Medical Image Classification," Proc. Int'l Conf. Machine Learning (ICML '06), 2006.
18. T. Joachims, "Transductive Learning via Spectral Graph Partitioning," Proc. Int'l Conf. Machine Learning (ICML), pp. 290-297, 2003.
19. D. D. Lewis and J. Catlett, "Heterogeneous Uncertainty Sampling for Supervised Learning," Proc. 11th Int'l Conf. Machine Learning (ICML '94), pp. 148-156, 1994.
20. C. X. Ling and J. Du, "Active Learning with Direct Query Construction," Proc. 14th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (SIGKDD), pp. 480-487, 2008.
21. T. Luo, K. Kramer, D. B. Goldgof, S. Samson, A. Remsen, T. Hopkins, and D. Cohn, "Active Learning to Recognize Multiple Types of Plankton," Machine Learning Research, vol. 6, pp. 589-613, 2005.
22. H. Nguyen and A. Smeulders, "Active Learning with Pre-Clustering," Proc. Int'l Conf. Machine Learning (ICML '04), pp. 623-630, 2004.
23. E. Ni and C. Ling, "Active Learning with C-Certainty," Proc. 16th Pacific-Asia Conf. Advances in Knowledge Discovery and Data Mining, pp. 231-242, 2012.
24. C. Papadimitriou and K. Steiglitz, Combinatorial Optimization: Algorithms and Complexity. Dover, 1998.
25. P. Donmez and J. G. Carbonell, "Paired Sampling in Density-Sensitive Active Learning," Proc. Int'l Symp. Artificial Intelligence and Math., 2008.
26. V. C. Raykar, S. Yu, L. Zhao, A. Jerebko, C. Florin, G. Hermosillo-Valadez, L. Bogoni, and L. Moy, "Supervised Learning from Multiple Experts: Whom to Trust when Everyone Lies a Bit," Proc. 26th Ann. Int'l Conf. Machine Learning (ICML), 2009.
27. N. Roy and A. McCallum, "Toward Optimal Active Learning through Sampling Estimation of Error Reduction," Proc. Int'l Conf. Machine Learning (ICML'01), pp. 441-448, 2001.
28. R. Schapire, M. Rochery, M. Rahim, and N. Gupta, "Incorporating Prior Knowledge into Boosting," Proc. Int'l Conf. Machine Learning (ICML '02), 2002.
29. B. Settles, "Active Learning Literature Survey," Technical Report 1648, 2009.
30. B. Settles and M. Craven, "An Analysis of Active Learning Strategies for Sequence Labeling Tasks," Proc. Conf. Empirical Methods in Natural Language Processing (EMNLP), pp. 1070-1079, 2008.
31. H. Seung, M. Opper, and H. Sompolinsky, "Query by Committee," Proc. Int'l Conf. Learning Theory (COLT '02), pp. 287-294, 2002.
32. V. S. Sheng, F. Provost, and P. G. Ipeirotis, "Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers," Proc. 14th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD), 2008.
33. S. Tong and D. Koller, "Support Vector Machine Active Learning with Applications to Text Classification," Proc. Int'l Conf. Machine Learning (ICML '00), pp. 999-1006, 2000.
34. S. Vijayanarasimhan, P. Jain, and K. Grauman, "Far-Sighted Active Learning on a Budget for Image and Video Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 3035-3042, 2010.
35. B. C. Wallace, K. Small, C. E. Brodley, and T. A. Trikalinos, "Who Should Label What? Instance Allocation in Multiple Expert Active Learning," Proc. SIAM Int'l Conf. Data Mining (SDM), 2011.
36. I. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2005.
37. X. Wu and R. K. Srihari, "Incorporating Prior Knowledge with Weighted Margin Support Vector Machines," Proc. 10th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (SIGKDD), 2004.
38. Y. Yan, R. Rosales, G. Fung, and D. Dy, "Active Learing from Crowds," Proc. Int'l Conf. Machine Learning, 2011.
39. L. Zhao, G. Sukthankar, and R. Sukthankar, "Incremental Relabeling for Active Learning with Noisy Crowdsourced Annotations," Proc. IEEE Int'l Conf. Social Computing, 2011.
40. Y. Zheng, S. Scott, and K. Deng, "Active Learning from Multiple Noisy Labelers with Varied Costs," Proc. IEEE 10th Int'l Conf. Data Mining (ICDM), pp. 639-648, 2010.
41. X. Zhu and X. Wu, "Class Noise vs. Attribute Noise: A Quantitative Study of their Impact," Artificial Intelligence Rev., vol. 22, pp. 177-210, 2004.
42. X. Zhu, P. Zhang, X. Lin, and Y. Shi, "Active Learning from Data Streams," Proc. IEEE Seventh Int'l Conf. Data Mining (ICDM), pp. 757-7627, 2007.
43. X. Zhu, P. Zhang, Y. Shi, and X. Lin, "Active Learning from Stream Data Using Optimal Weight Classifier Ensemble," IEEE Trans. Systems, Man, and Cybernetics, Part B, vol. 40, no. 6, pp. 1607-1621, Dec. 2010.
44. X. Zhu, "Semi-Supervised Learning Literature Survey," Computer Sciences TR 1530, 2008.