Inconsistency-based active learning for support vector machines

Pattern Recognition

Volumn 45, Issue 10, 2012, Pages 3751-3767

  Wang, Ran ^a   Kwong, Sam ^a   Chen, Degang ^b  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

^b NORTH CHINA ELECTRIC POWER UNIVERSITY   (China)

Author keywords

Active learning; Concept learning; Inconsistency; Sample selection; Support vector machine

Indexed keywords

ACTIVE LEARNING; ADDITIONAL KNOWLEDGE; CLASSIFICATION TASKS; CONCEPT LEARNING; DATA COMPLEXITY; DATA REDUNDANCY; DATA SETS; GENERALIZATION CAPABILITY; INCONSISTENCY; LEARNING EFFICIENCY; LEARNING PROCESS; POOL-BASED; SAMPLE SELECTION; VERSION SPACE;

CLASSIFICATION (OF INFORMATION); COMPETITION; LAKES; LEARNING ALGORITHMS;

SUPPORT VECTOR MACHINES;

EID: 84861810043     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.03.022     Document Type: Article

References (52)

1. D. Cohn, L. Atlas, and R. Ladner Improving generalization with active learning Machine Learning 15 2 1994 201 221
2. L. Atlas, D. Cohn, R. Ladner, M. El-Sharkawi, and R. Marks II Training connectionist networks with queries and selective sampling Advances in Neural Information Processing Systems (NIPS) 2 1989 566 573
3. S. Tong, and D. Koller Support vector machine active learning with applications to text classification Journal of Machine Learning Research 2 2002 45 66
4. J. Cheng, and K. Wang Active learning for image retrieval with Co-SVM Pattern Recognition 40 1 2007 330 334
5. R. Liu, Y. Wang, T. Baba, D. Masumoto, and S. Nagata SVM-based active feedback in image retrieval using clustering and unlabeled data Pattern Recognition 41 8 2008 2645 2655
6. D. Zhang, F. Wang, Z. Shi, and C. Zhang Interactive localized content based image retrieval with multiple-instance active learning Pattern Recognition 43 2 2010 478 484
7. G. Chen, T. Wang, L. Gong, and P. Herrera Multi-class support vector machine active learning for music annotation International Journal of Innovative Computing, Information and Control 6 2010 921 930
8. M. Mandel, G. Poliner, and D. Ellis Support vector machine active learning for music retrieval Multimedia Systems 12 1 2006 3 13
9. D. Angluin Queries and concept learning Machine Learning 2 4 1988 319 342
10. Y. Freund, H. Seung, E. Shamir, and N. Tishby Selective sampling using the query by committee algorithm Machine Learning 28 2 1997 133 168
11. H. Seung, M. Opper, H. Sompolinsky, Query by committee, in: Proceedings of the 5th Annual Workshop on Computational Learning Theory, 1992, pp. 287-294.
12. X. Zhu, P. Zhang, X. Lin, and Y. Shi Active learning from stream data using optimal weight classifier ensemble IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 40 6 2010 1607 1621
13. A. McCallum, K. Nigam, Employing EM in pool-based active learning for text classification, in: Proceedings of the 15th International Conference on Machine Learning (ICML), 1998, pp. 350-358.
14. M. Sugiyama, and S. Nakajima Pool-based active learning in approximate linear regression Machine Learning 75 3 2009 249 274
15. S. Wang, J. Wang, X. Gao, X. Wang, Pool-based active learning based on incremental decision tree, in: Proceedings of the 2010 International Conference on Machine Learning and Cybernetics (ICMLC), vol. 1, 2010, pp. 274-278.
16. Y. Guo, and D. Schuurmans Discriminative batch mode active learning Advances in Neural Information Processing Systems (NIPS) 20 2007 593 600
17. S. Hoi, R. Jin, and M. Lyu Batch mode active learning with applications to text categorization and image retrieval IEEE Transactions on Knowledge and Data Engineering 21 9 2009 1233 1248
18. C. Campbell, N. Cristianini, A. Smola, Query learning with large margin classifiers, in: Proceedings of the 17th International Conference on Machine Learning (ICML), 2000, pp. 111-118.
19. M. Lindenbaum, S. Markovitch, and D. Rusakov Selective sampling for nearest neighbor classifiers Machine Learning 54 2 2004 125 152
20. N. Roy, A. McCallum, Toward optimal active learning through sampling estimation of error reduction, in: Proceedings of the 18th International Conference on Machine Learning (ICML), 2001, pp. 441-448.
21. V. Iyengar, C. Apte, T. Zhang, Active learning using adaptive resampling, in: Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2000, pp. 91-98.
22. D. Lewis, J. Catlett, Heterogeneous uncertainty sampling for supervised learning, in: Proceedings of the 11th International Conference on Machine Learning (ICML), 1994, pp. 148-156.
23. M. Li, and I. Sethi Confidence-based active learning IEEE Transactions on Pattern Analysis and Machine Intelligence 28 8 2006 1251 1261
24. R. Wang, S. Kwong, Sample selection based on maximum entropy for support vector machines, in: Proceedings of the 2010 International Conference on Machine Learning and Cybernetics (ICMLC), vol. 3, 2010, pp. 1390-1395.
25. H. Nguyen, A. Smeulders, Active learning using pre-clustering, in: Proceedings of the 21st International Conference on Machine Learning (ICML), 2004.
26. A. Tavares da Silva, A. Xavier Falcão, and L. Pini Magalhães Active learning paradigms for CBIR systems based on optimum-path forest classification Pattern Recognition 44 12 2011 2971 2978
27. J. Tang, Z. Zha, D. Tao, C. Tat-Seng, Semantic-gap oriented active learning for multi-label image annotation, IEEE Transactions on Image Processing 21 (4) (2012) 2354-2360.
28. Z. Zha, M. Wang, Y. Zheng, Y. Yang, R. Hong, and T. Chua Interactive video indexing with statistical active learning IEEE Transactions on Multimedia 14 1 2012 17 27
29. W. Hu, W. Hu, N. Xie, and S. Maybank Unsupervised active learning based on hierarchical graph-theoretic clustering IEEE Transactions on Systems, Man, and Cybernetics Part B: Cybernetics 39 5 2009 1147 1161
30. A. Joshi, F. Porikli, N. Papanikolopoulos, Multi-class active learning for image classification, in: Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 2372-2379.
31. A. Joshi, F. Porikli, N. Papanikolopoulos, Multi-class batch-mode active learning for image classification, in: Proceedings of the 2010 IEEE International Conference on Robotics and Automation (ICRA), 2010, pp. 1873-1878.
32. G. Qi, X. Hua, Y. Rui, J. Tang, and H. Zhang Two-dimensional multilabel active learning with an efficient online adaptation model for image classification IEEE Transactions on Pattern Analysis and Machine Intelligence 31 10 2009 1880 1897
33. Z. Wang, S. Chen, and D. Gao A novel multi-view learning developed from single-view patterns Pattern Recognition 44 10-11 2011 2395 2413
34. Q. Zhang, and S. Sun Multiple-view multiple-learner active learning Pattern Recognition 43 9 2010 3113 3119
35. R. Gilad-Bachrach, A. Navot, N. Tishby, Query by committee made real, Advances in Neural Information Processing Systems (NIPS) 18 (2005) 443-450
36. T. Michell Machine Learning 1997 McGraw Hill
37. R. Wang, S. Kwong, Q. He, Active learning based on support vector machines, in: Proceedings of the 2010 IEEE International Conference on Systems Man and Cybernetics (SMC), 2010, pp. 1312-1316.
38. V. Vapnik The Nature of Statistical Learning Theory 2000 Springer Verlag
39. B. Schölkopf, and A. Smola Learning with Kernels 2002 The MIT Press
40. G. Schohn, D. Cohn, Less is more: active learning with support vector machines, in: Proceedings of the 17th International Conference on Machine Learning (ICML), 2000, pp. 839-846.
41. S. Tong, Active Learning: Theory and Applications, Ph.D. Thesis, Citeseer, 2001.
42. S. Cheng, and F. Shih An improved incremental training algorithm for support vector machines using active query Pattern Recognition 40 3 2007 964 971
43. Z. Wang, S. Yan, and C. Zhang Active learning with adaptive regularization Pattern Recognition 44 10-11 2011 2375 2383
44. D. Gorisse, M. Cord, and F. Precioso SALSAS: Sub-linear active learning strategy with approximate k-NN search Pattern Recognition 44 10-11 2011 2343 2357
45. T. Mitchell, Version Spaces: An Approach to Concept Learning, Technical Report, DTIC Document, 1978.
46. D. Chen, Q. He, and X. Wang On linear separability of data sets in feature space Neurocomputing 70 13-15 2007 2441 2448
47. S. Ho, and H. Wechsler Query by transduction IEEE Transactions on Pattern Analysis and Machine Intelligence 30 9 2008 1557 1571
48. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proceedings of the IEEE 86 11 1998 2278 2324
49. S. Maji, J. Malik, Fast and Accurate Digit Classification, Technical Report UCB/EECS-2009-159, EECS Department, University of California, Berkeley.
50. J. Blackard, and D. Dean Comparative accuracies of artificial neural networks and discriminant analysis in predicting forest cover types from cartographic variables Computers and Electronics in Agriculture 24 3 1999 131 152
51. B. Meyer, Forest Cover Type Prediction.
52. M. Trebar, and N. Steele Application of distributed SVM architectures in classifying forest data cover types Computers and Electronics in Agriculture 63 2 2008 119 130