Exploring Representativeness and Informativeness for Active Learning

IEEE Transactions on Cybernetics

Volumn 47, Issue 1, 2017, Pages 14-26

  Du, Bo ^a   Wang, Zengmao ^a   Zhang, Lefei ^a   Zhang, Liangpei ^b   Liu, Wei ^c   Shen, Jialie ^d   Tao, Dacheng ^e  

^a WUHAN UNIVERSITY   (China)

^b Wuhan University   (China)

^c IBM T J WATSON RESEARCH CENTER   (United States)

^d SINGAPORE MANAGEMENT UNIVERSITY   (Singapore)

^e UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Active learning; classification informative and representative; informativeness; representativeness

Indexed keywords

ARTIFICIAL INTELLIGENCE; BENCHMARKING; CHARACTER RECOGNITION; CLASSIFICATION (OF INFORMATION); IMAGE RECOGNITION; IMAGE SEGMENTATION; ITERATIVE METHODS; OPTIMIZATION; RADIAL BASIS FUNCTION NETWORKS; TEXT PROCESSING;

ACTIVE LEARNING; ACTIVE-LEARNING ALGORITHM; CLASSIFICATION PERFORMANCE; INFORMATIVE NESS; ITERATIVE OPTIMIZATION; RADIAL BASIS FUNCTIONS; REPRESENTATIVENESS; STATE-OF-THE-ART METHODS;

LEARNING ALGORITHMS;

EID: 85027542157     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2015.2496974     Document Type: Article

References (62)

1. M. Yu, L. Liu, and L. Shao, "Structure-preserving binary representations for RGB-D action recognition, " IEEE Trans. Pattern Anal. Mach. Intell., Doi: 10. 1109/TPAMI. 2015. 2491925.
2. Q. Zhu, J. Mai, and L. Shao, "A fast single image haze removal algorithm using color attenuation prior, " IEEE Trans. Image Process., vol. 24, no. 11, pp. 3522-3533, Nov. 2015.
3. T. Liu and D. Tao, "Classification with noisy labels by importance reweighting, " IEEE Trans. Pattern Anal. Mach. Intell., Doi: 10. 1109/TPAMI. 2015. 2456899.
4. C. Xu, D. Tao, and C. Xu, "Multi-view intact space learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 12, pp. 2531-2544, Dec. 2015.
5. D. Tao, J. Cheng, M. Song, and X. Lin, "Manifold ranking-based matrix factorization for saliency detection, " IEEE Trans. Neural Netw. Learn. Syst., Doi: 10. 1109/TNNLS. 2015. 2461554.
6. D. Tao, X. Lin, L. Jin, and X. Li, "Principal component 2-D long shortterm memory for font recognition on single Chinese characters, " IEEE Trans. Cybern., Doi: 10. 1109/TCYB. 2015. 2414920.
7. L. Liu, M. Yu, and L. Shao, "Unsupervised local feature hashing for image similarity search, " IEEE Trans. Cybern., Doi: 10. 1109/TCYB. 2015. 2480966.
8. F. Zhu and L. Shao, "Weakly-supervised cross-domain dictionary learning for visual recognition, " Int. J. Comput. Vision, vol. 109, nos. 1-2, pp. 42-59, 2014.
9. L. Liu, M. Yu, and L. Shao, "Multiview alignment hashing for efficient image search, " IEEE Trans. Image Process., vol. 24, no. 3, pp. 956-966, 2015.
10. D. Tao, L. Jin, W. Liu, and X. Li., "Hessian regularized support vector machines for mobile image annotation on the cloud, " IEEE Trans. Multimedia, vol. 15, no. 4, pp. 833-844, 2013.
11. B. Settles, "Active learning literature survey, " Dept. Comput. Sci., Univ. Wisconson-Madison, Madison, WI, USA, Tech. Rep. 1648, 2009.
12. X. He, "Laplacian regularized D-optimal design for active learning and its application to image retrieval, " IEEE Trans. Image Process., vol. 19, no. 1, pp. 254-263, Jan. 2010.
13. L. Zhang et al., "Active learning based on locally linear reconstruction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 2026-2038, Oct. 2011.
14. R. Chattopadhyay, W. Fan, I. Davidson, S. Panchanathan, and J. Ye, "Joint transfer and batch-mode active learning, " in Proc. ICML, Atlanta, GA, USA, 2013, pp. 253-261.
15. J. Attenberg and F. Provost, "Online active inference and learning, " in Proc. ACM SIGKDD, San Diego, CA, USA, 2011, pp. 186-194.
16. M. Fang, J. Yin, and X. Zhu, "Knowledge transfer for multi-labeler active learning, " in Proc. ECML-PKDD, Prague, Czech Republic, 2013, pp. 273-288.
17. J. Wang, N. Srebro, and J. Evans, "Active collaborative permutation learning, " in Proc. ACM SIGKDD, New York, NY, USA, 2014, pp. 502-511.
18. N. García-Pedrajas, J. Prez-Rodríguez, and A. de Haro-García, "OligoIS: Scalable instance selection for class-imbalanced data sets, " IEEE Trans. Cybern., vol. 43, no. 1, pp. 332-346, Feb. 2013.
19. W. Hu, W. Hu, N. Xie, and S. Maybank, "Unsupervised active learning based on hierarchical graph-theoretic clustering, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 5, pp. 1147-1161, Oct. 2009.
20. W. Nam and R. Alur, "Active learning of plans for safety and reachability goals with partial observability, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 2, pp. 412-420, Apr. 2010.
21. J. Zhang, X. Wu, and V. S. Sheng, "Active learning with imbalanced multiple noisy labeling, " IEEE Trans. Cybern., vol. 45, no. 5, pp. 1081-1093, Aug. 2015.
22. X. Zhu, P. Zhang, Y. Shi, and X. Lin, "Active learning from stream data using optimal weight classifier ensemble, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 6, pp. 1607-1621, Dec. 2010.
23. O. M. Aodha, N. D. F. Campbell, J. Kautz, and G. J. Brostow, "Hierarchical subquery evaluation for active learning on a graph, " in Proc. CVPR, Columbus, OH, USA, 2014, pp. 564-571.
24. E. Elhamifar, G. Sapiro, A. Yang, and S. S. Sastry, "A convex optimization framework for active learning, " in Proc. ICCV, Sydney, NSW, Australia, 2013, pp. 209-216.
25. Y. Fu, X. Zhu, and A. K. Elmagarmid, "Active learning with optimal instance subset selection, " IEEE Trans. Cybern., vol. 43, no. 2, pp. 464-475, Apr. 2013.
26. M. Zuluaga, G. Sergent, A. Krause, and M. Püschel, "Active learning for multi-objective optimization, " in Proc. ICML, Atlanta, GA, USA, 2013, pp. 462-470.
27. A. Gonen, S. Sabato, and S. Shalev-Shwartz, "Efficient active learning of halfspaces: An aggressive approach, " in Proc. ICML, Atlanta, GA, USA, 2013, pp. 480-488.
28. S. J. Huang, R. Jin, and Z. H. Zhou, "Active learning by querying informative and representative examples, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 10, pp. 1936-1949, Oct. 2014.
29. X. Lu, Y. Wang, and Y. Yuan, "Sparse coding from a Bayesian perspective, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 6, pp. 929-939, Jun. 2013.
30. X. Lu, H. Wu, and Y. Yuan, "Double constrained NMF for hyperspectral unmixing, " IEEE Trans. Geosci. Remote Sens., vol. 52, no. 5, pp. 2746-2758, May 2014.
31. X. Lu, Y. Wang, and Y. Yuan, "Graph-regularized low-rank representation for destriping of hyperspectral images, " IEEE Trans. Geosci. Remote Sens., vol. 51, no. 7, pp. 4009-4018, Jul. 2013.
32. X. Lu, Y. Yuan, and P. Yan, "Image super-resolution via double sparsity regularized manifold learning, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 12, pp. 2022-2033, Dec. 2013.
33. X. Lu, H. Wu, Y. Yuan, P. Yan, and X. Li, "Manifold regularized sparse NMF for hyperspectral unmixing, " IEEE Trans. Geosci. Remote Sens., vol. 51, no. 5, pp. 2815-2826, May 2013.
34. D. Vasisht, A. Damianou, M. Varma, and A. Kapoor, "Active learning for sparse Bayesian multilabel classification, " in Proc. ACM SIGKDD, New York, NY, USA, 2014, pp. 472-481.
35. P. Melville and R. J. Mooney, "Diverse ensembles for active learning, " in Proc. 21th Int. Conf. Mach. Learn., Banff, AB, Canada, 2004, p. 74.
36. I. Guyon, G. Cawley, V. Lemaire, and G. Dror, "Results of the active learning challenge, " J. Mach. Learn. Res., vol. 16, pp. 19-45, 2011.
37. M. Wang and X.-S. Hua, "Active learning in multimedia annotation and retrieval: A survey, " ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, pp. 1-21, 2011.
38. Y. Chen and A. Krause, "Near-optimal batch mode active learning and adaptive submodular optimization, " J. Mach. Learn. Res., vol. 28, no. 1, pp. 160-168, 2013.
39. S. Tong and D. Koller, "Support vector machine active learning with applications to text classification, " J. Mach. Learn. Res., vol. 2, pp. 45-66, 2001.
40. J. Zhu and M. Ma, "Uncertainty-based active learning with instability estimation for text classification, " ACM Trans. Speech Lang. Process., vol. 8, no. 4, pp. 1-21, 2012.
41. M. Park and J. W. Pillow, "Bayesian active learning with localized priors for fast receptive field characterization, " in Proc. NIPS, Nevada City, CA, USA, 2012, pp. 2357-2365.
42. W. Luo, A. Schwing, and R. Urtasun, "Latent structured active learning, " in Proc. NIPS, Lake Tahoe, CA, USA, 2013, pp. 728-736.
43. N. V. Cuong, W. S. Lee, N. Ye, K. M. A. Chai, and H. L. Chieu, "Active learning for probabilistic hypotheses using the maximum Gibbs error criterion, " in Proc. NIPS, Lake Tahoe, CA, USA, 2013, pp. 1457-1465.
44. X. Li, D. Kuang, and C. X. Ling, "Active learning for hierarchical text classification, " in Advances in Knowledge Discovery and Data Mining, Berlin, Germany: Springer, 2012, pp. 14-25.
45. I. Dino, B. Albert, Z. Indre, and P. Bernhard, "Clustering based active learning for evolving data streams, " in Discovery Science, Berlin, Germany: Springer, 2013, pp. 79-93.
46. R. Chattopadhyay et al., "Batch mode active sampling based on marginal probability distribution matching, " in Proc. ACM SIGKDD, Beijing, China, 2012, pp. 741-749.
47. Y. Fu, B. Li, X. Zhu, and C. Zhang, "Active learning without knowing individual instance labels: A pairwise label homogeneity query approach, " IEEE Trans. Knowl. Data Eng., vol. 26, no. 4, pp. 808-822, Apr. 2014.
48. T. Reitmaier, A. Calma, and B. Sick, "Transductive active learning- A new semi-supervised learning approach based on iteratively refined generative models to capture structure in data, " Inf. Sci., vol. 293, pp. 275-298, Feb. 2015.
49. Z. Wang and J. Ye, "Querying discriminative and representative samples for batch mode active learning, " in Proc. ACM SIGKDD, San Jose, CA, USA, 2013, pp. 158-166.
50. M. Li, R. Wang, and K. Tang, "Combining semi-supervised and active learning for hyperspectral image classification, " in Proc. CIDM, Singapore, 2013, pp. 89-94.
51. M. F. A. Hady and F. Schwenker, "Combining committee-based semisupervised learning and active learning, " J. Comput. Sci. Technol., vol. 25, no. 4, pp. 681-698, 2010.
52. M. F. A. Hady and F. Schwenker, "Semisupervised learning, " in Handbook on Neural Information Processing. Berlin, Germany: Springer, 2013.
53. A. J. Joshi, F. Porikli, and N. P. Papanikolopoulos, "Scalable active learning for multiclass image classification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2259-2273, Nov. 2012.
54. A. Frank and A. Asuncion, "UCI Machine Learning Repository, " School Inf. Comput. Sci., Univ. California, Irvine, CA, USA, Tech. Rep. 213, 2010.
55. A. Gretton, K. M. Borgwardt, M. J. Rasch, B. Schölkopf, and A. Smola, "A kernel two-sample test, " J. Mach. Learn. Res., vol. 13, no. 1, pp. 723-733, 2013.
56. P. Hall, "Central limit theorem for integrated square error of multivariate nonparametric density estimators, " J. Multivariate Anal., vol. 14, no. 1, pp. 1-16, 1984.
57. N. H. Anderson, P. Hall, and D. M. Titterington, "Two-sample test statistics for measuring discrepancies between two multivariate probability density functions using kernel-based density estimates, " J. Multivariate Anal., vol. 50, no. 1, pp. 41-54, 1994.
58. C. McDiarmid, "On the method of bounded differences, " in Surveys Combinatorics, vol. 141. Cambridge, U. K.: Cambridge Univ. Press, 1989, pp. 148-188.
59. K. Chen and S. Wang, "Semi-supervised learning via regularized boosting working on multiple semi-supervised assumptions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 129-143, Jan. 2011.
60. L. Zhang et al., "Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding, " Pattern Recognit., vol. 48, no. 10, pp. 3102-3112, 2015.
61. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines, " ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, 2011, Art. ID 21.
62. H. Zhuang and J. Young, "Leveraging in-batch annotation bias for crowdsourced active learning, " in Proc. ACM WSDM, Shanghai, China, 2015, pp. 243-252.