Batch mode active sampling based on marginal probability distribution matching

ACM Transactions on Knowledge Discovery from Data

Volumn 7, Issue 3, 2013, Pages

  Chattopadhyay, Rita ^a   Wang, Zheng ^a   Fan, Wei ^b   Davidson, Ian ^c   Panchanathan, Sethuraman ^a   Ye, Jieping ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b HUAWEI NOAH S ARK LAB   (China)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Active learning; Marginal probability distribution; Maximum mean discrepancy; Transfer learning

Indexed keywords

ACTIVE LEARNING; BIOMEDICAL IMAGE DATABASE; CONVEX QUADRATIC PROGRAMMING; GENERALIZATION PERFORMANCE; LINEAR PROGRAMMING PROBLEM; MAXIMUM MEAN DISCREPANCY; TRANSFER LEARNING; UNCERTAINTY INFORMATIONS;

CLASSIFICATION (OF INFORMATION); INTEGER PROGRAMMING; LINEAR PROGRAMMING; OPTIMIZATION; PROBABILITY DISTRIBUTIONS;

PROBLEM SOLVING;

EID: 84884991180     PISSN: 15564681     EISSN: 1556472X     Source Type: Journal    
DOI: 10.1145/2513092.2513094     Document Type: Conference Paper

References (44)

1. Bickel, S., Br̈ uckner, M., and Scheffer, T. 2009. Discriminative learning under covariate shift. J. Mach. Learn. Res. 10, 2137-2155.
2. Borgwardt, K., Gretton, A., Rasch, M., Kriegel, H., Schlkopf, B., and Smola, A. 2006. Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics 22, 14, 49-57.
3. Boyd, S. and Vandenberghe, L. 2004. Convex Optimization. Cambridge.
4. Brinker, K. 2003. Incorporating diversity in active learning with support vector machines. In Proceedings of the International Conference on Machine Learning.
5. Cai, D. and He, X. 2012. Manifold adaptive experimental design for text categorization. IEEE Trans. on Knowledge and Data Engineering 24, 4, 707-719.
6. Campbell, C., Cristianini, N., and Smola, A. 2000. Query learning with large margin classifiers. In Proceedings of the International Conference on Machine Learning.
7. Dagan, I. and Engelson, S. 1995. Committee-based sampling for training probabilistic classifiers. In Proceedings of the International Conference on Machine Learning.
8. Eaton, E. and Desjardins, M. 2009. Set-based boosting for instance-level transfer. In Proceedings of the IEEE International Conference on Data Mining.
9. Freund, Y., Seung, H., Shamir, E., and Tishby, N. 1997. Selective sampling using query by committee algorithm. Mach. Learn. 28.
10. Grant, M. and Boyd, S. 2007. CVX: Matlab software for disciplined convex programming, version 1.21.
11. Gretton, A., Borgwardt, K. M., Rasch, M., Scholkopf, B., and Smola, A. J. 2007. A kernel method for the two-sample problem. In Proceedings of the Conference on Advances in Neural Information Processing Systems.
12. Gretton, A., Borgwardt, K. M., Rasch, M., Scḧolkopf, B., and Smola, A. J. 2008. A kernel method for the two-sample-problem. Journal of Machine Learning Research 1, 1-10.
13. Guo, Y. 2010. Active instance sampling via matrix partition. In Proceedings of the Conference on Advances in Neural Information Processing Systems.
14. Guo, Y. and Schuurmans, D. 2007. Discriminative batch mode active learning. In Proceedings of the Conference on Advances in Neural Information Processing Systems.
15. He, X. and Cai, D. 2009. Active subspace learning. In ICCV.
16. Hoi, S., Jin, R., Zhu, J., and Lyu, M. 2006. Batch mode active learning and its application to medical image classification. In Proceedings of the International Conference on Machine Learning.
17. Hoi, S., Jin, R., Zhu, J., and Lyu, M. 2008. Semi-supervised svm batch mode active learning for image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
18. Huang, J., Smola, A., Gretton, A., Borgwardt, K., and Scholkopf, B. 2007. Correcting sample selection bias by unlabeled data. In Proceedings of the Conference on Advances in Neural Information Processing Systems.
19. Huang, S., Jin, R., and Zhou, Z. 2010. Active Learning by Querying Informative and Representative Examples. In NIPS.
20. Jing, F., Li, M., Zhang, H., and Zhang, B. 2004. Entropy based active learning with support vector machines for content based image retrieval. In Proceedings of the International Conference on Multimedia and Expo.
21. Joshi, A., Porikli, F., and Papanikolopoulos, N. 2009. Multi-class active learning for image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
22. Lecuyer, E., Yoshida, H., Parthasarathy, N., Alm, C., and Babak, T. 2011. Global analysis of mrna localization reveals a prominent role in organizing cellular architecture and function. Cell 131, 1, 174-187. (Pubitemid 47498530)
23. Liu, C. and Wechsler, H. 2002. Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans. Image Process. 11, 467-476. (Pubitemid 34692396)
24. Pan, S. and Yang, Q. 2009. A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 10.
25. Pan, S., Tsang, I., Kwok, J., and Yang, Q. 2009. Domain adaptation via transfer component analysis. In Proceedings of the International Joint Conference on Artificial Intelligence.
26. Pan, S. J., Kwok, J. T., and Yang, Q. 2008. Transfer learning via dimensionality reduction. In AAAI.
27. Rai, P., Saha, A., Dauḿe, H. III, and Venkatasubramanian, S. 2010. Domain adaptation meets active learning. In Proceedings of the NAACL-HLT Active Learning for NLP Workshop.
28. Schohn, G. and Cohn, D. 2000. Less is more: Active learning with support vector machines. In Proceedings of the International Conference on Machine Learning.
29. Settles, B. 2009. Active learning literature survey. Computer Sciences Tech. rep. 1648, University of Wisconsin-Madison.
30. Seung, H., Opper, M., and Sompolinsky, H. 1992. Query by committee. In Proceedings of the ACM Workshop on Computational Learning Theory.
31. Shi, X., Fan, W., and Ren, J. 2008. Actively transfer domain knowledge. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases.
32. Shimodaira, H. 2000. Improving predictive inference under covariate shift by weighting the log-likelihood function. J. Stat. Plan. Inference 90, 227-244.
33. Sriperumbudur, B., Gretton, A., Fukumizu, K., Scholkopf, B., and Lanckriet, G. 2010. Hilbert space embeddings and metrics on probability measures. J. Mach. Learn. Res. 11, 1517-1561.
34. Steinwart, I. 2002. On the influence of the kernel on the consistency of support vector machines. J. Mach. Learn. Res. 2, 67-93.
35. Sugiyama, M., Nakajima, S., Kashima, H., Buenau, P. V., and Kawanabe, M. 2008. Direct importance estimation with model selection and its application to covariate shift adaptation. In NIPS.
36. Tomancak, P., Beaton, A., Weiszmann, R., Kwan, E., and Shu, S. 2002. Systematic determination of patterns of gene expression during drosophila embryogenesis. Genome Biol. 3.
37. Tong, S. and Koller, D. 2000. Support vector machine active learning with applications to text classification. J. Mach. Learn. Res. 2, 45-66.
38. Vapnik, V. N. 2000. The Nature of Statistical Learning Theory. Springer.
39. Wasserman, L. 2005. All of Statistics: A Concise Course in Statistical Inference. Springer.
40. Witten, I. and Frank, E. 2000. Data Mining: Practical Machine Learning Tools with Java Implementations. Morgan Kaufmann.
41. Wu, Y., Kozintsev, I., Bouguet, J., and Dulong, C. 2006. Sampling strategies for active learning in personal photo retrieval. In Proceedings of the International Conference on Multimedia and Expo.
42. Yu, K., Bi, J., and Tresp, V. 2006. Active learning via transductive experimental design. In Proceedings of the International Conference on Machine Learning.
43. Zhang, L., Chen, C., Bu, J., Cai, D., He, X., and Huang, T. S. 2011. Active learning based on locally linear reconstruction. IEEE Trans. on Pattern Analysis and Machine Intelligence 33, 10, 2026-2038.
44. Zhang, T. and Oles, F. 2000. A probability analysis on the value of unlabeled data for classification problems. In Proceedings of the International Conference on Machine Learning.