Pool-based active learning in approximate linear regression

Machine Learning

Volumn 75, Issue 3, 2009, Pages 249-274

  Sugiyama, Masashi ^a   Nakajima, Shinichi ^b  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b NIKON CORPORATION   (Japan)

Author keywords

ALICE; Approximate linear regression; Covariate shift; Importance weighted least squares; Pool based active learning

Indexed keywords

ALICE; APPROXIMATE LINEAR REGRESSION; COVARIATE SHIFT; IMPORTANCE-WEIGHTED LEAST-SQUARES; POOL-BASED ACTIVE LEARNING;

COMPUTATIONAL FLUID DYNAMICS; ERROR ANALYSIS; LAKES; LINEAR REGRESSION;

EDUCATION;

EID: 67349146515     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-009-5100-3     Document Type: Article

References (28)

1. Bach, F. R. (2007). Active learning for misspecified generalized linear models. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems (Vol. 19, pp. 65-72). Cambridge: MIT Press.
2. Baldi, P., & Brunak, S. (1998). Bioinformatics: the machine learning approach. Cambridge: MIT Press.
3. Bickel, S., Brückner, M., & Scheffer, T. (2007). Discriminative learning for differing training and test distributions. In Proceedings of the 24th international conference on machine learning.
4. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Clarendon.
5. D. A. Cohn Z. Ghahramani M. I. Jordan 1996 Active learning with statistical models Journal of Artificial Intelligence Research 4 129 145 (Pubitemid 126646151)
6. D. Coomans M. Broeckaert M. Jonckheer D. L. Massart 1983 Comparison of multivariate discriminant techniques for clinical data-application to the thyroid functional state Methods of Information in Medicine 22 93 101
7. Fedorov, V. V. (1972). Theory of optimal experiments. San Diego: Academic Press.
8. Fishman, G. S. (1996). Monte Carlo: concepts, algorithms, and applications. Berlin: Springer.
9. K. Fukumizu 2000 Statistical active learning in multilayer perceptrons IEEE Transactions on Neural Networks 11 1 17 26
10. Henkel, R. E. (1979). Tests of significance. Thousand Oaks: SAGE.
11. Huang, J., Smola, A., Gretton, A., Borgwardt, K. M., & Schölkopf, B. (2007). Correcting sample selection bias by unlabeled data. In B. Schölkopf & J. Platt (Eds.), Advances in neural information processing systems (Vol. 19, pp. 601-608). Cambridge: MIT Press.
12. T. Kanamori 2007 Pool-based active learning with optimal sampling distribution and its information geometrical interpretation Neurocomputing 71 1-3 353 362 (Pubitemid 350028654)
13. T. Kanamori H. Shimodaira 2003 Active learning algorithm using the maximum weighted log-likelihood estimator Journal of Statistical Planning and Inference 116 1 149 162 (Pubitemid 36742567)
14. McCallum, A., & Nigam, K. (1998). Employing EM in pool-based active learning for text classification. In Proceedings of the 15th international conference on machine learning.
15. Melville, P., & Mooney, R. J. (2004). Diverse ensembles for active learning. In Proceedings of the twenty-first international conference on machine learning. New York: ACM.
16. Rasmussen, C. E., Neal, R. M., Hinton, G. E., van Camp, D., Revow, M., Ghahramani, Z., Kustra, R., & Tibshirani, R. (1996). The DELVE manual. URL http://www.cs.toronto.edu/~delve/.
17. A. I. Schein L. H. Ungar 2007 Active learning for logistic regression: an evaluation Machine Learning 68 3 235 265 (Pubitemid 47312489)
18. H. Shimodaira 2000 Improving predictive inference under covariate shift by weighting the log-likelihood function Journal of Statistical Planning and Inference 90 2 227 244
19. M. Sugiyama 2006 Active learning in approximately linear regression based on conditional expectation of generalization error Journal of Machine Learning Research 7 141 166 (Pubitemid 43100915)
20. M. Sugiyama K.-R. Müller 2005 Input-dependent estimation of generalization error under covariate shift Statistics & Decisions 23 4 249 279
21. M. Sugiyama H. Ogawa 2003 Active learning with model selection- simultaneous optimization of sample points and models for trigonometric polynomial models IEICE Transactions on Information and Systems E86-D 12 2753 2763
22. M. Sugiyama N. Rubens 2008 A batch ensemble approach to active learning with model selection Neural Networks 21 9 1287 1286
23. M. Sugiyama M. Krauledat K.-R. Müller 2007 Covariate shift adaptation by importance weighted cross validation Journal of Machine Learning Research 8 985 1005 (Pubitemid 46798411)
24. M. Sugiyama T. Suzuki S. Nakajima H. Kashima P. von Bünau M. Kawanabe 2008 Direct importance estimation for covariate shift adaptation Annals of the Institute of Statistical Mathematics 60 4 699 746
25. Sugiyama, M., Rubens, N., & Müller, K.-R. (2009). A conditional expectation approach to model selection and active learning under covariate shift. In J. Quiñonero-Candela, M. Sugiyama, A. Schwaighofer, & N. Lawrence (Eds.), Dataset shift in machine learning (pp. 107-130). Cambridge: MIT Press.
26. Vapnik, V. N. (1998). Statistical learning theory. New York: Wiley.
27. M. K. Warmuth J. Liao G. Rätsch M. Mathieson S. Putta C. Lemmen 2003 Active learning with SVMs in the drug discovery process Chemical Information and Computer Sciences 43 2 667 673
28. D. P. Wiens 2000 Robust weights and designs for biased regression models: Least squares and generalized M-estimation Journal of Statistical Planning and Inference 83 2 395 412