Active learning with model selection in linear regression

Society for Industrial and Applied Mathematics - 8th SIAM International Conference on Data Mining 2008, Proceedings in Applied Mathematics 130

Volumn 2, Issue , 2008, Pages 518-529

  Sugiyama, Masashi ^a   Rubens, Neil ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; ITERATIVE METHODS; NUMERICAL METHODS;

ACTIVE LEARNING; BEST MODEL; GENERALIZATION PERFORMANCE; MODEL SELECTION; NEW APPROACHES; NUMERICAL EXPERIMENTS; SEQUENTIAL MANNERS;

LEARNING SYSTEMS;

EID: 52649095948     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972788.47     Document Type: Conference Paper

References (22)

1. H. Akaike. A new look at the statistical model identification. IEEE Transactions on Automatic Control, AC-19(6):716-723, 1974.
2. F. Bach. Active learning for misspecified generalized linear models. In B. Schölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19. MIT Press, Cambridge, MA, 2007.
3. D. A. Cohn, Z. Ghahramani, and M. I. Jordan. Active learning with statistical models. Journal of Artificial Intelligence Research, 4:129-145, 1996.
4. P. Craven and G. Wahba. Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation. Numerische Mathematik, 31:377-403, 1979.
5. V. V. Fedorov. Theory of Optimal Experiments. Academic Press, New York, 1972.
6. K. Fukumizu. Statistical active learning in multilayer perceptrons. IEEE Transactions on Neural Networks, 11(1):17-26, 2000.
7. R. E. Henkel. Tests of Significance. SAGE Publication, Beverly Hills, 1979.
8. J. Huang, A. Smola, A. Gretton, K. M. Borgwardt, and B. Schölkopf. Correcting sample selection bias by unlabeled data. In B. Schölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19, pages 601-608. MIT Press, Cambridge, MA, 2007.
9. T. Kanamori and H. Shimodaira. Active learning algorithm using the maximum weighted log-likelihood estimator. Journal of Statistical Planning and Inference, 116(1):149-162, 2003.
10. D. J. C. MacKay. Bayesian interpolation. Neural Computation, 4(3):415-447, 1992.
11. D. J. C. MacKay. Information-based objective functions for active data selection. Neural Computation, 4(4):590-604, 1992.
12. C. R. Rao. Linear Statistical Inference and Its Applications. Wiley, New York, 1965.
13. C. E. Rasmussen, R. M. Neal, G. E. Hinton, D. van Camp, M. Revow, Z. Ghahramani, R. Kustra, and R. Tibshirani. The DELVE manual, 1996.
14. J. Rissanen. Modeling by shortest data description. Automatica, 14(5):465-471, 1978.
15. G. Schwarz. Estimating the dimension of a model. The Annals of Statistics, 6:461-464, 1978.
16. H. Shimodaira. Improving predictive inference under covariate shift by weighting the log-likelihood function. Journal of Statistical Planning and Inference, 90(2):227-244, 2000.
17. M. Sugiyama. Active learning in approximately linear regression based on conditional expectation of generalization error. Journal of Machine Learning Research, 7:141-166, Jan. 2006.
18. M. Sugiyama, M. Krauledat, and K.-R. Müller. Covariate shift adaptation by importance weighted cross validation. Journal of Machine Learning Research, 8:985-1005, May 2007.
19. M. Sugiyama and K.-R. Müller. Input-dependent estimation of generalization error under covariate shift. Statistics & Decisions, 23(4):249-279, 2005.
20. M. Sugiyama and H. Ogawa. Active learning with model selection- Simultaneous optimization of sample points and models for trigonometric polynomial models. IEICE Transactions on Information and Systems, E86-D( 12):2753-2763, 2003.
21. D. P. Wiens. Robust weights and designs for biased regression models: Least squares and generalized M-estimation. Journal of Statistical Planning and Inference, 83(2):395-412, 2000.
22. B. Zadrozny. Learning and evaluating classifiers under sample selection bias. In Proceedings of the Twenty-First International Conference on Machine Learning, New York, NY, 2004. ACM Press.