Semi-supervised learning of class balance under class-prior change by distribution matching

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 1, Issue , 2012, Pages 823-830

  Du Plessis, Marthinus Christoffel ^a   Sugiyama, Masashi ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BIAS CORRECTION; DATA SETS; DISTRIBUTION MATCHING; ESTIMATION BIAS; LABELED DATA; RESAMPLING; SEMI-SUPERVISED LEARNING; TEST INPUTS; TRAINING DATASET;

CLASSIFICATION (OF INFORMATION); PROBABILITY DISTRIBUTIONS; SUPERVISED LEARNING;

STATISTICAL TESTS;

EID: 84867122342     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. Ali, S. M. and Silvey, S. D. A general class of coefficients of divergence of one distribution from another. Journal of the Royal Statistical Society, Series B, 28:131-142, 1966.
2. Basu, A., Harris, I. R., Hjort, N. L., and Jones, M. C. Robust and efficient estimation by minimising a density power divergence. Biometrika, 85(3):549-559, 1998.
3. Bishop, C. M. Pattern Recognition and Machine Learning. Springer, New York, NY, USA, 2006.
4. Boyd, S. and Vandenberghe, L. Convex Optimization. Cambridge University Press, New York, NY, USA, 2004.
5. Chan, Y. S. and Ng, H. T. Estimating class priors in domain adaptation for word sense disambiguation. In Proceedings of the 21st International Conference on Computational Linguistics, pp. 89-96, 2006.
6. Chapelle, O., Schölkopf, B., and Zien, A. (eds.). Semi-Supervised Learning. MIT Press, Cambridge, MA, USA, 2006.
7. Clémençon, S., Vayatis, N., and Depecker, M. AUC optimization and the two-sample problem. In Advances in Neural Information Processing Systems 22, pp. 360-368, 2009.
8. Cortes, C. and Mohri, M. AUC optimization vs. error rate minimization. In Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2004.
9. Csiszár, I. Information-type measures of difference of probability distributions and indirect observation. Studia Scientiarum Mathematicarum Hungarica, 2:229-318, 1967.
10. Dempster, A. P., Laird, N. M., and Rubin, D. B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, series B, 39(1):1-38, 1977.
11. Duarte, M. F. and Hu, Y. H. Vehicle classification in distributed sensor networks. Journal of Parallel and Distributed Computing, 64(7):826-838, 2004.
12. Elkan, C. The foundations of cost-sensitive learning. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, pp. 973-978, 2001.
13. Hastie, T., Tibshirani, R., and Friedman, J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York, NY, USA, 2001.
14. Heckman, J. J. Sample selection bias as a specification error. Econometrica, 47(1):153-161, 1979.
15. Kanamori, T., Hido, S., and Sugiyama, M. A least-squares approach to direct importance estimation. Journal of Machine Learning Research, 10:1391-1445, 2009a.
16. Kanamori, T., Suzuki, T., and Sugiyama, M. Condition number analysis of kernel-based density ratio estimation. Technical report, arXiv, 2009b.
17. Kanamori, T., Suzuki, T., and Sugiyama, M. Statistical analysis of kernel-based least-squares density-ratio estimation. Machine Learning, 2012.
18. Keziou, A. Dual representation of φ-divergences and applications. Comptes Rendus Mathématique, 336(10):857-862, 2003.
19. Kullback, S. and Leibler, R. A. On information and sufficiency. Annals of Mathematical Statistics, 22:79-86, 1951.
20. Latinne, P., Saerens, M., and Decaestecker, C. Adjusting the outputs of a classifier to new a priori probabilities may significantly improve classification accuracy: Evidence from a multi-class problem in remote sensing. In Proceedings of the 18th International Conference on Machine Learning, pp. 298-305, 2001.
21. Lin, Y., Lee, Y., and Wahba, G. Support vector machines for classification in nonstandard situations. Machine Learning, 46(1/3):191-202, 2002.
22. McLachlan, G. J. and Krishnan, T. The EM algorithm and extensions. Wiley series in probability and statistics: Applied probability and statistics. John Wiley, 1997.
23. Nguyen, X., Wainwright, M. J., and Jordan, M. I. Estimating divergence functionals and the likelihood ratio by convex risk minimization. IEEE Transactions on Information Theory, 56(11):5847-5861, 2010.
24. Pearson, K. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philosophical Magazine, 50:157-175, 1900.
25. Quiñonero-Candela, J., Sugiyama, M., Schwaighofer, A., and Lawrence, N. (eds.). Dataset Shift in Machine Learning. MIT Press, Cambridge, MA, USA, 2009.
26. Rifkin, R., Yeo, G., and Poggio, T. Regularized least-squares classification. Advances in Learning Theory: Methods, Model and Applications. NATO Science Series III: Computer and Systems Sciences, 190:131-153, 2003.
27. Rockafellar, R. T. Convex Analysis. Princeton University Press, Princeton, NJ, USA, 1970.
28. Saerens, M., Patrice, M., and Decaestecker, C. Adjusting the outputs of a classifier to new a priori probabilities: A simple procedure. Neural Computation, 14:21-41, 2001.
29. Schmidt, M. minFunc - Unconstrained differentiable multivariate optimization in MATLAB, 2005.
30. Silverman, B. W. Density Estimation: For Statistics and Data Analysis. Chapman and Hall, London, UK, 1986.
31. Sugiyama, M. Superfast-trainable multi-class probabilistic classifier by least-squares posterior fitting. IEICE Transactions on Information and Systems, E93-D:2690-2701, 2010.
32. Sugiyama, M. and Kawanabe, M. Machine Learning in Non-Stationary Environments: Introduction to Covariate Shift Adaptation. MIT Press, Cambridge, MA, USA, 2012.
33. Sugiyama, M., Suzuki, T., Nakajima, S., Kashima, H., von Bünau, P., and Kawanabe, M. Direct importance estimation for covariate shift adaptation. Annals of the Institute of Statistical Mathematics, 60(4):699-746, 2008.
34. Sugiyama, M., Suzuki, T., and Kanamori, T. Density ratio matching under the Bregman divergence: A unified framework of density ratio estimation. Annals of the Institute of Statistical Mathematics, 2012.
35. Vapnik, V. N. Statistical Learning Theory. Wiley, New York, NY, USA, 1998.