Importance-weighted least-squares probabilistic classifier for covariate shift adaptation with application to human activity recognition

Neurocomputing

Volumn 80, Issue , 2012, Pages 93-101

  Hachiya, Hirotaka ^a   Sugiyama, Masashi ^a   Ueda, Naonori ^b  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b Nippon Telegraph and Telephone Corporation   (Japan)

Author keywords

Covariate shift; Human activity recognition; Importance sampling; Probabilistic classifier; Semi supervised learning

Indexed keywords

COVARIATES; HUMAN ACTIVITY RECOGNITION; IMPORTANCE SAMPLING; PROBABILISTIC CLASSIFIERS; SEMI-SUPERVISED LEARNING;

ACCELEROMETERS;

SUPERVISED LEARNING;

ACCELEROMETRY; ARTICLE; CLASSIFIER; CONTROLLED STUDY; IMPORTANCE WEIGHTED LEAST SQUARE; INFORMATION PROCESSING; INTERMETHOD COMPARISON; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MOBILE PHONE; PHYSICAL ACTIVITY; PREDICTION; PRIORITY JOURNAL; PROBABILITY; RECOGNITION; TELEMEDICINE;

EID: 84855251060     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.09.016     Document Type: Article

References (37)

1. Bao L., Intille S.S. Activity recognition from user-annotated acceleration data. Proceedings of the Second IEEE International Conference on Pervasive Computing 2004, 1-17.
2. Bharatula N.B., Stager M., Lukowicz P., Troster G. Empirical study of design choices in multi-sensor context recognition systems. Proceedings of the Second International Forum on Applied Wearable Computing 2005, 79-93.
3. Blitzer J., Dredze M., Pereira F. Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics 2007, 440-447.
4. Blitzer J., McDonald R., Pereira F. Domain adaptation with structural correspondence learning. Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing 2006, 120-128.
5. O. Chapelle, B. Schölkopf, A. Zien, (Eds.), Semi-Supervised Learning, MIT Press, Cambridge, 2006.
6. Cortes C., Mansour Y., Mohri M. Learning bounds for importance weighting. Advances in Neural Information Processing Systems 2010, vol. 23:442-450.
7. ćwik J., Mielniczuk J. Estimating density ratio with application to discriminant analysis. Communications in Statistics: Theory and Methods 1989, 18(8):3057-3069.
8. Daume H. Frustratingly easy domain adaptation. Proceedings of the 45th International Annual Meeting of the Association of Computational Linguistics 2007, 256-263.
9. Daume H., Kumar A., Saha A. Co-regularization based semi-supervised domain adaptation. Advances in Neural Information Processing Systems 2010, vol. 23:256-263.
10. Gao C., Kong F., Tan J. Healthaware: tackling obesity with health aware smart phone systems. Proceedings of the 2009 IEEE International Conference on Robotics and Biometrics 2009, 1549-1554.
11. Hattori Y., Inoue S., Masaki T., Hirakawa G., Sudo O. Gathering large scale human activity information using mobile sensor devices. Proceedings of the Second International Workshop on Network Traffic Control, Analysis and Applications 2010, 708-713.
12. Huang J., Smola A., Gretton A., Borgwardt K.M., Schölkopf B. Correcting sample selection bias by unlabeled data. Advances in Neural Information Processing Systems 2007, vol. 19:601-608. MIT Press, Cambridge, MA, USA.
13. Kanamori T., Hido S., Sugiyama M. A least-squares approach to direct importance estimation. J. Mach. Learn. Res. 2009, 10(July):1391-1445.
14. T. Kanamori, T. Suzuki, M. Sugiyama, Statistical analysis of kernel-based least-squares density-ratio estimation, Mach. Learn., to appear.
15. T. Kanamori, T. Suzuki, M. Sugiyama, Computational complexity of kernel-based density-ratio estimation: a condition number analysis, Mach. Learn., submitted for publication.
16. Leijdekkers P., Gay V. A self-test to detect a heart attack using a mobile phone and wearable sensors. Proceedings of the 21st IEEE International Symposium on Computer-Based Medical Systems 2008, 93-98.
17. Pan S.J., Tsang I.W., Kwok J.T., Yang Q. Domain adaptation via transfer component analysis. IEEE Trans. Neural Networks 2011, 22(2):199-210.
18. Pan S.J., Yang Q. A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 2010, 22(10):1345-1359.
19. Qin J. Inferences for case-control and semiparametric two-sample density ratio models. Biometrika 1998, 85(3):619-639.
20. J. Quiñonero-Candela, M. Sugiyama, A. Schwaighofer, N. Lawrence, (Eds.), Dataset Shift in Machine Learning, MIT Press, Cambridge, MA, USA, 2009.
21. M. Schmidt. minfunc, 2005. 〈〉. http://www.cs.ubc.ca/~schmidtm/Software/minFunc.html.
22. Shimodaira H. Improving predictive inference under covariate shift by weighting the log-likelihood function. J. Stat. Plan. Inference 2000, 90(2):227-244.
23. Silverman B.W. Density ratios, empirical likelihood and cot death. J. R. Stat. Soc. Ser. C 1978, 27(1):26-33.
24. Stuntebeck E.P., Davis J.S., Abowd G.D., Blount M. Healthsense: classification of health-related sensor data through user-assisted machine learning. Proceedings of the Ninth Workshop on Mobile Computing Systems and Applications 2008, 1-5.
25. Sugiyama M. Superfast-trainable multi-class probabilistic classifier by least-squares posterior fitting. IEICE Trans. Inf. Syst. 2010, E93-D(August):2690-2701.
26. M. Sugiyama, M. Kawanabe, Machine Learning in Non-Stationary Environments: Introduction to Covariate Shift Adaptation, MIT Press, Cambridge, MA, USA, to appear.
27. Sugiyama M., Kawanabe M., Chui P.L. Dimensionality reduction for density ratio estimation in high-dimensional spaces. Neural Networks 2010, 23(1):44-59.
28. Sugiyama M., Krauledat M., Müller K.-R. Covariate shift adaptation by importance weighted cross validation. J. Mach. Learn. Res. 2007, 8(May):985-1005.
29. M. Sugiyama, T. Suzuki, T. Kanamori, Density Ratio Estimation in Machine Learning, Cambridge University Press, Cambridge, UK, to appear.
30. Sugiyama M., Suzuki T., Nakajima S., Kashima H., von Bünau P., Kawanabe M. Direct importance estimation for covariate shift adaptation. Ann. Inst. Stat. Math. 2008, 60(4):699-746.
31. Sugiyama M., Yamada M., von Bünau P., Suzuki T., Kanamori T., Kawanabe M. Direct density-ratio estimation with dimensionality reduction via least-squares hetero-distributional subspace search. Neural Networks 2011, 24(2):183-198.
32. M. Yamada, M. Sugiyama, Direct density-ratio estimation with dimensionality reduction via hetero-distributional subspace analysis, in: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, 2011, pp. 549-554.
33. Yamada M., Sugiyama M., Matsui T. Semi-supervised speaker identification under covariate shift. Signal Process. 2010, 90(8):2353-2361.
34. Yamada M., Sugiyama M., Wichern G., Simm J. Improving the accuracy of least-squares probabilistic classifiers. IEICE Trans. Inf. Syst. 2011, E94-D(6):1337-1340.
35. M. Yamada, T. Suzuki, T. Kanamori, H. Hachiya, M. Sugiyama, Relative Density-Ratio Estimation for Robust Distribution Comparison, Technical Report, arXiv, 2011.
36. Yamagishi K., Ito N., Kosuga H., Yasuda N., Isogami K., Kozuno N. A simplified measurement of farm worker's load using an accelerometer. J. Jpn. Soc. Agric. Technol. Manage. 2002, 9(2):127-132.
37. Zhang Y., Hu X., Fang Y. Logistic regression for transductive transfer learning from multiple sources. Proceedings of Advanced Data Mining and Applications 2010, 175-182.