Large-scale personalized human activity recognition using online multitask learning

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 11, 2013, Pages 2551-2563

  Sun, Xu ^a   Kashima, Hisashi ^b   Ueda, Naonori ^c  

^a PEKING UNIVERSITY   (China)

^b UNIVERSITY OF TOKYO   (Japan)

^c NTT Communication Science Laboratories   (Japan)

Author keywords

conditional random fields; data mining; human activity recognition; Multitask learning; online learning

Indexed keywords

ACTIVITY PATTERNS; ACTIVITY RECOGNITION; CONDITIONAL RANDOM FIELD; CONVERGENCE ANALYSIS; CONVERGENCE PROPERTIES; HUMAN ACTIVITY RECOGNITION; MULTITASK LEARNING; ONLINE LEARNING;

DATA MINING; PATTERN RECOGNITION;

E-LEARNING;

EID: 84884810331     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.246     Document Type: Article

References (37)

1. L. Bao and S.S. Intille, "Activity Recognition from User-Annotated Acceleration Data," Proc. Int'l Conf. Pervasive Computing, pp. 1-17, 2004.
2. J. Präkkä , M. Ermes, P. Korpipää, J. Mäntyjärvi, J. Peltola, and I. Korhonen, "Activity Classification Using Realistic Data from Wearable Sensors," IEEE Trans. Information Technology in Biomedicine, vol. 10, no. 1, pp. 119-128, Jan. 2006. (Pubitemid 43092325)
3. N. Ravi, N. Dandekar, P. Mysore, and M.L. Littman, "Activity Recognition from Accelerometer Data," Proc. Conf. Innovative Applications of Artificial Intelligence (IAAI '05), pp. 1541-1546, 2005. (Pubitemid 43006650)
4. T. Huynh, M. Fritz, and B. Schiele, "Discovery of Activity Patterns Using Topic Models," Proc. 10th Int'l Conf. Ubiquitous Computing, pp. 10-19, 2008.
5. X. Sun, H. Kashima, R. Tomioka, N. Ueda, and P. Li, "A New Multi-Task Learning Method for Personalized Activity Recognition," Proc. IEEE Int'l Conf. Data Mining (ICDM '11), 2011.
6. X. Sun, H. Kashima, T. Matsuzaki, and N. Ueda, "Averaged Stochastic Gradient Descent with Feedback: An Accurate, Robust, and Fast Training Method," Proc. IEEE 10th Int'l Conf. Data Mining (ICDM '10), pp. 1067-1072, 2010.
7. J. Yin, D. Shen, Q. Yang, and Z.-N. Li, "Activity Recognition through Goal-Based Segmentation," Proc. Nat'l Conf. Artificial Intelligence (AAAI '05), M.M. Veloso and S. Kambhampati, eds., pp. 28-34, 2005.
8. J. Yin, Q. Yang, and J. Pan, "Sensor-Based Abnormal Human-Activity Detection," IEEE Trans. Knowledge Data Eng., vol. 20, no. 8, pp. 1082-1090, Aug. 2008.
9. M.R. Hodges, M.W. Newman, and M.E. Pollack, "Object-Use Activity Monitoring: Feasibility for People with Cognitive Impairments," Proc. AAAI Spring Symp.: Human Behavior Modeling, pp. 13-18, 2009.
10. J. Baxter, "A Model of Inductive Bias Learning," CoRR, vol. abs/1106.0245, informal publication, 2011.
11. R. Caruana, "Multitask Learning," Machine Learning, vol. 28, no. 1, pp. 41-75, 1997. (Pubitemid 127507169)
12. H. Daumé III, "Frustratingly Easy Domain Adaptation," Proc. 45th Ann. Meeting of the Assoc. of Computational Linguistics, pp. 256-263, June 2007.
13. K. Yu, V. Tresp, and A. Schwaighofer, "Learning Gaussian Processes from Multiple Tasks," Proc. Int'l Conf. Machine Learning (ICML '05), L.D. Raedt and S. Wrobel, eds., vol. 119, pp. 1012-1019, 2005.
14. J. Zhang, Z. Ghahramani, and Y. Yang, "Learning Multiple Related Tasks Using Latent Independent Component Analysis," Proc. Neural Information Processing System (NIPS '05), 2005.
15. N.D. Lawrence and J.C. Platt, "Learning to Learn with the Informative Vector Machine," Proc. Int'l Conf. Machine Learning (ICML '04), C.E. Brodley, ed., vol. 69, 2004.
16. R.K. Ando and T. Zhang, "A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data," J. Machine Learning Research, vol. 6, pp. 1817-1853, 2005.
17. H. Yang, I. King, and M.R. Lyu, "Online Learning for Multi-Task Feature Selection," Proc. ACM Int'l Conf. Information and Knowledge Management, pp. 1693-1696, 2010.
18. Y. Zhang and D.-Y. Yeung, "A Convex Formulation for Learning Task Relationships in Multi-Task Learning," Proc. Conf. Uncertainty in Artificial Intelligence (UAI '10), pp. 733-742, 2010.
19. A. Argyriou, C.A. Micchelli, M. Pontil, and Y. Ying, "A Spectral Regularization Framework for Multi-Task Structure Learning," Proc. Neural Information Processing System (NIPS '07), 2007.
20. Y. Xue, D. Dunson, and L. Carin, "The Matrix Stick-Breaking Process for Flexible Multi-Task Learning," Proc. 24th Int'l Conf. Machine Learning (ICML '07), pp. 1063-1070, 2007.
21. O. Dekel, P.M. Long, and Y. Singer, "Online Multitask Learning," Proc. 19th Ann. Conf. Learning Theory (COLT), G. Lugosi and H.-U. Simon, eds., pp. 453-467, 2006. (Pubitemid 44072212)
22. J. Abernethy, P. Bartlett, and A. Rakhlin, "Multitask Learning with Expert Advice," Proc. Ann. Conf. Learning Theory (COLT), N.H. Bshouty and C. Gentile, eds., pp. 484-498, 2007.
23. A. Agarwal, A. Rakhlin, and P. Bartlett, "Matrix Regularization Techniques for Online Multitask Learning," Technical Report UCB/EECS-2008-138, EECS Dept., Univ. of California, Berkeley, Oct. 2008.
24. T. Evgeniou, C.A. Micchelli, and M. Pontil, "Learning Multiple Tasks with Kernel Methods," J. Machine Learning Research, vol. 6, pp. 615-637, 2005.
25. P. Rai and H.D. Daumé III, "Infinite Predictor Subspace Models for Multitask Learning," J. Machine Learning Research, vol. 9, pp. 613-620, 2010.
26. G. Cavallanti, N. Cesa-Bianchi, and C. Gentile, "Linear Algorithms for Online Multitask Classification," Proc. Ann. Conf. Learning Theory (COLT), R.A. Servedio and T. Zhang, eds., pp. 251-262, 2008.
27. J. Lafferty, A. McCallum, and F. Pereira, "Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data," Proc. 18th Int'l Conf. Machine Learning (ICML '01), pp. 282-289, 2001.
28. F. Sha and F. Pereira, "Shallow Parsing with Conditional Random Fields," NAACL '03: Proc. Conf. North Am. Chapter of the Assoc. for Computational Linguistics on Human Language Technology, pp. 134-141, 2003.
29. J. Nocedal and S.J. Wright, Numerical Optimization. Springer, 1999.
30. L. Bottou, "Online Algorithms and Stochastic Approximations," Online Learning and Neural Networks, D. Saad, ed., Cambridge Univ. Press, 1998.
31. J.C. Spall, Introduction to Stochastic Search and Optimization. Wiley-IEEE, 2005.
32. M. Collins, A. Globerson, T. Koo, X. Carreras, and P.L. Bartlett, "Exponentiated Gradient Algorithms for Conditional Random Fields and Max-Margin Markov Networks," J. Machine Learning Research, vol. 9, pp. 1775-1822, 2008.
33. L. Bottou, "Stochastic Learning," Advanced Lectures on Machine Learning, pp. 146-168, Springer, 2004. (Pubitemid 39741631)
34. Y. Hattori, M. Takemori, S. Inoue, G. Hirakawa, and O. Sudo, "Operation and Baseline Assessment of Large Scale Activity Gathering System by Mobile Device," Proc. DICOMO Workshop, 2010.
35. M. Collins, "Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms," Proc. Conf. Empirical Methods in Natural Language Processing (EMNLP '02), pp. 1-8, 2002.
36. T. Joachims, T. Finley, and C.-N. Yu, "Cutting-Plane Training of Structural SVMs," Machine Learning, vol. 77, no. 1, pp. 27-59, 2009.
37. M.J.F. Gales, "Maximum Likelihood Linear Transformations for HMM-Based Speech Recognition," Computer Speech and Language, vol. 12, no. 2, pp. 75-98, 1998. (Pubitemid 128383747)