Sensor-based human activity recognition system with a multilayered model using time series shapelets

Knowledge-Based Systems

Volumn 90, Issue , 2015, Pages 138-152

  Liu, Li ^a,b   Peng, Yuxin ^b   Liu, Ming ^c   Huang, Zigang ^d  

^a CHONGQING UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c SOUTHWEST UNIVERSITY   (China)

^d AZ 85281   (United States)

Author keywords

Complex activity; Human activity recognition; Multilayer; Sensor; Time series

Indexed keywords

BASKETBALL; DATA HANDLING; ENERGY EFFICIENCY; MULTILAYERS; SENSORS; TIME SERIES;

ACTIVITY MODELING; ACTIVITY RECOGNITION; COMPLEX ACTIVITY; DAILY LIVING ACTIVITIES; DATA-DRIVEN APPROACH; HUMAN ACTIVITY RECOGNITION; HUMAN ACTIVITY RECOGNITION SYSTEMS; UBIQUITOUS APPLICATION;

PATTERN RECOGNITION;

EID: 84946708846     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2015.09.024     Document Type: Article

References (77)

1. O. Lara, and M. Labrador A survey on human activity recognition using wearable sensors IEEE Commun. Surv. Tutor. 15 3 2013 1192 1209
2. T. Van Kasteren, A. Noulas, G. Englebienne, and B. Kröse Accurate activity recognition in a home setting Proceedings of the 10th International Conference on Ubiquitous Computing 2008 ACM 1 9
3. A. Fleury, M. Vacher, and N. Noury SVM-based multimodal classification of activities of daily living in health smart homes: sensors, algorithms, and first experimental results IEEE Trans. Informat. Technol. Biomed., 14 2 2010 274 283
4. L. Chen, C.D. Nugent, and H. Wang A knowledge-driven approach to activity recognition in smart homes IEEE Trans. Knowl. Data Eng., 24 6 2012 961 974
5. D. Sanchez, M. Tentori, and J. Favela Activity recognition for the smart hospital IEEE Intell. Syst., 23 2 2008 50 57
6. M. Tentori, and J. Favela Activity-aware computing for healthcare IEEE Pervasive Comput., 7 2 2008 51 57
7. J. Lester, T. Choudhury, and G. Borriello A practical approach to recognizing physical activities Pervasive Computing 2006 Springer 1 16
8. P. Kan, R. Huq, J. Hoey, R. Goetschalckx, and A. Mihailidis The development of an adaptive upper-limb stroke rehabilitation robotic system J. Neuroeng. Rehabil., 8 1 2011 1 18
9. M. Ermes, J. Parkka, J. Mantyjarvi, and I. Korhonen Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions IEEE Trans. Inform. Technol. Biomed., 12 1 2008 20 26
10. K. Altun, and B. Barshan Human activity recognition using inertial/magnetic sensor units Human Behavior Understanding 2010 Springer 38 51
11. A.M. Khan, Y.-K. Lee, S.Y. Lee, and T.-S. Kim A triaxial accelerometer-based physical-activity recognition via augmented-signal features and a hierarchical recognizer IEEE Trans. Informat. Technol. Biomed., 14 5 2010 1166 1172
12. J. Yin, Q. Yang, and J.J. Pan Sensor-based abnormal human-activity detection IEEE Trans. Knowl Data Eng., 20 8 2008 1082 1090
13. N.D. Lane, M. Mohammod, M. Lin, X. Yang, H. Lu, S. Ali, A. Doryab, E. Berke, T. Choudhury, and A. Campbell Bewell: a smartphone application to monitor, model and promote wellbeing Proceedings of the 5th International ICST Conference on Pervasive Computing Technologies for Healthcare 2011 Citeseer 23 26
14. O.D. Incel, M. Kose, and C. Ersoy A review and taxonomy of activity recognition on mobile phones BioNanoScience 3 2 2013 145 171
15. L. Chen, J. Hoey, C.D. Nugent, D.J. Cook, and Z. Yu Sensor-based activity recognition IEEE Trans. Syst., Man, Cybern., Part C: Appl. Rev., 42 6 2012 790 808
16. D. Abowd, A.K. Dey, R. Orr, and J. Brotherton Context-awareness in wearable and ubiquitous computing Virtual Real. 3 3 1998 200 211
17. A. Bulling, U. Blanke, and B. Schiele A tutorial on human activity recognition using body-worn inertial sensors ACM Comput. Surv. (CSUR) 46 3 2014 33
18. E. Kim, S. Helal, and D. Cook Human activity recognition and pattern discovery IEEE Pervasive Comput., 9 1 2010 48 53
19. D.J. Patterson, D. Fox, H. Kautz, and M. Philipose Fine-grained activity recognition by aggregating abstract object usage Proceedings of the Ninth IEEE International Symposium on Wearable Computers, 2005 2005 IEEE 44 51
20. N.T. Nguyen, D.Q. Phung, S. Venkatesh, and H. Bui Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005 2 2005 IEEE 955 960
21. D. Wyatt, M. Philipose, and T. Choudhury Unsupervised activity recognition using automatically mined common sense Proceedings of the AAAI 5 2005 21 27
22. J.A. Ward, P. Lukowicz, G. Troster, and T.E. Starner Activity recognition of assembly tasks using body-worn microphones and accelerometers IEEE Trans. Pattern Anal. Mach. Intell., 28 10 2006 1553 1567
23. P. Natarajan, and R. Nevatia Coupled hidden semi Markov models for activity recognition Proceedings of the IEEE Workshop on Motion and Video Computing, 2007. WMVC'07. 2007 IEEE 10 17
24. J. Modayil, T. Bai, and H. Kautz Improving the recognition of interleaved activities Proceedings of the 10th international conference on Ubiquitous computing 2008 ACM 40 43
25. T. Duong, D. Phung, H. Bui, and S. Venkatesh Efficient duration and hierarchical modeling for human activity recognition Artif. Intell. 173 7 2009 830 856
26. D.L. Vail, M.M. Veloso, and J.D. Lafferty Conditional random fields for activity recognition Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems 2007 ACM 1331 1338
27. D. Hao Hu, S.J. Pan, V.W. Zheng, N.N. Liu, and Q. Yang Real world activity recognition with multiple goals Proceedings of the 10th International Conference on Ubiquitous Computing 2008 ACM 30 39
28. D.H. Hu, and Q. Yang Cigar: Concurrent and interleaving goal and activity recognition. Proceedings of the AAAI 8 2008 1363 1368
29. S. Gong, and T. Xiang Recognition of group activities using dynamic probabilistic networks Proceedings. Ninth IEEE International Conference on Computer Vision, 2003. 2003 IEEE 742 749
30. Y. Du, F. Chen, W. Xu, and Y. Li Recognizing interaction activities using dynamic Bayesian network Proceedings of the 18th International Conference on Pattern Recognition, 2006. ICPR 2006. 1 2006 IEEE 618 621
31. T. Van Kasteren, and B. Krose Bayesian activity recognition in residence for elders Proceedings of the 3rd IET International Conference on Intelligent Environments Intelligent Environments, 2007. IE 2007. 2007 IET 209 212
32. M. Schneider Plan recognition in instrumented environments. Proceedings of the 5th International Conference on Intelligent Environments 2009 2009 IOS 295 302
33. Y. Zhang, E. Swears, N. Larios, Z. Wang, and Q. Ji Modeling temporal interactions with interval temporal Bayesian networks for complex activity recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35 10 2013 2468 2483
34. T. Gu, Z. Wu, X. Tao, H.K. Pung, and J. Lu epSICAR: an emerging patterns based approach to sequential, interleaved and concurrent activity recognition Proceedings of the IEEE International Conference on Pervasive Computing and Communications, 2009. PerCom 2009 2009 IEEE 1 9
35. T. Gu, L. Wang, Z. Wu, X. Tao, and J. Lu A pattern mining approach to sensor-based human activity recognition IEEE Trans. Knowl. Data Eng., 23 9 2011 1359 1372
36. J. Ye, G. Stevenson, and S. Dobson Usmart: an unsupervised semantic mining activity recognition technique ACM Trans. Interact. Intell. Syst. (TiiS) 4 4 2014 16
37. K. Li, and Y. Fu Prediction of human activity by discovering temporal sequence patterns IEEE Trans. Pattern Anal. Mach. Intell., 36 8 2014 1644 1657
38. U. Blanke, and B. Schiele Remember and transfer what you have learned-recognizing composite activities based on activity spotting Proceedings of the International Symposium on Wearable Computers (ISWC), 2010 2010 IEEE 1 8
39. R. Helaoui, D. Riboni, and H. Stuckenschmidt A probabilistic ontological framework for the recognition of multilevel human activities Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing 2013 ACM 345 354
40. Z. Wang, S. Wang, and Q. Ji Capturing complex spatio-temporal relations among facial muscles for facial expression recognition Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013 2013 IEEE 3422 3429
41. C. Gan, M. Lin, Y. Yang, Y. Zhuang, and A. G Hauptmann Exploring semantic inter-class relationships (sir) for zero-shot action recognition Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence 2015 AAAI 3769 3775
42. L. Ye, and E. Keogh Time series shapelets: a novel technique that allows accurate, interpretable and fast classification Data Min. Knowl. Discov. 22 1-2 2011 149 182
43. A. Mueen, E. Keogh, and N. Young Logical-shapelets: an expressive primitive for time series classification Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2011 ACM 1154 1162
44. L. Ye, and E. Keogh Time series shapelets: a new primitive for data mining Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2009 ACM 947 956
45. J. Aggarwal, and M.S. Ryoo Human activity analysis: A review ACM Comput. Surv. (CSUR) 43 3 2011 16
46. N. Vaswani, A.R. Chowdhury, and R. Chellappa Activity recognition using the dynamics of the configuration of interacting objects Proceedings. 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. 2 2003 IEEE II 633
47. A. Veeraraghavan, A.R. Chowdhury, and R. Chellappa Role of shape and kinematics in human movement analysis Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. 1 2004 IEEE I 730
48. N. Johnson, and D. Hogg Learning the distribution of object trajectories for event recognition Image Vis. Comput. 14 8 1996 609 615
49. L.W. Campbell, and A.F. Bobick Recognition of human body motion using phase space constraints Proceedings of Fifth International Conference on Computer Vision, 1995 1995 IEEE 624 630
50. C. Rao, A. Yilmaz, and M. Shah View-invariant representation and recognition of actions Int. J. Comput. Vis. 50 2 2002 203 226
51. A. Mohamed F, R.-C. Amit K, C. Rama, and A. Umut Activity representation using 3d shape models EURASIP J. Image Video Process. 2008 5 2008
52. D. Roggen, K. Förster, A. Calatroni, T. Holleczek, Y. Fang, G. Tröster, P. Lukowicz, G. Pirkl, D. Bannach, K. Kunze, and et al. Opportunity: Towards opportunistic activity and context recognition systems Proceedings of the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks & Workshops, 2009. WoWMoM 2009. 2009 IEEE 1 6
53. P. Lukowicz, G. Pirkl, D. Bannach, F. Wagner, A. Calatroni, K. Förster, T. Holleczek, M. Rossi, D. Roggen, G. Tröster, J. Doppler, C. Holzmann, A. Riener, A. Ferscha, and R. Chavarriaga Recording a complex, multi modal activity data set for context recognition Proceedings of the International Conference on Architecture of Computing Systems 2010 VDE 1 6
54. B. Logan, J. Healey, M. Philipose, E.M. Tapia, and S. Intille A long-term evaluation of sensing modalities for activity recognition UbiComp 2007: Ubiquitous Computing 2007 Springer 483 500
55. R. Helaoui, M. Niepert, and H. Stuckenschmidt Recognizing interleaved and concurrent activities: a statistical-relational approach Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom), 2011 2011 IEEE 1 9
56. J. Ye, G. Stevenson, and S. Dobson Kcar: A knowledge-driven approach for concurrent activity recognition Pervasive Mobile Comput. 19 2015 47 70
57. P. Natarajan, and R. Nevatia Hierarchical multi-channel hidden semi-Markov graphical models for activity recognition Comput. Vis. Image Underst. 117 10 2013 1329 1344
58. H.-T. Cheng Learning and Recognizing The Hierarchical and Sequential Structure of Human Activities 2013 Carnegie Mellon University (Ph.D. thesis)
59. T. Springer, and A.-Y. Turhan Employing description logics in ambient intelligence for modeling and reasoning about complex situations J. Ambient Intell. Smart Environ. 1 3 2009 235 259
60. J. Lester, T. Choudhury, N. Kern, G. Borriello, and B. Hannaford A hybrid discriminative/generative approach for modeling human activities. Proceedings of the IJCAI 5 2005 766 772
61. D. Riboni, L. Pareschi, L. Radaelli, and C. Bettini Is ontology-based activity recognition really effective? Proceedings of the IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops), 2011 2011 IEEE 427 431
62. S. Saguna, A. Zaslavsky, and D. Chakraborty Complex activity recognition using context-driven activity theory and activity signatures ACM Trans. Comput.-Hum. Interact. (TOCHI) 20 6 2013 32
63. Z. Xing, J. Pei, S.Y. Philip, and K. Wang Extracting interpretable features for early classification on time series. Proceedings of the 2011 SIAM International Conference on Data Mining (SDM) 11 2011 SIAM 247 258
64. H. Ding, G. Trajcevski, P. Scheuermann, X. Wang, and E. Keogh Querying and mining of time series data: experimental comparison of representations and distance measures Proceedings of the VLDB Endowment 1 2 2008 1542 1552
65. L. Lamport The temporal logic of actions ACM Trans. Program. Languages Syst. (TOPLAS) 16 3 1994 872 923
66. A. Pnueli The temporal logic of programs Proceedings of the 18th Annual Symposium on Foundations of Computer Science, 1977. 1977 IEEE 46 57
67. T. Rakthanmanon, and E. Keogh Fast shapelets: A scalable algorithm for discovering time series shapelets Proceedings of the thirteenth SIAM conference on data mining (SDM) 2013 SIAM 668 676
68. J.R. Kwapisz, G.M. Weiss, and S.A. Moore Activity recognition using cell phone accelerometers ACM SIGKDD Explor. Newsl. 12 2 2011 74 82
69. B. Gavilanes-Miranda, G.A. Garcia, J. Juan, and G. De Gandarias Walking and Jogging: Quantification of Muscle Activity of the Lower Extremities 2011 INTECH Open Access Publisher
70. P. Esling, and C. Agon Time-series data mining ACM Comput. Surv. (CSUR) 45 1 2012 12
71. J. Lines, L.M. Davis, J. Hills, and A. Bagnall A shapelet transform for time series classification Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2012 ACM 289 297
72. Q. He, Z. Dong, F. Zhuang, T. Shang, and Z. Shi Fast time series classification based on infrequent shapelets Proceedings of the 11th International Conference on Machine Learning and Applications (ICMLA), 2012 1 2012 IEEE 215 219
73. M.S. Cetin, A. Mueen, and V.D. Calhoun Shapelet ensemble for multi-dimensional time series Proceedings of the 2015 SIAM International Conference on Data Mining (SDM) 2015 SIAM 307 315
74. K. Altun, B. Barshan, and O. Tunçel Comparative study on classifying human activities with miniature inertial and magnetic sensors Pattern Recogn. 43 10 2010 3605 3620
75. B. Barshan, and M.C. Yüksek Recognizing daily and sports activities in two open source machine learning environments using body-worn sensor units Comput. J. 57 11 2014 1649 1667
76. J. Hills, J. Lines, E. Baranauskas, J. Mapp, and A. Bagnall Classification of time series by shapelet transformation Data Min. Knowl. Discov. 28 4 2014 851 881
77. K.-L. Skillen, C. Nugent, M. Donnelly, L. Chen, and W. Burns Using Ontologies for Managing User Profiles in Personalised Mobile Service Delivery 2015 Springer