From action to activity: Sensor-based activity recognition

Neurocomputing

Volumn 181, Issue , 2016, Pages 108-115

  Liu, Ye ^a   Nie, Liqiang ^a   Liu, Li ^a   Rosenblum, David S ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Activity recognition; Discriminative feature extraction; Sensor generated data; Temporal pattern mining

Indexed keywords

ALGORITHMS; FEATURE EXTRACTION; MOTION ESTIMATION; PATTERN RECOGNITION;

ACTION RECOGNITION; ACTIVITY RECOGNITION; ACTIVITY REPRESENTATION; AUTOMATED RECOGNITION; DISCRIMINATIVE FEATURE EXTRACTION; MID-LEVEL FEATURES; TEMPORAL PATTERN; TEMPORAL PATTERN MININGS;

IMAGE RECOGNITION;

ACCURACY; ACTIVITY RECOGNITION; ALGORITHM; ARTICLE; AUTOMATION; CLASSIFICATION ALGORITHM; CONTROLLED STUDY; DISCRIMINATIVE FEATURE EXTRACTION; INTERMETHOD COMPARISON; MATHEMATICAL PARAMETERS; PRIORITY JOURNAL; RECOGNITION; SEMANTICS; SENSITIVITY ANALYSIS; SENSOR; SENSOR BASED ACTIVITY RECOGNITION; TEMPORAL PATTERN MINING; VISION;

EID: 84958833351     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.08.096     Document Type: Article

References (59)

1. Lara Ò.D., Labrador M.A. A survey on human activity recognition using wearable sensors. IEEE Commun. Surv. Tutor. 2013, 15(3):1192-1209.
2. Kwapisz J.R., Weiss G.M., Moore S.A. Activity recognition using cell phone accelerometers. ACM SIGKDD Explor. Newsl. 2011, 12(2):74-82.
3. Ward J.A., Lukowicz P., Troster G., Starner T.E. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(10):1553-1567.
4. T. Van Kasteren, A. Noulas, G. Englebienne, B. Kröse, Accurate activity recognition in a home setting, In: Proceedings of the International Conference on Ubiquitous Computing, ACM, New York, NY, USA, 2008, pp. 1-9.
5. Bulling A., Blanke U., Schiele B. A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput. Surv. 2014, 46(3):33:1-33:33.
6. J. Pansiot, D. Stoyanov, D. McIlwraith, B. Lo, G. Yang, Ambient and wearable sensor fusion for activity recognition in healthcare monitoring systems, In: Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks, Springer, RWTH Aachen Univ, Aachen, Germany, 2007, pp. 208-212.
7. X. Wang, D. Rosenblum, Y. Wang, Context-aware mobile music recommendation for daily activities, In: Proceedings of the ACM International Conference on Multimedia, ACM, New York, NY, USA, 2012, pp. 99-108.
8. E.M. Tapia, S.S. Intille, W. Haskell, K. Larson, J. Wright, A. King, R. Friedman, Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor, In: Proceedings of the IEEE International Symposium on Wearable Computers, IEEE, Washington, DC, USA, 2007, pp. 37-40.
9. N. Ravi, N. Dandekar, P. Mysore, M.L. Littman, Activity recognition from accelerometer data, In: Proceedings of the Conference on Innovative Applications of Artificial Intelligence, 2005, pp. 1541-1546.
10. L. Bao, S.S. Intille, Activity recognition from user-annotated acceleration data, In: Proceedings of Pervasive Computing, Springer, Linz/Vienna, Austria, 2004, pp. 1-17.
11. T. Gu, Z. Wu, X. Tao, H. K. Pung, J. Lu, epsicar: An emerging patterns based approach to sequential, interleaved and concurrent activity recognition, In: Proceedings of the IEEE International Conference on Pervasive Computing and Communications, IEEE, Washington, DC, USA, 2009, pp. 1-9.
12. J. Modayil, T. Bai, H. Kautz, Improving the recognition of interleaved activities, In: Proceedings of the International Conference on Ubiquitous Computing, ACM, New York, NY, USA, 2008, pp. 40-43.
13. Zhang Y., Zhang Y., Swears E., Larios N., Wang Z., Ji Q. Modeling temporal interactions with interval temporal Bayesian networks for complex activity recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35(10):2468-2483.
14. Y. Bangpeng, L. Fei-Fei, Grouplet: a structured image representation for recognizing human and object interactions, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, San Francisco, CA, 2010, pp. 9-16.
15. Q. Till, F. Vittorio, L. Bastian, L.V. Gool, Efficient mining of frequent and distinctive feature configurations, In: Proceedings of the IEEE International Conference on Computer Vision, IEEE, Rio de Janeiro, Brazil, 2007, pp. 1-8.
16. F. Höppner, Discovery of temporal patterns, In: Principles of Data Mining and Knowledge Discovery, Springer, Berlin, Heidelberg, 2001, pp. 192-203.
17. D. Patel, W. Hsu, M.L. Lee, Mining relationships among interval-based events for classification, In: Proceedings of the ACM SIGMOD International Conference on Management of Data, ACM, New York, NY, USA, 2008, pp. 393-404.
18. Wu S.-Y., Chen Y.-L. Mining nonambiguous temporal patterns for interval-based events. IEEE Trans. Knowl. Data Eng. 2007, 19(6):742-758.
19. D. Wyatt, M. Philipose, T. Choudhury, Unsupervised activity recognition using automatically mined common sense, In: Proceedings of the AAAI Conference on Artificial Intelligence, 2005, pp. 21-27.
20. Gu T., Wang L., Wu Z., Tao X., Lu J. A pattern mining approach to sensor-based human activity recognition. IEEE Trans. Knowl. Data Eng. 2011, 23(9):1359-1372.
21. Chen L., Hoey J., Nugent C.D., Cook D.J., Yu Z. Sensor-based activity recognition. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 2012, 42(6):790-808.
22. Ma Z., Yang Y., Nie F., Sebe N., Yan S., Hauptmann A. Harnessing lab knowledge for real-world action recognition. Int. J. Comput. Vis. 2014, 109(1-2):60-73.
23. B. Nicolas, Y. Yi, L. Zhenzhong, D. Betrand, F. Preteux, A. Hauptmann, Space-time robust video representation for action recognition, In: Proceedings of the IEEE International Conference on Computer Vision, IEEE, Sydney, NSW, Australia, 2013, pp. 2704-2711.
24. Aggarwal J., Michael S. Human activity analysis: a review. ACM Comput. Surv. 2011, 43(3):16:1-16:43.
25. Ke S.-R., Thuc H.L.U., Lee Y.-J., Hwang J.-N., Yoo J.-H., Choi K.-H. A review on video-based human activity recognition. Computers 2013, 2(2):88-131.
26. Turaga P., Chellappa R., Subrahmanian V.S., Udrea O. Machine recognition of human activities: a survey. IEEE Trans. Circuits Syst. Video Technol. 2008, 18(11):1473-1488.
27. T. Plötz, N.Y. Hammerla, P. Olivier, Feature learning for activity recognition in ubiquitous computing, In: Proceedings of the International Joint Conference on Artificial Intelligence, 2011, pp. 1729-1734.
28. X. Wang, Q. Ji, A hierarchical context model for event recognition in surveillance video, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Columbus, OH, USA, 2014, pp. 2561-2568.
29. Y. Liu, X. Zhang, J. Cui, C. Wu, H. Aghajan, H. Zha, Visual analysis of child-adult interactive behaviors in video sequences, In: Proceedings of the International Conference on Virtual Systems and Multimedia, IEEE, Seoul, South Korea, 2010, pp. 26-33.
30. Zhang L., Gao Y., Ji R., Xia Y., Dai Q., Li X. Actively learning human gaze shifting paths for semantics-aware photo cropping. IEEE Trans. Image Process. 2014, 23(5):2235-2245.
31. E. Swears, A. Hoogs, Q. Ji, K. Boyer, Complex activity recognition using Granger constrained DBN (GCDBN) in sports and surveillance video, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Washington, DC, USA, 2014, pp. 788-795.
32. Y.-W. Tai, S. Lin, Motion-aware noise filtering for deblurring of noisy and blurry images, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Washington, DC, USA, 2012, pp. 17-24.
33. L. Zhang, M. Song, Z. Liu, X. Liu, J. Bu, C. Chen, Probabilistic graphlet cut: exploiting spatial structure cue for weakly supervised image segmentation, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Portland, OR, USA, 2013, pp. 1908-1915.
34. Zhang L., Gao Y., Xia Y., Lu K., Shen J., Ji R. Representative discovery of structure cues for weakly-supervised image segmentation. IEEE Trans. Multimed. 2014, 16(2):470-479.
35. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, In: Proceedings of the IEEE International Conference on Computer Vision, IEEE, Beijing, China, 2005, pp. 1395-1402.
36. B.D. Lucas, T. Kanade, et al., An iterative image registration technique with an application to stereo vision, In: Proceedings of the International Joint Conference on Artificial Intelligence, 1981, pp. 674-679.
37. J. Shi, C. Tomasi, Good features to track, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Seattle, WA, USA, 1994, pp. 593-600.
38. D.G. Lowe, Object recognition from local scale-invariant features, In: Proceedings of the International Conference on Computer Vision, IEEE, Kerkyra, Greece, 1999, pp. 1150-1157.
39. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, San Diego, CA, USA, 2005, pp. 886-893.
40. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Anchorage, AK, USA, 2008, pp. 1-8.
41. M. Jain, H. Jégou, P. Bouthemy, Better exploiting motion for better action recognition, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Portland, OR, USA, 2013, pp. 2555-2562.
42. Veeraraghavan A., Roy-Chowdhury A.K., Chellappa R. Matching shape sequences in video with applications in human movement analysis. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27(12):1896-1909.
43. Ramanan D., Forsyth D.A., Zisserman A. Tracking people by learning their appearance. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(1):65-81.
44. Cui J., Liu Y., Xu Y., Zhao H., Zha H. Tracking generic human motion via fusion of low-and high-dimensional approaches. IEEE Trans. Syst. Man Cybern.: Syst. 2013, 43(4):996-1002.
45. Liu Ye, Cui Jinshi, Zhao Huijing, Zha Hongbin Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking. Proceedings of the 21st International Conference on Pattern Recognition 2012, 898-901. ICPR, Tsukuba, Japan.
46. Rabiner L.R. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 1989, 77(2):257-286.
47. K.P. Murphy, Dynamic Bayesian networks: representation, inference and learning (Ph.D. thesis), University of California, Berkeley, 2002.
48. Agarwal A., Triggs B. Recovering 3D human pose from monocular images. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(1):44-58.
49. Jain A.K., Duin R.P.W., Mao J. Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22(1):4-37.
50. R. Helaoui, D. Riboni, H. Stuckenschmidt, A probabilistic ontological framework for the recognition of multilevel human activities, In: Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, ACM, Zurich, Switzerland, 2013, pp. 345-354.
51. D.H. Hu, Q. Yang, Cigar: concurrent and interleaving goal and activity recognition, In: Proceedings of the AAAI Conference on Artificial Intelligence, 2008, pp. 1363-1368.
52. Yang Q., Wu K., Jiang Y. Learning action models from plan examples using weighted max-sat. Artif. Intell. 2007, 171(2):107-143.
53. Q. Yang, Activity recognition: linking low-level sensors to high-level intelligence, In: Proceedings of the International Joint Conference on Artificial Intelligence, 2009, pp. 20-25.
54. H.H. Zhuo, D.H. Hu, C. Hogg, Q. Yang, H. Munoz-Avila, Learning HTN method preconditions and action models from partial observations, In: Proceedings of the International Joint Conference on Artificial Intelligence, 2009, pp. 1804-1810.
55. A. Gabaldon, Activity recognition with intended actions, In: Proceedings of the International Joint Conference on Artificial Intelligence, 2009, pp. 1696-1701.
56. Liu Ye, Nie Liqiang, Han Lei, Zhang Luming, Rosenblum David S. Action2Activity: Recognizing Complex Activities from Sensor Data. Proceedings of the 24th International Conference on Artificial Intelligence, series = IJCAI'15 2015, 1617-1623. publisher = AAAI Press, Buenos Aires, Argentina.
57. R. Agrawal, R. Srikant, Fast algorithms for mining association rules in large databases, In: Proceedings of the International Conference on Very Large Data Bases, 1994, pp. 487-499.
58. Allen J.F. Maintaining knowledge about temporal intervals. Commun. ACM 1983, 26(11):832-843.
59. Ricardo C., Hesam S., Alberto C., Sundaratejaswi D., Gerhard T., José R.M., del Daniel R. The opportunity challenge: a benchmark database for on-body sensor-based activity recognition. Pattern Recognit. Lett. 2013, 34(15):2033-2042.