Similar gait action recognition using an inertial sensor

Pattern Recognition

Volumn 48, Issue 4, 2015, Pages 1289-1301

  Ngo, Trung Thanh ^a   Makihara, Yasushi ^b   Nagahara, Hajime ^a   Mukaigawa, Yasuhiro ^c   Yagi, Yasushi ^b  

^a KYUSHU UNIVERSITY   (Japan)

^b OSAKA UNIVERSITY   (Japan)

^c NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Gait action recognition; Heel strike detection; Inertial sensor; Interclass relationship; Sensor orientation robustness

Indexed keywords

INERTIAL NAVIGATION SYSTEMS; STAIRS;

GAIT ACTION; HEEL STRIKES; INERTIAL SENSOR; INTER CLASS; SENSOR ORIENTATION;

PATTERN RECOGNITION;

EID: 84920669699     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.10.012     Document Type: Article

References (59)

1. R. Raya, E. Rocon, J.A. Gallego, R. Ceres, J.L. Pons, A robust kalman algorithm to facilitate human-computer interaction for people with cerebral palsy, using a new interface based on inertial sensors, Sensors 12 (3) (2012) 3049-3067.
2. T.T. Ngo, Y. Makihara, H. Nagahara, R. Sagawa, Y. Mukaigawa, Y. Yagi, Phase registration in a gallery improving gait authentication, in: Proceedings of the International Joint Conference on Biometrics, 2011, pp. 1-7.
3. J. Paefgen, F. Kehr, Y. Zhai, F. Michahelles, Driving behavior analysis with smartphones: insights from a controlled field study, in: Proceedings of the Eleventh International Conference on Mobile and Ubiquitous Multimedia, MUM '12, ACM, New York, NY, USA, 2012, pp. 36:1-36:8.
4. N. Noury, A. Fleury, P. Rumeau, A. Bourke, G. Laighin, V. Rialle, J. Lundy, Fall detection - principles and methods, in: Engineering in Medicine and Biology Society, 2007. EMBS 2007. Twenty-ninth Annual International Conference of the IEEE, 2007, pp. 1663-1666.
5. C. Cifuentes, A. Braidot, L. Rodriguez, M. Frisoli, A. Santiago, A. Frizera, Development of a wearable ZigBee sensor system for upper limb rehabilitation robotics, in: Fourth IEEE RAS EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), 2012, 2012, pp. 1989-1994.
6. L. Cheng, S. Hailes, Analysis of wireless inertial sensing for athlete coaching support, in: Global Telecommunications Conference, 2008. IEEE GLOBECOM 2008. IEEE, 2008, pp. 1-5.
7. S. Zhang, M. Ang, W. Xiao, C. Tham, Detection of activities for daily life surveillance: Eating and drinking, in: Tenth International Conference on e-health Networking, Applications and Services, 2008. HealthCom 2008, 2008, pp. 171-176.
8. S. Preece, J. Goulermas, L. Kenney, D. Howard, A comparison of feature extraction methods for the classification of dynamic activities from accelerometer data, IEEE Trans. Biomed. Eng. 56 (3) (2009) 871-879.
9. S.J. Preece, J.Y. Goulermas, L.P.J. Kenney, D. Howard, K. Meijer, R. Crompton, Activity identification using body-mounted sensors-a review of classification techniques, Physiol. Meas. 30 (4) (2009) R1.
10. A. Avci, S. Bosch, M. Marin-Perianu, R. Marin-Perianu, P.J.M. Havinga, Activity recognition using inertial sensing for healthcare, wellbeing and sports applications: a survey, in: International Conference on Architecture of Computing Systems, Workshop Proceedings, 2010, pp. 1-10.
11. K. Altun, B. Barshan, O. Tuncel, Comparative study on classifying human activities with miniature inertial and magnetic sensors, Pattern Recognit. 43 (10) (2010) 3605-3620.
12. V.H. Cheung, L. Gray,M. Karunanithi, Review of accelerometry for determining daily activity among elderly patients, Arch. Phys. Med. Rehabil. 92 (6) (2011) 998-1014.
13. L. Chen, J. Hoey, C. Nugent, D. Cook, Z. Yu, Sensor-based activity recognition, IEEE Trans. Syst. Man Cybern. C: Appl. Rev. 42 (6) (2012) 790-808.
14. Y. Meng, H.-C. Kim, A review of accelerometer-based physical activity measurement, in: K.J. Kim, S.J. Ahn (Eds.), Proceedings of the International Conference on IT Convergence and Security 2011, Lecture Notes in Electrical Engineering, vol. 120, Springer Netherlands, 2012, pp. 223-237.
15. M. Sekine, T. Tamura, M. Akay, T. Fujimoto, T. Togawa, Y. Fukui, Discrimination of walking patterns using wavelet-based fractal analysis, IEEE Trans. Neural Syst. Rehabil. Eng. 10 (3) (2002) 188-196.
16. S. Bonnet, P. Jallon, Hidden markov models applied onto gait classification, in: Eighteenth European Signal Processing Conference, EURASIP, 2010, pp. 929-933.
17. R. Ibrahim, E. Ambikairajah, B. Celler, N. Lovell, Time-frequency based features for classification of walking patterns, in: Fifteenth International Conference on Digital Signal Processing, 2007, 2007, pp. 187-190.
18. T.T. Ngo, Y. Makihara, H. Nagahara, Y. Mukaigawa, Y. Yagi, Orientation-compensative signal registration for owner authentication using an accelerometer, IEICE Trans. Inf. Syst. E97-D (3) (2014) 541-553.
19. T.T. Ngo, Y. Makihara, H. Nagahara, Y. Mukaigawa, Y. Yagi, Inertial-sensor-based walking action recognition using robust step detection and inter-class relationships, in: Twenty-first International Conference on Pattern Recognition, 2012, pp. 3811-3814.
20. L. Bao, S. Intille, Activity recognition from user-annotated acceleration data, in: A. Ferscha, F. Mattern (Eds.), Pervasive Computing, Lecture Notes in Computer Science, vol. 3001, Springer Berlin Heidelberg, 2004, pp. 1-17.
21. N. Ravi, N. Dandekar, P. Mysore, M.L. Littman, Activity recognition from accelerometer data, in: Proceedings of the Seventeenth Conference on Innovative Applications of Artificial Intelligence, vol. 3, IAAI'05, AAAI Press, 2005, pp. 1541-1546.
22. N. Wang, E. Ambikairajah, N. Lovell, B. Celler, Accelerometry based classification of walking patterns using time-frequency analysis, in: International Conference of the IEEE Engineering in Medicine and Biology Society, 2007, pp. 4899-4902.
23. A. Khan, Y.-K. Lee, S. Lee, T.-S. Kim, A triaxial accelerometer-based physicalactivity recognition via augmented-signal features and a hierarchical recognizer, IEEE Trans. Inf. Technol. Biomed. 14 (5) (2010) 1166-1172.
24. A. Mannini, A. Sabatini, On-line classification of human activity and estimation of walk-run speed from acceleration data using support vector machines, in: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC, 2011, pp. 3302-3305.
25. J.R. Kwapisz, G.M. Weiss, S.A. Moore, Activity recognition using cell phone accelerometers, SIGKDD Explor. Newsl. 12 (2) (2011) 74-82.
26. M. Zhang, A.A. Sawchuk, Motion primitive-based human activity recognition using a bag-of-features approach, in: Proceedings of the Second ACM SIGHIT International Health Informatics Symposium, 2012, pp. 631-640.
27. D. Kelly, B. Caulfield, An investigation into non-invasive physical activity recognition using smartphones, in: Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2012, 2012, pp. 3340-3343.
28. J.O. Laguna, A.G. Olaya, D. Borrajo, A dynamic sliding window approach for activity recognition, in: Proceedings of the nineteenth International Conference on User modeling, Adaption, and Personalization, 2011, pp. 219-230.
29. M. Nyan, F. Tay, K. Seah, Y. Sitoh, Classification of gait patterns in the time-frequency domain, J. Biomech. 39 (14) (2006) 2647-2656.
30. S.-W. Lee, K. Mase, Activity and location recognition using wearable sensors, IEEE Pervasive Comput. 1 (3) (2002) 24-32.
31. H. Ying, C. Silex, A. Schnitzer, S. Leonhardt, M. Schiek, Automatic step detection in the accelerometer signal, in: Fourth International Workshop on Wearable and Implantable Body Sensor Networks (BSN 2007), IFMBE Proceedings, vol. 13, Springer Berlin Heidelberg, 2007, pp. 80-85.
32. M.O. Derawi, P. Bours, K. Holien, Improved cycle detection for accelerometer based gait authentication, in: Proceedings of the Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2010, pp. 312-317.
33. R. Chavarriaga, H. Bayati, J.D. Millán, Unsupervised adaptation for acceleration-based activity recognition: robustness to sensor displacement and rotation, Pers. Ubiquitous Comput. 17 (3) (2013) 479-490.
34. K. Forster, D. Roggen, G. Troster, Unsupervised classifier self-calibration through repeated context occurences: is there robustness against sensor displacement to gain?, in: International Symposium on Wearable Computers, 2009. ISWC '09, 2009, pp. 77-84.
35. K. Forster, P. Brem, D. Roggen, G. Troster, Evolving discriminative features robust to sensor displacement for activity recognition in body area sensor networks, in: Fifth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2009, 2009, pp. 43-48.
36. K. Kunze, P. Lukowicz, Dealing with sensor displacement in motion-based onbody activity recognition systems, in: Proceedings of the Tenth International Conference on Ubiquitous Computing, UbiComp '08, ACM, New York, NY, USA, 2008, pp. 20-29.
37. P. Siirtola, J. Röning, Recognizing human activities user-independently on smartphones based on accelerometer data, Int. J. Interact. Multim. Artif. Intell. (2012) 38-45.
38. P. Widhalm, P. Nitsche, N. Braendle, Transport mode detection with realistic smartphone sensor data, in: Twenty-first International Conference on Pattern Recognition, 2012, pp. 573-576.
39. C.W. Han, S.J. Kang, N.S. Kim, Implementation of HMM-based human activity recognition using single triaxial accelerometer, IEICE Trans. Fundam. Electron. Commun. Comput. Sci. E93-A (2010) 1379-1383.
40. B. Florentino-Liano, N. O'Mahony, A. Artes-Rodriguez, Human activity recognition using inertial sensors with invariance to sensor orientation, in: Third International Workshop on Cognitive Information Processing (CIP), 2012, 2012, pp. 1-6.
41. J. Yang, Toward physical activity diary: motion recognition using simple acceleration features with mobile phones, in: Proceedings of the First International Workshop on Interactive Multimedia for Consumer Electronics, ACM, New York, NY, USA, 2009, pp. 1-10.
42. D. Mizell, Using gravity to estimate accelerometer orientation, in: Proceedings of the Seventh IEEE International Symposium on Wearable Computers, 2003, 2003, pp. 252-253.
43. A. Henpraserttae, S. Thiemjarus, S. Marukatat, Accurate activity recognition using a mobile phone regardless of device orientation and location, in: International Conference on Body Sensor Networks (BSN), 2011, 2011, pp. 41-46.
44. Y.E. Ustev, O. Durmaz Incel, C. Ersoy, User, device and orientation independent human activity recognition on mobile phones: Challenges and a proposal, in: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, UbiComp '13 Adjunct, ACM, 2013, pp. 1427-1436.
45. A. Jain, K. Nandakumar, A. Ross, Score normalization in multimodal biometric systems, Pattern Recognit. 38 (12) (2005) 2270-2285.
46. R. Auckenthaler, M. Carey, H. Lloyd-Thomas, Score normalization for textindependent speaker verification systems, Digit. Signal Process. 10 (2000) 42-54.
47. G. Aggarwal, N. Ratha, R. Bolle, Biometric verification: Looking beyond raw similarity scores, in: Conference on Computer Vision and Pattern Recognition Workshop, 2006. CVPRW '06, 2006, pp. 31-31.
48. N. Kumar, A.C. Berg, P.N. Belhumeur, S.K. Nayar, Attribute and simile classifiers for face verification, in: The Twelfth IEEE International Conference on Computer Vision (ICCV), 2009, pp. 365-372.
49. M. Okumura, H. Iwama, Y. Makihara, Y. Yagi, Performance evaluation of visionbased gait recognition using a very large-scale gait database, in: IEEE Fourth International Conference on Biometrics: Theory, Applications and Systems, 2010, pp. 1-6.
50. T. Oberg, A. Karsznia, Basic gait parameters: reference data for normal subjects, 10-79 years of age, J. Rehabil. Res. Dev. 30 (1993) 210-223.
51. C.L. Vaughan, B.L. Davis, J.C.O. Connor, Dynamics of Human Gait, second ed., Kiboho Publishers, 1999, pp. 7-14 (Chapter 2).
52. A.P. Witkin, Scale-space filtering, in: Proceedings of the Eighth International Joint Conference on Artificial Intelligence, vol. 2, IJCAI'83, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1983, pp. 1019-1022.
53. J. Weickert, S. Ishikawa, A. Imiya, Linear scale-space has first been proposed in Japan, J. Math. Imaging Vis. 10 (3) (1999) 237-252.
54. M. Wand, C. Jones, Kernel Smoothing, Monographs on Statistics and Applied Probability, Chapman & Hall, 1995, pp.10-52 (Chapter 2).
55. M. Lourakis, levmar: Levenberg-Marquardt nonlinear least squares algorithms in C/C ++, [web page] 〈http://www.ics.forth.gr/-lourakis/levmar/〉, [Accessed on 31 January 2005.] (2004).
56. ZMP Inc., IMUZ, 〈http://www.zmp.co.jp/products/imu-z〉, In Japanese.
57. T.T. Ngo, Y. Makihara, H. Nagahara, Y. Mukaigawa, Y. Yagi, The largest inertial sensor-based gait database and performance evaluation of gait-based personal authentication, Pattern Recognit. 47 (1) (2014) 228-237.
58. J. Kittler, M. Hatef, R.P. Duin, J. Matas, On combining classifiers, IEEE Trans. Pattern Anal. Mach. Intell. 20 (3) (1998) 226-239.
59. C.-C. Chang, C.-J. Lin, Libsvm: a library for support vector machines, ACM Trans. Intell. Syst. Technol. 2 (3) (2011) 27:1-27:27.