Fusion of inertial and depth sensor data for robust hand gesture recognition

IEEE Sensors Journal

Volumn 14, Issue 6, 2014, Pages 1898-1903

  Liu, Kui ^a   Chen, Chen ^a   Jafari, Roozbeh ^a   Kehtarnavaz, Nasser ^a  

^a Department of Electrical Engineering ^*  (United States)

Author keywords

Fusion of inertial and depth sensor data; Hand gesture recognition; Sensor fusion

Indexed keywords

GESTURE RECOGNITION; HIDDEN MARKOV MODELS; SENSORS;

BODY MOVEMENTS; DEPTH SENSORS; HAND GESTURE; HAND-GESTURE RECOGNITION; INERTIAL SENSOR; REALISTIC CONDITIONS; ROBUST RECOGNITION; SENSOR FUSION;

SENSOR DATA FUSION;

EID: 84899512999     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2014.2306094     Document Type: Article

References (25)

1. A. Erol, G. Bebis, M. Nicolescu, R. Boyle, and X. Twombly, "Vision-based hand pose estimation: A review," J. Comput. Vis. Image Understand., vol. 108, nos. 1-2, pp. 52-73, Oct. 2007. (Pubitemid 47333390)
2. S. Mitra and T. Acharya, "Gesture recognition: A survey," IEEE Trans. Syst., Man, Cybern., C, Appl. Rev., vol. 37, no. 3, pp. 311-324, May 2007. (Pubitemid 46621535)
3. G. Murthy and R. Jadon, "A review of vision based hand gesture recognition," Int. J. Inf. Technol. Knowl. Manag., vol. 2, no. 2, pp. 405-410, Jul./Dec. 2009.
4. K. Liu and N. Kehtarnavaz, "Real-time robust vision-based hand gesture recognition using stereo images," J. Real-Time Image Process., Feb. 2013, doi: 10.1007/s11554-013-0333-6, print to appear in 2014.
5. S. Uchida and H. Sakoe, "A survey of elastic matching techniques for handwritten character recognition," IEICE Trans. Inf. Syst., vol. E88-D, no. 8, pp. 1781-1790, Aug. 2005. (Pubitemid 41409990)
6. P. Djuric, M. Vemula, and M. Bugallo, "Target tracking by particle filtering in binary sensor networks," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2229-2238, Jun. 2008. (Pubitemid 351801717)
7. P. Pan and D. Schonfeld, "Video tracking based on sequential particle filtering on graphs," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1641-1651, Jun. 2011.
8. H. Lee and J. Kim, "An HMM-based threshold model approach for gesture recognition," IEEE Trans. Pattern Recognit. Mach. Intell., vol. 21, no. 10, pp. 961-973, Oct. 1999. (Pubitemid 129304130)
9. C. Chen, K. Liu, and N. Kehtarnavaz, "Real-time human action recognition based on depth motion maps," J. Real-Time Image Process., Aug. 2013, doi: 10.1007/s11554-013-0370-1, print to appear in 2014.
10. C. Keskin, F. Kirac, Y. Kara, and L. Akarun, "Real time hand pose estimation using depth sensors," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, Barcelona, Spain, Nov. 2011, pp. 1228-1234.
11. Z. Ren, J. Meng, J. Yuan, and Z. Zhang, "Robust hand gesture recognition with kinect sensor," in Proc. ACM Int. Conf. Multimedia, Scottsdale, AZ, USA, Dec. 2011, pp. 759-760.
12. Y. Wang C. Yang X. Wu, and S. Xu, "Kinect based dynamic hand gesture recognition algorithm research," in Proc. IEEE Int. Conf. Intell. Human Mach. Syst. Cybern., Nanchang, China, Aug. 2012, pp. 274-279.
13. Z. Zhang, Z. Wu, J. Chen, and J. Wu, "Ubiquitous human body motion capture using micro-sensors," in Proc. IEEE Int. Conf. Pervas. Comput. Commun., Galveston, TX, USA, Mar. 2009, pp. 1-5.
14. L. Wang, T. Gu, H. Chen, X. Tao, and J. Lu, "Real-time activity recognition in wireless body sensor networks: From simple gestures to complex activities," in Proc. IEEE Int. Conf. Embedded Real-Time Comput. Syst. Appl., Macau, China, Aug. 2010, pp. 43-52.
15. M. Zhang and A. Sawchuk, "A customizable framework of body area sensor network for rehabilitation," in Proc. IEEE Int. Symp. Appl. Sci. Biomed. Commun. Technol., Bratislava, Slovakia, Nov. 2009, pp. 1-6.
16. S. Patel, K. Lorincz, R. Hughes, and N. Hugguns, "Monitoring motor fluctuations in patients with Parkinson's disease using wearable sensors," IEEE Trans. Inf. Technol. Biomed., vol. 13, no. 6, pp. 864-873, Nov. 2009.
17. R. Zhu and Z. Zhou, "A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 12, no. 2, pp. 295-302, Jun. 2004. (Pubitemid 38765759)
18. E. Foxlin, Y. Altshuler, L. Naimark, and M. Harrinton, "Flight tracker: A novel optical/inertial tracker for cockpit enhanced vision," in Proc. IEEE ACM Int. Symp. Mixed Augmented Reality, Nov. 2004, pp. 212-221. (Pubitemid 40682402)
19. J. Hol, "Sensor fusion and calibration of inertial sensors, vision, ultrawideband and GPS," Ph.D. dissertation, Division Autom. Control, Linkoping Univ., Linköping, Sweden, 2011.
20. J. Hol, B. Schon, F. Gustafsson, and P. Slycke, "Sensor fusion for augmented reality," in Proc. IEEE Int. Conf. Inf. Fusion, Florence, Italy, Jul. 2006, pp. 1-6.
21. J. Lobo and J. Dias, "Vision and inertial sensor cooperation using gravity as a vertical," IEEE Trans. Pattern Recognit. Mach. Intell., vol. 25, no. 12, pp. 1597-1608, Dec. 2003.
22. O. Banos, A. Calatroni, M. Damas, and H. Pomares, "Kinect=IMU? learning MIMO signal mappings to automatically translate activity recognition systems across sensor modalities," in Proc. IEEE 16th Int. Symp. Wearable Comput., Newcastle, U.K., Jun. 2012, pp. 92-99.
23. M. Bidmeshki and R. Jafari, "Low power programmable architecture for periodic activity monitoring," in Proc. ACM/IEEE 4th Int. Conf. Cyber- Phys. Syst., Philadelphia, PA, USA, Apr. 2013, pp. 81-88.
24. L. Rabiner, "A tutorial on hidden Markov model and selected application in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
25. J. Yuan, Z. Liu, and Y. Wu, "Discriminative subvolume search for efficient action detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA, Jun. 2009, pp. 2442-2449.