3-D posture and gesture recognition for interactivity in smart spaces

IEEE Transactions on Industrial Informatics

Volumn 8, Issue 1, 2012, Pages 178-187

  Tran, Cuong ^a   Trivedi, Mohan Manubhai ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Head and hands tracking; human activity analysis; inverse kinematics; smart environment; upper body motion tracking

Indexed keywords

BODY GESTURE; BODY MODELS; BODY MOTIONS; BODY POSE; CLASSIFICATION ACCURACY; EXPERIMENTAL EVALUATION; HUMAN ACTIVITY ANALYSIS; HUMAN POSTURES; INTELLIGENT VIDEO; INTERACTIVITY; INVERSE KINEMATICS PROBLEM; JOINT ANGLE; LONGEST COMMON SUBSEQUENCES; MULTIPLE CAMERAS; POSE TRACKING; REAL TIME PERFORMANCE; SEARCH PROBLEM; SIMILARITY MEASUREMENTS; SMART ENVIRONMENT; SMART SPACE;

DYNAMICS; INVERSE KINEMATICS; INVERSE PROBLEMS; THREE DIMENSIONAL;

GESTURE RECOGNITION;

EID: 84856337169     PISSN: 15513203     EISSN: None     Source Type: Journal    
DOI: 10.1109/TII.2011.2172450     Document Type: Article

References (36)

1. O. Bernier, P. Cheung-Mon-Chana, and A. Bougueta, "Fast nonparametric belief propagation for real-time stereo articulated body tracking," Comput. Vis. Image Understand., vol. 113, no. 1, pp. 29-47, 2009.
2. F. Caillette, A. Galata, and T. Howard, "Real-time 3-D human body tracking using learnt models of behaviour," Comput. Vis. Image Understand., vol. 109, pp. 112-125, 2008.
3. S. Y. Cheng and M. M. Trivedi, "Articulated human body pose inference from voxel data using a kinematically constrained Gaussian mixture model," in Proc. 2nd Workshop Eval. Articulated Human Motion Pose Estimat., 2007.
4. G. Cheung, S. Baker, and T. Kanade, "Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2003, pp. I-77-I-84.
5. S. Corazza, L. Mundermann, E. Gambaretto, G. Ferrigno, and T. Andriacchi, "Markerless motion capture through visual hull, articulated ICP and subject specific model generation," Int. J. Comput. Vis., vol. 87, no. 1-2, pp. 156-169, 2010.
6. A. Datta, Y. Sheikh, and T. Kanade, "Linear motion estimation for systems of articulated planes," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
7. A. Doshi, B. Morris, and M. M. Trivedi, "On-road prediction of driver's intent with multimodal sensory cues," IEEE Pervasive Comput., vol. 10, no. 3, pp. 22-34, Mar. 2011.
8. J. Gall, B. Rosenhahn, T. Brox, and H. Seidel, "Optimization and filtering for human motion capture: A multi-layer framework," Int. J. Comput. Vis., vol. 87, no. 1-2, pp. 75-92, 2010.
9. H. Ghasemzadeh and R. Jafari, "Physical movement monitoring using body sensor networks: A phonological approach to construct spatial decision trees," IEEE Trans. Ind. Informat., vol. 7, no. 1, pp. 66-77, Feb. 2011.
10. G. Gomez and E. Morales, "Automatic feature construction and a simple rule induction algorithm for skin detection," in Proc. ICML Workshop Mach. Learn. Comput. Vis., 2002, pp. 31-38.
11. M. Hofmann and D. M. Gavrila, "Multi-view 3D human pose estimation in complex environment," Int. J. Comput. Vis., pp. 1-22, 2011, doi:10.1007/s11263-011-0451-1.
12. M. B. Holte, C. Tran, M. M. Trivedi, and T. B. Moeslund, "Human activity recognition using multiple views: A comparative perspective on recent developments," in Proc. Workshop Multimedia Access 3D Human Objects, ACM Int. Conf. Multimedia, Dec. 2011.
13. K. S. Huang and M. M. Trivedi, "3D shape context based gesture analysis integrated with tracking using omni video array," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshop, 2005.
14. G. Johansson, "Visual perception of biological motion and a model for its analysis," Percept. Psychophys., vol. 14, no. 2, pp. 201-211, 1973.
15. J. Kofman, X. Wu, T. J. Luu, and S. Verma, "Teleoperation of a robot manipulator using a vision-based human-robot interface," IEEE Trans. Ind. Electron., vol. 52, no. 5, pp. 1206-1219, Oct. 2005. (Pubitemid 41489363)
16. H. Lee and J. H. Kim, "An HMM-based threshold model approach for gesture recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 10, pp. 961-973, Oct. 1999. (Pubitemid 129304130)
17. R. Li, T. P. Tian, S. Sclaroff, and M. H. Yang, "3D human motion tracking with a coordinated mixture of factor analyzers," Int. J. Comput. Vis., vol. 87, no. 1-2, pp. 170-190, 2010.
18. M. C. D. Mendonca, "Estimation of height from the length of long bones in a Portugese adult population," Amer. J. Phys. Anthropol., vol. 112, no. 1, pp. 39-48, 2000.
19. A. S. Micilotta, E. Ong, and R. Bowden, "Real-time upper body detection and 3D pose estimation in monoscopic images," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 139-150. (Pubitemid 44029673)
20. I. Mikic, M. M. Trivedi, E. Hunter, and P. Cosman, "Human body model acquisition and tracking using voxel data," Int. J. Comput. Vis., vol. 53, no. 3, pp. 199-223, 2003.
21. R. Poppe, "Vision-based human motion analysis: An overview," Comput. Vis. Image Understand., vol. 108, pp. 4-18, 2007. (Pubitemid 47333391)
22. Y. Kogay, K. Kondoz, J. Kuffnery, and J. Latombey, "Planning motions with intentions," Proc. SIGGRAPH, pp. 395-408, 1994.
23. S. T. Shivappa, M. M. Trivedi, and B. D. Rao, "Audio-visual information fusion in human computer interfaces and intelligent environments: A survey," Proc. IEEE, vol. 98, no. 10, pp. 1692-1715, Oct. 2010.
24. L. Sigal and M. J. Black, "Guest editorial: State of the art in image and video based human pose and motion estimation," Int. J. Comput. Vis., vol. 87, no. 1, pp. 1-3, 2010.
25. J. Soechting and M. Flanders, "Errors in pointing are due to approximations in sensorimotor transformations," J. Neurophysiol., vol. 62, no. 2, pp. 595-608, 1989. (Pubitemid 19208086)
26. A. Sundaresan and R. Chellappa, "Model driven segmentation of articulating humans in Laplacian Eigenspace," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 10, pp. 1771-1785, Oct. 2008.
27. C. Tran and M. M. Trivedi, "Driver assistance for keeping hands on the wheel and eyes on the road," in Proc. IEEE Int. Conf. Veh. Electron. Safety, 2009, pp. 97-101.
28. C. Tran and M. M. Trivedi, "Introducing XMOB: Extremity movement observation framework for upper body pose tracking in 3D," in Proc. 11th IEEE Int. Symp. Multimedia, 2009, pp. 446-447.
29. C. Tran and M. M. Trivedi, "Vision for driver assistance: Looking at people in a vehicle," in Guide to Visual Analysis of Humans: Looking at People, T. B. Moeslund, L. Sigal, V. Krueger, and A. Hilton, Eds. New York: Springer-Verlag, 2011.
30. M. M. Trivedi and S. Y. Cheng, "Holistic sensing and active displays for intelligent driver support systems," IEEE Comput., vol. 40, no. 5, pp. 60-68, May 2007.
31. M. M. Trivedi, T. L. Gandhi, and K. S. Huang, "Distributed interactive video arrays for event capture and enhanced situational awareness," IEEE Intell. Syst., vol. 20, no. 5, pp. 58-66, Sep./Oct. 2005.
32. M. M. Trivedi, K. S. Huang, and I. Mikic, "Dynamic context capture and distributed video arrays for intelligent spaces," IEEE Trans. Syst., Man, Cybern. A Syst., Humans, vol. 35, no. 1, pp. 145-163, Jan. 2005. (Pubitemid 40085391)
33. M. Vlachos, G. Kollios, and D. Gunopulos, "Discovering similar multidimensional trajectories," in Proc. IEEE 18th Int. Conf. Data Eng., 2002, pp. 673-684. (Pubitemid 34278779)
34. J. Wang, P. Liu, M. She, and H. Liu, "Human action categorization using conditional random field," in Proc. IEEEWorkshop Robot. Intell. Inform. Structured Space, 2011, pp. 131-135.
35. E. Yu and J. K. Aggarwal, "Human action recognition with extremities as semantic posture representation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1-8.
36. J. Ziegler, K. Nickel, and R. Stiefelhagen, "Tracking of the articulated upper body on multi-viewstereo image sequences," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2006, pp. 774-781. (Pubitemid 44931403)