Real-time head and hand tracking based on 2.5D data

IEEE Transactions on Multimedia

Volumn 14, Issue 3 PART1, 2012, Pages 575-585

  Suau, Xavier ^a   Ruiz Hidalgo, Javier ^a   Casas, Josep R ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Gesture recognition; hand tracking; head tracking; interactivity; range camera

Indexed keywords

ADAPTIVE SEARCH; BOUNDING BOX; FAST MOVEMENT; HAND POSITIONS; HAND TRACKING; HEAD TRACKING; HIGH ROBUSTNESS; INTERACTIVE APPLICATIONS; INTERACTIVITY; PARTIAL OCCLUSIONS; RANGE CAMERAS; REAL TIME ALGORITHMS; SIMPLE METHOD;

GESTURE RECOGNITION; TEMPLATE MATCHING;

CAMERAS;

EID: 84861118029     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2189853     Document Type: Article

References (31)

1. J. Yan and M. Pollefeys, "A factorization-based approach for articulated nonrigid shape, motion and kinematic chain recovery from video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 5, pp. 865-877, May 2008. (Pubitemid 351486754)
2. P. Guan, A. Weiss, A. Balan, and M. Black, "Estimating human shape and pose from a single image," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 1381-1388.
3. M. A. Brubaker, D. J. Fleet, and A. Hertzmann, "Physics-based person tracking using the anthropomorphic Walker," Int. J. Comput. Vis., vol. 87, no. 1-2, pp. 140-155, Aug. 2009.
4. A. D. Kuo, "Energetics of actively powered locomotion using the simplest walking model," J. Biomech. Eng., vol. 124, no. 1, pp. 113-113, 2002.
5. N. Hasler, H. Ackermann, B. Rosenhahn, T. Thormahlen, and H. Seidel, "Multilinear pose and body shape estimation of dressed subjects from image sets," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 1823-1830.
6. J. Gall, C. Stoll, E. De Aguiar, C. Theobalt, B. Rosenhahn, and H.-P. Seidel, "Motion capture using joint skeleton tracking and surface estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1746-1753.
7. A. Sundaresan and R. Chellappa, "Multicamera tracking of articulated human motion using shape and motion cues," IEEE Trans. Image Process., vol. 18, no. 9, pp. 2114-2126, Sep. 2009.
8. J. Neumann, J. R. Casas, D. Macho, and J. R. Hidalgo, "Integration of audiovisual sensors and technologies in a smart room," Personal and Ubiquitous Computing, vol. 13, no. 1, pp. 15-23, 2007.
9. M. Alcoverro, J. R. Casas, and M. Pardàs, "Skeleton and shape adjustment and tracking in multicamera environments," in AMDO, ser. Lecture Notes in Computer Science, F. J. P. López and R. B. Fisher, Eds. : Springer, 2010, vol. 6169.
10. S. Corazza, L.Mündermann, E. Gambaretto, G. Ferrigno, and T. P. Andriacchi, "Markerless motion capture through visual hull, articulated ICP and subject specific model generation," Int. J. Comput. Vis., vol. 87, no. 1-2, pp. 156-169, Sep. 2009.
11. G. Pons-Moll, A. Baak, T. Helten, M. Muller, H. Seidel, and B. Rosenhahn, "Multisensor-fusion for 3d full-body humanmotion capture," Elements, pp. 2-9, 2010.
12. A. Kolb, E. Barth, R. Koch, and R. Larsen, "Time-of-flight cameras in computer graphics," Comput. Graph. Forum, vol. 29, no. 1, pp. 141-159, 2010.
13. MESA SR4000 MESA Imaging, 2011 [Online]. Available: http://www.mesa- imaging.ch/prodview4k.php
14. PMD[vision] CamCube PMDTechnologies, 2011 [Online]. Available: http://www.pmdtec.com/products-services/pmdvisionr-cameras/pmdvisionr-camcube- 30/
15. A. Bevilacqua, L. Stefano, and P. Azzari, "People tracking using a time-of-flight depth sensor," in Proc. IEEE Int. Conf. Video and Signal Based Surveillance, 2006, pp. 89-89.
16. S. Knoop, S. Vacek, and R. Dillmann, "Sensor fusion for 3D human body tracking with an articulated 3D body model," in Proc. Int. Conf. Robot. Autom., May 2006, pp. 1686-1691. (Pubitemid 44940312)
17. D. Grest, V. Krüger, and R. Koch, "Single view motion tracking by depth and silhouette information," Lecture Notes in Computer Science, vol. 4522, pp. 719-729, 2007.
18. Y. Zhu, B. Dariush, and K. Fujimura, "Controlled human pose estimation from depth image streams," in Proc. Int. Conf. Comput. Vis. Pattern Recognit. Workshops., Jun. 2008, pp. 1-8.
19. N. H. Lehment, M. Kaiser, D. Arsic, and G. Rigoll, "Cue-independent extending inverse kinematics for robust pose estimation in 3D point clouds," in Proc. Int. Conf. Image Process., Hong Kong, 2010, pp. 2465-2468.
20. C. Plagemann, V. Ganapathi, D. Koller, and S. Thrun, "Real-time identification and localization of body parts from depth images," in Proc. Int. Conf. Robot. Autom., 2010, pp. 3108-3113.
21. V. Ganapathi, C. Plagemann, D. Koller, and S. Thrun, "Real time motion capture using a single time-of-flight camera," in Proc. Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, 2010, pp. 755-762.
22. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake, "Real-time human pose recognition in parts from single depth images," in Proc. Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, 2011, pp. 1297-1304.
23. M. Haker, M. Bohme, T. Martinetz, and E. Barth, "Geometric invariants for facial feature tracking with 3D TOF cameras," in Proc. ISSCS, Jul. 2007, pp. 3-6.
24. M. Bohme, M. Haker, T. Martinetz, and E. Barth, "Head tracking with combined face and nose detection," in Proc. Int. Symp. Signals Circuits Syst., Jul. 2009, pp. 1-4.
25. M. Nichau and V. Blanz, "Pose-insensitive nose detection in TOF-scans," Comput. Vis. Image Underst and ., vol. 114, no. 12, pp. 1346-1352, Dec. 2010.
26. S. Malassiotis and M. G. Strintzis, "Robust real-time 3D head pose estimation from range data," Pattern Recognit., vol. 38, no. 8, pp. 1153-1165, Aug. 2005. (Pubitemid 40654767)
27. J. H. Friedman, J. L. Bentley, and R. A. Finkel, "An algorithm for finding best matches in logarithmic expected time," ACM Trans. Math. Software, vol. 3, no. 3, pp. 209-226, 1977.
28. S. Maneewongvatana and D.M.Mount, "It's okay to be skinny, if your friends are fat," in Proc. 4th Annu. CGC Workshop Comptutat. Geometry, Oct. 1999, pp. 1-8.
29. X. Suau, J. R. Casas, and J. Ruiz-hidalgo, "Real-time head and h and tracking based on 2.5D data," in Proc. Int. Conf. Multimedia Expo, Barcelona, 2011, pp. 1-6.
30. Format-Agnostic Script-Based Interactive Experience FascinatE [Online]. Available: http://www.fascinate-project.eu/
31. OpenNI PrimeSense, 2011 [Online]. Available: http://openni.org