Lightweight palm and finger tracking for real-time 3D gesture control

Proceedings - IEEE Virtual Reality

Volumn , Issue , 2011, Pages 19-26

  Hackenberg, Georg ^a   McCall, Rod ^a   Broll, Wolfgang ^a  

^a FRAUNHOFER INSTITUTE FOR APPLIED INFORMATION TECHNOLOGY FIT   (Germany)

Author keywords

3D user interfaces; computer vision; gesture recognition; hand tracking; multi touch

Indexed keywords

3D CONTENT; 3D INTERACTIONS; 3D USER INTERFACE; COMPUTATIONAL RESOURCES; CONSTRAINT MODELING; ENVIRONMENTAL REQUIREMENT; GESTURE CONTROL; HAND TRACKING; LIGHTING CONDITIONS; MULTI-TOUCH; MULTIPLE USER; NOVEL TECHNIQUES; PROTOTYPE SYSTEM; REAL-TIME OPERATION; TIME-OF-FLIGHT CAMERAS; USER TESTS; WORKING VOLUME;

ALGORITHMS; CAMERAS; COMPUTER HARDWARE; COMPUTER VISION; GESTURE RECOGNITION; USER INTERFACES; VIRTUAL REALITY;

THREE DIMENSIONAL;

EID: 79956258658     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VR.2011.5759431     Document Type: Conference Paper

References (31)

1. K. Abe, H. Saito and S. Ozawa. "3-D drawing system via hand motion recognition from two cameras," in Proc. of IEEE SMC, 2000, pp. 840-845 vol. 2. (Pubitemid 32069140)
2. A. Argyros and M. Lourakis. "Tracking multiple colored blobs with a moving camera," in Proc. of IEEE CVPR, 2005, 1178 vol. 2.
3. K. Barhate et al. "Robust shape based two hand tracker," in Proc. Of IEEE ICIP, 2004, pp. 1017-1020. (Pubitemid 40820209)
4. Q. Delamarre and O. Faugeras. "Finding pose of hand in video images: a stereo-based approach," in Proc. of IEEE FG, 1998, pp. 585-590.
5. M. Donoser and H. Bischof. "Real time appearance based hand tracking." in Proc. of ICPR, 2008, pp. 1-4.
6. A. El-Sawah, C. Joslin, N. Georganas and E. Petriu. "A Framework for 3D Hand Tracking and Gesture Recognition using Elements of Genetic Programming," in Proc. of IEEE CRV, 2007, pp. 495-502. (Pubitemid 47432508)
7. S. Ghobadi et al. "Real Time Hand Based Robot Control Using 2D/3D Images," in Proc. of ISVC, 2008, pp. 307-316.
8. J. Gould and C. Lewis. "Designing for usability: key principles and what designers think." CACM, vol. 28, no. 3, pp. 300-311, 1985. (Pubitemid 15599384)
9. T. Gumpp, P. Azad, K. Welke, E. Oztop, R. Dillmann and G. Cheng. "Unconstrained Real-time Markerless Hand Tracking for Humanoid Interaction," in Proc. of IEEE Humanoids, 2006, pp. 88-93.
10. S. Guomundsson et al. "Model-Based Hand Gesture Tracking in ToF Image Sequences," in Proc. of AMDO, 2010, pp. 118-127.
11. C. Keskin, A. Erkan and L. Akarun. "Real time hand tracking and 3d gesture recognition for interactive interfaces using hmm," in Proc. Of Int. Conf. on Artificial Neural Networks, 2003.
12. H. Kim, K. Kwak, S. Chi and Y. Cho. "AR-KLT based Hand Tracking," in Proc. of IEEE RO-MAN, 2006, pp. 611-616.
13. M. Kolsch and M. Turk. "Robust hand detection," in Proc. of IEEE FG, 2004, pp. 614-619.
14. M. Kolsch and M. Turk. "Hand tracking with Flocks of Features," in Proc. of IEEE CVPR, 2005, p. 1187 vol. 2.
15. R. Lange and P. Seitz. "Solid-state time-of-flight range camera." IEEE J. of Quantum Electronics, vol. 37, no. 3, pp. 390-397, 2001. (Pubitemid 32286777)
16. J. Letessier and F. Bérard. "Visual tracking of bare fingers for interactive surfaces," in Proc. of ACM UIST, 2004, pp. 119-122. (Pubitemid 40787672)
17. W. Liang, Y. Jia, F. Sun, B. Ning, T. Liu and X. Wu. "Visual Hand Tracking Using MDSA Method, "in Proc. of IMACS Multiconf. On Computational Eng. in Syst. Applications, 2006, pp. 255-259.
18. Y. Liu and Y. Jia. "A Robust Hand Tracking and Gesture Recognition Method for Wearable Visual Interfaces and Its Applications," in Proc. of IEEE ICIG, 2004, pp. 472-475. (Pubitemid 40498129)
19. S. Lu, D. Metaxas, D. Samaras and J. Oliensis. "Using multiple cues for hand tracking and model refinement in Proc. of IEEE CVPR, 2003, pp. 443-450 vol. 2.
20. B. Lucas and T. Kanade. "An iterative image registration technique with an application to stereo vision," in Proc. of IJCAI, 1981, pp. 674-679. (Pubitemid 14478744)
21. J. Matas, O. Chum, M. Urban and T. Pajdla. "Robust wide baseline stereo from maximally stable external regions, "in Proc. of British Machine Vision Conference, 2002, pp. 384-393.
22. Z. Mo, J. Lewis and U. Neumann. "SmartCanvas: a gesture-driven intelligent drawing desk system," in Proc. of ACM IUI, 2005, pp. 239-243.
23. J. Nielsen. "The usability engineering life cycle." IEEE Computer, vol. 25, no. 3, pp. 12-22, 1992.
24. P. Peltonen et al. "Extending large-scale event participation with user-created mobile media on a public display," in Proc. of ACM MUM. 2007, pp. 131-138.
25. R. Rosales, V. Athitsos, L. Sigal and S. Sclaroff. "3D hand pose reconstruction using specialized mappings," in Proc. of IEEE ICCV, 2001, pp. 378-385 vol. 1.
26. E. Rosten, R. Porter and T. Drummond. "Faster and Better: A Machine Learning Approach to Corner Detection." IEEE Trans. Pattern Anal. Mach. Intelligence, vol. 32, no. 1, pp. 105-119, 2010.
27. Y. Sato, M. Saito and H. Koike. "Real-time input of 3D pose and gestures of a user's hand and its applications for HCI, " in Proc. Of IEEE VR, 2001, pp. 79-86. (Pubitemid 32334735)
28. J. Segen and S. Kumar. "Gesture VR: vision-based 3D hand interface for spatial interaction," in Proc. of ACM MULTIMEDIA, 1998, pp. 455-464.
29. E. Ueda, Y. Matsumoto, M. Imai and T. Ogasawara, "A hand-pose estimation for vision-based human interfaces." IEEE Trans. Ind. Electronics, vol. 50, no. 4, pp. 676-684, 2003.
30. J. Wall. "Demo I Microsoft Surface and the Single View Platform," in Proc. of Int. Symp. on Collaborative Technologies and Systems, 2009, pp. xxxi-xxxii.
31. X. Wang, X. Zhang and G. Dai. "Tracking of deformable human hand in real time as continuous input for gesture-based interaction," in Proc. of ACM IUI, 2007, pp. 235-242. (Pubitemid 47464009)