Sensors for gesture recognition systems

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 42, Issue 3, 2012, Pages 277-290

  Berman, Sigal ^a   Stern, Helman ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Gesture recognition; human machine interface; image sensors; reviews

Indexed keywords

ADVANCED RESEARCHES; APPLICATION DOMAINS; BASIC STRUCTURE; CLASSIFICATION ALGORITHM; COMPREHENSIVE ANALYSIS; COMPUTATIONAL REQUIREMENTS; CONTEXT OF USE; CRITICAL COMPONENT; GESTURE RECOGNITION SYSTEM; HAND GESTURE; HUMAN MACHINE INTERFACE; MOTION CAPTURE; NATURAL COMMUNICATION; PRELIMINARY DESIGN; RESEARCH AND DEVELOPMENT; SENSOR PLATFORM; SOFTWARE SYSTEMS; THREE COMPONENT; TRACKING ALGORITHM; VISUAL SENSOR;

ALGORITHMS; DESIGN; FEATURE EXTRACTION; GESTURE RECOGNITION; IMAGE SENSORS; REVIEWS;

SENSORS;

EID: 84860217899     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2011.2161077     Document Type: Review

References (80)

1. P. K. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea, "Machine recognition of human activities: A survey", IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1473-1488, Nov. 2008.
2. L. Tian, Y. Wang, G. Mori, and S. Robinovitch, "Retrieving actions in group contexts", in Proc. IEEE Int. Conf. Comput. Vision Int. Workshop Sign Gesture Activity, 2010.
3. W. Yang, Y. Wang, and G. Mori, "Recognizing human actions from still images with latent poses", in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 2030-2037.
4. F. Alireza and G. Mori, "Human pose estimation using motion exemplars", in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2007, pp. 1-8.
5. P. Garg, N. Aggarwal, and S. Sofat, "Vision based hand gesture recognition", in Proc. World Acad. Sci., Eng. Technol., vol. 49, pp. 972-977, 2009.
6. A. Yilmaz, O. Javed, and M. Shah, "Object Tracking: A Survey", ACM Comput. Survey, vol. 38, no. 4, pp. 1-45, 2006.
7. D. Rowe, "Reviewing detections and tracking approaches", in Towards Robust Multiple-Target tracking in Unconstrained Human-Populated Environments, Ph. D. dissertation, Universitat Autonoma de Barcelona, Barcelona, Spain, 2008, ch. 2.
8. J. Wachs, M. Kolsch, H. Stern, and Y. Edan, "Vision-based hand gesture applications: Challenges and innovations", Commun. ACM, vol. 54, no. 2, pp. 60-71, Feb. 2011.
9. V. I. Pavlovic, R. Sharma, and T. S. Huang, "Visual interpretation of hand gestures for human-computer interaction: Areview", IEEE Trans. Pattern Anal. Intell., vol. 19, no. 7, pp. 677-95, Jul. 1997. (Pubitemid 127762261)
10. J. K. Aggarwal and S. Park, "Human motion: Modeling and recognition of actions and interactions", in Proc. 2nd Int. Symp. 3D Data Process., Vis., Transmiss., Sep. 2004, pp. 640-647. (Pubitemid 40456354)
11. S. Mitra and T. Acharya, "Gesture recognition: A survey", IEEE Trans. Syst., Man, Cybern., vol. 37, no. 3, pp. 311-324, May 2007. (Pubitemid 46621535)
12. D. M. Gavrila, "The visual analysis of human movement: A survey", Comput. Vis. Image Understanding, vol. 73, no. 1, pp. 82-98, Jan. 1999.
13. Y. Wu and T. S. Huang, "Vision based gesture recognition: A review", in Proc. Int. Gesture Workshop Gesture-Based Commun. Human-Comput. Interaction, 1999, pp. 103-115.
14. R. L. Potter, L. J. Weldon, and B. Shneiderman, "Improving the accuracy of touch screens: An experimental evaluation of three strategies", in Proc. CHI'88 SIGCHI Conf. Human Factors Comput. Syst., 1988, pp. 27-32.
15. D. Wigdor, J. Fletcher, and G. Morrison, "Designing user interfaces for multi-touch and gesture devices", in Proc. 27th Int. Conf. Extended Abstracts Human Factors Comput. Syst., 2009, p. 2755.
16. D. Saffer, Designing Gestural Interfaces: Touchscreens and Interactive Devices. Ottawa, Canada: O'Reilly Media, Inc., 2009.
17. D. Ibrahim, "Using touch screen LCDs in embedded applications", Electron. World, vol. 116, no. 189, pp. 28-34, 2010.
18. H. Tong-Hun, C. Wen-Hai, Y. Ik-Seok, and K. Oh-Kyong, "Highly areaefficient controller for capacitive touch screen panel systems", IEEE Trans. Consum. Electron., vol. 56, no. 2, pp. 1115-1122, May 2010.
19. S. Mori, C. Suen, and K. Yamamoto, "Historical review of OCR research and development", Proc. IEEE, vol. 80, no. 7, pp. 1029-1058, Jul. 1992.
20. M. Kohler, "System architecture and techniques for gesture recognition in unconstraint environments", in Proc. Int. Conf. Virtual Syst. MultiMedia, 1997, pp. 137-146.
21. S. T. Huang and V. Pavlovic, "Hand gesture modeling analysis, and synthesis", in Proc. IEEE Int. Workshop Autom. Face Gesture Recog., 1995, pp. 73-79.
22. A. D. Wilson, "TouchLight: An imaging touch screen and display for gesture-based interaction", in Proc. ICMI'04 6th Int. Conf. Multimodal Interfaces, 2004, pp. 69-76. (Pubitemid 40371893)
23. C. J. Brown, H. Kato, K. Maeda, and B. Hadwen, "A continuous-grain silicon-system LCD with optical input function", IEEE J. Solid-State Circuits, vol. 42, no. 12, pp. 2904-2912, Dec. 2007.
24. A. Abileah, W. Den Boer, R. T. Tuenge, and T. S. Larsson, "Integrated optical light sensitive active matrix liquid crystal display", U. S. Patent 7 009 663, 2006.
25. H. Stern, D. Frolova, and S. Berman, "Hand gesture recognition for TV remote control using tree-based ensemble and LCS classifiers", presented at the WORLDCOMP'10 The 2010 World Congr. Comput. Sci., Comput. Eng., Appl. Comput., Las Vegas, CA, Jul. 2010.
26. Q. Chen, N. D. Georganas, and E. M. Petriu, "Real-time vision based hand gesture recognition using haar-like features", in Proc. Instrum. Meas. Technol. Conf., May 2007, pp. 1-6.
27. J. Wilder, P. J. Phillips, C. Jiang, and S. Wiener, "Comparison of visible and infrared imagery for face recognition", in Proc. 2nd Int. Conf. Autom. Face Gesture Recog., Oct. 1996, pp. 182-187.
28. D. A. Socolinsky and A. A. Selinger, "Comparative analysis of face recognition performance with visible and thermal infrared imagery", in Proc. Int. Conf. Pattern Recog., 2002, pp. 217-222. (Pubitemid 44850984)
29. H. Chang, A. Koschan, M. Abidi, S. G. Kong, and C. H. Won, "Multispectral visible and infrared imaging for face recognition", IEEE Conf. Comput. Vision Pattern Recog., Jun. 2008, pp. 1-6.
30. J. Zhu, L. Wang, R. Yang, J. E. Davis, and Z. Pan, "Reliability fusion of time-of-flight depth and stereo geometry for high quality depth maps", IEEE Trans. Pattern Anal. Mach. Intell, vol. 33, no. 7, pp. 1400-1414, Jul. 2011.
31. A. Verri and V. Torre, "Absolute depth estimate in stereopsis", J. Opt. Soc. Am. A, vol. 3, pp. 297-299, 1986.
32. E. Huber, "3-D real-time gesture recognition using proximity spaces", in Proc. 3rd IEEE Workshop Appl. Comput. Vis., Dec. 1996, pp. 136-141.
33. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense twoframe stereo correspondence algorithms", Int. J. Comput. Vis., vol. 47, no. 1, pp. 7-42, 2002. (Pubitemid 34428419)
34. R. Horisaki, S. Irie, Y. Ogura, and J. Tanida, "Three-dimensional information acquisition using a compound imaging system", Opt. Rev., vol. 14, no. 5, pp. 347-350, 2007.
35. S. Perrin, A. Cassinelli, and M. Ishikawa, "Gesture recognition using laser-based tracking system", in Proc. 6th IEEE Int. Conf. Autom. Face Gesture Recog., May 2004, pp. 541-546.
36. B. Büttgen, T. Oggier, M. Lehmann, R. Kaufmann, and F. Lustenberger, "CCD/CMOS lock-in pixel for range imaging: Challenges, limitations and state-of-the-art", in Proc. 1st Range Imaging Res. Day, Zurich, Switzerland, 2005, pp. 21-32.
37. R. Lange and P. Seitz, "Solid-state time-of-flight range camera", IEEE J. Quantum Electron., vol. 37, no. 3, pp. 390-397, Mar. 2001. (Pubitemid 32286777)
38. A. Kolb, E. Barth, R. Koch, and R. Larsen, "Time-of-flight sensors in computer graphics", in Eurographics State Art Rep., 2009, pp. 119-134.
39. R. Crabb, C. Tracey, A. Puranik, and J. Davis, "Real-time foreground segmentation via range and color imaging", Comput. Vis. Pattern Recog. Workshop, pp. 1-5, Jun. 2008.
40. M. B. Holte, T. B. Moeslund, and P. Fihl, "View invariant gesture recognition using the CSEM SwissRanger SR-2 camera", Int. J. Intell. Syst. Technol. Appl., 2008, pp. 295-303.
41. S. Acharya, C. Tracey, and A. Rafii, "System design of time-of-flight range camera for car park assist and backup application", in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-6.
42. G. Yahav, G. J. Iddan, and D. Mandelboum, "3D imaging camera for gaming application", in Proc. Int. Conf. Consum. Electron., Jan. 2007, pp. 1-2.
43. S. Y. Chen, Y. F. Li, and J. W. Zhang, "Vision processing for real-time 3D data acquisition based on coded structured light", IEEE Trans. Image Process., vol. 17, no. 2, pp. 167-176, Feb. 2008. (Pubitemid 351279245)
44. C. Guan, L. G. Hassebrook, and D. Lau, "Near-infrared composite pattern projection for continuous motion hand-computer interaction", J. Vis. Commun. Image Representation, vol. 18, no. 2, pp. 141-150, 2007. (Pubitemid 46497833)
45. L. A. Ypsilos, A. Hilton, and S. Rowe, "Video-rate capture of dynamic face shape and appearance", in Proc. 6th IEEE Int. Conf. Autom. Face Gesture Recog., May 2004, pp. 117-122.
46. T. G. Zimmerman, J. Lanier, C. Blanchard, S. Bryson, and Y. Harvill, "A hand gesture interface device", in Proc. SIGCHI/GI Conf. Human Factors Comput. Syst. Graph. Interface, 1987, pp. 189-192.
47. K. Kalgaonkar and B. Raj, "One-handed gesture recognition using ultrasonic Doppler sonar", in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Apr. 2009, pp. 1882-1899.
48. H. Ketabdar, K. A. Yüksel, and M. Roshandel, "MagiTact: Interaction with mobile devices based on compass (Magnetic) sensor", in Proc. 14th Int. Conf. Intell. User Interfaces, Hong Kong, China, 2010, pp. 413-414.
49. T. Pylvanainen, "Accelerometer based gesture recognition using continuous HMMs", in LNCS: Pattern Recogition and Image Analysis. Berlin, Germany: Springer-Verlag, 2005, pp. 639-646. (Pubitemid 41351502)
50. N. Crampton, K. Fox, H. Johnston, and A. Whitehead, "Dance, dance evolution: Accelerometer sensor networks as input to video games", in Proc. IEEE Int. Workshop Haptic, Audio, Vis. Environ. Games, Oct. 2007, pp. 107-112.
51. J. Wu, G. Pan, D. Zhang, G. Qi, and S. Li, "Gesture recognition with a 3-D accelerometer", in Proc. Ubiquitous Intell. Comput.: Lecture Notes Comput. Sci., 2009, vol. 5585/2009, pp. 25-38.
52. R. Amstutz, Ol. Amft, B. French, A. Smailagic, D. Siewiorek, and G. Tröster, "Performance analysis of an HMM-based gesture recognition using a wristwatch device", in Proc. Int. Conf. Comput. Sci. Eng., 2009, vol. 2, pp. 303-309.
53. K. Ishii, K. Zhao, M. Inami, T. Igarashi, and M. Imai, "Designing laser gesture interface for robot control", in Proc. INTERACT 2009 12th IFIP TC13 Conf. Human-Comput. Interaction, pp. 479-492.
54. R. Y. Wang and J. Popović, "Real-time hand tracking with a color glove", ACM Trans. Graph., vol. 28, no. 3, pp. 1-8, art. no. 63.
55. D. Struman and D. Zeltzer, "A survey of glove-based input", IEEE Comput. Graph. Appl., vol. 14, no. 1, pp. 30-39, Jan. 1994.
56. N. Joshi, S. Avidan, W. Matusik, and D. Kriegman, "Synthetic aperture tracking: Through occlusions", in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2007, pp. 1-8.
57. T. T. Santos and C. H. Morimoto, "People detection under occlusion in multiple camera views", in Proc. XXI Brazilian Symp. Comput. Graph. Image Process., Oct. 2008, pp. 53-60.
58. M. Keck and J. W. Davis, "3D occlusion recovery using few cameras", in Proc. IEEE Conf. Comput. Vision Pattern Recog., Anchorage, AK, Jun. 2008, pp. 1-8.
59. P. Turaga and Y. Ivanov, "Diamond sentry: Integrating cameras and sensors for real-timemonitoring of indoor spaces", IEEE Sensors J., vol. 11, no. 3, pp. 593-602, Mar. 2011.
60. M. Hirsch, D. Lanman, H. Holtzman, and R. Raskar, "BiDi screen: A thin, depth-sensing LCD for 3D interaction using light fields", in Proc. SIGGRAPH Asia, 2009, vol. 28, no. 5.
61. J. Fraden, AIP Handbook of Modern Sensors. Melville, NY: Amer. Inst. Phys., 1993.
62. A. Nishikawa, M. Nishimura, A. Hirano, K. Koara, and F. Miyazaki, "Systematic selection of local correlation parameters for optical flowbased gesture recognition", in Proc. IEEE Int. Workshop Robot Human Interaction, 1999, pp. 183-188.
63. D. Murray and A. Basu, "Motion tracking with an active camera", IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 5, pp. 449-459, May 1994.
64. W. Karwowski, Handbook on Standards and Guidelines in Ergonomics and Human Factors. Mahwah, NJ: Lawrence Erlbaum Assoc., 2006.
65. F. Wang and X. Ren, "Empirical evaluation for finger input properties in multi-touch interaction", in Proc. 27th Int. Conf. Human Factors Comput. Syst., 2009, pp. 1069-1072.
66. P. Kakumanu, S. Makrogiannis, and N. Bourbakis, "A survey of skin-color modeling and detectionmethods", Pattern Recog., vol. 40, pp. 1106-1122, 2007.
67. H. Stern and B. Efros, "Adaptive color space switching for tracking under varying illumination", Image Vision Comput., vol. 23, no. 3, pp. 353-364, 2005. (Pubitemid 40206231)
68. S. G. Kong, J. Heo, B. R. Abidi, J. Paik, and M. A. Abidi, "Recent advances in visual and infrared face recognition-A review", Comput. Vis. Image Understanding, vol. 97, no. 1, pp. 103-135, 2005. (Pubitemid 40049163)
69. D. A. Socolinsky, A. Selinger, and J. D. Neuheisel, "Face recognition with visible and thermal infrared imagery", Comput. Vis. Image Understanding, vol. 91, no. 1-2, pp. 72-114, 2003.
70. B. B. Bederson, R. S. Wallace, and E. L. Schwartz, "A miniaturized active vision system", in Proc. 11th IAPR Int. Conf. Pattern Recog., 1992, pp. 58-61.
71. J. Wachs, H. Stern, Y. Edan, M. Gillam, C. Feied, M. Smith, and J. Handler, "A hand gesture sterile tool for browsing MRI images in the OR", J. Am. Med. Inform. Assoc., vol. 15, no. 3, pp. 321-323, 2008. (Pubitemid 351626631)
72. C. Graetzel, T. W. Fong, S. Grange, and C. Baur, "A non-contact mouse for surgeon-computer interaction", Technol. Health Care, vol. 12, no. 3, pp. 245-257, 2004. (Pubitemid 39158728)
73. R. Swaminathan, M. D. Grossberg, and S. K. Nayar, "Aperspective on distortions", in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Jun., 2003, vol. 2, pp. I-594-601.
74. E. H. Adelson and J. Y. A. Wang, "Single lens stereo with a plenoptic camera", IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 99-106, Feb. 1992.
75. T. E. Bishop and P. Favaro, "Plenoptic depth estimation from multiple aliased views", in Proc. Int. Workshop 3-D Digital Imaging Modeling, 2009, pp. 1622-1629.
76. J. Neumann, C. Fermuller, and Y. Aloimonos, "A hierarchy of cameras for 3D photography", in Proc. Int. Symp. 3D Data Process. Vis. Transmiss., pp. 2-11, 2002.
77. T. Georgiev, A. Lumsdaine, and G. Chunev, "Using focused plenoptic cameras for rich image capture", IEEE Comput. Graph. Appl., vol. 31, no. 1, pp. 62-73, Jan. 2011.
78. V. Drazic, "Optimal depth resolution in plenoptic imaging", in Proc. IEEE Int. Conf. Multimedia Expo., Jul. 2010, pp. 1588-1593.
79. W. Jiang, M. Shimizu, and M. Okutomi, "Single-camera multi-baseline stereo using fish-eye lens and mirrors", in Proc. Comput. Vision, 2010, pp. 347-358.
80. E. S. Shijagurumayum and F. Chang, "Preliminary survey of multiview synthesis technology", in Proc. 6th Int. Conf. Intell. Inf. Hiding Multimedia Signal Process., Oct. 2010, pp. 163-166.