Dante vision: In-air and touch gesture sensing for natural surface interaction with combined depth and thermal cameras

2012 IEEE International Conference on Emerging Signal Processing Applications, ESPA 2012 - Proceedings

Volumn , Issue , 2012, Pages 167-170

  Saba, Elliot N ^a   Larson, Eric C ^a   Patel, Shwetak N ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

depth imaging; natural user interface; sensor fusion; thermal imaging

Indexed keywords

DEPTH IMAGING; DEPTH SENSING; GESTURE SENSING; MICROSOFT; MULTIPLE TOUCH; MULTIPLE USER; NATURAL SURFACE; PROCESSING DELAY; REAL TIME; SENSOR FUSION; TABLE-TOP; TEMPERATURE SENSING; THERMAL CAMERA; THERMAL IMAGING CAMERAS;

CAMERAS; INFRARED IMAGING; SIGNAL PROCESSING;

USER INTERFACES;

EID: 84858015959     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ESPA.2012.6152472     Document Type: Conference Paper

References (21)

1. S. K. Kane et al., "Bonfire: a nomadic system for hybrid laptoptabletop interaction," in Proceedings of the 22nd annual ACM symposium on User interface software and technology, 2009, pp. 129-138.
2. P. Wellner, "Interacting with paper on the DigitalDesk," Commun. ACM, vol. 36, no. 7, pp. 87-96, Jul. 1993.
3. A. D. Wilson, "PlayAnywhere: a compact interactive tabletop projection-vision system," in Proceedings of the 18th annual ACM symposium on User interface software and technology, 2005, pp. 83-92. (Pubitemid 44531224)
4. C. J. Cohen, G. J. Beach, and G. Foulk, "A Basic Hand Gesture Control System for PC Applications," in Proceedings of the 30th on Applied Imagery Pattern Recognition Workshop, 2001, p. 74.
5. A. D. Wilson, "Using a depth camera as a touch sensor," in ACM International Conference on Interactive Tabletops and Surfaces, 2010, pp. 69-72.
6. E. Larson et al., "HeatWave: thermal imaging for surface user interaction," in Proceedings of the 2011 annual conference on Human factors in computing systems, 2011, pp. 2565-2574.
7. K. Oka, Y. Sato, and H. Koike, "Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems," in Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, 2002, p. 0429.
8. O. Hilliges, S. Izadi, A. D. Wilson, S. Hodges, A. Garcia-Mendoza, and A. Butz, "Interactions in the air: adding further depth to interactive tabletops," in Proceedings of the 22nd annual ACM symposium on User interface software and technology, 2009, pp. 139-148.
9. C. Manresa, J. Varona, R. Mas, and F. Perales, "Hand tracking and gesture recognition for human-computer interaction," Electronic letters on computer vision and image analysis, vol. 5, no. 3, pp. 96-104, 2005.
10. M. Wu and R. Balakrishnan, "Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays," in Proceedings of the 16th annual ACM symposium on User interface software and technology, 2003, vol. 5, no. 2, pp. 193-202. (Pubitemid 40730689)
11. J. Marshall, T. Pridmore, M. Pound, S. Benford, and B. Koleva, "Pressing the flesh: Sensing multiple touch and finger pressure on arbitrary surfaces," Pervasive Computing, pp. 38-55, 2008. (Pubitemid 351777348)
12. A. Simonsson, "Exploring gesture based interaction and visualizations for supporting collaboration," 2011.
13. Y. Sato and Y. Kobayashi, "Fast tracking of hands and fingertips in infrared images for augmented desk interface," pp. 462-467, 2000.
14. J. Wachs and H. Stern, "Vision-based hand-gesture applications," Communications of the ACM, vol. 54, no. 2, p. 60, Feb. 2011.
15. "Kinect for Windows SDK beta," http://research.microsoft.com/ enus/um/redmond/projects/kinectsdk/default.aspx.
16. "RazIR Nano Thermal Camera," http://raz-ir.com/raz-ir- nanothermal-infrared-camera.html.
17. G. Bradski and A. Kaehler, Learning OpenCV: Computer vision with the OpenCV library. O'Reilly Media, 2008.
18. N. Otsu, "A Threshold Selection Method from Gray-Level Histograms," Systems, Man and Cybernetics, IEEE Transactions on, vol. 9, no. 1, pp. 62-66, 1979. (Pubitemid 9413341)
19. H. Kato and T. Kato, "A marker-less Augmented Reality based on fast fingertip detection for smart phones," in Consumer Electronics (ICCE), 2011 IEEE International Conference on, 2011, pp. 127-128.
20. J. R. Quinlan, C4.5: programs for machine learning. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 1993.
21. I. H. Witten and E. Frank, Data Mining: Practical Machine Learing Tools and and Techniques, Second Edi. 2005.