HeatWave: Thermal imaging for surface user interaction

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2011, Pages 2565-2574

  Larson, Eric ^a   Cohn, Gabe ^a   Gupta, Sidhant ^a   Ren, Xiaofeng ^b   Harrison, Beverly ^b   Fox, Dieter ^a,b   Patel, Shwetak N ^a  

^a UW   (United States)

^b INTEL CORPORATION   (United States)

Author keywords

Cameras; Computer vision; Gestures; Surface interaction; Thermal imaging; User interfaces

Indexed keywords

CAMERAS; COMPUTER VISION; INFRARED IMAGING;

ARBITRARY SURFACES; ENERGY AUDITING; GESTURE; HEATWAVES; RESEARCH COMMUNITIES; SURFACE INTERACTIONS; THERMAL IMAGING CAMERAS; THERMAL SENSING; THERMAL-IMAGING; USER INTERACTION;

USER INTERFACES;

EID: 79958139138     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1978942.1979317     Document Type: Conference Paper

References (38)

1. Arai, T., Machii, K. and Kuzunuki, S. Retrieving electronic documents with real-world objects on InteractiveDESK. In Proc. of UIST '95. New York: ACM Press, 1995, pp. 37-38.
2. Barras, C. Microsoft's body-sensing, button-busting controller. New Scientist: Technology. 7 Jan 2010.
3. Bradski, G.; Kaehler, A. (2008), Learning OpenCV: Computer Vision with the OpenCV Library
4. Cohen, C.J., Beach, G.J. and Foulk, G.A. Basic hand gesture control system for PC applications. In Proc. of AIPR '01. IEEE Computer Society, 2001, pp. 74.
5. Dietz, P. and Leigh, D. DiamondTouch: A multi-user touch technology. In Proc. of UIST '01. New York: ACM Press, 2001, pp. 219-226. (Pubitemid 34991287)
6. Duda, R. and Hart, P "Use of the Hough Transformation to Detect Lines and Curves in Pictures," Comm. ACM, Vol. 15, pp. 11-15, Jan., 1972
7. Felzenszwalb, P., McAllester, D., and Ramanan, D. A Discriminatively Trained, Multiscale, Deformable Part Model. In Proc. of IEEE CVPR '08, 2008.
8. Hilliges, O., Izadi, S., Wilson, A.D., Hodges, S., Garcia-Mendoza, A., Butz, A. Interactions in the air: adding further depth to interactive tabletops. In Proc. of UIST '09. New York: ACM Press, 2009, pp. 139-148.
9. Iwai, D. and Sato, K. "Heat Sensation in Image Creation with Thermal Vision", ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE2005), pp.213-216, Jun. 2005.
10. Iwai, D. and Sato K, "Limpid Desk: theoretical papers of transparent projection of Mixed Reality", IPSJ, vol.48, no.3, pp.1294-1306, 2007.
11. Izadi, S., Hodges, S. Taylor, S., Rosenfeld, D., Villar, N., Butler, A., Westhues, J. Going beyond the display: a surface technology with an electronically switchable diffuser. In Proc. of UIST '09. New York: ACM Press, 2009, pp. 269-278.
12. Kane, S., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A.D., Philipose, M., LaMarca, A. Bonfire: a nomadic systems for hybrid laptop-tabletop interaction. In Proc. of UIST '09. New York: ACM Press, 2009.
13. Khan, M.M., Ingleby, M., and Ward, R.D. Automated Facial Expression Classification and affect interpretation using infrared measurement of facial skin temperature variations. ACM Trans. on Autonomous and Adaptive Systems, 2006.
14. Khan, M.M., Ward, R.D., and Ingleby, M. Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature. ACM Trans. on Applied Perception, 2009.
15. nd ed. New York: W.H. Freeman, 1980.
16. Kong, S.G., Heo, J., Boughorbel, F., Zheng, Y., Abidi, B.R., Koschan, A., Yi, M., and Abidi, M.A. Multiscale Fusion of Visible and Thermal IR Images for Illumination-Invariant Face Recognition. Inte rnational Journal of Computer Vision, 2007.
17. Kurtenbach, G. The Design and Evaluation of Marking Menus, Ph.D. Thesis, Department of Computer Science, University of Toronto. May 1993.
18. Lee, J., Hudson, S., Summet, J., and Dietz, P. Moveable interactive projected displays using projector based tracking. In Proc. of UIST '05. New York: ACM Press, 2005, pp. 63-72. (Pubitemid 44531222)
19. Letessier, J. and Bérard, F. Visual tracking of bare fingers for interactive surfaces. In Proc. of UIST '04. New York: ACM Press, 2004, pp. 119-122. (Pubitemid 40787672)
20. Manresa, C., Varona, J., Mas, R. and Perales, F. Hand tracking and gesture recognition for humancomputer interaction. Electronic Letters on Computer Vision and Image Analysis, 5 (3), 2005, pp. 96-104.
21. Marshall, J., Pridmore, T., Pound, M., Benford, S., Koleva, B. Pressing the Flesh: Sincing Multiple Touch and Finger Pressure on Arbitrary Surfaces. In Proc. of Pervasive '08. Berlin: Springer-Verlag, 2008, pp. 38-55. (Pubitemid 351777348)
22. Microsoft Surface. http://www.microsoft.com/surface
23. Oka, K., Sato, Y. and Koike, H. "Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems." IEEE Computer Graphics and Applications. Vol. 22, No. 6, pp. 64-71, 2002.
24. Otsu, N, "A threshold selection method from gray-level histograms". IEEE Trans. Systems, Man, and Cybernetics. 9: 62-66, 1972
25. Pavlidis, I., Dowdall, J., Sun, N., Puri, C., Fei, J., and Garbey, M. Interacting with human physiology. Computer Vision and Image Understanding, 2007.
26. Puri, C., Olson, L., Pavlidis, I., Levine, J., and Starren, J. StressCam: non-contact measurement of users' emotional states through thermal imaging. In Proc. of CHI '05, 2005.
27. Quinlan, J. R. C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, 1993.
28. RazIR. NANO Thermal Camera, http://raz-ir.com/raz-ir-nano-thermal- infrared-camera.html.
29. Rekimoto, J. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proc. of CHI '02. New York: ACM Press, 2002, pp. 113-120.
30. Saletan, W. Heat Check: Swine flu, body heat, and airport scanners. http://www.slate.com/id/2217148/, 28 April 2009.
31. Sato, Y., Kobayashi, Y., and Koike, H. "Fast tracking of hands and fingertips in infrared images for augmented desk interface," Proc. 2000 IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2000), pp. 462-467, March 2000.
32. Tanriverdi, V. and Jacob R.J.K. Interacting with eye movements in virtual environments. In Proc. of CHI '00. New York: ACM Press, 2000, pp. 265-272.
33. Wellner, P. Interacting with paper on the DigitalDesk. Communications of the ACM, 36 (7), 1993, pp. 87-96.
34. Wilson, A. D. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proc. of UIST '05. New York: ACM Press, 2005, pp. 83-92. (Pubitemid 44531224)
35. Witten, I. and Frank, E.: "Data Mining: Practical machine learning tools and techniques", 2nd Edition, Morgan Kaufmann, San Francisco (2005).
36. Wong, W.K., Tan, P.N., Loo, C.K., and Lim, W.S. An Effective Surveillance System Using Thermal Camera. In Proc. of International Conference on Signal Acquisition and Processing, 2009.
37. Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multiuser tabletop displays. In Proc. of UIST '03. New York: ACM Press, 2003, pp. 193-202. (Pubitemid 40730689)
38. Yun, C., Shastri, D., Pavlidis, I., and Deng, Z. O' game, can you feel my frustration?: improving user's gaming experience via stresscam. In Proc. of CHI '09, 2009.