Mime: Compact, low-power 3D gesture sensing for interaction with head-mounted displays

UIST 2013 - Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology

Volumn , Issue , 2013, Pages 227-236

  Colaço, Andrea ^a   Kirmani, Ahmed ^b,c   Yang, Hye Soo ^a   Gong, Nan Wei ^a   Schmandt, Chris ^a   Goyal, Vivek K ^b  

^a MIT MEDIA LAB   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c Department of Electrical Engineering and Computer Science   (United States)

Author keywords

3D sensing; Gesture sensing; Glasses; Hand tracking; Head mounted displays; Mobile; Time of flight imaging

Indexed keywords

3-D SENSING; GESTURE SENSING; HAND TRACKING; HEAD MOUNTED DISPLAYS; MOBILE; TIME-OF-FLIGHT IMAGING;

CAMERAS; GLASS; SENSORS; SIGNAL PROCESSING; THREE DIMENSIONAL; USER INTERFACES;

HELMET MOUNTED DISPLAYS;

EID: 84887571717     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2501988.2502042     Document Type: Conference Paper

References (20)

1. Bailly, G., Müller, J., Rohs, M., Wigdor, D., and Kratz, S. ShoeSense: A new perspective on gestural interaction and wearable applications. In Proc. ACM Ann. Conf. Human Factors in Comput. Syst. (2012).
2. Chen, X. A., Marquardt, N., Tang, A., Boring, S., and Greenberg, S. Extending a mobile device's interaction space through body-centric interaction. In Proc. 14th ACM Int. Conf. Human-Computer Interaction with Mobile Devices and Services (2012).
3. Fredembach, C., Barbuscia, N., and Süsstrunk, S. Combining visible and near-infrared images for realistic skin smoothing. In Proc. IS&T/SID 17th Color Imaging Conf. (2009).
4. Gustafson, S., Bierwirth, D., and Baudisch, P. Imaginary interfaces: Spatial interaction with empty hands and without visual feedback. In Proc. ACM Symp. User Interface Softw. Tech. (2010).
5. Harrison, C., Benko, H., and Wilson, A. D. OmniTouch: Wearable multitouch interaction everywhere. In Proc. 24th Ann. ACM Symp. User Interface Softw. Tech. (2011).
6. Ho, K. C., Lu, X., and Kovavisaruch, L. Source localization using TDOA and FDOA measurements in the presence of receiver location errors: Analysis and solution. IEEE Trans. Signal Process. (2007).
7. Hong, Y., Lee, S., Lee, Y., and Kim, S. Mobile pointing and input system using active marker. In Proc. IEEE/ACM Int. Symp. Mixed & Augmented Reality (2006).
8. Jones, B., Sodhi, R., Forsyth, D., Bailey, B., and Maciocci, G. Around device interaction for multiscale navigation. In Proc. Conf. HCI with Mobile Devices and Services (2012).
9. Kim, D., Hilliges, O., Izadi, S., Butler, A., Chen, J., Oikonomidis, I., and Olivier, P. Digits: Freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In ACM UIST (2012).
10. Kirmani, A., Colaço, A., Wong, F. N. C., and Goyal, V. K. Exploiting sparsity in time-of-flight range acquisition using a single time-resolved sensor. Opt. Expr. 19, 22 (Oct. 2011), 21485-21507.
11. Lange, R., and Seitz, P. Solid-state time-of-flight range camera. IEEE J. Quant. Electron. 37, 3 (2001), 390-397.
12. Lyons, K., Starner, T., Plaisted, D., Fusia, J., Lyons, A., Drew, A., and Looney, E. W. Twiddler typing: One-handed chording text entry for mobile phones. In SIGCHI Human Factors in Comput. Syst. (2004).
13. Mitra, S., and Acharya, T. Gesture recognition: A survey. IEEE Trans. Syst., Man, Cybernetics, Part C: Appl. Rev. 37, 3 (2007), 311-324.
14. Nelson, S. A., Lee, J. C., and Helgeson, M. A. Handheld computer apparatus. US Patent 6,911,969, 2005.
15. Newman, R. L., and Haworth, L. A. Flight displays II: Head-up and helmet-mounted displays. Spatial Disorientation in Aviation (2004).
16. Piekarski, W., and Thomas, B. ARQuake: The outdoor augmented reality gaming system. Commun. ACM 45, 1 (2002), 36-38.
17. Smith, R., Piekarski, W., and Wigley, G. Hand tracking for low powered mobile AR user interfaces. In Proc. Sixth Australasian Conf. User Interface (2005).
18. Starner, T., Auxier, J., Ashbrook, D., and Gandy, M. The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. In IEEE Int. Symp. Wearable Comput. (2000).
19. Szeliski, R. Computer Vision: Algorithms and Applications. 2010.
20. Thomas, B. H., and Piekarski, W. Glove based user interaction techniques for augmented reality in an outdoor environment. Virtual Reality 6, 3 (2002), 167-180.