User-defined surface+motion gestures for 3D manipulation of objects at a distance through a mobile device

APCHI'12 - Proceedings of the 2012 Asia Pacific Conference on Computer-Human Interaction

Volumn , Issue , 2012, Pages 299-308

  Liang, Hai Ning ^a,b   Williams, Cary ^b   Semegen, Myron ^c   Stuerzlinger, Wolfgang ^d   Irani, Pourang ^b  

^a XI AN JIAOTONG LIVERPOOL UNIVERSITY   (China)

^b UNIVERSITY OF MANITOBA   (Canada)

^c Industrial Technology Centre   (Canada)

^d YORK UNIVERSITY   (Canada)

Author keywords

3D visualizations; Collaboration interfaces; Input devices; Interaction techniques; Mobile devices; Motion gestures; Multi display environments; Surface gestures

Indexed keywords

HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; MOBILE DEVICES; THREE DIMENSIONAL COMPUTER GRAPHICS;

3D VISUALIZATION; INPUT DEVICES; INTERACTION TECHNIQUES; MOTION GESTURES; MULTI DISPLAY ENVIRONMENTS;

THREE DIMENSIONAL DISPLAYS;

EID: 84866880577     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2350046.2350098     Document Type: Conference Paper

References (41)

1. Baudisch, P. and Chu, G. (2009). Back-of-device Interaction allows creating very small touch devices. CHI'09. pp. 1923 - 1932.
2. Boring, S., Baur, D., Butz, A., Gustafson, S., and Baudisch, P. (2010). Touch Projector: Mobile Interaction Through Video. CHI'10, pp. 2287-2296.
3. Bragdon, A., Nelson, E., Li, Y., and Hinckley, K. (2011). Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environments. CHI'11, pp. 403-412.
4. Davidson, P. L. and Han, J. Y. (2008). Extending 2D object arrangement with pressure-sensitive layering cues. UIST'08, pp. 87-90.
5. Grossman, T., Balakrishnan, R., Kurtenbach, G., Fitzmaurice, G.W., Khan, A., and Buxton, W. (2001). Interaction techniques for 3D modeling on large displays. I3DG'01, pp. 17-23.
6. Grossman, T. and Wigdor, D. (2007). Going Deeper: a Taxonomy of 3D on the Tabletop. Proc. IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pp. 137-144.
7. Hancock, M., Carpendale, S., and Cockburn, A. (2007). Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques. CHI'07, pp. 1147-1156.
8. Hancock, M., ten Cate, T. and Carpendale, S. (2009). Sticky Tools: Full 6DOF Force-Based Interaction for Multi-Touch Tables. ITS'09, pp. 145-152.
9. Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., and But, A. (2009). Interactions in the Air: Adding Further Depth to Interactive Tabletops. UIST'09, pp. 139-147.
10. Hinrichs, U. and Carpendale, S. (2011). Gestures in the Wild: Studying Multi-Touch GestureSequences on Interactive Tabletop Exhibits. CHI '11, pp. 3023-3032.
11. Jones, E., Alexander, J., Andreou, A., Irani, P., and Subramanian, S. (2010). GesText: Accelerometer-Based Gestural Text-Entry Systems. CHI '10, pp. 2173-2182.
12. Kane, S.K., Bigham, J.P. and Wobbrock, J.O. (2008). Slide Rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques. ASSETS '08, pp. 73-80.
13. Kin, K., Hartmann, B., and Agrawala, M. (2011). Twohanded marking menus for multitouch devices. ACM Trans on CHI, 18(3), 1-23.
14. Li, Y. (2010). Gesture Search: A Tool for Fast Mobile Data Access. UIST'10, pp. 87-96.
15. Liu, J., Zhong, L., Wickramasuriya, J., and Vasudevan, V. (2009). User evaluation of lightweight user authentication with a single tri-axis accelerometer. MobileHCI '09, pp. 1-10.
16. Lu, H. and Li, Y. (2011). Gesture Avatar: A Technique for Operating Mobile User Interfaces Using Gestures. CHI'11, pp. 207-216.
17. Malik, S., Ranjan, A., and Balakrishnan, R. (2005). Interacting with large displays from a distance with vision-tracked multi-finger gestural input. UIST'05 pp. 43-52.
18. Martinet, A., Casiez, G., and Grisoni, L. (2010). The effect of DOF separation in 3D manipulation tasks with multi-touch displays. VRST '10, pp. 111-118.
19. McAdam, C & Brewster, S. (2011). Using mobile phones to interact with tabletop computers. ITS'11, p. 232-241.
20. McCallum, D.C. and Irani, P. (2009). ARC-Pad: absolute+ relative cursor positioning for large displays with a mobile touchscreen. UIST '09, pp. 153-156.
21. Morris, M.R., Huang, A., Paepcke, A., and Winograd, T. (2006). Cooperative Gestures: Multi-User Gestural Interactions for Co-located Groupware. CHI'06, pp. 1201-1210.
22. Morris, M.R., Wobbrock, J., and Wilson, A. (2010). Understanding Users' Preferences for Surface Gestures. GI'10, pp. 261-268.
23. Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G., and Want, R. (2002). TiltType: accelerometer-supported text entry for very small devices. UIST '02, pp. 201-204.
24. Reisman, J.L., Davidson, P.L., and Han, J.Y. (2009). A screen-space formulation for 2D and 3D direct manipulation. UIST '09, pp. 69-78.
25. Rekimoto, J. (1996) Tilting operations for small screen interfaces. UIST '96, pp. 167-168.
26. Ruiz, J., Li, Y., and Lank. E. (2011). User-Defined Motion Gestures for Mobile Interaction. CHI'11, pp. 197-206.
27. Schuler, D. (1993). Participatory design: principles and practices. L. Erlbaum Associates, Hillsdale N.J., 1993
28. Scott, J., Izadi, S., Rezai, L. S., Ruszkowski, D., Bi, X., and Balakrishnan, R. (2010). RearType: Text Entry Using Keys on the Back of a Device. MobileHCI'10. pp. 171-180.
29. Silfverberg, M., Korhonen, P., and MacKenzie,I.S. (2006). Zoomig and panning content on a display screen. United States patent 7075513, July 11, 2006.
30. Stoakley, R., Conway, M.J., and Pausch, R. (1995). Virtual reality on a WIM: interactive worlds in miniature. CHI'95, pp. 265-272.
31. Sugimoto, M. and Hiroki, K. (2006). HybridTouch: an intuitive manipulation technique for pdas using their front and rear surfaces. Extended Abstracts of MobileHCI' 06. pp. 137-140.
32. Valkov, D., Steinicke, F., Bruder, G., and Hinrichs, K.H. (2011). 2D Touching of 3D Stereoscopic Objects. CHI'11, pp. 1353-1362.
33. Vlaming, L., Collins, C., Hancock, M., Nacenta, M., Isenberg, T. and Carpendale, S. (2012). Integrating 2D mouse emulation with 3D manipulation for visualizations on a multi-touch table. ITS'10, pp. 221-230.
34. Vogel, D. and Balakrishnan, R. (2004). Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. UIST'04, pp. 137-146.
35. Wigdor, D. and Balakrishnan, R. (2003). TiltText: Using tilt for text input to mobile phones. UIST '03, pp. 81-90.
36. Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. (2007). LucidTouch: A See-through Mobile Device. UIST'07. pp. 269-278.
37. Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. (2008). Bringing physics to the surface. UIST'08, pp. 67-76.
38. Wobbrock, J.O., Aung, H.H., Rothrock, B., and Myers, B.A. (2005). Maximizing the guessability of symbolic input. CHI '05 Extended Abstracts, 1869.
39. Wobbrock, J.O., Morris, M.R. and Wilson, A.D. (2009). User-defined gestures for surface computing. CHI'09, pp. 1083-1092.
40. Wobbrock, J. O., Myers, B. A., and Aung, H. H. (2008). The performance of hand postures in front- and back-ofdevice interaction for mobile computing. IJHCS. v66 (12), pp. 857-875.
41. Yang, X. D., Mak, E., Irani, P., and Bischof, W. F. (2009). Dual-Surface Input: Augmenting One-Handed Interaction with Coordinated Front and Behind-the-Screen Input. MobileHCI'09. pp. 1-10.