Nomadic gestures: A technique for reusing gesture commands for frequent ambient interactions

Journal of Ambient Intelligence and Smart Environments

Volumn 4, Issue 2, 2012, Pages 79-93

  Vatavu, Radu Daniel ^a  

^a STEFAN CEL MARE UNIVERSITY OF SUCEAVA   (Romania)

Author keywords

Ambient displays; ambient intelligence; ambient interactions; computer vision; gesture based interfaces; gestures; kinect; mobile phones; personalized and adapted interaction

Indexed keywords

AMBIENT DISPLAYS; AMBIENT INTELLIGENCE; GESTURE-BASED INTERFACE; GESTURES; KINECT; PERSONALIZED AND ADAPTED INTERACTION;

COMPUTER VISION; MOBILE DEVICES; MOBILE PHONES;

ARTIFICIAL INTELLIGENCE;

EID: 84859456568     PISSN: 18761364     EISSN: None     Source Type: Journal    
DOI: 10.3233/AIS-2012-0137     Document Type: Article

References (61)

1. E. Aarts, R. Harwig and M. Schuurmans, Ambient Intelligence, in: The Invisible Future, P.J. Denning, ed., McGraw-Hill, Inc., New York, NY, USA, 2001, pp. 235-250.
2. E. Aarts and B. de Ruyter, New research perspectives on Ambient Intelligence, Journal of Ambient Intelligence and Smart Environments, IOS Press 1(1) (2009), 5-14.
3. C. Appert and S. Zhai, Using strokes as command shortcuts: Cognitive benefits and toolkit support, in: Proc. of the 27th International Conference on Human Factors in Computing Systems (CHI '09), ACM, New York, NY, USA, 2009, pp. 2289-2298.
4. D. Avis, A survey of heuristics for the weighted matching problem, Networks, John Wiley & Sons, Inc., 13 (1983), 475-493.
5. R. Ballagas, M. Rohs and J.G. Sheridan, Sweep and point and shoot: Phonecam-based interactions for large public displays, in: CHI '05 Extended Abstracts, ACM, New York, NY, USA, 2005, pp. 1200-1203.
6. O. Bau and W.E. Mackay, OctoPocus: A dynamic guide for learning gesture-based command sets, in: Proc. of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08), ACM, New York, NY, USA, 2008, pp. 37-46.
7. S. Boring, M. Jurmu and A. Butz, Scroll, tilt or move it: Using mobile phones to continuously control pointers on large public displays, in: Proc. of the 21st Annual Conference of the Australian CHI Special Interest Group, OZCHI '09, Vol. 411, ACM, New York, NY, 2009, pp. 161-168.
8. R.A. Bolt, Put-that-there: Voice and gesture at the graphics interface, in: Proc. of the 7th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '80), ACM, New York, NY, USA, 1980, pp. 262-270.
9. A. Bragdon, R. Zeleznik, B. Williamson, T. Miller and J.J. LaViola Jr., GestureBar: Improving the approachability of gesture-based interfaces, in: Proc. of the 27th International Conference on Human Factors in Computing Systems (CHI '09), ACM, New York, NY, USA, 2009, pp. 2269-2278.
10. A. Bragdon and H.-S. Ko, Gesture select: Acquiring remote targets on large displays without pointing, in: Proc. of the 2011 Annual Conference on Human Factors in Computing Systems (CHI '11), ACM, New York, 2011, pp. 187-196.
11. W. Buxton, Multi-touch systems that I have known and loved, Microsoft Research, http://www.billbuxton.com/multitouchOverview.html (2011
12. R. Dachselt and R. Buchholz, Natural throw and tilt interaction between mobile phones and distant displays, in: Proc. of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (CHI '09), ACM, New York, NY, USA, 2009, pp. 3253-3258.
13. M. Duggan, Wii Game Creation for Teens, 1st edn, Course Technology Press, Boston, MA, USA, 2010.
14. E. Farella, S. O'Modhrain, L. Benini and B. Riccó, Gesture signature for ambient intelligence applications: A feasibility study, in: Pervasive Computing, K. Fishkin, B. Schiele, P. Nixon, A. Quigley, eds, Springer, Berlin /Heidelberg, 2006, pp. 288-304. (Pubitemid 44044764)
15. J.-D. Fekete, N. Elmqvist and Y. Guiard, Motion-pointing: Target selection using elliptical motions, in: Proc. of the 27th International Conference on Human Factors in Computing Systems (CHI '09), ACM, New York, NY, USA, 2009, pp. 289-298.
16. Y. Huang, D. Monekosso, H. Wang and J.C. Augusto, A concept grounding approach for glove-based gesture recognition, in: Proc. of the 7th International Conference on Intelligent Environments (IE'11), 2011, pp. 358-361.
17. S. Izadi, H. Brignull, T. Rodden, Y. Rogers andM. Underwood, Dynamo: A public interactive surface supporting the cooperative sharing and exchange of media, in: Proc. of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST '03), ACM, New York, 2003, pp. 159-168. (Pubitemid 40730685)
18. A. Jaimes and N. Sebe, Multimodal human-computer interaction: A survey. Computer Vision and Image Understing 108(1-2) (2007), 116-134. (Pubitemid 47333395)
19. G. Johnson, M.D. Gross, J. Hong and E.Y.-L. Do, Computational support for sketching in design: A review, Foundations and Trends in Human-Computer Interaction 2(1) (2009), (2009), 1-93.
20. S. Jorda, S.E. Hunter, P. Pla i Conesa, D. Gallardo, D. Leithinger, H. Kaufman, C.F. Julia and M. Kaltenbrunner, Development strategies for tangible interaction on horizontal surfaces, in: Proc. of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10), ACM, New York, NY, USA, 2010, pp. 369-372.
21. E. Keogh, Exact indexing of dynamic time warping, in: Proc. of the 28th International Conference on Very Large Data Bases (VLDB '02), VLDB Endowment, 2002, pp. 406-417.
22. A. Kendon, Gesture: Visible Action as Utterance, Cambridge University Press, 2004.
23. Kinect for XBox 360, http://www.xbox.com/kinect (2011
24. C. Kray, D. Nesbitt, J. Dawson andM. Rohs, User-defined gestures for connecting mobile phones, public displays, and tabletops, in: Proc. of MobileHCI '10, ACM, New York, NY, USA, 2010, pp. 239-248.
25. N.C. Krishnan, C. Juillard, D. Colbry and S. Panchanathan, Recognition of hand movements using wearable accelerometers, J. Ambient Intell. Smart Environ. 1(2) (2009), 143-155.
26. G. Kurtenbach and W. Buxton, The limits of expert performance using hierarchic marking menus, in: Proc. of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93), ACM, New York, NY, USA, 1993, pp. 482-487.
27. J.J. LaViola Jr. and R.C. Zeleznik, MathPad2: A system for the creation and exploration of mathematical sketches, in: ACM SIGGRAPH 2004 Papers (SIGGRAPH '04), J. Marks, ed., ACM, New York, NY, USA, 2004, pp. 432-440.
28. J.C. Lee, In search of a natural gesture, XRDS: Crossroads, The ACM Magazine for Students 16(4) (2010), 9-12.
29. M. Lew, E.M. Bakker, N. Sebe and T.S. Huang, Humancomputer intelligent interaction: A survey, in: Proc. of the 2007 IEEE International Conference on Human-Computer Interaction (HCI'07),M. Lew, E.M. Bakker,N. Sebe, and T.S.Huang, eds, Springer-Verlag, Berlin, Heidelberg, 2007, pp. 1-5.
30. Y. Li, Gesture search: A tool for fast mobile data access, in: Proc. of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST '10), ACM, New York, NY, USA, 2010, pp. 87-96.
31. S. Malik, A. Ranjan and R. Balakrishnan, Interacting with large displays from a distance with vision-tracked multi-finger gestural input, in: Proc. of UIST '05, ACM, New York, NY, USA, 2005, pp. 43-52. (Pubitemid 44531220)
32. D. McNeill, Hand and Mind. What Gestures Reveal about Thought, University of Chicago Press, 1996.
33. T.B. Moeslund, A. Hilton and V. Krüger, A survey of advances in vision-based human motion capture and analysis, Computer Vision and Image Understanding 104(2) (2006), 90-126. (Pubitemid 44573873)
34. M.R. Morris, J.O. Wobbrock and A.D. Wilson, Understanding users' preferences for surface gestures, in: Proc. of Graphics Interface 2010 (GI '10), Canadian Information Processing Society, Toronto, Ont., Canada, 2010, pp. 261-268.
35. T. Nakamura, S. Takahashi and J. Tanaka, Double-crossing: A new interaction technique for hand gesture interfaces, in: Proc. APCHI '08, Springer-Verlag, Berlin, Heidelberg, 2008, pp. 292-300.
36. M. Nancel, J. Wagner, E. Pietriga, O. Chapuis and W. Mackay, Mid-air pan-and-zoom on wall-sized displays, in: Proc. of the 2011 Annual Conference on Human Factors in Computing Systems (CHI '11), ACM, New York, NY, USA, 2011, pp. 177-186.
37. M. Nielsen, M. Storring, T.B. Moeslund and E. Granum, A procedure for developing intuitive and ergonomic gesture interfaces for HCI, in: Proc. of GW'2003: Gesture-Based Communication in Human-Computer Interaction, LNCS, Vol. 2915, Springer, Berlin /Heidelberg, 2003, pp. 409-420. (Pubitemid 38285461)
38. D.A. Norman, Natural user interfaces are not natural, ACM Interactions 17(3) (2010), 6-10.
39. D.A. Norman and J. Nielsen, Gestural interfaces: A step backward in usability, ACM Interactions 17(5) (2010), 46-49.
40. J. Norton, C.A.Wingrave and J.J. LaViola Jr., Exploring strategies and guidelines for developing full body video game interfaces, in: Proc. of the Fifth International Conference on the Foundations of Digital Games (FDG '10), ACM, New York, NY, USA, 2010, pp. 155-162.
41. C.H. Papadimitriou and K. Steiglitz, Combinatorial Optimization: Algorithms and Complexity, Dover Publications, 1998.
42. B. Paulson, D. Cummings and T. Hammond, Object interaction detection using hand posture cues in an office setting, International Journal of Human-Computer Studies 69(1-2) (2011), 19-29.
43. PlayStation Move Motion Controller, http://us.playstation. com/ps3/playstation-move/(2011
44. B. Pogorelc and M. Gams, Identification of gait patterns related to health problems of elderly, in: Ubiquitous Intelligence and Computing, Z. Yu, R. Liscano, G. Chen, D. Zhang, X. Zhou, eds, LNCS, Vol. 6406, Springer, Berlin /Heidelberg, 2010, pp. 179-191.
45. R. Poppe, Vision-based human motion analysis: An overview, Computer Vision and Image Understanding 108(1-2) (2007), 4-18. (Pubitemid 47333391)
46. J. Richarz and G.A. Fink, Visual recognition of 3D emblematic gestures in an HMM framework, J. Ambient Intell. Smart Environ. 3(3) (2011), 193-211.
47. J. Rico and S. Brewster, Usable gestures for mobile interfaces: Evaluating social acceptability, in: Proc. of CHI '10, ACM, New York, NY, USA, 2010, pp. 887-896.
48. J. Ruiz, Y. Li and E. Lank, User-defined motion gestures for mobile interaction, in: Proc. of the 2011 Annual Conference on Human Factors in Computing Systems (CHI '11), ACM, New York, NY, USA, 2011, pp. 197-206.
49. S.D. Scott, M. Sheelagh, T. Carpendale and K.M. Inkpen, Territoriality in collaborative tabletop workspaces, in: Proc. of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04), ACM, New York, NY, USA, 2004, pp. 294-303.
50. N. Sebe, Multimodal interfaces: Challenges and perspectives. Journal of Ambient Intelligence and Smart Environments 1(1) (2009), 23-30.
51. PlayStation Move Motion Controller, http://us.playstation. com/ps3/playstation-move/(2011
52. I.E. Sutherland, Sketchpad: A man-machine graphical communication system, in: Proc. of the May 21-23, 1963, Spring Joint Computer Conference (AFIPS '63 (Spring)), ACM,NewYork, NY, USA, 1963, pp. 329-346.
53. G. Shoemaker, A. Tang and K.S. Booth, Shadow reaching: A new perspective on interaction for large displays, in: Proc. of UIST '07, ACM, New York, NY, 2007, pp. 53-56. (Pubitemid 351429336)
54. R.D. Vatavu, Understanding challenges in designing interactions for the age of ambient media, in: Proc. of the 3rd International Workshop on Semantic Ambient Media Experience (SAME 2010), Malaga, Spain, Tampere University Press, 2010, pp. 8-13.
55. D. Vlasic, R. Adelsberger, G. Vannucci, J. Barnwell, M. Gross, W. Matusik and J. Popovic, Practical motion capture in everyday surroundings. ACM Transactions on Graphics 26(3) Article 35 (2007
56. D. Vogel and R. Balakrishnan, Interactive public ambient displays: Transitioning from implicit to explicit, public to personal, interaction with multiple users, in: Proc. of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04), ACM, New York, NY, USA, 2004, pp. 137-146. (Pubitemid 40787675)
57. D. Vogel and R. Balakrishnan, Distant freehand pointing and clicking on very large, high resolution displays, in: Proc. of the 18th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, 2005, pp. 33-42. (Pubitemid 44531219)
58. Nintendo Wii, http://wii.com//.
59. J.O. Wobbrock, M.R. Morris and A.D. Wilson, User-defined gestures for surface computing, in: Proc. of the 27th International Conference on Human Factors in Computing Systems (CHI '09), ACM, New York, NY, USA, 2009, pp. 1083-1092.
60. R. Zeleznik and T. Miller, Fluid inking: Augmenting the medium of free-form inking with gestures, in: Proc. of Graphics Interface 2006 (GI '06), Canadian Information Processing Society, Toronto, Ont., Canada, 2006, pp. 155-162.
61. S. Zhai, P.O. Kristensson, P. Gong, M. Greiner, S.A. Peng, L.M. Liu and A. Dunnigan, Shapewriter on the iphone: From the laboratory to the real world, in: Proc. of CHI '09, ACM, New York, NY, USA, 2009, pp. 2667-2670.