A comparative study of user-defined handheld vs. freehand gestures for home entertainment environments

Journal of Ambient Intelligence and Smart Environments

Volumn 5, Issue 2, 2013, Pages 187-211

  Vatavu, Radu Daniel ^a  

^a STEFAN CEL MARE UNIVERSITY OF SUCEAVA   (Romania)

Author keywords

freehand; gestural interfaces; gesture elicitation study; gesture set; Gesture based interaction; handheld; home entertainment; human computer interaction; Kinect; participatory design; user adapted interaction; Wii

Indexed keywords

FREEHAND; GESTURAL INTERFACES; GESTURE ELICITATION STUDY; GESTURE SET; GESTURE-BASED INTERACTION; HANDHELDS; HOME ENTERTAINMENT; KINECT; PARTICIPATORY DESIGN; USER-ADAPTED INTERACTION; WII;

ARTIFICIAL INTELLIGENCE; HUMAN COMPUTER INTERACTION;

SOFTWARE ENGINEERING;

EID: 84876274780     PISSN: 18761364     EISSN: None     Source Type: Journal    
DOI: 10.3233/AIS-130200     Document Type: Article

References (63)

1. E. Aarts, Ambient Intelligence: A multimedia perspective, IEEE MultiMedia 11(1) (2004), 12-19.
2. E. Aarts and B. de Ruyter, New research perspectives on Ambient Intelligence, Journal of Ambient Intelligence and Smart Environments, IOS Press 1(1) (2009), pp. 5-14.
3. D. Ashbrook and T. Starner, MAGIC: A motion gesture design tool, in: Proc. of the 28th International Conference on Human Factors in Computing Systems (CHI '10), ACM, New York, NY, USA, 2010, pp. 2159-2168.
4. L. Baillie and D. Benyon, Place and technology in the home, Comput. Supported Coop. Work 17(2-3) (2008), 227-256. (Pubitemid 351572868)
5. G. Bailly, D.-B. Vo, E. Lecolinet, and Y. Guiard, Gestureaware remote controls: Guidelines and interaction technique, in: Proc. of the 13th International Conference on Multimodal Interfaces (ICMI '11), ACM, New York, NY, USA, 2011, pp. 263-270.
6. R. Bernhaupt, M. Obrist, A. Weiss, E. Beck, and M. Tscheligi, Trends in the living room and beyond: Results from ethnographic studies using creative and playful probing, Comput. Entertain. 6(1) Article 5 (2008), 23. DOI: 10.1145/1350843.1350848.
7. F. Block, A. Schmidt, N. Villar, and H.-W. Gellersen, Towards a playful user interface for home entertainment systems, in: Proc. of the European Symposium on Ambient Intelligence, Springer, 2004, pp. 207-217. (Pubitemid 39743853)
8. R.A. Bolt, Put-that-there: Voice and gesture at the graphics interface, in: Proc. of the 7th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '80), ACM, New York, NY, USA, 1980, pp. 262-270.
9. A.G. Canizares, Fun Rooms: Home Theaters, Music Studios, Game Rooms, and More, Harper Design, 2006.
10. X. Cao and S. Zhai, Modeling human performance of pen stroke gestures, in: Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07), ACM, New York, NY, USA, 2007, pp. 1495-1504. (Pubitemid 47581741)
11. F. Cardinaux, D. Bhowmik, C. Abhayaratne, andM.S. Hawley, Video based technology for ambient assisted living: A review of the literature, J. Ambient Intell. Smart Environ. 3(3) (2011), 253-269.
12. M.-y. Chen, L. Mummert, P. Pillai, A. Hauptmann, and R. Sukthankar, Controlling your TV with gestures, in: Proc. of the International Conference on Multimedia Information Retrieval (MIR '10), ACM, New York, NY, USA, 2010, pp. 405-408.
13. D. Cotting and M. Gross, Interactive environment-aware display bubbles, in: Proc. of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06), ACM, New York, NY, USA, 2006, pp. 245-254. (Pubitemid 47142447)
14. P. Fagerberg, A. Ståhl, and K. Höök, Designing gestures for affective input: An analysis of shape, effort and valence, in: Proc. of MUM2003, Norrköping, Sweden, 2003, pp. 57-65.
15. W.T. Freeman and C. Weissman, Television control by hand gestures, in: Int. Workshop IEEE FG'95, 1995, pp. 179-183.
16. C. Holz and P. Baudisch, Understanding touch, in: Proc. of the 2011 Annual Conference on Human Factors in Computing Systems (CHI '11), ACM, New York, NY, USA, 2011p, pp. 2501-2510.
17. A. Ibrahim and P. Johansson, Multimodal dialogue systems for Interactive TV applications, in: Proc. of the 4th IEEE International Conference on Multimodal Interfaces (ICMI '02), IEEE Computer Society, Washington, DC, USA, 2002.
18. P. Isokoski, Model for unistroke writing time, in: Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01), ACM, New York, NY, USA, 2001, pp. 357-364. (Pubitemid 32399784)
19. A. Jaimes and N. Sebe, Multimodal human-computer interaction: A survey, Comput. Vis. Image Underst. 108(1-2) (2007), 116-134, DOI:10.1016/j.cviu.2006. 10.019. (Pubitemid 47333395)
20. F. Jensen, Interactive television: New genres, new format, new content, in: Proc. of the Second Australasian Conference on Interactive Entertainment (IE 2005), Creativity & Cognition Studios Press, Sydney, Australia, 2005, pp. 89-96.
21. Y. Kawasaki, T. Igarashi, T. Ajioka, and I. Honda, Vision-based gestural interaction using plush toys, in: ACM UIST'05, 2005.
22. S.-H. Kim, J. Ok,H.J. Kang,M.-C. Kim, andM.Kim,An interaction and product design of gesture based TV remote control, in: CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04), ACM, New York, NY, USA, 2004, p. 1548.
23. M. Kohler, Special topics of gesture recognition applied in intelligent home environments, in: GW'1997, LNCS, Vol. 1471, Springer, Heidelberg, 1998, pp. 285-296. (Pubitemid 128067894)
24. C. Kray, D. Nesbitt, J. Dawson, and M. Rohs, User-defined gestures for connecting mobile phones, public displays, and tabletops, in: Proc. of MobileHCI '10, ACM, New York, NY, USA, 2010, pp. 239-248.
25. C. Kühnel, T. Westermann, F. Hemmert, S. Kratz, A. Müller, and S. Möller, I'm home: Defining and evaluating a gesture set for smart-home control, International Journal of Human-Computer Studies 69(11) (2011), 693-704, DOI: 10.1016/j.ijhcs.2011.04.005.
26. G. Lekakos, K. Chorianopoulos, and G. Doukidis, Interactive Digital Television: Technologies and Applications, IGI Publishing, Hershey, PA, USA, 2007.
27. J.C. Lee, S.E. Hudson, J.W. Summet, and P.H. Dietz, Moveable interactive projected displays using projector based tracking, in: Proc. of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05), ACM, NewYork, NY, USA, 2005, pp. 63-72. (Pubitemid 44531222)
28. S. Lenman, L. Bretzner, and B. Thuresson, Using marking menus to develop command sets for computer vision based hand gesture interfaces, in: Proc. of the Second Nordic Conference on Human-Computer Interaction (NordiCHI '02), ACM, New York, NY, USA, 2002, pp. 239-242.
29. A.C. Long Jr., J.A. Landay, L.A. Rowe, and J. Michiels, Visual similarity of pen gestures, in: Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '00), ACM, New York, NY, USA, 2000, pp. 360-367.
30. A.C. Long, J.A. Landay, and L.A. Rowe, Helping designers create recognition-enabled interfaces, in: Multimodal Interface for Human-Machine Communication, P.C. Yuen, Y.Y. Tang, and P.S.P. Wang, eds, Machine Perception and Artificial Intelligence, Vol. 48. World Scientific Publishing Co., Inc., River Edge, NJ, USA, 2002, pp. 121-146.
31. S. Malik, A. Ranjan, and R. Balakrishnan, Interacting with large displays from a distance with vision-tracked multi-finger gestural input, in: Proc. of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05), ACM, New York, NY, USA, 2005, pp. 43-52. (Pubitemid 44531220)
32. T.B. Moeslund, A. Hilton, and V. Krüger, A survey of advances in vision-based human motion capture and analysis, Computer Vision and Image Understanding 104(2) (2006), 90-126. (Pubitemid 44573873)
33. M.R. Morris, J.O. Wobbrock, and A.D. Wilson, Understanding users' preferences for surface gestures, in: Proc. of Graphics Interface 2010 (GI '10), Canadian Information Processing Society, Toronto, Ont., Canada, 2010, pp. 261-268.
34. M. Nielsen, M. Storring, T.B. Moeslund, and E. Granum, A procedure for developing intuitive and ergonomic gesture interfaces for HCI, in: Proc. of GW'2003: Gesture-Based Communication in Human-Computer Interaction, LNCS 2915, Springer, Berlin, Heidelberg, 2003, pp. 409-420. (Pubitemid 38285461)
35. D.A. Norman, Natural user interfaces are not natural, ACM Interactions 17(3) (2010), 6-10.
36. J.K. Perng, B. Fisher, S. Hollar, and K.S.J. Pister, Acceleration sensing glove, in: Proc. of the 3rd IEEE International Symposium on Wearable Computers (ISWC '99), IEEE Computer Society, Washington, DC, USA, 1999.
37. B. Pogorelc, Z. Bosnic, and M. Gams, Automatic recognition of gait-related health problems in the elderly using machine learning, Multimed Tools Appl. 58 (2012), pp. 333-354, DOI:10.1007/s11042-011-0786-1.
38. R. Poppe, Vision-based human motion analysis: An overview, Computer Vision and Image Understanding 108(1-2) (2007), 4-18. (Pubitemid 47333391)
39. M. Rehm, N. Bee, and E. André, Wave like an Egyptian: Accelerometer based gesture recognition for culture specific interactions, in: Proc. of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction-Volume 1 (BCS-HCI '08), British Computer Society, Swinton, UK, 2008, pp. 13-22.
40. D. Rubine, Specifying gestures by example, SIGGRAPH Comput. Graph. 25(4) (1991), 329-337. DOI: 10.1145/127719.122753.
41. J. Ruiz, Y. Li, and E. Lank, User-defined motion gestures for mobile interaction, in: Proc. of the 2011 Annual Conference on Human Factors in Computing Systems (CHI '11), ACM, New York, NY, USA, 2011, pp. 197-206.
42. K. Rushing, Home Theater Design: Planning and Decorating Media-Savvy Interiors, Quarry Books, 2006.
43. F. Sadri, Ambient intelligence: A survey. ACM Comput. Surv. 43(4) Article 36 (2011), 66, DOI:10.1145/1978802.1978815.
44. M. Schreiber, M. Wilamowitz-Moellendorff, and R. Bruder, New interaction concepts by using the wii remote, in: Proc. of the 13th International Conference on Human-Computer Interaction, Springer, Berlin, Heidelberg, 2009, pp. 261-270.
45. O.A. Schipor, D.M. Schipor, E. Crismariu, and S.G. Pentiuc, Finding key emotional states to be recognized in a computer based speech therapy system, Procedia-Social and Behavioral Sciences 30 (2011), 1177-1182, DOI:10.1016/j.sbspro.2011.10.229.
46. N. Sebe, Multimodal interfaces: Challenges and perspectives, Journal of Ambient Intelligence and Smart Environments 1(1) (2009), 23-30.
47. G. Shoemaker, A. Tang, and K.S. Booth, Shadow reaching: A new perspective on interaction for large displays, in: Proc. of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07), ACM, New York, NY, USA, 2007, pp. 53-56. (Pubitemid 351429336)
48. J. Solaro, The kinect digital out-of-box experience, Computer 44(6) (2011), 97-99, DOI:10.1109/MC.2011.190.
49. D. Surie, T. Pederson, and L.-E. Janlert, The easy ADL home: A physical-virtual approach to domestic living, J. Ambient Intell. Smart Environ. 2(3) (2010), 287-310.
50. M. Tahir, G. Baily, and E. Lecolinet, A remote: A tangible interface for selecting TV channels, in: Proc. of the 17th Annual Conf. on Artificial Reality and Telexistence, ICAT'07, ACM Press, 2007, pp. 298-299.
51. R.D. Vatavu and S.G. Pentiuc, Interactive coffee tables: Interfacing TV within an intuitive, fun and shared experience, in: Proc. of the 6th European Conference on Changing Television Environments (EUROITV '08), M. Tscheligi, M. Obrist, and A. Lugmayr, eds, Springer, Berlin, Heidelberg, 2008, pp. 183-187,
52. R.D. Vatavu, Creativity in Interactive TV: Personalize, share, and invent interfaces, in: Mobile TV: Customizing Content and Experience. Springer Human-Computer Interaction Series, A. Marcus, A. Cereijo Roibas, and R. Sala, eds, Springer, London, 2010, pp. 121-139.
53. R.D. Vatavu, D. Vogel, G. Casiez, and L. Grisoni, Estimating the perceived difficulty of pen gestures, in: Proc. of the 13th IFIP TC 13 International Conference on Human-Computer Interaction-Volume Part II (INTERACT'11), P. Campos, N. Nunes, N. Graham, J. Jorge, and P. Palanque, eds, Springer, Berlin, Heidelberg, 2011, pp. 89-106.
54. R.D. Vatavu, Point & click mediated interactions for large home entertainment displays, Multimedia Tools and Applications 59(1) (2012), 113-128, Springer, DOI:10.1007/s11042-010-0698-5.
55. R.D. Vatavu, Nomadic gestures: A technique for reusing gesture commands for frequent ambient interactions, Journal of Ambient Intelligence and Smart Environments 4(2) (2012), 79-93, IOS Press, DOI:10.3233/AIS-2012-0137.
56. D. Vogel and R. Balakrishnan, Distant freehand pointing and clicking on very large, high resolution displays, in: Proc. of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05), ACM, New York, NY, USA, 2005, pp. 33-42. (Pubitemid 44531219)
57. D. Voth, Evolutions in gaming, IEEE Pervasive Computing 6(2) (2007), 7-10, DOI:10.1109/MPRV.2007.29.
58. J.P. Wachs, M. Kölsch, H. Stern, and Y. Edan, Vision-based hand-gesture applications, Commun. ACM 54(2) (2011), 60-71, DOI:10.1145/1897816. 1897838 (2011).
59. J.O. Wobbrock, H.H. Aung, B. Rothrock, and B.A. Myers, Maximizing the guessability of symbolic input, in: CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05), ACM, New York, NY, USA, 2005, pp. 1869-1872.
60. J.O. Wobbrock, A.D. Wilson, and Y. Li, Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes, in: Proc. of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07), ACM, New York, NY, USA, 2007, pp. 159-168. (Pubitemid 351429349)
61. J.O. Wobbrock, M.R. Morris, and A.D. Wilson, User-defined gestures for surface computing, in: Proc. of the 27th International Conference on Human Factors in Computing Systems (CHI '09), ACM, New York, NY, USA, 2009, pp. 1083-1092.
62. M. Wu, C. Shen, K. Ryall, C. Forlines, and R. Balakrishnan, Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces, in: Proc. of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06), IEEE Computer Society, Washington, DC, USA, 2006, pp. 185-192. (Pubitemid 44499875)
63. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang, A survey of affect recognition methods: Audio, visual and spontaneous expressions, in: Proc. of the 9th International Conference on Multimodal Interfaces (ICMI '07), ACM, New York, NY, USA, 2007, pp. 126-133.