Enhancing personal communication with spatial haptics: Two scenario-based experiments on gestural interaction

Journal of Visual Languages and Computing

Volumn 20, Issue 5, 2009, Pages 287-304

  Heikkinen, Jani ^a   Rantala, Jussi ^a   Olsson, Thomas ^a   Raisamo, Roope ^a   Lylykangas, Jani ^a   Raisamo, Jukka ^a   Surakka, Veikko ^a   Ahmaniemi, Teemu ^b  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

^b NOKIA RESEARCH CENTER   (United States)

Author keywords

Communication; Gestures; Haptics; Prototype; Scenarios; User study

Indexed keywords

EID: 69249213417     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2009.07.007     Document Type: Article

References (37)

1. Quek F., McNeill D., Bryll R., Duncan S., Ma X., Kirbas C., McCullough K.E., and Ansari R. Multimodal human discourse: gesture and speech. ACM Transactions on Computer-Human Interaction 9 3 (2002) 171-193
2. Cassell J., Sullivan J., Prevost S., and Churchill F. Embodied Conversational Agents (2000), The MIT Press, Cambridge, MA
3. Magnenat-Thalmann N., and Bonanni U. Haptics in virtual reality and multimedia. IEEE MultiMedia 13 3 (2006) 6-11
4. De Boeck J., Cuppens E., De Weyer T., Raymaekers C., and Coninx K. Multisensory interaction metaphors with haptics and proprioception in virtual environments. Proceedings of Third NordiCHI 83 (2004) 189-197
5. Chang A., O'Modhrain S., Jacob R., Gunther E., and Ishii H. ComTouch: design of a vibrotactile communication device. Proceedings of the DIS (2002) 312-320
6. L.M. Brown, J. Williamson, Shake-to-talk: multimodal messaging for interpersonal communication, in: Proceedings of the Second International Workshop on Haptic and Audio Interaction Design, 2007.
7. E. Hoggan, S. Brewster, S. Anwar, Mobile Multi-Actuator Tactile Displays Proceedings of Second International Workshop Haptic and Audio Interaction Design, 2007, pp. 22-33.
8. Symmons M.A., Richardson B.L., and Wuillemin D.B. Components of haptic information: skin rivals kinaesthesis. Perception 37 10 (2008) 1596-1604
9. Campion G., and Hayward V. On the synthesis of haptic textures. IEEE Transactions on Robotics 24 3 (2008) 527-536
10. Klatzky R.L., and Lederman S.J. The perceived roughness of resistive virtual textures: I. Rendering by a force-feedback mouse. ACM: Transactions of Applied Perception 3 1 (2006) 1-14
11. C. Müller-Tomfelde, C. Paris, Explicit task representation based on gesture interaction, in: F. Chen, J. Epps (Eds.), ACM International Conference Proceeding Series, vol. 163, 2006, pp. 39-45.
12. R.B. Dannenberg, D. Amon, A gesture based user interface prototyping system, in: Proceedings of the Second Annual ACM SIGGRAPH Symposium on User interface Software and Technology, 1989, pp. 127-132.
13. O'Neill E., Kaenampornpan M., Kostakos V., Warr A., and Woodgate D. Can we do without GUIs? Gesture and speech interaction with a patient information system. Personal and Ubiquitous Computing 10 5 (2006) 269-283
14. M. Karam, M.C. Schraefel, A study on the use of semaphoric gestures to support secondary task interactions, CHI '05 Extended Abstracts on Human Factors in Computing Systems, 2005, pp. 1961-1964.
15. E. Eichhorn, R. Wettach, E. Hornecker, A stroking device for spatially separated couples, in: Proceedings of the 10th international Conference on Human Computer Interaction with Mobile Devices and Services, 2008, pp. 303-306.
16. A. Wexelblat, Research challenges in gesture: open issues and unsolved problems, in: Proceedings of the international Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction, 1998.
17. B.L. Harrison, K.P. Fishkin, A. Gujar, C. Mochon, R. Want, squeeze me, hold me, tilt me! An exploration of manipulative user interfaces, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1998, pp. 17-24.
18. D. Small, H. Ishii, Design of spatially aware graspable displays, CHI '97 Extended Abstracts on Human Factors in Computing Systems: Looking to the Future, 1997, pp. 367-368.
19. J. Williamson, R. Murray-Smith, S. Hughes, Shoogle: excitatory multimodal interaction on mobile devices, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2007, pp. 121-124.
20. T. Ahmaniemi, V. Lantz, J. Marila, Dynamic audiotactile feedback in gesture interaction, in: Proceedings of Mobile HCI 2008, 2008, pp. 339-342.
21. J. Rekimoto, Tilting operations for small screen interfaces, in: Proceedings of the Ninth Annual ACM Symposium on User Interface Software and Technology, 1996, pp. 167-168.
22. K. Hinckley, J. Pierce, M. Sinclair, E. Horvitz, Sensing techniques for mobile interaction, in: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, 2000, pp. 91-100.
23. T. Ahmaniemi, V. Lantz, J. Marila, Perception of dynamic audiotactile feedback to gesture input, in: Proceedings of the 10th International Conference on Multimodal Interfaces, 2008, pp. 85-92.
24. P. Eslambolchilar, R. Murray-Smith, Tilt-based automatic zooming and scaling in mobile devices - a state-space implementation, in: Proceedings of Mobile HCI 2004, 2004, pp. 120-131.
25. Fabian, N. Gyorbiro, G. Homanyi, Activity recognition system for mobile phones using the motionband device, in: Proceedings of the First International Conference on MOBILe Wireless MiddleWARE, 2008.
26. Hinckley K., Pierce J., Horvitz E., and Sinclair M. Foreground and background interaction with sensor-enhanced mobile devices. ACM Transactions on Computer-Human Interfaces 12 1 (2005) 31-52
27. J. Linjama, J. Häkkilä, S. Ronkainen, Gesture interfaces for mobile devices-minimalist approach for haptic interaction, in: CHI Workshop: Hands on Haptics: Exploring Non-Visual Visualisation Using the Sense of Touch, 2005.
28. T.B. Hansen, E. Eriksson, A. Lykke-Olesen, Mixed interaction space - designing for camera based interaction with mobile devices, CHI '05 Extended Abstracts on Human Factors in Computing Systems, 2005, pp. 1933-1936.
29. R. Murray-Smith, J. Williamson, S. Hughes, T. Quaade, Stane: Synthesized surfaces for tactile input, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2008, pp. 1299-1302.
30. V. Bellotti, M. Back, W.K. Edwards, R.E. Grinter, A. Henderson, C. Lopes, Making sense of sensing systems: five questions for designers and researchers, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2002, pp. 415-422.
31. Goldstein E.B. Sensation & Perception. fifth ed (1999), Brooks/Cole Publishing Company, USA
32. Kaczmarek K.A., Webster J.G., Bach-y-Rita P., and Tompkins W.J. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions on Biomedical Engineering 38 1 (1991) 1-16
33. Y. Ikei, K. Wakamatsu, S. Fukuda, Texture presentation by vibratory tactile display-image based presentation of a tactile texture, in: Proceedings of the Virtual Reality Annual International Symposium, 1997, pp. 199-205.
34. T. Pietrzak, I. Pecci, B. Martin, Static and dynamic tactile directional cues experiments with VTPlayer mouse, in: Proceedings of the EuroHaptics, 2006, pp. 63-68.
35. K. Bark, J. Wheeler, S. Premakumar, M.R. Cutkosky, Comparison of skin stretch and vibrotactile stimulation for feedback of proprioceptive information, in: Proceedings of the 16th Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems, 2008, pp. 71-78.
36. K. Laurila, T. Pylvänäinen, S.Silanto, A.Virolainen, Wireless motion bands, position paper at UbiComp'05 Workshop on Ubiquitous Computing to Support Monitoring, Measuring and Motivating Exercise, 2005.
37. Guerreiro T.J.V., and Jorge J.A.P. Assessing electromyographic interfaces. Journal of Virtual Reality and Broadcasting 5 12 (2008)