On the naturalness of touchless: Putting the "interaction" back into NUI

ACM Transactions on Computer-Human Interaction

Volumn 20, Issue 1, 2013, Pages

  O'Hara, Kenton ^a   Harper, Richard ^a   Mentis, Helena ^a   Sellen, Abigail ^a   Taylor, Alex ^a  

^a MICROSOFT RESEARCH   (United Kingdom)

Author keywords

Gestural interfaces; Natural user interfaces; Touches interaction

Indexed keywords

COMMON GROUND; GESTURAL INTERFACES; NATURAL USER INTERFACES; TOUCHES INTERACTION; TOUCHLESS;

HUMAN COMPUTER INTERACTION;

USER INTERFACES;

EID: 84877899568     PISSN: 10730516     EISSN: 15577325     Source Type: Journal    
DOI: 10.1145/2442106.2442111     Document Type: Article

References (66)

1. ABOWD, G. D. AND DIX, A. J. 1994. Integrating status and event phenomena in formal specifications of interactive systems. In Proceedings of the 2nd ACM SIGSOFT Symposium on Foundations of Software Engineering. Addison-Wesley/ACM Press.
2. BANNON, L. AND SCHMIDT, K. 1989. CSCW: Four characters in search of a context. In Proceedings of the 1st European Conference on Computer Supported Cooperative Work (ECSCW'89). 358-372.
3. BARDRAM, J. AND BOSSEN, C. 2005. Mobility work: The spatial dimension of collaboration at a hospital. J. Comput. Supported Coop. Work 14, 2.
4. BAUDE, T. AND BEAUDOUIN-LAFON, M. 1993. Charade: Remote control of objects using free-hand gestures. Comm. ACM 36, 7, 28-35.
5. BOEHNER, K., DEPAULA, R., DOURISH, P. AND SENGERS, P. 2005. Affect: From information to interaction. In Proceedings of the 4th Decennial Conference on Critical Computing: Between Sense and Sensibility (CC'05), O. W. Bertelsen, N. O. Bouvin, P. G. Krogh, and M. Kyng, Eds., ACM Press, New York, 59-68.
6. BOWERS, J. AND HELLSTRÖM, S. O. 2000. Simple interfaces to complex sound improved music. In CHI'00 Extended Abstracts on Human Factors in Computing Systems. ACM Press, 125-126.
7. BHUIYAN, M. AND PICKING, R. 2009. Gesture control user interface, what have we done and what's next? In Proceedings of the 5th Collaborative Research Symposium on Security, E-learning, Internet and Networking (SEIN'09).
8. BROWN J. S. AND DUGUID, D. 1991. Organizational learning and communities-of-practice: Toward a unified view of working, learning, and innovation. Organ. Sci. 2, 1, 40-57.
9. BUTTON, G. 1991. Ethnomethodology and the Human Sciences, Cambridge University Press.
10. CIPOLLE, R. AND PENTLAND, A. 1998. Computer Vision and Human-Computer Interaction. Cambridge University Press.
11. CLARK, A. 2003. Natural-Born Cyborgs: Minds, Technologies and the Future Human. Open University Press, Milton Keynes.
12. CORRADINI, A. 2001. Real-Time gesture recognition by means of hybrid recognizers. In Proceedings of the Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction (GW'01). I. Wachsmuth and T. Sowa, Eds., Springer, 34-46.
13. DAVIDSON, D. 1963. Actions, reasons, and causes. In Essays on Davidson: Action and Events, Oxford Universiry Press, 1980, 3-20.
14. DE LA BARRE, R., CHOJECKI, P., LEINER, U., MUHLBACJ, L., AND RUSCHIN, D. 2009. Touchless interaction-novel cases and challenges. In Proceedings of the International Conference on Human Computer Interaction (HCI'09), J. Jacko, Ed., Springer, 169-169.
15. DE LA BARRÉ, R.,PASTOOR, S.,CONOMIS, C.,PRZEWOZNY, D.,RENAULT, S., STACHEL, O.,DUCKSTEIN, B., AND SCHENKE, K. 2005. Natural interaction in a desktop mixed reality environment. In Proceedings of the 6th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'05).
16. DOURISH, P. 2001. Where the Action Is: The Foundations of Embodied Interaction. MIT Press.
17. DOURISH, P. 2004. What we talk about when we talk about context. Pers. Ubiquitous Comput. 8, 1.
18. DOUGLAS, M. 1966. Purity and Danger. Routledge, London.
19. FLORES, F., GRAVES, M., HARTFIELD, B., AND WINOGRAD, T. 1988. Computer systems and the design of organizational interaction. ACM Trans. Inf. Syst. 6, 2.
20. GARFINKEL, H. 1967. Studies in Ethnomethodology. Prentice Hall.
21. GARG, P. AGGARWAL, N., AND SOFAT, S. 2009. Vision based hand gesture recognition. World Academy Sci. Engin. Technol. 49.
22. GOODWIN, C. 1994. Professional vision. Amer. Anthropol. 96, 3, 606-633.
23. GRAETZEL, C., FONG, T.,GRANGE, S., AND BAUR, C. 2004. A non-contact mouse for surgeon-computer interaction. Technol. Health Care 12. IOS Press.
24. HALL, E. T. 1966. The Hidden Dimension. Doubleday, New York.
25. HOLLAN, J. AND STORNETTA, S. 1992. Beyond being there. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'92). 119-125.
26. HORNECKER, E. AND BUUR, J. 2006. Getting a grip on tangible interaction: A framework on physical space and social interaction. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI'06). ACM Press, New York, 437-446.
27. HORNECKER, E. 2005. A design theme for tangible interaction: Embodied facilitation. In Proceedings of the 9th European Conference on Computer Supported Cooperative Work (ECSCW'05).
28. HUSSERL, E. 1939. Experience in Judgement. Routledge, London.
29. IHDE D. 2002. Bodies in Technology. University of Minnesota Press, Minneapolis, MN.
30. JACOB, R.,GIROUARD, A.,HIRSHFIELD, L.,HORN, M., SHAER, O., SOLOVEY, E., AND ZIGELBAUM, J. 2008. Reality based interaction: A framework for post-WIMP interfaces. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI'08).
31. JOHNSON, R., O'HARA, K., SELLEN, A., COUSINS, C., AND CRIMINISI, A. 2011. Exploring the potential for touchless interaction in image-guided interventional radiology. In Proceedings of the Conference on Human Factors in Computing. 3323-3332.
32. KARAM, M. AND SCHRAEFEL, M. 2005. A taxonomy of gestures in human-computer interaction. Tech. rep. ECSTR-IAM05-009, Electronics and Computer Science, University of Southampton.
33. KENDON, A. 2010. Spacing and orientation in co-present interaction. In Proceedings of the COST Training School. Springer, 1-15.
34. LAVE, J. ANDWENGER, E. 1991. Situated Learning: Legitimate Peripheral Participation. Cambridge University Press.
35. LARSSEN, T., ROBERTSON, T. AND J EDWARDS, J. 2007. The feel dimension of technology interaction: Exploring tangibles through movement and touch. In Proceedings of the Conference on Tangible and Embedded Interaction. 271-278.
36. LARSSEN, A. T.,LOKE, L., ROBERTSON, T. AND EDWARDS, J. 2004. Understanding movement as input for interaction -A study of two Eyetoy (TM) Games. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OZCHI'04).
37. MARSHALL, P., ROGERS, Y., AND PANDITI, N. 2011. Using f-formations to analyse spatial patterns of interaction in physical environments. In Proceedings of the Conference on Computer Supported Cooperative Work (CSCW'11). 445-454.
38. MENTIS, H., O'HARA, K.,SELLEN, A., AND TRIVEDI, R. 2012. Interaction proxemics and image use in neurosurgery. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Sytems.
39. MERLEAU-PONTY, M. 1962. Phenomenology of Perception. Routledge, UK.
40. MERLEAU-PONTY, M. 1968. The intertwining - the chiasm. In The Visible and the Invisible. Northwestern University Press, Chicago, IL.
41. MORAY, N. 1998. Identifying mental models of complex human-machine systems. Int. J. Ind. Ergonom. 22, 4-5, 293-297.
42. NORMAN, D. 2010. Natural user interfaces are not natural. Interact. 17, 3, 6-10.
43. O'HAGAN, R., ZELINSKY, A., AND ROUGEAUX, S. 2002. Visual gesture interfaces for virtual environments. Interact. Comput. 14, 231-250.
44. O'HARA, K.,KJELDSKOV, J., AND PAAY, J. 2011. Blended interaction spaces. ACM Trans. Comput.-Hum. Interact. 18, 1.
45. O'HARA, K., GLANCEY, M., AND ROBERTSHAW, S. 2008. Collective play in an urban screen game. In Proceedings of the Conference on Computer Supported Cooperative Work (CSCW'08).
46. O'SHEA, C. 2009. Hand from above. http://www.chrisoshea.org/hand-from- above
47. O'SHEA, C. 2010. Question of sport relief. http://www.chrisoshea.org/big- screen-quiz
48. PAVLOVIC, V., SHARMA, R., AND HUANG, T. 1997. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7, 677-695.
49. QUEK, F., MCNEILL, D., BRILL, R., DUNCAN, S., MA, X.-F., KIRBAS, C., MCCULLOUGH, K. E., AND ANSARI, R. 2002. Multimodal human discourse: Gesture and speech. ACM Trans. Comput.-Hum. Interact. 9, 3, 171-193.
50. ROGERS, Y. ANDMULLER, H. 2006. A framework for designing sensor-based interactions to promote exploration and reflection in play source. Int. J. Hum.-Comput. Stud. 64, 1.
51. SAFFER, D. 2009. Designing Gestural Interfaces. O'Reilly.
52. SÁNCHEZ-NIELSEN, E., ANTÓN-CANALIS, L., AND HERNÁNDEZ-TEJERA, M. 2003. Hand gesture recognition for human-machine interaction. J. WSCG 12, 1-3.
53. SCHMIDT, K. 2011. Cooperative Work and Coordinative Practices: Contributions to the Conceptual Foundations of Computer-Supported Cooperative Work. Springer.
54. SMITH, D. C., IRBY, C., KIMBALL, R., AND HARSLEM, E. 1982. The star interface: An overview. In Proceedings of the National Computer Conference (AFIPS'82). R. Brown, and H. Morgan, Eds., 515-528.
55. STERN, H., WACHS, J., AND EDAN, Y. 2008. Optimal consensus intuitive hand gesture vocabulary design. In Proceedings of the IEEE International Conference on Semantic Computing (ICSC'08). IEEE Computer Society, 96-103.
56. SUCHMAN, L. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press.
57. SUCHMAN L. AND WYNNE, E. 1984. Procedures and problems in the office. Office Technol. People 2, 133-154.
58. VARONA, J., JAUME-I-CAPÓ, A., GONZÁLEZ, J., AND PERALES, F. J. 2008. Toward natural interaction through visual recognition of body gestures in real-time. Interact. Comput. 21, 1, 3-10.
59. WACHS, J., STERN, H., EDAN, Y., GILLAM, M., FEIED, C., SMITH, M., AND HANDLER, J. 2006. A real-time hand gesture interface for medical visualization applications. http://web.ics.purdue.edu/~jpwachs/papers/WSC10 wachs.pdf.
60. WACHS, J., STERN, H., EDAN, Y., GILLAM, M., FEIED, C., SMITH, M., AND HANDLER, J. 2007. Real-Time hand gesture interface for browsing medical images. IC Med. 1, 2.
61. WENGER, E. 1998. Communities of Practice: Learning, Meaning and Identity. Cambridge University Press.
62. WEXELBLAT, A. 1995. An approach to natural gesture in virtual environments. ACM Trans. Comput.-Hum. Interact. 2, 3, 179-200.
63. WIDGOR, D. AND WIXON, D. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Morgan Kaufmann.
64. WITTGENSTEIN, L. 1953. Philosophical Investigations. Blackwell, Oxford, UK.
65. WITTGENSTEIN, L. 1969. On Certainty. Blackwell, Oxford, UK.
66. WU, Y. AND HUANG, T. 1999. Vision-Based gesture recognition: A review. In Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction (GW'99). A. Braffort, R. Gherbi, S. Gibet, J. Richardson, and D. Teil, Eds., Springer, 103-115.