Camera assisted multimodal user interaction

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 7542, Issue , 2010, Pages

  Hannuksela, Jari ^a   Silvén, Olli ^a   Ronkainen, Sami ^b   Alenius, Sakari ^c   Vehviläinen, Markku ^c  

^a UNIVERSITY OF OULU   (Finland)

^b MICROSOFT   (United States)

^c NOKIA RESEARCH CENTER   (United States)

Author keywords

Computer vision; Face detection; Mobile device; User interface

Indexed keywords

AMBIENT ILLUMINATION; BAR CODE READING; CONTEXT IDENTIFICATION; CONTEXTUAL INFORMATION; DISPLAY TECHNOLOGIES; FACE DETECTION; HANDHELDS; IMAGE CAPTURING; IN-BUILDING SYSTEMS; LIGHT SENSOR; MOBILE DEVICE USERS; MOTION SENSORS; MULTI-MODAL; MULTIPLE SENSORS; PROCESSING POWER; TASK PERFORMANCE; USER EXPERIENCE; USER INTERACTION;

BAR CODES; CAMERAS; COMPUTER VISION; DISPLAY DEVICES; MOBILE TELECOMMUNICATION SYSTEMS; PORTABLE EQUIPMENT; SENSORS; USER INTERFACES;

MOBILE DEVICES;

EID: 77952047154     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.839449     Document Type: Conference Paper

References (20)

1. J. Rekimoto, "Tilting operations for small screen interfaces," in 9th annual ACM symposium on User interface software and technology, pp. 167-168, ACM Press, 1996.
2. K. Hinckley, J. S. Pierce, M. Sinclair, and E. Horvitz, "Sensing techniques for mobile interaction," in 13th annual ACM symposium on User Interface Software and Technology, pp. 91-100, 2000.
3. A. Pentland, "Looking at people: Sensing for ubiquitous and wearable computing," IEEE Transactions on Pattern Analalysis and Machine Intelligence 22(1), pp. 107-119, 2000. (Pubitemid 32132957)
4. M. Turk, "Computer vision in the interface," Communications of the ACM 47, pp. 60-67, January 2004.
5. A. Schmidt, M. Beigl, and H. w. Gellersen, "There is more to context than location," Computers and Graphics 23, pp. 893-901, 1999. (Pubitemid 30546505)
6. S. Oviatt, P. Cohen, L. Wu, J. Vergo, L. Duncan, B. Suhm, J. Bers, T. Holzman, T. Winograd, J. Landay, J. Larson, and D. Ferro, "Designing the user interface for multimodal speech and pen-based gesture applications: State-of-the-art systems and future research directions," Human Computer Interaction 15(4), pp. 263-322, 2000.
7. J. O. Wobbrock, "The future of mobile device research in hci," in CHI 2006 Workshop Proceedings: What is the Next Generation of Human-Computer Interaction?, pp. 131-134, 2006.
8. M. Turk and G. Robertson, "Perceptual user interfaces," Communications of the ACM 43, pp. 33-34, 2000.
9. A. Sears, M. Lin, J. Jacko, and Y. Xiao, When Computers Fade...Pervasive Computing and Situationally-Induced Impairments and Disabilities, pp. 1298-1302. Lawrence Erlbaum Associates, Hillsdale, 2003.
10. S. Oviatt, R. Coulston, and R. Lunsford, "When do we interact multimodally?: cognitive load and multimodal communication patterns," in ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pp. 129-136, ACM, 2004.
11. J. Williamson, R. Murray-Smith, and S. Hughes, "Shoogle: excitatory multimodal interaction on mobile devices," in CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 121-124, ACM, 2007.
12. S. Ronkainen, J. Häkkilä, S. Kaleva, A. Colley, and J. Linjama, "Tap input as an embedded interaction method for mobile devices," in TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction, pp. 263-270, ACM, 2007.
13. C. Randell and H. Muller, "Context awareness by analyzing accelerometer data," in ISWC '00: Proceedings of the 4th IEEE International Symposium on Wearable Computers, p. 175, IEEE Computer Society, 2000.
14. W. Freeman, P. Beardsley, H. Kage, K. Tanaka, K. Kyuma, and C. Weissman, "Computer vision for computer interaction," ACM SIGGRAPH Computer Graphics 33(4), pp. 65-68, 2000.
15. S. A. Brewster and J. Johnston, "Multimodal interfaces for camera phones," in MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services, pp. 387-390, ACM, 2008.
16. O. J. Silvén, J. Hannuksela, M. Bordallo López, M. Turtinen, M. Niskanen, J. Boutellier, M. Vehviläinen, and M. Tico, "New video applications on mobile communication devices," in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, 6821, 2008.
17. V. Ojansivu and J. Heikkilä, "Blur insensitive texture classification using local phase quantization," in Proceedings of international conference on Image and Signal Processing, pp. 236-243, 2008.
18. Nokia, "Nokia Point & Find BETA." Website, 2009. http://pointandfind.nokia.com/.
19. A. Schmidt, K. A. Aidoo, A. Takaluoma, U. Tuomela, K. Van Laerhoven, and W. Van de Velde, "Advanced interaction in context," Lecture Notes in Computer Science 1707, pp. 89-101, 1999.
20. W. Kuhmann, W. Boucsein, F. Schaefer, and J. Alexander, "Experimental investigation of psychophysiological stress-reactions induced by different response times in human-computer interaction," Ergonomics 30, pp. 933-943, 1987.