Multimodal interaction: A suitable strategy for including older users?

Interacting with Computers

Volumn 22, Issue 6, 2010, Pages 465-474

  Naumann, Anja B ^a   Wechsung, Ina ^a   Hurtienne, Jörn ^b  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Inclusive design; Intuitive Interaction; Multimodal interaction; Usability; User experience

Indexed keywords

BEHAVIORAL RESEARCH; INTERACTIVE COMPUTER SYSTEMS; MOTION CONTROL; USER INTERFACES;

INCLUSIVE DESIGN; INPUT MODALITIES; INTUITIVE INTERACTION; MULTI-MODAL INTERACTIONS; MULTI-MODAL INTERFACES; MULTIMODAL USER INTERFACE; USABILITY; USER SATISFACTION;

USER EXPERIENCE;

EID: 78149468486     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2010.08.005     Document Type: Article

References (56)

1. M.E. Altinsoy, and S. Merchel Audiotactile feedback design for touch screens M.E. Altinsoy, U. Jekosch, S. Brewster, Haptic and Audio Interaction Design 2009, LNCS 5763 2009 Springer Berlin 136 144
2. J.A. Bargas-Avila, G. Oberholzer, P. Schmutz, M. de Vito, and K. Opwis Usable error message presentation in the World Wide Web: do not show errors right away Interacting with Computers 19 3 2007 330 341
3. Blackler, A.; Mahar, D.; Popovic, V.; 2009. Intuitive interaction, prior experience and ageing: An empirical study. In: HCI 2009 Electronic Proceedings: WS4 - Prior Experience. British Computer Society, Cambridge.
4. BSI BS 7000 Design Management Systems - Part 6: Managing Inclusive Design - Guide 2005 British Standards Institution London
5. Burke, J.L.; Prewett, M.S.; Gray, A.A.; Yang, L.; Stilson, F.R.; Coovert, M.D.; Elliot, L.R.; Redden, E.; 2006. Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In: Proceedings of the 8th international Conference on Multimodal Interfaces (ICMI '06), ACM, New York, NY, pp. 108-117. .
6. F. Chen Designing Human Interface in Speech Technology 2006 Springer Berlin
7. J. Cohen Statistical Power Analysis for the Behavioural Sciences second ed. 1988 Lawrence Earlbaum Hillsdale, NJ
8. Cohen, P.; McGee, D.; Clow, J.; 2000. The efficiency of multimodal interaction for a map-based task. In: Proceedings of the Sixth Conference on Applied Natural Language Processing (Seattle, Washington, 2000). Applied Natural Language Conferences. Association for Computational Linguistics, Morristown, NJ, pp. 331-338. .
9. Cox, A.L.; Cairns, P.A.; Walton, A.; Lee, S.; 2008. Tlk or txt? Using voice input for SMS composition. Personal Ubiquitous Computing, 8 (November 2008) 567-588. .
10. K.V. Echt, R.W. Morrell, and D.C. Park Effects of age and training formats on basic computer skill acquisition in older adults Educational Gerontology 24 1 1998 3 25
11. K. Eilers, F. Nachreiner, and K. Hänecke Entwicklung und Überprüfung einer Skala zur Erfassung subjektiv erlebter Anstrengung Zeitschrift für Arbeitswissenschaft 40 1986 215 224
12. A. Fisk, W. Rogers, N. Charness, S. Czaja, and J. Sharit Designing for Older Adults: Principles and Creative Human Factors Approaches 2009 CRC Press Boca Raton
13. M. Hassenzahl, M. Burmester, and F. Koller AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität [A questionnaire for measuring perceived hedonic and pragmatic quality] J. Ziegler, G. Szwillus, Mensch & Computer 2003. Interaktion in Bewegung 2001 B.G. Teubner Stuttgart 187 196
14. D. Hawthorn Possible implications of aging for interface designers Interacting with Computers 12 5 2000 507 528
15. Hoggan, E.; Brewster, S.A.; Johnston, J.; 2008. Investigating the effectiveness of tactile feedback for mobile touch screens. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (CHI '08), ACM, New York, NY, pp. 1573-1582. .
16. Hoggan, E.; Crossan, A.; Brewster, S.A.; Kaaresoja, T.; 2009. Audio or Tactile Feedback: Which Modality When? In: Proceedings of ACM CHI2009 (Boston, USA). ACM Press, Addison-Wesley, pp. 2253-2256.
17. Hoggan, E.; Brewster, S.A.; 2010. Crosstrainer: testing the use of multimodal interfaces in situ. In: Proceedings of ACM CHI 2010 (Atlanta, GA, USA), ACM Press Addison-Wesley, pp. 333-342.
18. J. Jacko, V.K. Emery, P.J. Edwards, M. Ashok, L. Barnard, T. Kongnakorn, and K.P. Moloney The effects of multimodal feedback on older adults' task performance given varying levels of computer experience Behaviour & Information Technology 23 4 2004 247 10.1080/01449290310001659213
19. Jokinen, K.; Raike, A.; 2003. Multimodality - technology, visions and demands for the future. In: The 1st Nordic Symposium on Multimodal Interfaces, Copenhagen, September, 2003.
20. Jöst, M.; Häußler, J.; Merdes, M.; Malaka, R.; 2005. Multimodal interaction for pedestrians: an evaluation study. In: Proceedings of the 10th International Conference on Intelligent User Interfaces IUI '05. ACM, New York, NY, pp. 59-66. .
21. C. Ketcham, and G. Stelmach Movement control in the older adult R.W. Pew, S.B. van Hemel, Technology for Adaptive Aging 2004 The National Academies Press Washington, DC 64 92
22. J. Kirakowski, and M. Corbett SUMI: The software usability measurement inventory British Journal of Educational Technology 24 3 1993 210 212
23. Lai, J.; 2004. Facilitating mobile communication with multimodal access to email messages on a cell phone. In: CHI '04 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, NY, pp. 1259-1262. .
24. Lemmelä, S.; Vetek, A.; Mäkelä, K.; Trendafilov, D.; 2008. Designing and evaluating multimodal interaction for mobile contexts. In: ICMI 2008, pp. 265-272.
25. T. Lewis, P.M. Langdon, and P.J. Clarkson Prior experience of domestic microwave cooker interfaces: a user study P.M. Langdon, P.J. Clarkson, P. Robinson, Designing Inclusive Futures 2008 Springer London 95 106
26. McGookin, D.; Robertson, E.; Brewster, S.A.; 2010. Clutching at straws: using tangible interaction to provide non-visual access to graphs. In: Proceedings of ACM CHI 2010 (Atlanta, GA, USA). ACM Press, Addison-Wesley, pp. 1715-1724.
27. McGuirl, J.M.; Sarter, N.B.; 2001. Tactile information presentation during in-flight icing conditions: Supporting timesharing and hazard awareness. In: Proceedings of the 20th Digital Avionics Systems Conference, 2001, pp. 2A2/1-2A2/8.
28. S. Merchel, and M.E. Altinsoy Vibratory and acoustical factors in multimodal reproduction of concert DVDs M.E. Altinsoy, U. Jekosch, S. Brewster, Haptic and Audio Interaction Design 2009, LNCS 5763 2009 Springer Berlin 119 127
29. Mohs, C.; Hurtienne, J.; Israel, J.H.; Naumann, A.; Kindsmüller, M.C.; Meyer, H.A.; Pohlmeyer, A.; 2006. IUUI - intuitive use of user interfaces. In: Bosenick, T.; Hassenzahl, M.; Müller-Prove, M.; Peissner, M. (Eds.), Usability Professionals 06, German Chapter of the Usability Professionals' Association, Stuttgart, 2006, pp. 130-133.
30. C. Mohs, J. Hurtienne, D. Scholz, and M. Rötting Intuitivität: definierbar, beeinflussbar, überprüfbar! [Intuitivity: definable, influencable, measurable!] VDI/VDE-Gesellschaft Mess-und Automatisierungstechnik Useware 2006 2006 VDI-Verlag Düsseldorf 215 224
31. Naumann, A.B.; Wechsung, I.; 2008. Developing usability methods for multimodal systems: the use of subjective and objective measures. In: Law, E.L.-C.; Bevan, N.; Christou, G.; Springett, M.; Larusdottir, M. (Eds.), Proceedings of the International Workshop on Meaningful Measures: Valid Useful User Experience Measurement (VUUM) 2008, Institute of Research in Informatics of Toulouse (IRIT), Toulouse, pp. 8-12.
32. Naumann, A.B.; Hurtienne, J.; 2010. Benchmarks for intuitive interaction with mobile devices. In: Proceedings of Mobile HCI.
33. J. Niemann, V. Presse, J. Reissland, and A. Naumann Developing a user-centered mobile service interface based on a cognitive model of attention allocation J.A. Turner, IFIP Advances in Information and Communication Technology, WCC2010 2010 Springer
34. S. Oviatt Ten myths of multimodal interaction Communications of the ACM 42 11 1999 74 81
35. S. Oviatt Breaking the robustness barrier: recent progress on the design of robust multimodal systems Advances in Computers 56 2002 305 341
36. S. Oviatt Multimodal interfaces J.A. Jacko, A. Sears, The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications 2003 Lawrence Erlbaum Associates, Mahwah 286 304
37. Oviatt, S.; VanGent, R.; 1996. Error resolution during multimodal human-computer interaction. In: Proceedings of the International Conference on Spoken Language Processing (ICSLP 96), Philadelphia PA, pp. 204-207.
38. S. Oviatt, and W. Wahlster Introduction to this special issue on multimodal interfaces multimodal interfaces Human-Computer Interaction 1&2 1997 1 5
39. Prewett, M.S.; Yang, L.; Stilson, F.R.; Gray, A.A.; Coovert, M.D.; Burke, J.; Redden, E.; Elliot, L.R.; 2006. The benefits of multimodal information: a meta-analysis comparing visual and visual-tactile feedback. In: Proceedings of the 8th International Conference on Multimodal Interfaces (ICMI '06.), ACM, New York, NY, pp. 333-338. .
40. Prewett, M.S.; Johnson, R.C.; Saboe, K.N.; Elliott, L.R.; Coovert, M.D.; 2010. Managing workload in human-robot interaction: a review of empirical studies, Computers in Human Behavior 26(5), 840-856. .
41. N. Sarter Multiple-resource theory as a basis for multimodal interface design: success stories, qualifications, and research needs A. Kramer, D. Wiegmann, A. Kirlik, Attention: From Theory to Practice 2006 Oxford University Press Oxford 187 195
42. N.B. Sarter, and D.D. Woods Team play with a powerful and independent agent: a full-mission simulation study Human Factors 42 3 2000 390 402
43. Scheibe, R.; Moehring, M.; Froehlich, B.; 2007. Tactile feedback at the finger tips for improved direct interaction in immersive environments. In: 2007 IEEE Symposium on 3D User Interfaces, IEEE Computer Society Press, Silver Spring, MD, pp. 123-130.
44. W. Schnotz, M. Bannert, and T. Seufert Towards an integrative view of text and picture comprehension: visualization effects on the construction of mental models J. Otero, A. Graesser, J.A. Leon, The Psychology of Science Text Comprehension 2002 Erlbaum Mahwah 385 416
45. Schomaker, L.; Nijtmans, J.; Camurri, A.; Lavagetto, F.; Morasso, P.; Benoît, C.; Guiard-Marigny, T.; Le Goff, B.; Robert-Ribes, J.; Adjoudani, A.; Defée, I.; Münch, S.; Hartung, K.; Blauert, J.; 1995. A Taxonomy of Multimodal Interaction in the Human Information Processing System. A Report of the ESPRIT Project 8579 MIAMI. NICI, Nijmegen.
46. A.E. Sklar, and N.B. Sarter "Good vibrations": the use of tactile feedback in support of mode awareness on advanced technology aircraft Human Factors 41 4 1999 543 552
47. J. Sturm, and L. Boves Effective error recovery strategies for multimodal form-filling applications Speech Communication 45 2005 289 303
48. Vazquez-Alvarez, Y.; Brewster, S.A.; 2010. Designing Spatial Audio Interfaces to Support Multiple Audio Streams. In: Proceedings of MobileHCI 2010 (Lisbon, Portugal), ACM Press.
49. M. Vercruyssen Movement control and speed of behavior A.D. Fisk, W.A. Rogers, Handbook of Human Factors and the Older Adult 1996 Academic Press San Diego, CA 55 86
50. Walker, N.; Millians, J.; Worden, A.; 1996. Mouse gain functions and cursor positioning: performance of older computer user. In: Proceedings of the Human Factors and Ergonomics Society, pp. 151-154.
51. N. Walker, D. Philbin, and D. Fisk Age related differences in movement control: adjusting submovement structure to optimize performance Journal of Gerontology: Psychological Science 52B 1 1997 40 52
52. Wechsung, I.; Naumann, A.B.; 2008. Evaluation methods for multimodal systems: a comparison of standardized usability questionnaires. In: André, E.; Dybkjær, L.; Minker, W.; Neumann, H.; Pieraccini, R.; Weber, M. (Eds.), Proceedings of PIT 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems. LNAI, vol. 5078. Springer, Berlin, pp. 276-284.
53. Wechsung, I.; Naumann, A.B.; 2009. Evaluating a multimodal remote control: the interplay between user experience and usability. In: Proceedings of the First IEEE International Workshop on Quality of Multimedia Experience (QoMEX' 2009), IEEE, New York, pp. 19-22.
54. C.D. Wickens Multiple resources and performance prediction Theoretical Issues in Ergonomics Science 3 2002 159 177
55. F.R.H. Zijlstra Subjective mental effort questionnaire Efficiency in Work Behaviour: A Design Approach for Modern Tools 1993 Delft University Press Delft
56. Zijlstra, F.R.H.; van Doorn, L.; 1985. The construction of a scale to measure subjective effort. Technical Report, Delft University of Technology, Department of Philosophy and Social Sciences.