The effects of multimodal feedback on older adults' task performance given varying levels of computer experience

Behaviour and Information Technology

Volumn 23, Issue 4, 2004, Pages 247-264

  Jacko, Julie ^a   Emery, V Kathlene ^a   Edwards, Paula J ^a   Ashok, Mahima ^a   Barnard, Leon ^a   Kongnakorn, Thitima ^a   Moloney, Kevin P ^a   Sainfort, François ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; GRAPHICAL USER INTERFACES; HAPTIC INTERFACES; SENSORY FEEDBACK; VISION;

AUDITORY FEEDBACK; DRAG-AND-DROP TASKS; HAPTIC-VISUAL BIMODAL FEEDBACK; MULTIMODAL FEEDBACK;

AUDITION;

EID: 3042660865     PISSN: 0144929X     EISSN: None     Source Type: Journal    
DOI: 10.1080/01449290310001659213     Document Type: Article

References (66)

1. AGNEW, J., BOLLA-WILSON, K., KAWAS, C. H. and BLEECKER, M. L. 1988, Purdue pegboard age and sex norms for people 40 years old and older. Developmental Neuropsychology, 4(1), 29-35.
2. AKAMATSU, M., MACKKENZIE, I. S. and HASBROUQ, T. 1995, A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics, 38, 816-827.
3. AKAMATSU, M. and SATO, S. 1994, A multi-modal mouse with tactile and force feedback. International Journal of Human Computer Studies, 40, 443-453.
4. BREWSTER, S. A. 1998, Sonically-enhanced drag and drop. Proceedings of the International Conference on Auditory Display (ICAD '98), Glasgow, UK, 1-7.
5. CHARNESS, N. 1996, Human Factors Engineering and Ageing. 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Amsterdam, pp. 2146 - 2147.
6. CZAJA, S. J. and SHARIT, J. 1998, Age Differences in Attitudes Toward Computers. Journal of Gerentology: Psychological Sciences, 53B(5), 329-430.
7. CZAJA, S. J., SHARIT, J., OWNBY, R., ROTH, D. L. and NAIR, S. 2001, Examining Age Differences in Performance of a Complex Search and Retrieval Task. Psychology and Aging, 16(4), 564-579.
8. DYCK, J. L. and SMITHER, J. A. 1996, Older Adults' Acquisition of Word Processing: The Contribution of Cognitive Abilities and Computer Anxiety. Computers in Human Behavior, 12(1), 107-119.
9. EASON, K. D., JOHNSON, C. and FAIRCLOUGH, S. 1991, The interaction of sensory modalities in the man-machine interface. In J. A. J. Roufs (ed) Vision and dysfunction: The man-machine interface (Boca Raton, FL: CRC).
10. ECHT, K. V., MORRELL, R. W. and PARK, D. C. 1998, Effects of age and training formats on basic computer skill acquisition in older adults. Educational Gerontology, 28(1), 3-25.
11. ELLIS, R. D. and ALLAIRE, J. C. 1999, Modeling computer interest in older adults: The role of age, education, computer knowledge, and computer anxiety. Human Factors, 41(3), 345-355.
12. ELLIS, R. D. and KURNIAWAN, S. 2000, Increasing the usability of online information for older users: A case study in participatory design. International Journal of Human-Computer Interaction, 2(12), 263-276.
13. EMERY, V. K., JACKO, J. A., KONGNAKORN, T., KURUCHITTHAM, V., LANDRY, S., NICKLES, G. M. III, SEARS, A. and WHITTLE, J. 2001, Identifying critical interaction scenarios for innovative user modeling. Proceedings of the 9th International Conference on Human-Computer Interaction, 5-10 August 2001, New Orleans, LA, pp. 481-485.
14. FIELD, A. 2000, Discovering Statistics using SPSS for Windows (London: The Cromwell Press, Ltd.)
15. FISHKIN, K. P., GUJAR, A., HARRISON, B. L., MORAN, T. P. and WANT, W. 2000, Embodied User Interfaces for Really Direct Manipulation. Communications of the ACM, 43(9), 74-80.
16. FISK, A. D. and ROGERS, W. A. 2000, Influence of training and experience on skill acquisition and maintenance in older adults. Journal of Aging and Physical Activity, 8, 373-378.
17. FRASER, J. and GUTWIN, C. 2000, A Framework of Assistive Pointers for Low Vision Users. Fourth Annual International ACM/SIGCAPH Conference on Assistive Technologies (ASSETS 2000), Arlington, VA, pp. 9-16.
18. GAVER, W. 1989, The SonicFinder: An interface that uses auditory icons. Human Computer Interaction, 4(1), 67-94.
19. GILLAN, D. J., HOLDEN, K., ADAM, S., RUDISILL, M. and MAGEE, L. 1990, How does Fitt's law fit pointing and dragging? In Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people (New York: ACM Press), pp. 227-234.
20. GREENE, A. J. 2001, Visual Auditory Events: Cross Modal Perception Priming Recognition Memory, Consciousness and Cognition, 10, 425-435.
21. HAWTHORN, D. 2000, Possible implications of aging for interface designers. Interacting with Computers, 12, 507-528.
22. HILZ, M. J., AXELROD, F. B., HERMANN, K., HAERTL, U., DUETSCH, M. and NEUNDÖRFER, B. 1998, Normative values of vibratory perception in 530 children, juveniles and adults. Journal of the Neurological Sciences, 159, 219-225.
23. HOWARD, J. H. and HOWARD, D. V. 1997, Learning and memory. In A. D. Fisk and W. A. Rogers (eds) Handbook of Human Factors and the Older Adult (London: Academic Press), pp. 7-26.
24. HUTCHISON, D., EASTMAN, C. and TIRRITO, T. 1997, Designing user interfaces for older adults. Educational Gerontology, 23, 497-513.
25. INKPEN, K. M. 2001, Drag-and-drop versus point-and-click mouse interaction styles for children. ACM Transactions on Computer-Human- Interactions, 8(1), 1-33.
26. JACKO, J. A., SCOTT, I. U., SAINFORT, F., BARNARD, L., EDWARDS, P. J., EMERY, V. K., KONGNAKORN, T., MOLONEY, K. P. and ZORICH, B. S. 2003a, Older adults and visual impairment: What do exposure times and accuracy tell us about performance gains associated with multimodal feedback? CHI Letters, 5(1), 33-40.
27. JACKO, J. A., SCOTT, I. U., SAINFORT, F., MOLONEY, K. P., KONGNAKORN, T., ZORICH, B. S. and EMERY, V. K. 2003b, Effects of multimodal feedback on the performance of older adults with normal and impaired vision. Lecture Notes in Computer Science (LNCS), 2615, 3-22.
28. JAY, G. M. and WILLIS, S. L. 1992, Influence of Direct Computer Experience on Older Adults' Attitudes Toward Computers. Journal of Gerontology: Psychological Sciences, 47(4), 250-257.
29. JOINER, R., MESSER, D., LIGHT, P. and LITTLETON, K. 1998, It is Best to Point for Young Children: A Comparison of Children's Pointing and Dragging. Computers in Human Behavior, 14(3), 513-529.
30. JONES, B. D. and BAYEN, U. J. 1998, Teaching older adults to use computers: recommendations based on cognitive aging research. Educational Gerontology, 24(7), 675-690.
31. KLINE, D. W. and SCIALFA, C. T. 1997, Sensory and perceptual functioning: basic research and human factors implications. In A. D. Fisk and W. A. Rogers (eds) Handbook of Human Factors and the Older Adult (London: Academic Press), pp. 27-54.
32. LAGUANA, K. and BABCOCK, R. L. 1997, Computer anxiety in young and older adults: Implications for human-computer interactions in older populations. Computers in Human Behavior, 13(3), 317-326.
33. LOVELACE, C.T. and PARTAN, S. 2001, Integrating sensory integration. TRENDS in Cognitive Science, 5(2), 48-49.
34. MACKENZIE, I. S., SELLEN, A. and BUXTON, W. A. S. 1991, A comparison of input devices in elemental pointing and dragging tasks. Proceedings of the ACM Conference on Human Factors in Computing Systems: Reaching through Technology, 1991 (New York: ACM), pp. 161-166.
35. MACKENZIE, I. S., KAUPPINEN, T. and SILFVERBERG, M. 2001, Accuracy measures for evaluating computer pointing devices. Proceedings of the 2001 ACM Conference on Human Factors in Computing Systems (New York: ACM), pp. 9-16.
36. MCGEE, M. R., GRAY, P. D. and BREWSTER, S. A. 2001, The effective combination of haptic and auditory textural information. In S. A. Brewster and R. Murray-Smith (eds) Haptic-Human-Computer Interaction (Springer LNCS), Vol 2058, pp. 118-126.
37. MEAD, S. E., BATSAKES, P., FISK, A. D. and MYKITYSHYN, A. 1999, Application of cognitive theory to training and design solutions for age-related computer use. International Journal of Behavioral Development, 23(3), 553-573.
38. MEAD, S. E., SIT, R. A., ROGERS, W. A., JAMIESON, B. A. and ROUSSEAU, G. K. 2000, Influences of general computer experience and age on library database search performance. Behaviour & Information Technology, 19(2), 107-123.
39. MEYER, J. 2001, Age: 2000. Census 2000 Brief. C2KBR/01-12, US Census Bureau, USA.
40. MORRELL, R. W., MAYHORN, C. B. and BENNETT, J. 2000, A survey of world wide web use in middle-aged and older adults. Human Factors, 42(2), 175-182.
41. NEWBURGER, E. C. 2001, Home Computers and Internet Use in the United States: August 2000. Current Population Reports, Series P23-207, US Census Bureau, USA.
42. OAKLEY, I., MCGEE, M. R., BREWSTER, S. and GRAY, P. 2000, Putting the Feel in 'Look and Feel'. In Proceedings of ACM CHI 2000 (New York: ACM Press), pp. 415-422.
43. OVIATT, S. and COHEN, P. 2000, Multimodal interfaces that process what comes naturally. Communications of the ACM, 43(3), 45-53.
44. PROCTOR, R. W. and VU, K. L. 2002, Human information processing: Some implications for human-computer interaction. In J. Jacko and A. Sears (eds) The Human-Computer Interaction Handbook (Mahwah, NJ: Lawrence Erlbaum Associates), pp. 35-51.
45. RAMSTEIN, C., MARTIAL, O., DUFRENSE, A., CARIGNAN, M., CHASSE, P. and MABILLEAU, P. 1996, Touching and hearing GUI's: Design issues for pc-access system, 2nd Annual International ACM/SIGCAPH Conference on Assistive Technologies (ASSETS '96), Vancouver, B.C., 2-9.
46. ROGERS, W. A. 1997, Individual differences, aging, and human factors: An overview. In A. D. Fisk, and W. A. Rogers (eds) Handbook of Human Factors and the Older Adult (London: Academic Press), pp. 151-170.
47. SANDERS, M. S. and MCCORMICK, E. J. 1993, Human Factors in Engineering and Design, 7th edition (New York: McGraw-Hill Inc.).
48. SHNEIDERMAN, B. 1998, Designing the User Interface: Strategies for Effective Human Computer Interaction (Massachusetts: Addison Wesley).
49. SHNEIDERMAN, B. 1982, The future of interactive systems and the emergence of direct manipulation. Behavior and Information Technology, 1, 237-256.
50. SELLEN, A. J., KRUTENBACH, G. P. and BUXTON, W. A. S. 1990, The role of visual and kinesthetic feedback in the perception of mode errors. In D. Diaper, D. Gilmore, G. Cockton and B. Shackel (eds) Human-Computer Interaction, INTERACT '90, Proceedings of the IFIP TC13 Third International Conference on Human-Computer Interaction, (Cambridge, UK), pp. 667-673.
51. SELLEN, A. J., KRUTENBACH, G. P. and BUXTON, W. A. S. 1992, The prevention of mode errors through sensory feedback. Human-Computer Interaction, 7, 141-164.
52. SHIMOJO, S. and SHAMS, L. 2001, Sensory modalities are not separate modalities: plasticity and interactions. Current Opinion in Neurobiology, 11, 505-509.
53. SOTO-FARACO, S., LYONS, J., GAZZANIGA, M., SPENCE, C. and KINGSTONE, A. 2002, The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities. Cognitive Brain Research, 14, 139-146.
54. SMITH, M. W., SHARIT, J. and CZAJA, S. J. 1999, Aging, motor control, and the performance of computer related mouse tasks. Human Factors, 41(3), 389-396.
55. TAKAO, H., KAORU, S., OSUFI, J. and HIROAKI, I. 2002, Acoustic User Interface (AUI) for auditory displays. Displays, 23, 65-73.
56. TIFFIN, J. and ASHER, E. J. 1948, The Purdue Pegboard: Norms and Studies of Reliability and Validity. Journal of Applied Psychology, 32, 234-247.
57. VAN BEERS, R. J., WOLPERT, D. M. and HAGGARD, P. 2002, When feeling is more important that seeing in sensorimotor adaptation. Current Biology, 12, 834-837.
58. VAN DER VEER, G. C. and MELGUIZO, M. 2002, Mental Models. In J. Jacko and A. Sears (eds) The Human-Computer Interaction Handbook (Mahwah, NJ: Lawrence Erlbaum Associates), pp. 52-80.
59. VERCRUYSSEN, M. 1997. Movement control and speed of behavior. In A. D. Fisk and W. A. Rogers (eds) Handbook of Human Factors and the Older Adult (London: Academic Press), pp. 55-86.
60. VITENSE, H. S., JACKO, J. A. and EMERY, V. K. 2003, Multimodal feedback: an assessment of performance and mental workload. Ergonomics, 46(1-3), 68-87.
61. VITENSE, H. S., JACKO, J. A. and EMERY, V. K. 2002a, Foundations for improved interaction by individual with visual impairments through multimodal feedback. Universal Access in the Information Society (UAIS), 2, 76-87.
62. VITENSE, H. S., JACKO, J. A. and EMERY, V. K. 2002b, Unimodal, bimodal and trimodal output: Increasing accessibility for individuals with visual impairments. Proceedings of The Fifth International ACM SIGCAPH Conference on Assistive Technologies, Edinburgh, Scotland, 8-10 July 2002 (New York: ACM Press), pp. 49-56.
63. WARE, J. E., KOSINSKI, M. and KELLER, S. D. 1995, SF-12: How to Score the SF-12 Physical and Mental Health Summary Scales (2nd Ed.). (Boston, MA: The Health Institute, New England Medical Center).
64. WICKENS, C. D. 1984, Processing resources in attention. In R. Parasuraman and R. Davies (eds) Varieties of Attention (New York: Academic Press), pp. 63-101.
65. WICKENS, C. D. and LUI, Y. 1988. Codes and modalities in multiple resources: A success and qualification. Human Factors, 30(5), 599-616.
66. YU, W. and BREWSTER, S. A. 2003, Evaluation of multimodal graphs for blind people. Universal Access in the Information Society, 2(2), 105-124.