Reducing working memory load in spoken dialogue systems

Interacting with Computers

Volumn 21, Issue 4, 2009, Pages 276-287

  Wolters, Maria ^a   Georgila, Kallirroi ^a   Moore, Johanna D ^a   Logie, Robert H ^a   MacPherson, Sarah E ^a   Watson, Matthew ^b  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSITY OF SUNDERLAND   (United Kingdom)

Author keywords

Cognitive ageing; Processing speed; Spoken dialogue systems; Universal design; Usability; Working memory

Indexed keywords

SPEECH PROCESSING;

COGNITIVE AGEING; PROCESSING SPEED; SPOKEN DIALOGUE SYSTEM; UNIVERSAL DESIGN; USABILITY; WORKING MEMORY;

COGNITIVE SYSTEMS;

EID: 67651096032     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2009.05.009     Document Type: Article

References (101)

1. Baddeley A. Working Memory in Thought and Action (2007), Oxford University Press, Oxford, UK
2. Alexandersson J. i2home - towards a universal home environment for the elderly and disabled. K ünstliche Intelligenz 08 3 (2008) 66-68
3. Arking R. Biology of Aging. third ed (2005), Oxford University Press, New York, NY
4. Aylett, M., Pidcock, C., Fraser, M., 2006. The Cerevoice Blizzard Entry 2006: a prototype database unit selection engine. In: Proceedings of the 2nd BLIZZARD Challenge.
5. Baber C., Mellor B., Graham R., Noyes J.M., and Tunley C. Workload and the use of automatic speech recognition: the effects of time and resource demands. Speech Communication 20 (1996) 37-53
6. Baeckman L., Small B.J., and Wahlin A. Aging and memory: cognitive and biological perspectives. In: Birren J.E., and Schaie K.W. (Eds). Handbook of the Psychology of Aging (2001), Academic Press, San Diego, CA, etc. 349-377
7. Bailey, B., 2000. How to improve design decisions by reducing reliance to superstition. Let's start with Miller's Magic 7 ± 2. (retrieved 08.02.08.).
8. Bickmore T., and Giorgino T. Health dialog systems for patients and consumers. Journal of Biomedical Informatics 39 (2006) 556-571
9. Black L.-A., McMeel C., McTear M., Black N., Harper R., and Lemon M. Implementing autonomy in a diabetes management system. Journal of Telemedicine and Telecare 11 Suppl. 1 (2005) 6-8
10. Black, L.-A., McTear, M., Black, N., Harper, R., Lemon, M., 2005b. Evaluating the DI@L-LOG system on a cohort of elderly, diabetic patients: results from a preliminary study. In: Proceedings of Interspeech, Lisbon, Portugal, pp. 821-824.
11. Bohus, D., Rudnicky, A., 2005. Sorry, I didn't catch that!-an investigation of non-understanding errors and recovery strategies. In: Proceedings of the 6th SIGDial Workshop on Discourse and Dialogue, Lisbon, Portugal, pp. 128-143.
12. Bond C., and Camack M. Your call is important to us, please hold. Ergonomics in Design 7 (1999) 9-15
13. Bortz J. Statistik. sixth ed. (1993), Springer, Berlin/New York
14. Brennan S. The grounding problem in conversations with and through computers. In: Kreuz S. (Ed). Social and Cognitive Psychological Applaches to Interpersonal Communication (1998), Lawrence Erlbaum, Hillsdale, NJ 201-225
15. Bugg J.M., Zook N.A., DeLosh E.L., Davalos D.B., and Davis H.P. Age differences in fluid intelligence: contributions of general slowing and frontal decline. Brain and Cognition 62 (2006) 9-16
16. Carenini G., and Moore J.D. Generating and evaluating evaluative arguments. Artificial Intelligence 170 11 (2006) 925-952
17. Charlton R.A., Landau S., Schiavone F., Barrick T.R., Clark C.A., Markus H.S., and Morris R.G. Astructural equation modeling investigation of age-related variance in executive function and DTI measured white matter damage. Neurobiology of Aging 29 (2007) 1547-1555
18. Clark H.H., and Brennan S.E. Grounding in communication. In: Resnick L.B., Levine J., and Behrend S.D. (Eds). Perspectives on Socially Shared Cognition (1991), American Psychological Association, Washington, DC 127-149
19. Clarke, K., Lewin, M., Atkins, D., Kalawsky, R., 2005. Testing a framework for multimodal control in the home environment. In: Proceedings of the IEEE Workshop on Perspectives in Pervasive Computing, pp. 87-95.
20. Cohen J. Statistical Power Analysis for the Behavioral Sciences. second ed. (1988), Lawrence Erlbaum, Hillsdale, NJ
21. Cohen R., Allaby C., Cumbaa C., Fitzgerald M., Ho K., Hui B., Latulipe C., Lu F., Moussa N., Pooley D., Qian A., and Siddiqi S. What is initiative?. User Modeling and User-Adaptive Interaction 8 (1998) 171-214
22. Commarford P.M., Lewis J.R., Smither J.A.-A., and Gentzler M.D. A comparison of broad versus deep auditory menu structures. Human Factors 50 1 (2008) 77-89. http://hfs.sagepub.com/cgi/content/abstract/50/1/77
23. Czaja S., and Lee C. The impact of aging on access to technology. Universal Access in the Information Society 5 (2007) 341-349
24. Dahlbäck N., Jönsson A., and Ahrenberg L. Wizard of Oz studies - Why and How. Knowledge-Based Systems 6 (1993) 258-266
25. Darlington, R., n.d. Factor analysis. http://www.psych.cornell.edu/Darlington/factor.htm (last retrieved 15.09.07.).
26. Deary I.J., Whiteman M.C., Starr J.M., Whalley L.J., and Fox H.C. The impact of childhood intelligence on later life: following up the Scottish Mental Surveys of 1932 and 1947. Journal of Personality and Social Psychology 86 (2004) 130-147
27. Duff S.C., and Logie R.H. Processing and storage in working memory span. Quarterly Journal of Experimental Psychology A 54 (2001) 31-48
28. Dulude L. Automated telephone answering systems and aging. Behaviour & Information Technology 21 (2002) 171-184
29. Fozard J.L., and Gordon-Salant S. Changes in vision and hearing with aging. In: Birren J.E., and Schaie K.W. (Eds). Handbook of the Psychology of Aging (2001), Academic Press, San Diego, CA 241-266
30. Fraser N., and Gilbert G. Simulating speech systems. Computer Speech and Language 5 1 (1991) 81-99
31. Garden S., Phillips L., and MacPherson S. Mid-life aging, open-ended planning, and laboratory measures of executive function. Neuropsychology 15 (2001) 472-482
32. Georgila, K., Wolters, M., Karaiskos, V., Kronenthal, M., Logie, R., Mayo, N., Moore, J., Watson, M., 2008a. A fully annotated corpus for studying the effect of cognitive ageing on users' interactions with spoken dialogue systems. In: Proceedings of the 6th International Conference on Language Resources and Evaluation.
33. Georgila, K., Wolters, M., Moore, J., 2008b. Simulating the behaviour of older versus younger users. In: Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics, Human Language Technologies (ACL/HLT), pp. 49-52.
34. Giorgino T., Azzini I., Rognoni C., Quaglini S., Stefanelli M., Gretter R., and Falavigna D. Automated spoken dialogue system for hypertensive patient home management. International Journal of Medical Informatics 74 (2005) 159-167
35. Gödde, F., Möller, S., Engelbrecht, K.-P., Kühnel, C., Schleicher, R., Naumann, A., Wolters, M., 2008. Study of a speech-based smart home system with older users. In: International Workshop on Intelligent User Interfaces for Ambient Assisted Living, pp. 17-22.
36. Gregor, P., Newell, A.F., Zajicek, M., 2002. Designing for dynamic diversity - interfaces for older people. In: Proceedings of ASSETS 2002, The 5th International ACM Conference on Assistive Technologies, Edinburgh UK, pp. 151-156.
37. Hawthorn D. Possible implications of aging for interface designers. Interacting with Computers 12 (2000) 507-528
38. Hockey, B.A., Lemon, O., Campana, E., Hiatt, L.M., Aist, G., Hieronymus, J., Dowding, J., Gruenstein, A., 2003. Targeted help for spoken dialogue systems. In: Proceedings of the 10th Conference of the European Chapter of the Association for Computational Linguistics, pp. 147-154.
39. Hone K.S., and Graham R. Towards a tool for the subjective assessment of speech system interfaces (SASSI). Natural Language Engineering 6 (2000) 287-305
40. Horn J.L. The theory of fluid and crystallized intelligence in relation to concepts of cognitive psychology and aging in adulthood. In: Craik F., and Trehub S. (Eds). Advances in the Study of Communication and Affect. Aging and Cognitive Processes (1982), Plenum Press, New York, NY 237-278 (Chapter 8)
41. Huguenard B.W., Lerch F.J., Junker B.W., Patz R.J., and Kass R.E. Working memory failure in phone-based interaction. ACM Transactions on Computer-Human Interaction 4 (1997) 67-102
42. ISO, 1998. ISO Ergonomic Requirements for Office Work With Visual Display Terminals (VDTs) - Part 11: Guidance on Usability.
43. ITU-T Rec. P.851, 2003. Subjective Quality Evaluation of Telephone Services Based on Spoken Dialogue Systems. International Telecommunication Union, Geneva.
44. Kurniawan, S.H., Ellis, R.D., Zaphiris, P., 2002. Comparing older and younger adults' traversal time in expandable and non-expandable hierarchical structures. In: Proceedings of the Human Factors and Ergonomics Society Conference, pp. 185-188.
45. Lai J., Karat C.-M., and Yankelovich N. Conversational speech interfaces and technologies. In: Sears A., and Jacko J. (Eds). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. second ed. (2008), Lawrence Erlbaum, New York, NY 381-391
46. Lemon, O., Pietquin, O., 2007. Machine learning for spoken dialogue systems. In: Proceedings of Interspeech, Antwerp, Belgium.
47. Levitt T., Fugelsang J., and Crossley M. Processing speed, attentional capacity, and age-related memory change. Experimental Aging Research 32 (2006) 263-295
48. Logie R., and vander Meulen M. Fragmenting and integrating visuo-spatial working memory. In: Brockmole J. (Ed). Representing the Visual World in Memory (2009), Psychology Press, Hove, UK 1-32 (Chapter 1)
49. Lohse G. The role of working memory in the graphical information design. Behaviour and Information Technology 21 (1997) 273-280
50. Miller G.A. The magical number seven, plus or minus two. Psychological Review 63 2 (1956) 81-97
51. Möller, S., Engelbrecht, K.-P., Oulasvirta, A., 2007. Analysis of communication failures for spoken dialogue systems. In: Proceedings of Interspeech.
52. Möller, S., Gödde, F., Wolters, M., 2008. A corpus analysis of spoken smart-home interactions with older users. In: Proceedings of the 6th International Conference on Language Resources and Evaluation.
53. Möller S., Smeele P., Boland H., and Krebber J. Evaluating spoken dialogue systems according to de-facto standards: a case study. Computer Speech and Language 21 1 (2007) 26-53
54. Moore, J.D., Foster, M.-E., Lemon, O., White, M., 2004. Generating tailored, comparative descriptions in spoken dialogue. In: Proceedings of the 17th International Florida Artificial Intelligence Research Society Conference, pp. 917-922.
55. Morrow D.G., Hier C.M., Menard W.E., and Leirer V.O. Icons improve older and younger adults' comprehension of medication information. Journals of Gerontology Series B: Psychological Sciences and Social Sciences 53 (1998) 240-254
56. In: Nielsen J., and Mack R.L. (Eds). Usability Inspection Methods (1994), John Wiley & Sons, New York, NY
57. Perugini S., Anderson T.J., and Moroney W.F. A study of out-of-turn interaction in menu-based, IVR, voicemail systems. CHI'07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2007), ACM Press, New York, NY, USA 961-970
58. Petrie H. Accessibility and usability requirements for ICTs for disabled and elderly people: a functional classification approach. In: Nicolle C., and Abascal J. (Eds). Inclusive Design Guidelines for HCI (2001), Taylor and Francis, London, UK 29-60
59. Polifroni, J., Walker, M., 2006. An analysis of automatic content selection algorithms for spoken dialogue system summaries. In: Proceedings of IEEE/ACL Spoken Language Technology Workshop, pp. 186-189.
60. Pollack M. Intelligent technology for an aging population: the use of AI to assist elders with cognitive impairment. AI Magazine 26 (2005) 9-24
61. Pollack M., Brown L., Colbry D., McCarthy C.E., Orosz C., Peintner B., Ramakrishman S., and Tsamardinos I. Autominder: an intelligent cognitive orthotic system for people with memory impairment. Robotics and Autonomous Systems 44 (2003) 273-282
62. R Development Core Team, 2006. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria.
63. Rabbitt P. Mild hearing loss can cause apparent memory failures which increase with age and reduce with IQ. Acta Oto-Laryngologica Supplement 476 (1990) 167-175
64. Rabbitt P., and Anderson M. The lacunae of loss? Aging and the differentiation of cognitive abilities. In: Bialystok E., and Craik F.I. (Eds). Lifespan Cognition: Mechanisms of Change (2006), Oxford University Press, New York, NY Ch.23
65. Rabbitt P., Diggle P., Holland F., and McInnes L. Practice and drop-out effects during a 17-year longitudinal study of cognitive aging. The Journals of Gerontology Series B, Psychological Sciences and Social Sciences 59 (2004) 84-97
66. Rabbitt P., Scott M., Thacker N., Lowe C., Jackson A., Horan M., and Pendleton N. Losses in gross brain volume and cerebral blood flow account for age-related differences in speed but not in fluid intelligence. Neuropsychology 20 (2006) 549-557
67. Raven, J., Raven, J., Court, J., 1998. Manual for Raven's Progressive Matrices and Vocabulary Scales. Harcourt Assessment, San Antonio, TX.
68. Rogers W.A., Meyer B., Walker N., and Fisk A.D. Functional limitations to daily living tasks in the aged: a focus group analysis. Human Factors 40 (1998) 111-125
69. Roy, N., Pineau, J., Thrun, S., 2000. Spoken dialogue management using probabilistic reasoning. In: Proceedings of the 38th Annual Meeting of the Association for Computation Linguistics (ACL), pp. 93-100.
70. Salthouse T.A. Mediation of adult age differences in cognition by reductions in working memory and speed of processing. Psychological Science 2 (1991) 179-183
71. Salthouse T.A. Speed mediation of adult age differences in cognition. Developmental Psychology 29 (1993) 722-738
72. Salthouse T.A. Interrelations of aging, knowledge, and cognitive performance. Understanding Human Development: Lifespan Psychology in Exchange With Other Disciplines (2003), Kluwer Academic, Berlin, Germany 265-287
73. Salthouse T.A. What and when of cognitive aging. Current Directions in Psychological Science 13 (2004) 140-144
74. Schaie K.W. Perceptual speed in adulthood: cross-sectional and longitudinal studies. Psychology and Aging 4 (1989) 443-453
75. Schatzmann J., Weilhammer K., Stuttle M., and Young S. A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies. Knowledge Engineering Review 21 (2006) 97-126
76. Schneider B.A., Daneman M., and Murphy D.R. Speech comprehension difficulties in older adults: cognitive slowing or age-related changes in hearing?. Psychology and Aging 20 (2005) 261-271
77. Sharit J., Czaja S.J., Hernandez M., Yang Y., Perdomo D., Lewis J., Lee C.C., and Nair S. An evaluation of performance by older persons on a simulated telecommuting task. Journals of Gerontolology, Series B: Psychological Sciences and Social Sciences 59 (2004) 306-315
78. Sharit J., Czaja S.J., Nair S., and Lee C.C. Effects of age, speech rate, and environmental support in using telephone voice menu systems. Human Factors 45 (2003) 234-251
79. Sharp H., Rogers Y., and Preece J. Interaction Design. second ed. (2007), John Wiley, London, UK
80. Sheeder T., and Balogh J. Say it like you mean it: priming for structure in caller responses to a spoken dialog system. International Journal of Speech Technology 6 (2003) 103-111
81. Sjölinder M., Höök K., and Nilsson L.-G. The effect of age-related cognitive differences, task complexity and prior internet experience in the use of an online grocery shop. Spatial Cognition and Computation 3 (2003) 61-84
82. Stent A.J., Huffman M.K., and Brennan S.E. Adapting speaking after evidence of misrecognition: local and global hyperarticulation. Speech Communication 50 3 (2008) 163-178
83. Stephens E.C., Carswell C.M., and Schumacher M.M. Evidence for an elders' advantage in the naive product usability judgments of older and younger adults. Human Factors 48 (2006) 422-433
84. Suhm B., Bers J., McCarthy D., Freeman B., Getty D., Godfrey K., and Peterson P. A comparative study of speech in the call center: natural language call routing vs. touch-tone menus. CHI'02: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2002), ACM Press, New York, NY, USA 283-290
85. Traum, D., 1994. A Computational Theory of Grounding in Natural Language Conversation. Ph.D. Thesis, University of Rochester.
86. Unsworth N., and Engle R.W. Individual differences in working memory capacity and learning: evidence from the serial reaction time task. Memory and Cognition 33 (2005) 213-220
87. vander Meulen M., Logie R., Freer Y., Sykes C., McIntosh N., and Hunter J. When a graph is poorer than 100 words: a comparison of computerised natural language generation, human generated descriptions and graphical displays in neonatal intensive care. Applied Cognitive Psychology (2009)
88. Vipperla, R., Wolters, M., Georgila, K., Renals, S., 2009. Speech input from older users in smart environments: challenges and perspectives. In: Proceedings of HCI International, San Diego, CA.
89. Walker M., Litman D.J., Kamm C.A., and Abella A. Evaluating spoken dialogue agents with PARADISE: two case studies. Computer Speech and Language 12 (1998) 26-53
90. Walker M., Whittaker S., Stent A., Maloor P., Moore J., Johnston M., and Vasireddy G. Generation and evaluation of user tailored responses in multimodal dialogue. Cognitive Science 28 5 (2005) 811-840
91. Walker, M.A., Passonneau, R.J., Boland, J., 2001. Quantitative and qualitative evaluation of DARPA communicator spoken dialogue systems. In: Proceedings of the 39th Meeting of the Association for Computational Linguistics, pp. 515-522.
92. Wechsler D. Manual for the Wechsler Adult Intelligence Scale-Revised (1981), The Psychological Corporation, New York
93. Wolters, M., Campbell, P., DePlacido, C., Liddell, A., Owens, D., 2007. Making synthetic speech accessible to older people. In: Proceedings of the 6th ISCA Workshop on Speech Synthesis, Bonn, Germany, pp. 288-293.
94. Wolters, M., Georgila, K., MacPherson, S., Moore, J., 2009. Being old doesn't mean acting old: older users' interaction with spoken dialogue systems. ACM Transactions on Accessible Computing 2 (1). Available from:.
95. Zajicek M. Successful and available: interface design exemplars for older users. Interacting with Computers 16 (2004) 411-430
96. Zajicek M. Aspects of HCI research for older people. Universal Access in the Information Society 5 3 (2006) 279-286
97. Zajicek, M., Khin Kyaw, Z., 2005. The speech dialogue design for a PDA/Web based reminder system. In: Proceedings of the 9th IASTED International Conference on Internet and Multimedia Systems and applications, Hawaii, pp. 394-399.
98. Zajicek M., and Morrissey W. Speech output for older visually impaired adults. People and Computers XV - Interaction without Frontiers. Joint Proceedings of HCI 2001 and IHM 2001 (2001), Springer, London, UK 503-513
99. Zajicek M., Wales R., and Lee A. Speech interaction for older adults. Universal Access in the Information Society 3 2 (2004) 122-130
100. Zaphiris P., Kurniawan S., and Ghiawadwala M. A systematic approach to the development of web design guidelines for older people. Universal Access in the Information Society 6 (2007) 59-75
101. Zoltan-Ford E. How to get people to say and type what computers can understand. International Journal of Man-Machine Studies 34 (1991) 527-547