Write-N-Speak: Authoring multimodal digital-Paper materials for speech-Language Therapy

ACM Transactions on Accessible Computing

Volumn 4, Issue 1, 2011, Pages

  Piper, Anne Marie ^a   Weibel, Nadir ^a   Hollan, James D ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Communication; Multimodal interaction; Older adults; Pen based computing; Speech language therapy

Indexed keywords

CLINICAL SETTINGS; DIGITAL PENS; END USERS; FIELD RESEARCH; MULTI-MODAL; MULTI-MODAL INTERACTIONS; OLDER ADULTS; PEN-BASED COMPUTING; SPEECH-LANGUAGE THERAPY;

COMMUNICATION; OBJECT RECOGNITION; PHOTOGRAPHY; SPEECH RECOGNITION;

SPEECH COMMUNICATION;

EID: 81755176771     PISSN: 19367228     EISSN: None     Source Type: Journal    
DOI: 10.1145/2039339.2039341     Document Type: Article

References (44)

1. ALLEN, M.,MCGRENERE, J., AND PURVES, B. 2008. The field evaluation of a mobile digital image communication application designed for people with aphasia. ACM Trans. Access. Comput. 1, 1, 1-26.
2. ANOTO. 2011. Digital Pen and Paper Technology. http://www.anoto.com.
3. AVERY. 2011. Office products and labels. http://www.avery.com.
4. BUNGALOW SOFTWARE. 2011. Therapy and Rehabilitation After Stroke, Aphasia and Head Injuries. http://www.bungalowsoftware.com.
5. CALDER, D. 2008. Speechkit: A multimedia speech tool. In Proceedings of the ACM Conference on Information Integration and Web-based Applications & Services (iiWAS). 647-650.
6. CHANDLER, S., HARRIS, J.,MONCRIEF, A., AND LEWIS, C. 2009. Naming practice for people with aphasia as a mobile Web application. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS). 247-248.
7. CHIU, P. AND WILCOX, L. 1998. A dynamic grouping technique for ink and audio notes. In Proceedings of ACM Symposium on User Interface Software and Technology (UIST). 195-202.
8. CONROY, K., LEVIN, D., AND GUIMBRETIÈRE, F. 2004. ProofRite: A paper-augmented word processor. Tech. rep. HCIL-2004-22, CS-TR-4652, Human-Computer Interaction Lab, University of Maryland.
9. CRERAR, M. 2004. Aphasia rehabilitation and the strange neglect of speed. Int. J. Neuropsych. Rehab. 14, 173-206. (Pubitemid 38392514)
10. CRERAR, M., ELLIS, A., AND DEAN, E. 1996. Remediation of sentence processing deficits in aphasia using a computer-based microworld. Brain Lang. 52, 1, 229-275.
11. DEVLIN, S. AND UNTHANK, G. 2006. Helping aphasic people process online information. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS). 225-226. (Pubitemid 46634160)
12. DYNAVOX. 2011. Speech Devices-Augmentative Communication. http://www.dynavoxtech.com.
13. FAIRBANKS, G. 1960. Voice and Articulation Drillbook. Addison Wesley, New York.
14. GUIMBRETIÈRE, F. 2003. Paper augmented digital documents. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). 51-60. (Pubitemid 40730673)
15. KONISHI, K. AND IKEDA, N. F. 2007. Data model and architecture of a paper-digital document management system. In Proceedings of the ACM Symposium on Document Engineering (DocEng). 29-31.
16. LEAPFROG ENTERPRISES. 2011. Fly Fusion Pentop Computer Software. http://www.flyworld.com.
17. LIAO, C., GUIMBRETIÈRE, F., HINCKLEY, K., AND HOLLAN, J. 2008. PapierCraft: A Gesture-Based Command System for Interactive Paper. ACM Trans. Comput. Hum. Inter. 14, 4, 1-27.
18. LINGRAPHICA. 2011. Communication Device for Stroke Victims - Aphasia - Apraxia. http://www.aphasia.com.
19. LIVESCRIBE. 2011a. Livescribe Developer Tools. http://www.livescribe.com/ developers.
20. LIVESCRIBE. 2011b. Livescribe Smart Pen Technology. http://www. livescribe.com.
21. LUFF, P.,HEATH, C., AND GREATBATCH, D. 1992. Tasks-in-interaction: Paper and screen based documentation in collaborative activity. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW). 163-170. (Pubitemid 23612589)
22. MACKAY, W. 1999. Is paper safer? The role of paper flight strips in air traffic control. ACM Trans. Comput.- Hum. Inter. 6, 4, 309-210.
23. MACKAY, W. E., POTHIER, G., LETONDAL, C., BøEGH, K., AND SøRENSEN, H. E. 2002. The Missing link: Augmenting biology laboratory notebooks. In Proceedings of the ACM User Interface and Software Technology (UIST). 41-50.
24. MOFFATT, K., MCGRENERE, J., PURVES, B., AND KLAWE, M. 2004. The participatory design of a sound and image enhanced daily planner for people with aphasia. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI). 407-414.
25. NOMURA, S., HUTCHINS, E., AND HOLDER, B. 2006. The uses of paper in commercial airline flight operations. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work (CSCW). 249-258. (Pubitemid 47112413)
26. NORRIE, M. C., SIGNER, B., AND WEIBEL, N. 2006. General Framework for the Rapid Development of Interactive Paper Applications. In Proceedings of the International Workshop on Collaborating over Paper and Digital Documents (CoPADD). 9-12.
27. OVIATT, S. 2003. Multimodal interfaces. In The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. A. Sears and J. Jacko Eds., 286-304.
28. OVIATT, S., COHEN, P., WU, L., VERGO, J., DUNCAN, L., SUHM, B., BERS, J., HOLZMAN, T., WINOGRAD, T., LANDAY, J., LARSON, J., AND FERRO, D. 2000. Designing the user interface for multimodal speech and pen-based gesture applications: State of the art systems and future research directions. J. Hum.- Comput. Inter. 15, 4, 263-322. (Pubitemid 32371462)
29. PIPER, A.,WEIBEL, N., AND HOLLAN, J. 2010. Introducing multimodal paper-digital interfaces for speechlanguage therapy. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS).
30. PROLOQUO2GO. 2011. Augmentative and Alternative Communication (AAC) for iPhone, iPod touch and iPad. http://www.proloquo2go.com.
31. SELLEN, A. J. AND HARPER, R. 2001. The Myth of the Paperless Office. MIT Press.
32. SIGNER, B. 2008. Fundamental Concepts for Interactive Paper and Cross-Media Information Spaces. Books on Demand Gmbh.
33. SIGNER, B. AND NORRIE, M. C. 2007. Paperpoint: A paper-based presentation and interactive paper prototyping tool. In Proceedings of the ACM Conference on Tangible and Embedded Interaction (TEI). 57-64. (Pubitemid 47482747)
34. SIGNER, B., KURMANN, U., AND NORRIE, M. C. 2007. Igesture: A general gesture recognition framework. In Proceedings of the International Conference on Document Analysis and Recognition (ICDAR).
35. STEIMLE, J., BRDICZKA, O., AND MÜHLHÄUSER, M. 2009. CoScribe: Integrating paper and digital documents for collaborative knowledge work. IEEE Trans. Learn. Technol. 2, 3, 174-188.
36. STIFELMAN, L., ARONS, B., AND SCHMANDT, C. 2001. The audio notebook: Paper and pen interaction with structured speech. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI). 182-189.
37. TEE, K.,MOFFATT, K., FINDLATER, L., MACGREGOR, E., MCGRENERE, J., PURVES, B., AND FELS, S. S. 2005. A visual recipe book for persons with language impairments. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI). 501-510. (Pubitemid 41809087)
38. WALLER, A., DENNIS, F., BRODIE, J., AND CAIRNS, A. 1998. Evaluating the use of TalksBac, A predictive (Pubitemid 28098604)
39. WEIBEL, N. 2009. A publishing infrastructure for interactive paper documents: Supporting interactions
40. WEIBEL, N., ISPAS, A., SIGNER, B., AND NORRIE, M. C. 2008. Paperproof: A paper-digital proof-editing system. In Extended Abstracts of ACM Conference on Human Factors in Computing Systems (CHI). 2349-2354.
41. WELLNER, P. 1993. Interacting with paper on the digitaldesk. Comm. ACM 36, 7, 87-96.
42. WORLD HEALTH ORGANIZATION. 2007. World Health Organization. World Health Report. http://www.who.int/whr/en.
43. YEH, R., LIAO, C., KLEMMER, S., GUIMBRETIÈRE, F., LEE, B., KAKARADOV, B., STAMBERGER, J., AND PAEPCKE, A. 2006. Butterflynet: A mobile capture and access system for field biology research. In Proceedings of ACM Conference on Human Factors in Computing Systems (CHI). 571-580. (Pubitemid 44032145)
44. YEH, R. B., KLEMMER, S. R., PAEPCKE, A., BASTÉA-FORTE, M., BRANDT, J., AND BOLI, J. 2007. Iterative design of a paper + digital toolkit: Supporting designing, developing, and debugging. Tech. rep. CSTR 2007-10, Stanford University, Computer Science Department