Accessible multimodal media center application for blind and partially sighted people

Computers in Entertainment

Volumn 8, Issue 3, 2010, Pages

  Turunen, Markku ^a   Soronen, Hannu ^a   Pakarinen, Santtu ^a   Hella, Juho ^a   Laivo, Tuuli ^a   Hakulinen, Jaakko ^a   Melto, Aleksi ^a   Rajaniemi, Juha Pekka ^a   Mäkinen, Erno ^a   Heimonen, Tomi ^a   Rantala, Jussi ^a   Valkama, Pellervo ^a   Miettinen, Toni ^a   Raisamo, Roope ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Accessibility; Digital television; Gestures; Haptic feedback; Media center; Speech recognition; Speech synthesis

Indexed keywords

ACCESSIBILITY; GESTURES; HAPTIC FEEDBACKS; KEY INPUT; LABORATORY STUDIES; MEDIA CENTER; MULTI-MODAL; PARTIALLY SIGHTED; SPEECH INPUT; SPEECH OUTPUT; USER GROUPS;

DIGITAL TELEVISION; GRAPHICAL USER INTERFACES; HAPTIC INTERFACES; SPEECH SYNTHESIS;

SPEECH RECOGNITION;

EID: 78650750587     PISSN: 15443574     EISSN: 15443981     Source Type: Journal    
DOI: 10.1145/1902593.1902595     Document Type: Conference Paper

References (34)

1. BALCHANDRAN, R., EPSTEIN, M. E., POTAMIANOS, G., AND SEREDI, L. 2008. A multi-modal spoken dialog system for interactive TV. In Proceedings of the 10th International Conference on Multimodal Interfaces (ICMI'08). ACM, New York, 191-192.
2. BEDERSON, B. B. 2000. Fisheye menus. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST'00). ACM, New York, 217-225.
3. BEDERSON, B. B., CLAMAGE, A., CZERWINSKI, M. P., AND ROBERTSON, G. G. 2004. DateLens: A fisheye calendar interface for PDAs. ACM Trans. Comput.-Human Interaction. 11, 1, 90-119.
4. BEDERSON, B. B., GROSJEAN, J., AND MEYER, J. 2004. Toolkit design for interactive structured graphics. IEEE Trans. Softw. Eng. 30, 8, 535-546.
5. BERGLUND, A. AND QVARFORDT, P. 2003. Error resolution strategies for interactive television speech interfaces. In Proceedings of the International Conference on Human-Computer Interaction (INTERACT'03). IFIP, Amsterdam, 2003, 105-112.
6. CAVAZZA, M., PEROTTO, W., AND CASHMAN, N. 1999. The "virtual interactive presenter": A conversational interface for interactive television. IDMS, 235-243.
7. CHEN, M.,MUMMERT, L., PILLAI, P., HAUPTMANN, A., AND SUKTHANKAR, R. 2010. Controlling your TV with gestures. In Proceedings of the International Conference onMultimedia Information Retrieval (MIR'10). ACM, New York, 405-408.
8. DTG USABILITY TEXT TO SPEECH SUBGROUP. 2009. White paper: Implementation guidelines and recommendations for text-to-speech v.1.4. (Dec.), DTG.
9. FERRETTI, S., ROCCETTI, M., AND STROZZI, F. 2008. On developing tangible interfaces for video streaming control: A real case study. In Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video. table of contents.
10. FERSCHA, A., VOGL, S., EMSENHUBER, B., AND WALLY, B. 2007. Physical shortcuts for media remote controls. In Proceedings of the 2nd International Conference on Intelligent Technologies for Interactive Entertainment (ICST). 1-8.
11. GOTO, J., KOMINE, K., KIM, Y.-B., AND URATANI, N. 2003. A television control system based on spoken natural language dialogue. In Proceedings of INTERACT 2003. IOS Press, 765-768.
12. HASSENZAHL, M. 2004. The thing and I: Understanding the relationship between user and product. In Funology: From Usability To Enjoyment. M. A. Blythe Ed. Kluwer, Norwell, MA, 31-42.
13. HOGGAN, E. AND BREWSTER, S. 2007. Designing audio and tactile crossmodal icons for mobile devices. In Proceedings of the 9th International Conference on Multimodal Interfaces (ICMI'07). ACM, New York, 162-169.
14. IBRAHIM, A. AND JOHANSSON, P. 2003. Multimodal dialogue systems: A case study for interactive TV. In 7th ERCIM International Workshop on User Interfaces for All. LNCS 2615, Springer, Berlin, 209-218.
15. JETTER, H.-C. AND GERKEN, J. 2006. A simplified model of user experience for practical application. The 2nd COST294-MAUSE International Open Workshop "User eXperience - Towards a Unified View" (NordiCHI'06).
16. KNILL, K. 2010. Text-to-speech synthesis to improve TV accessibility. IEEE Signal Process. Soc. Newsl., (July).
17. MICROSOFT CORP. 2010. Kinect overview. http://www.xbox.com/kinect/.
18. OVIATT, S. 1999. Ten myths of multimodal interaction. Commun. ACM 42, 11, 74-81.
19. PATOMÄKI, S., RAISAMO, R., SALO, J., PASTO, V., AND HIPPULA, A. 2004. Experiences on haptic interfaces for visually impaired young children. In Proceedings of ICMI 2004, The Sixth International Conference on Multimodal Interfaces. ACM, New York, 281-288. (Pubitemid 40371921)
20. PETRÉ , L. AND CHANDLER, E. 2009. Research into digital television: Analysis of 2007 survey on the user habits and preferences from blind and partially sighted people. RNIB Rep. (July).
21. REICHHELD, F. F. 2003. The one number you need to grow. Harvard Bus. Rev. 81, 47-54.
22. RICE, M. AND FELS, D. 2004. Low vision and the visual interface for interactive television. In Proceedings of the 2nd European Conference on Interactive Television. 80-89.
23. SAARINEN, R., JÄRVI, J., RAISAMO, R., TUOMINEN, E., KANGASSALO, M., PELTOLA, K., AND SALO, J. 2006. Supporting visually impaired children with software agents in a multimodal learning environment. Virtual Reality 9, 2-3, 108-117.
24. SCHLÖMER, T., POPPINGA, B., HENZE, N., AND BOLL, S. 2008. Gesture recognition with a Wii controller. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI'08). ACM, New York, 11-14.
25. SONY COMPUTER ENTERTAINMENT AMERICA LLC. 2010. PlayStation R® Move - PS3™ Move, PlayStation R® 3 Motion Controller. http://us.playstation. com/ps3/playstation-move/.
26. SORONEN, H., TURUNEN, M., AND HAKULINEN, J. 2008. Voice commands in home environment - A consumer survey. In Proceedings of Interspeech 2008. 2078-2081.
27. TINKER, P., FOX, J., AND DAILY, M. 2003. A zooming, electronic programming interface. In Proceedings of the 3rd Workshop on Personalization in Future TV (TV'03), 7-11.
28. TURUNEN, M., MELTO, A., HAKULINEN, J., KAINULAINEN, A., AND HEIMONEN, T. 2008. User expectations, user experiences and objective metrics in a multimodal mobile application. In Proceedings of the 3rd Workshop on Speech in Mobile and Pervasive Environments.
29. TURUNEN, M., KALLINEN, A., SÁNCHEZ, I., RIEKKI, J., HELLA, J., OLSSON, T., MELTO, A., RAJANIEMI, J.-P., HAKULINEN, J., MÄKINEN, E., VALKAMA, P., MIETTINEN, T., PYYKKÖNEN, M., SALORANTA, T., GILMAN, E., AND RAISAMO, R. 2009a. Multimodal interaction with speech and physical touch interface in a media center application. In Proceedings of the ACE 2009.
30. TURUNEN, M.,MELTO, A., HELLA, J., HEIMONEN, T., HAKULINEN, J.,MÄKINEN, E., LAIVO, T., AND SORONEN, H. 2009b. User expectations and user experience with different modalities in a mobile phone controlled home entertainment system. In Proceedings of the MobileHCI 2009.
31. TURUNEN, M., HAKULINEN, J., MELTO, A., HEIMONEN, T., LAIVO, T., AND HELLA, J. 2009c. SUXES - User experience evaluation method for spoken and multimodal interaction. In Proceedings of Interspeech.
32. TURUNEN, M., HAKULINEN, J., MELTO, A., HELLA, J., RAJANIEMI, J.-P., MÄKINEN, E., RANTALA, J., HEIMONEN, T., LAIVO, T., SORONEN, H., HANSEN, M., VALKAMA, P., MIETTINEN, T., AND RAISAMO, R. 2009d. Speech-based and Multimodal Media Center for different user groups. In Proceedings of Interspeech.
33. TURUNEN, M., HAKULINEN, J., MELTO, A., HELLA, J., LAIVO, T., RAJANIEMI, J.-P., MÄKINEN, E., SORONEN, H., HANSEN, M., PAKARINEN, S., HEIMONEN, T., RANTALA, J., VALKAMA, P., MIETTINEN, T., AND RAISAMO, R. 2010. Accessible speech-based and multimodal media center interface for users with physical disabilities. In Development of Multimodal Interfaces: Active Listening and Synchrony. Springer, Berlin, 66-79.
34. WITTENBURG, K., LANNING, T., SCHWENKE, D., SHUBIN, H., AND VETRO, A. 2006. The prospects for unrestricted speech input for TV content search. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI'06). ACM, New York, 352-359.