SpeeG: A multimodal speech- and gesture-based text input solution

Proceedings of the Workshop on Advanced Visual Interfaces AVI

Volumn , Issue , 2012, Pages 156-163

  Hoste, Lode ^a   Dumas, Bruno ^a   Signer, Beat ^a  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

gesture input; Kinect sensor; multimodal text input; speech recognition; SpeeG

Indexed keywords

ERROR RATE; GAME CONSOLES; GESTURE INPUT; HAND GESTURE; LEARNING PHASE; MICROSOFT; MULTI-MODAL; OPEN SOURCES; REAL-TIME CORRECTIONS; SPEECH INPUT; SPEEG; TEXT INPUT; TEXT INPUT SYSTEM; USER STUDY; WRITTEN TEXTS; ZOOMABLE USER INTERFACES;

FACE RECOGNITION; PATIENT REHABILITATION; SENSORS; SPEECH; SPEECH RECOGNITION;

USER INTERFACES;

EID: 84863577276     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2254556.2254585     Document Type: Conference Paper

References (15)

1. J. D. Baerdemaeker. SpeeG: A Speech- and Gesture-based Text Input Device. Master's thesis, Web & Information Systems Engineering Lab, Vrije Universiteit Brussel, September 2011.
2. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, N. L. Dahlgren, and V. Zue. TIMIT Acoustic-Phonetic Continuous Speech Corpus. Linguistic Data Consortium, Philadelphia, 1993.
3. D. Huggins-Daines and A. I. Rudnicky. Interactive ASR Error Correction for Touchscreen Devices. In Demo Proceedings of ACL 2008, Annual Meeting of the Association for Computational Linguistics, pages 17-19, Columbus, USA, 2008.
4. S. I. MacKenzie and W. R. Soukoreff. Phrase Sets for Evaluating Text Entry Techniques. In Extended Abstracts of CHI 2003, ACM Conference on Human Factors in Computing Systems, pages 754-755, Fort Lauderdale, USA, April 2003.
5. N. Osawa and Y. Y. Sugimoto. Multimodal Text Input in an Immersive Environment. In Proceedings of ICAT 2002, 12th International Conference on Artificial Reality and Telexistence, pages 85-92, Tokyo, Japan, December 2002.
6. S. Oviatt. Taming Recognition Errors with a Multimodal Interface. Communications of the ACM, 43:45-51, September 2000.
7. B. Suhm, B. Myers, and A. Waibel. Multimodal Error Correction for Speech User Interfaces. ACM Transactions on Computer-Human Interaction (TOCHI), 8:60-98, March 2001.
8. O. Tuisku, P. Majaranta, P. Isokoski, and K.-J. Räihä. Now Dasher! Dash Away!: Longitudinal Study of Fast Text Entry by Eye Gaze. In Proceedings of ETRA 2008, International Symposium on Eye Tracking Research & Applications, pages 19-26, Savannah, USA, March 2008.
9. K. Vertanen and P. O. Kristensson. Parakeet: A Continuous Speech Recognition System for Mobile Touch-Screen Devices. In Proceedings of IUI 2009, International Conference on Intelligent User Interfaces, pages 237-246, Sanibel Island, USA, February 2009.
10. K. Vertanen and D. J. MacKay. Speech Dasher: Fast Writing using Speech and Gaze. In Proceedings of CHI 2010, ACM Conference on Human Factors in Computing Systems, pages 595-598, Atlanta, USA, April 2010.
11. W. Walker, P. Lamere, P. Kwok, B. Raj, R. Singh, E. Gouvea, P. Wolf, and J. Woelfel. Sphinx-4: A Flexible Open Source Framework for Speech Recognition. Technical Report TR-2004-139, Sun Microsystems Inc., November 2004.
12. D. J. Ward, A. F. Blackwell, and D. J. C. MacKay. Dasher - A Data Entry Interface Using Continuous Gestures and Language Models. In Proceedings of UIST 2000, 13th Annual ACM Symposium on User Interface Software and Technology, pages 129-137, San Diego, USA, November 2000.
13. D. J. Ward and D. J. C. MacKay. Fast Hands-free Writing by Gaze Direction. Nature, 418(6900):838, August 2002.
14. S. Wills and D. MacKay. Dasher - An Efficient Writing System for Brain-Computer Interfaces? IEEE Transactions on Neural Systems and Rehabilitation Engineering, 14(2):244-246, June 2006. (Pubitemid 44150252)
15. A. D. Wilson and M. Agrawala. Text Entry Using a Dual Joystick Game Controller. In Proceedings of CHI 2006, ACM Conference on Human Factors in Computing Systems, pages 475-478, Montréal, Canada, April 2006.