Airwriting: Hands-free mobile text input by spotting and continuous recognition of 3d-space handwriting with inertial sensors

Proceedings - International Symposium on Wearable Computers, ISWC

Volumn , Issue , 2012, Pages 52-59

  Amma, Christoph ^a   Georgi, Marcus ^a   Schultz, Tanja ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

Accelerometers; Handwriting recognition; User interfaces; Wearable computers

Indexed keywords

DATA SEGMENT; DATA SETS; FALSE POSITIVE; HANDS-FREE; HANDS-FREE INTERACTIONS; HANDWRITING DATA; HANDWRITING RECOGNITION; INERTIAL SENSOR; INPUT METHODS; MOTION SENSING; MOTION SENSORS; PERSON-DEPENDENT; PERSON-INDEPENDENT; RECOGNITION OF HANDWRITING; RECOGNITION PERFORMANCE; SEARCH SPACES; STATISTICAL LANGUAGE MODELS; TEXT INPUT; TEXT REPRESENTATION; WORD ERROR RATE; WORD MODELS;

ACCELEROMETERS; EXPERIMENTS; HIDDEN MARKOV MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH RECOGNITION; THREE DIMENSIONAL COMPUTER GRAPHICS; USER INTERFACES; WEARABLE COMPUTERS;

CHARACTER RECOGNITION;

EID: 84866538938     PISSN: 15504816     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISWC.2012.21     Document Type: Conference Paper

References (24)

1. S. Mitra and T. Acharya, "Gesture Recognition: A Survey," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 37, pp. 311-324, 2007.
2. K. Lyons, T. Starner, D. Plaisted, J. Fusia, A. Lyons, A. Drew, and E. W. Looney, "Twiddler typing: one-handed chording text entry for mobile phones," in Proc. of the SIGCHI conference on Human factors in computing systems (CHI'04), 2004.
3. I. S. MacKenzie, R. W. Soukoreff, and J. Helga, "1 thumb, 4 buttons, 20 words per minute: design and evaluation of h4-writer," in Proc. of the 24th annual ACM symposium on User interface software and technology (UIST'11), 2011.
4. P. Mistry, P. Maes, and L. Chang, "Wuw - wear ur world: a wearable gestural interface," in Proc. of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA '09), 2009.
5. E. Tamaki, T. Miyaki, and J. Rekimoto, "Brainy hand: an ear-worn hand gesture interaction device," in Proc. of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA '09), 2009.
6. S. Gustafson, D. Bierwirth, and P. Baudisch, "Imaginary interfaces: spatial interaction with empty hands and without visual feedback," in Proc. of the 23nd annual ACM symposium on User interface software and technology (UIST'10), 2010.
7. H. Junker, O. Amft, P. Lukowicz, and G. Tröster, "Gesture spotting with body-worn inertial sensors to detect user activities," Pattern Recognition, vol. 41, no. 6, pp. 2010-2024, 2008.
8. G. Raffa, J. Lee, L. Nachman, and J. Song, "Don't slow me down: Bringing energy efficiency to continuous gesture recognition," in Proc. International Symposium on Wearable Computers (ISWC'10), 2010.
9. H.-K. Lee and J. Kim, "An hmm-based threshold model approach for gesture recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 961-973, oct 1999.
10. T. Stiefmeier, D. Roggen, G. Tröster, G. Ogris, and P. Lukowicz, "Wearable activity tracking in car manufacturing," IEEE Pervasive Computing, vol. 7, no. 2, p. 42, 2008
11. S. Kallio, J. Kela, and J. Mantyjarvi, "Online gesture recognition system for mobile interaction," in Proc. IEEE International Conference on Systems, Man and Cybernetics (ICSMC'03), 2003.
12. A. Hein, A. Hoffmeyer, and T. Kirste, "Utilizing an accelerometric bracelet for ubiquitous gesture-based interaction," in Universal Access in Human-Computer Interaction. Intelligent and Ubiquitous Interaction Environments, ser. Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2009, vol. 5615, pp. 519-527.
13. O. Amft, R. Amstutz, A. Smailagic, D. Siewiorek, and G. Trster, "Gesture-controlled user input to complete questionnaires on wrist-worn watches," in Human-Computer Interaction. Novel Interaction Methods and Techniques, ser. Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2009, vol. 5611, pp. 131-140.
14. D. Kim, H. Choi, and J. Kim, "3d space handwriting recognition with ligature model," in Ubiquitous Computing Systems, ser. Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2006, vol. 4239, pp. 41-56.
15. W.-C. Bang,W. Chang, K.-H. Kang, E.-S. Choi, A. Potanin, and D.-Y. Kim, "Self-contained spatial input device for wearable computers," in Proc. IEEE International Symposium on Wearable Computers (ISWC'03), 2003.
16. R. Plamondon and S. Srihari, "Online and off-line handwriting recognition: a comprehensive survey," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 1, pp. 63-84, 2000.
17. R. McGuire, J. Hernandez-Rebollar, T. Starner, V. Henderson, H. Brashear, and D. Ross, "Towards a one-way american sign language translator," in Proc. Sixth IEEE International Conference on Automatic Face and Gesture Recognition (FGR'04), 2004.
18. C. Amma, D. Gehrig, and T. Schultz, "Airwriting recognition using wearable motion sensors," in Proceedings of the 1st Augmented Human International Conference (AH'10), 2010.
19. C. Amma and T. Schultz, "Airwriting: Demonstrating Mobile Text Input by 3d-Space Handwriting," in Proc. of the ACM international conference on Intelligent User Interfaces (IUI'12), 2012.
20. O. J. Woodman, "An introduction to inertial navigation," University of Cambridge, Tech. Rep., 2007.
21. L. Rabiner, "A tutorial on hidden markov models and selected applications in speech recognition," Proceedings of the IEEE, vol. 77, no. 2, pp. 257-286, 1989.
22. X. Huang, A. Acero, and H. Hon, Spoken language processing. Prentice Hall, 2001.
23. H. Soltau, F. Metze, C. Fügen, and A. Waibel, "A one-pass decoder based on polymorphic linguistic context assignment," in IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU '01), 2001.
24. T. Schultz, "GlobalPhone: A multilingual speech and text database developed at Karlsruhe University," in Proc. of the International Conference on Spoken Language Processing, (ICSLP'02), 2002.