Ubiquitous keyboard for small mobile devices: Harnessing multipath fading for fine-grained keystroke localization

MobiSys 2014 - Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services

Volumn , Issue , 2014, Pages 14-27

  Wang, Junjue ^a   Zhao, Kaichen ^a   Zhang, Xinyu ^a   Peng, Chunyi ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

acoustic localization; mobile text entry; paper keyboard; ubik

Indexed keywords

MICROPHONES;

ACOUSTIC LOCALIZATION; ANDROID APPLICATIONS; LOCALIZATION ACCURACY; LOCATION DEPENDENTS; MOBILE TEXT-ENTRY; ON-SCREEN KEYBOARD; TOUCH-SCREEN KEYBOARDS; UBIK;

MOBILE DEVICES;

EID: 84903220244     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2594368.2594384     Document Type: Conference Paper

References (35)

1. M. Kölsch and M. Turk, "Keyboards without Keyboards: A Survey of Virtual Keyboards," in Proceedings of Sensing and Input for Media-centric Systems, 2002.
2. K. Al Faraj, M. Mojahid, and N. Vigouroux, "BigKey: A Virtual Keyboard for Mobile Devices," in Proceedings of International Conference on Human-Computer Interaction, 2009.
3. M. Goel, A. Jansen, T. Mandel, S. N. Patel, and J. O. Wobbrock, "ContextType: Using Hand Posture Information to Improve Mobile Touch Screen Text Entry," in Proc. of ACM CHI, 2013.
4. O. Schoenleben and A. Oulasvirta, "Sandwich keyboard: Fast ten-finger typing on a mobile device with adaptive touch sensing on the back side," in Proc. of ACM MobileHCI, 2013.
5. S. Oney, C. Harrison, A. Ogan, and J. Wiese, "ZoomBoard: A Diminutive Qwerty Soft Keyboard Using Iterative Zooming for Ultra-small Devices," in Proc. of ACM CHI, 2013.
6. H. Du, T. Oggier, F. Lustenberger, and E. Charbon, "A Virtual Keyboard Based on True-3D Optical Ranging," in Proceedings of the British Machine Vision Conference, 2005.
7. H. Roeber, J. Bacus, and C. Tomasi, "Typing in Thin Air: The Canesta Projection Keyboard - a New Method of Interaction with Electronic Devices," in ACM CHI Extended Abstracts, 2003.
8. C. Harrison, H. Benko, and A. D. Wilson, "OmniTouch: Wearable Multitouch Interaction Everywhere," in Proc. of ACM UIST, 2011.
9. Y. Chen, D. Lymberopoulos, J. Liu, and B. Priyantha, "FM-based Indoor Localization," in Proc. of ACM MobiSys, 2012.
10. T. Gustafsson, B. Rao, and M. Trivedi, "Source Localization in Reverberant Environments: Modeling and Statistical Analysis," IEEE Transactions on Speech and Audio Processing, vol. 11, no. 6, 2003.
11. C. Peng, G. Shen, Y. Zhang, Y. Li, and K. Tan, "BeepBeep: a High Accuracy Acoustic Ranging System Using COTS Mobile Devices," in Proc. of ACM SenSys, 2007.
12. K. Ho and M. Sun, "Passive Source Localization Using Time Differences of Arrival and Gain Ratios of Arrival," IEEE Transactions on Signal Processing, vol. 56, no. 2, 2008.
13. S. Sen, J. Lee, K.-H. Kim, and P. Congdon, "Avoiding Multipath to Revive Inbuilding WiFi Localization," in Proc. of ACM MobiSys, 2013.
14. J. Wang and D. Katabi, "Dude, Where's My Card?: RFID Positioning That Works with Multipath and Non-Line of Sight," in Proc. of ACM SIGCOMM, 2013.
15. D. Tse and P. Viswanath, Fundamentals of Wireless Communication. Cambridge University Press, 2005.
16. M. Vorlander, Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality. Springer, 2008.
17. S. Sen, B. Radunovic, R. R. Choudhury, and T. Minka, "You Are Facing the Mona Lisa: Spot Localization Using PHY Layer Information," in Proc. of ACM MobiSys, 2012.
18. W. Cui, Z. Cao, and J. Wei, "Dual-Microphone Source Location Method in 2-D Space," in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2006.
19. J. H. DiBiase, "A High-Accuracy, Low-Latency Technique for Talker Localization in Reverberant Environment," Ph.D. dissertation, Brown University, 2000.
20. R. Blum, S. Kassam, and H. Poor, "Distributed Detection With Multiple Sensors I. Advanced topics," Proceedings of the IEEE, vol. 85, no. 1, 1997.
21. P. Marquardt, A. Verma, H. Carter, and P. Traynor, "(Sp)iPhone: Decoding Vibrations from Nearby Keyboards Using Mobile Phone Accelerometers," in Proc. of ACM CCS, 2011.
22. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. Springer, 2013.
23. Smart Tool Co., "Sound Meter Pro." [Online]. Available: https://play.google.com/store/apps/details?id=kr.aboy.sound
24. Monsoon Solutions, Inc., "Monsoon Power Monitor," http://www.msoon.com/LabEquipment/PowerMonitor/.
25. I. S. MacKenzie and R. W. Soukoreff, "Phrase Sets for Evaluating Text Entry Techniques," in ACM CHI Extended Abstracts, 2003.
26. Swype Inc., "The Swype Virtual Keyboard," 2013. [Online]. Available: http://www.swype.com/
27. S. Kim, J. Son, G. Lee, H. Kim, and W. Lee, "TapBoard: Making a Touch Screen Keyboard More Touchable," in Proc. of ACM CHI, 2013.
28. Z. Zhang, D. Chu, X. Chen, and T. Moscibroda, "SwordFight: Enabling a New Class of Phone-to-phone Action Games on Commodity Phones," in Proc. of ACM MobiSys, 2012.
29. D. Asonov and R. Agrawal, "Keyboard Acoustic Emanations," in IEEE Symposium on Security and Privacy, 2004.
30. L. Zhuang, F. Zhou, and J. D. Tygar, "Keyboard Acoustic Emanations Revisited," ACM Transactions on Information System Security, vol. 13, no. 1, 2009.
31. J. Mantyjarvi, J. Koivumaki, and P. Vuori, "Keystroke Recognition for Virtual Keyboard," in Proc. of IEEE International Conference on Multimedia and Expo (ICME), 2002.
32. C. Harrison, J. Schwarz, and S. E. Hudson, "TapSense: Enhancing Finger Interaction on Touch Surfaces," in Proc. of ACM UIST, 2011.
33. M. Ono, B. Shizuki, and J. Tanaka, "Touch & Activate: Adding Interactivity to Existing Objects Using Active Acoustic Sensing," in Proc. of ACM UIST, 2013.
34. J. A. Paradiso, C. K. Leo, N. Checka, and K. Hsiao, "Passive Acoustic Knock Tracking for Interactive Windows," in ACM CHI Extended Abstracts, 2002.
35. D. T. Pham, Z. Ji, M. Yang, Z. Wang, and M. Al-Kutubi, "A Novel Human-computer Interface Based on Passive Acoustic Localisation," in Proc. of International Conference on Human-computer Interaction, 2007.