Gyrophone: Recognizing speech from gyroscope signals

Proceedings of the 23rd USENIX Security Symposium

Volumn , Issue , 2014, Pages 1053-1067

  Michalevsky, Yan ^a   Boneh, Dan ^a   Nakibly, Gabi ^b  

^a Stanford University   (United States)

^b Rafael Ltd

Author keywords

[No Author keywords available]

Indexed keywords

GYROSCOPES; SIGNAL PROCESSING; SMARTPHONES;

ACOUSTIC SIGNALS; ACTIVE WEB-CONTENT; MEMS GYROSCOPE; VERY LOW FREQUENCY;

SPEECH RECOGNITION;

EID: 85073879855     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (48)

1. 3-axis digital gyroscopes. http://www.st.com/st-web-ui/static/active/en/resource/sales_and_marketing/promotional_material/flyer/fl3axdigitalgyro.pdf.
2. Corona SDK API reference. http://docs.coronalabs.com/api/library/system/setGyroscopeInterval.html.
3. Galaxy Tab 7.7. http://www.techrepublic.com/blog/cracking-open/galaxy-tab-77-teardown-reveals-lots-of-samsungs-homegrown-hardware/588/.
4. Inside the Latest Galaxy Note 3. http://www.chipworks.com/en/technical-competitive-analysis/resources/blog/inside-the-galaxy-note-3/.
5. Inside the Samsung Galaxy S4. http://www.chipworks.com/en/technical-competitive-analysis/resources/blog/inside-the-samsung-galaxy-s4/.
6. Inside the Samsung Galaxy SIII. http://www.chipworks.com/en/technical-competitive-analysis/resources/blog/inside-the-samsung-galaxy-siii/.
7. InvenSense Inc. http://www.invensense.com/.
8. iPad Mini Retina Display Teardown. http://www.ifixit.com/Teardown/iPad+Mini+Retina+Display+Teardown/19374.
9. L3G4200D data sheet. http://www.st.com/st-web-ui/static/active/en/resource/technical/document/datasheet/CD00265057.pdf.
10. LSM330DLC data sheet. http://www.st.com/st-web-ui/static/active/en/resource/technical/document/datasheet/DM00037200.pdf.
11. MPU-6000 and MPU-6050 Register Map and Descriptions. http://invensense.com/mems/gyro/documents/RM-MPU-6000A.pdf.
12. MPU-6050 product specification. http://www.invensense.com/mems/gyro/documents/PS-MPU-6000A-00v3.4.pdf.
13. Nexus 4 Teardown. http://www.ifixit.com/Teardown/Nexus+4+Teardown/11781.
14. Nexus 7 Teardown. http://www.ifixit.com/Teardown/Nexus+7+Teardown/9623.
15. STMicroelectronics Inc. http://www.st.com/.
16. Everything about STMicroelectronics 3-axis digital MEMS gyroscopes. http://www.st.com/web/en/resource/technical/document/technical_article/DM00034730.pdf, July 2011.
17. iPhone 5S MEMS Gyroscope STMicroelectron-ics 3x3mm - Reverse Costing Analysis. http://www.researchandmarkets.com/research/lxrnrn/iphone_5s_mems, October 2013.
18. MEMS for Cell Phones and Tablets. http://www.i-micronews.com/upload/Rapports/Yole_MEMS_for_Mobile_June_2013_Report_Sample.pdf, July 2013.
19. AL-HAIQI, A., ISMAIL, M., and NORDIN, R. On the best sensor for keystrokes inference attack on android. Procedia Technology 11 (2013), 989-995.
20. APPELMAN, D. The Science of Vocal Pedagogy: Theory and Application. Midland book. Indiana University Press, 1967.
21. CAI, L., and CHEN, H. Touchlogger: inferring keystrokes on touch screen from smartphone motion. In Proceedings of the 6th USENIX conference on Hot topics in security (2011), USENIX Association, pp. 9-9.
22. CASTRO, S., DEAN, R., ROTH, G., FLOWERS, G. T., and GRANTHAM, B. Influence of acoustic noise on the dynamic performance of mems gyroscopes. In ASME 2007 International Mechanical Engineering Congress and Exposition (2007), pp. 1825-1831.
23. CRAMMER, K., KEARNS, M., and WORTMAN, J. Learning from multiple sources. The Journal of Machine Learning Research 9 (2008), 1757-1774.
24. DEAN, R. N., and CASTRO., S. T., FLOWERS, G. T., ROTH, G., AHMED, A., and HODEL., A. S., GRANTHAM, B. E., BITTLE, D. A., and BRUNSCH, J. P. A characterization of the performance of a mems gyroscope in acoustically harsh environments. Industrial Electronics, IEEE Transactions on 58, 7 (2011), 2591-2596.
25. DEAN, R. N., and FLOWERS., G. T., HODEL, A. S., ROTH, G., CASTRO, S., ZHOU, R., MOREIRA, A., AHMED, A., RIFKI, R., GRANTHAM, B. E., ET AL. On the degradation of mems gyroscope performance in the presence of high power acoustic noise. In Industrial Electronics, 2007. ISIE 2007. IEEE International Symposium on (2007), IEEE, pp. 1435-1440.
26. EL-CHAMMAS, M., and MURMANN, B. Background calibration of time-interleaved data converters. Springer, 2012.
27. EL-CHAMMAS, M. I. Background Calibration of Timing Skew in Time-Interleaved A/D Converters. Stanford University, 2010.
28. ELDAR, Y. C., and OPPENHEIM, A. V. Filterbank reconstruction of bandlimited signals from nonuniform and generalized samples. Signal Processing, IEEE Transactions on 48, 10 (2000), 2864-2875.
29. GIANNAKOPOULOS, T. A method for silence removal and segmentation of speech signals, implemented in matlab.
30. HASAN, M. R., JAMIL, M., and RAHMAN, M. G. R. M. S. Speaker identification using mel frequency cepstral coefficients. variations 1 (2004), 4.
31. JOHANSSON, H. K., AND LÖWENBORG, P. Reconstruction of periodically nonuniformly sampled bandlimited signals using time-varying FIR filters. 2005.
32. LARTILLOT, O., TOIVIAINEN, P., and EEROLA, T. A matlab toolbox for music information retrieval. In Data analysis, machine learning and applications. Springer, 2008, pp. 261-268.
33. LEONARD, R. G., and DODDINGTON, G. TIDIGITS. http://catalog.ldc.upenn.edu/LDC93S10, 1993.
34. MANTYJARVI, J., LINDHOLM, M., VILDJIOUNAITE, E., MAKELA, S.-M., and AILISTO, H. Identifying users of portable devices from gait pattern with accelerometers. In Acoustics, Speech, and Signal Processing, 2005. Proceedings.(ICASSP'05). IEEE International Conference on (2005), Vol. 2, IEEE, pp. ii-973.
35. MARQUARDT, P., VERMA, A., CARTER, H., and TRAYNOR, P. (sp) iphone: decoding vibrations from nearby keyboards using mobile phone accelerometers. In Proceedings of the 18th ACM conference on Computer and communications security (2011), ACM, pp. 551-562.
36. MIET, G. Towards wideband speech by narrowband speech bandwidth extension: magic effect or wideband recovery? These de doctorat, University of Maine (2001).
37. MÜLLER, M. Dynamic time warping. Information retrieval for music and motion (2007), 69-84.
38. PAPOULIS, A. Generalized sampling expansion. Circuits and Systems, IEEE Transactions on 24, 11 (1977), 652-654.
39. PRENDERGAST, R. S., and LEVY., B. C., and HURST, P. J. Reconstruction of band-limited periodic nonuniformly sampled signals through multirate filter banks. Circuits and Systems I: Regular Papers, IEEE Transactions on 51, 8 (2004), 1612-1622.
40. RABINER, L. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE (1989).
41. REYNOLDS, D. A., and ROSE, R. C. Robust text-independent speaker identification using gaussian mixture speaker models. Speech and Audio Processing, IEEE Transactions on 3, 1 (1995), 72-83.
42. ROSSI, M., FEESE, S., AMFT, O., BRAUNE, N., MARTIS, S., and TROSTER, G. Ambientsense: A real-time ambient sound recognition system for smartphones. In Pervasive Computing and Communications Workshops (PERCOM Workshops), 2013 IEEE International Conference on (2013), IEEE, pp. 230-235.
43. SEEGER, J., LIM, M., and NASIRI, S. Development of high-performance high-volume consumer MEMS gyroscopes. http://www.invensense.com/mems/gyro/documents/whitepapers/Development-of-High-Performance-High-Volume-Consumer-MEMS-Gyroscopes.pdf.
44. SHANNON, C. E. Communication in the presence of noise. Proceedings of the IRE 37, 1 (1949), 10-21.
45. SINDHI, S., and PRABHU, K. Reconstruction of N-th Order Nonuniformly Sampled Signals Using Digital Filter Banks. commsp.ee.ic.ac.uk (2012).
46. STROHMER, T., and TANNER, J. Fast reconstruction algorithms for periodic nonuniform sampling with applications to time-interleaved adcs. In Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on (2007), Vol. 3, IEEE, pp. III-881.
47. WALKER, W., LAMERE, P., KWOK, P., RAJ, B., SINGH, R., GOUVEA, E., WOLF, P., and WOELFEL, J. Sphinx-4: A flexible open source framework for speech recognition. Tech. rep., 2004.
48. YEE, L., and AHMAD, A. Comparative Study of Speaker Recognition Methods: DTW, GMM and SVM. comp.utm.my.