Hidden voice commands

Proceedings of the 25th USENIX Security Symposium

Volumn , Issue , 2016, Pages 513-530

  Carlini, Nicholas ^a   Mishra, Pratyush ^a   Vaidya, Tavish ^b   Zhang, Yuankai ^b   Sherr, Micah ^b   Shields, Clay ^b   Wagner, David ^a   Zhou, Wenchao ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b GEORGETOWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BLACK-BOX MODEL; CHALLENGE RESPONSE PROTOCOLS; EXISTING SYSTEMS; HUMAN LISTENERS; MACHINE LEARNING APPROACHES; SPEECH RECOGNITION SYSTEMS; VOICE INTERFACES; WHITE-BOX MODELS;

SPEECH RECOGNITION;

EID: 85024499569     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (44)

1. I. Androutsopoulos, J. Koutsias, K. V. Chandrinos, and C. D. Spyropoulos. An Experimental Comparison of Naive Bayesian and Keyword-based Anti-spam Filtering with Personal e-Mail Messages. In ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2000.
2. Apple. Use Siri on your iPhone, iPad, or iPod touch. Support article. Available at https://support.apple.com/en-us/HT204389.
3. M. P. Aylett and J. Yamagishi. Combining Statistical Parameteric Speech Synthesis and Unit-Selection for Automatic Voice Cloning. In LangTech, 2008.
4. M. Barreno, B. Nelson, A. D. Joseph, and J. Tygar. The security of machine learning. Machine Learning, 81(2):121–148, 2010.
5. B. Biggio, I. Corona, D. Maiorca, B. Nelson, N. Šrndić, P. Laskov, G. Giacinto, and F. Roli. Evasion Attacks against Machine Learning at Test Time. In Machine Learning and Knowledge Discovery in Databases, 2013.
6. E. Bursztein and S. Bethard. Decaptcha: Breaking 75% of eBay Audio CAPTCHAs. In USENIX Workshop on Offensive Technologies (WOOT), 2009.
7. J. Campbell, J.P. Speaker Recognition: A Tutorial. Proceedings of the IEEE, 85(9):1437–1462, 1997.
8. CereVoice Me Voice Cloning Service. https://www.cereproc.com/en/products/cerevoiceme.
9. Crowd Sounds — Free Sounds at SoundBible. http://soundbible.com/tagscrowd.html.
10. N. Dalvi, P. Domingos, Mausam, S. Sanghai, and D. Verma. Adversarial Classification. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2004.
11. M. Darnstadt, H. Meutzner, and D. Kolossa. Reducing the Cost of Breaking Audio CAPTCHAs by Active and Semi-supervised Learning. In International Conference on Machine Learning and Applications (ICMLA), 2014.
12. W. Diao, X. Liu, Z. Zhou, and K. Zhang. Your Voice Assistant is Mine: How to Abuse Speakers to Steal Information and Control Your Phone. In ACM Workshop on Security and Privacy in Smartphones & Mobile Devices (SPSM), 2014.
13. H. Drucker, S. Wu, and V. Vapnik. Support vector machines for spam categorization. IEEE Transactions on Neural Networks, 10(5), Sep 1999.
14. A. Fawzi, O. Fawzi, and P. Frossard. Analysis of classifiers’ robustness to adversarial perturbations. arXiv preprint arXiv:1502.02590, 2015.
15. M. Fredrikson, S. Jha, and T. Ristenpart. Model inversion attacks that exploit confidence information and basic countermeasures. In Proceedings of the 22nd ACM Conference on Computer and Communications Security, 2015.
16. T. Giannakopoulos. Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications. https://github.com/tyiannak/pyAudioAnalysis.
17. I. J. Goodfellow, J. Shlens, and C. Szegedy. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572, 2014.
18. Google. Turn on “Ok Google” on your Android. Support article. Available at https://support.google.com/websearch/answer/6031948.
19. Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images, 2015. IEEE.
20. C. Ittichaichareon, S. Suksri, and T. Yingthawornsuk. Speech recognition using MFCC. In International Conference on Computer Graphics, Simulation and Modeling (ICGSM), 2012.
21. Y. Jang, C. Song, S. P. Chung, T. Wang, and W. Lee. A11y Attacks: Exploiting Accessibility in Operating Systems. In ACM Conference on Computer and Communications Security (CCS), November 2014.
22. A. Kantchelian, S. Afroz, L. Huang, A. C. Islam, B. Miller, M. C. Tschantz, R. Greenstadt, A. D. Joseph, and J. D. Tygar. Approaches to Adversarial Drift. In ACM Workshop on Artificial Intelligence and Security, 2013.
23. C. Kasmi and J. Lopes Esteves. Iemi threats for information security: Remote command injection on modern smartphones. IEEE Transactions on Electromagnetic Compatibility, PP(99):1–4, 2015.
24. P. Lamere, P. Kwok, W. Walker, E. Gouvea, R. Singh, B. Raj, and P. Wolf. Design of the CMU Sphinx-4 Decoder. In Eighth European Conference on Speech Communication and Technology, 2003.
25. A. Mahendran and A. Vedaldi. Understanding deep image representations by inverting them. In Conference on Computer Vision and Pattern Recognition (CVPR) 2015, 2015.
26. M. May. Inaccessibility of CAPTCHA: Alternatives to Visual Turing Tests on the Web. Technical report, W3C Working Group Note, 2005. Available at http://www.w3.org/TR/turingtest/.
27. H. Meutzner, S. Gupta, and D. Kolossa. Constructing Secure Audio CAPTCHAs by Exploiting Differences Between Humans and Machines. In Annual ACM Conference on Human Factors in Computing Systems (CHI), 2015.
28. D. E. Meyer and R. W. Schvaneveldt. Facilitation in Recognizing Pairs of Words: Evidence of a Dependence between Retrieval Operations. Journal of Experimental Psychology, 90(2):227, 1971.
29. J. Morgan, S. LaRocca, S. Bellinger, and C. C. Ruscelli. West Point Company G3 American English Speech. Linguistic Data Consortium, item LDC2005S30. University of Pennsylvania. Available at https://catalog.ldc.upenn.edu/LDC2005S30, 2005.
30. NLP Captcha. http://nlpcaptcha.in/.
31. N. Papernot, P. McDaniel, S. Jha, M. Fredrikson, Z. B. Celik, and A. Swami. The limitations of deep learning in adversarial settings. arXiv preprint arXiv:1511.07528, 2015.
32. N. Papernot, P. McDaniel, and I. Goodfellow. Transferability in machine learning: from phenomena to black-box attacks using adversarial samples. arXiv preprint arXiv:1605.07277, 2016.
33. reCAPTCHA. http://google.com/recaptcha.
34. H. Sak, A. Senior, K. Rao, F. Beaufays, and J. Schalkwyk. Google Voice Search: Faster and More Accurate, 2015. Google Research Blog post. Available at http://googleresearch.blogspot.com/2015/09/googlevoice-search-faster-and-more.html.
35. S. Schechter, R. Dhamija, A. Ozment, and I. Fischer. The Emperor’s New Security Indicators: An Evaluation of Website Authentication and the Effect of Role Playing on Usability Studies. In IEEE Symposium on Security and Privacy (Oakland), 2007.
36. R. Schlegel, K. Zhang, X.-Y. Zhou, M. Intwala, A. Kapadia, and X. Wang. Soundcomber: A Stealthy and Context-Aware Sound Trojan for Smartphones. In Network and Distributed System Security Symposium (NDSS), 2011.
37. J. Sunshine, S. Egelman, H. Almuhimedi, N. Atri, and L. F. Cranor. Crying Wolf: An Empirical Study of SSL Warning Effectiveness. In USENIX Security Symposium (USENIX), 2009.
38. C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus. Intriguing Properties of Neural Networks. arXiv preprint arXiv:1312.6199, 2013.
39. J. Tam, J. Simsa, S. Hyde, and L. V. Ahn. Breaking Audio CAPTCHAs. In Advances in Neural Information Processing Systems (NIPS), 2008.
40. J. Tygar. Adversarial Machine Learning. IEEE Internet Computing, 15(5): 4–6, 2011.
41. T. Vaidya, Y. Zhang, M. Sherr, and C. Shields. Cocaine Noodles: Exploiting the Gap between Human and Machine Speech Recognition. In USENIX Workshop on Offensive Technologies (WOOT), August 2015.
42. O. Viikki and K. Laurila. Cepstral Domain Segmental Feature Vector Normalization for Noise Robust Speech Recognition. Speech Communication, 25(13):133–147, 1998.
43. S. H. Weinberger. Speech Accent Archive. George Mason University, 2015. Available at http://accent.gmu.edu.
44. M. Wu, R. C. Miller, and S. L. Garfinkel. Do Security Toolbars Actually Prevent Phishing Attacks? In SIGCHI Conference on Human Factors in Computing Systems (CHI), 2006.