Towards Security and Privacy for Multi-user Augmented Reality: Foundations with End Users

Proceedings - IEEE Symposium on Security and Privacy

Volumn 2018-May, Issue , 2018, Pages 392-408

  Lebeck, Kiron ^a   Ruth, Kimberly ^a   Kohno, Tadayoshi ^a   Roesner, Franziska ^a  

^a University of Washington   (United States)

Author keywords

augmented reality; multi user interaction; privacy; security; user studies

Indexed keywords

ACCESS CONTROL; AUGMENTED REALITY; DATA PRIVACY; HUMAN COMPUTER INTERACTION;

IMMERSIVE AUGMENTED REALITIES; MULTI-USER INTERACTION; SAFETY CONCERNS; SECURITY; SECURITY AND PRIVACY; SEMI STRUCTURED INTERVIEWS; USER STUDY; VIRTUAL OBJECTS;

COMPUTER PRIVACY;

EID: 85051016146     PISSN: 10816011     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SP.2018.00051     Document Type: Conference Paper

References (52)

1. AR Studio. https://developers.facebook.com/products/camera-effects/ar-studio/, 2017.
2. ARKit. https://developer.apple.com/arkit/, 2017.
3. Tango. http://get.google.com/tango/, 2017.
4. World Lens, 2017. https://questvisual.com/.
5. E. Adams. Drive a car like you'd fly an F-35 with augmented reality. Wired, Feb 2017. https://www.wired.com/2017/02/drive-car-like-youdfly-f-35-augmented-reality/.
6. T. M. Andrews. Tweet that sent journalist Kurt Eichenwald into seizure considered 'deadly weapon' in indictment. Washington Post, Mar. 2017. https://www.washingtonpost.com/news/morning-mix/wp/2017/03/22/tweet-that-sent-journalist-kurt-eichenwaldinto-seizure-considered-deadly-weapon-in-indictment/.
7. K. Bark, C. Tran, K. Fujimura, and V. Ng-Thow-Hing. Personal navi: Benefits of an augmented reality navigational aid using a see-thru 3D volumetric hud. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI '14, New York, NY, USA, 2014. ACM.
8. A. Butz, C. Beshers, and S. Feiner. Of vampire mirrors and privacy lamps: Privacy management in multi-user augmented environments. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. ACM, 1998.
9. A. Butz, T. Hollerer, S. Feiner, B. MacIntyre, and C. Beshers. Enveloping users and computers in a collaborative 3D augmented reality. In Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality. IEEE, 1999.
10. K. Charmaz. Constructing Grounded Theory. Sage Publications Ltd, second edition, 2014.
11. J. Cohen. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 1960.
12. L. D'Antoni, A. Dunn, S. Jana, T. Kohno, B. Livshits, D. Molnar, A. Moshchuk, E. Ofek, F. Roesner, S. Saponas, M. Veanes, and H. J.Wang. Operating system support for augmented reality applications. Hot Topics in Operating Systems (HotOS), 2013.
13. J. A. de Guzman, K. Thilakarathna, and A. Seneviratne. Security and privacy approaches in mixed reality: A literature survey. arXiv preprint arXiv:1802.05797, 2018.
14. N. Dell, V. Vaidyanathan, I. Medhi, E. Cutrell, and W. Thies. Yours is better!: Participant response bias in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2012.
15. T. Denning, Z. Dehlawi, and T. Kohno. In situ with bystanders of augmented reality glasses: Perspectives on recording and privacy-mediating technologies. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, 2014.
16. L. S. Figueiredo, B. Livshits, D. Molnar, and M. Veanes. PrePose: Security and privacy for gesture-based programming. In IEEE Symposium on Security and Privacy. IEEE, 2016.
17. J. L. Fleiss, B. Levin, and M. C. Paik. Statistical Methods for Rates and Proportions. John Wiley & Sons, New York, 3 edition, 2003.
18. E. Gaebel, N. Zhang, W. Lou, and Y. T. Hou. Looks good to me: Authentication for augmented reality. In Proceedings of the 6th International Workshop on Trustworthy Embedded Devices. ACM, 2016.
19. B. G. Glasser and A. L. Strauss. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Publishing Company, Chicago, 1967.
20. G. Guest, A. Bunce, and L. Johnson. How many interviews are enough? An experiment with data saturation and variability. Field Methods, 18, 2006.
21. HoloLens hardware details, 2017. https://developer.microsoft.com/en-us/windows/mixedreality/hololens-hardware-details.
22. HoloLens, 2017. https://www.microsoft.com/microsofthololens/en-us.
23. S. Jana, D. Molnar, A. Moshchuk, A. M. Dunn, B. Livshits, H. J. Wang, and E. Ofek. Enabling finegrained permissions for augmented reality applications with recognizers. In USENIX Security, 2013.
24. H. Kaufmann and D. Schmalstieg. Mathematics and geometry education with collaborative augmented reality. Computers & Graphics, 27(3), 2003.
25. K. Lebeck, T. Kohno, and F. Roesner. How to safely augment reality: Challenges and directions. In Proceedings of the 17th International Workshop on Mobile Computing Systems and Applications. ACM, 2016.
26. K. Lebeck, K. Ruth, T. Kohno, and F. Roesner. Securing augmented reality output. In IEEE Symposium on Security and Privacy. IEEE, 2017.
27. L. Matney. Jeff Koons' augmented reality Snapchat artwork gets 'vandalized', Oct. 2017. https://techcrunch.com/2017/10/08/jeff-koonsaugmented-reality-snapchat-artwork-gets-vandalized/.
28. M. May. Augmented reality in the car industry, Aug. 2015. https://www.linkedin.com/pulse/augmentedreality-car-industry-melanie-may.
29. T. Merel. The reality of VR/AR growth, 2017. https://techcrunch.com/2017/01/11/the-reality-of-vrar-growth.
30. Meta, 2017. https://www.metavision.com/.
31. M. R. Morris, A. Cassanego, A. Paepcke, T. Winograd, A. M. Piper, and A. Huang. Mediating group dynamics through tabletop interface design. IEEE Computer Graphics and Applications, 26(5), 2006.
32. T. Moynihan. It's a good thing the F-35's $400k helmet is stupid cool. Wired, Jun 2016. https://www.wired.com/2016/06/course-f-35-comes-400000-augmented-reality-helmet/.
33. T. Olsson, P. Ihamäki, E. Lagerstam, L. Ventä-Olkkonen, and K. Väänänen-Vainio-Mattila. User expectations for mobile mixed reality services: an initial user study. In European Conference on Cognitive Ergonomics: Designing beyond the Product-Understanding Activity and User Experience in Ubiquitous Environments. VTT Technical Research Centre of Finland, 2009.
34. T. Olsson, E. Lagerstam, T. Kärkkäinen, and K. Väänänen-Vainio-Mattila. Expected user experience of mobile augmented reality services: a user study in the context of shopping centres. Personal and Ubiquitous Computing, 17(2), 2013.
35. T. Olsson and M. Salo. Narratives of satisfying and unsatisfying experiences of current mobile augmented reality applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2012.
36. N. Raval, A. Srivastava, A. Razeen, K. Lebeck, A. Machanavajjhala, and L. P. Cox. What you mark is what apps see. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 2016.
37. F. Roesner, T. Kohno, and D. Molnar. Security and privacy for augmented reality systems. Communications of the ACM, 57(4), 2014.
38. F. Roesner, D. Molnar, A. Moshchuk, T. Kohno, and H. J. Wang. World-driven access control for continuous sensing. In ACM Conference on Computer & Communications Security, 2014.
39. S. D. Scott, M. S. T. Carpendale, and K. M. Inkpen. Territoriality in collaborative tabletop workspaces. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work. ACM, 2004.
40. I. Sluganovic, M. Serbec, A. Derek, and I. Martinovic. HoloPair: Securing shared augmented reality using microsoft hololens. In Annual Computer Security Applications Conference (ACSAC) 2017, 2017.
41. S. Sridhar and V. Ng-Thow-Hing. Generation of virtual display surfaces for in-vehicle contextual augmented reality. In 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 2012.
42. J. Swearingen. How the camera doomed Google Glass, Jan. 2015. https://www.theatlantic.com/technology/archive/2015/01/how-the-camera-doomed-googleglass/384570/.
43. Z. Szalavári, D. Schmalstieg, A. Fuhrmann, and M. Gervautz. studierstube: An environment for collaboration in augmented reality. Virtual Reality, 3(1), 1998.
44. D. Takahashi. Pokémon go is the fastest mobile game to hit $600 million in revenues, 2016. http://venturebeat.com/2016/10/20/pokemon-go-isthe-fastest-mobile-game-to-hit-600-million-in-revenues/.
45. R. Templeman, M. Korayem, D. Crandall, and A. Kapadia. PlaceAvoider: Steering first-person cameras away from sensitive spaces. In Network and Distributed System Security Symposium (NDSS), 2014.
46. R. Tilton. Daydream Labs: positive social experiences in VR. Google, Aug. 2016. https://www.blog.google/products/google-vr/daydream-labs-positive-social/.
47. C. Tran, K. Bark, and V. Ng-Thow-Hing. A left-turn driving aid using projected oncoming vehicle paths with augmented reality. In 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2013.
48. J. Vilk, A. Moshchuk, D. Molnar, B. Livshits, E. Ofek, C. Rossbach, H. J. Wang, and R. Gal. SurroundWeb: Mitigating privacy concerns in a 3D web browser. In IEEE Symposium on Security and Privacy, 2015.
49. D. Wagner, T. Pintaric, F. Ledermann, and D. Schmalstieg. Towards massively multi-user augmented reality on handheld devices. In Pervasive, volume 2005. Springer, 2005.
50. Wikitude, 2017. https://www.wikitude.com/showcase/tripadvisor-be-in-the-know/.
51. N. Yee, J. N. Bailenson, M. Urbanek, F. Chang, and D. Merget. The unbearable likeness of being digital: The persistence of nonverbal social norms in online virtual environments. CyberPsychology & Behavior, 10(1), 2007.
52. K. Yeung. Microsoft partners with Autodesk to bring 3D product design to HoloLens, 2015. https://venturebeat.com/2015/11/30/microsoft-partnerswith-autodesk-to-bring-3d-product-design-to-hololens/.