Learning Human Identity from Motion Patterns

IEEE Access

Volumn 4, Issue , 2016, Pages 1810-1820

  Neverova, Natalia ^a   Wolf, Christian ^a   Lacey, Griffin ^b   Fridman, Lex ^c   Chandra, Deepak ^d   Barbello, Brandon ^d   Taylor, Graham ^b  

^a CNRS   (France)

^b UNIVERSITY OF GUELPH   (Canada)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d GOOGLE INC   (United States)

Author keywords

Authentication; Biometrics (access control); Learning; Mobile computing; Recurrent neural networks

Indexed keywords

AUTHENTICATION; BIOMETRICS; DEEP NEURAL NETWORKS; KINEMATICS; MOBILE COMPUTING; MODAL ANALYSIS;

AUTHENTICATION SYSTEMS; BIOMETRIC AUTHENTICATION; EFFICIENT LEARNING; LARGE-SCALE STUDIES; LEARNING; NEURAL ARCHITECTURES; TEMPORAL CHARACTERISTICS; VALUABLE COMPONENT;

RECURRENT NEURAL NETWORKS;

EID: 84979800464     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2016.2557846     Document Type: Article

References (34)

1. A. Anjos, L. El Shafey, R. Wallace, M. Günther, C. McCool, S. Marcel, "Bob: A free signal processing and machine learning toolbox for researchers," in Proc. 20th ACM MM, 2012, pp. 1449-1452.
2. R. Auckenthaler, M. Carey, H. Lloyd-Thomas, "Score normalization for text-independent speaker veri-cation systems," Digit. Signal Process., vol. 10, no. 1, pp. 42-54, 2000.
3. J. Bergstra et al., "Theano: A CPU and GPU math compiler in Python," in Proc. Python Sci. Comput. Conf. (SciPy), 2010, pp. 1-7.
4. S. Berlemont, G. Lefebvre, S. Duffner, C. Garcia, "Siamese neural network based similarity metric for inertial gesture classi-cation and rejection," in Proc. FG, 2015, pp. 1-6.
5. S. Bhattacharya, P. Nurmi, N. Hammerla, T. Plotz, "Using unlabeled data in a sparse-coding framework for human activity recognition," Pervasive Mobile Comput., vol. 15, pp. 242-262, Dec. 2014.
6. C. Bo, L. Zhang, X.-Y. Li, Q. Huang, Y. Wang, "SilentSense: Silent user identi-cation via touch and movement behavioral biometrics," in Proc. MobiCom, 2013, pp. 187-190.
7. A. Bulling, U. Blanke, B. Schiele, "A tutorial on human activity recognition using body-worn inertial sensors," ACM Comput. Surv., vol. 46, no. 3, 2014, Art. no. 33.
8. A. Das, N. Borisov, M. Caesar. (2015). "Exploring ways to mitigate sensor-based smartphone-ngerprinting." [Online]. Available: http://arxiv.org/abs/1503.01874
9. M. O. Derawi, C. Nickel, P. Bours, C. Busch, "Unobtrusive user-authentication on mobile phones using biometric gait recognition," in Proc. IIH-MSP, 2010, pp. 306-311.
10. J. Donahue et al. (2015). "Long-term recurrent convolutional networks for visual recognition and description." [Online]. Available: http://arxiv.org/abs/1411.4389
11. S. Duffner, S. Berlemont, G. Lefebre, C. Garcia, "3D gesture classi-cation with convolutional neural networks," in Proc. ICASSP, 2014, pp. 5432-5436.
12. D. Figo, P. C. Diniz, D. R. Ferreira, J. M. P. Cardoso, "Preprocessing techniques for context recognition from accelerometer data," Pers. Ubiquitous Comput., vol. 14, no. 7, pp. 645-662, 2010.
13. A. Hannun et al. (2014). "Deep speech: Scaling up end-to-end speech recognition." [Online]. Available: http://arxiv.org/abs/1412.5567
14. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Comput., vol. 9, no. 8, pp. 1735-1780, 1997.
15. S. E. Kahou et al., "Combining modality speci-c deep neural networks for emotion recognition in video," in Proc. ICMI, 2013, pp. 543-550.
16. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, L. Fei-Fei, "Large-scale video classi-cation with convolutional neural networks," in Proc. CVPR, 2014, pp. 1725-1732.
17. E. Khoury, L. El Shafey, C. McCool, M. Gunther, S. Marcel, "Bi-modal biometric authentication on mobile phones in challenging conditions," Image Vis. Comput., vol. 32, no. 12, pp. 1147-1160, 2014.
18. J. Koutnik, K. Greff, F. Gomez, J. Schmidhuber, "A clockwork RNN," in Proc. 31st ICML, 2014, pp. 1863-1871.
19. G. Lefebvre, S. Berlemont, F. Mamalet, C. Garcia, "BLSTM-RNN based 3D gesture classi-cation," in Proc. 22nd ICANN, 2013, pp. 381-388.
20. J. R. Napier, "The prehensile movements of the human hand," J. Bone Joint Surgery, vol. 38-B, no. 4, pp. 902-913, 1956.
21. N. Neverova, C. Wolf, G. W. Taylor, F. Nebout, "ModDrop: Adaptive multi-modal gesture recognition," IEEE Trans. Pattern Anal. Mach. Intell., to be published. [Online]. Available: http://ieeexplore.ieee.org/xpl/articleDetails.jspreload=true&arnumber=7169562
22. J. Ngiam, A. Khosla, M. Kin, J. Nam, H. Lee, A. Y. Ng, "Multimodal deep learning," in Proc. 28th ICML, 2011, pp. 1-8.
23. C. Nickel, H. Brandt, C. Busch, "Benchmarking the performance of svms and hmms for accelerometer-based biometric gait recognition," in Proc. ISSPIT, 2011, pp. 281-286.
24. People With Phones at the Station-Walking and Talking, accessed on Nov. 15, 2015. [Online]. Available: https://www.-ickr.com/photos/infomastern/16275617512/in/photolist-qNdN43-qvR6ht-qvSsqr-quRXrCqS9eNN-vRtLdL-rrK5jM-qv5KHv-quS3Ko-rrP3iA-krP8vt-rrTJwr-Ew8J2C-C77CYL-uxdvJ1
25. T. Plötz, N. Y. Hammerla, P. Olivier, "Feature learning for activity recognition in ubiquitous computing," in Proc. 22nd Int. Joint Conf. Artif. Intell., 2011, pp. 1729-1734.
26. D. A. Reynolds, T. F. Quatieri, R. B. Dunn, "Speaker veri-cation using adapted Gaussian mixture models," Digit. Signal Process., vol. 10, nos. 1-3, pp. 19-41, 2000.
27. T. N. Sainath, O. Vinyals, A. Senior, H. Sak, "Convolutional, long short-term memory, fully connected deep neural networks," in Proc. ICASSP, 2015, pp. 4580-4584.
28. S. Escalera et al., "ChaLearn looking at people challenge 2014: Dataset and results," in Proc. ECCVW, 2014, pp. 459-473.
29. Z. Sitova et al. (2015). "HMOG: New behavioral biometric features for continuous authentication of smartphone users." [Online]. Available: http://arxiv.org/abs/1501.01199
30. N. Srivastava and R. Salakhutdinov, "Multimodal learning with deep Boltzmann machines," in Proc. NIPS, 2013, pp. 2222-2230.
31. G. W. Taylor, G. E. Hinton, S. T. Roweis, "Two distributed-state models for generating high-dimensional time series," J. Mach. Learn. Res., vol. 12, pp. 1025-1068, Mar. 2011.
32. E. Vildjiounaite et al., "Unobtrusive multimodal biometrics for ensuring privacy and information security with personal devices," in Proc. Pervasive Comput., 2006, pp. 187-201.
33. Q. Yang et al., "A multimodal data set for evaluating continuous authentication performance in smartphones," in Proc. 12th ACM SenSys, 2014, pp. 358-359.
34. M. Zeng et al., "Convolutional neural networks for human activity recognition using mobile sensors," in Proc. 6th Int. Conf. MobiCASE, 2014, pp. 197-205.