Multi-sensor system for driver's hand-gesture recognition

2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

Volumn , Issue , 2015, Pages

  Molchanov, Pavlo ^a   Gupta, Shalini ^a   Kim, Kihwan ^a   Pulli, Kari ^a  

^a NVIDIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CAMERAS; FACE RECOGNITION; PALMPRINT RECOGNITION; RADAR;

DEEP NEURAL NETWORKS; HAND-GESTURE RECOGNITION; MULTI-SENSOR SYSTEMS; MULTIPLE SENSORS; POWER EFFICIENT; SHORT RANGE RADAR; VARIABLE LIGHTINGS; VISION BASED SYSTEM;

GESTURE RECOGNITION;

EID: 84944930863     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FG.2015.7163132     Document Type: Conference Paper

References (32)

1. NHTSA, "Traffic safety facts," National Highway Traffic Safety Administration, Tech. Rep., 2009.
2. F. Parada-Loira, E. Gonzalez-Agulla, and J. Alba-Castro, "Hand gestures to control infotainment equipment in cars," in IEEE Intelligent Vehicles Symposium, 2014, pp. 1-6.
3. A. Riener, A. Ferscha, F. Bachmair, P. Hagmüller, A. Lemme, D. Muttenthaler, D. Pühringer, H. Rogner, A. Tappe, and F. Weger, "Standardization of the in-car gesture interaction space," in International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 2013, pp. 14-21.
4. S. Mitra and T. Acharya, "Gesture recognition: A survey," IEEE Systems, Man, and Cybernetics, vol. 37, no. 3, pp. 311-324, 2007.
5. V. I. Pavlovic, R. Sharma, and T. S. Huang, "Visual interpretation of hand gestures for human-computer interaction: A review," PAMI, vol. 19, pp. 677-695, 1997.
6. T. Starner, A. Pentland, and J. Weaver, "Real-time American sign language recognition using desk and wearable computer based video," PAMI, vol. 20, no. 12, pp. 1371-1375, 1998.
7. J. Suarez and R. R. Murphy, "Hand gesture recognition with depth images: A review," in RO-MAN. IEEE, 2012, pp. 411-417.
8. K. R. Konda, A. Königs, H. Schulz, and D. Schulz, "Real time interaction with mobile robots using hand gestures," in ACM/IEEE HRI, 2012, pp. 177-178.
9. E. Ohn-Bar and M. Trivedi, "Hand gesture recognition in real time for automotive interfaces: A multimodal vision-based approach and evaluations," Intelligent Transportation Systems, IEEE Transactions on, vol. PP, no. 99, pp. 1-10, 2014.
10. J. J. LaViola Jr., "An introduction to 3D gestural interfaces," in SIGGRAPH 2014 Courses, 2014.
11. C. Clemente, A. Balleri, K. Woodbridge, and J. Soraghan, "Developments in target micro-Doppler signatures analysis: radar imaging, ultrasound and through-The-wall radar," EURASIP Journal on Advances in Signal Processing, no. 1, 2013.
12. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems 25, 2012, pp. 1097-1105.
13. D. C. Ciresan, U. Meier, L. M. Gambardella, and J. Schmidhuber, "Deep, big, simple neural nets for handwritten digit recognition," Neural Comput., vol. 22, no. 12, pp. 3207-3220, 2010.
14. N. Neverova, C. Wolf, G. W. Taylor, and F. Nebout, "Multi-scale deep learning for gesture detection and localization," in ECCV ChaLearn Workshop on Looking at People, 2014.
15. S. Escalera, X. Bar, J. Gonzlez, M. A. Bautista, M. Madadi, M. Reyes, V. Ponce, H. J. Escalante, J. Shotton, and I. Guyon, "Chalearn looking at people challenge 2014: Dataset and results," in ECCV ChaLearn Workshop on Looking at People, 2014.
16. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng, "Multimodal deep learning," in Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 689-696.
17. N. Srivastava and R. Salakhutdinov, "Multimodal learning with deep boltzmann machines," in Advances in neural information processing systems, 2012, pp. 2222-2230.
18. S. Gupta, D. Morris, S. Patel, and D. Tan, "Soundwave: using the Doppler effect to sense gestures," in CHI, 2012, pp. 1911-1914.
19. K. Kalgaonkar and B. Raj, "One-handed gesture recognition using ultrasonic Doppler sonar," in ICASSP, 2009, pp. 1889-1892.
20. N. Neverova, C. Wolf, G. Paci, G. Sommavilla, G. W. Taylor, and F. Nebout, "A multi-scale approach to gesture detection and recognition," in Computer Vision Workshops (ICCVW), 2013, pp. 484-491.
21. P. Trindade, J. Lobo, and J. Barreto, "Hand gesture recognition using color and depth images enhanced with hand angular pose data," in Multisensor Fusion and Integration for Intelligent Systems (MFI), 2012 IEEE Conference on, 2012, pp. 71-76.
22. S. B. Wang, A. Quattoni, L. Morency, D. Demirdjian, and T. Darrell, "Hidden conditional random fields for gesture recognition," in CVPR, vol. 2, 2006, pp. 1521-1527.
23. N. Dardas and N. D. Georganas, "Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques," IEEE Transactions on Instrumentation and Measurement, vol. 60, no. 11, pp. 3592-3607, 2011.
24. M. Zobl, R. Nieschulz, M. Geiger, M. Lang, and G. Rigoll, "Gesture components for natural interaction with in-car devices," in Gesture-Based Communication in Human-Computer Interaction. Springer, 2004, pp. 448-459.
25. F. Althoff, R. Lindl, L. Walchshausl, and S. Hoch, "Robust multimodal hand-and head gesture recognition for controlling automotive infotainment systems," VDI BERICHTE, vol. 1919, p. 187, 2005.
26. S. Dura-Bernal, G. Garreau, C. Andreou, A. Andreou, J. Georgiou, T. Wennekers, and S. Denham, "Human action categorization using ultrasound micro-doppler signatures," in Human Behavior Understanding. Springer, 2011, pp. 18-28.
27. J. Woll, "Monopulse Doppler radar for vehicle applications," in Intelligent Vehicles Symposium, 1995, pp. 42-47.
28. I. Lozano Mrmol, "Monopulse range-doppler FMCW radar signal processing for spatial localization of moving targets," Universidad Politcnica de Cartagena, Tech. Rep., 2012.
29. Infineon, "Using BGT24MTR11 in low power applications, 24 GHz Radar," Application Note AN341, Tech. Rep., 2013.
30. H. Rohling, "Radar CFAR thresholding in clutter and multiple target situations," Aerospace and Electronic Systems, IEEE Transactions on, vol. AES-19, no. 4, pp. 608-621, 1983.
31. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio, "Theano: a CPU and GPU math expression compiler," in Python for Scientific Computing Conference (SciPy), 2010.
32. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov, "Improving neural networks by preventing coadaptation of feature detectors," arXiv, 2012.