Real-time sign language letter and word recognition from depth data

Proceedings of the IEEE International Conference on Computer Vision

Volumn , Issue , 2011, Pages 383-390

  Uebersax, Dominique ^a   Gall, Juergen ^a   Van Den Bergh, Michael ^a   Van Gool, Luc ^a,b  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

AMERICAN SIGN LANGUAGE; LETTER RECOGNITION; SIGN LANGUAGE; TRAINING EXAMPLE; WORD RECOGNITION;

IMAGE PROCESSING;

VOCABULARY CONTROL;

EID: 84856675314     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCVW.2011.6130267     Document Type: Conference Paper

References (28)

1. M. Amin and H. Yan. Sign language finger alphabet recognition from gabor-pca representation of hand gestures. In Machine Learning and Cybernetics, 2007.
2. P. Breuer, C. Eckes, and S. M̈uller. Hand gesture recognition with a novel ir time-of-flight range camera: a pilot study. In MIRAGE, pages 247-260. 2007.
3. K. Derpanis, R. Wildes, and J. Tsotsos. Hand gesture recognition within a linguistics-based framework. In European Conference on Computer Vision, pages 282-296, 2004.
4. P. Dreuw, H. Ney, G. Martinez, O. Crasborn, J. Piater, J. M. Moya, and M. Wheatley. The signspeak project-bridging the gap between signers and speakers. In International Conference on Language Resources and Evaluation, 2010.
5. I. Incertis, J. Garcia-Bermejo, and E. Casanova. Hand gesture recognition for deaf people interfacing. In International Conference on Pattern Recognition, pages 100-103, 2006.
6. D. Kelly, J. Mc Donald, and C. Markham. A person independent system for recognition of hand postures used in sign language. Pattern Recognition Letters, 31:1359-1368, 2010.
7. E. Kollorz, J. Penne, J. Hornegger, and A. Barke. Gesture recognition with a time-of-flight camera. International Journal of Intelligent Systems Technologies and Applications, 5:334-343, 2008.
8. H. Lahamy and D. Litchi. Real-time hand gesture recognition using range cameras. In Canadian Geomatics Conference, 2010.
9. Z. Li and R. Jarvis. Real time hand gesture recognition using a range camera. In Australasian Conference on Robotics and Automation, 2009.
10. X. Liu and K. Fujimura. Hand gesture recognition using depth data. In International Conference on Automatic Face and Gesture Recognition, 2004.
11. S. Liwicki and M. Everingham. Automatic recognition of fingerspelled words in british sign language. In IEEE Workshop on CVPR for Human Communicative Behavior Analysis, 2009.
12. R. Lockton and A. W. Fitzgibbon. Real-time gesture recognition using deterministic boosting. In British Machine Vision Conference, 2002.
13. J. Marnik. The polish finger alphabet hand postures recognition using elastic graph matching. In Computer Recognition Systems 2, volume 45 of Advances in Soft Computing, pages 454-461. 2007.
14. Z. Mo and U. Neumann. Real-time hand pose recognition using low-resolution depth images. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1499-1505, 2006.
15. Q. Munib, M. Habeeb, B. Takruri, and H. Al-Malik. American sign language (asl) recognition based on hough transform and neural networks. Expert Systems with Applications, 32(1):24-37, 2007.
16. S. Ong and S. Ranganath. Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(6):873-891, 2005.
17. C. Papageorgiou, M. Oren, and T. Poggio. A general framework for object detection. In International Conference on Computer Vision, pages 555-562, 1998.
18. T. Pei, T. Starner, H. Hamilton, I. Essa, and J. Rehg. Learnung the basic units in american sign language using discriminative segmental feature selection. In IEEE International Conference on Acoustics, Speech and Signal Processing, pages 4757-4760, 2009.
19. J. Penne, S. Soutschek, L. Fedorowicz, and J. Hornegger. Robust real-time 3d time-of-flight based gesture navigation. In International Conference on Automatic Face and Gesture Recognition, 2008.
20. S. Soutschek, J. Penne, J. Hornegger, and J. Kornhuber. 3-d gesture-based scene navigation in medical imaging applications using time-of-flight cameras. In Workshop On Time of Flight Camera based Computer Vision, 2008.
21. T. Starner, J. Weaver, and A. Pentland. Real-time american sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12):1371-1375, 1998.
22. H. Takimoto, S. Yoshimori, Y. Mitsukura, and M. Fukumi. Classification of hand postures based on 3d vision model for human-robot interaction. In International Symposium on Robot and Human Interactive Communication, pages 292-297, 2010.
23. S. Theodorakis, V. Pitsikalis, and P. Maragos. Model-level data-driven sub-units for signs in videos of continuous sign language. In IEEE International Conference on Acoustics, Speech and Signal Processing, pages 2262-2265, 2010.
24. M. Van den Bergh, E. Koller-Meier, and L. Van Gool. Realtime body pose recognition using 2d or 3d haarlets. International Journal of Computer Vision, 83:72-84, 2009.
25. M. Van den Bergh and L. Van Gool. Combining rgb and tof cameras for real-time 3d hand gesture interaction. In IEEE Workshop on Applications of Computer Vision, 2011.
26. F. Wang and C. Zhang. Feature extraction by maximizing the average neighborhood margin. In IEEE Conference on Computer Vision and Pattern Recognition, 2007.
27. H.-D. Yang, S. Sclaroff, and S.-W. Lee. Sign language spotting with a threshold model based on conditional random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(7):1264-1277, 2009.
28. Z. Zafrulla, H. Brashear, H. Hamilton, and T. Starner. A novel approach to american sign language (asl) phrase verification using reversed signing. In IEEE Workshop on CVPR for Human Communicative Behavior Analysis, pages 48-55, 2010.