Exploiting phonological constraints for handshape inference in ASL video

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2011, Pages 521-528

  Thangali, Ashwin ^a   Nash, Joan P ^a   Sclaroff, Stan ^a   Neidle, Carol ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; IMAGE ENHANCEMENT; INFERENCE ENGINES; LINGUISTICS;

AMERICAN SIGN LANGUAGE; IMAGE ALIGNMENT ALGORITHM; INFERENCE ALGORITHM; LINGUISTIC CONSTRAINTS; MODEL PARAMETERS; RECOGNITION ACCURACY; SIGN LANGUAGE RECOGNITION; VARIATIONAL BAYES;

PATTERN RECOGNITION;

EID: 80052870095     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2011.5995718     Document Type: Conference Paper

References (26)

1. J. Alon, V. Athitsos, Q. Yuan, and S. Sclaroff. A unified framework for gesture recognition and spatiotemporal gesture segmentation. PAMI, 31(9):1685-1699, 2009.
2. V. Athitsos, J. Alon, S. Sclaroff, and G. Kollios. BoostMap: An embedding method for efficient nearest neighbor retrieval. PAMI, 30(1):89-104, 2008.
3. V. Athitsos, C. Neidle, S. Sclaroff, J. Nash, A. Stefan, Q. Yuan, and A. Thangali. The American Sign Language lexicon video dataset. In CVPR4HB, 2008.
4. R. Battison. Analyzing variation in language, papers from the Colloquium on New Ways of Analzing Variation, chapter A Good Rule of Thumb: Variable Phonology in American Sign Language, pages 291-301. Georgetown University, 1973.
5. R. Battison. Linguistics of American Sign Language: An introduction, chapter Analyzing Signs, pages 193-212. Gallaudet University Press, 2000.
6. M. Beal. Variational Algorithms for Approximate Bayesian Inference. PhD thesis, Gatsby Computational Neuroscience Unit, University College London, 2003.
7. R. Bowden, D. Windridge, T. Kadir, A. Zisserman, and M. Brady. A linguistic feature vector for the visual interpretation of sign language. In ECCV, 2004.
8. M. Bray, E. Koller-Meier, and L. Van Gool. Smart particle filtering for high-dimensional tracking. CVIU, 106(1):116-129, 2007.
9. P. Buehler, M. Everingham, and A. Zisserman. Learning sign language by watching TV (using weakly aligned subtitles). In CVPR, 2009.
10. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In CVPR, 2005.
11. M. de La Gorce, N. Paragios, and D. J. Fleet. Model-based hand tracking with texture, shading and self-occlusions. In CVPR, 2008.
12. P. Dreuw and H. Ney. Visual modeling and feature adaptation in sign language recognition. In ITG Conference on Speech Communication, 2008.
13. A. Erol, G. Bebis, M. Nicolescu, R. D. Boyle, and X. Twombly. Vision-based hand pose estimation: A review. CVIU, 108:52-73, 2007.
14. A. Farhadi, D. Forsyth, and R. White. Transfer learning in sign language. In CVPR, 2007.
15. H. Fillbrandt, S. Akyol, and K. F. Kraiss. Extraction of 3D hand shape and posture from image sequences for sign language recognition. In Face and Gesture, 2003.
16. F. Jelinek. Statistical methods for speech recognition. The MIT Press, 1997.
17. D. Kwon, K. J. Lee, I. D. Yun, and S. U. Lee. Nonrigid image registration using dynamic higher-order MRF model. In ECCV, 2008.
18. C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. T. Freeman. SIFT flow: Dense correspondence across different scenes. In ECCV, 2008.
19. S. Liwicki and M. Everingham. Automatic recognition of fingerspelled words in british sign language. In CVPR4HB, 2009.
20. C. Neidle. SignStream annotation: Conventions used for the American Sign Language Linguistic Research Project. Technical report, Boston University, Reports No. 11 (2002) and 13 (addendum, 2007).
21. C. Neidle, S. Sclaroff, and V. Athitsos. SignStream: A tool for linguistic and computer vision research on visual-gestural language data. Behavior Research Methods, Instruments, and Computers, 33(3):311-320, 2001.
22. R. Tennant and G. Brown. The American Sign Language Handshape Dictionary. Gallaudet University Press, 2004.
23. A. Thangali and S. Sclaroff. An alignment based similarity measure for hand detection in cluttered sign language video. In CVPR4HB, 2009.
24. C. Valli, editor. The Gallaudet Dictionary of American Sign Language. Gallaudet University Press, 2005.
25. C. Vogler and D. Metaxas. A framework for recognizing the simultaneous aspects of American Sign Language. CVIU, 81:358-384, 2001.
26. R. Yang, S. Sarkar, and B. Loeding. Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming. PAMI, 32, no. 3:462-477, 2010.