Modelling and recognition of the linguistic components in American Sign Language

Image and Vision Computing

Volumn 27, Issue 12, 2009, Pages 1826-1844

  Ding, Liya ^a   Martinez, Aleix M ^a  

^a The Ohio State University   (United States)

Author keywords

American Sign Language; Computer vision; Handshape; Motion reconstruction; Multiple cue recognition

Indexed keywords

COMPUTER VISION; QUERY LANGUAGES; TWO DIMENSIONAL; VIDEO RECORDING;

AMERICAN SIGN LANGUAGE; BASIC BUILDING BLOCK; HANDSHAPE; MOTION RECONSTRUCTION; MULTIPLE CUE RECOGNITION; PATTERN RECOGNITION TECHNIQUES; SEMI-AUTOMATICS; SIGN LANGUAGE; THREE COMPONENT; VIDEO SEQUENCES;

LINGUISTICS;

EID: 70349281706     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2009.02.005     Document Type: Article

References (42)

1. U. von Agris, D. Schneider, J. Zieren, K. Kraiss, Rapid signer adaptation for isolated sign language recognition, in: Proceedings of the IEEE Computer Vision and Pattern Recognition, June 2006, p. 159.
2. O. Aran, I. Ari, A. Benoit, A.H. Carrillo, F.-X. Fanard, P. Campr, L. Akarun, A. Caplier, M. Rombaut, B. Sankur, Sign language tutoring tool. Report in ENTERFACE Workshop, 2006.
3. M.S. Arulampalam, S. Maskell, N. Gordon, T. Clapp, A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking, in: Proceedings of the IEEE Computer Vision and Pattern Recognition, 2008, IEEE Transactions on Signal Processing 50 (2) (2002).
4. Cui Y., and Weng J. Appearance-based hand sign recognition from intensity image sequences. Computer Vision Image Understanding 78 2 (2000) 157-176
5. H. Brashear, V. Henderson, K.-H. Park, H. Hamilton, S. Lee, T. Starner, American sign language recognition in game development for deaf children, in: Proceedings of the Conference on ACM SIGACCESS on Computers and Accessibility, 2006.
6. Brentari D. A Prosodic Model of Sign Language Phonology (2000), MIT Press
7. J.E. Dennis, R.B. Schnabel, Numerical methods for unconstrained optimization and nonlinear equations (classics in applied mathematics), Society for Industrial Mathematics, 1987.
8. L. Ding, A.M. Martinez, Three-dimensional shape and motion reconstruction for the analysis of American sign language, in: Proceedings of the Second IEEE Workshop on Vision for Human Computer Interaction, 2006.
9. L. Ding, A.M. Martinez, Precise detailed detection of faces and facial features, in: Proceedings of the IEEE Computer Vision and Pattern Recognition, 2008.
10. In: Emmorey K., and Reilly J. (Eds). Language, Gesture, and Space (1999), Lawrence Erlbaum, Hillsdale, N.J.
11. G. Fang, W. Gao, A SRN/HMM system for signer-independent continuous sign language recognition, in: Proceedings of the IEEE Automatic Face and Gesture Recognition, 2002.
12. M.L. Gorce, N. Paragios, D.J. Fleet, Model-based hand tracking with texture, shading and self-occlusions, in: Proceedings of the IEEE Computer Vision and Pattern Recognition, 2008.
13. Grunert J.A. Das Pothenotische Problem in erweiterter Gestalt nebst Über seine Anwendungen in der Geodäsie. Grunerts Archiv für Mathematik und Physik. Band 1 (1841) 238-248
14. Haralick R.M., Lee C., Ottenberg K., and Nolle M. Review and analysis of solutions of the three point perspective pose estimation problem. International Journal of Computer Vision 13 3 (1994) 331-356
15. Hartley R., and Zisserman A. Multiple View Geometry in Computer Vision (2003), Cambridge University Press
16. J.L. Hernandez-Rebollar, N. Kyriakopoulos, R.W. Lindeman, A new instrumented approach for translating American sign language into sound and text, in: Proceedings of the IEEE Automatic Face and Gesture Recognition, 2004.
17. K. Imagawa, H. Matsuo, R.-i. Taniguchi, D. Arita, S. Lu, S. Igi, Recognition of local features for camera-based sign language recognition system, in: Proceedings of the IEEE Pattern Recognition, vol. 4, 2000, pp. 849-853.
18. Jacobs D.W. Linear fitting with missing data for structure-from-motion computer. Vision and Image Understanding 82 1 (2001) 57-81
19. H. Jia, A.M. Martinez, Low-rank matrix fitting based on subspace perturbation analysis with applications to structure from motion, IEEE Transactions on Pattern Analysis and Machine Intelligence 31(2) (2009) 841-854.
20. R.-H. Liang, M. Ouhyoung, A real-time continuous gesture recognition system for sign languagem, in: Proceedings of the IEEE Automatic Face and Gesture Recognition, 1998, pp. 558-565.
21. Lichtenauer J., Hendriks E., and Reinders M. Sign language recognition by combining statistical DTW and independent classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 11 (2008) 2040-2046
22. A.M. Martinez, R.B. Wilbur, R. Shay, A.C. Kak, The Purdue ASL database for the recognition of american sign language, in: Proceedings of the IEEE Multimodal Interfaces, Pittsburgh, PA, November 2002.
23. Martinez A.M., and Zhu M. Where are linear feature extraction methods applicable?. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 12 (2005) 1934-1944
24. Messing M.S., and Campbell R. Gesture, Speech, and Sign (1999), Oxford University Press
25. S. Nayak, S. Sarkar, B. Loeding, Distribution-based dimensionality reduction applied to articulated motion recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence 31(2) (2009) 795-810.
26. Ong S.C.W., and Ranganath S. Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 6 (2005)
27. Starner T., and Pentland A. Real-time American sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 12 (1998)
28. Stoke W.C. Sign language structure: an outline of the visual communication systems of the American deaf. Journal of Deaf Studies and Deaf Education 10 1 (2005)
29. Stoke W.C., Casterline D.C., and Croneberg C.G. A Dictionary of American Sign Language on Linguistic Principles (1976), Linstok Press
30. Su M.-C. A fuzzy rule-based approach to spatio-temporal hand gesture recognition. IEEE Transactions on Systems, Man, and Cybernetics. Part C: Applications and Reviews 30 2 (2000) 276-281
31. Tamura S., and Kawasaki S. Recognition of sign language motion images. Pattern Recognition 21 4 (1988) 343-353
32. N. Tanibata, N. Shimada, Y. Shirai, Extraction of hand features for recognition of sign language words, in: Proceedings of the International Conference on Vision Interface, 2002, pp. 391-398.
33. P. Vamplew, A. Adams, Recognition of sign language gestures using neural networks, Neuropsychological Trends (1) (2007) 31-41.
34. C. Vogler, American sign language recognition: reducing the complexity of the task with phoneme-based modeling and parallel hidden markov models. Ph.D. thesis, University of Pennsylvania, 2003.
35. Wang J., Athitsos V., Sclaroff S., and Betke M. Detecting objects of variable shape structure with hidden state shape models. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 3 (2008) 477-492
36. Wilbur R.B. American Sign Language: Linguistic and Applied Dimensions. second ed. (1987), Little, Brown, Boston
37. Wilbur R.B., and Martinez A.M. Physical Correlates of Prosodic Structure in American Sign Language vol. 38 (2002), Chicago Linguistic Society
38. N. Kuhn, T.A. Ciciliani, R.B. Wilbur, Phonological parameters in Croatian Sign Language, Sign Language & Linguistics 9(1-2) (2006) 33-70.
39. Yang M., Ahuja N., and Tabb M. Extraction of 2D motion trajectories and its application to hand gesture recognition. IEEE Transactions on Pattern Analysis Machine Intelligence 24 8 (2002) 1061-1074
40. R. Yang, S. Sarkar, B. Loeding, Enhanced level building algorithm for the movement epenthesis problem in sign language recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2007.
41. J. Ye, H. Yao, F. Jiang, Based on HMM and SVM multilayer architecture classifier for chinese sign language recognition with large vocabulary, in: Proceedings of the IEEE International Conference on Image and Graphics, 2004.
42. Zhu M., and Martinez A.M. Pruning noisy bases in discriminant analysis. IEEE Transactions on Neural Networks 19 1 (2008) 148-157